2023-12-22T09:44:11.065 INFO:root:teuthology version: 0.0.1.dev226+g9680d2a 2023-12-22T09:44:11.066 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_rishabh@teuthology --name rishabh-2023-12-22_08:19:05-fs-rishabh-mdscap-pacific-testing-default-smithi --archive /home/teuthworker/archive/rishabh-2023-12-22_08:19:05-fs-rishabh-mdscap-pacific-testing-default-smithi/7499495 --description fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/alternate-pool} --verbose -- /home/teuthworker/archive/rishabh-2023-12-22_08:19:05-fs-rishabh-mdscap-pacific-testing-default-smithi/7499495/orig.config.yaml 2023-12-22T09:44:11.108 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T09:44:11.189 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2023-12-22_08:19:05-fs-rishabh-mdscap-pacific-testing-default-smithi/7499495 branch: rishabh-mdscap-pacific description: fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/alternate-pool} email: null first_in_suite: false job_id: '7499495' kernel: flavor: default kdb: true sha1: 623393c9d50c04c7ea1d88824b8e92712e3e5611 last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: rishabh-2023-12-22_08:19:05-fs-rishabh-mdscap-pacific-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: rishabh-mdscap-pacific ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - bad backtrace - object missing on disk - error reading table object - error reading sessionmap - unmatched fragstat - unmatched rstat - was unreadable, recreating it now - Scrub error on inode - Metadata damage detected - MDS_FAILED - MDS_DAMAGE sha1: 4ab91a455dc86ea102fdfa1407dbcce323929634 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 4ab91a455dc86ea102fdfa1407dbcce323929634 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: rishabh-mdscap-pacific sha1: 4ab91a455dc86ea102fdfa1407dbcce323929634 owner: scheduled_rishabh@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 405 sha1: 4ab91a455dc86ea102fdfa1407dbcce323929634 sleep_before_teardown: 0 subset: 293/512 suite: fs suite_branch: rishabh-mdscap-pacific suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_4ab91a455dc86ea102fdfa1407dbcce323929634/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 4ab91a455dc86ea102fdfa1407dbcce323929634 targets: smithi045.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= smithi113.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - ceph-fuse: null - cephfs_test_runner: modules: - tasks.cephfs.test_recovery_pool teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 9680d2aba1e76f64ade295c81599c97907457848 timestamp: 2023-12-22_08:19:05 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.1485078 2023-12-22T09:44:11.189 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_4ab91a455dc86ea102fdfa1407dbcce323929634/qa; will attempt to use it 2023-12-22T09:44:11.190 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_4ab91a455dc86ea102fdfa1407dbcce323929634/qa/tasks 2023-12-22T09:44:11.190 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-12-22T09:44:11.191 INFO:teuthology.task.internal:Checking packages... 2023-12-22T09:44:11.216 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '4ab91a455dc86ea102fdfa1407dbcce323929634' 2023-12-22T09:44:11.216 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-22T09:44:11.217 INFO:teuthology.packaging:ref: None 2023-12-22T09:44:11.217 INFO:teuthology.packaging:tag: None 2023-12-22T09:44:11.217 INFO:teuthology.packaging:branch: rishabh-mdscap-pacific 2023-12-22T09:44:11.217 INFO:teuthology.packaging:sha1: 4ab91a455dc86ea102fdfa1407dbcce323929634 2023-12-22T09:44:11.217 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=rishabh-mdscap-pacific 2023-12-22T09:44:11.358 INFO:teuthology.task.internal:Found packages for ceph version 16.2.14-395-g4ab91a45-1focal 2023-12-22T09:44:11.359 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-12-22T09:44:11.366 INFO:teuthology.task.internal:no buildpackages task found 2023-12-22T09:44:11.366 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-12-22T09:44:11.379 INFO:teuthology.task.internal:Saving configuration 2023-12-22T09:44:11.395 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-12-22T09:44:11.403 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-22T09:44:11.423 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi045.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-22_08:19:05-fs-rishabh-mdscap-pacific-testing-default-smithi/7499495', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-22 09:37:35.888859', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-12-22T09:44:11.444 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi113.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-22_08:19:05-fs-rishabh-mdscap-pacific-testing-default-smithi/7499495', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-22 09:37:35.887459', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-12-22T09:44:11.444 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-12-22T09:44:11.453 INFO:teuthology.task.internal:roles: ubuntu@smithi045.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-12-22T09:44:11.453 INFO:teuthology.task.internal:roles: ubuntu@smithi113.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-12-22T09:44:11.453 INFO:teuthology.run_tasks:Running task console_log... 2023-12-22T09:44:11.530 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f02dffd6ca0>, signals=[15]) 2023-12-22T09:44:11.531 INFO:teuthology.run_tasks:Running task internal.connect... 2023-12-22T09:44:11.542 INFO:teuthology.task.internal:Opening connections... 2023-12-22T09:44:11.542 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi045.front.sepia.ceph.com 2023-12-22T09:44:11.543 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T09:44:11.593 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi113.front.sepia.ceph.com 2023-12-22T09:44:11.594 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T09:44:11.642 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-12-22T09:44:11.652 DEBUG:teuthology.orchestra.run.smithi045:> uname -m 2023-12-22T09:44:11.674 INFO:teuthology.orchestra.run.smithi045.stdout:x86_64 2023-12-22T09:44:11.674 DEBUG:teuthology.orchestra.run.smithi045:> cat /etc/os-release 2023-12-22T09:44:11.722 INFO:teuthology.orchestra.run.smithi045.stdout:NAME="Ubuntu" 2023-12-22T09:44:11.723 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-12-22T09:44:11.723 INFO:teuthology.orchestra.run.smithi045.stdout:ID=ubuntu 2023-12-22T09:44:11.723 INFO:teuthology.orchestra.run.smithi045.stdout:ID_LIKE=debian 2023-12-22T09:44:11.723 INFO:teuthology.orchestra.run.smithi045.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-12-22T09:44:11.723 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION_ID="20.04" 2023-12-22T09:44:11.723 INFO:teuthology.orchestra.run.smithi045.stdout:HOME_URL="https://www.ubuntu.com/" 2023-12-22T09:44:11.723 INFO:teuthology.orchestra.run.smithi045.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-12-22T09:44:11.723 INFO:teuthology.orchestra.run.smithi045.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-12-22T09:44:11.723 INFO:teuthology.orchestra.run.smithi045.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-12-22T09:44:11.723 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION_CODENAME=focal 2023-12-22T09:44:11.724 INFO:teuthology.orchestra.run.smithi045.stdout:UBUNTU_CODENAME=focal 2023-12-22T09:44:11.725 INFO:teuthology.lock.ops:Updating smithi045.front.sepia.ceph.com on lock server 2023-12-22T09:44:11.828 DEBUG:teuthology.orchestra.run.smithi113:> uname -m 2023-12-22T09:44:11.835 INFO:teuthology.orchestra.run.smithi113.stdout:x86_64 2023-12-22T09:44:11.835 DEBUG:teuthology.orchestra.run.smithi113:> cat /etc/os-release 2023-12-22T09:44:11.884 INFO:teuthology.orchestra.run.smithi113.stdout:NAME="Ubuntu" 2023-12-22T09:44:11.884 INFO:teuthology.orchestra.run.smithi113.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-12-22T09:44:11.884 INFO:teuthology.orchestra.run.smithi113.stdout:ID=ubuntu 2023-12-22T09:44:11.884 INFO:teuthology.orchestra.run.smithi113.stdout:ID_LIKE=debian 2023-12-22T09:44:11.884 INFO:teuthology.orchestra.run.smithi113.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-12-22T09:44:11.884 INFO:teuthology.orchestra.run.smithi113.stdout:VERSION_ID="20.04" 2023-12-22T09:44:11.884 INFO:teuthology.orchestra.run.smithi113.stdout:HOME_URL="https://www.ubuntu.com/" 2023-12-22T09:44:11.885 INFO:teuthology.orchestra.run.smithi113.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-12-22T09:44:11.885 INFO:teuthology.orchestra.run.smithi113.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-12-22T09:44:11.885 INFO:teuthology.orchestra.run.smithi113.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-12-22T09:44:11.885 INFO:teuthology.orchestra.run.smithi113.stdout:VERSION_CODENAME=focal 2023-12-22T09:44:11.885 INFO:teuthology.orchestra.run.smithi113.stdout:UBUNTU_CODENAME=focal 2023-12-22T09:44:11.885 INFO:teuthology.lock.ops:Updating smithi113.front.sepia.ceph.com on lock server 2023-12-22T09:44:11.911 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-12-22T09:44:11.920 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-12-22T09:44:11.932 INFO:teuthology.task.internal:Checking for old test directory... 2023-12-22T09:44:11.932 DEBUG:teuthology.orchestra.run.smithi045:> test '!' -e /home/ubuntu/cephtest 2023-12-22T09:44:11.935 DEBUG:teuthology.orchestra.run.smithi113:> test '!' -e /home/ubuntu/cephtest 2023-12-22T09:44:11.940 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-12-22T09:44:11.950 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-12-22T09:44:11.951 DEBUG:teuthology.orchestra.run.smithi045:> test -z $(ls -A /var/lib/ceph) 2023-12-22T09:44:11.953 DEBUG:teuthology.orchestra.run.smithi113:> test -z $(ls -A /var/lib/ceph) 2023-12-22T09:44:11.976 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-12-22T09:44:12.035 INFO:teuthology.run_tasks:Running task kernel... 2023-12-22T09:44:12.057 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': '623393c9d50c04c7ea1d88824b8e92712e3e5611'} 2023-12-22T09:44:12.057 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': True, 'sha1': '623393c9d50c04c7ea1d88824b8e92712e3e5611'}, 'mon.b': {'flavor': 'default', 'kdb': True, 'sha1': '623393c9d50c04c7ea1d88824b8e92712e3e5611'}}, timeout 300 2023-12-22T09:44:12.057 DEBUG:teuthology.orchestra.run.smithi045:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-22T09:44:12.058 DEBUG:teuthology.orchestra.run.smithi113:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-22T09:44:12.063 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-22T09:44:12.063 DEBUG:teuthology.task.kernel:sha1 for mon.a is 623393c9d50c04c7ea1d88824b8e92712e3e5611 2023-12-22T09:44:12.063 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "623393c9d50c04c7ea1d88824b8e92712e3e5611"... 2023-12-22T09:44:12.063 DEBUG:teuthology.orchestra.run.smithi045:> uname -r 2023-12-22T09:44:12.065 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-22T09:44:12.066 DEBUG:teuthology.task.kernel:sha1 for mon.b is 623393c9d50c04c7ea1d88824b8e92712e3e5611 2023-12-22T09:44:12.066 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "623393c9d50c04c7ea1d88824b8e92712e3e5611"... 2023-12-22T09:44:12.066 DEBUG:teuthology.orchestra.run.smithi113:> uname -r 2023-12-22T09:44:12.072 INFO:teuthology.orchestra.run.smithi045.stdout:5.4.0-124-generic 2023-12-22T09:44:12.072 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-124-generic vs 623393c9d50c04c7ea1d88824b8e92712e3e5611 2023-12-22T09:44:12.072 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-12-22T09:44:12.072 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=623393c9d50c04c7ea1d88824b8e92712e3e5611 2023-12-22T09:44:12.076 INFO:teuthology.orchestra.run.smithi113.stdout:5.4.0-124-generic 2023-12-22T09:44:12.076 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-124-generic vs 623393c9d50c04c7ea1d88824b8e92712e3e5611 2023-12-22T09:44:12.076 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-12-22T09:44:12.077 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=623393c9d50c04c7ea1d88824b8e92712e3e5611 2023-12-22T09:44:12.225 INFO:teuthology.task.kernel:Installing linux-firmware on mon.b... 2023-12-22T09:44:12.226 DEBUG:teuthology.orchestra.run.smithi113:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-12-22T09:44:12.242 INFO:teuthology.orchestra.run.smithi113.stderr:bash: line 0: cd: /lib/firmware/updates: No such file or directory 2023-12-22T09:44:12.318 INFO:teuthology.task.kernel:Installing linux-firmware on mon.a... 2023-12-22T09:44:12.318 DEBUG:teuthology.orchestra.run.smithi045:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-12-22T09:44:12.353 INFO:teuthology.orchestra.run.smithi045.stderr:bash: line 0: cd: /lib/firmware/updates: No such file or directory 2023-12-22T09:44:12.356 INFO:teuthology.orchestra.run.smithi113.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-12-22T09:44:12.358 DEBUG:teuthology.orchestra.run.smithi113:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-12-22T09:44:12.440 DEBUG:teuthology.orchestra.run.smithi113:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-12-22T09:44:12.458 DEBUG:teuthology.orchestra.run.smithi113:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-12-22T09:44:12.474 INFO:teuthology.orchestra.run.smithi045.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-12-22T09:44:12.476 DEBUG:teuthology.orchestra.run.smithi045:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-12-22T09:44:12.551 DEBUG:teuthology.orchestra.run.smithi045:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-12-22T09:44:12.569 DEBUG:teuthology.orchestra.run.smithi045:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-12-22T09:44:56.922 INFO:teuthology.orchestra.run.smithi113.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-12-22T09:44:56.922 INFO:teuthology.orchestra.run.smithi113.stderr: * [new branch] main -> origin/main 2023-12-22T09:44:56.978 INFO:teuthology.orchestra.run.smithi113.stderr: * [new tag] 20190312 -> 20190312 2023-12-22T09:44:56.978 INFO:teuthology.orchestra.run.smithi113.stderr: * [new tag] 20190416 -> 20190416 2023-12-22T09:44:56.978 INFO:teuthology.orchestra.run.smithi113.stderr: * [new tag] 20190514 -> 20190514 2023-12-22T09:44:56.978 INFO:teuthology.orchestra.run.smithi113.stderr: * [new tag] 20190618 -> 20190618 2023-12-22T09:44:56.978 INFO:teuthology.orchestra.run.smithi113.stderr: * [new tag] 20190717 -> 20190717 2023-12-22T09:44:56.978 INFO:teuthology.orchestra.run.smithi113.stderr: * [new tag] 20190815 -> 20190815 2023-12-22T09:44:56.978 INFO:teuthology.orchestra.run.smithi113.stderr: * [new tag] 20190923 -> 20190923 2023-12-22T09:44:56.978 INFO:teuthology.orchestra.run.smithi113.stderr: * [new tag] 20191022 -> 20191022 2023-12-22T09:44:56.980 INFO:teuthology.orchestra.run.smithi113.stderr: * [new tag] 20191215 -> 20191215 2023-12-22T09:44:56.980 INFO:teuthology.orchestra.run.smithi113.stderr: * [new tag] 20200122 -> 20200122 2023-12-22T09:44:56.980 INFO:teuthology.orchestra.run.smithi113.stderr: * [new tag] 20200316 -> 20200316 2023-12-22T09:44:56.980 INFO:teuthology.orchestra.run.smithi113.stderr: * [new tag] 20200421 -> 20200421 2023-12-22T09:44:56.980 INFO:teuthology.orchestra.run.smithi113.stderr: * [new tag] 20200519 -> 20200519 2023-12-22T09:44:56.980 INFO:teuthology.orchestra.run.smithi113.stderr: * [new tag] 20200619 -> 20200619 2023-12-22T09:44:56.980 INFO:teuthology.orchestra.run.smithi113.stderr: * [new tag] 20200721 -> 20200721 2023-12-22T09:44:56.981 INFO:teuthology.orchestra.run.smithi113.stderr: * [new tag] 20200817 -> 20200817 2023-12-22T09:44:56.981 INFO:teuthology.orchestra.run.smithi113.stderr: * [new tag] 20200918 -> 20200918 2023-12-22T09:44:56.981 INFO:teuthology.orchestra.run.smithi113.stderr: * [new tag] 20201022 -> 20201022 2023-12-22T09:44:56.981 INFO:teuthology.orchestra.run.smithi113.stderr: * [new tag] 20201118 -> 20201118 2023-12-22T09:44:56.981 INFO:teuthology.orchestra.run.smithi113.stderr: * [new tag] 20201218 -> 20201218 2023-12-22T09:44:56.981 INFO:teuthology.orchestra.run.smithi113.stderr: * [new tag] 20210208 -> 20210208 2023-12-22T09:44:56.981 INFO:teuthology.orchestra.run.smithi113.stderr: * [new tag] 20210315 -> 20210315 2023-12-22T09:44:56.981 INFO:teuthology.orchestra.run.smithi113.stderr: * [new tag] 20210511 -> 20210511 2023-12-22T09:44:56.981 INFO:teuthology.orchestra.run.smithi113.stderr: * [new tag] 20210716 -> 20210716 2023-12-22T09:44:56.984 INFO:teuthology.orchestra.run.smithi113.stderr: * [new tag] 20210818 -> 20210818 2023-12-22T09:44:56.984 INFO:teuthology.orchestra.run.smithi113.stderr: * [new tag] 20210919 -> 20210919 2023-12-22T09:44:56.984 INFO:teuthology.orchestra.run.smithi113.stderr: * [new tag] 20211027 -> 20211027 2023-12-22T09:44:56.984 INFO:teuthology.orchestra.run.smithi113.stderr: * [new tag] 20211216 -> 20211216 2023-12-22T09:44:56.984 INFO:teuthology.orchestra.run.smithi113.stderr: * [new tag] 20220209 -> 20220209 2023-12-22T09:44:56.984 INFO:teuthology.orchestra.run.smithi113.stderr: * [new tag] 20220310 -> 20220310 2023-12-22T09:44:56.984 INFO:teuthology.orchestra.run.smithi113.stderr: * [new tag] 20220411 -> 20220411 2023-12-22T09:44:56.985 INFO:teuthology.orchestra.run.smithi113.stderr: * [new tag] 20220509 -> 20220509 2023-12-22T09:44:56.985 INFO:teuthology.orchestra.run.smithi113.stderr: * [new tag] 20220610 -> 20220610 2023-12-22T09:44:56.985 INFO:teuthology.orchestra.run.smithi113.stderr: * [new tag] 20220708 -> 20220708 2023-12-22T09:44:56.985 INFO:teuthology.orchestra.run.smithi113.stderr: * [new tag] 20220815 -> 20220815 2023-12-22T09:44:56.985 INFO:teuthology.orchestra.run.smithi113.stderr: * [new tag] 20220913 -> 20220913 2023-12-22T09:44:56.985 INFO:teuthology.orchestra.run.smithi113.stderr: * [new tag] 20221012 -> 20221012 2023-12-22T09:44:56.985 INFO:teuthology.orchestra.run.smithi113.stderr: * [new tag] 20221109 -> 20221109 2023-12-22T09:44:56.985 INFO:teuthology.orchestra.run.smithi113.stderr: * [new tag] 20221214 -> 20221214 2023-12-22T09:44:56.985 INFO:teuthology.orchestra.run.smithi113.stderr: * [new tag] 20230117 -> 20230117 2023-12-22T09:44:56.986 INFO:teuthology.orchestra.run.smithi113.stderr: * [new tag] 20230210 -> 20230210 2023-12-22T09:44:56.986 INFO:teuthology.orchestra.run.smithi113.stderr: * [new tag] 20230310 -> 20230310 2023-12-22T09:44:56.986 INFO:teuthology.orchestra.run.smithi113.stderr: * [new tag] 20230404 -> 20230404 2023-12-22T09:44:56.986 INFO:teuthology.orchestra.run.smithi113.stderr: * [new tag] 20230515 -> 20230515 2023-12-22T09:44:56.986 INFO:teuthology.orchestra.run.smithi113.stderr: * [new tag] 20230625 -> 20230625 2023-12-22T09:44:56.986 INFO:teuthology.orchestra.run.smithi113.stderr: * [new tag] 20230804 -> 20230804 2023-12-22T09:44:56.986 INFO:teuthology.orchestra.run.smithi113.stderr: * [new tag] 20230919 -> 20230919 2023-12-22T09:44:56.986 INFO:teuthology.orchestra.run.smithi113.stderr: * [new tag] 20231030 -> 20231030 2023-12-22T09:44:56.986 INFO:teuthology.orchestra.run.smithi113.stderr: * [new tag] 20231111 -> 20231111 2023-12-22T09:44:56.986 INFO:teuthology.orchestra.run.smithi113.stderr: * [new tag] 20231211 -> 20231211 2023-12-22T09:45:00.932 INFO:teuthology.orchestra.run.smithi113.stderr:Updating files: 51% (1691/3256) Updating files: 52% (1694/3256) Updating files: 53% (1726/3256) Updating files: 54% (1759/3256) Updating files: 55% (1791/3256) Updating files: 56% (1824/3256) Updating files: 57% (1856/3256) Updating files: 58% (1889/3256) Updating files: 59% (1922/3256) Updating files: 60% (1954/3256) Updating files: 61% (1987/3256) Updating files: 62% (2019/3256) Updating files: 63% (2052/3256) Updating files: 64% (2084/3256) Updating files: 65% (2117/3256) Updating files: 65% (2130/3256) Updating files: 66% (2149/3256) Updating files: 67% (2182/3256) Updating files: 68% (2215/3256) Updating files: 69% (2247/3256) Updating files: 70% (2280/3256) Updating files: 71% (2312/3256) Updating files: 72% (2345/3256) Updating files: 73% (2377/3256) Updating files: 74% (2410/3256) Updating files: 75% (2442/3256) Updating files: 76% (2475/3256) Updating files: 77% (2508/3256) Updating files: 78% (2540/3256) Updating files: 79% (2573/3256) Updating files: 80% (2605/3256) Updating files: 81% (2638/3256) Updating files: 81% (2659/3256) Updating files: 82% (2670/3256) Updating files: 83% (2703/3256) Updating files: 84% (2736/3256) Updating files: 85% (2768/3256) Updating files: 86% (2801/3256) Updating files: 87% (2833/3256) Updating files: 88% (2866/3256) Updating files: 89% (2898/3256) Updating files: 90% (2931/3256) Updating files: 91% (2963/3256) Updating files: 92% (2996/3256) Updating files: 93% (3029/3256) Updating files: 94% (3061/3256) Updating files: 95% (3094/3256) Updating files: 96% (3126/3256) Updating files: 97% (3159/3256) Updating files: 98% (3191/3256) Updating files: 99% (3224/3256) Updating files: 100% (3256/3256) Updating files: 100% (3256/3256), done. 2023-12-22T09:45:00.937 INFO:teuthology.orchestra.run.smithi113.stdout:HEAD is now at c156e6be Merge branch 'robot/pr-0-1702625169' into 'main' 2023-12-22T09:45:00.954 INFO:teuthology.task.kernel:Downloading kernel 623393c9d50c04c7ea1d88824b8e92712e3e5611 on mon.b... 2023-12-22T09:45:00.955 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=623393c9d50c04c7ea1d88824b8e92712e3e5611 2023-12-22T09:45:01.175 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/623393c9d50c04c7ea1d88824b8e92712e3e5611/ubuntu/focal/flavors/default/pool/main/l/linux-6.6.0-g623393c9d50c/ 2023-12-22T09:45:01.175 DEBUG:teuthology.orchestra.run.smithi113:> rm -f /tmp/linux-image.deb && echo linux-image-6.6.0-g623393c9d50c_6.6.0-g623393c9d50c-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://4.chacra.ceph.com/r/kernel/testing/623393c9d50c04c7ea1d88824b8e92712e3e5611/ubuntu/focal/flavors/default/pool/main/l/linux-6.6.0-g623393c9d50c/ --input-file=- 2023-12-22T09:45:01.177 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi113.front.sepia.ceph.com to complete... 2023-12-22T09:45:02.669 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22 09:45:02 URL:https://4.chacra.ceph.com/r/kernel/testing/623393c9d50c04c7ea1d88824b8e92712e3e5611/ubuntu/focal/flavors/default/pool/main/l/linux-6.6.0-g623393c9d50c/linux-image-6.6.0-g623393c9d50c_6.6.0-g623393c9d50c-1_amd64.deb [38936568/38936568] -> "/tmp/linux-image.deb" [1] 2023-12-22T09:45:02.669 INFO:teuthology.orchestra.run.smithi113.stderr:FINISHED --2023-12-22 09:45:02-- 2023-12-22T09:45:02.669 INFO:teuthology.orchestra.run.smithi113.stderr:Total wall clock time: 1.5s 2023-12-22T09:45:02.669 INFO:teuthology.orchestra.run.smithi113.stderr:Downloaded: 1 files, 37M in 1.4s (27.4 MB/s) 2023-12-22T09:45:02.672 INFO:teuthology.task.kernel:Installing kernel 623393c9d50c04c7ea1d88824b8e92712e3e5611 on mon.b... 2023-12-22T09:45:02.672 DEBUG:teuthology.orchestra.run.smithi113:> sudo dpkg -i /tmp/linux-image.deb 2023-12-22T09:45:02.945 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package linux-image-6.6.0-g623393c9d50c. 2023-12-22T09:45:04.582 INFO:teuthology.orchestra.run.smithi045.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-12-22T09:45:04.583 INFO:teuthology.orchestra.run.smithi045.stderr: * [new branch] main -> origin/main 2023-12-22T09:45:04.645 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20190312 -> 20190312 2023-12-22T09:45:04.645 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20190416 -> 20190416 2023-12-22T09:45:04.645 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20190514 -> 20190514 2023-12-22T09:45:04.645 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20190618 -> 20190618 2023-12-22T09:45:04.645 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20190717 -> 20190717 2023-12-22T09:45:04.645 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20190815 -> 20190815 2023-12-22T09:45:04.645 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20190923 -> 20190923 2023-12-22T09:45:04.645 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20191022 -> 20191022 2023-12-22T09:45:04.645 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20191215 -> 20191215 2023-12-22T09:45:04.645 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20200122 -> 20200122 2023-12-22T09:45:04.645 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20200316 -> 20200316 2023-12-22T09:45:04.646 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20200421 -> 20200421 2023-12-22T09:45:04.646 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20200519 -> 20200519 2023-12-22T09:45:04.646 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20200619 -> 20200619 2023-12-22T09:45:04.646 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20200721 -> 20200721 2023-12-22T09:45:04.646 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20200817 -> 20200817 2023-12-22T09:45:04.646 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20200918 -> 20200918 2023-12-22T09:45:04.646 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20201022 -> 20201022 2023-12-22T09:45:04.646 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20201118 -> 20201118 2023-12-22T09:45:04.646 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20201218 -> 20201218 2023-12-22T09:45:04.648 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20210208 -> 20210208 2023-12-22T09:45:04.648 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20210315 -> 20210315 2023-12-22T09:45:04.648 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20210511 -> 20210511 2023-12-22T09:45:04.648 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20210716 -> 20210716 2023-12-22T09:45:04.648 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20210818 -> 20210818 2023-12-22T09:45:04.648 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20210919 -> 20210919 2023-12-22T09:45:04.648 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20211027 -> 20211027 2023-12-22T09:45:04.648 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20211216 -> 20211216 2023-12-22T09:45:04.648 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20220209 -> 20220209 2023-12-22T09:45:04.649 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20220310 -> 20220310 2023-12-22T09:45:04.651 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20220411 -> 20220411 2023-12-22T09:45:04.651 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20220509 -> 20220509 2023-12-22T09:45:04.651 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20220610 -> 20220610 2023-12-22T09:45:04.651 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20220708 -> 20220708 2023-12-22T09:45:04.651 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20220815 -> 20220815 2023-12-22T09:45:04.651 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20220913 -> 20220913 2023-12-22T09:45:04.651 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20221012 -> 20221012 2023-12-22T09:45:04.651 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20221109 -> 20221109 2023-12-22T09:45:04.651 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20221214 -> 20221214 2023-12-22T09:45:04.651 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20230117 -> 20230117 2023-12-22T09:45:04.651 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20230210 -> 20230210 2023-12-22T09:45:04.651 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20230310 -> 20230310 2023-12-22T09:45:04.651 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20230404 -> 20230404 2023-12-22T09:45:04.651 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20230515 -> 20230515 2023-12-22T09:45:04.652 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20230625 -> 20230625 2023-12-22T09:45:04.652 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20230804 -> 20230804 2023-12-22T09:45:04.652 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20230919 -> 20230919 2023-12-22T09:45:04.652 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20231030 -> 20231030 2023-12-22T09:45:04.652 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20231111 -> 20231111 2023-12-22T09:45:04.652 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20231211 -> 20231211 2023-12-22T09:45:04.689 INFO:teuthology.orchestra.run.smithi113.stdout:(Reading database ... 104373 files and directories currently installed.) 2023-12-22T09:45:04.694 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-12-22T09:45:04.794 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking linux-image-6.6.0-g623393c9d50c (6.6.0-g623393c9d50c-1) ... 2023-12-22T09:45:07.680 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up linux-image-6.6.0-g623393c9d50c (6.6.0-g623393c9d50c-1) ... 2023-12-22T09:45:07.803 INFO:teuthology.orchestra.run.smithi113.stderr:update-initramfs: Generating /boot/initrd.img-6.6.0-g623393c9d50c 2023-12-22T09:45:08.821 INFO:teuthology.orchestra.run.smithi045.stderr:Updating files: 49% (1602/3256) Updating files: 50% (1628/3256) Updating files: 51% (1661/3256) Updating files: 52% (1694/3256) Updating files: 53% (1726/3256) Updating files: 54% (1759/3256) Updating files: 55% (1791/3256) Updating files: 56% (1824/3256) Updating files: 57% (1856/3256) Updating files: 58% (1889/3256) Updating files: 59% (1922/3256) Updating files: 60% (1954/3256) Updating files: 61% (1987/3256) Updating files: 62% (2019/3256) Updating files: 63% (2052/3256) Updating files: 63% (2083/3256) Updating files: 64% (2084/3256) Updating files: 65% (2117/3256) Updating files: 66% (2149/3256) Updating files: 67% (2182/3256) Updating files: 68% (2215/3256) Updating files: 69% (2247/3256) Updating files: 70% (2280/3256) Updating files: 71% (2312/3256) Updating files: 72% (2345/3256) Updating files: 73% (2377/3256) Updating files: 74% (2410/3256) Updating files: 75% (2442/3256) Updating files: 76% (2475/3256) Updating files: 77% (2508/3256) Updating files: 78% (2540/3256) Updating files: 79% (2573/3256) Updating files: 80% (2605/3256) Updating files: 81% (2638/3256) Updating files: 81% (2647/3256) Updating files: 82% (2670/3256) Updating files: 83% (2703/3256) Updating files: 84% (2736/3256) Updating files: 85% (2768/3256) Updating files: 86% (2801/3256) Updating files: 87% (2833/3256) Updating files: 88% (2866/3256) Updating files: 89% (2898/3256) Updating files: 90% (2931/3256) Updating files: 91% (2963/3256) Updating files: 92% (2996/3256) Updating files: 92% (3004/3256) Updating files: 93% (3029/3256) Updating files: 94% (3061/3256) Updating files: 95% (3094/3256) Updating files: 96% (3126/3256) Updating files: 97% (3159/3256) Updating files: 98% (3191/3256) Updating files: 99% (3224/3256) Updating files: 100% (3256/3256) Updating files: 100% (3256/3256), done. 2023-12-22T09:45:08.823 INFO:teuthology.orchestra.run.smithi045.stdout:HEAD is now at c156e6be Merge branch 'robot/pr-0-1702625169' into 'main' 2023-12-22T09:45:08.842 INFO:teuthology.task.kernel:Downloading kernel 623393c9d50c04c7ea1d88824b8e92712e3e5611 on mon.a... 2023-12-22T09:45:08.842 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=623393c9d50c04c7ea1d88824b8e92712e3e5611 2023-12-22T09:45:09.061 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/623393c9d50c04c7ea1d88824b8e92712e3e5611/ubuntu/focal/flavors/default/pool/main/l/linux-6.6.0-g623393c9d50c/ 2023-12-22T09:45:09.061 DEBUG:teuthology.orchestra.run.smithi045:> rm -f /tmp/linux-image.deb && echo linux-image-6.6.0-g623393c9d50c_6.6.0-g623393c9d50c-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://4.chacra.ceph.com/r/kernel/testing/623393c9d50c04c7ea1d88824b8e92712e3e5611/ubuntu/focal/flavors/default/pool/main/l/linux-6.6.0-g623393c9d50c/ --input-file=- 2023-12-22T09:45:09.064 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi045.front.sepia.ceph.com to complete... 2023-12-22T09:45:10.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22 09:45:10 URL:https://4.chacra.ceph.com/r/kernel/testing/623393c9d50c04c7ea1d88824b8e92712e3e5611/ubuntu/focal/flavors/default/pool/main/l/linux-6.6.0-g623393c9d50c/linux-image-6.6.0-g623393c9d50c_6.6.0-g623393c9d50c-1_amd64.deb [38936568/38936568] -> "/tmp/linux-image.deb" [1] 2023-12-22T09:45:10.558 INFO:teuthology.orchestra.run.smithi045.stderr:FINISHED --2023-12-22 09:45:10-- 2023-12-22T09:45:10.558 INFO:teuthology.orchestra.run.smithi045.stderr:Total wall clock time: 1.5s 2023-12-22T09:45:10.558 INFO:teuthology.orchestra.run.smithi045.stderr:Downloaded: 1 files, 37M in 1.3s (27.5 MB/s) 2023-12-22T09:45:10.560 INFO:teuthology.task.kernel:Installing kernel 623393c9d50c04c7ea1d88824b8e92712e3e5611 on mon.a... 2023-12-22T09:45:10.560 DEBUG:teuthology.orchestra.run.smithi045:> sudo dpkg -i /tmp/linux-image.deb 2023-12-22T09:45:10.879 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package linux-image-6.6.0-g623393c9d50c. 2023-12-22T09:45:12.611 INFO:teuthology.orchestra.run.smithi045.stdout:(Reading database ... 104373 files and directories currently installed.) 2023-12-22T09:45:12.616 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-12-22T09:45:12.820 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking linux-image-6.6.0-g623393c9d50c (6.6.0-g623393c9d50c-1) ... 2023-12-22T09:45:15.866 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up linux-image-6.6.0-g623393c9d50c (6.6.0-g623393c9d50c-1) ... 2023-12-22T09:45:15.985 INFO:teuthology.orchestra.run.smithi045.stderr:update-initramfs: Generating /boot/initrd.img-6.6.0-g623393c9d50c 2023-12-22T09:45:33.977 INFO:teuthology.orchestra.run.smithi113.stderr:Sourcing file `/etc/default/grub' 2023-12-22T09:45:33.992 INFO:teuthology.orchestra.run.smithi113.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-12-22T09:45:34.023 INFO:teuthology.orchestra.run.smithi113.stderr:Generating grub configuration file ... 2023-12-22T09:45:34.363 INFO:teuthology.orchestra.run.smithi113.stderr:Found linux image: /boot/vmlinuz-6.6.0-g623393c9d50c 2023-12-22T09:45:34.388 INFO:teuthology.orchestra.run.smithi113.stderr:Found initrd image: /boot/initrd.img-6.6.0-g623393c9d50c 2023-12-22T09:45:34.765 INFO:teuthology.orchestra.run.smithi113.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-12-22T09:45:34.778 INFO:teuthology.orchestra.run.smithi113.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-12-22T09:45:36.480 INFO:teuthology.orchestra.run.smithi113.stderr:done 2023-12-22T09:45:36.657 DEBUG:teuthology.orchestra.run.smithi113:> dpkg-deb -c /tmp/linux-image.deb 2023-12-22T09:45:36.666 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./ 2023-12-22T09:45:36.667 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./boot/ 2023-12-22T09:45:36.667 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 4415617 2023-12-21 02:06 ./boot/System.map-6.6.0-g623393c9d50c 2023-12-22T09:45:36.682 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 169214 2023-12-21 02:06 ./boot/config-6.6.0-g623393c9d50c 2023-12-22T09:45:36.682 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11352864 2023-12-21 02:06 ./boot/vmlinuz-6.6.0-g623393c9d50c 2023-12-22T09:45:36.703 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./etc/ 2023-12-22T09:45:36.703 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./etc/kernel/ 2023-12-22T09:45:36.703 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./etc/kernel/postinst.d/ 2023-12-22T09:45:36.703 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./etc/kernel/postrm.d/ 2023-12-22T09:45:36.703 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./etc/kernel/preinst.d/ 2023-12-22T09:45:36.703 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./etc/kernel/prerm.d/ 2023-12-22T09:45:36.703 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/ 2023-12-22T09:45:36.703 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/ 2023-12-22T09:45:36.703 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/ 2023-12-22T09:45:36.704 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/ 2023-12-22T09:45:36.704 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/ 2023-12-22T09:45:36.704 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/ 2023-12-22T09:45:36.704 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/ 2023-12-22T09:45:36.704 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 490233 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/aesni-intel.ko 2023-12-22T09:45:36.706 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 25329 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-12-22T09:45:36.706 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 29529 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-12-22T09:45:36.706 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 30313 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-12-22T09:45:36.706 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 93113 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-12-22T09:45:36.707 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 106729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-12-22T09:45:36.707 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 152241 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-12-22T09:45:36.707 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 12553 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-12-22T09:45:36.707 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13777 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-12-22T09:45:36.707 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 83889 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-12-22T09:45:36.707 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 18625 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-12-22T09:45:36.707 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 47225 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-12-22T09:45:36.707 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 47209 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/serpent-avx2.ko 2023-12-22T09:45:36.707 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 51801 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-12-22T09:45:36.707 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 38937 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-12-22T09:45:36.707 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 40529 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-12-22T09:45:36.707 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 58585 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-12-22T09:45:36.708 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 50497 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-12-22T09:45:36.708 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 32065 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-12-22T09:45:36.708 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13625 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-12-22T09:45:36.708 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/kernel/ 2023-12-22T09:45:36.708 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/kernel/cpu/ 2023-12-22T09:45:36.708 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/kernel/cpu/mce/ 2023-12-22T09:45:36.708 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 40113 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-12-22T09:45:36.708 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13353 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/kernel/cpuid.ko 2023-12-22T09:45:36.708 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 17937 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/kernel/msr.ko 2023-12-22T09:45:36.708 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/kvm/ 2023-12-22T09:45:36.708 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 354433 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/kvm/kvm-amd.ko 2023-12-22T09:45:36.708 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 881625 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/kvm/kvm-intel.ko 2023-12-22T09:45:36.709 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 2275865 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/kvm/kvm.ko 2023-12-22T09:45:36.786 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/ 2023-12-22T09:45:36.787 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 53697 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/af_alg.ko 2023-12-22T09:45:36.787 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 23097 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/algif_hash.ko 2023-12-22T09:45:36.787 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 19985 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/algif_skcipher.ko 2023-12-22T09:45:36.787 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 17209 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/ansi_cprng.ko 2023-12-22T09:45:36.787 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 19641 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/anubis.ko 2023-12-22T09:45:36.787 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 10145 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/arc4.ko 2023-12-22T09:45:36.787 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/asymmetric_keys/ 2023-12-22T09:45:36.787 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 10185 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-12-22T09:45:36.787 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/async_tx/ 2023-12-22T09:45:36.787 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11249 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/async_tx/async_memcpy.ko 2023-12-22T09:45:36.787 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 19473 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/async_tx/async_pq.ko 2023-12-22T09:45:36.788 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 21561 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/async_tx/async_raid6_recov.ko 2023-12-22T09:45:36.788 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13825 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/async_tx/async_tx.ko 2023-12-22T09:45:36.788 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 17745 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/async_tx/async_xor.ko 2023-12-22T09:45:36.788 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 17921 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/async_tx/raid6test.ko 2023-12-22T09:45:36.788 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 20489 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/authenc.ko 2023-12-22T09:45:36.788 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 22577 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/authencesn.ko 2023-12-22T09:45:36.788 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 21817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/blake2b_generic.ko 2023-12-22T09:45:36.788 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 12729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/blowfish_common.ko 2023-12-22T09:45:36.788 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 10537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/blowfish_generic.ko 2023-12-22T09:45:36.789 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 38809 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/camellia_generic.ko 2023-12-22T09:45:36.789 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 27321 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/cast5_generic.ko 2023-12-22T09:45:36.789 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 17745 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/cast6_generic.ko 2023-12-22T09:45:36.789 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 10537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/cast_common.ko 2023-12-22T09:45:36.789 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 35097 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/ccm.ko 2023-12-22T09:45:36.789 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 14769 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/cmac.ko 2023-12-22T09:45:36.789 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 9585 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/crc32_generic.ko 2023-12-22T09:45:36.789 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 47505 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/cryptd.ko 2023-12-22T09:45:36.789 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 39505 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/crypto_engine.ko 2023-12-22T09:45:36.789 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 26953 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/crypto_simd.ko 2023-12-22T09:45:36.789 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 24737 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/crypto_user.ko 2023-12-22T09:45:36.790 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 17729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/cts.ko 2023-12-22T09:45:36.790 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 10913 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/des_generic.ko 2023-12-22T09:45:36.790 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 15681 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/dh_generic.ko 2023-12-22T09:45:36.790 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11001 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/echainiv.ko 2023-12-22T09:45:36.790 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 25321 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/essiv.ko 2023-12-22T09:45:36.790 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 17993 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/fcrypt.ko 2023-12-22T09:45:36.790 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 26897 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/khazad.ko 2023-12-22T09:45:36.790 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 15649 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/lrw.ko 2023-12-22T09:45:36.791 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11513 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/lz4.ko 2023-12-22T09:45:36.791 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11529 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/lz4hc.ko 2023-12-22T09:45:36.791 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11697 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/md4.ko 2023-12-22T09:45:36.791 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 9729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/michael_mic.ko 2023-12-22T09:45:36.791 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 10673 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/pcbc.ko 2023-12-22T09:45:36.791 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 18745 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/pcrypt.ko 2023-12-22T09:45:36.791 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 16049 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/rmd160.ko 2023-12-22T09:45:36.791 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 29393 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/seed.ko 2023-12-22T09:45:36.791 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 27081 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/serpent_generic.ko 2023-12-22T09:45:36.791 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 149193 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/tcrypt.ko 2023-12-22T09:45:36.791 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 10881 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/tea.ko 2023-12-22T09:45:36.791 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 28777 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/twofish_common.ko 2023-12-22T09:45:36.791 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13169 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/twofish_generic.ko 2023-12-22T09:45:36.791 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 17401 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/vmac.ko 2023-12-22T09:45:36.792 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 36185 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/wp512.ko 2023-12-22T09:45:36.792 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 14105 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/xcbc.ko 2023-12-22T09:45:36.792 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 26665 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/xor.ko 2023-12-22T09:45:36.792 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 18713 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/xts.ko 2023-12-22T09:45:36.792 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 9481 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/xxhash_generic.ko 2023-12-22T09:45:36.792 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ 2023-12-22T09:45:36.792 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/acpi/ 2023-12-22T09:45:36.792 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 18249 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/acpi/acpi_extlog.ko 2023-12-22T09:45:36.792 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 26985 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/acpi/acpi_ipmi.ko 2023-12-22T09:45:36.792 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 28793 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/acpi/acpi_pad.ko 2023-12-22T09:45:36.792 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/acpi/apei/ 2023-12-22T09:45:36.792 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 31241 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/acpi/apei/einj.ko 2023-12-22T09:45:36.792 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 12801 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/acpi/ec_sys.ko 2023-12-22T09:45:36.792 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 14937 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/acpi/platform_profile.ko 2023-12-22T09:45:36.792 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 24401 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/acpi/sbs.ko 2023-12-22T09:45:36.793 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 19521 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/acpi/sbshc.ko 2023-12-22T09:45:36.793 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 103025 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/acpi/video.ko 2023-12-22T09:45:36.793 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/ 2023-12-22T09:45:36.793 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 21601 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/acard-ahci.ko 2023-12-22T09:45:36.793 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 88865 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/ahci.ko 2023-12-22T09:45:36.793 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 14729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/ahci_platform.ko 2023-12-22T09:45:36.793 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 88289 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/libahci.ko 2023-12-22T09:45:36.794 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 34985 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/libahci_platform.ko 2023-12-22T09:45:36.794 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 17137 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_acpi.ko 2023-12-22T09:45:36.794 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 30433 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_ali.ko 2023-12-22T09:45:36.794 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 33505 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_amd.ko 2023-12-22T09:45:36.794 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 21265 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_artop.ko 2023-12-22T09:45:36.794 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 21121 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_atiixp.ko 2023-12-22T09:45:36.794 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 24945 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_atp867x.ko 2023-12-22T09:45:36.794 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 17657 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_cmd640.ko 2023-12-22T09:45:36.794 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 25185 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_cmd64x.ko 2023-12-22T09:45:36.794 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 15049 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_cypress.ko 2023-12-22T09:45:36.794 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 17849 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_efar.ko 2023-12-22T09:45:36.794 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 21945 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_hpt366.ko 2023-12-22T09:45:36.794 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 33977 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_hpt37x.ko 2023-12-22T09:45:36.794 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 23129 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_hpt3x2n.ko 2023-12-22T09:45:36.794 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 16921 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_hpt3x3.ko 2023-12-22T09:45:36.795 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 16993 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_it8213.ko 2023-12-22T09:45:36.795 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 35273 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_it821x.ko 2023-12-22T09:45:36.795 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 12889 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_jmicron.ko 2023-12-22T09:45:36.795 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 51481 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_legacy.ko 2023-12-22T09:45:36.795 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 15185 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_marvell.ko 2023-12-22T09:45:36.795 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 16281 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_mpiix.ko 2023-12-22T09:45:36.795 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 12833 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_netcell.ko 2023-12-22T09:45:36.795 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 16817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_ninja32.ko 2023-12-22T09:45:36.795 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 15105 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_ns87410.ko 2023-12-22T09:45:36.795 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 17361 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_ns87415.ko 2023-12-22T09:45:36.795 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 16569 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_oldpiix.ko 2023-12-22T09:45:36.795 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 15377 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_opti.ko 2023-12-22T09:45:36.795 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 20681 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_optidma.ko 2023-12-22T09:45:36.795 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 32585 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_pcmcia.ko 2023-12-22T09:45:36.796 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 37793 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_pdc2027x.ko 2023-12-22T09:45:36.796 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 20561 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-12-22T09:45:36.796 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 14225 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_piccolo.ko 2023-12-22T09:45:36.796 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 15449 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_radisys.ko 2023-12-22T09:45:36.796 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 19521 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_rdc.ko 2023-12-22T09:45:36.796 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 15329 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_rz1000.ko 2023-12-22T09:45:36.796 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13937 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_sch.ko 2023-12-22T09:45:36.796 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 23097 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_serverworks.ko 2023-12-22T09:45:36.796 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 23457 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_sil680.ko 2023-12-22T09:45:36.796 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 19697 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_sl82c105.ko 2023-12-22T09:45:36.796 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 16009 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_triflex.ko 2023-12-22T09:45:36.796 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 30433 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_via.ko 2023-12-22T09:45:36.796 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 22793 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pdc_adma.ko 2023-12-22T09:45:36.796 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 29121 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_inic162x.ko 2023-12-22T09:45:36.797 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 83345 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_mv.ko 2023-12-22T09:45:36.797 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 70393 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_nv.ko 2023-12-22T09:45:36.797 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 37377 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_promise.ko 2023-12-22T09:45:36.797 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 23041 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_qstor.ko 2023-12-22T09:45:36.797 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 29273 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_sil.ko 2023-12-22T09:45:36.797 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 38337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_sil24.ko 2023-12-22T09:45:36.797 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 17945 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_sis.ko 2023-12-22T09:45:36.797 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 20441 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_svw.ko 2023-12-22T09:45:36.797 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 44793 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_sx4.ko 2023-12-22T09:45:36.797 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 15601 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_uli.ko 2023-12-22T09:45:36.797 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 35065 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_via.ko 2023-12-22T09:45:36.797 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 20065 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_vsc.ko 2023-12-22T09:45:36.797 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/auxdisplay/ 2023-12-22T09:45:36.797 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 16289 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/auxdisplay/ks0108.ko 2023-12-22T09:45:36.797 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/bcma/ 2023-12-22T09:45:36.798 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 124473 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/bcma/bcma.ko 2023-12-22T09:45:36.798 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/ 2023-12-22T09:45:36.798 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/aoe/ 2023-12-22T09:45:36.798 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 113665 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/aoe/aoe.ko 2023-12-22T09:45:36.798 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/drbd/ 2023-12-22T09:45:36.798 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 965585 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/drbd/drbd.ko 2023-12-22T09:45:36.798 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 173225 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/floppy.ko 2023-12-22T09:45:36.798 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/mtip32xx/ 2023-12-22T09:45:36.798 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 94297 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-12-22T09:45:36.798 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 115793 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/nbd.ko 2023-12-22T09:45:36.798 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/null_blk/ 2023-12-22T09:45:36.798 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 110385 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/null_blk/null_blk.ko 2023-12-22T09:45:36.798 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 98193 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/pktcdvd.ko 2023-12-22T09:45:36.799 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 263769 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/rbd.ko 2023-12-22T09:45:36.799 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/xen-blkback/ 2023-12-22T09:45:36.799 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 98145 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-12-22T09:45:36.799 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/zram/ 2023-12-22T09:45:36.799 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 60217 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/zram/zram.ko 2023-12-22T09:45:36.799 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/ 2023-12-22T09:45:36.799 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 30705 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/applicom.ko 2023-12-22T09:45:36.799 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 12009 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/hangcheck-timer.ko 2023-12-22T09:45:36.800 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/hw_random/ 2023-12-22T09:45:36.800 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13889 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/hw_random/amd-rng.ko 2023-12-22T09:45:36.800 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 18809 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/hw_random/intel-rng.ko 2023-12-22T09:45:36.800 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13169 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-12-22T09:45:36.800 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 10673 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/hw_random/via-rng.ko 2023-12-22T09:45:36.800 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 15633 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/hw_random/virtio-rng.ko 2023-12-22T09:45:36.800 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/ipmi/ 2023-12-22T09:45:36.800 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 30713 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-12-22T09:45:36.800 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 148601 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-12-22T09:45:36.800 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 26569 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-12-22T09:45:36.800 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 139313 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/ipmi/ipmi_si.ko 2023-12-22T09:45:36.800 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 70921 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-12-22T09:45:36.800 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 53513 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-12-22T09:45:36.800 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 36321 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/lp.ko 2023-12-22T09:45:36.801 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/mwave/ 2023-12-22T09:45:36.801 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 84097 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/mwave/mwave.ko 2023-12-22T09:45:36.801 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 25873 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/nvram.ko 2023-12-22T09:45:36.801 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 32169 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/ppdev.ko 2023-12-22T09:45:36.801 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 51113 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/tlclk.ko 2023-12-22T09:45:36.801 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/tpm/ 2023-12-22T09:45:36.801 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 16401 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/tpm/tpm_atmel.ko 2023-12-22T09:45:36.801 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 15881 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-12-22T09:45:36.801 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 23473 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-12-22T09:45:36.802 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 32985 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-12-22T09:45:36.802 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 30121 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/tpm/tpm_infineon.ko 2023-12-22T09:45:36.802 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 22697 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/tpm/tpm_nsc.ko 2023-12-22T09:45:36.802 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 23561 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-12-22T09:45:36.802 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/xillybus/ 2023-12-22T09:45:36.802 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 17001 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/xillybus/xillybus_class.ko 2023-12-22T09:45:36.802 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 50945 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/xillybus/xillybus_core.ko 2023-12-22T09:45:36.802 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 12393 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-12-22T09:45:36.802 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/clk/ 2023-12-22T09:45:36.802 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 12489 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/clk/clk-palmas.ko 2023-12-22T09:45:36.802 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 47849 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/clk/clk-si5351.ko 2023-12-22T09:45:36.802 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11457 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/clk/clk-twl6040.ko 2023-12-22T09:45:36.802 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 19249 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/clk/clk-wm831x.ko 2023-12-22T09:45:36.802 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/cpufreq/ 2023-12-22T09:45:36.802 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 10097 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-12-22T09:45:36.803 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 16833 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/cpufreq/p4-clockmod.ko 2023-12-22T09:45:36.803 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 25297 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/cpufreq/speedstep-lib.ko 2023-12-22T09:45:36.803 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/ 2023-12-22T09:45:36.803 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/ccp/ 2023-12-22T09:45:36.803 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 70801 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-12-22T09:45:36.803 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 243025 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/ccp/ccp.ko 2023-12-22T09:45:36.803 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/intel/ 2023-12-22T09:45:36.804 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/intel/qat/ 2023-12-22T09:45:36.804 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/intel/qat/qat_common/ 2023-12-22T09:45:36.804 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 438761 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-12-22T09:45:36.804 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-12-22T09:45:36.805 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 24081 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-12-22T09:45:36.805 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 19937 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/padlock-aes.ko 2023-12-22T09:45:36.805 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 21537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/padlock-sha.ko 2023-12-22T09:45:36.805 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/virtio/ 2023-12-22T09:45:36.805 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 70273 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-12-22T09:45:36.805 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/dca/ 2023-12-22T09:45:36.805 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 29785 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/dca/dca.ko 2023-12-22T09:45:36.805 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/dma/ 2023-12-22T09:45:36.805 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/dma/dw/ 2023-12-22T09:45:36.805 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 15857 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/dma/dw/dw_dmac.ko 2023-12-22T09:45:36.805 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/dma/ioat/ 2023-12-22T09:45:36.805 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 122569 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/dma/ioat/ioatdma.ko 2023-12-22T09:45:36.805 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/ 2023-12-22T09:45:36.806 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 79953 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/amd64_edac.ko 2023-12-22T09:45:36.806 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 35769 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/e752x_edac.ko 2023-12-22T09:45:36.806 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 63617 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/edac_mce_amd.ko 2023-12-22T09:45:36.806 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 18105 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/i3000_edac.ko 2023-12-22T09:45:36.806 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 18065 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/i3200_edac.ko 2023-12-22T09:45:36.806 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 22537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/i5100_edac.ko 2023-12-22T09:45:36.806 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 25657 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/i5400_edac.ko 2023-12-22T09:45:36.806 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 24913 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/i7300_edac.ko 2023-12-22T09:45:36.806 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 52041 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/i7core_edac.ko 2023-12-22T09:45:36.806 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 18433 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/i82975x_edac.ko 2023-12-22T09:45:36.806 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 20017 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/ie31200_edac.ko 2023-12-22T09:45:36.806 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 56825 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/sb_edac.ko 2023-12-22T09:45:36.806 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 17529 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/x38_edac.ko 2023-12-22T09:45:36.806 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/extcon/ 2023-12-22T09:45:36.807 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 12673 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/extcon/extcon-gpio.ko 2023-12-22T09:45:36.807 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 27185 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/extcon/extcon-max14577.ko 2023-12-22T09:45:36.807 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 29569 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/extcon/extcon-max77693.ko 2023-12-22T09:45:36.807 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 24745 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/extcon/extcon-max8997.ko 2023-12-22T09:45:36.807 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 26537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/extcon/extcon-palmas.ko 2023-12-22T09:45:36.807 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 23713 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/extcon/extcon-rt8973a.ko 2023-12-22T09:45:36.807 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 27785 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/extcon/extcon-sm5502.ko 2023-12-22T09:45:36.807 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/firmware/ 2023-12-22T09:45:36.807 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 34977 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/firmware/dmi-sysfs.ko 2023-12-22T09:45:36.807 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/firmware/efi/ 2023-12-22T09:45:36.807 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 15521 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/firmware/efi/efi-pstore.ko 2023-12-22T09:45:36.807 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 20729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/firmware/iscsi_ibft.ko 2023-12-22T09:45:36.807 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/ 2023-12-22T09:45:36.807 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 12305 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-adp5520.ko 2023-12-22T09:45:36.807 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 20153 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-amd8111.ko 2023-12-22T09:45:36.808 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 14993 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-arizona.ko 2023-12-22T09:45:36.808 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13841 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-da9052.ko 2023-12-22T09:45:36.808 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11921 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-da9055.ko 2023-12-22T09:45:36.808 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 22065 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-dln2.ko 2023-12-22T09:45:36.808 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 77849 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-f7188x.ko 2023-12-22T09:45:36.808 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 28937 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-generic.ko 2023-12-22T09:45:36.808 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 19569 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-ich.ko 2023-12-22T09:45:36.808 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11905 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-12-22T09:45:36.808 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 14113 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-kempld.ko 2023-12-22T09:45:36.808 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 12537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-lp3943.ko 2023-12-22T09:45:36.808 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 9505 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-max7300.ko 2023-12-22T09:45:36.808 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11905 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-max730x.ko 2023-12-22T09:45:36.808 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 22073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-max732x.ko 2023-12-22T09:45:36.808 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 25145 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-12-22T09:45:36.809 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 47073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-pca953x.ko 2023-12-22T09:45:36.809 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 26825 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-pcf857x.ko 2023-12-22T09:45:36.809 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 14377 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-rdc321x.ko 2023-12-22T09:45:36.809 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 20593 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-sch.ko 2023-12-22T09:45:36.809 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 19505 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-sch311x.ko 2023-12-22T09:45:36.809 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 12145 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-tps65912.ko 2023-12-22T09:45:36.809 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 21057 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-twl4030.ko 2023-12-22T09:45:36.809 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-twl6040.ko 2023-12-22T09:45:36.810 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 20601 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-viperboard.ko 2023-12-22T09:45:36.810 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 15377 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-vx855.ko 2023-12-22T09:45:36.810 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 16281 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-wm831x.ko 2023-12-22T09:45:36.810 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11617 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-wm8350.ko 2023-12-22T09:45:36.810 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 16753 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-wm8994.ko 2023-12-22T09:45:36.810 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/ 2023-12-22T09:45:36.810 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11577 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-a4tech.ko 2023-12-22T09:45:36.810 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 39169 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-apple.ko 2023-12-22T09:45:36.810 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 14481 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-appleir.ko 2023-12-22T09:45:36.810 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 8353 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-aureal.ko 2023-12-22T09:45:36.810 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 15169 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-axff.ko 2023-12-22T09:45:36.810 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11049 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-belkin.ko 2023-12-22T09:45:36.810 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 10313 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-cherry.ko 2023-12-22T09:45:36.810 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 16041 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-chicony.ko 2023-12-22T09:45:36.811 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 60649 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-cp2112.ko 2023-12-22T09:45:36.811 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11049 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-cypress.ko 2023-12-22T09:45:36.811 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 16385 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-dr.ko 2023-12-22T09:45:36.811 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 10697 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-elecom.ko 2023-12-22T09:45:36.811 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 17665 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-elo.ko 2023-12-22T09:45:36.811 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13457 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-emsff.ko 2023-12-22T09:45:36.811 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 10105 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-ezkey.ko 2023-12-22T09:45:36.811 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 14305 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-gaff.ko 2023-12-22T09:45:36.811 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 9225 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-generic.ko 2023-12-22T09:45:36.811 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 17129 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-gt683r.ko 2023-12-22T09:45:36.811 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 12681 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-gyration.ko 2023-12-22T09:45:36.811 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 10161 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-holtek-kbd.ko 2023-12-22T09:45:36.811 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 10457 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-holtek-mouse.ko 2023-12-22T09:45:36.811 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 14449 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-holtekff.ko 2023-12-22T09:45:36.812 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 19105 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-hyperv.ko 2023-12-22T09:45:36.812 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 10489 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-icade.ko 2023-12-22T09:45:36.812 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 9241 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-kensington.ko 2023-12-22T09:45:36.812 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 8545 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-keytouch.ko 2023-12-22T09:45:36.812 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 17201 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-kye.ko 2023-12-22T09:45:36.812 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 10809 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-lcpower.ko 2023-12-22T09:45:36.812 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 20497 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-led.ko 2023-12-22T09:45:36.812 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 42297 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-lenovo.ko 2023-12-22T09:45:36.812 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 30697 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-lg-g15.ko 2023-12-22T09:45:36.812 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 58185 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-logitech-dj.ko 2023-12-22T09:45:36.812 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 101481 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-12-22T09:45:36.812 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 80993 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-logitech.ko 2023-12-22T09:45:36.812 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 30801 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-magicmouse.ko 2023-12-22T09:45:36.812 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 21969 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-microsoft.ko 2023-12-22T09:45:36.812 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 10361 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-monterey.ko 2023-12-22T09:45:36.813 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 50161 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-multitouch.ko 2023-12-22T09:45:36.813 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 32593 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-ntrig.ko 2023-12-22T09:45:36.813 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 8857 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-ortek.ko 2023-12-22T09:45:36.813 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 9121 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-penmount.ko 2023-12-22T09:45:36.813 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 12289 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-petalynx.ko 2023-12-22T09:45:36.813 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 72937 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-picolcd.ko 2023-12-22T09:45:36.813 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 14225 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-pl.ko 2023-12-22T09:45:36.813 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 15105 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-plantronics.ko 2023-12-22T09:45:36.813 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 8417 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-primax.ko 2023-12-22T09:45:36.813 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 35393 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-rmi.ko 2023-12-22T09:45:36.814 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 20833 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-arvo.ko 2023-12-22T09:45:36.814 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 14065 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-common.ko 2023-12-22T09:45:36.814 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 31425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-isku.ko 2023-12-22T09:45:36.814 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 29729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-kone.ko 2023-12-22T09:45:36.814 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 31129 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-12-22T09:45:36.814 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 21137 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-konepure.ko 2023-12-22T09:45:36.814 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 29489 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-12-22T09:45:36.814 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13305 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-lua.ko 2023-12-22T09:45:36.814 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 29313 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-pyra.ko 2023-12-22T09:45:36.814 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 27937 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-ryos.ko 2023-12-22T09:45:36.815 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 19521 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-savu.ko 2023-12-22T09:45:36.815 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 23337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat.ko 2023-12-22T09:45:36.815 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13681 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-saitek.ko 2023-12-22T09:45:36.815 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 15193 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-samsung.ko 2023-12-22T09:45:36.815 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 36817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-sensor-hub.ko 2023-12-22T09:45:36.815 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13601 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-sjoy.ko 2023-12-22T09:45:36.815 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 51249 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-sony.ko 2023-12-22T09:45:36.815 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 8313 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-speedlink.ko 2023-12-22T09:45:36.815 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 25297 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-steelseries.ko 2023-12-22T09:45:36.815 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 9817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-sunplus.ko 2023-12-22T09:45:36.815 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 16993 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-thrustmaster.ko 2023-12-22T09:45:36.815 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 10537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-tivo.ko 2023-12-22T09:45:36.815 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 15089 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-tmff.ko 2023-12-22T09:45:36.816 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 14385 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-topseed.ko 2023-12-22T09:45:36.816 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 16473 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-twinhan.ko 2023-12-22T09:45:36.816 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 71073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-uclogic.ko 2023-12-22T09:45:36.816 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 10921 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-waltop.ko 2023-12-22T09:45:36.816 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 143473 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-wiimote.ko 2023-12-22T09:45:36.816 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 8153 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-xinmo.ko 2023-12-22T09:45:36.816 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13321 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-zpff.ko 2023-12-22T09:45:36.816 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 16665 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-zydacron.ko 2023-12-22T09:45:36.816 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 267825 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid.ko 2023-12-22T09:45:36.816 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 32321 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/uhid.ko 2023-12-22T09:45:36.816 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/usbhid/ 2023-12-22T09:45:36.816 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 125721 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/usbhid/usbhid.ko 2023-12-22T09:45:36.816 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 19137 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/usbhid/usbkbd.ko 2023-12-22T09:45:36.817 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 14953 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/usbhid/usbmouse.ko 2023-12-22T09:45:36.817 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 217873 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/wacom.ko 2023-12-22T09:45:36.817 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hv/ 2023-12-22T09:45:36.817 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 64201 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hv/hv_balloon.ko 2023-12-22T09:45:36.817 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 89625 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hv/hv_utils.ko 2023-12-22T09:45:36.817 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 305465 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hv/hv_vmbus.ko 2023-12-22T09:45:36.817 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ 2023-12-22T09:45:36.817 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 66521 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/abituguru.ko 2023-12-22T09:45:36.817 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 61393 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/abituguru3.ko 2023-12-22T09:45:36.817 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 34745 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/acpi_power_meter.ko 2023-12-22T09:45:36.817 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 17505 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ad7414.ko 2023-12-22T09:45:36.817 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 19313 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ad7418.ko 2023-12-22T09:45:36.817 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 25257 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adc128d818.ko 2023-12-22T09:45:36.817 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 31729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adm1025.ko 2023-12-22T09:45:36.817 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 97977 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adm1026.ko 2023-12-22T09:45:36.818 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 19745 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adm1029.ko 2023-12-22T09:45:36.818 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 45553 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adm1031.ko 2023-12-22T09:45:36.818 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 26289 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adm9240.ko 2023-12-22T09:45:36.818 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 14769 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ads7828.ko 2023-12-22T09:45:36.818 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 10769 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adt7410.ko 2023-12-22T09:45:36.818 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 22049 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adt7411.ko 2023-12-22T09:45:36.818 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 74433 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adt7462.ko 2023-12-22T09:45:36.818 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 39585 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adt7470.ko 2023-12-22T09:45:36.818 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 67929 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adt7475.ko 2023-12-22T09:45:36.818 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 19625 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adt7x10.ko 2023-12-22T09:45:36.818 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 39073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/amc6821.ko 2023-12-22T09:45:36.818 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 55201 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/applesmc.ko 2023-12-22T09:45:36.818 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 49913 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/asb100.ko 2023-12-22T09:45:36.818 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 58617 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/asc7621.ko 2023-12-22T09:45:36.819 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 40825 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/asus_atk0110.ko 2023-12-22T09:45:36.819 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 17225 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/atxp1.ko 2023-12-22T09:45:36.819 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 28281 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/coretemp.ko 2023-12-22T09:45:36.819 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 24593 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/da9052-hwmon.ko 2023-12-22T09:45:36.819 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 17265 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/da9055-hwmon.ko 2023-12-22T09:45:36.819 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 44465 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-12-22T09:45:36.819 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 99601 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/dme1737.ko 2023-12-22T09:45:36.819 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 19489 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ds1621.ko 2023-12-22T09:45:36.819 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 15321 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ds620.ko 2023-12-22T09:45:36.819 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 29777 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/emc1403.ko 2023-12-22T09:45:36.819 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 33185 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/emc2103.ko 2023-12-22T09:45:36.819 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 30321 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/emc6w201.ko 2023-12-22T09:45:36.819 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 66985 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/f71805f.ko 2023-12-22T09:45:36.819 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 94457 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/f71882fg.ko 2023-12-22T09:45:36.820 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 41401 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/f75375s.ko 2023-12-22T09:45:36.820 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 21305 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/fam15h_power.ko 2023-12-22T09:45:36.820 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 55449 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/fschmd.ko 2023-12-22T09:45:36.820 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 14481 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/g760a.ko 2023-12-22T09:45:36.820 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 24017 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/g762.ko 2023-12-22T09:45:36.820 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 46801 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/gl518sm.ko 2023-12-22T09:45:36.820 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 45529 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/gl520sm.ko 2023-12-22T09:45:36.820 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13273 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/hih6130.ko 2023-12-22T09:45:36.820 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 9745 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/hwmon-vid.ko 2023-12-22T09:45:36.820 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11553 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/i5500_temp.ko 2023-12-22T09:45:36.820 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 22601 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/i5k_amb.ko 2023-12-22T09:45:36.820 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 34529 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ibmaem.ko 2023-12-22T09:45:36.820 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 21257 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ibmpex.ko 2023-12-22T09:45:36.820 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 24873 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ina209.ko 2023-12-22T09:45:36.821 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13401 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ina2xx.ko 2023-12-22T09:45:36.821 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 130449 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/it87.ko 2023-12-22T09:45:36.821 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 18841 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/jc42.ko 2023-12-22T09:45:36.821 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 24329 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/k10temp.ko 2023-12-22T09:45:36.821 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13553 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/k8temp.ko 2023-12-22T09:45:36.821 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 18929 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lineage-pem.ko 2023-12-22T09:45:36.821 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 48601 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm63.ko 2023-12-22T09:45:36.821 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 16697 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm73.ko 2023-12-22T09:45:36.821 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 36777 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm75.ko 2023-12-22T09:45:36.821 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 19537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm77.ko 2023-12-22T09:45:36.821 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 34593 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm78.ko 2023-12-22T09:45:36.821 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 31745 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm80.ko 2023-12-22T09:45:36.821 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 16889 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm83.ko 2023-12-22T09:45:36.821 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 72833 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm85.ko 2023-12-22T09:45:36.822 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 46153 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm87.ko 2023-12-22T09:45:36.822 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 37913 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm90.ko 2023-12-22T09:45:36.822 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 19745 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm92.ko 2023-12-22T09:45:36.822 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 108841 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm93.ko 2023-12-22T09:45:36.822 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 33393 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm95234.ko 2023-12-22T09:45:36.822 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 16201 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm95241.ko 2023-12-22T09:45:36.822 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 18113 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm95245.ko 2023-12-22T09:45:36.822 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 24017 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ltc2945.ko 2023-12-22T09:45:36.822 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13793 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ltc4151.ko 2023-12-22T09:45:36.822 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 15193 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ltc4215.ko 2023-12-22T09:45:36.822 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 14889 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ltc4222.ko 2023-12-22T09:45:36.822 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 14825 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ltc4245.ko 2023-12-22T09:45:36.822 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13249 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ltc4260.ko 2023-12-22T09:45:36.822 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 14993 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ltc4261.ko 2023-12-22T09:45:36.823 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 33489 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/max16065.ko 2023-12-22T09:45:36.823 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 18433 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/max1619.ko 2023-12-22T09:45:36.823 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 24353 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/max1668.ko 2023-12-22T09:45:36.823 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 19969 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/max197.ko 2023-12-22T09:45:36.823 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 27129 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/max6639.ko 2023-12-22T09:45:36.823 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 23321 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/max6650.ko 2023-12-22T09:45:36.823 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 35777 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/max6697.ko 2023-12-22T09:45:36.823 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 18585 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/mc13783-adc.ko 2023-12-22T09:45:36.823 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 10585 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/mcp3021.ko 2023-12-22T09:45:36.823 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 15937 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-12-22T09:45:36.823 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 44129 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/nct6683.ko 2023-12-22T09:45:36.823 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 119817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/nct6775-core.ko 2023-12-22T09:45:36.823 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 60705 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/nct6775.ko 2023-12-22T09:45:36.823 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 59737 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/nct7802.ko 2023-12-22T09:45:36.824 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 82337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pc87360.ko 2023-12-22T09:45:36.824 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 54433 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pc87427.ko 2023-12-22T09:45:36.824 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 18473 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pcf8591.ko 2023-12-22T09:45:36.824 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/ 2023-12-22T09:45:36.824 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 21353 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-12-22T09:45:36.824 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 17065 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-12-22T09:45:36.824 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 28329 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-12-22T09:45:36.824 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 9577 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/max16064.ko 2023-12-22T09:45:36.824 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 17657 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/max34440.ko 2023-12-22T09:45:36.824 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 10169 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/max8688.ko 2023-12-22T09:45:36.824 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 15505 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-12-22T09:45:36.824 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 82577 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-12-22T09:45:36.824 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 8729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-12-22T09:45:36.824 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 30729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-12-22T09:45:36.824 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 15073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-12-22T09:45:36.825 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 20681 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-12-22T09:45:36.825 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13017 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/powr1220.ko 2023-12-22T09:45:36.825 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 18705 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/sch5627.ko 2023-12-22T09:45:36.825 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 28817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/sch5636.ko 2023-12-22T09:45:36.825 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 27145 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/sch56xx-common.ko 2023-12-22T09:45:36.825 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 32137 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/sht15.ko 2023-12-22T09:45:36.825 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13505 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/sht21.ko 2023-12-22T09:45:36.825 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 16833 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/shtc1.ko 2023-12-22T09:45:36.826 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 40105 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/sis5595.ko 2023-12-22T09:45:36.826 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 19577 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/smsc47b397.ko 2023-12-22T09:45:36.826 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 39193 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/smsc47m1.ko 2023-12-22T09:45:36.826 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 37385 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/smsc47m192.ko 2023-12-22T09:45:36.826 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 26553 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/thmc50.ko 2023-12-22T09:45:36.826 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 17057 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/tmp102.ko 2023-12-22T09:45:36.826 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 14097 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/tmp103.ko 2023-12-22T09:45:36.826 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 21257 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/tmp401.ko 2023-12-22T09:45:36.826 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 19537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/tmp421.ko 2023-12-22T09:45:36.826 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 19721 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/via-cputemp.ko 2023-12-22T09:45:36.826 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 41945 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/via686a.ko 2023-12-22T09:45:36.826 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 52457 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/vt1211.ko 2023-12-22T09:45:36.826 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 51545 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/vt8231.ko 2023-12-22T09:45:36.826 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 57449 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/w83627ehf.ko 2023-12-22T09:45:36.827 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 78873 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/w83627hf.ko 2023-12-22T09:45:36.827 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 71345 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/w83781d.ko 2023-12-22T09:45:36.827 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 63225 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/w83791d.ko 2023-12-22T09:45:36.827 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 71321 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/w83792d.ko 2023-12-22T09:45:36.827 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 101473 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/w83793.ko 2023-12-22T09:45:36.827 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 119505 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/w83795.ko 2023-12-22T09:45:36.827 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 17313 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/w83l785ts.ko 2023-12-22T09:45:36.827 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 35625 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/w83l786ng.ko 2023-12-22T09:45:36.827 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13825 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-12-22T09:45:36.827 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 10625 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-12-22T09:45:36.827 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/ 2023-12-22T09:45:36.827 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/algos/ 2023-12-22T09:45:36.827 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 20049 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-12-22T09:45:36.827 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 19345 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-12-22T09:45:36.828 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/ 2023-12-22T09:45:36.828 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 27969 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-12-22T09:45:36.828 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 28801 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-12-22T09:45:36.828 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 27777 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-12-22T09:45:36.828 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 17937 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-12-22T09:45:36.828 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 26193 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-12-22T09:45:36.828 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 16201 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-12-22T09:45:36.828 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 15153 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-12-22T09:45:36.828 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 6929 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-12-22T09:45:36.828 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13961 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-12-22T09:45:36.828 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 50201 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-12-22T09:45:36.828 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 23905 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-12-22T09:45:36.828 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 20001 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-12-22T09:45:36.828 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 17337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-12-22T09:45:36.829 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 12497 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-12-22T09:45:36.829 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 17585 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-12-22T09:45:36.829 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 62817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-i801.ko 2023-12-22T09:45:36.829 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 22433 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-isch.ko 2023-12-22T09:45:36.829 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 47889 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-12-22T09:45:36.829 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 17721 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-12-22T09:45:36.829 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 17881 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-12-22T09:45:36.829 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 22337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-12-22T09:45:36.829 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 26265 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-12-22T09:45:36.829 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 25145 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-parport.ko 2023-12-22T09:45:36.829 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 16497 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-12-22T09:45:36.829 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 47241 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-12-22T09:45:36.829 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 15289 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-12-22T09:45:36.829 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 18649 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-12-22T09:45:36.829 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11809 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-12-22T09:45:36.830 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 22313 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-12-22T09:45:36.830 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 29361 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-12-22T09:45:36.830 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 20329 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-12-22T09:45:36.830 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 19241 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-12-22T09:45:36.830 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 19809 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-12-22T09:45:36.830 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13801 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-via.ko 2023-12-22T09:45:36.830 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 26081 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-12-22T09:45:36.830 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 19041 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-12-22T09:45:36.830 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 47657 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-12-22T09:45:36.830 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 22449 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/i2c-mux.ko 2023-12-22T09:45:36.830 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 18825 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/i2c-smbus.ko 2023-12-22T09:45:36.830 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 27073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/i2c-stub.ko 2023-12-22T09:45:36.830 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/muxes/ 2023-12-22T09:45:36.830 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 14921 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-12-22T09:45:36.831 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13457 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-12-22T09:45:36.831 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 29737 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-12-22T09:45:36.831 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ 2023-12-22T09:45:36.831 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/core/ 2023-12-22T09:45:36.831 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 273609 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/core/ib_cm.ko 2023-12-22T09:45:36.831 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 879969 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/core/ib_core.ko 2023-12-22T09:45:36.831 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 69273 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/core/ib_umad.ko 2023-12-22T09:45:36.831 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 324217 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-12-22T09:45:36.831 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 97985 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/core/iw_cm.ko 2023-12-22T09:45:36.831 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 282273 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/core/rdma_cm.ko 2023-12-22T09:45:36.831 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 66201 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-12-22T09:45:36.831 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/hw/ 2023-12-22T09:45:36.831 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/hw/cxgb4/ 2023-12-22T09:45:36.831 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 493073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-12-22T09:45:36.832 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/hw/mlx4/ 2023-12-22T09:45:36.832 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 419737 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-12-22T09:45:36.832 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/hw/mlx5/ 2023-12-22T09:45:36.832 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 739025 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-12-22T09:45:36.832 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/hw/mthca/ 2023-12-22T09:45:36.832 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 296625 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-12-22T09:45:36.832 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/hw/ocrdma/ 2023-12-22T09:45:36.832 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 153697 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-12-22T09:45:36.832 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/hw/usnic/ 2023-12-22T09:45:36.832 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 168969 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-12-22T09:45:36.832 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp/ 2023-12-22T09:45:36.832 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp/ipoib/ 2023-12-22T09:45:36.832 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 263081 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-12-22T09:45:36.832 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp/iser/ 2023-12-22T09:45:36.833 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 100241 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-12-22T09:45:36.833 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp/isert/ 2023-12-22T09:45:36.833 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 111425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-12-22T09:45:36.833 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp/srp/ 2023-12-22T09:45:36.833 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 128753 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-12-22T09:45:36.833 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp/srpt/ 2023-12-22T09:45:36.833 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 129529 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-12-22T09:45:36.833 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/ 2023-12-22T09:45:36.833 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 10745 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/evbug.ko 2023-12-22T09:45:36.833 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 24129 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/ff-memless.ko 2023-12-22T09:45:36.833 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/gameport/ 2023-12-22T09:45:36.833 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11881 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-12-22T09:45:36.833 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 12145 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/gameport/fm801-gp.ko 2023-12-22T09:45:36.833 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 41241 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/gameport/gameport.ko 2023-12-22T09:45:36.834 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 41801 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/joydev.ko 2023-12-22T09:45:36.834 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/ 2023-12-22T09:45:36.834 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13313 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-12-22T09:45:36.834 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 12801 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-12-22T09:45:36.834 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 26841 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-12-22T09:45:36.834 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 24761 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-12-22T09:45:36.834 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 36665 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/gpio_keys.ko 2023-12-22T09:45:36.834 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 18625 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-12-22T09:45:36.834 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 21257 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/lkkbd.ko 2023-12-22T09:45:36.834 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 26473 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/lm8323.ko 2023-12-22T09:45:36.834 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 14409 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/lm8333.ko 2023-12-22T09:45:36.834 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 24265 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-12-22T09:45:36.834 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 18217 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-12-22T09:45:36.834 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 15929 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-12-22T09:45:36.834 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 16489 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-12-22T09:45:36.835 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11585 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/newtonkbd.ko 2023-12-22T09:45:36.835 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 10673 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-12-22T09:45:36.835 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 14161 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/qt1070.ko 2023-12-22T09:45:36.835 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 17929 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/qt2160.ko 2023-12-22T09:45:36.835 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 23817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-12-22T09:45:36.835 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11481 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/stowaway.ko 2023-12-22T09:45:36.835 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 18289 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/sunkbd.ko 2023-12-22T09:45:36.835 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 17425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-12-22T09:45:36.835 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 16177 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-12-22T09:45:36.835 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 16801 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-12-22T09:45:36.835 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11753 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/xtkbd.ko 2023-12-22T09:45:36.835 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11465 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/matrix-keymap.ko 2023-12-22T09:45:36.835 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/mouse/ 2023-12-22T09:45:36.835 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 34329 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/mouse/appletouch.ko 2023-12-22T09:45:36.836 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 34177 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/mouse/bcm5974.ko 2023-12-22T09:45:36.836 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 123681 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/mouse/cyapatp.ko 2023-12-22T09:45:36.836 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 89449 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/mouse/elan_i2c.ko 2023-12-22T09:45:36.836 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13961 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/mouse/gpio_mouse.ko 2023-12-22T09:45:36.836 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 335929 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/mouse/psmouse.ko 2023-12-22T09:45:36.836 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 14681 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/mouse/sermouse.ko 2023-12-22T09:45:36.836 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 23881 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-12-22T09:45:36.836 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 22569 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/mouse/synaptics_usb.ko 2023-12-22T09:45:36.836 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 15665 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/mouse/vsxxxaa.ko 2023-12-22T09:45:36.836 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/rmi4/ 2023-12-22T09:45:36.836 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 109873 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/rmi4/rmi_core.ko 2023-12-22T09:45:36.836 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/serio/ 2023-12-22T09:45:36.836 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11665 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/serio/altera_ps2.ko 2023-12-22T09:45:36.836 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 16289 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/serio/arc_ps2.ko 2023-12-22T09:45:36.837 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 16425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/serio/ct82c710.ko 2023-12-22T09:45:36.837 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 16953 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-12-22T09:45:36.837 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 15833 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/serio/parkbd.ko 2023-12-22T09:45:36.837 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13225 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/serio/pcips2.ko 2023-12-22T09:45:36.837 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 20153 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/serio/ps2mult.ko 2023-12-22T09:45:36.837 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 24153 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/serio/serio_raw.ko 2023-12-22T09:45:36.837 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 17977 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/serio/serport.ko 2023-12-22T09:45:36.837 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/sparse-keymap.ko 2023-12-22T09:45:36.837 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/iommu/ 2023-12-22T09:45:36.837 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/iommu/amd/ 2023-12-22T09:45:36.837 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 39289 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/iommu/amd/iommu_v2.ko 2023-12-22T09:45:36.837 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/ 2023-12-22T09:45:36.837 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-88pm860x.ko 2023-12-22T09:45:36.837 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11385 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-adp5520.ko 2023-12-22T09:45:36.837 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 59753 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-bd2802.ko 2023-12-22T09:45:36.838 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 24785 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-blinkm.ko 2023-12-22T09:45:36.838 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 10473 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-da903x.ko 2023-12-22T09:45:36.838 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 12241 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-da9052.ko 2023-12-22T09:45:36.838 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 16561 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-gpio.ko 2023-12-22T09:45:36.838 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 15793 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-lm3530.ko 2023-12-22T09:45:36.838 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 30505 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-lm3533.ko 2023-12-22T09:45:36.838 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 19353 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-lm355x.ko 2023-12-22T09:45:36.838 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 19961 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-lm3642.ko 2023-12-22T09:45:36.838 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 16241 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-lp3944.ko 2023-12-22T09:45:36.838 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11233 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-lp8788.ko 2023-12-22T09:45:36.838 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 14929 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-max8997.ko 2023-12-22T09:45:36.838 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 12545 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-mc13783.ko 2023-12-22T09:45:36.838 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13385 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-menf21bmc.ko 2023-12-22T09:45:36.838 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 20721 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-pca9532.ko 2023-12-22T09:45:36.839 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 20481 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-pca955x.ko 2023-12-22T09:45:36.839 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 17857 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-pca963x.ko 2023-12-22T09:45:36.839 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 34433 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-ss4200.ko 2023-12-22T09:45:36.839 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 24865 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-tca6507.ko 2023-12-22T09:45:36.839 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 15665 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-wm831x-status.ko 2023-12-22T09:45:36.839 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11841 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-wm8350.ko 2023-12-22T09:45:36.839 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/trigger/ 2023-12-22T09:45:36.839 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 9985 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-12-22T09:45:36.839 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 10873 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-12-22T09:45:36.839 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 9089 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-12-22T09:45:36.839 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 7617 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-12-22T09:45:36.839 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 14249 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-12-22T09:45:36.839 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 14073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-12-22T09:45:36.839 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11889 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-12-22T09:45:36.839 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 14073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-12-22T09:45:36.840 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/ 2023-12-22T09:45:36.840 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/bcache/ 2023-12-22T09:45:36.840 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 654969 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/bcache/bcache.ko 2023-12-22T09:45:36.840 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 40577 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-bio-prison.ko 2023-12-22T09:45:36.840 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 89601 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-bufio.ko 2023-12-22T09:45:36.840 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 47529 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-cache-smq.ko 2023-12-22T09:45:36.840 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 156009 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-cache.ko 2023-12-22T09:45:36.840 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 106897 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-crypt.ko 2023-12-22T09:45:36.840 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 21545 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-delay.ko 2023-12-22T09:45:36.840 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 53857 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-era.ko 2023-12-22T09:45:36.840 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 28465 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-flakey.ko 2023-12-22T09:45:36.840 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 41529 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-log-userspace.ko 2023-12-22T09:45:36.840 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 32737 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-log.ko 2023-12-22T09:45:36.840 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 49545 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-mirror.ko 2023-12-22T09:45:36.841 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 78033 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-multipath.ko 2023-12-22T09:45:36.841 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 16473 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-queue-length.ko 2023-12-22T09:45:36.841 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 70825 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-raid.ko 2023-12-22T09:45:36.841 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 36297 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-region-hash.ko 2023-12-22T09:45:36.841 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 15873 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-round-robin.ko 2023-12-22T09:45:36.841 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 16801 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-service-time.ko 2023-12-22T09:45:36.841 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 109529 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-snapshot.ko 2023-12-22T09:45:36.841 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 19361 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-switch.ko 2023-12-22T09:45:36.841 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 181865 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-thin-pool.ko 2023-12-22T09:45:36.841 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 51737 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-verity.ko 2023-12-22T09:45:36.841 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 8561 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-zero.ko 2023-12-22T09:45:36.841 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 15345 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/faulty.ko 2023-12-22T09:45:36.841 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 19625 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/linear.ko 2023-12-22T09:45:36.841 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 32417 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/multipath.ko 2023-12-22T09:45:36.842 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/persistent-data/ 2023-12-22T09:45:36.842 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 199937 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-12-22T09:45:36.842 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 37337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/raid0.ko 2023-12-22T09:45:36.842 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 113073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/raid1.ko 2023-12-22T09:45:36.842 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 158681 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/raid10.ko 2023-12-22T09:45:36.842 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 395721 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/raid456.ko 2023-12-22T09:45:36.842 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/message/ 2023-12-22T09:45:36.842 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/message/fusion/ 2023-12-22T09:45:36.842 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 178137 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/message/fusion/mptbase.ko 2023-12-22T09:45:36.842 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 63385 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/message/fusion/mptctl.ko 2023-12-22T09:45:36.842 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 44665 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/message/fusion/mptfc.ko 2023-12-22T09:45:36.842 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 37225 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/message/fusion/mptlan.ko 2023-12-22T09:45:36.843 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 123321 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/message/fusion/mptsas.ko 2023-12-22T09:45:36.843 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 79041 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/message/fusion/mptscsih.ko 2023-12-22T09:45:36.843 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 53017 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/message/fusion/mptspi.ko 2023-12-22T09:45:36.843 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/ 2023-12-22T09:45:36.843 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 17305 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/88pm800.ko 2023-12-22T09:45:36.843 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 12761 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/88pm805.ko 2023-12-22T09:45:36.843 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11193 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/88pm80x.ko 2023-12-22T09:45:36.843 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11865 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/arizona-i2c.ko 2023-12-22T09:45:36.843 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 123721 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/arizona.ko 2023-12-22T09:45:36.843 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11961 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/bcm590xx.ko 2023-12-22T09:45:36.843 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 17465 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/cros_ec_dev.ko 2023-12-22T09:45:36.843 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 34961 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/dln2.ko 2023-12-22T09:45:36.843 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 16689 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/janz-cmodio.ko 2023-12-22T09:45:36.843 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 53585 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/kempld-core.ko 2023-12-22T09:45:36.844 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 27529 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/lm3533-core.ko 2023-12-22T09:45:36.844 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 14993 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-12-22T09:45:36.844 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13009 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/lp3943.ko 2023-12-22T09:45:36.844 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 54569 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/lpc_ich.ko 2023-12-22T09:45:36.844 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 12113 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/lpc_sch.ko 2023-12-22T09:45:36.844 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 17409 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/max8907.ko 2023-12-22T09:45:36.844 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 29857 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/mc13xxx-core.ko 2023-12-22T09:45:36.844 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11801 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-12-22T09:45:36.844 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11593 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/menf21bmc.ko 2023-12-22T09:45:36.844 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 17329 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/pcf50633-adc.ko 2023-12-22T09:45:36.844 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 9153 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/pcf50633-gpio.ko 2023-12-22T09:45:36.844 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 34873 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/pcf50633.ko 2023-12-22T09:45:36.844 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 10105 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-12-22T09:45:36.844 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 20289 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/retu-mfd.ko 2023-12-22T09:45:36.844 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 80425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/si476x-core.ko 2023-12-22T09:45:36.845 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 48457 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/sm501.ko 2023-12-22T09:45:36.845 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 19825 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-12-22T09:45:36.845 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 51137 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/tps65010.ko 2023-12-22T09:45:36.845 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 10353 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/tps6507x.ko 2023-12-22T09:45:36.845 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13329 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/viperboard.ko 2023-12-22T09:45:36.845 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 10537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/vx855.ko 2023-12-22T09:45:36.845 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 17953 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/wl1273-core.ko 2023-12-22T09:45:36.845 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 44345 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/wm8994.ko 2023-12-22T09:45:36.845 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/ 2023-12-22T09:45:36.845 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13833 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-12-22T09:45:36.845 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 48489 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/ad525x_dpot.ko 2023-12-22T09:45:36.845 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/altera-stapl/ 2023-12-22T09:45:36.845 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 46585 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-12-22T09:45:36.845 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 18393 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/apds9802als.ko 2023-12-22T09:45:36.846 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 36729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/apds990x.ko 2023-12-22T09:45:36.846 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 45593 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/bh1770glc.ko 2023-12-22T09:45:36.846 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/c2port/ 2023-12-22T09:45:36.846 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11145 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-12-22T09:45:36.846 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 35281 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/c2port/core.ko 2023-12-22T09:45:36.846 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/cb710/ 2023-12-22T09:45:36.846 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 25161 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/cb710/cb710.ko 2023-12-22T09:45:36.846 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 17801 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/ds1682.ko 2023-12-22T09:45:36.846 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 8897 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/dummy-irq.ko 2023-12-22T09:45:36.846 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/echo/ 2023-12-22T09:45:36.846 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13657 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/echo/echo.ko 2023-12-22T09:45:36.846 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/eeprom/ 2023-12-22T09:45:36.846 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 37849 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/eeprom/at24.ko 2023-12-22T09:45:36.846 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 14321 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/eeprom/eeprom.ko 2023-12-22T09:45:36.846 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 14769 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-12-22T09:45:36.847 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/eeprom/max6875.ko 2023-12-22T09:45:36.847 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 33009 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/enclosure.ko 2023-12-22T09:45:36.847 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/genwqe/ 2023-12-22T09:45:36.847 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 152201 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-12-22T09:45:36.847 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 14129 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/hmc6352.ko 2023-12-22T09:45:36.847 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 31257 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/hpilo.ko 2023-12-22T09:45:36.847 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/ibmasm/ 2023-12-22T09:45:36.847 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 72129 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-12-22T09:45:36.847 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 19785 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/ics932s401.ko 2023-12-22T09:45:36.847 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 21681 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/isl29003.ko 2023-12-22T09:45:36.847 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 15753 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/isl29020.ko 2023-12-22T09:45:36.847 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/lis3lv02d/ 2023-12-22T09:45:36.847 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 42513 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-12-22T09:45:36.847 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13857 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-12-22T09:45:36.847 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/mei/ 2023-12-22T09:45:36.848 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 125209 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/mei/mei-me.ko 2023-12-22T09:45:36.848 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 56521 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/mei/mei-txe.ko 2023-12-22T09:45:36.848 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 310113 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/mei/mei.ko 2023-12-22T09:45:36.848 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 31329 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/phantom.ko 2023-12-22T09:45:36.848 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/ti-st/ 2023-12-22T09:45:36.848 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 74265 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/ti-st/st_drv.ko 2023-12-22T09:45:36.848 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 24305 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/tifm_7xx1.ko 2023-12-22T09:45:36.848 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 28785 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/tifm_core.ko 2023-12-22T09:45:36.848 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 18729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/tsl2550.ko 2023-12-22T09:45:36.848 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 48697 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/vmw_balloon.ko 2023-12-22T09:45:36.848 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/vmw_vmci/ 2023-12-22T09:45:36.848 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 183609 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-12-22T09:45:36.848 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ 2023-12-22T09:45:36.848 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/bonding/ 2023-12-22T09:45:36.849 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 490129 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/bonding/bonding.ko 2023-12-22T09:45:36.849 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/dsa/ 2023-12-22T09:45:36.849 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/dsa/b53/ 2023-12-22T09:45:36.849 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 106033 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/dsa/b53/b53_common.ko 2023-12-22T09:45:36.849 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 40417 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/dsa/bcm-sf2.ko 2023-12-22T09:45:36.849 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 16041 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/dsa/mv88e6060.ko 2023-12-22T09:45:36.849 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/dsa/mv88e6xxx/ 2023-12-22T09:45:36.849 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 453737 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-12-22T09:45:36.849 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 16929 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/dummy.ko 2023-12-22T09:45:36.849 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 17961 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/eql.ko 2023-12-22T09:45:36.849 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/ 2023-12-22T09:45:36.849 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/3com/ 2023-12-22T09:45:36.849 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 45785 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-12-22T09:45:36.849 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 42105 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-12-22T09:45:36.849 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 130553 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-12-22T09:45:36.850 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 68849 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-12-22T09:45:36.850 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/8390/ 2023-12-22T09:45:36.850 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 37649 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/8390/8390.ko 2023-12-22T09:45:36.850 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 59689 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-12-22T09:45:36.850 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 27201 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-12-22T09:45:36.850 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 99049 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-12-22T09:45:36.850 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/adaptec/ 2023-12-22T09:45:36.850 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 54521 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-12-22T09:45:36.850 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/agere/ 2023-12-22T09:45:36.850 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 69137 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/agere/et131x.ko 2023-12-22T09:45:36.850 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/alteon/ 2023-12-22T09:45:36.850 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 59585 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-12-22T09:45:36.850 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/altera/ 2023-12-22T09:45:36.850 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 41409 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-12-22T09:45:36.850 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/amd/ 2023-12-22T09:45:36.851 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 54609 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-12-22T09:45:36.851 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 49289 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-12-22T09:45:36.851 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 87297 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-12-22T09:45:36.851 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/atheros/ 2023-12-22T09:45:36.851 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/atheros/alx/ 2023-12-22T09:45:36.851 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 97337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-12-22T09:45:36.851 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-12-22T09:45:36.851 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 104673 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-12-22T09:45:36.851 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-12-22T09:45:36.851 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 90257 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-12-22T09:45:36.851 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/atheros/atlx/ 2023-12-22T09:45:36.851 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 81569 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-12-22T09:45:36.851 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 69729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-12-22T09:45:36.851 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/broadcom/ 2023-12-22T09:45:36.852 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 78401 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-12-22T09:45:36.852 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 176761 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-12-22T09:45:36.852 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-12-22T09:45:36.852 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 1421497 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-12-22T09:45:36.852 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 128569 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-12-22T09:45:36.852 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/broadcom/genet/ 2023-12-22T09:45:36.852 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 132089 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-12-22T09:45:36.852 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 312081 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-12-22T09:45:36.852 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/brocade/ 2023-12-22T09:45:36.852 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/brocade/bna/ 2023-12-22T09:45:36.852 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 323513 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-12-22T09:45:36.852 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio/ 2023-12-22T09:45:36.852 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-12-22T09:45:36.852 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 193497 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-12-22T09:45:36.852 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-12-22T09:45:36.853 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 347417 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-12-22T09:45:36.853 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-12-22T09:45:36.853 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 1044497 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-12-22T09:45:36.853 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-12-22T09:45:36.853 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 166193 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-12-22T09:45:36.853 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-12-22T09:45:36.853 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 34881 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-12-22T09:45:36.853 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/cisco/ 2023-12-22T09:45:36.853 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/cisco/enic/ 2023-12-22T09:45:36.853 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 204345 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-12-22T09:45:36.853 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dec/ 2023-12-22T09:45:36.853 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dec/tulip/ 2023-12-22T09:45:36.853 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 69449 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-12-22T09:45:36.853 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 61489 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-12-22T09:45:36.854 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 141225 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-12-22T09:45:36.854 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 51497 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-12-22T09:45:36.854 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 62817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-12-22T09:45:36.854 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 31369 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-12-22T09:45:36.854 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dlink/ 2023-12-22T09:45:36.854 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 60873 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-12-22T09:45:36.854 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 62833 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-12-22T09:45:36.854 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 45721 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dnet.ko 2023-12-22T09:45:36.972 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 25185 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/ec_bhf.ko 2023-12-22T09:45:36.972 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/emulex/ 2023-12-22T09:45:36.972 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/emulex/benet/ 2023-12-22T09:45:36.972 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 281137 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-12-22T09:45:36.972 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 49457 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/ethoc.ko 2023-12-22T09:45:36.972 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 51737 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/fealnx.ko 2023-12-22T09:45:36.972 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/fujitsu/ 2023-12-22T09:45:36.973 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 45345 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-12-22T09:45:36.973 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/ 2023-12-22T09:45:36.973 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 90465 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/e100.ko 2023-12-22T09:45:36.973 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/e1000/ 2023-12-22T09:45:36.973 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 295577 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-12-22T09:45:36.973 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/e1000e/ 2023-12-22T09:45:36.973 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 584497 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-12-22T09:45:36.973 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/fm10k/ 2023-12-22T09:45:36.973 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 246209 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-12-22T09:45:36.973 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/i40e/ 2023-12-22T09:45:36.973 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 925825 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-12-22T09:45:36.973 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/iavf/ 2023-12-22T09:45:36.973 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 302937 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-12-22T09:45:36.973 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/igb/ 2023-12-22T09:45:36.974 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 514641 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-12-22T09:45:36.974 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/igbvf/ 2023-12-22T09:45:36.974 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 93593 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-12-22T09:45:36.974 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-12-22T09:45:36.974 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 734305 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-12-22T09:45:36.974 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-12-22T09:45:36.974 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 151769 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-12-22T09:45:36.974 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 86921 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/jme.ko 2023-12-22T09:45:36.974 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/marvell/ 2023-12-22T09:45:36.974 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 20977 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-12-22T09:45:36.974 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 102289 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/marvell/skge.ko 2023-12-22T09:45:36.974 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 122649 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-12-22T09:45:36.974 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/mellanox/ 2023-12-22T09:45:36.975 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-12-22T09:45:36.975 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 727601 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-12-22T09:45:36.975 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 278937 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-12-22T09:45:36.975 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-12-22T09:45:36.975 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-12-22T09:45:36.975 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 1113681 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-12-22T09:45:36.975 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/micrel/ 2023-12-22T09:45:36.975 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 53041 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-12-22T09:45:36.975 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 40993 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-12-22T09:45:36.975 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 19489 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-12-22T09:45:36.975 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 95665 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-12-22T09:45:36.975 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/myricom/ 2023-12-22T09:45:36.976 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-12-22T09:45:36.976 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 108649 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-12-22T09:45:36.976 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/natsemi/ 2023-12-22T09:45:36.976 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 73441 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-12-22T09:45:36.976 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 47777 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-12-22T09:45:36.976 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/neterion/ 2023-12-22T09:45:36.976 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 150905 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-12-22T09:45:36.976 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/nvidia/ 2023-12-22T09:45:36.976 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 136721 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-12-22T09:45:36.976 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/packetengines/ 2023-12-22T09:45:36.976 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 50481 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-12-22T09:45:36.976 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 43145 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-12-22T09:45:36.977 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/qlogic/ 2023-12-22T09:45:36.977 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-12-22T09:45:36.977 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 227897 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-12-22T09:45:36.977 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 87081 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-12-22T09:45:36.977 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-12-22T09:45:36.977 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 672049 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-12-22T09:45:36.977 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/rdc/ 2023-12-22T09:45:36.977 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 43017 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-12-22T09:45:36.977 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/realtek/ 2023-12-22T09:45:36.977 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 67385 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-12-22T09:45:36.977 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 83985 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-12-22T09:45:36.977 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 29321 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/realtek/atp.ko 2023-12-22T09:45:36.977 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 189801 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-12-22T09:45:36.978 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/samsung/ 2023-12-22T09:45:36.978 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-12-22T09:45:36.978 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 104241 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-12-22T09:45:36.978 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/sfc/ 2023-12-22T09:45:36.978 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 1052497 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-12-22T09:45:36.978 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/silan/ 2023-12-22T09:45:36.978 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 47097 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-12-22T09:45:36.978 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/sis/ 2023-12-22T09:45:36.978 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 54817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/sis/sis190.ko 2023-12-22T09:45:36.978 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 63337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/sis/sis900.ko 2023-12-22T09:45:36.978 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/smsc/ 2023-12-22T09:45:36.978 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 61537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-12-22T09:45:36.978 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 67193 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-12-22T09:45:36.978 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 73409 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-12-22T09:45:36.979 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 68177 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-12-22T09:45:36.979 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/stmicro/ 2023-12-22T09:45:36.979 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-12-22T09:45:36.979 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13441 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-12-22T09:45:36.979 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 39905 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-12-22T09:45:36.979 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 20657 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-12-22T09:45:36.979 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 487025 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-12-22T09:45:36.979 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/sun/ 2023-12-22T09:45:36.979 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 103337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/sun/cassini.ko 2023-12-22T09:45:36.979 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 166097 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/sun/niu.ko 2023-12-22T09:45:36.979 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 66329 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/sun/sungem.ko 2023-12-22T09:45:36.979 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 78801 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-12-22T09:45:36.979 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/tehuti/ 2023-12-22T09:45:36.979 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 50057 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-12-22T09:45:36.980 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/ti/ 2023-12-22T09:45:36.980 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 86529 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/ti/tlan.ko 2023-12-22T09:45:36.980 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/via/ 2023-12-22T09:45:36.980 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 80273 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-12-22T09:45:36.980 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 83633 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-12-22T09:45:36.980 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/wiznet/ 2023-12-22T09:45:36.980 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 46241 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-12-22T09:45:36.980 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 30849 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-12-22T09:45:36.980 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/xircom/ 2023-12-22T09:45:36.980 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 59993 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-12-22T09:45:36.980 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/fddi/ 2023-12-22T09:45:36.981 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 41001 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/fddi/defxx.ko 2023-12-22T09:45:36.981 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/fddi/skfp/ 2023-12-22T09:45:36.981 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 216985 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/fddi/skfp/skfp.ko 2023-12-22T09:45:36.981 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 77345 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/geneve.ko 2023-12-22T09:45:36.981 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/hyperv/ 2023-12-22T09:45:36.981 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 235521 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-12-22T09:45:36.981 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ieee802154/ 2023-12-22T09:45:36.981 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 18273 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ieee802154/fakelb.ko 2023-12-22T09:45:36.981 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 25065 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ifb.ko 2023-12-22T09:45:36.981 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ipvlan/ 2023-12-22T09:45:36.981 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 83769 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ipvlan/ipvlan.ko 2023-12-22T09:45:36.981 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 62145 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/macvlan.ko 2023-12-22T09:45:36.981 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 15865 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/macvtap.ko 2023-12-22T09:45:36.982 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/mdio/ 2023-12-22T09:45:36.982 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 20569 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-12-22T09:45:36.982 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 14185 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-12-22T09:45:36.982 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13681 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/mdio/mdio-gpio.ko 2023-12-22T09:45:36.982 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 8825 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/mdio/mdio-regmap.ko 2023-12-22T09:45:36.982 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 16025 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/mdio.ko 2023-12-22T09:45:36.982 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 20513 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/mii.ko 2023-12-22T09:45:36.982 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 43953 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/netconsole.ko 2023-12-22T09:45:36.982 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13145 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/nlmon.ko 2023-12-22T09:45:36.982 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/pcs/ 2023-12-22T09:45:36.983 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 17985 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/pcs/pcs-lynx.ko 2023-12-22T09:45:36.983 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 38977 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-12-22T09:45:36.983 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/ 2023-12-22T09:45:36.983 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 9737 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/amd.ko 2023-12-22T09:45:36.983 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 50033 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-12-22T09:45:36.983 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 44721 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/bcm7xxx.ko 2023-12-22T09:45:36.983 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11521 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/bcm87xx.ko 2023-12-22T09:45:36.983 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 42241 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/broadcom.ko 2023-12-22T09:45:36.984 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 10625 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/cicada.ko 2023-12-22T09:45:36.984 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13025 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/davicom.ko 2023-12-22T09:45:36.984 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 9449 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/et1011c.ko 2023-12-22T09:45:36.984 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 24969 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/icplus.ko 2023-12-22T09:45:36.984 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 15849 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/lxt.ko 2023-12-22T09:45:36.984 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 82049 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/marvell.ko 2023-12-22T09:45:36.984 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 76113 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/micrel.ko 2023-12-22T09:45:36.984 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 12033 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/national.ko 2023-12-22T09:45:36.984 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 97857 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/phylink.ko 2023-12-22T09:45:36.984 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 10065 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/qsemi.ko 2023-12-22T09:45:36.984 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 50065 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/realtek.ko 2023-12-22T09:45:36.984 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 29985 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/smsc.ko 2023-12-22T09:45:36.984 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 10857 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/ste10Xp.ko 2023-12-22T09:45:36.984 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 24289 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/vitesse.ko 2023-12-22T09:45:36.985 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/plip/ 2023-12-22T09:45:36.985 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 43505 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/plip/plip.ko 2023-12-22T09:45:36.985 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ppp/ 2023-12-22T09:45:36.985 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 15857 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ppp/bsd_comp.ko 2023-12-22T09:45:36.985 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 29713 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ppp/ppp_async.ko 2023-12-22T09:45:36.985 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 17665 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ppp/ppp_deflate.ko 2023-12-22T09:45:36.985 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 18625 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ppp/ppp_mppe.ko 2023-12-22T09:45:36.985 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 28729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ppp/ppp_synctty.ko 2023-12-22T09:45:36.985 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 42545 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ppp/pppoe.ko 2023-12-22T09:45:36.985 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13441 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ppp/pppox.ko 2023-12-22T09:45:36.985 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 32689 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ppp/pptp.ko 2023-12-22T09:45:36.985 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 28289 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/sb1000.ko 2023-12-22T09:45:36.985 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/slip/ 2023-12-22T09:45:36.986 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 42465 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/slip/slip.ko 2023-12-22T09:45:36.986 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 26929 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/sungem_phy.ko 2023-12-22T09:45:36.986 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 64449 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/tap.ko 2023-12-22T09:45:36.986 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/team/ 2023-12-22T09:45:36.986 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 106169 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/team/team.ko 2023-12-22T09:45:36.986 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13497 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/team/team_mode_activebackup.ko 2023-12-22T09:45:36.986 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 10209 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/team/team_mode_broadcast.ko 2023-12-22T09:45:36.986 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 28881 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-12-22T09:45:36.986 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 9641 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/team/team_mode_random.ko 2023-12-22T09:45:36.986 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 9321 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-12-22T09:45:36.986 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 87017 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/veth.ko 2023-12-22T09:45:36.986 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/vmxnet3/ 2023-12-22T09:45:36.987 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 144297 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-12-22T09:45:36.987 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/vxlan/ 2023-12-22T09:45:36.987 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 297329 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/vxlan/vxlan.ko 2023-12-22T09:45:36.987 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/xen-netback/ 2023-12-22T09:45:36.987 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 144585 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/xen-netback/xen-netback.ko 2023-12-22T09:45:36.987 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ntb/ 2023-12-22T09:45:36.987 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 20969 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ntb/ntb.ko 2023-12-22T09:45:36.987 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/nvme/ 2023-12-22T09:45:36.987 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/nvme/host/ 2023-12-22T09:45:36.987 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 265121 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/nvme/host/nvme-core.ko 2023-12-22T09:45:36.987 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 102209 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/nvme/host/nvme.ko 2023-12-22T09:45:36.987 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/parport/ 2023-12-22T09:45:36.987 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 133841 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/parport/parport.ko 2023-12-22T09:45:36.988 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 14561 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/parport/parport_cs.ko 2023-12-22T09:45:36.988 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 84465 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/parport/parport_pc.ko 2023-12-22T09:45:36.988 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 26121 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/parport/parport_serial.ko 2023-12-22T09:45:36.988 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pci/ 2023-12-22T09:45:36.988 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pci/hotplug/ 2023-12-22T09:45:36.988 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 25009 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-12-22T09:45:36.988 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 17849 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-12-22T09:45:36.988 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 20137 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-12-22T09:45:36.988 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11857 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pci/pci-stub.ko 2023-12-22T09:45:36.988 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 46465 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pci/xen-pcifront.ko 2023-12-22T09:45:36.988 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pcmcia/ 2023-12-22T09:45:36.988 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 26793 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pcmcia/i82092.ko 2023-12-22T09:45:36.989 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 145809 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pcmcia/pcmcia.ko 2023-12-22T09:45:36.989 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 62137 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pcmcia/pcmcia_core.ko 2023-12-22T09:45:36.989 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 34345 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-12-22T09:45:36.989 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 34265 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pcmcia/pd6729.ko 2023-12-22T09:45:36.989 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 112889 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pcmcia/yenta_socket.ko 2023-12-22T09:45:36.989 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/phy/ 2023-12-22T09:45:36.989 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/phy/broadcom/ 2023-12-22T09:45:36.989 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 10841 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-12-22T09:45:36.989 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/phy/samsung/ 2023-12-22T09:45:36.989 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 8441 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-12-22T09:45:36.989 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pinctrl/ 2023-12-22T09:45:36.989 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pinctrl/intel/ 2023-12-22T09:45:36.989 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 70153 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-12-22T09:45:36.990 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/ 2023-12-22T09:45:36.990 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/chrome/ 2023-12-22T09:45:36.990 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 50889 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-12-22T09:45:36.990 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 20849 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/chrome/cros_ec.ko 2023-12-22T09:45:36.990 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 21449 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-12-22T09:45:36.990 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 25417 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-12-22T09:45:36.990 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 26201 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-12-22T09:45:36.990 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 18201 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-12-22T09:45:36.990 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 17361 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-12-22T09:45:36.990 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/ 2023-12-22T09:45:36.990 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 67097 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/acer-wmi.ko 2023-12-22T09:45:36.991 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 39145 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/acerhdf.ko 2023-12-22T09:45:36.991 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 37025 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/apple-gmux.ko 2023-12-22T09:45:36.991 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 59665 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/asus-laptop.ko 2023-12-22T09:45:36.991 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 31161 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-12-22T09:45:36.991 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 127441 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/asus-wmi.ko 2023-12-22T09:45:36.991 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 36849 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/classmate-laptop.ko 2023-12-22T09:45:36.991 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 49121 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-12-22T09:45:36.991 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13961 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-12-22T09:45:36.991 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 40265 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-12-22T09:45:36.992 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 22521 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-12-22T09:45:36.992 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 36593 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/hdaps.ko 2023-12-22T09:45:36.992 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 19449 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/ibm_rtl.ko 2023-12-22T09:45:36.992 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/intel/ 2023-12-22T09:45:36.993 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 12073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-12-22T09:45:36.993 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 8985 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-12-22T09:45:36.993 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 43497 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/intel_ips.ko 2023-12-22T09:45:36.993 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 20273 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/msi-wmi.ko 2023-12-22T09:45:36.993 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 10377 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/mxm-wmi.ko 2023-12-22T09:45:36.993 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 34801 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-12-22T09:45:36.993 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 42329 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/samsung-laptop.ko 2023-12-22T09:45:36.993 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 14169 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/samsung-q10.ko 2023-12-22T09:45:36.993 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 17321 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/topstar-laptop.ko 2023-12-22T09:45:36.993 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13721 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-12-22T09:45:36.993 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 17081 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/toshiba_haps.ko 2023-12-22T09:45:36.993 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 10129 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/wmi-bmof.ko 2023-12-22T09:45:36.994 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 57569 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/wmi.ko 2023-12-22T09:45:36.994 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/ 2023-12-22T09:45:36.994 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/ 2023-12-22T09:45:36.994 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 30281 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/88pm860x_battery.ko 2023-12-22T09:45:36.994 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 33985 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/88pm860x_charger.ko 2023-12-22T09:45:36.994 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 55057 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/bq2415x_charger.ko 2023-12-22T09:45:36.994 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 54081 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/bq24190_charger.ko 2023-12-22T09:45:36.994 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 21553 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/bq24735-charger.ko 2023-12-22T09:45:36.994 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 17337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-12-22T09:45:36.994 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 19609 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/da9030_battery.ko 2023-12-22T09:45:36.994 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 19841 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/da9052-battery.ko 2023-12-22T09:45:36.994 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 29281 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/ds2760_battery.ko 2023-12-22T09:45:36.994 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 23217 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/ds2780_battery.ko 2023-12-22T09:45:36.994 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 23353 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/ds2781_battery.ko 2023-12-22T09:45:36.995 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 23649 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/ds2782_battery.ko 2023-12-22T09:45:36.995 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 20353 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/gpio-charger.ko 2023-12-22T09:45:36.995 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 18041 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/isp1704_charger.ko 2023-12-22T09:45:36.995 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 20273 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/lp8727_charger.ko 2023-12-22T09:45:36.995 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 12577 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/max14577_charger.ko 2023-12-22T09:45:36.995 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 25897 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/max17040_battery.ko 2023-12-22T09:45:36.995 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 30289 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/max17042_battery.ko 2023-12-22T09:45:36.995 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 18585 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/max8903_charger.ko 2023-12-22T09:45:36.995 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 23729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/max8925_power.ko 2023-12-22T09:45:36.995 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 21657 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/pcf50633-charger.ko 2023-12-22T09:45:36.995 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 38009 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/sbs-battery.ko 2023-12-22T09:45:36.995 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 28385 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/test_power.ko 2023-12-22T09:45:36.995 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 18865 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/tps65090-charger.ko 2023-12-22T09:45:36.995 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11969 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/wm831x_backup.ko 2023-12-22T09:45:36.996 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 24521 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/wm831x_power.ko 2023-12-22T09:45:36.996 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 22417 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/wm8350_power.ko 2023-12-22T09:45:36.996 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/powercap/ 2023-12-22T09:45:36.996 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 57729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/powercap/intel_rapl_common.ko 2023-12-22T09:45:36.996 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 17345 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/powercap/intel_rapl_msr.ko 2023-12-22T09:45:36.996 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pps/ 2023-12-22T09:45:36.996 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pps/clients/ 2023-12-22T09:45:36.996 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 15521 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pps/clients/pps-gpio.ko 2023-12-22T09:45:36.996 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13249 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pps/clients/pps-ldisc.ko 2023-12-22T09:45:36.996 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 15913 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pps/clients/pps_parport.ko 2023-12-22T09:45:36.996 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 41873 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pps/pps_core.ko 2023-12-22T09:45:36.996 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ptp/ 2023-12-22T09:45:36.996 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 66385 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ptp/ptp.ko 2023-12-22T09:45:36.997 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 16449 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ptp/ptp_kvm.ko 2023-12-22T09:45:36.997 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/ 2023-12-22T09:45:36.997 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 23497 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-88pm80x.ko 2023-12-22T09:45:36.997 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 24521 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-88pm860x.ko 2023-12-22T09:45:36.997 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 15393 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-bq32k.ko 2023-12-22T09:45:36.997 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 20105 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-da9052.ko 2023-12-22T09:45:36.997 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 18505 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-da9055.ko 2023-12-22T09:45:36.997 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 20425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-da9063.ko 2023-12-22T09:45:36.997 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 16457 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-ds1286.ko 2023-12-22T09:45:36.997 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 68577 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-ds1307.ko 2023-12-22T09:45:36.997 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 20817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-ds1374.ko 2023-12-22T09:45:36.997 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 18217 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-ds1511.ko 2023-12-22T09:45:36.997 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 16737 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-ds1553.ko 2023-12-22T09:45:36.997 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13953 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-ds1672.ko 2023-12-22T09:45:36.998 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13369 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-ds1742.ko 2023-12-22T09:45:36.998 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 14697 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-ds2404.ko 2023-12-22T09:45:36.998 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 23705 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-ds3232.ko 2023-12-22T09:45:36.998 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11081 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-em3027.ko 2023-12-22T09:45:36.998 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 24329 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-fm3130.ko 2023-12-22T09:45:36.998 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 20729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-isl12022.ko 2023-12-22T09:45:36.998 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 35969 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-isl1208.ko 2023-12-22T09:45:36.998 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 14673 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-lp8788.ko 2023-12-22T09:45:36.998 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 38097 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-m41t80.ko 2023-12-22T09:45:36.998 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 12089 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-m48t35.ko 2023-12-22T09:45:36.998 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 25945 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-m48t59.ko 2023-12-22T09:45:36.998 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 14841 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-m48t86.ko 2023-12-22T09:45:36.998 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11633 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-max6900.ko 2023-12-22T09:45:36.998 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 14673 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-max8907.ko 2023-12-22T09:45:36.999 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 15345 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-max8925.ko 2023-12-22T09:45:36.999 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 25809 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-max8997.ko 2023-12-22T09:45:36.999 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 16681 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-max8998.ko 2023-12-22T09:45:36.999 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 18513 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-12-22T09:45:36.999 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11409 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-msm6242.ko 2023-12-22T09:45:36.999 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 19625 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-palmas.ko 2023-12-22T09:45:36.999 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 46633 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-pcf2127.ko 2023-12-22T09:45:36.999 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 17977 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-pcf50633.ko 2023-12-22T09:45:36.999 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 26993 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-pcf85063.ko 2023-12-22T09:45:36.999 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 21825 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-pcf8523.ko 2023-12-22T09:45:36.999 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 29817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-pcf8563.ko 2023-12-22T09:45:36.999 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 12441 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-pcf8583.ko 2023-12-22T09:45:36.999 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 18033 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-rc5t583.ko 2023-12-22T09:45:36.999 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13049 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-rp5c01.ko 2023-12-22T09:45:37.000 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 33753 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-rs5c372.ko 2023-12-22T09:45:37.000 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 27833 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-12-22T09:45:37.000 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 25257 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-rx8025.ko 2023-12-22T09:45:37.000 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 20113 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-rx8581.ko 2023-12-22T09:45:37.000 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 21617 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-s35390a.ko 2023-12-22T09:45:37.000 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 16825 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-12-22T09:45:37.000 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 17889 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-tps6586x.ko 2023-12-22T09:45:37.000 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 21337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-tps65910.ko 2023-12-22T09:45:37.000 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 20545 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-wm831x.ko 2023-12-22T09:45:37.000 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 21089 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-wm8350.ko 2023-12-22T09:45:37.000 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 27873 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-x1205.ko 2023-12-22T09:45:37.000 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/ 2023-12-22T09:45:37.000 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 77617 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/3w-9xxx.ko 2023-12-22T09:45:37.000 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 57665 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/3w-sas.ko 2023-12-22T09:45:37.001 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 55105 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/3w-xxxx.ko 2023-12-22T09:45:37.001 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 135185 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/BusLogic.ko 2023-12-22T09:45:37.001 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 26657 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/a100u2w.ko 2023-12-22T09:45:37.001 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/aacraid/ 2023-12-22T09:45:37.001 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 272305 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/aacraid/aacraid.ko 2023-12-22T09:45:37.001 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 100617 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/advansys.ko 2023-12-22T09:45:37.001 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/aic7xxx/ 2023-12-22T09:45:37.001 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 356201 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-12-22T09:45:37.001 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 295801 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-12-22T09:45:37.001 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/aic94xx/ 2023-12-22T09:45:37.001 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 189185 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-12-22T09:45:37.001 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 24073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/am53c974.ko 2023-12-22T09:45:37.001 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/arcmsr/ 2023-12-22T09:45:37.001 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 106881 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-12-22T09:45:37.002 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 38185 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/atp870u.ko 2023-12-22T09:45:37.002 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/be2iscsi/ 2023-12-22T09:45:37.002 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 246985 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-12-22T09:45:37.002 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/bfa/ 2023-12-22T09:45:37.002 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 1171945 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/bfa/bfa.ko 2023-12-22T09:45:37.002 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/bnx2fc/ 2023-12-22T09:45:37.002 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 237273 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-12-22T09:45:37.002 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/bnx2i/ 2023-12-22T09:45:37.002 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 115369 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-12-22T09:45:37.002 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 40585 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/ch.ko 2023-12-22T09:45:37.002 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/csiostor/ 2023-12-22T09:45:37.002 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 308921 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/csiostor/csiostor.ko 2023-12-22T09:45:37.002 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/cxgbi/ 2023-12-22T09:45:37.002 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-12-22T09:45:37.003 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 76145 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-12-22T09:45:37.003 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-12-22T09:45:37.003 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 101449 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-12-22T09:45:37.003 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 146689 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-12-22T09:45:37.003 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 75553 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/dc395x.ko 2023-12-22T09:45:37.003 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 38073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/dmx3191d.ko 2023-12-22T09:45:37.003 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/esas2r/ 2023-12-22T09:45:37.003 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 212425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/esas2r/esas2r.ko 2023-12-22T09:45:37.003 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 60505 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/esp_scsi.ko 2023-12-22T09:45:37.003 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/fcoe/ 2023-12-22T09:45:37.003 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 78209 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/fcoe/fcoe.ko 2023-12-22T09:45:37.003 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 158505 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-12-22T09:45:37.003 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 18945 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/fdomain.ko 2023-12-22T09:45:37.003 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/fnic/ 2023-12-22T09:45:37.004 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 263489 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/fnic/fnic.ko 2023-12-22T09:45:37.004 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 201817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/hpsa.ko 2023-12-22T09:45:37.004 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 51209 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/hptiop.ko 2023-12-22T09:45:37.004 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 49041 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/hv_storvsc.ko 2023-12-22T09:45:37.004 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 35337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/imm.ko 2023-12-22T09:45:37.004 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 44057 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/initio.ko 2023-12-22T09:45:37.004 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 266537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/ipr.ko 2023-12-22T09:45:37.004 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 101881 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/ips.ko 2023-12-22T09:45:37.004 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/isci/ 2023-12-22T09:45:37.004 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 317153 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/isci/isci.ko 2023-12-22T09:45:37.004 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 26385 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-12-22T09:45:37.004 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 52961 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/iscsi_tcp.ko 2023-12-22T09:45:37.004 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/libfc/ 2023-12-22T09:45:37.004 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 314865 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/libfc/libfc.ko 2023-12-22T09:45:37.004 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 145585 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/libiscsi.ko 2023-12-22T09:45:37.005 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 53521 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/libiscsi_tcp.ko 2023-12-22T09:45:37.005 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/libsas/ 2023-12-22T09:45:37.005 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 216665 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/libsas/libsas.ko 2023-12-22T09:45:37.005 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/lpfc/ 2023-12-22T09:45:37.005 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 2197249 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/lpfc/lpfc.ko 2023-12-22T09:45:37.005 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/megaraid/ 2023-12-22T09:45:37.005 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 73569 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-12-22T09:45:37.005 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 33529 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-12-22T09:45:37.005 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 310617 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-12-22T09:45:37.006 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 84721 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/megaraid.ko 2023-12-22T09:45:37.006 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/mpt3sas/ 2023-12-22T09:45:37.006 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 659825 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-12-22T09:45:37.006 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/mvsas/ 2023-12-22T09:45:37.006 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 119561 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/mvsas/mvsas.ko 2023-12-22T09:45:37.006 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 78129 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/mvumi.ko 2023-12-22T09:45:37.006 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/pcmcia/ 2023-12-22T09:45:37.006 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 81625 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-12-22T09:45:37.006 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11713 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-12-22T09:45:37.006 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 20865 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-12-22T09:45:37.006 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 23857 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-12-22T09:45:37.006 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/pm8001/ 2023-12-22T09:45:37.007 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 364105 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-12-22T09:45:37.007 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 123617 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/pmcraid.ko 2023-12-22T09:45:37.007 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 34513 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/ppa.ko 2023-12-22T09:45:37.007 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 55361 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/qla1280.ko 2023-12-22T09:45:37.007 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/qla2xxx/ 2023-12-22T09:45:37.007 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 1876689 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-12-22T09:45:37.007 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 85289 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-12-22T09:45:37.007 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/qla4xxx/ 2023-12-22T09:45:37.007 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 559033 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-12-22T09:45:37.007 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 19025 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/qlogicfas408.ko 2023-12-22T09:45:37.007 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 15993 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/raid_class.ko 2023-12-22T09:45:37.007 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 238761 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/scsi_debug.ko 2023-12-22T09:45:37.007 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 173937 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/scsi_transport_fc.ko 2023-12-22T09:45:37.007 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 279313 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-12-22T09:45:37.008 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 97729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/scsi_transport_sas.ko 2023-12-22T09:45:37.008 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 73881 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/scsi_transport_spi.ko 2023-12-22T09:45:37.008 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 44993 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/scsi_transport_srp.ko 2023-12-22T09:45:37.008 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 26249 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/ses.ko 2023-12-22T09:45:37.008 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 115889 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/st.ko 2023-12-22T09:45:37.008 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 46825 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/stex.ko 2023-12-22T09:45:37.008 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/sym53c8xx_2/ 2023-12-22T09:45:37.008 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 162121 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-12-22T09:45:37.008 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 42297 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/virtio_scsi.ko 2023-12-22T09:45:37.008 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 50321 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/vmw_pvscsi.ko 2023-12-22T09:45:37.008 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 39961 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/wd719x.ko 2023-12-22T09:45:37.008 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 50025 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/xen-scsifront.ko 2023-12-22T09:45:37.008 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ssb/ 2023-12-22T09:45:37.008 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 129441 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ssb/ssb.ko 2023-12-22T09:45:37.009 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/ 2023-12-22T09:45:37.009 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/iscsi/ 2023-12-22T09:45:37.009 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 736601 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-12-22T09:45:37.009 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/loopback/ 2023-12-22T09:45:37.009 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 49985 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/loopback/tcm_loop.ko 2023-12-22T09:45:37.009 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 39713 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/target_core_file.ko 2023-12-22T09:45:37.009 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 43025 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/target_core_iblock.ko 2023-12-22T09:45:37.009 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 930257 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/target_core_mod.ko 2023-12-22T09:45:37.009 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 44305 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/target_core_pscsi.ko 2023-12-22T09:45:37.009 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 122521 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/target_core_user.ko 2023-12-22T09:45:37.009 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/tcm_fc/ 2023-12-22T09:45:37.009 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 75593 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-12-22T09:45:37.009 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/ 2023-12-22T09:45:37.010 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/ 2023-12-22T09:45:37.010 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/ 2023-12-22T09:45:37.010 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 23481 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-12-22T09:45:37.010 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 29321 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-12-22T09:45:37.010 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 9953 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-12-22T09:45:37.010 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 10257 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-12-22T09:45:37.010 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 15081 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-12-22T09:45:37.010 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 16497 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-12-22T09:45:37.010 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 26809 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-12-22T09:45:37.010 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 20281 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-12-22T09:45:37.010 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 14865 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-12-22T09:45:37.010 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 14393 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-12-22T09:45:37.011 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13001 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-12-22T09:45:37.011 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 37065 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-12-22T09:45:37.011 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 30729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-12-22T09:45:37.011 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 18937 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-12-22T09:45:37.011 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11521 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-12-22T09:45:37.011 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 26425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-12-22T09:45:37.011 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/ 2023-12-22T09:45:37.011 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/ipwireless/ 2023-12-22T09:45:37.011 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 78425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-12-22T09:45:37.011 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 57865 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/moxa.ko 2023-12-22T09:45:37.011 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 50953 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/mxser.ko 2023-12-22T09:45:37.011 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 108601 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/n_gsm.ko 2023-12-22T09:45:37.011 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 31961 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/n_hdlc.ko 2023-12-22T09:45:37.011 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 67929 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/nozomi.ko 2023-12-22T09:45:37.012 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/serial/ 2023-12-22T09:45:37.012 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/serial/8250/ 2023-12-22T09:45:37.012 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 35753 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-12-22T09:45:37.012 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 59497 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-12-22T09:45:37.012 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 18097 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-12-22T09:45:37.012 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 22577 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/serial/altera_uart.ko 2023-12-22T09:45:37.012 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 9425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/serial/arc_uart.ko 2023-12-22T09:45:37.012 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 72425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-12-22T09:45:37.012 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/serial/jsm/ 2023-12-22T09:45:37.012 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 103073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/serial/jsm/jsm.ko 2023-12-22T09:45:37.012 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 28785 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/serial/rp2.ko 2023-12-22T09:45:37.012 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 52817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/serial/sc16is7xx.ko 2023-12-22T09:45:37.012 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ufs/ 2023-12-22T09:45:37.013 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ufs/core/ 2023-12-22T09:45:37.013 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 531265 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ufs/core/ufshcd-core.ko 2023-12-22T09:45:37.013 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ufs/host/ 2023-12-22T09:45:37.013 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 28481 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-12-22T09:45:37.013 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 14601 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-12-22T09:45:37.013 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/uio/ 2023-12-22T09:45:37.013 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 44513 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/uio/uio.ko 2023-12-22T09:45:37.013 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 12241 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/uio/uio_aec.ko 2023-12-22T09:45:37.013 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11281 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/uio/uio_cif.ko 2023-12-22T09:45:37.013 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 18329 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/uio/uio_dmem_genirq.ko 2023-12-22T09:45:37.014 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 12937 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/uio/uio_mf624.ko 2023-12-22T09:45:37.014 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 12177 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/uio/uio_netx.ko 2023-12-22T09:45:37.014 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 10601 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/uio/uio_pci_generic.ko 2023-12-22T09:45:37.014 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 16057 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-12-22T09:45:37.014 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13633 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/uio/uio_sercos3.ko 2023-12-22T09:45:37.014 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/ 2023-12-22T09:45:37.014 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/c67x00/ 2023-12-22T09:45:37.014 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 73297 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/c67x00/c67x00.ko 2023-12-22T09:45:37.014 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/chipidea/ 2023-12-22T09:45:37.014 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 144377 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-12-22T09:45:37.014 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 18505 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-12-22T09:45:37.014 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 12713 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-12-22T09:45:37.014 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13057 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-12-22T09:45:37.014 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/class/ 2023-12-22T09:45:37.015 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 87089 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/class/cdc-acm.ko 2023-12-22T09:45:37.015 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 51345 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/class/cdc-wdm.ko 2023-12-22T09:45:37.015 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 47305 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/class/usblp.ko 2023-12-22T09:45:37.015 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 89857 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/class/usbtmc.ko 2023-12-22T09:45:37.015 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/common/ 2023-12-22T09:45:37.015 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 22953 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/common/ulpi.ko 2023-12-22T09:45:37.015 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/dwc2/ 2023-12-22T09:45:37.015 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11529 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-12-22T09:45:37.015 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/dwc3/ 2023-12-22T09:45:37.015 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 12089 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-12-22T09:45:37.015 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 30041 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-12-22T09:45:37.015 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 448505 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/dwc3/dwc3.ko 2023-12-22T09:45:37.015 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/ 2023-12-22T09:45:37.015 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/function/ 2023-12-22T09:45:37.016 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 60177 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/function/u_ether.ko 2023-12-22T09:45:37.016 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 51881 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/function/u_serial.ko 2023-12-22T09:45:37.016 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 28841 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-12-22T09:45:37.016 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 42449 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-12-22T09:45:37.016 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 27953 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-12-22T09:45:37.016 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 36513 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-12-22T09:45:37.016 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 92489 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-12-22T09:45:37.016 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 51049 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-12-22T09:45:37.016 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 122081 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-12-22T09:45:37.016 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 57681 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-12-22T09:45:37.016 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 22185 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-12-22T09:45:37.016 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 31265 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-12-22T09:45:37.016 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 57729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-12-22T09:45:37.016 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 85609 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-12-22T09:45:37.017 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 19273 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-12-22T09:45:37.017 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 58113 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-12-22T09:45:37.017 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 67337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-12-22T09:45:37.017 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/legacy/ 2023-12-22T09:45:37.017 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 21265 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-12-22T09:45:37.017 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 18057 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-12-22T09:45:37.017 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 18465 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-12-22T09:45:37.017 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 21657 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-12-22T09:45:37.017 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 28401 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-12-22T09:45:37.017 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 19009 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-12-22T09:45:37.017 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 20409 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-12-22T09:45:37.017 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 16977 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-12-22T09:45:37.017 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 32073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-12-22T09:45:37.017 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 16793 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-12-22T09:45:37.018 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 19393 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-12-22T09:45:37.018 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 27201 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-12-22T09:45:37.018 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 62185 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-12-22T09:45:37.018 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 15201 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-12-22T09:45:37.018 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 161225 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/libcomposite.ko 2023-12-22T09:45:37.018 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/udc/ 2023-12-22T09:45:37.018 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 17705 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-12-22T09:45:37.018 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/udc/bdc/ 2023-12-22T09:45:37.018 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 157681 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-12-22T09:45:37.018 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 36089 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-12-22T09:45:37.018 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 52721 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-12-22T09:45:37.018 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 69705 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-12-22T09:45:37.018 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 56033 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-12-22T09:45:37.018 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 76057 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/udc/net2272.ko 2023-12-22T09:45:37.019 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 75073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/udc/net2280.ko 2023-12-22T09:45:37.019 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 73169 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-12-22T09:45:37.019 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 65809 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-12-22T09:45:37.019 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 66097 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-12-22T09:45:37.019 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 81505 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-12-22T09:45:37.019 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 156073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-12-22T09:45:37.019 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/host/ 2023-12-22T09:45:37.019 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11585 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/host/bcma-hcd.ko 2023-12-22T09:45:37.019 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 80113 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/host/isp116x-hcd.ko 2023-12-22T09:45:37.020 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 87353 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-12-22T09:45:37.020 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 78873 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-12-22T09:45:37.020 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 51329 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/host/sl811-hcd.ko 2023-12-22T09:45:37.020 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 15593 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/host/sl811_cs.ko 2023-12-22T09:45:37.020 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13305 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/host/ssb-hcd.ko 2023-12-22T09:45:37.020 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 25945 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-12-22T09:45:37.020 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/image/ 2023-12-22T09:45:37.020 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 34585 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/image/mdc800.ko 2023-12-22T09:45:37.020 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 21081 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/image/microtek.ko 2023-12-22T09:45:37.020 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/ 2023-12-22T09:45:37.020 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 41721 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/adutux.ko 2023-12-22T09:45:37.020 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 20713 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/appledisplay.ko 2023-12-22T09:45:37.020 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 17721 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-12-22T09:45:37.020 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 23049 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/cytherm.ko 2023-12-22T09:45:37.021 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/ehset.ko 2023-12-22T09:45:37.021 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 15057 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/emi26.ko 2023-12-22T09:45:37.021 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 15985 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/emi62.ko 2023-12-22T09:45:37.021 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11433 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/ezusb.ko 2023-12-22T09:45:37.021 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 19297 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/idmouse.ko 2023-12-22T09:45:37.021 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 36553 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/iowarrior.ko 2023-12-22T09:45:37.021 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11593 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/isight_firmware.ko 2023-12-22T09:45:37.021 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 36529 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/ldusb.ko 2023-12-22T09:45:37.021 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 36265 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/legousbtower.ko 2023-12-22T09:45:37.021 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 27793 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/lvstest.ko 2023-12-22T09:45:37.021 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/sisusbvga/ 2023-12-22T09:45:37.021 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 64841 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-12-22T09:45:37.022 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 12937 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/trancevibrator.ko 2023-12-22T09:45:37.022 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 20473 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/usb3503.ko 2023-12-22T09:45:37.022 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 25145 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/usblcd.ko 2023-12-22T09:45:37.022 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 22753 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/usbsevseg.ko 2023-12-22T09:45:37.022 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 70809 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/usbtest.ko 2023-12-22T09:45:37.022 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 41905 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/uss720.ko 2023-12-22T09:45:37.022 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 27617 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/yurex.ko 2023-12-22T09:45:37.022 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/mon/ 2023-12-22T09:45:37.022 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 72953 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/mon/usbmon.ko 2023-12-22T09:45:37.022 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/musb/ 2023-12-22T09:45:37.022 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 301697 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/musb/musb_hdrc.ko 2023-12-22T09:45:37.022 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/phy/ 2023-12-22T09:45:37.022 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 21105 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/phy/phy-generic.ko 2023-12-22T09:45:37.022 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 20177 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-12-22T09:45:37.023 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 12257 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/phy/phy-isp1301.ko 2023-12-22T09:45:37.023 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 21745 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/phy/phy-tahvo.ko 2023-12-22T09:45:37.023 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/ 2023-12-22T09:45:37.023 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13209 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/aircable.ko 2023-12-22T09:45:37.023 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 33329 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/ark3116.ko 2023-12-22T09:45:37.023 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 26633 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/belkin_sa.ko 2023-12-22T09:45:37.023 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 38105 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/ch341.ko 2023-12-22T09:45:37.023 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 70257 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/cp210x.ko 2023-12-22T09:45:37.023 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 31057 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/cyberjack.ko 2023-12-22T09:45:37.023 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 58217 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/cypress_m8.ko 2023-12-22T09:45:37.023 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 49817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/digi_acceleport.ko 2023-12-22T09:45:37.023 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 9617 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/empeg.ko 2023-12-22T09:45:37.023 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 44273 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/f81232.ko 2023-12-22T09:45:37.023 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 175137 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/ftdi_sio.ko 2023-12-22T09:45:37.024 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 53113 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/garmin_gps.ko 2023-12-22T09:45:37.024 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 137081 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/io_edgeport.ko 2023-12-22T09:45:37.024 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 124833 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/io_ti.ko 2023-12-22T09:45:37.024 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 67769 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/ipaq.ko 2023-12-22T09:45:37.024 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 19161 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/ipw.ko 2023-12-22T09:45:37.024 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 26897 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/ir-usb.ko 2023-12-22T09:45:37.024 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 58233 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-12-22T09:45:37.024 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 107521 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/keyspan.ko 2023-12-22T09:45:37.024 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 35617 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/keyspan_pda.ko 2023-12-22T09:45:37.024 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 25665 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/kl5kusb105.ko 2023-12-22T09:45:37.024 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 33689 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/kobil_sct.ko 2023-12-22T09:45:37.024 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 32953 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/mct_u232.ko 2023-12-22T09:45:37.024 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 22033 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/metro-usb.ko 2023-12-22T09:45:37.024 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 66449 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/mos7720.ko 2023-12-22T09:45:37.025 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 78217 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/mos7840.ko 2023-12-22T09:45:37.025 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 56337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/mxuport.ko 2023-12-22T09:45:37.025 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 14025 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/navman.ko 2023-12-22T09:45:37.025 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 12009 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/omninet.ko 2023-12-22T09:45:37.025 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 24633 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/opticon.ko 2023-12-22T09:45:37.025 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 191137 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/option.ko 2023-12-22T09:45:37.025 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 39073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/oti6858.ko 2023-12-22T09:45:37.025 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 54353 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/pl2303.ko 2023-12-22T09:45:37.025 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 9737 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/qcaux.ko 2023-12-22T09:45:37.025 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 37825 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/qcserial.ko 2023-12-22T09:45:37.025 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 34321 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/quatech2.ko 2023-12-22T09:45:37.025 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 15393 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/safe_serial.ko 2023-12-22T09:45:37.025 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 51625 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/sierra.ko 2023-12-22T09:45:37.025 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 21673 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/spcp8x5.ko 2023-12-22T09:45:37.026 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 29993 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/ssu100.ko 2023-12-22T09:45:37.026 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 17265 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/symbolserial.ko 2023-12-22T09:45:37.026 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 61489 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-12-22T09:45:37.026 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 23729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-12-22T09:45:37.026 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 10241 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/usb_debug.ko 2023-12-22T09:45:37.026 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 33201 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/usb_wwan.ko 2023-12-22T09:45:37.026 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 125609 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/usbserial.ko 2023-12-22T09:45:37.026 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 28753 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/visor.ko 2023-12-22T09:45:37.026 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 37409 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/whiteheat.ko 2023-12-22T09:45:37.026 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 10537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/wishbone-serial.ko 2023-12-22T09:45:37.026 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 9289 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/xsens_mt.ko 2023-12-22T09:45:37.026 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ 2023-12-22T09:45:37.026 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 52913 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/uas.ko 2023-12-22T09:45:37.026 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 26017 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-alauda.ko 2023-12-22T09:45:37.027 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13049 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-cypress.ko 2023-12-22T09:45:37.027 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 22049 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-datafab.ko 2023-12-22T09:45:37.027 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 33497 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-12-22T09:45:37.027 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13745 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-freecom.ko 2023-12-22T09:45:37.027 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 19769 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-isd200.ko 2023-12-22T09:45:37.027 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 19361 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-12-22T09:45:37.027 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13713 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-karma.ko 2023-12-22T09:45:37.027 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 17841 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-onetouch.ko 2023-12-22T09:45:37.027 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 28441 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-realtek.ko 2023-12-22T09:45:37.027 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 28905 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-sddr09.ko 2023-12-22T09:45:37.027 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 19521 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-sddr55.ko 2023-12-22T09:45:37.027 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 35337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-usbat.ko 2023-12-22T09:45:37.027 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 179969 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/usb-storage.ko 2023-12-22T09:45:37.027 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/usbip/ 2023-12-22T09:45:37.028 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 67481 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/usbip/usbip-core.ko 2023-12-22T09:45:37.028 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 72177 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/usbip/usbip-host.ko 2023-12-22T09:45:37.028 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 107001 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-12-22T09:45:37.028 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vfio/ 2023-12-22T09:45:37.028 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vfio/pci/ 2023-12-22T09:45:37.028 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 154297 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-12-22T09:45:37.028 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 29537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vfio/pci/vfio-pci.ko 2023-12-22T09:45:37.028 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 108737 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vfio/vfio.ko 2023-12-22T09:45:37.028 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 77609 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-12-22T09:45:37.028 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vhost/ 2023-12-22T09:45:37.028 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 113785 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vhost/vhost.ko 2023-12-22T09:45:37.028 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 17009 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vhost/vhost_iotlb.ko 2023-12-22T09:45:37.028 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 58089 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vhost/vhost_net.ko 2023-12-22T09:45:37.028 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 89249 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vhost/vhost_scsi.ko 2023-12-22T09:45:37.029 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/ 2023-12-22T09:45:37.029 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/ 2023-12-22T09:45:37.029 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 15417 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-12-22T09:45:37.029 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 12393 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/aat2870_bl.ko 2023-12-22T09:45:37.029 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 23305 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/adp5520_bl.ko 2023-12-22T09:45:37.029 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 32609 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/adp8860_bl.ko 2023-12-22T09:45:37.029 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 39993 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/adp8870_bl.ko 2023-12-22T09:45:37.029 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 16921 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/apple_bl.ko 2023-12-22T09:45:37.029 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 16777 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/as3711_bl.ko 2023-12-22T09:45:37.029 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 12033 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/bd6107.ko 2023-12-22T09:45:37.029 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11409 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/da903x_bl.ko 2023-12-22T09:45:37.029 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11273 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/da9052_bl.ko 2023-12-22T09:45:37.029 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11753 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/gpio_backlight.ko 2023-12-22T09:45:37.029 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 14769 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/kb3886_bl.ko 2023-12-22T09:45:37.030 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 22017 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/lcd.ko 2023-12-22T09:45:37.030 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 23657 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/lm3533_bl.ko 2023-12-22T09:45:37.030 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 19337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/lm3639_bl.ko 2023-12-22T09:45:37.030 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/lv5207lp.ko 2023-12-22T09:45:37.030 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 14345 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/max8925_bl.ko 2023-12-22T09:45:37.030 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11313 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/pandora_bl.ko 2023-12-22T09:45:37.030 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 10865 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-12-22T09:45:37.030 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 10897 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/platform_lcd.ko 2023-12-22T09:45:37.030 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 12721 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/wm831x_bl.ko 2023-12-22T09:45:37.030 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/ 2023-12-22T09:45:37.030 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/masters/ 2023-12-22T09:45:37.031 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 18785 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/masters/ds2482.ko 2023-12-22T09:45:37.031 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 38985 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/masters/ds2490.ko 2023-12-22T09:45:37.031 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11265 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/masters/matrox_w1.ko 2023-12-22T09:45:37.031 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 12417 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/masters/w1-gpio.ko 2023-12-22T09:45:37.031 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/ 2023-12-22T09:45:37.031 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 12041 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-12-22T09:45:37.031 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 22745 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-12-22T09:45:37.031 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 15113 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-12-22T09:45:37.031 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 10825 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-12-22T09:45:37.031 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 14153 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-12-22T09:45:37.031 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11929 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-12-22T09:45:37.031 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 14049 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-12-22T09:45:37.031 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 14049 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-12-22T09:45:37.032 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 17921 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-12-22T09:45:37.032 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 7385 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_smem.ko 2023-12-22T09:45:37.032 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 56425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_therm.ko 2023-12-22T09:45:37.032 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 102673 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/wire.ko 2023-12-22T09:45:37.032 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/ 2023-12-22T09:45:37.032 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 18793 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/acquirewdt.ko 2023-12-22T09:45:37.032 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 19977 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/advantechwdt.ko 2023-12-22T09:45:37.032 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 18561 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/alim1535_wdt.ko 2023-12-22T09:45:37.032 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 22969 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/alim7101_wdt.ko 2023-12-22T09:45:37.032 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 19113 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/cpu5wdt.ko 2023-12-22T09:45:37.032 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13617 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/da9052_wdt.ko 2023-12-22T09:45:37.032 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 12777 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/da9055_wdt.ko 2023-12-22T09:45:37.032 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 17409 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/da9063_wdt.ko 2023-12-22T09:45:37.032 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 20169 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/dw_wdt.ko 2023-12-22T09:45:37.032 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 20265 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/eurotechwdt.ko 2023-12-22T09:45:37.033 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 23865 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/f71808e_wdt.ko 2023-12-22T09:45:37.033 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 27401 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/hpwdt.ko 2023-12-22T09:45:37.033 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 15577 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/i6300esb.ko 2023-12-22T09:45:37.033 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 10833 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-12-22T09:45:37.033 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 21913 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/iTCO_wdt.ko 2023-12-22T09:45:37.033 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 19241 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/ib700wdt.ko 2023-12-22T09:45:37.033 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 18689 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/ibmasr.ko 2023-12-22T09:45:37.033 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 19713 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-12-22T09:45:37.033 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 21225 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/it8712f_wdt.ko 2023-12-22T09:45:37.033 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13841 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/it87_wdt.ko 2023-12-22T09:45:37.033 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 21489 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/kempld_wdt.ko 2023-12-22T09:45:37.033 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 18617 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/machzwd.ko 2023-12-22T09:45:37.033 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 14721 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/mena21_wdt.ko 2023-12-22T09:45:37.034 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13217 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-12-22T09:45:37.034 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 24673 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/nv_tco.ko 2023-12-22T09:45:37.034 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 17737 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-12-22T09:45:37.034 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 22265 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/pc87413_wdt.ko 2023-12-22T09:45:37.034 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 38657 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/pcwd_pci.ko 2023-12-22T09:45:37.034 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 31825 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/pcwd_usb.ko 2023-12-22T09:45:37.034 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13065 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/retu_wdt.ko 2023-12-22T09:45:37.034 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 20449 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-12-22T09:45:37.034 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 14129 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-12-22T09:45:37.034 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 17321 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-12-22T09:45:37.034 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 23809 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/sc1200wdt.ko 2023-12-22T09:45:37.035 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 23321 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/sch311x_wdt.ko 2023-12-22T09:45:37.035 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 21577 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-12-22T09:45:37.035 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 17273 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/softdog.ko 2023-12-22T09:45:37.035 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 22273 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/sp5100_tco.ko 2023-12-22T09:45:37.035 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 12817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/twl4030_wdt.ko 2023-12-22T09:45:37.035 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 17649 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/via_wdt.ko 2023-12-22T09:45:37.035 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 19161 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-12-22T09:45:37.035 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 20681 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/w83877f_wdt.ko 2023-12-22T09:45:37.035 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 25409 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/w83977f_wdt.ko 2023-12-22T09:45:37.035 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 18497 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/wafer5823wdt.ko 2023-12-22T09:45:37.035 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 28089 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/wdt_pci.ko 2023-12-22T09:45:37.035 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 16257 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/wm831x_wdt.ko 2023-12-22T09:45:37.035 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13785 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/wm8350_wdt.ko 2023-12-22T09:45:37.035 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 15697 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/xen_wdt.ko 2023-12-22T09:45:37.036 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/xen/ 2023-12-22T09:45:37.036 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 24729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/xen/xen-evtchn.ko 2023-12-22T09:45:37.036 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 26769 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/xen/xen-gntalloc.ko 2023-12-22T09:45:37.036 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 47865 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/xen/xen-gntdev.ko 2023-12-22T09:45:37.036 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/xen/xen-pciback/ 2023-12-22T09:45:37.036 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 176377 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-12-22T09:45:37.036 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 40121 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/xen/xen-privcmd.ko 2023-12-22T09:45:37.036 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 71249 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/xen/xen-scsiback.ko 2023-12-22T09:45:37.036 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/xen/xenfs/ 2023-12-22T09:45:37.036 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 19425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/xen/xenfs/xenfs.ko 2023-12-22T09:45:37.036 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/ 2023-12-22T09:45:37.037 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/9p/ 2023-12-22T09:45:37.037 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 166425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/9p/9p.ko 2023-12-22T09:45:37.037 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/adfs/ 2023-12-22T09:45:37.037 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 61073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/adfs/adfs.ko 2023-12-22T09:45:37.037 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/affs/ 2023-12-22T09:45:37.037 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 163593 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/affs/affs.ko 2023-12-22T09:45:37.037 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/afs/ 2023-12-22T09:45:37.037 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 932817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/afs/kafs.ko 2023-12-22T09:45:37.037 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/autofs/ 2023-12-22T09:45:37.037 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 101057 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/autofs/autofs4.ko 2023-12-22T09:45:37.037 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/befs/ 2023-12-22T09:45:37.037 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 64545 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/befs/befs.ko 2023-12-22T09:45:37.038 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/bfs/ 2023-12-22T09:45:37.038 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 41257 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/bfs/bfs.ko 2023-12-22T09:45:37.038 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 34585 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/binfmt_misc.ko 2023-12-22T09:45:37.038 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/btrfs/ 2023-12-22T09:45:37.038 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 3402729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/btrfs/btrfs.ko 2023-12-22T09:45:37.038 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/cachefiles/ 2023-12-22T09:45:37.038 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 306009 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/cachefiles/cachefiles.ko 2023-12-22T09:45:37.038 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/ceph/ 2023-12-22T09:45:37.038 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 1331857 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/ceph/ceph.ko 2023-12-22T09:45:37.038 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/coda/ 2023-12-22T09:45:37.038 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 100801 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/coda/coda.ko 2023-12-22T09:45:37.038 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/configfs/ 2023-12-22T09:45:37.039 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 108393 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/configfs/configfs.ko 2023-12-22T09:45:37.039 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/cramfs/ 2023-12-22T09:45:37.039 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 29625 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/cramfs/cramfs.ko 2023-12-22T09:45:37.039 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/dlm/ 2023-12-22T09:45:37.039 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 642513 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/dlm/dlm.ko 2023-12-22T09:45:37.039 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/efs/ 2023-12-22T09:45:37.039 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 36649 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/efs/efs.ko 2023-12-22T09:45:37.039 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/f2fs/ 2023-12-22T09:45:37.039 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 1505025 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/f2fs/f2fs.ko 2023-12-22T09:45:37.039 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/fat/ 2023-12-22T09:45:37.039 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 27929 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/fat/msdos.ko 2023-12-22T09:45:37.039 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/freevxfs/ 2023-12-22T09:45:37.039 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 42545 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/freevxfs/freevxfs.ko 2023-12-22T09:45:37.039 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/fscache/ 2023-12-22T09:45:37.039 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 226481 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/fscache/fscache.ko 2023-12-22T09:45:37.040 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/fuse/ 2023-12-22T09:45:37.040 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 24489 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/fuse/cuse.ko 2023-12-22T09:45:37.040 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/gfs2/ 2023-12-22T09:45:37.040 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 1231529 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/gfs2/gfs2.ko 2023-12-22T09:45:37.040 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/hfs/ 2023-12-22T09:45:37.040 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 141209 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/hfs/hfs.ko 2023-12-22T09:45:37.040 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/hfsplus/ 2023-12-22T09:45:37.040 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 222817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/hfsplus/hfsplus.ko 2023-12-22T09:45:37.040 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/hpfs/ 2023-12-22T09:45:37.040 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 192329 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/hpfs/hpfs.ko 2023-12-22T09:45:37.040 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/isofs/ 2023-12-22T09:45:37.040 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 74065 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/isofs/isofs.ko 2023-12-22T09:45:37.040 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/jfs/ 2023-12-22T09:45:37.041 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 419497 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/jfs/jfs.ko 2023-12-22T09:45:37.041 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/lockd/ 2023-12-22T09:45:37.041 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 280313 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/lockd/lockd.ko 2023-12-22T09:45:37.041 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/minix/ 2023-12-22T09:45:37.041 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 89193 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/minix/minix.ko 2023-12-22T09:45:37.041 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/netfs/ 2023-12-22T09:45:37.041 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 124649 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/netfs/netfs.ko 2023-12-22T09:45:37.041 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs/ 2023-12-22T09:45:37.041 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs/blocklayout/ 2023-12-22T09:45:37.041 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 81449 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-12-22T09:45:37.041 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs/filelayout/ 2023-12-22T09:45:37.041 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 59449 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-12-22T09:45:37.041 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs/flexfilelayout/ 2023-12-22T09:45:37.041 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 117465 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-12-22T09:45:37.042 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 1055721 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs/nfs.ko 2023-12-22T09:45:37.042 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 66441 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs/nfsv2.ko 2023-12-22T09:45:37.042 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 120177 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs/nfsv3.ko 2023-12-22T09:45:37.042 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 2042137 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs/nfsv4.ko 2023-12-22T09:45:37.042 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs_common/ 2023-12-22T09:45:37.042 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 16929 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs_common/grace.ko 2023-12-22T09:45:37.042 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 16145 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs_common/nfs_acl.ko 2023-12-22T09:45:37.042 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfsd/ 2023-12-22T09:45:37.042 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 1516873 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfsd/nfsd.ko 2023-12-22T09:45:37.042 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nilfs2/ 2023-12-22T09:45:37.042 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 592833 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nilfs2/nilfs2.ko 2023-12-22T09:45:37.042 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/ 2023-12-22T09:45:37.042 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13793 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-celtic.ko 2023-12-22T09:45:37.042 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13169 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-centeuro.ko 2023-12-22T09:45:37.043 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13793 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-croatian.ko 2023-12-22T09:45:37.043 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 12865 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-cyrillic.ko 2023-12-22T09:45:37.043 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13481 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-gaelic.ko 2023-12-22T09:45:37.043 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 12857 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-greek.ko 2023-12-22T09:45:37.043 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13793 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-iceland.ko 2023-12-22T09:45:37.043 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13169 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-inuit.ko 2023-12-22T09:45:37.043 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 14097 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-roman.ko 2023-12-22T09:45:37.043 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13793 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-romanian.ko 2023-12-22T09:45:37.043 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13793 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-turkish.ko 2023-12-22T09:45:37.043 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11297 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_ascii.ko 2023-12-22T09:45:37.043 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 12537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp1250.ko 2023-12-22T09:45:37.043 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 12233 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp1251.ko 2023-12-22T09:45:37.043 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 12921 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp1255.ko 2023-12-22T09:45:37.043 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 12537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp737.ko 2023-12-22T09:45:37.044 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 12537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp775.ko 2023-12-22T09:45:37.044 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 12225 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp850.ko 2023-12-22T09:45:37.044 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 12225 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp852.ko 2023-12-22T09:45:37.044 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 12225 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp855.ko 2023-12-22T09:45:37.044 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11913 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp857.ko 2023-12-22T09:45:37.044 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 12849 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp860.ko 2023-12-22T09:45:37.044 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13161 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp861.ko 2023-12-22T09:45:37.044 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13473 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp862.ko 2023-12-22T09:45:37.044 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13161 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp863.ko 2023-12-22T09:45:37.044 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 12849 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp864.ko 2023-12-22T09:45:37.044 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13161 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp865.ko 2023-12-22T09:45:37.044 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 12537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp866.ko 2023-12-22T09:45:37.044 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 12225 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp869.ko 2023-12-22T09:45:37.045 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11985 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp874.ko 2023-12-22T09:45:37.045 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 94137 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp932.ko 2023-12-22T09:45:37.045 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 142673 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp936.ko 2023-12-22T09:45:37.045 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 165745 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp949.ko 2023-12-22T09:45:37.045 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 118121 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp950.ko 2023-12-22T09:45:37.045 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 12457 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_euc-jp.ko 2023-12-22T09:45:37.045 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11305 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-1.ko 2023-12-22T09:45:37.045 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11929 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-13.ko 2023-12-22T09:45:37.045 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11929 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-14.ko 2023-12-22T09:45:37.046 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11929 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-15.ko 2023-12-22T09:45:37.046 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11921 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-2.ko 2023-12-22T09:45:37.046 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11921 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-3.ko 2023-12-22T09:45:37.046 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11921 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-4.ko 2023-12-22T09:45:37.046 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11921 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-5.ko 2023-12-22T09:45:37.046 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11617 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-6.ko 2023-12-22T09:45:37.046 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 12233 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-7.ko 2023-12-22T09:45:37.046 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11617 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-9.ko 2023-12-22T09:45:37.046 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 12537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_koi8-r.ko 2023-12-22T09:45:37.046 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 8017 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_koi8-ru.ko 2023-12-22T09:45:37.046 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 12537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_koi8-u.ko 2023-12-22T09:45:37.046 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 7569 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_ucs2_utils.ko 2023-12-22T09:45:37.046 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 8337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_utf8.ko 2023-12-22T09:45:37.046 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/ntfs/ 2023-12-22T09:45:37.047 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 219417 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/ntfs/ntfs.ko 2023-12-22T09:45:37.047 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2/ 2023-12-22T09:45:37.047 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2/cluster/ 2023-12-22T09:45:37.047 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 244409 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-12-22T09:45:37.047 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2/dlm/ 2023-12-22T09:45:37.047 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 440737 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-12-22T09:45:37.047 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2/dlmfs/ 2023-12-22T09:45:37.047 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 54049 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-12-22T09:45:37.047 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 2592433 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2/ocfs2.ko 2023-12-22T09:45:37.047 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 17905 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-12-22T09:45:37.047 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 31729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-12-22T09:45:37.047 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 35897 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-12-22T09:45:37.047 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/omfs/ 2023-12-22T09:45:37.047 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 53433 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/omfs/omfs.ko 2023-12-22T09:45:37.048 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/overlayfs/ 2023-12-22T09:45:37.048 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 352161 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/overlayfs/overlay.ko 2023-12-22T09:45:37.048 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/pstore/ 2023-12-22T09:45:37.048 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 54809 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/pstore/ramoops.ko 2023-12-22T09:45:37.048 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/qnx4/ 2023-12-22T09:45:37.048 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 26865 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/qnx4/qnx4.ko 2023-12-22T09:45:37.048 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/qnx6/ 2023-12-22T09:45:37.048 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 46689 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/qnx6/qnx6.ko 2023-12-22T09:45:37.048 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/quota/ 2023-12-22T09:45:37.048 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 30881 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/quota/quota_tree.ko 2023-12-22T09:45:37.049 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 14297 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/quota/quota_v1.ko 2023-12-22T09:45:37.049 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 22017 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/quota/quota_v2.ko 2023-12-22T09:45:37.049 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/reiserfs/ 2023-12-22T09:45:37.049 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 532673 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/reiserfs/reiserfs.ko 2023-12-22T09:45:37.049 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/romfs/ 2023-12-22T09:45:37.049 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 28641 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/romfs/romfs.ko 2023-12-22T09:45:37.049 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/smb/ 2023-12-22T09:45:37.049 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/smb/client/ 2023-12-22T09:45:37.049 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 2668401 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/smb/client/cifs.ko 2023-12-22T09:45:37.049 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/smb/common/ 2023-12-22T09:45:37.049 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 7161 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/smb/common/cifs_arc4.ko 2023-12-22T09:45:37.049 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11257 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/smb/common/cifs_md4.ko 2023-12-22T09:45:37.050 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/squashfs/ 2023-12-22T09:45:37.050 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 134641 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/squashfs/squashfs.ko 2023-12-22T09:45:37.050 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/sysv/ 2023-12-22T09:45:37.050 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 90721 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/sysv/sysv.ko 2023-12-22T09:45:37.050 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/udf/ 2023-12-22T09:45:37.050 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 247737 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/udf/udf.ko 2023-12-22T09:45:37.050 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/ufs/ 2023-12-22T09:45:37.050 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 162497 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/ufs/ufs.ko 2023-12-22T09:45:37.050 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/xfs/ 2023-12-22T09:45:37.050 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 4011017 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/xfs/xfs.ko 2023-12-22T09:45:37.050 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/kernel/ 2023-12-22T09:45:37.050 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/kernel/locking/ 2023-12-22T09:45:37.050 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 75489 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/kernel/locking/locktorture.ko 2023-12-22T09:45:37.051 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/kernel/time/ 2023-12-22T09:45:37.051 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13737 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/kernel/time/test_udelay.ko 2023-12-22T09:45:37.051 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 60553 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/kernel/torture.ko 2023-12-22T09:45:37.051 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/ 2023-12-22T09:45:37.051 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 6833 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/crc-itu-t.ko 2023-12-22T09:45:37.051 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 6529 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/crc7.ko 2023-12-22T09:45:37.051 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 7025 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/crc8.ko 2023-12-22T09:45:37.051 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/crypto/ 2023-12-22T09:45:37.051 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 7097 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/crypto/libarc4.ko 2023-12-22T09:45:37.051 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 37081 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/crypto/libdes.ko 2023-12-22T09:45:37.051 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13313 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/interval_tree_test.ko 2023-12-22T09:45:37.052 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 8425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/libcrc32c.ko 2023-12-22T09:45:37.052 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 24953 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/lru_cache.ko 2023-12-22T09:45:37.052 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/lz4/ 2023-12-22T09:45:37.052 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 33801 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/lz4/lz4_compress.ko 2023-12-22T09:45:37.052 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 22633 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/lz4/lz4hc_compress.ko 2023-12-22T09:45:37.052 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/math/ 2023-12-22T09:45:37.052 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 6617 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/math/cordic.ko 2023-12-22T09:45:37.052 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 8233 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/memory-notifier-error-inject.ko 2023-12-22T09:45:37.052 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 10865 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/notifier-error-inject.ko 2023-12-22T09:45:37.052 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 14089 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/percpu_test.ko 2023-12-22T09:45:37.052 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 8305 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/pm-notifier-error-inject.ko 2023-12-22T09:45:37.052 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/raid6/ 2023-12-22T09:45:37.052 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 143433 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/raid6/raid6_pq.ko 2023-12-22T09:45:37.052 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 21105 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/rbtree_test.ko 2023-12-22T09:45:37.053 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/reed_solomon/ 2023-12-22T09:45:37.053 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 18753 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/reed_solomon/reed_solomon.ko 2023-12-22T09:45:37.053 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 38841 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/test-kstrtox.ko 2023-12-22T09:45:37.053 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 26321 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/test-string_helpers.ko 2023-12-22T09:45:37.053 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 4760425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/test_bpf.ko 2023-12-22T09:45:37.053 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 49089 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/test_firmware.ko 2023-12-22T09:45:37.053 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 6369 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/test_module.ko 2023-12-22T09:45:37.053 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 20801 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/test_user_copy.ko 2023-12-22T09:45:37.053 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 9585 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/ts_bm.ko 2023-12-22T09:45:37.053 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11121 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/ts_fsm.ko 2023-12-22T09:45:37.053 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 9625 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/ts_kmp.ko 2023-12-22T09:45:37.053 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/xz/ 2023-12-22T09:45:37.054 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13545 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/xz/xz_dec_test.ko 2023-12-22T09:45:37.054 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/mm/ 2023-12-22T09:45:37.054 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 15425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/mm/hwpoison-inject.ko 2023-12-22T09:45:37.054 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ 2023-12-22T09:45:37.054 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/6lowpan/ 2023-12-22T09:45:37.054 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 55737 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/6lowpan/6lowpan.ko 2023-12-22T09:45:37.054 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 7049 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/6lowpan/nhc_dest.ko 2023-12-22T09:45:37.054 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 7065 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/6lowpan/nhc_fragment.ko 2023-12-22T09:45:37.054 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 7049 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/6lowpan/nhc_hop.ko 2023-12-22T09:45:37.054 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 6985 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/6lowpan/nhc_ipv6.ko 2023-12-22T09:45:37.055 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 7065 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/6lowpan/nhc_mobility.ko 2023-12-22T09:45:37.055 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 7001 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/6lowpan/nhc_routing.ko 2023-12-22T09:45:37.055 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 15329 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/6lowpan/nhc_udp.ko 2023-12-22T09:45:37.055 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/802/ 2023-12-22T09:45:37.055 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 30385 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/802/garp.ko 2023-12-22T09:45:37.055 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 34809 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/802/mrp.ko 2023-12-22T09:45:37.055 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 8545 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/802/p8022.ko 2023-12-22T09:45:37.055 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 16345 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/802/psnap.ko 2023-12-22T09:45:37.055 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/802/stp.ko 2023-12-22T09:45:37.055 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/8021q/ 2023-12-22T09:45:37.055 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 81737 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/8021q/8021q.ko 2023-12-22T09:45:37.055 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/9p/ 2023-12-22T09:45:37.056 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 198337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/9p/9pnet.ko 2023-12-22T09:45:37.056 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 35977 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/9p/9pnet_fd.ko 2023-12-22T09:45:37.056 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 26345 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/9p/9pnet_rdma.ko 2023-12-22T09:45:37.056 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 32337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/9p/9pnet_virtio.ko 2023-12-22T09:45:37.056 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/batman-adv/ 2023-12-22T09:45:37.056 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 649297 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/batman-adv/batman-adv.ko 2023-12-22T09:45:37.056 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/ 2023-12-22T09:45:37.056 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 63809 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/br_netfilter.ko 2023-12-22T09:45:37.056 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 777689 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/bridge.ko 2023-12-22T09:45:37.056 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ 2023-12-22T09:45:37.056 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 7657 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-12-22T09:45:37.056 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 12385 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_among.ko 2023-12-22T09:45:37.056 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 9169 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_arp.ko 2023-12-22T09:45:37.056 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 9073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-12-22T09:45:37.057 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 9625 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-12-22T09:45:37.057 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 8737 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_ip.ko 2023-12-22T09:45:37.057 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 9145 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-12-22T09:45:37.057 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 9825 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_limit.ko 2023-12-22T09:45:37.057 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13217 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_log.ko 2023-12-22T09:45:37.057 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 7585 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_mark.ko 2023-12-22T09:45:37.057 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 7593 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-12-22T09:45:37.057 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 8385 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-12-22T09:45:37.057 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 7537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-12-22T09:45:37.057 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 9593 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-12-22T09:45:37.057 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 8649 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_snat.ko 2023-12-22T09:45:37.058 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 8825 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_stp.ko 2023-12-22T09:45:37.058 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 12401 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-12-22T09:45:37.058 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11529 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-12-22T09:45:37.058 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 9817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-12-22T09:45:37.058 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 9793 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-12-22T09:45:37.058 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 55929 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebtables.ko 2023-12-22T09:45:37.058 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 14041 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-12-22T09:45:37.058 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13945 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-12-22T09:45:37.058 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ceph/ 2023-12-22T09:45:37.058 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 1046897 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ceph/libceph.ko 2023-12-22T09:45:37.059 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/core/ 2023-12-22T09:45:37.059 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 125993 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/core/pktgen.ko 2023-12-22T09:45:37.059 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/dccp/ 2023-12-22T09:45:37.059 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 194209 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/dccp/dccp.ko 2023-12-22T09:45:37.059 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 8665 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/dccp/dccp_diag.ko 2023-12-22T09:45:37.059 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 57881 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/dccp/dccp_ipv4.ko 2023-12-22T09:45:37.059 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 60337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/dccp/dccp_ipv6.ko 2023-12-22T09:45:37.059 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/dsa/ 2023-12-22T09:45:37.059 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 390473 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/dsa/dsa_core.ko 2023-12-22T09:45:37.059 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/dsa/tag_brcm.ko 2023-12-22T09:45:37.059 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 12577 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/dsa/tag_dsa.ko 2023-12-22T09:45:37.059 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 7721 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/dsa/tag_none.ko 2023-12-22T09:45:37.060 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 8953 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/dsa/tag_trailer.ko 2023-12-22T09:45:37.060 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/hsr/ 2023-12-22T09:45:37.060 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 99729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/hsr/hsr.ko 2023-12-22T09:45:37.060 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ieee802154/ 2023-12-22T09:45:37.060 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ieee802154/6lowpan/ 2023-12-22T09:45:37.060 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 45233 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-12-22T09:45:37.060 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 254625 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ieee802154/ieee802154.ko 2023-12-22T09:45:37.060 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 47289 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ieee802154/ieee802154_socket.ko 2023-12-22T09:45:37.060 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/ 2023-12-22T09:45:37.060 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 24729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/ah4.ko 2023-12-22T09:45:37.060 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 38905 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/esp4.ko 2023-12-22T09:45:37.060 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 48337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/fou.ko 2023-12-22T09:45:37.060 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 18121 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/gre.ko 2023-12-22T09:45:37.060 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 48657 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/inet_diag.ko 2023-12-22T09:45:37.061 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 60633 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/ip_gre.ko 2023-12-22T09:45:37.061 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 61225 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/ip_tunnel.ko 2023-12-22T09:45:37.061 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 34505 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/ip_vti.ko 2023-12-22T09:45:37.061 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 14001 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/ipcomp.ko 2023-12-22T09:45:37.061 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 28841 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/ipip.ko 2023-12-22T09:45:37.061 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/ 2023-12-22T09:45:37.061 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 37641 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/arp_tables.ko 2023-12-22T09:45:37.061 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 8873 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-12-22T09:45:37.061 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 10409 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-12-22T09:45:37.061 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 41609 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/ip_tables.ko 2023-12-22T09:45:37.061 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 10057 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-12-22T09:45:37.061 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 9681 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-12-22T09:45:37.062 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 14121 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-12-22T09:45:37.062 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11177 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-12-22T09:45:37.062 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 14881 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-12-22T09:45:37.062 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11305 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-12-22T09:45:37.062 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11649 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-12-22T09:45:37.062 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 14905 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-12-22T09:45:37.062 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11545 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-12-22T09:45:37.062 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 10409 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/iptable_security.ko 2023-12-22T09:45:37.062 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 12425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-12-22T09:45:37.062 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 8817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-12-22T09:45:37.062 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 27625 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-12-22T09:45:37.062 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 18161 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-12-22T09:45:37.063 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-12-22T09:45:37.063 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 20561 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-12-22T09:45:37.063 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 9329 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-12-22T09:45:37.063 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 15177 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-12-22T09:45:37.063 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 9961 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-12-22T09:45:37.063 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 17113 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-12-22T09:45:37.063 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 9009 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-12-22T09:45:37.063 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_bic.ko 2023-12-22T09:45:37.063 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13737 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_dctcp.ko 2023-12-22T09:45:37.063 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 15369 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_diag.ko 2023-12-22T09:45:37.063 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 9537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_highspeed.ko 2023-12-22T09:45:37.063 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 12401 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_htcp.ko 2023-12-22T09:45:37.063 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 10449 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_hybla.ko 2023-12-22T09:45:37.063 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11473 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_illinois.ko 2023-12-22T09:45:37.064 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 10433 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_lp.ko 2023-12-22T09:45:37.064 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 8329 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_scalable.ko 2023-12-22T09:45:37.064 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 14425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_vegas.ko 2023-12-22T09:45:37.064 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 10089 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_veno.ko 2023-12-22T09:45:37.064 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 10953 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_westwood.ko 2023-12-22T09:45:37.064 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 10185 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_yeah.ko 2023-12-22T09:45:37.064 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 22601 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tunnel4.ko 2023-12-22T09:45:37.064 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 17097 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/udp_diag.ko 2023-12-22T09:45:37.064 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 41665 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/udp_tunnel.ko 2023-12-22T09:45:37.064 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11361 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/xfrm4_tunnel.ko 2023-12-22T09:45:37.064 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/ 2023-12-22T09:45:37.064 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 26377 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/ah6.ko 2023-12-22T09:45:37.064 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 39537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/esp6.ko 2023-12-22T09:45:37.065 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 14425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/fou6.ko 2023-12-22T09:45:37.065 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 80897 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/ip6_gre.ko 2023-12-22T09:45:37.065 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 93577 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/ip6_tunnel.ko 2023-12-22T09:45:37.065 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 10825 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-12-22T09:45:37.065 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 53273 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/ip6_vti.ko 2023-12-22T09:45:37.065 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13785 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/ipcomp6.ko 2023-12-22T09:45:37.065 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 19017 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/mip6.ko 2023-12-22T09:45:37.065 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ 2023-12-22T09:45:37.065 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 42169 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-12-22T09:45:37.065 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11753 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-12-22T09:45:37.065 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 9753 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-12-22T09:45:37.065 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 14137 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-12-22T09:45:37.065 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 14273 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-12-22T09:45:37.065 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 7801 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-12-22T09:45:37.066 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 16209 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-12-22T09:45:37.066 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 16033 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-12-22T09:45:37.066 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 8913 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-12-22T09:45:37.066 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 9897 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-12-22T09:45:37.066 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 10937 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-12-22T09:45:37.066 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 10897 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-12-22T09:45:37.066 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11321 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-12-22T09:45:37.066 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11121 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-12-22T09:45:37.066 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 15009 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-12-22T09:45:37.066 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11553 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-12-22T09:45:37.066 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 10433 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-12-22T09:45:37.066 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 39113 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-12-22T09:45:37.066 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 8449 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-12-22T09:45:37.066 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 25945 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-12-22T09:45:37.067 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 9801 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-12-22T09:45:37.067 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 15393 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-12-22T09:45:37.067 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 9633 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-12-22T09:45:37.067 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 16025 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-12-22T09:45:37.067 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 9009 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-12-22T09:45:37.067 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 74073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/sit.ko 2023-12-22T09:45:37.067 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 24193 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/tunnel6.ko 2023-12-22T09:45:37.067 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 23297 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/xfrm6_tunnel.ko 2023-12-22T09:45:37.067 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/key/ 2023-12-22T09:45:37.067 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 82833 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/key/af_key.ko 2023-12-22T09:45:37.067 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/l2tp/ 2023-12-22T09:45:37.067 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 125281 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/l2tp/l2tp_core.ko 2023-12-22T09:45:37.067 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 20177 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/l2tp/l2tp_debugfs.ko 2023-12-22T09:45:37.067 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 25953 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/l2tp/l2tp_eth.ko 2023-12-22T09:45:37.068 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 35569 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/l2tp/l2tp_ip.ko 2023-12-22T09:45:37.068 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 36713 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/l2tp/l2tp_ip6.ko 2023-12-22T09:45:37.068 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 33001 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/l2tp/l2tp_netlink.ko 2023-12-22T09:45:37.068 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 53241 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/l2tp/l2tp_ppp.ko 2023-12-22T09:45:37.068 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/lapb/ 2023-12-22T09:45:37.068 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 47977 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/lapb/lapb.ko 2023-12-22T09:45:37.068 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/llc/ 2023-12-22T09:45:37.068 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 23193 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/llc/llc.ko 2023-12-22T09:45:37.068 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 267913 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/llc/llc2.ko 2023-12-22T09:45:37.068 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/mac802154/ 2023-12-22T09:45:37.068 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 290417 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/mac802154/mac802154.ko 2023-12-22T09:45:37.068 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/mpls/ 2023-12-22T09:45:37.068 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 9393 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/mpls/mpls_gso.ko 2023-12-22T09:45:37.068 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ 2023-12-22T09:45:37.069 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ 2023-12-22T09:45:37.069 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 119585 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set.ko 2023-12-22T09:45:37.069 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 28353 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-12-22T09:45:37.069 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 26913 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-12-22T09:45:37.069 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 26369 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-12-22T09:45:37.069 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 100297 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-12-22T09:45:37.069 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 101441 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-12-22T09:45:37.069 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 102817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-12-22T09:45:37.069 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 103417 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-12-22T09:45:37.069 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 112849 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-12-22T09:45:37.069 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 60329 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-12-22T09:45:37.070 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 109593 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-12-22T09:45:37.070 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 113129 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-12-22T09:45:37.070 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 112585 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-12-22T09:45:37.070 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 111585 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-12-22T09:45:37.070 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 114465 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-12-22T09:45:37.070 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 30025 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-12-22T09:45:37.070 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ 2023-12-22T09:45:37.070 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 411729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs.ko 2023-12-22T09:45:37.070 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11961 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-12-22T09:45:37.070 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 7625 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-12-22T09:45:37.070 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 17729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-12-22T09:45:37.070 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 17905 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-12-22T09:45:37.070 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 20673 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-12-22T09:45:37.070 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 7689 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-12-22T09:45:37.071 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 7689 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-12-22T09:45:37.071 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 10681 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-12-22T09:45:37.071 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 9233 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-12-22T09:45:37.071 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 7697 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-12-22T09:45:37.071 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13521 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-12-22T09:45:37.071 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 7697 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-12-22T09:45:37.071 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 10993 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-12-22T09:45:37.071 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 49257 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conncount.ko 2023-12-22T09:45:37.071 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 408257 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack.ko 2023-12-22T09:45:37.071 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 15985 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-12-22T09:45:37.072 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 10177 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-12-22T09:45:37.072 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 33761 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-12-22T09:45:37.072 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 118145 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_h323.ko 2023-12-22T09:45:37.072 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 22185 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_irc.ko 2023-12-22T09:45:37.072 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 8817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-12-22T09:45:37.072 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 107233 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-12-22T09:45:37.072 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 33633 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-12-22T09:45:37.072 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 17401 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_sane.ko 2023-12-22T09:45:37.072 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 66641 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_sip.ko 2023-12-22T09:45:37.072 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11233 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-12-22T09:45:37.072 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 19185 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-12-22T09:45:37.072 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 10113 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_dup_netdev.ko 2023-12-22T09:45:37.072 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 89425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_flow_table.ko 2023-12-22T09:45:37.073 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 9593 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_flow_table_inet.ko 2023-12-22T09:45:37.073 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 37129 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_log_syslog.ko 2023-12-22T09:45:37.073 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 95353 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_nat.ko 2023-12-22T09:45:37.073 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 10129 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_nat_amanda.ko 2023-12-22T09:45:37.073 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 12625 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_nat_ftp.ko 2023-12-22T09:45:37.073 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11857 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_nat_irc.ko 2023-12-22T09:45:37.073 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 28929 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_nat_sip.ko 2023-12-22T09:45:37.073 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 8809 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_nat_tftp.ko 2023-12-22T09:45:37.073 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 44065 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_synproxy_core.ko 2023-12-22T09:45:37.073 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 615649 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_tables.ko 2023-12-22T09:45:37.073 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 42561 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nfnetlink.ko 2023-12-22T09:45:37.073 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 30233 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nfnetlink_acct.ko 2023-12-22T09:45:37.073 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 30569 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-12-22T09:45:37.073 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 39785 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nfnetlink_log.ko 2023-12-22T09:45:37.074 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 22921 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nfnetlink_osf.ko 2023-12-22T09:45:37.074 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 49377 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nfnetlink_queue.ko 2023-12-22T09:45:37.074 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 10457 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_chain_nat.ko 2023-12-22T09:45:37.074 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 33209 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_compat.ko 2023-12-22T09:45:37.074 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 40721 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_ct.ko 2023-12-22T09:45:37.074 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 9601 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_dup_netdev.ko 2023-12-22T09:45:37.074 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11401 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_fib.ko 2023-12-22T09:45:37.074 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13745 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_fwd_netdev.ko 2023-12-22T09:45:37.074 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 14185 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_hash.ko 2023-12-22T09:45:37.074 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 20065 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_limit.ko 2023-12-22T09:45:37.075 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 15401 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_log.ko 2023-12-22T09:45:37.075 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 14801 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_masq.ko 2023-12-22T09:45:37.075 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 14329 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_nat.ko 2023-12-22T09:45:37.075 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13673 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_numgen.ko 2023-12-22T09:45:37.075 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11841 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_osf.ko 2023-12-22T09:45:37.075 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 14073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_queue.ko 2023-12-22T09:45:37.075 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 14193 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_redir.ko 2023-12-22T09:45:37.075 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 10497 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_reject.ko 2023-12-22T09:45:37.075 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 10081 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_reject_inet.ko 2023-12-22T09:45:37.075 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 12737 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_socket.ko 2023-12-22T09:45:37.075 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 20369 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_synproxy.ko 2023-12-22T09:45:37.075 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 14849 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_tproxy.ko 2023-12-22T09:45:37.075 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 89313 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/x_tables.ko 2023-12-22T09:45:37.075 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 12097 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_AUDIT.ko 2023-12-22T09:45:37.076 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 9633 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_CHECKSUM.ko 2023-12-22T09:45:37.076 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 7729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_CLASSIFY.ko 2023-12-22T09:45:37.076 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11521 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-12-22T09:45:37.076 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 18169 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_CT.ko 2023-12-22T09:45:37.076 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 10497 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_DSCP.ko 2023-12-22T09:45:37.076 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 9465 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_HL.ko 2023-12-22T09:45:37.076 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13369 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_HMARK.ko 2023-12-22T09:45:37.076 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 38873 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_IDLETIMER.ko 2023-12-22T09:45:37.076 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13889 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_LED.ko 2023-12-22T09:45:37.076 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11489 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_LOG.ko 2023-12-22T09:45:37.076 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11753 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_MASQUERADE.ko 2023-12-22T09:45:37.076 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11657 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_NETMAP.ko 2023-12-22T09:45:37.077 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 9473 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_NFLOG.ko 2023-12-22T09:45:37.077 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13289 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_NFQUEUE.ko 2023-12-22T09:45:37.077 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 19665 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_RATEEST.ko 2023-12-22T09:45:37.077 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_REDIRECT.ko 2023-12-22T09:45:37.077 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 14337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_SECMARK.ko 2023-12-22T09:45:37.077 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 16057 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_TCPMSS.ko 2023-12-22T09:45:37.077 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 10433 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-12-22T09:45:37.077 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 17361 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_TEE.ko 2023-12-22T09:45:37.077 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 16785 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_TPROXY.ko 2023-12-22T09:45:37.077 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 8321 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_TRACE.ko 2023-12-22T09:45:37.077 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13897 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_addrtype.ko 2023-12-22T09:45:37.077 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13897 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_bpf.ko 2023-12-22T09:45:37.077 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 15529 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_cgroup.ko 2023-12-22T09:45:37.078 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11209 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_cluster.ko 2023-12-22T09:45:37.078 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 7505 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_comment.ko 2023-12-22T09:45:37.078 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 10465 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_connbytes.ko 2023-12-22T09:45:37.078 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11081 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_connlabel.ko 2023-12-22T09:45:37.078 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 9401 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_connlimit.ko 2023-12-22T09:45:37.078 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13129 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_connmark.ko 2023-12-22T09:45:37.078 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 12401 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_conntrack.ko 2023-12-22T09:45:37.078 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 7817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_cpu.ko 2023-12-22T09:45:37.078 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 10969 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_dccp.ko 2023-12-22T09:45:37.078 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 7865 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_devgroup.ko 2023-12-22T09:45:37.078 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 8801 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_dscp.ko 2023-12-22T09:45:37.078 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 10657 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_ecn.ko 2023-12-22T09:45:37.078 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11473 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_esp.ko 2023-12-22T09:45:37.078 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 43289 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_hashlimit.ko 2023-12-22T09:45:37.079 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11313 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_helper.ko 2023-12-22T09:45:37.079 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 7865 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_hl.ko 2023-12-22T09:45:37.079 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11921 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_ipcomp.ko 2023-12-22T09:45:37.079 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11473 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_iprange.ko 2023-12-22T09:45:37.079 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11785 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_ipvs.ko 2023-12-22T09:45:37.079 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 16041 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_l2tp.ko 2023-12-22T09:45:37.079 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 8001 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_length.ko 2023-12-22T09:45:37.079 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 10209 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_limit.ko 2023-12-22T09:45:37.079 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 7545 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_mac.ko 2023-12-22T09:45:37.079 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 8577 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_mark.ko 2023-12-22T09:45:37.079 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11825 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_multiport.ko 2023-12-22T09:45:37.079 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_nat.ko 2023-12-22T09:45:37.079 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 10105 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_nfacct.ko 2023-12-22T09:45:37.080 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 8297 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_osf.ko 2023-12-22T09:45:37.080 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 9553 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_owner.ko 2023-12-22T09:45:37.080 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 9729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_physdev.ko 2023-12-22T09:45:37.080 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 7633 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_pkttype.ko 2023-12-22T09:45:37.080 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11985 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_policy.ko 2023-12-22T09:45:37.080 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 9473 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_quota.ko 2023-12-22T09:45:37.081 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 10409 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_rateest.ko 2023-12-22T09:45:37.081 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 8257 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_realm.ko 2023-12-22T09:45:37.081 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 36433 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_recent.ko 2023-12-22T09:45:37.081 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13329 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_sctp.ko 2023-12-22T09:45:37.081 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 30089 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_set.ko 2023-12-22T09:45:37.081 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 16089 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_socket.ko 2023-12-22T09:45:37.081 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 9505 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_state.ko 2023-12-22T09:45:37.081 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 9473 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_statistic.ko 2023-12-22T09:45:37.081 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 8809 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_string.ko 2023-12-22T09:45:37.081 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 8553 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_tcpmss.ko 2023-12-22T09:45:37.081 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 15777 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_tcpudp.ko 2023-12-22T09:45:37.081 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11065 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_time.ko 2023-12-22T09:45:37.082 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 9401 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_u32.ko 2023-12-22T09:45:37.082 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netlink/ 2023-12-22T09:45:37.082 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13969 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netlink/netlink_diag.ko 2023-12-22T09:45:37.082 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/nsh/ 2023-12-22T09:45:37.082 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 12425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/nsh/nsh.ko 2023-12-22T09:45:37.082 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/openvswitch/ 2023-12-22T09:45:37.082 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 380033 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/openvswitch/openvswitch.ko 2023-12-22T09:45:37.082 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 10257 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/openvswitch/vport-geneve.ko 2023-12-22T09:45:37.082 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 9449 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/openvswitch/vport-gre.ko 2023-12-22T09:45:37.082 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 11793 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/openvswitch/vport-vxlan.ko 2023-12-22T09:45:37.082 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/packet/ 2023-12-22T09:45:37.082 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13057 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/packet/af_packet_diag.ko 2023-12-22T09:45:37.082 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/phonet/ 2023-12-22T09:45:37.083 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 110201 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/phonet/phonet.ko 2023-12-22T09:45:37.083 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 54721 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/phonet/pn_pep.ko 2023-12-22T09:45:37.083 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/rds/ 2023-12-22T09:45:37.083 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 251481 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/rds/rds.ko 2023-12-22T09:45:37.083 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 164937 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/rds/rds_rdma.ko 2023-12-22T09:45:37.083 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 67377 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/rds/rds_tcp.ko 2023-12-22T09:45:37.083 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/rxrpc/ 2023-12-22T09:45:37.083 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 819657 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/rxrpc/rxrpc.ko 2023-12-22T09:45:37.083 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/ 2023-12-22T09:45:37.083 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 32241 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/act_csum.ko 2023-12-22T09:45:37.083 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 23577 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/act_gact.ko 2023-12-22T09:45:37.083 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 26873 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/act_ipt.ko 2023-12-22T09:45:37.083 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 34097 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/act_mirred.ko 2023-12-22T09:45:37.083 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 23401 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/act_nat.ko 2023-12-22T09:45:37.084 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 43449 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/act_pedit.ko 2023-12-22T09:45:37.084 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 31961 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/act_police.ko 2023-12-22T09:45:37.084 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 20289 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/act_simple.ko 2023-12-22T09:45:37.084 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 35297 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/act_skbedit.ko 2023-12-22T09:45:37.084 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 36665 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/act_vlan.ko 2023-12-22T09:45:37.084 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 26169 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/cls_basic.ko 2023-12-22T09:45:37.084 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 33961 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/cls_bpf.ko 2023-12-22T09:45:37.084 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 19169 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/cls_cgroup.ko 2023-12-22T09:45:37.084 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 31401 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/cls_flow.ko 2023-12-22T09:45:37.084 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 31769 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/cls_fw.ko 2023-12-22T09:45:37.084 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 38425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/cls_route.ko 2023-12-22T09:45:37.084 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 61409 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/cls_u32.ko 2023-12-22T09:45:37.084 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 7441 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/em_cmp.ko 2023-12-22T09:45:37.084 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 13409 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/em_ipset.ko 2023-12-22T09:45:37.085 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 33289 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/em_meta.ko 2023-12-22T09:45:37.085 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 7897 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/em_nbyte.ko 2023-12-22T09:45:37.085 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 10625 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/em_text.ko 2023-12-22T09:45:37.085 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 7249 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/em_u32.ko 2023-12-22T09:45:37.085 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 21649 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_choke.ko 2023-12-22T09:45:37.085 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 20849 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_codel.ko 2023-12-22T09:45:37.085 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 34633 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_drr.ko 2023-12-22T09:45:37.085 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 33609 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_fq.ko 2023-12-22T09:45:37.085 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 31617 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_fq_codel.ko 2023-12-22T09:45:37.085 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 35433 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_gred.ko 2023-12-22T09:45:37.085 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 49817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_hfsc.ko 2023-12-22T09:45:37.085 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 22089 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_hhf.ko 2023-12-22T09:45:37.085 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 66393 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_htb.ko 2023-12-22T09:45:37.085 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 26073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_ingress.ko 2023-12-22T09:45:37.086 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 30273 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_mqprio.ko 2023-12-22T09:45:37.086 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 10793 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_mqprio_lib.ko 2023-12-22T09:45:37.086 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 26065 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_multiq.ko 2023-12-22T09:45:37.086 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 36137 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_netem.ko 2023-12-22T09:45:37.086 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 27497 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_pie.ko 2023-12-22T09:45:37.086 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 10625 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_plug.ko 2023-12-22T09:45:37.086 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 24729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_prio.ko 2023-12-22T09:45:37.086 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 48729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_qfq.ko 2023-12-22T09:45:37.086 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 32905 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_red.ko 2023-12-22T09:45:37.086 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 26881 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_sfb.ko 2023-12-22T09:45:37.086 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 31353 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_sfq.ko 2023-12-22T09:45:37.086 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 28897 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_tbf.ko 2023-12-22T09:45:37.086 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 28105 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_teql.ko 2023-12-22T09:45:37.086 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sctp/ 2023-12-22T09:45:37.087 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 929745 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sctp/sctp.ko 2023-12-22T09:45:37.087 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 19033 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sctp/sctp_diag.ko 2023-12-22T09:45:37.087 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sunrpc/ 2023-12-22T09:45:37.087 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sunrpc/auth_gss/ 2023-12-22T09:45:37.087 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 336529 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-12-22T09:45:37.087 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 54737 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-12-22T09:45:37.087 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 1520097 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sunrpc/sunrpc.ko 2023-12-22T09:45:37.087 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sunrpc/xprtrdma/ 2023-12-22T09:45:37.087 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 707657 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-12-22T09:45:37.087 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/tipc/ 2023-12-22T09:45:37.087 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 10025 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/tipc/diag.ko 2023-12-22T09:45:37.087 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 862665 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/tipc/tipc.ko 2023-12-22T09:45:37.087 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/unix/ 2023-12-22T09:45:37.087 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 15729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/unix/unix_diag.ko 2023-12-22T09:45:37.088 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/vmw_vsock/ 2023-12-22T09:45:37.088 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 85409 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-12-22T09:45:37.088 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 68049 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-12-22T09:45:37.088 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 96193 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/vmw_vsock/vsock.ko 2023-12-22T09:45:37.088 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 10705 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/vmw_vsock/vsock_diag.ko 2023-12-22T09:45:37.088 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 17521 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/vmw_vsock/vsock_loopback.ko 2023-12-22T09:45:37.088 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/x25/ 2023-12-22T09:45:37.088 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 125177 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/x25/x25.ko 2023-12-22T09:45:37.088 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/xfrm/ 2023-12-22T09:45:37.088 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 22657 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/xfrm/xfrm_algo.ko 2023-12-22T09:45:37.088 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 20649 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/xfrm/xfrm_ipcomp.ko 2023-12-22T09:45:37.088 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 102257 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/xfrm/xfrm_user.ko 2023-12-22T09:45:37.088 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/virt/ 2023-12-22T09:45:37.088 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/virt/lib/ 2023-12-22T09:45:37.089 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 15537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/virt/lib/irqbypass.ko 2023-12-22T09:45:37.089 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 640081 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/modules.alias 2023-12-22T09:45:37.091 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 624107 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/modules.alias.bin 2023-12-22T09:45:37.091 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 7663 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/modules.builtin 2023-12-22T09:45:37.091 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 23428 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/modules.builtin.alias.bin 2023-12-22T09:45:37.091 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 9821 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/modules.builtin.bin 2023-12-22T09:45:37.091 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 70004 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/modules.builtin.modinfo 2023-12-22T09:45:37.091 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 146313 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/modules.dep 2023-12-22T09:45:37.091 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 232548 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/modules.dep.bin 2023-12-22T09:45:37.091 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 210 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/modules.devname 2023-12-22T09:45:37.091 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 72606 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/modules.order 2023-12-22T09:45:37.091 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 879 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/modules.softdep 2023-12-22T09:45:37.091 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 254438 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/modules.symbols 2023-12-22T09:45:37.092 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 309363 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/modules.symbols.bin 2023-12-22T09:45:37.092 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./usr/ 2023-12-22T09:45:37.092 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./usr/share/ 2023-12-22T09:45:37.092 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./usr/share/doc/ 2023-12-22T09:45:37.092 INFO:teuthology.orchestra.run.smithi113.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./usr/share/doc/linux-image-6.6.0-g623393c9d50c/ 2023-12-22T09:45:37.092 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 170 2023-12-21 02:06 ./usr/share/doc/linux-image-6.6.0-g623393c9d50c/changelog.Debian.gz 2023-12-22T09:45:37.092 INFO:teuthology.orchestra.run.smithi113.stdout:-rw-r--r-- root/root 691 2023-12-21 02:06 ./usr/share/doc/linux-image-6.6.0-g623393c9d50c/copyright 2023-12-22T09:45:37.093 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-g623393c9d50c 2023-12-22T09:45:37.093 INFO:teuthology.task.kernel:searching for kernel 6.6.0-g623393c9d50c 2023-12-22T09:45:37.093 DEBUG:teuthology.orchestra.run.smithi113:> egrep '(submenu|menuentry.*6.6.0-g623393c9d50c).*{' /boot/grub/grub.cfg 2023-12-22T09:45:37.099 INFO:teuthology.orchestra.run.smithi113.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-12-22T09:45:37.099 INFO:teuthology.orchestra.run.smithi113.stdout: menuentry 'Ubuntu, with Linux 6.6.0-g623393c9d50c' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-g623393c9d50c-advanced-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-12-22T09:45:37.099 INFO:teuthology.orchestra.run.smithi113.stdout: menuentry 'Ubuntu, with Linux 6.6.0-g623393c9d50c (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-g623393c9d50c-recovery-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-12-22T09:45:37.099 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-12-22T09:45:37.100 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.6.0-g623393c9d50c 2023-12-22T09:45:37.100 DEBUG:teuthology.orchestra.run.smithi113:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-12-22T09:45:37.144 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi113.front.sepia.ceph.com to complete... 2023-12-22T09:45:37.645 INFO:teuthology.orchestra.run.smithi113.stderr:Sourcing file `/etc/default/grub' 2023-12-22T09:45:37.647 INFO:teuthology.orchestra.run.smithi113.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-12-22T09:45:37.667 INFO:teuthology.orchestra.run.smithi113.stderr:Generating grub configuration file ... 2023-12-22T09:45:37.918 INFO:teuthology.orchestra.run.smithi113.stderr:Found linux image: /boot/vmlinuz-6.6.0-g623393c9d50c 2023-12-22T09:45:37.930 INFO:teuthology.orchestra.run.smithi113.stderr:Found initrd image: /boot/initrd.img-6.6.0-g623393c9d50c 2023-12-22T09:45:38.289 INFO:teuthology.orchestra.run.smithi113.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-12-22T09:45:38.301 INFO:teuthology.orchestra.run.smithi113.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-12-22T09:45:39.074 INFO:teuthology.orchestra.run.smithi113.stderr:done 2023-12-22T09:45:42.679 INFO:teuthology.orchestra.run.smithi045.stderr:Sourcing file `/etc/default/grub' 2023-12-22T09:45:42.690 INFO:teuthology.orchestra.run.smithi045.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-12-22T09:45:42.719 INFO:teuthology.orchestra.run.smithi045.stderr:Generating grub configuration file ... 2023-12-22T09:45:43.046 INFO:teuthology.orchestra.run.smithi045.stderr:Found linux image: /boot/vmlinuz-6.6.0-g623393c9d50c 2023-12-22T09:45:43.079 INFO:teuthology.orchestra.run.smithi045.stderr:Found initrd image: /boot/initrd.img-6.6.0-g623393c9d50c 2023-12-22T09:45:43.520 INFO:teuthology.orchestra.run.smithi045.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-12-22T09:45:43.533 INFO:teuthology.orchestra.run.smithi045.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-12-22T09:45:45.329 INFO:teuthology.orchestra.run.smithi045.stderr:done 2023-12-22T09:45:45.537 DEBUG:teuthology.orchestra.run.smithi045:> dpkg-deb -c /tmp/linux-image.deb 2023-12-22T09:45:45.547 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./ 2023-12-22T09:45:45.547 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./boot/ 2023-12-22T09:45:45.547 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 4415617 2023-12-21 02:06 ./boot/System.map-6.6.0-g623393c9d50c 2023-12-22T09:45:45.564 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 169214 2023-12-21 02:06 ./boot/config-6.6.0-g623393c9d50c 2023-12-22T09:45:45.565 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11352864 2023-12-21 02:06 ./boot/vmlinuz-6.6.0-g623393c9d50c 2023-12-22T09:45:45.586 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./etc/ 2023-12-22T09:45:45.586 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./etc/kernel/ 2023-12-22T09:45:45.586 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./etc/kernel/postinst.d/ 2023-12-22T09:45:45.587 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./etc/kernel/postrm.d/ 2023-12-22T09:45:45.587 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./etc/kernel/preinst.d/ 2023-12-22T09:45:45.587 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./etc/kernel/prerm.d/ 2023-12-22T09:45:45.587 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/ 2023-12-22T09:45:45.587 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/ 2023-12-22T09:45:45.587 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/ 2023-12-22T09:45:45.587 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/ 2023-12-22T09:45:45.587 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/ 2023-12-22T09:45:45.587 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/ 2023-12-22T09:45:45.587 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/ 2023-12-22T09:45:45.587 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 490233 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/aesni-intel.ko 2023-12-22T09:45:45.590 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25329 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-12-22T09:45:45.590 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 29529 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-12-22T09:45:45.590 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 30313 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-12-22T09:45:45.590 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 93113 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-12-22T09:45:45.590 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 106729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-12-22T09:45:45.590 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 152241 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-12-22T09:45:45.590 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12553 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-12-22T09:45:45.590 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13777 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-12-22T09:45:45.590 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 83889 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-12-22T09:45:45.590 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18625 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-12-22T09:45:45.591 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 47225 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-12-22T09:45:45.591 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 47209 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/serpent-avx2.ko 2023-12-22T09:45:45.591 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 51801 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-12-22T09:45:45.591 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 38937 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-12-22T09:45:45.591 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 40529 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-12-22T09:45:45.591 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 58585 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-12-22T09:45:45.591 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 50497 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-12-22T09:45:45.591 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 32065 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-12-22T09:45:45.591 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13625 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-12-22T09:45:45.591 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/kernel/ 2023-12-22T09:45:45.591 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/kernel/cpu/ 2023-12-22T09:45:45.591 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/kernel/cpu/mce/ 2023-12-22T09:45:45.591 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 40113 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-12-22T09:45:45.591 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13353 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/kernel/cpuid.ko 2023-12-22T09:45:45.592 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17937 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/kernel/msr.ko 2023-12-22T09:45:45.592 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/kvm/ 2023-12-22T09:45:45.592 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 354433 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/kvm/kvm-amd.ko 2023-12-22T09:45:45.592 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 881625 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/kvm/kvm-intel.ko 2023-12-22T09:45:45.592 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 2275865 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/arch/x86/kvm/kvm.ko 2023-12-22T09:45:45.636 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/ 2023-12-22T09:45:45.637 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 53697 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/af_alg.ko 2023-12-22T09:45:45.637 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23097 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/algif_hash.ko 2023-12-22T09:45:45.637 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19985 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/algif_skcipher.ko 2023-12-22T09:45:45.637 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17209 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/ansi_cprng.ko 2023-12-22T09:45:45.637 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19641 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/anubis.ko 2023-12-22T09:45:45.637 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10145 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/arc4.ko 2023-12-22T09:45:45.637 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/asymmetric_keys/ 2023-12-22T09:45:45.637 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10185 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-12-22T09:45:45.637 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/async_tx/ 2023-12-22T09:45:45.637 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11249 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/async_tx/async_memcpy.ko 2023-12-22T09:45:45.637 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19473 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/async_tx/async_pq.ko 2023-12-22T09:45:45.638 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21561 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/async_tx/async_raid6_recov.ko 2023-12-22T09:45:45.638 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13825 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/async_tx/async_tx.ko 2023-12-22T09:45:45.638 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17745 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/async_tx/async_xor.ko 2023-12-22T09:45:45.638 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17921 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/async_tx/raid6test.ko 2023-12-22T09:45:45.638 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20489 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/authenc.ko 2023-12-22T09:45:45.638 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22577 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/authencesn.ko 2023-12-22T09:45:45.638 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/blake2b_generic.ko 2023-12-22T09:45:45.638 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/blowfish_common.ko 2023-12-22T09:45:45.638 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/blowfish_generic.ko 2023-12-22T09:45:45.638 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 38809 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/camellia_generic.ko 2023-12-22T09:45:45.638 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 27321 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/cast5_generic.ko 2023-12-22T09:45:45.638 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17745 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/cast6_generic.ko 2023-12-22T09:45:45.638 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/cast_common.ko 2023-12-22T09:45:45.638 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 35097 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/ccm.ko 2023-12-22T09:45:45.639 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14769 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/cmac.ko 2023-12-22T09:45:45.639 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9585 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/crc32_generic.ko 2023-12-22T09:45:45.639 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 47505 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/cryptd.ko 2023-12-22T09:45:45.639 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 39505 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/crypto_engine.ko 2023-12-22T09:45:45.639 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26953 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/crypto_simd.ko 2023-12-22T09:45:45.639 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24737 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/crypto_user.ko 2023-12-22T09:45:45.639 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/cts.ko 2023-12-22T09:45:45.639 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10913 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/des_generic.ko 2023-12-22T09:45:45.639 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15681 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/dh_generic.ko 2023-12-22T09:45:45.639 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11001 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/echainiv.ko 2023-12-22T09:45:45.639 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25321 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/essiv.ko 2023-12-22T09:45:45.639 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17993 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/fcrypt.ko 2023-12-22T09:45:45.639 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26897 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/khazad.ko 2023-12-22T09:45:45.639 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15649 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/lrw.ko 2023-12-22T09:45:45.640 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11513 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/lz4.ko 2023-12-22T09:45:45.640 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11529 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/lz4hc.ko 2023-12-22T09:45:45.640 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11697 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/md4.ko 2023-12-22T09:45:45.640 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/michael_mic.ko 2023-12-22T09:45:45.640 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10673 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/pcbc.ko 2023-12-22T09:45:45.640 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18745 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/pcrypt.ko 2023-12-22T09:45:45.640 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16049 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/rmd160.ko 2023-12-22T09:45:45.640 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 29393 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/seed.ko 2023-12-22T09:45:45.640 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 27081 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/serpent_generic.ko 2023-12-22T09:45:45.640 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 149193 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/tcrypt.ko 2023-12-22T09:45:45.640 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10881 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/tea.ko 2023-12-22T09:45:45.640 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28777 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/twofish_common.ko 2023-12-22T09:45:45.640 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13169 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/twofish_generic.ko 2023-12-22T09:45:45.640 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17401 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/vmac.ko 2023-12-22T09:45:45.641 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 36185 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/wp512.ko 2023-12-22T09:45:45.641 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14105 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/xcbc.ko 2023-12-22T09:45:45.641 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26665 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/xor.ko 2023-12-22T09:45:45.641 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18713 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/xts.ko 2023-12-22T09:45:45.641 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9481 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/crypto/xxhash_generic.ko 2023-12-22T09:45:45.641 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ 2023-12-22T09:45:45.641 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/acpi/ 2023-12-22T09:45:45.641 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18249 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/acpi/acpi_extlog.ko 2023-12-22T09:45:45.641 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26985 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/acpi/acpi_ipmi.ko 2023-12-22T09:45:45.641 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28793 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/acpi/acpi_pad.ko 2023-12-22T09:45:45.641 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/acpi/apei/ 2023-12-22T09:45:45.641 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 31241 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/acpi/apei/einj.ko 2023-12-22T09:45:45.641 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12801 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/acpi/ec_sys.ko 2023-12-22T09:45:45.642 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14937 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/acpi/platform_profile.ko 2023-12-22T09:45:45.642 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24401 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/acpi/sbs.ko 2023-12-22T09:45:45.642 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19521 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/acpi/sbshc.ko 2023-12-22T09:45:45.642 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 103025 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/acpi/video.ko 2023-12-22T09:45:45.642 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/ 2023-12-22T09:45:45.642 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21601 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/acard-ahci.ko 2023-12-22T09:45:45.642 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 88865 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/ahci.ko 2023-12-22T09:45:45.642 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/ahci_platform.ko 2023-12-22T09:45:45.642 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 88289 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/libahci.ko 2023-12-22T09:45:45.642 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 34985 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/libahci_platform.ko 2023-12-22T09:45:45.642 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17137 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_acpi.ko 2023-12-22T09:45:45.642 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 30433 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_ali.ko 2023-12-22T09:45:45.642 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 33505 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_amd.ko 2023-12-22T09:45:45.642 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21265 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_artop.ko 2023-12-22T09:45:45.643 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21121 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_atiixp.ko 2023-12-22T09:45:45.643 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24945 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_atp867x.ko 2023-12-22T09:45:45.643 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17657 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_cmd640.ko 2023-12-22T09:45:45.643 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25185 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_cmd64x.ko 2023-12-22T09:45:45.643 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15049 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_cypress.ko 2023-12-22T09:45:45.643 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17849 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_efar.ko 2023-12-22T09:45:45.643 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21945 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_hpt366.ko 2023-12-22T09:45:45.643 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 33977 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_hpt37x.ko 2023-12-22T09:45:45.643 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23129 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_hpt3x2n.ko 2023-12-22T09:45:45.643 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16921 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_hpt3x3.ko 2023-12-22T09:45:45.643 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16993 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_it8213.ko 2023-12-22T09:45:45.643 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 35273 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_it821x.ko 2023-12-22T09:45:45.643 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12889 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_jmicron.ko 2023-12-22T09:45:45.643 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 51481 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_legacy.ko 2023-12-22T09:45:45.644 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15185 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_marvell.ko 2023-12-22T09:45:45.644 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16281 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_mpiix.ko 2023-12-22T09:45:45.644 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12833 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_netcell.ko 2023-12-22T09:45:45.644 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_ninja32.ko 2023-12-22T09:45:45.644 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15105 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_ns87410.ko 2023-12-22T09:45:45.644 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17361 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_ns87415.ko 2023-12-22T09:45:45.644 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16569 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_oldpiix.ko 2023-12-22T09:45:45.644 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15377 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_opti.ko 2023-12-22T09:45:45.644 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20681 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_optidma.ko 2023-12-22T09:45:45.644 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 32585 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_pcmcia.ko 2023-12-22T09:45:45.644 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 37793 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_pdc2027x.ko 2023-12-22T09:45:45.644 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20561 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-12-22T09:45:45.644 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14225 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_piccolo.ko 2023-12-22T09:45:45.644 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15449 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_radisys.ko 2023-12-22T09:45:45.645 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19521 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_rdc.ko 2023-12-22T09:45:45.645 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15329 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_rz1000.ko 2023-12-22T09:45:45.645 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13937 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_sch.ko 2023-12-22T09:45:45.645 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23097 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_serverworks.ko 2023-12-22T09:45:45.645 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23457 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_sil680.ko 2023-12-22T09:45:45.645 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19697 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_sl82c105.ko 2023-12-22T09:45:45.645 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16009 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_triflex.ko 2023-12-22T09:45:45.645 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 30433 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pata_via.ko 2023-12-22T09:45:45.645 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22793 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/pdc_adma.ko 2023-12-22T09:45:45.645 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 29121 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_inic162x.ko 2023-12-22T09:45:45.645 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 83345 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_mv.ko 2023-12-22T09:45:45.645 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 70393 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_nv.ko 2023-12-22T09:45:45.645 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 37377 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_promise.ko 2023-12-22T09:45:45.645 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23041 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_qstor.ko 2023-12-22T09:45:45.646 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 29273 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_sil.ko 2023-12-22T09:45:45.646 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 38337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_sil24.ko 2023-12-22T09:45:45.646 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17945 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_sis.ko 2023-12-22T09:45:45.646 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20441 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_svw.ko 2023-12-22T09:45:45.646 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 44793 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_sx4.ko 2023-12-22T09:45:45.646 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15601 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_uli.ko 2023-12-22T09:45:45.646 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 35065 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_via.ko 2023-12-22T09:45:45.646 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20065 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ata/sata_vsc.ko 2023-12-22T09:45:45.646 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/auxdisplay/ 2023-12-22T09:45:45.646 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16289 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/auxdisplay/ks0108.ko 2023-12-22T09:45:45.646 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/bcma/ 2023-12-22T09:45:45.646 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 124473 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/bcma/bcma.ko 2023-12-22T09:45:45.646 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/ 2023-12-22T09:45:45.646 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/aoe/ 2023-12-22T09:45:45.647 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 113665 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/aoe/aoe.ko 2023-12-22T09:45:45.647 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/drbd/ 2023-12-22T09:45:45.647 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 965585 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/drbd/drbd.ko 2023-12-22T09:45:45.647 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 173225 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/floppy.ko 2023-12-22T09:45:45.647 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/mtip32xx/ 2023-12-22T09:45:45.647 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 94297 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-12-22T09:45:45.647 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 115793 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/nbd.ko 2023-12-22T09:45:45.647 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/null_blk/ 2023-12-22T09:45:45.647 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 110385 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/null_blk/null_blk.ko 2023-12-22T09:45:45.647 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 98193 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/pktcdvd.ko 2023-12-22T09:45:45.647 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 263769 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/rbd.ko 2023-12-22T09:45:45.647 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/xen-blkback/ 2023-12-22T09:45:45.647 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 98145 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-12-22T09:45:45.647 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/zram/ 2023-12-22T09:45:45.648 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 60217 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/block/zram/zram.ko 2023-12-22T09:45:45.648 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/ 2023-12-22T09:45:45.648 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 30705 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/applicom.ko 2023-12-22T09:45:45.648 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12009 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/hangcheck-timer.ko 2023-12-22T09:45:45.648 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/hw_random/ 2023-12-22T09:45:45.648 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13889 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/hw_random/amd-rng.ko 2023-12-22T09:45:45.648 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18809 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/hw_random/intel-rng.ko 2023-12-22T09:45:45.648 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13169 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-12-22T09:45:45.648 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10673 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/hw_random/via-rng.ko 2023-12-22T09:45:45.648 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15633 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/hw_random/virtio-rng.ko 2023-12-22T09:45:45.648 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/ipmi/ 2023-12-22T09:45:45.648 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 30713 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-12-22T09:45:45.648 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 148601 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-12-22T09:45:45.648 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26569 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-12-22T09:45:45.649 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 139313 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/ipmi/ipmi_si.ko 2023-12-22T09:45:45.649 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 70921 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-12-22T09:45:45.649 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 53513 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-12-22T09:45:45.649 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 36321 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/lp.ko 2023-12-22T09:45:45.649 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/mwave/ 2023-12-22T09:45:45.649 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 84097 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/mwave/mwave.ko 2023-12-22T09:45:45.649 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25873 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/nvram.ko 2023-12-22T09:45:45.649 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 32169 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/ppdev.ko 2023-12-22T09:45:45.649 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 51113 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/tlclk.ko 2023-12-22T09:45:45.649 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/tpm/ 2023-12-22T09:45:45.649 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16401 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/tpm/tpm_atmel.ko 2023-12-22T09:45:45.649 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15881 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-12-22T09:45:45.649 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23473 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-12-22T09:45:45.650 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 32985 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-12-22T09:45:45.650 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 30121 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/tpm/tpm_infineon.ko 2023-12-22T09:45:45.650 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22697 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/tpm/tpm_nsc.ko 2023-12-22T09:45:45.650 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23561 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-12-22T09:45:45.650 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/xillybus/ 2023-12-22T09:45:45.650 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17001 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/xillybus/xillybus_class.ko 2023-12-22T09:45:45.650 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 50945 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/xillybus/xillybus_core.ko 2023-12-22T09:45:45.650 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12393 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-12-22T09:45:45.650 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/clk/ 2023-12-22T09:45:45.650 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12489 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/clk/clk-palmas.ko 2023-12-22T09:45:45.650 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 47849 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/clk/clk-si5351.ko 2023-12-22T09:45:45.650 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11457 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/clk/clk-twl6040.ko 2023-12-22T09:45:45.650 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19249 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/clk/clk-wm831x.ko 2023-12-22T09:45:45.650 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/cpufreq/ 2023-12-22T09:45:45.650 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10097 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-12-22T09:45:45.651 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16833 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/cpufreq/p4-clockmod.ko 2023-12-22T09:45:45.651 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25297 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/cpufreq/speedstep-lib.ko 2023-12-22T09:45:45.651 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/ 2023-12-22T09:45:45.651 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/ccp/ 2023-12-22T09:45:45.651 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 70801 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-12-22T09:45:45.651 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 243025 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/ccp/ccp.ko 2023-12-22T09:45:45.651 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/intel/ 2023-12-22T09:45:45.651 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/intel/qat/ 2023-12-22T09:45:45.651 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/intel/qat/qat_common/ 2023-12-22T09:45:45.651 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 438761 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-12-22T09:45:45.651 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-12-22T09:45:45.651 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24081 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-12-22T09:45:45.651 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19937 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/padlock-aes.ko 2023-12-22T09:45:45.651 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/padlock-sha.ko 2023-12-22T09:45:45.652 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/virtio/ 2023-12-22T09:45:45.652 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 70273 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-12-22T09:45:45.652 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/dca/ 2023-12-22T09:45:45.652 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 29785 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/dca/dca.ko 2023-12-22T09:45:45.652 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/dma/ 2023-12-22T09:45:45.652 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/dma/dw/ 2023-12-22T09:45:45.652 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15857 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/dma/dw/dw_dmac.ko 2023-12-22T09:45:45.652 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/dma/ioat/ 2023-12-22T09:45:45.652 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 122569 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/dma/ioat/ioatdma.ko 2023-12-22T09:45:45.652 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/ 2023-12-22T09:45:45.652 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 79953 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/amd64_edac.ko 2023-12-22T09:45:45.652 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 35769 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/e752x_edac.ko 2023-12-22T09:45:45.652 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 63617 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/edac_mce_amd.ko 2023-12-22T09:45:45.652 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18105 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/i3000_edac.ko 2023-12-22T09:45:45.653 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18065 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/i3200_edac.ko 2023-12-22T09:45:45.653 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/i5100_edac.ko 2023-12-22T09:45:45.653 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25657 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/i5400_edac.ko 2023-12-22T09:45:45.653 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24913 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/i7300_edac.ko 2023-12-22T09:45:45.653 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 52041 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/i7core_edac.ko 2023-12-22T09:45:45.653 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18433 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/i82975x_edac.ko 2023-12-22T09:45:45.653 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20017 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/ie31200_edac.ko 2023-12-22T09:45:45.653 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 56825 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/sb_edac.ko 2023-12-22T09:45:45.653 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17529 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/edac/x38_edac.ko 2023-12-22T09:45:45.653 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/extcon/ 2023-12-22T09:45:45.653 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12673 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/extcon/extcon-gpio.ko 2023-12-22T09:45:45.653 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 27185 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/extcon/extcon-max14577.ko 2023-12-22T09:45:45.653 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 29569 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/extcon/extcon-max77693.ko 2023-12-22T09:45:45.654 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24745 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/extcon/extcon-max8997.ko 2023-12-22T09:45:45.654 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/extcon/extcon-palmas.ko 2023-12-22T09:45:45.654 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23713 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/extcon/extcon-rt8973a.ko 2023-12-22T09:45:45.654 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 27785 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/extcon/extcon-sm5502.ko 2023-12-22T09:45:45.654 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/firmware/ 2023-12-22T09:45:45.654 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 34977 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/firmware/dmi-sysfs.ko 2023-12-22T09:45:45.654 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/firmware/efi/ 2023-12-22T09:45:45.654 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15521 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/firmware/efi/efi-pstore.ko 2023-12-22T09:45:45.654 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/firmware/iscsi_ibft.ko 2023-12-22T09:45:45.654 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/ 2023-12-22T09:45:45.654 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12305 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-adp5520.ko 2023-12-22T09:45:45.654 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20153 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-amd8111.ko 2023-12-22T09:45:45.655 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14993 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-arizona.ko 2023-12-22T09:45:45.655 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13841 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-da9052.ko 2023-12-22T09:45:45.655 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11921 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-da9055.ko 2023-12-22T09:45:45.655 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22065 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-dln2.ko 2023-12-22T09:45:45.655 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 77849 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-f7188x.ko 2023-12-22T09:45:45.655 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28937 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-generic.ko 2023-12-22T09:45:45.655 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19569 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-ich.ko 2023-12-22T09:45:45.655 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11905 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-12-22T09:45:45.655 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14113 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-kempld.ko 2023-12-22T09:45:45.655 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-lp3943.ko 2023-12-22T09:45:45.655 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9505 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-max7300.ko 2023-12-22T09:45:45.655 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11905 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-max730x.ko 2023-12-22T09:45:45.655 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-max732x.ko 2023-12-22T09:45:45.656 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25145 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-12-22T09:45:45.656 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 47073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-pca953x.ko 2023-12-22T09:45:45.656 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26825 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-pcf857x.ko 2023-12-22T09:45:45.656 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14377 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-rdc321x.ko 2023-12-22T09:45:45.656 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20593 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-sch.ko 2023-12-22T09:45:45.656 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19505 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-sch311x.ko 2023-12-22T09:45:45.656 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12145 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-tps65912.ko 2023-12-22T09:45:45.656 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21057 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-twl4030.ko 2023-12-22T09:45:45.656 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-twl6040.ko 2023-12-22T09:45:45.656 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20601 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-viperboard.ko 2023-12-22T09:45:45.656 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15377 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-vx855.ko 2023-12-22T09:45:45.656 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16281 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-wm831x.ko 2023-12-22T09:45:45.656 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11617 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-wm8350.ko 2023-12-22T09:45:45.656 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16753 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/gpio/gpio-wm8994.ko 2023-12-22T09:45:45.657 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/ 2023-12-22T09:45:45.657 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11577 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-a4tech.ko 2023-12-22T09:45:45.657 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 39169 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-apple.ko 2023-12-22T09:45:45.657 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14481 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-appleir.ko 2023-12-22T09:45:45.657 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8353 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-aureal.ko 2023-12-22T09:45:45.657 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15169 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-axff.ko 2023-12-22T09:45:45.657 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11049 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-belkin.ko 2023-12-22T09:45:45.657 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10313 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-cherry.ko 2023-12-22T09:45:45.657 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16041 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-chicony.ko 2023-12-22T09:45:45.657 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 60649 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-cp2112.ko 2023-12-22T09:45:45.657 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11049 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-cypress.ko 2023-12-22T09:45:45.657 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16385 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-dr.ko 2023-12-22T09:45:45.657 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10697 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-elecom.ko 2023-12-22T09:45:45.658 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17665 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-elo.ko 2023-12-22T09:45:45.658 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13457 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-emsff.ko 2023-12-22T09:45:45.658 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10105 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-ezkey.ko 2023-12-22T09:45:45.658 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14305 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-gaff.ko 2023-12-22T09:45:45.658 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9225 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-generic.ko 2023-12-22T09:45:45.658 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17129 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-gt683r.ko 2023-12-22T09:45:45.658 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12681 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-gyration.ko 2023-12-22T09:45:45.658 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10161 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-holtek-kbd.ko 2023-12-22T09:45:45.658 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10457 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-holtek-mouse.ko 2023-12-22T09:45:45.658 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14449 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-holtekff.ko 2023-12-22T09:45:45.658 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19105 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-hyperv.ko 2023-12-22T09:45:45.658 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10489 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-icade.ko 2023-12-22T09:45:45.658 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9241 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-kensington.ko 2023-12-22T09:45:45.658 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8545 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-keytouch.ko 2023-12-22T09:45:45.659 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17201 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-kye.ko 2023-12-22T09:45:45.659 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10809 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-lcpower.ko 2023-12-22T09:45:45.659 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20497 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-led.ko 2023-12-22T09:45:45.659 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 42297 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-lenovo.ko 2023-12-22T09:45:45.659 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 30697 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-lg-g15.ko 2023-12-22T09:45:45.659 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 58185 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-logitech-dj.ko 2023-12-22T09:45:45.659 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 101481 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-12-22T09:45:45.659 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 80993 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-logitech.ko 2023-12-22T09:45:45.659 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 30801 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-magicmouse.ko 2023-12-22T09:45:45.659 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21969 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-microsoft.ko 2023-12-22T09:45:45.659 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10361 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-monterey.ko 2023-12-22T09:45:45.659 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 50161 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-multitouch.ko 2023-12-22T09:45:45.659 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 32593 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-ntrig.ko 2023-12-22T09:45:45.659 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8857 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-ortek.ko 2023-12-22T09:45:45.659 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9121 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-penmount.ko 2023-12-22T09:45:45.660 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12289 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-petalynx.ko 2023-12-22T09:45:45.660 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 72937 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-picolcd.ko 2023-12-22T09:45:45.660 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14225 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-pl.ko 2023-12-22T09:45:45.660 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15105 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-plantronics.ko 2023-12-22T09:45:45.660 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8417 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-primax.ko 2023-12-22T09:45:45.660 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 35393 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-rmi.ko 2023-12-22T09:45:45.660 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20833 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-arvo.ko 2023-12-22T09:45:45.660 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14065 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-common.ko 2023-12-22T09:45:45.660 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 31425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-isku.ko 2023-12-22T09:45:45.660 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 29729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-kone.ko 2023-12-22T09:45:45.660 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 31129 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-12-22T09:45:45.660 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21137 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-konepure.ko 2023-12-22T09:45:45.660 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 29489 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-12-22T09:45:45.660 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13305 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-lua.ko 2023-12-22T09:45:45.661 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 29313 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-pyra.ko 2023-12-22T09:45:45.661 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 27937 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-ryos.ko 2023-12-22T09:45:45.661 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19521 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat-savu.ko 2023-12-22T09:45:45.661 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-roccat.ko 2023-12-22T09:45:45.661 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13681 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-saitek.ko 2023-12-22T09:45:45.661 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15193 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-samsung.ko 2023-12-22T09:45:45.661 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 36817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-sensor-hub.ko 2023-12-22T09:45:45.661 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13601 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-sjoy.ko 2023-12-22T09:45:45.661 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 51249 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-sony.ko 2023-12-22T09:45:45.661 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8313 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-speedlink.ko 2023-12-22T09:45:45.662 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25297 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-steelseries.ko 2023-12-22T09:45:45.662 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-sunplus.ko 2023-12-22T09:45:45.662 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16993 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-thrustmaster.ko 2023-12-22T09:45:45.662 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-tivo.ko 2023-12-22T09:45:45.662 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15089 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-tmff.ko 2023-12-22T09:45:45.662 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14385 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-topseed.ko 2023-12-22T09:45:45.662 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16473 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-twinhan.ko 2023-12-22T09:45:45.662 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 71073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-uclogic.ko 2023-12-22T09:45:45.662 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10921 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-waltop.ko 2023-12-22T09:45:45.662 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 143473 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-wiimote.ko 2023-12-22T09:45:45.662 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8153 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-xinmo.ko 2023-12-22T09:45:45.662 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13321 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-zpff.ko 2023-12-22T09:45:45.662 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16665 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid-zydacron.ko 2023-12-22T09:45:45.662 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 267825 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/hid.ko 2023-12-22T09:45:45.663 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 32321 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/uhid.ko 2023-12-22T09:45:45.663 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/usbhid/ 2023-12-22T09:45:45.663 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 125721 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/usbhid/usbhid.ko 2023-12-22T09:45:45.663 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19137 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/usbhid/usbkbd.ko 2023-12-22T09:45:45.663 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14953 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/usbhid/usbmouse.ko 2023-12-22T09:45:45.663 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 217873 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hid/wacom.ko 2023-12-22T09:45:45.663 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hv/ 2023-12-22T09:45:45.663 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 64201 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hv/hv_balloon.ko 2023-12-22T09:45:45.663 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 89625 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hv/hv_utils.ko 2023-12-22T09:45:45.663 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 305465 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hv/hv_vmbus.ko 2023-12-22T09:45:45.663 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ 2023-12-22T09:45:45.663 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 66521 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/abituguru.ko 2023-12-22T09:45:45.663 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 61393 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/abituguru3.ko 2023-12-22T09:45:45.663 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 34745 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/acpi_power_meter.ko 2023-12-22T09:45:45.664 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17505 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ad7414.ko 2023-12-22T09:45:45.664 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19313 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ad7418.ko 2023-12-22T09:45:45.664 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25257 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adc128d818.ko 2023-12-22T09:45:45.664 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 31729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adm1025.ko 2023-12-22T09:45:45.664 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 97977 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adm1026.ko 2023-12-22T09:45:45.664 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19745 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adm1029.ko 2023-12-22T09:45:45.664 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 45553 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adm1031.ko 2023-12-22T09:45:45.664 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26289 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adm9240.ko 2023-12-22T09:45:45.664 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14769 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ads7828.ko 2023-12-22T09:45:45.664 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10769 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adt7410.ko 2023-12-22T09:45:45.664 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22049 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adt7411.ko 2023-12-22T09:45:45.664 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 74433 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adt7462.ko 2023-12-22T09:45:45.664 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 39585 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adt7470.ko 2023-12-22T09:45:45.664 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 67929 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adt7475.ko 2023-12-22T09:45:45.665 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19625 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/adt7x10.ko 2023-12-22T09:45:45.665 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 39073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/amc6821.ko 2023-12-22T09:45:45.665 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 55201 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/applesmc.ko 2023-12-22T09:45:45.665 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 49913 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/asb100.ko 2023-12-22T09:45:45.665 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 58617 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/asc7621.ko 2023-12-22T09:45:45.665 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 40825 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/asus_atk0110.ko 2023-12-22T09:45:45.665 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17225 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/atxp1.ko 2023-12-22T09:45:45.665 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28281 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/coretemp.ko 2023-12-22T09:45:45.665 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24593 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/da9052-hwmon.ko 2023-12-22T09:45:45.665 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17265 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/da9055-hwmon.ko 2023-12-22T09:45:45.665 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 44465 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-12-22T09:45:45.665 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 99601 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/dme1737.ko 2023-12-22T09:45:45.665 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19489 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ds1621.ko 2023-12-22T09:45:45.665 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15321 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ds620.ko 2023-12-22T09:45:45.666 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 29777 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/emc1403.ko 2023-12-22T09:45:45.666 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 33185 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/emc2103.ko 2023-12-22T09:45:45.666 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 30321 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/emc6w201.ko 2023-12-22T09:45:45.666 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 66985 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/f71805f.ko 2023-12-22T09:45:45.666 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 94457 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/f71882fg.ko 2023-12-22T09:45:45.666 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 41401 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/f75375s.ko 2023-12-22T09:45:45.666 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21305 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/fam15h_power.ko 2023-12-22T09:45:45.666 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 55449 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/fschmd.ko 2023-12-22T09:45:45.666 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14481 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/g760a.ko 2023-12-22T09:45:45.666 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24017 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/g762.ko 2023-12-22T09:45:45.666 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 46801 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/gl518sm.ko 2023-12-22T09:45:45.666 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 45529 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/gl520sm.ko 2023-12-22T09:45:45.666 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13273 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/hih6130.ko 2023-12-22T09:45:45.666 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9745 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/hwmon-vid.ko 2023-12-22T09:45:45.667 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11553 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/i5500_temp.ko 2023-12-22T09:45:45.667 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22601 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/i5k_amb.ko 2023-12-22T09:45:45.667 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 34529 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ibmaem.ko 2023-12-22T09:45:45.667 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21257 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ibmpex.ko 2023-12-22T09:45:45.667 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24873 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ina209.ko 2023-12-22T09:45:45.667 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13401 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ina2xx.ko 2023-12-22T09:45:45.667 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 130449 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/it87.ko 2023-12-22T09:45:45.667 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18841 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/jc42.ko 2023-12-22T09:45:45.667 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24329 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/k10temp.ko 2023-12-22T09:45:45.667 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13553 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/k8temp.ko 2023-12-22T09:45:45.667 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18929 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lineage-pem.ko 2023-12-22T09:45:45.667 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 48601 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm63.ko 2023-12-22T09:45:45.667 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16697 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm73.ko 2023-12-22T09:45:45.667 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 36777 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm75.ko 2023-12-22T09:45:45.667 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm77.ko 2023-12-22T09:45:45.668 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 34593 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm78.ko 2023-12-22T09:45:45.668 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 31745 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm80.ko 2023-12-22T09:45:45.668 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16889 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm83.ko 2023-12-22T09:45:45.668 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 72833 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm85.ko 2023-12-22T09:45:45.668 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 46153 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm87.ko 2023-12-22T09:45:45.668 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 37913 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm90.ko 2023-12-22T09:45:45.668 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19745 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm92.ko 2023-12-22T09:45:45.668 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 108841 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm93.ko 2023-12-22T09:45:45.668 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 33393 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm95234.ko 2023-12-22T09:45:45.668 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16201 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm95241.ko 2023-12-22T09:45:45.668 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18113 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/lm95245.ko 2023-12-22T09:45:45.668 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24017 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ltc2945.ko 2023-12-22T09:45:45.668 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13793 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ltc4151.ko 2023-12-22T09:45:45.669 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15193 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ltc4215.ko 2023-12-22T09:45:45.669 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14889 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ltc4222.ko 2023-12-22T09:45:45.669 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14825 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ltc4245.ko 2023-12-22T09:45:45.669 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13249 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ltc4260.ko 2023-12-22T09:45:45.669 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14993 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/ltc4261.ko 2023-12-22T09:45:45.669 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 33489 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/max16065.ko 2023-12-22T09:45:45.669 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18433 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/max1619.ko 2023-12-22T09:45:45.669 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24353 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/max1668.ko 2023-12-22T09:45:45.669 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19969 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/max197.ko 2023-12-22T09:45:45.669 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 27129 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/max6639.ko 2023-12-22T09:45:45.669 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23321 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/max6650.ko 2023-12-22T09:45:45.669 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 35777 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/max6697.ko 2023-12-22T09:45:45.669 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18585 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/mc13783-adc.ko 2023-12-22T09:45:45.669 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10585 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/mcp3021.ko 2023-12-22T09:45:45.670 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15937 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-12-22T09:45:45.670 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 44129 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/nct6683.ko 2023-12-22T09:45:45.670 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 119817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/nct6775-core.ko 2023-12-22T09:45:45.670 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 60705 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/nct6775.ko 2023-12-22T09:45:45.670 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 59737 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/nct7802.ko 2023-12-22T09:45:45.670 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 82337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pc87360.ko 2023-12-22T09:45:45.670 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 54433 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pc87427.ko 2023-12-22T09:45:45.670 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18473 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pcf8591.ko 2023-12-22T09:45:45.670 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/ 2023-12-22T09:45:45.670 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21353 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-12-22T09:45:45.670 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17065 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-12-22T09:45:45.670 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28329 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-12-22T09:45:45.670 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9577 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/max16064.ko 2023-12-22T09:45:45.670 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17657 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/max34440.ko 2023-12-22T09:45:45.671 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10169 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/max8688.ko 2023-12-22T09:45:45.671 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15505 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-12-22T09:45:45.671 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 82577 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-12-22T09:45:45.671 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-12-22T09:45:45.671 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 30729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-12-22T09:45:45.671 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-12-22T09:45:45.671 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20681 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-12-22T09:45:45.671 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13017 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/powr1220.ko 2023-12-22T09:45:45.671 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18705 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/sch5627.ko 2023-12-22T09:45:45.671 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/sch5636.ko 2023-12-22T09:45:45.671 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 27145 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/sch56xx-common.ko 2023-12-22T09:45:45.671 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 32137 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/sht15.ko 2023-12-22T09:45:45.672 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13505 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/sht21.ko 2023-12-22T09:45:45.672 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16833 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/shtc1.ko 2023-12-22T09:45:45.672 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 40105 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/sis5595.ko 2023-12-22T09:45:45.672 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19577 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/smsc47b397.ko 2023-12-22T09:45:45.672 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 39193 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/smsc47m1.ko 2023-12-22T09:45:45.672 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 37385 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/smsc47m192.ko 2023-12-22T09:45:45.672 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26553 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/thmc50.ko 2023-12-22T09:45:45.672 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17057 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/tmp102.ko 2023-12-22T09:45:45.672 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14097 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/tmp103.ko 2023-12-22T09:45:45.672 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21257 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/tmp401.ko 2023-12-22T09:45:45.672 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/tmp421.ko 2023-12-22T09:45:45.672 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19721 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/via-cputemp.ko 2023-12-22T09:45:45.672 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 41945 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/via686a.ko 2023-12-22T09:45:45.672 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 52457 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/vt1211.ko 2023-12-22T09:45:45.673 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 51545 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/vt8231.ko 2023-12-22T09:45:45.673 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 57449 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/w83627ehf.ko 2023-12-22T09:45:45.673 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 78873 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/w83627hf.ko 2023-12-22T09:45:45.673 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 71345 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/w83781d.ko 2023-12-22T09:45:45.673 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 63225 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/w83791d.ko 2023-12-22T09:45:45.673 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 71321 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/w83792d.ko 2023-12-22T09:45:45.673 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 101473 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/w83793.ko 2023-12-22T09:45:45.673 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 119505 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/w83795.ko 2023-12-22T09:45:45.673 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17313 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/w83l785ts.ko 2023-12-22T09:45:45.673 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 35625 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/w83l786ng.ko 2023-12-22T09:45:45.673 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13825 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-12-22T09:45:45.673 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10625 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-12-22T09:45:45.673 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/ 2023-12-22T09:45:45.673 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/algos/ 2023-12-22T09:45:45.674 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20049 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-12-22T09:45:45.674 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19345 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-12-22T09:45:45.674 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/ 2023-12-22T09:45:45.674 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 27969 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-12-22T09:45:45.674 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28801 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-12-22T09:45:45.674 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 27777 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-12-22T09:45:45.674 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17937 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-12-22T09:45:45.674 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26193 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-12-22T09:45:45.674 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16201 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-12-22T09:45:45.674 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15153 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-12-22T09:45:45.674 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 6929 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-12-22T09:45:45.674 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13961 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-12-22T09:45:45.674 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 50201 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-12-22T09:45:45.674 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23905 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-12-22T09:45:45.675 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20001 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-12-22T09:45:45.675 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-12-22T09:45:45.675 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12497 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-12-22T09:45:45.675 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17585 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-12-22T09:45:45.675 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 62817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-i801.ko 2023-12-22T09:45:45.675 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22433 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-isch.ko 2023-12-22T09:45:45.675 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 47889 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-12-22T09:45:45.675 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17721 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-12-22T09:45:45.675 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17881 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-12-22T09:45:45.675 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-12-22T09:45:45.675 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26265 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-12-22T09:45:45.675 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25145 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-parport.ko 2023-12-22T09:45:45.675 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16497 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-12-22T09:45:45.675 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 47241 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-12-22T09:45:45.676 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15289 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-12-22T09:45:45.676 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18649 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-12-22T09:45:45.676 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11809 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-12-22T09:45:45.676 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22313 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-12-22T09:45:45.676 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 29361 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-12-22T09:45:45.676 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20329 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-12-22T09:45:45.676 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19241 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-12-22T09:45:45.676 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19809 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-12-22T09:45:45.676 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13801 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-via.ko 2023-12-22T09:45:45.676 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26081 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-12-22T09:45:45.676 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19041 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-12-22T09:45:45.676 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 47657 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-12-22T09:45:45.676 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22449 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/i2c-mux.ko 2023-12-22T09:45:45.676 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18825 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/i2c-smbus.ko 2023-12-22T09:45:45.676 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 27073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/i2c-stub.ko 2023-12-22T09:45:45.677 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/muxes/ 2023-12-22T09:45:45.677 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14921 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-12-22T09:45:45.677 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13457 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-12-22T09:45:45.677 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 29737 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-12-22T09:45:45.677 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ 2023-12-22T09:45:45.677 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/core/ 2023-12-22T09:45:45.677 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 273609 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/core/ib_cm.ko 2023-12-22T09:45:45.677 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 879969 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/core/ib_core.ko 2023-12-22T09:45:45.677 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 69273 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/core/ib_umad.ko 2023-12-22T09:45:45.677 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 324217 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-12-22T09:45:45.677 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 97985 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/core/iw_cm.ko 2023-12-22T09:45:45.677 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 282273 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/core/rdma_cm.ko 2023-12-22T09:45:45.677 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 66201 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-12-22T09:45:45.677 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/hw/ 2023-12-22T09:45:45.678 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/hw/cxgb4/ 2023-12-22T09:45:45.678 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 493073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-12-22T09:45:45.678 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/hw/mlx4/ 2023-12-22T09:45:45.678 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 419737 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-12-22T09:45:45.678 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/hw/mlx5/ 2023-12-22T09:45:45.678 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 739025 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-12-22T09:45:45.678 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/hw/mthca/ 2023-12-22T09:45:45.678 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 296625 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-12-22T09:45:45.678 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/hw/ocrdma/ 2023-12-22T09:45:45.678 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 153697 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-12-22T09:45:45.734 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/hw/usnic/ 2023-12-22T09:45:45.734 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 168969 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-12-22T09:45:45.734 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp/ 2023-12-22T09:45:45.734 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp/ipoib/ 2023-12-22T09:45:45.734 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 263081 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-12-22T09:45:45.734 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp/iser/ 2023-12-22T09:45:45.734 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 100241 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-12-22T09:45:45.734 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp/isert/ 2023-12-22T09:45:45.734 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 111425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-12-22T09:45:45.734 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp/srp/ 2023-12-22T09:45:45.734 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 128753 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-12-22T09:45:45.734 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp/srpt/ 2023-12-22T09:45:45.735 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 129529 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-12-22T09:45:45.735 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/ 2023-12-22T09:45:45.735 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10745 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/evbug.ko 2023-12-22T09:45:45.735 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24129 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/ff-memless.ko 2023-12-22T09:45:45.735 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/gameport/ 2023-12-22T09:45:45.735 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11881 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-12-22T09:45:45.735 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12145 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/gameport/fm801-gp.ko 2023-12-22T09:45:45.735 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 41241 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/gameport/gameport.ko 2023-12-22T09:45:45.735 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 41801 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/joydev.ko 2023-12-22T09:45:45.735 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/ 2023-12-22T09:45:45.735 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13313 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-12-22T09:45:45.735 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12801 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-12-22T09:45:45.735 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26841 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-12-22T09:45:45.735 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24761 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-12-22T09:45:45.736 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 36665 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/gpio_keys.ko 2023-12-22T09:45:45.736 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18625 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-12-22T09:45:45.736 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21257 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/lkkbd.ko 2023-12-22T09:45:45.736 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26473 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/lm8323.ko 2023-12-22T09:45:45.736 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14409 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/lm8333.ko 2023-12-22T09:45:45.736 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24265 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-12-22T09:45:45.736 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18217 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-12-22T09:45:45.736 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15929 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-12-22T09:45:45.736 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16489 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-12-22T09:45:45.736 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11585 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/newtonkbd.ko 2023-12-22T09:45:45.736 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10673 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-12-22T09:45:45.736 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14161 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/qt1070.ko 2023-12-22T09:45:45.736 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17929 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/qt2160.ko 2023-12-22T09:45:45.736 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-12-22T09:45:45.737 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11481 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/stowaway.ko 2023-12-22T09:45:45.737 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18289 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/sunkbd.ko 2023-12-22T09:45:45.737 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-12-22T09:45:45.737 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16177 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-12-22T09:45:45.737 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16801 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-12-22T09:45:45.737 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11753 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/keyboard/xtkbd.ko 2023-12-22T09:45:45.737 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11465 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/matrix-keymap.ko 2023-12-22T09:45:45.737 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/mouse/ 2023-12-22T09:45:45.737 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 34329 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/mouse/appletouch.ko 2023-12-22T09:45:45.737 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 34177 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/mouse/bcm5974.ko 2023-12-22T09:45:45.737 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 123681 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/mouse/cyapatp.ko 2023-12-22T09:45:45.737 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 89449 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/mouse/elan_i2c.ko 2023-12-22T09:45:45.737 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13961 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/mouse/gpio_mouse.ko 2023-12-22T09:45:45.738 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 335929 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/mouse/psmouse.ko 2023-12-22T09:45:45.738 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14681 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/mouse/sermouse.ko 2023-12-22T09:45:45.738 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23881 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-12-22T09:45:45.738 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22569 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/mouse/synaptics_usb.ko 2023-12-22T09:45:45.738 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15665 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/mouse/vsxxxaa.ko 2023-12-22T09:45:45.738 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/rmi4/ 2023-12-22T09:45:45.738 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 109873 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/rmi4/rmi_core.ko 2023-12-22T09:45:45.738 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/serio/ 2023-12-22T09:45:45.738 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11665 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/serio/altera_ps2.ko 2023-12-22T09:45:45.738 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16289 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/serio/arc_ps2.ko 2023-12-22T09:45:45.738 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/serio/ct82c710.ko 2023-12-22T09:45:45.738 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16953 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-12-22T09:45:45.738 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15833 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/serio/parkbd.ko 2023-12-22T09:45:45.738 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13225 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/serio/pcips2.ko 2023-12-22T09:45:45.739 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20153 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/serio/ps2mult.ko 2023-12-22T09:45:45.739 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24153 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/serio/serio_raw.ko 2023-12-22T09:45:45.739 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17977 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/serio/serport.ko 2023-12-22T09:45:45.739 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/input/sparse-keymap.ko 2023-12-22T09:45:45.739 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/iommu/ 2023-12-22T09:45:45.739 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/iommu/amd/ 2023-12-22T09:45:45.739 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 39289 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/iommu/amd/iommu_v2.ko 2023-12-22T09:45:45.739 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/ 2023-12-22T09:45:45.739 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-88pm860x.ko 2023-12-22T09:45:45.739 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11385 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-adp5520.ko 2023-12-22T09:45:45.739 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 59753 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-bd2802.ko 2023-12-22T09:45:45.739 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24785 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-blinkm.ko 2023-12-22T09:45:45.739 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10473 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-da903x.ko 2023-12-22T09:45:45.739 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12241 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-da9052.ko 2023-12-22T09:45:45.740 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16561 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-gpio.ko 2023-12-22T09:45:45.740 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15793 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-lm3530.ko 2023-12-22T09:45:45.740 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 30505 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-lm3533.ko 2023-12-22T09:45:45.740 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19353 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-lm355x.ko 2023-12-22T09:45:45.740 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19961 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-lm3642.ko 2023-12-22T09:45:45.740 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16241 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-lp3944.ko 2023-12-22T09:45:45.740 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11233 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-lp8788.ko 2023-12-22T09:45:45.740 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14929 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-max8997.ko 2023-12-22T09:45:45.740 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12545 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-mc13783.ko 2023-12-22T09:45:45.740 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13385 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-menf21bmc.ko 2023-12-22T09:45:45.740 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20721 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-pca9532.ko 2023-12-22T09:45:45.740 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20481 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-pca955x.ko 2023-12-22T09:45:45.740 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17857 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-pca963x.ko 2023-12-22T09:45:45.740 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 34433 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-ss4200.ko 2023-12-22T09:45:45.741 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24865 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-tca6507.ko 2023-12-22T09:45:45.741 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15665 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-wm831x-status.ko 2023-12-22T09:45:45.741 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11841 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/leds-wm8350.ko 2023-12-22T09:45:45.741 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/trigger/ 2023-12-22T09:45:45.741 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9985 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-12-22T09:45:45.741 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10873 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-12-22T09:45:45.741 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9089 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-12-22T09:45:45.741 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7617 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-12-22T09:45:45.741 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14249 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-12-22T09:45:45.741 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-12-22T09:45:45.741 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11889 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-12-22T09:45:45.741 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-12-22T09:45:45.741 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/ 2023-12-22T09:45:45.741 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/bcache/ 2023-12-22T09:45:45.742 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 654969 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/bcache/bcache.ko 2023-12-22T09:45:45.742 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 40577 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-bio-prison.ko 2023-12-22T09:45:45.742 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 89601 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-bufio.ko 2023-12-22T09:45:45.742 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 47529 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-cache-smq.ko 2023-12-22T09:45:45.742 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 156009 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-cache.ko 2023-12-22T09:45:45.742 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 106897 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-crypt.ko 2023-12-22T09:45:45.742 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21545 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-delay.ko 2023-12-22T09:45:45.742 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 53857 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-era.ko 2023-12-22T09:45:45.742 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28465 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-flakey.ko 2023-12-22T09:45:45.742 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 41529 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-log-userspace.ko 2023-12-22T09:45:45.742 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 32737 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-log.ko 2023-12-22T09:45:45.742 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 49545 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-mirror.ko 2023-12-22T09:45:45.742 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 78033 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-multipath.ko 2023-12-22T09:45:45.742 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16473 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-queue-length.ko 2023-12-22T09:45:45.742 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 70825 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-raid.ko 2023-12-22T09:45:45.743 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 36297 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-region-hash.ko 2023-12-22T09:45:45.743 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15873 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-round-robin.ko 2023-12-22T09:45:45.743 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16801 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-service-time.ko 2023-12-22T09:45:45.743 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 109529 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-snapshot.ko 2023-12-22T09:45:45.743 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19361 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-switch.ko 2023-12-22T09:45:45.743 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 181865 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-thin-pool.ko 2023-12-22T09:45:45.743 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 51737 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-verity.ko 2023-12-22T09:45:45.743 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8561 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/dm-zero.ko 2023-12-22T09:45:45.743 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15345 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/faulty.ko 2023-12-22T09:45:45.743 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19625 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/linear.ko 2023-12-22T09:45:45.743 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 32417 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/multipath.ko 2023-12-22T09:45:45.743 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/persistent-data/ 2023-12-22T09:45:45.743 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 199937 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-12-22T09:45:45.744 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 37337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/raid0.ko 2023-12-22T09:45:45.744 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 113073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/raid1.ko 2023-12-22T09:45:45.744 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 158681 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/raid10.ko 2023-12-22T09:45:45.744 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 395721 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/md/raid456.ko 2023-12-22T09:45:45.744 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/message/ 2023-12-22T09:45:45.744 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/message/fusion/ 2023-12-22T09:45:45.744 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 178137 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/message/fusion/mptbase.ko 2023-12-22T09:45:45.744 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 63385 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/message/fusion/mptctl.ko 2023-12-22T09:45:45.744 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 44665 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/message/fusion/mptfc.ko 2023-12-22T09:45:45.744 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 37225 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/message/fusion/mptlan.ko 2023-12-22T09:45:45.744 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 123321 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/message/fusion/mptsas.ko 2023-12-22T09:45:45.744 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 79041 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/message/fusion/mptscsih.ko 2023-12-22T09:45:45.744 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 53017 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/message/fusion/mptspi.ko 2023-12-22T09:45:45.744 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/ 2023-12-22T09:45:45.744 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17305 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/88pm800.ko 2023-12-22T09:45:45.745 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12761 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/88pm805.ko 2023-12-22T09:45:45.745 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11193 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/88pm80x.ko 2023-12-22T09:45:45.745 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11865 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/arizona-i2c.ko 2023-12-22T09:45:45.745 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 123721 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/arizona.ko 2023-12-22T09:45:45.745 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11961 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/bcm590xx.ko 2023-12-22T09:45:45.745 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17465 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/cros_ec_dev.ko 2023-12-22T09:45:45.745 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 34961 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/dln2.ko 2023-12-22T09:45:45.745 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16689 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/janz-cmodio.ko 2023-12-22T09:45:45.745 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 53585 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/kempld-core.ko 2023-12-22T09:45:45.745 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 27529 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/lm3533-core.ko 2023-12-22T09:45:45.745 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14993 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-12-22T09:45:45.745 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13009 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/lp3943.ko 2023-12-22T09:45:45.745 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 54569 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/lpc_ich.ko 2023-12-22T09:45:45.745 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12113 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/lpc_sch.ko 2023-12-22T09:45:45.746 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17409 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/max8907.ko 2023-12-22T09:45:45.746 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 29857 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/mc13xxx-core.ko 2023-12-22T09:45:45.746 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11801 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-12-22T09:45:45.746 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11593 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/menf21bmc.ko 2023-12-22T09:45:45.746 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17329 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/pcf50633-adc.ko 2023-12-22T09:45:45.746 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9153 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/pcf50633-gpio.ko 2023-12-22T09:45:45.746 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 34873 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/pcf50633.ko 2023-12-22T09:45:45.746 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10105 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-12-22T09:45:45.746 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20289 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/retu-mfd.ko 2023-12-22T09:45:45.746 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 80425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/si476x-core.ko 2023-12-22T09:45:45.746 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 48457 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/sm501.ko 2023-12-22T09:45:45.746 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19825 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-12-22T09:45:45.746 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 51137 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/tps65010.ko 2023-12-22T09:45:45.746 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10353 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/tps6507x.ko 2023-12-22T09:45:45.747 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13329 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/viperboard.ko 2023-12-22T09:45:45.747 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/vx855.ko 2023-12-22T09:45:45.747 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17953 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/wl1273-core.ko 2023-12-22T09:45:45.747 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 44345 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/mfd/wm8994.ko 2023-12-22T09:45:45.747 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/ 2023-12-22T09:45:45.747 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13833 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-12-22T09:45:45.747 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 48489 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/ad525x_dpot.ko 2023-12-22T09:45:45.747 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/altera-stapl/ 2023-12-22T09:45:45.747 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 46585 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-12-22T09:45:45.747 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18393 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/apds9802als.ko 2023-12-22T09:45:45.747 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 36729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/apds990x.ko 2023-12-22T09:45:45.747 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 45593 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/bh1770glc.ko 2023-12-22T09:45:45.747 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/c2port/ 2023-12-22T09:45:45.747 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11145 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-12-22T09:45:45.748 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 35281 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/c2port/core.ko 2023-12-22T09:45:45.748 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/cb710/ 2023-12-22T09:45:45.748 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25161 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/cb710/cb710.ko 2023-12-22T09:45:45.748 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17801 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/ds1682.ko 2023-12-22T09:45:45.748 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8897 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/dummy-irq.ko 2023-12-22T09:45:45.748 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/echo/ 2023-12-22T09:45:45.748 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13657 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/echo/echo.ko 2023-12-22T09:45:45.748 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/eeprom/ 2023-12-22T09:45:45.748 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 37849 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/eeprom/at24.ko 2023-12-22T09:45:45.748 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14321 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/eeprom/eeprom.ko 2023-12-22T09:45:45.748 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14769 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-12-22T09:45:45.748 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/eeprom/max6875.ko 2023-12-22T09:45:45.748 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 33009 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/enclosure.ko 2023-12-22T09:45:45.748 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/genwqe/ 2023-12-22T09:45:45.749 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 152201 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-12-22T09:45:45.749 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14129 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/hmc6352.ko 2023-12-22T09:45:45.749 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 31257 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/hpilo.ko 2023-12-22T09:45:45.749 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/ibmasm/ 2023-12-22T09:45:45.749 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 72129 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-12-22T09:45:45.749 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19785 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/ics932s401.ko 2023-12-22T09:45:45.749 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21681 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/isl29003.ko 2023-12-22T09:45:45.749 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15753 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/isl29020.ko 2023-12-22T09:45:45.749 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/lis3lv02d/ 2023-12-22T09:45:45.749 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 42513 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-12-22T09:45:45.749 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13857 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-12-22T09:45:45.749 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/mei/ 2023-12-22T09:45:45.749 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 125209 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/mei/mei-me.ko 2023-12-22T09:45:45.749 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 56521 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/mei/mei-txe.ko 2023-12-22T09:45:45.750 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 310113 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/mei/mei.ko 2023-12-22T09:45:45.750 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 31329 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/phantom.ko 2023-12-22T09:45:45.750 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/ti-st/ 2023-12-22T09:45:45.750 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 74265 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/ti-st/st_drv.ko 2023-12-22T09:45:45.750 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24305 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/tifm_7xx1.ko 2023-12-22T09:45:45.750 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28785 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/tifm_core.ko 2023-12-22T09:45:45.750 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/tsl2550.ko 2023-12-22T09:45:45.750 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 48697 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/vmw_balloon.ko 2023-12-22T09:45:45.750 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/vmw_vmci/ 2023-12-22T09:45:45.750 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 183609 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-12-22T09:45:45.750 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ 2023-12-22T09:45:45.750 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/bonding/ 2023-12-22T09:45:45.750 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 490129 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/bonding/bonding.ko 2023-12-22T09:45:45.750 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/dsa/ 2023-12-22T09:45:45.751 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/dsa/b53/ 2023-12-22T09:45:45.751 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 106033 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/dsa/b53/b53_common.ko 2023-12-22T09:45:45.751 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 40417 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/dsa/bcm-sf2.ko 2023-12-22T09:45:45.751 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16041 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/dsa/mv88e6060.ko 2023-12-22T09:45:45.751 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/dsa/mv88e6xxx/ 2023-12-22T09:45:45.751 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 453737 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-12-22T09:45:45.751 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16929 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/dummy.ko 2023-12-22T09:45:45.751 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17961 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/eql.ko 2023-12-22T09:45:45.751 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/ 2023-12-22T09:45:45.751 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/3com/ 2023-12-22T09:45:45.751 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 45785 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-12-22T09:45:45.751 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 42105 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-12-22T09:45:45.751 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 130553 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-12-22T09:45:45.751 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 68849 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-12-22T09:45:45.751 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/8390/ 2023-12-22T09:45:45.752 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 37649 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/8390/8390.ko 2023-12-22T09:45:45.752 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 59689 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-12-22T09:45:45.752 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 27201 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-12-22T09:45:45.752 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 99049 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-12-22T09:45:45.752 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/adaptec/ 2023-12-22T09:45:45.752 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 54521 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-12-22T09:45:45.752 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/agere/ 2023-12-22T09:45:45.752 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 69137 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/agere/et131x.ko 2023-12-22T09:45:45.752 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/alteon/ 2023-12-22T09:45:45.752 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 59585 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-12-22T09:45:45.752 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/altera/ 2023-12-22T09:45:45.752 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 41409 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-12-22T09:45:45.752 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/amd/ 2023-12-22T09:45:45.752 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 54609 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-12-22T09:45:45.753 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 49289 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-12-22T09:45:45.753 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 87297 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-12-22T09:45:45.753 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/atheros/ 2023-12-22T09:45:45.753 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/atheros/alx/ 2023-12-22T09:45:45.753 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 97337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-12-22T09:45:45.753 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-12-22T09:45:45.753 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 104673 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-12-22T09:45:45.753 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-12-22T09:45:45.753 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 90257 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-12-22T09:45:45.753 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/atheros/atlx/ 2023-12-22T09:45:45.753 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 81569 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-12-22T09:45:45.753 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 69729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-12-22T09:45:45.753 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/broadcom/ 2023-12-22T09:45:45.754 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 78401 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-12-22T09:45:45.754 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 176761 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-12-22T09:45:45.754 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-12-22T09:45:45.754 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 1421497 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-12-22T09:45:45.754 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 128569 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-12-22T09:45:45.754 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/broadcom/genet/ 2023-12-22T09:45:45.754 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 132089 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-12-22T09:45:45.754 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 312081 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-12-22T09:45:45.754 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/brocade/ 2023-12-22T09:45:45.754 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/brocade/bna/ 2023-12-22T09:45:45.754 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 323513 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-12-22T09:45:45.754 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio/ 2023-12-22T09:45:45.754 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-12-22T09:45:45.754 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 193497 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-12-22T09:45:45.754 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-12-22T09:45:45.755 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 347417 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-12-22T09:45:45.755 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-12-22T09:45:45.755 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 1044497 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-12-22T09:45:45.755 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-12-22T09:45:45.755 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 166193 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-12-22T09:45:45.755 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-12-22T09:45:45.755 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 34881 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-12-22T09:45:45.755 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/cisco/ 2023-12-22T09:45:45.755 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/cisco/enic/ 2023-12-22T09:45:45.755 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 204345 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-12-22T09:45:45.755 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dec/ 2023-12-22T09:45:45.755 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dec/tulip/ 2023-12-22T09:45:45.755 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 69449 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-12-22T09:45:45.756 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 61489 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-12-22T09:45:45.756 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 141225 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-12-22T09:45:45.756 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 51497 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-12-22T09:45:45.756 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 62817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-12-22T09:45:45.756 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 31369 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-12-22T09:45:45.756 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dlink/ 2023-12-22T09:45:45.756 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 60873 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-12-22T09:45:45.756 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 62833 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-12-22T09:45:45.756 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 45721 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/dnet.ko 2023-12-22T09:45:45.756 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25185 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/ec_bhf.ko 2023-12-22T09:45:45.756 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/emulex/ 2023-12-22T09:45:45.756 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/emulex/benet/ 2023-12-22T09:45:45.756 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 281137 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-12-22T09:45:45.756 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 49457 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/ethoc.ko 2023-12-22T09:45:45.757 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 51737 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/fealnx.ko 2023-12-22T09:45:45.757 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/fujitsu/ 2023-12-22T09:45:45.757 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 45345 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-12-22T09:45:45.757 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/ 2023-12-22T09:45:45.757 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 90465 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/e100.ko 2023-12-22T09:45:45.757 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/e1000/ 2023-12-22T09:45:45.757 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 295577 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-12-22T09:45:45.757 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/e1000e/ 2023-12-22T09:45:45.757 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 584497 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-12-22T09:45:45.757 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/fm10k/ 2023-12-22T09:45:45.757 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 246209 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-12-22T09:45:45.757 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/i40e/ 2023-12-22T09:45:45.757 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 925825 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-12-22T09:45:45.757 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/iavf/ 2023-12-22T09:45:45.757 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 302937 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-12-22T09:45:45.758 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/igb/ 2023-12-22T09:45:45.758 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 514641 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-12-22T09:45:45.758 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/igbvf/ 2023-12-22T09:45:45.758 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 93593 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-12-22T09:45:45.758 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-12-22T09:45:45.758 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 734305 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-12-22T09:45:45.758 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-12-22T09:45:45.758 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 151769 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-12-22T09:45:45.758 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 86921 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/jme.ko 2023-12-22T09:45:45.758 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/marvell/ 2023-12-22T09:45:45.758 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20977 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-12-22T09:45:45.758 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 102289 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/marvell/skge.ko 2023-12-22T09:45:45.758 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 122649 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-12-22T09:45:45.759 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/mellanox/ 2023-12-22T09:45:45.759 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-12-22T09:45:45.759 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 727601 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-12-22T09:45:45.759 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 278937 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-12-22T09:45:45.759 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-12-22T09:45:45.759 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-12-22T09:45:45.759 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 1113681 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-12-22T09:45:45.759 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/micrel/ 2023-12-22T09:45:45.759 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 53041 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-12-22T09:45:45.759 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 40993 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-12-22T09:45:45.759 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19489 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-12-22T09:45:45.759 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 95665 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-12-22T09:45:45.759 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/myricom/ 2023-12-22T09:45:45.759 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-12-22T09:45:45.759 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 108649 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-12-22T09:45:45.760 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/natsemi/ 2023-12-22T09:45:45.760 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 73441 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-12-22T09:45:45.760 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 47777 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-12-22T09:45:45.760 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/neterion/ 2023-12-22T09:45:45.760 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 150905 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-12-22T09:45:45.760 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/nvidia/ 2023-12-22T09:45:45.760 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 136721 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-12-22T09:45:45.760 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/packetengines/ 2023-12-22T09:45:45.760 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 50481 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-12-22T09:45:45.760 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 43145 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-12-22T09:45:45.760 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/qlogic/ 2023-12-22T09:45:45.760 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-12-22T09:45:45.760 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 227897 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-12-22T09:45:45.760 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 87081 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-12-22T09:45:45.761 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-12-22T09:45:45.761 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 672049 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-12-22T09:45:45.761 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/rdc/ 2023-12-22T09:45:45.761 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 43017 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-12-22T09:45:45.761 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/realtek/ 2023-12-22T09:45:45.761 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 67385 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-12-22T09:45:45.761 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 83985 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-12-22T09:45:45.761 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 29321 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/realtek/atp.ko 2023-12-22T09:45:45.761 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 189801 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-12-22T09:45:45.761 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/samsung/ 2023-12-22T09:45:45.761 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-12-22T09:45:45.761 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 104241 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-12-22T09:45:45.761 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/sfc/ 2023-12-22T09:45:45.761 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 1052497 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-12-22T09:45:45.762 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/silan/ 2023-12-22T09:45:45.762 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 47097 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-12-22T09:45:45.762 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/sis/ 2023-12-22T09:45:45.762 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 54817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/sis/sis190.ko 2023-12-22T09:45:45.762 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 63337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/sis/sis900.ko 2023-12-22T09:45:45.762 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/smsc/ 2023-12-22T09:45:45.762 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 61537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-12-22T09:45:45.762 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 67193 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-12-22T09:45:45.762 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 73409 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-12-22T09:45:45.762 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 68177 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-12-22T09:45:45.762 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/stmicro/ 2023-12-22T09:45:45.762 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-12-22T09:45:45.762 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13441 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-12-22T09:45:45.762 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 39905 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-12-22T09:45:45.762 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20657 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-12-22T09:45:45.763 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 487025 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-12-22T09:45:45.763 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/sun/ 2023-12-22T09:45:45.763 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 103337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/sun/cassini.ko 2023-12-22T09:45:45.763 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 166097 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/sun/niu.ko 2023-12-22T09:45:45.763 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 66329 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/sun/sungem.ko 2023-12-22T09:45:45.763 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 78801 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-12-22T09:45:45.763 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/tehuti/ 2023-12-22T09:45:45.763 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 50057 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-12-22T09:45:45.763 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/ti/ 2023-12-22T09:45:45.763 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 86529 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/ti/tlan.ko 2023-12-22T09:45:45.763 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/via/ 2023-12-22T09:45:45.763 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 80273 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-12-22T09:45:45.763 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 83633 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-12-22T09:45:45.763 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/wiznet/ 2023-12-22T09:45:45.764 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 46241 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-12-22T09:45:45.764 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 30849 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-12-22T09:45:45.764 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/xircom/ 2023-12-22T09:45:45.764 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 59993 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-12-22T09:45:45.764 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/fddi/ 2023-12-22T09:45:45.764 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 41001 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/fddi/defxx.ko 2023-12-22T09:45:45.764 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/fddi/skfp/ 2023-12-22T09:45:45.764 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 216985 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/fddi/skfp/skfp.ko 2023-12-22T09:45:45.764 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 77345 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/geneve.ko 2023-12-22T09:45:45.764 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/hyperv/ 2023-12-22T09:45:45.764 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 235521 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-12-22T09:45:45.764 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ieee802154/ 2023-12-22T09:45:45.764 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18273 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ieee802154/fakelb.ko 2023-12-22T09:45:45.764 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25065 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ifb.ko 2023-12-22T09:45:45.765 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ipvlan/ 2023-12-22T09:45:45.765 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 83769 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ipvlan/ipvlan.ko 2023-12-22T09:45:45.765 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 62145 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/macvlan.ko 2023-12-22T09:45:45.765 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15865 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/macvtap.ko 2023-12-22T09:45:45.765 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/mdio/ 2023-12-22T09:45:45.765 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20569 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-12-22T09:45:45.765 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14185 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-12-22T09:45:45.765 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13681 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/mdio/mdio-gpio.ko 2023-12-22T09:45:45.765 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8825 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/mdio/mdio-regmap.ko 2023-12-22T09:45:45.765 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16025 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/mdio.ko 2023-12-22T09:45:45.765 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20513 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/mii.ko 2023-12-22T09:45:45.765 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 43953 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/netconsole.ko 2023-12-22T09:45:45.765 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13145 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/nlmon.ko 2023-12-22T09:45:45.765 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/pcs/ 2023-12-22T09:45:45.766 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17985 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/pcs/pcs-lynx.ko 2023-12-22T09:45:45.766 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 38977 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-12-22T09:45:45.766 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/ 2023-12-22T09:45:45.766 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9737 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/amd.ko 2023-12-22T09:45:45.766 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 50033 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-12-22T09:45:45.766 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 44721 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/bcm7xxx.ko 2023-12-22T09:45:45.766 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11521 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/bcm87xx.ko 2023-12-22T09:45:45.766 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 42241 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/broadcom.ko 2023-12-22T09:45:45.766 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10625 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/cicada.ko 2023-12-22T09:45:45.766 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13025 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/davicom.ko 2023-12-22T09:45:45.766 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9449 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/et1011c.ko 2023-12-22T09:45:45.766 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24969 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/icplus.ko 2023-12-22T09:45:45.766 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15849 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/lxt.ko 2023-12-22T09:45:45.766 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 82049 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/marvell.ko 2023-12-22T09:45:45.767 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 76113 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/micrel.ko 2023-12-22T09:45:45.767 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12033 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/national.ko 2023-12-22T09:45:45.767 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 97857 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/phylink.ko 2023-12-22T09:45:45.767 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10065 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/qsemi.ko 2023-12-22T09:45:45.767 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 50065 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/realtek.ko 2023-12-22T09:45:45.767 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 29985 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/smsc.ko 2023-12-22T09:45:45.767 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10857 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/ste10Xp.ko 2023-12-22T09:45:45.767 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24289 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/phy/vitesse.ko 2023-12-22T09:45:45.767 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/plip/ 2023-12-22T09:45:45.767 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 43505 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/plip/plip.ko 2023-12-22T09:45:45.767 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ppp/ 2023-12-22T09:45:45.767 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15857 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ppp/bsd_comp.ko 2023-12-22T09:45:45.767 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 29713 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ppp/ppp_async.ko 2023-12-22T09:45:45.767 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17665 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ppp/ppp_deflate.ko 2023-12-22T09:45:45.768 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18625 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ppp/ppp_mppe.ko 2023-12-22T09:45:45.768 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ppp/ppp_synctty.ko 2023-12-22T09:45:45.768 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 42545 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ppp/pppoe.ko 2023-12-22T09:45:45.768 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13441 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ppp/pppox.ko 2023-12-22T09:45:45.768 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 32689 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/ppp/pptp.ko 2023-12-22T09:45:45.768 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28289 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/sb1000.ko 2023-12-22T09:45:45.768 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/slip/ 2023-12-22T09:45:45.768 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 42465 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/slip/slip.ko 2023-12-22T09:45:45.768 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26929 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/sungem_phy.ko 2023-12-22T09:45:45.768 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 64449 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/tap.ko 2023-12-22T09:45:45.768 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/team/ 2023-12-22T09:45:45.768 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 106169 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/team/team.ko 2023-12-22T09:45:45.768 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13497 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/team/team_mode_activebackup.ko 2023-12-22T09:45:45.768 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10209 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/team/team_mode_broadcast.ko 2023-12-22T09:45:45.768 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28881 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-12-22T09:45:45.769 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9641 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/team/team_mode_random.ko 2023-12-22T09:45:45.769 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9321 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-12-22T09:45:45.769 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 87017 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/veth.ko 2023-12-22T09:45:45.769 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/vmxnet3/ 2023-12-22T09:45:45.769 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 144297 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-12-22T09:45:45.769 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/vxlan/ 2023-12-22T09:45:45.769 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 297329 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/vxlan/vxlan.ko 2023-12-22T09:45:45.769 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/xen-netback/ 2023-12-22T09:45:45.769 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 144585 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/net/xen-netback/xen-netback.ko 2023-12-22T09:45:45.769 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ntb/ 2023-12-22T09:45:45.769 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20969 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ntb/ntb.ko 2023-12-22T09:45:45.769 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/nvme/ 2023-12-22T09:45:45.769 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/nvme/host/ 2023-12-22T09:45:45.769 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 265121 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/nvme/host/nvme-core.ko 2023-12-22T09:45:45.770 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 102209 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/nvme/host/nvme.ko 2023-12-22T09:45:45.770 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/parport/ 2023-12-22T09:45:45.770 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 133841 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/parport/parport.ko 2023-12-22T09:45:45.770 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14561 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/parport/parport_cs.ko 2023-12-22T09:45:45.770 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 84465 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/parport/parport_pc.ko 2023-12-22T09:45:45.770 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26121 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/parport/parport_serial.ko 2023-12-22T09:45:45.770 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pci/ 2023-12-22T09:45:45.770 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pci/hotplug/ 2023-12-22T09:45:45.770 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25009 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-12-22T09:45:45.770 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17849 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-12-22T09:45:45.770 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20137 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-12-22T09:45:45.770 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11857 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pci/pci-stub.ko 2023-12-22T09:45:45.770 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 46465 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pci/xen-pcifront.ko 2023-12-22T09:45:45.770 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pcmcia/ 2023-12-22T09:45:45.771 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26793 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pcmcia/i82092.ko 2023-12-22T09:45:45.771 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 145809 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pcmcia/pcmcia.ko 2023-12-22T09:45:45.771 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 62137 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pcmcia/pcmcia_core.ko 2023-12-22T09:45:45.771 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 34345 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-12-22T09:45:45.771 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 34265 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pcmcia/pd6729.ko 2023-12-22T09:45:45.771 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 112889 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pcmcia/yenta_socket.ko 2023-12-22T09:45:45.771 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/phy/ 2023-12-22T09:45:45.771 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/phy/broadcom/ 2023-12-22T09:45:45.771 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10841 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-12-22T09:45:45.771 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/phy/samsung/ 2023-12-22T09:45:45.771 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8441 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-12-22T09:45:45.771 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pinctrl/ 2023-12-22T09:45:45.771 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pinctrl/intel/ 2023-12-22T09:45:45.772 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 70153 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-12-22T09:45:45.772 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/ 2023-12-22T09:45:45.772 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/chrome/ 2023-12-22T09:45:45.772 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 50889 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-12-22T09:45:45.772 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20849 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/chrome/cros_ec.ko 2023-12-22T09:45:45.772 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21449 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-12-22T09:45:45.772 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25417 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-12-22T09:45:45.772 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26201 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-12-22T09:45:45.772 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18201 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-12-22T09:45:45.772 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17361 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-12-22T09:45:45.772 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/ 2023-12-22T09:45:45.772 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 67097 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/acer-wmi.ko 2023-12-22T09:45:45.772 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 39145 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/acerhdf.ko 2023-12-22T09:45:45.772 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 37025 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/apple-gmux.ko 2023-12-22T09:45:45.772 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 59665 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/asus-laptop.ko 2023-12-22T09:45:45.773 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 31161 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-12-22T09:45:45.773 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 127441 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/asus-wmi.ko 2023-12-22T09:45:45.773 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 36849 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/classmate-laptop.ko 2023-12-22T09:45:45.773 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 49121 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-12-22T09:45:45.773 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13961 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-12-22T09:45:45.773 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 40265 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-12-22T09:45:45.773 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22521 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-12-22T09:45:45.773 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 36593 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/hdaps.ko 2023-12-22T09:45:45.773 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19449 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/ibm_rtl.ko 2023-12-22T09:45:45.773 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/intel/ 2023-12-22T09:45:45.773 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-12-22T09:45:45.773 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8985 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-12-22T09:45:45.773 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 43497 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/intel_ips.ko 2023-12-22T09:45:45.774 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20273 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/msi-wmi.ko 2023-12-22T09:45:45.774 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10377 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/mxm-wmi.ko 2023-12-22T09:45:45.774 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 34801 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-12-22T09:45:45.774 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 42329 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/samsung-laptop.ko 2023-12-22T09:45:45.774 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14169 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/samsung-q10.ko 2023-12-22T09:45:45.774 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17321 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/topstar-laptop.ko 2023-12-22T09:45:45.774 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13721 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-12-22T09:45:45.774 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17081 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/toshiba_haps.ko 2023-12-22T09:45:45.774 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10129 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/wmi-bmof.ko 2023-12-22T09:45:45.774 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 57569 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/platform/x86/wmi.ko 2023-12-22T09:45:45.774 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/ 2023-12-22T09:45:45.774 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/ 2023-12-22T09:45:45.774 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 30281 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/88pm860x_battery.ko 2023-12-22T09:45:45.774 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 33985 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/88pm860x_charger.ko 2023-12-22T09:45:45.775 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 55057 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/bq2415x_charger.ko 2023-12-22T09:45:45.775 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 54081 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/bq24190_charger.ko 2023-12-22T09:45:45.775 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21553 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/bq24735-charger.ko 2023-12-22T09:45:45.775 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-12-22T09:45:45.775 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19609 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/da9030_battery.ko 2023-12-22T09:45:45.775 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19841 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/da9052-battery.ko 2023-12-22T09:45:45.775 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 29281 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/ds2760_battery.ko 2023-12-22T09:45:45.775 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23217 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/ds2780_battery.ko 2023-12-22T09:45:45.775 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23353 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/ds2781_battery.ko 2023-12-22T09:45:45.775 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23649 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/ds2782_battery.ko 2023-12-22T09:45:45.775 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20353 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/gpio-charger.ko 2023-12-22T09:45:45.775 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18041 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/isp1704_charger.ko 2023-12-22T09:45:45.775 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20273 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/lp8727_charger.ko 2023-12-22T09:45:45.775 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12577 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/max14577_charger.ko 2023-12-22T09:45:45.775 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25897 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/max17040_battery.ko 2023-12-22T09:45:45.776 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 30289 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/max17042_battery.ko 2023-12-22T09:45:45.776 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18585 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/max8903_charger.ko 2023-12-22T09:45:45.776 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/max8925_power.ko 2023-12-22T09:45:45.776 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21657 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/pcf50633-charger.ko 2023-12-22T09:45:45.776 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 38009 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/sbs-battery.ko 2023-12-22T09:45:45.776 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28385 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/test_power.ko 2023-12-22T09:45:45.776 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18865 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/tps65090-charger.ko 2023-12-22T09:45:45.776 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11969 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/wm831x_backup.ko 2023-12-22T09:45:45.776 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24521 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/wm831x_power.ko 2023-12-22T09:45:45.776 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22417 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/power/supply/wm8350_power.ko 2023-12-22T09:45:45.776 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/powercap/ 2023-12-22T09:45:45.776 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 57729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/powercap/intel_rapl_common.ko 2023-12-22T09:45:45.776 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17345 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/powercap/intel_rapl_msr.ko 2023-12-22T09:45:45.776 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pps/ 2023-12-22T09:45:45.777 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pps/clients/ 2023-12-22T09:45:45.777 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15521 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pps/clients/pps-gpio.ko 2023-12-22T09:45:45.777 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13249 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pps/clients/pps-ldisc.ko 2023-12-22T09:45:45.777 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15913 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pps/clients/pps_parport.ko 2023-12-22T09:45:45.777 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 41873 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/pps/pps_core.ko 2023-12-22T09:45:45.777 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ptp/ 2023-12-22T09:45:45.777 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 66385 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ptp/ptp.ko 2023-12-22T09:45:45.777 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16449 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ptp/ptp_kvm.ko 2023-12-22T09:45:45.777 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/ 2023-12-22T09:45:45.777 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23497 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-88pm80x.ko 2023-12-22T09:45:45.777 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24521 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-88pm860x.ko 2023-12-22T09:45:45.777 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15393 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-bq32k.ko 2023-12-22T09:45:45.777 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20105 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-da9052.ko 2023-12-22T09:45:45.777 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18505 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-da9055.ko 2023-12-22T09:45:45.778 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-da9063.ko 2023-12-22T09:45:45.778 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16457 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-ds1286.ko 2023-12-22T09:45:45.778 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 68577 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-ds1307.ko 2023-12-22T09:45:45.778 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-ds1374.ko 2023-12-22T09:45:45.778 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18217 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-ds1511.ko 2023-12-22T09:45:45.778 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16737 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-ds1553.ko 2023-12-22T09:45:45.778 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13953 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-ds1672.ko 2023-12-22T09:45:45.778 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13369 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-ds1742.ko 2023-12-22T09:45:45.778 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14697 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-ds2404.ko 2023-12-22T09:45:45.778 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23705 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-ds3232.ko 2023-12-22T09:45:45.778 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11081 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-em3027.ko 2023-12-22T09:45:45.778 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24329 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-fm3130.ko 2023-12-22T09:45:45.778 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-isl12022.ko 2023-12-22T09:45:45.778 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 35969 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-isl1208.ko 2023-12-22T09:45:45.779 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14673 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-lp8788.ko 2023-12-22T09:45:45.779 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 38097 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-m41t80.ko 2023-12-22T09:45:45.779 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12089 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-m48t35.ko 2023-12-22T09:45:45.779 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25945 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-m48t59.ko 2023-12-22T09:45:45.779 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14841 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-m48t86.ko 2023-12-22T09:45:45.779 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11633 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-max6900.ko 2023-12-22T09:45:45.779 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14673 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-max8907.ko 2023-12-22T09:45:45.779 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15345 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-max8925.ko 2023-12-22T09:45:45.779 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25809 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-max8997.ko 2023-12-22T09:45:45.779 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16681 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-max8998.ko 2023-12-22T09:45:45.779 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18513 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-12-22T09:45:45.779 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11409 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-msm6242.ko 2023-12-22T09:45:45.779 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19625 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-palmas.ko 2023-12-22T09:45:45.779 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 46633 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-pcf2127.ko 2023-12-22T09:45:45.780 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17977 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-pcf50633.ko 2023-12-22T09:45:45.780 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26993 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-pcf85063.ko 2023-12-22T09:45:45.780 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21825 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-pcf8523.ko 2023-12-22T09:45:45.780 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 29817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-pcf8563.ko 2023-12-22T09:45:45.780 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12441 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-pcf8583.ko 2023-12-22T09:45:45.780 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18033 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-rc5t583.ko 2023-12-22T09:45:45.780 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13049 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-rp5c01.ko 2023-12-22T09:45:45.780 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 33753 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-rs5c372.ko 2023-12-22T09:45:45.780 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 27833 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-12-22T09:45:45.780 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25257 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-rx8025.ko 2023-12-22T09:45:45.780 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20113 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-rx8581.ko 2023-12-22T09:45:45.780 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21617 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-s35390a.ko 2023-12-22T09:45:45.780 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16825 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-12-22T09:45:45.780 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17889 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-tps6586x.ko 2023-12-22T09:45:45.781 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-tps65910.ko 2023-12-22T09:45:45.781 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20545 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-wm831x.ko 2023-12-22T09:45:45.781 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21089 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-wm8350.ko 2023-12-22T09:45:45.781 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 27873 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/rtc/rtc-x1205.ko 2023-12-22T09:45:45.781 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/ 2023-12-22T09:45:45.781 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 77617 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/3w-9xxx.ko 2023-12-22T09:45:45.781 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 57665 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/3w-sas.ko 2023-12-22T09:45:45.781 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 55105 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/3w-xxxx.ko 2023-12-22T09:45:45.781 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 135185 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/BusLogic.ko 2023-12-22T09:45:45.781 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26657 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/a100u2w.ko 2023-12-22T09:45:45.781 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/aacraid/ 2023-12-22T09:45:45.781 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 272305 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/aacraid/aacraid.ko 2023-12-22T09:45:45.781 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 100617 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/advansys.ko 2023-12-22T09:45:45.781 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/aic7xxx/ 2023-12-22T09:45:45.781 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 356201 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-12-22T09:45:45.782 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 295801 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-12-22T09:45:45.782 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/aic94xx/ 2023-12-22T09:45:45.782 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 189185 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-12-22T09:45:45.782 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/am53c974.ko 2023-12-22T09:45:45.782 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/arcmsr/ 2023-12-22T09:45:45.782 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 106881 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-12-22T09:45:45.782 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 38185 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/atp870u.ko 2023-12-22T09:45:45.782 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/be2iscsi/ 2023-12-22T09:45:45.782 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 246985 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-12-22T09:45:45.782 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/bfa/ 2023-12-22T09:45:45.782 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 1171945 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/bfa/bfa.ko 2023-12-22T09:45:45.782 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/bnx2fc/ 2023-12-22T09:45:45.782 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 237273 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-12-22T09:45:45.782 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/bnx2i/ 2023-12-22T09:45:45.783 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 115369 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-12-22T09:45:45.783 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 40585 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/ch.ko 2023-12-22T09:45:45.783 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/csiostor/ 2023-12-22T09:45:45.783 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 308921 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/csiostor/csiostor.ko 2023-12-22T09:45:45.783 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/cxgbi/ 2023-12-22T09:45:45.783 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-12-22T09:45:45.783 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 76145 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-12-22T09:45:45.783 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-12-22T09:45:45.783 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 101449 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-12-22T09:45:45.783 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 146689 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-12-22T09:45:45.783 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 75553 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/dc395x.ko 2023-12-22T09:45:45.783 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 38073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/dmx3191d.ko 2023-12-22T09:45:45.783 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/esas2r/ 2023-12-22T09:45:45.784 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 212425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/esas2r/esas2r.ko 2023-12-22T09:45:45.784 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 60505 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/esp_scsi.ko 2023-12-22T09:45:45.784 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/fcoe/ 2023-12-22T09:45:45.784 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 78209 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/fcoe/fcoe.ko 2023-12-22T09:45:45.784 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 158505 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-12-22T09:45:45.784 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18945 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/fdomain.ko 2023-12-22T09:45:45.784 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/fnic/ 2023-12-22T09:45:45.784 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 263489 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/fnic/fnic.ko 2023-12-22T09:45:45.784 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 201817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/hpsa.ko 2023-12-22T09:45:45.784 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 51209 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/hptiop.ko 2023-12-22T09:45:45.784 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 49041 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/hv_storvsc.ko 2023-12-22T09:45:45.784 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 35337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/imm.ko 2023-12-22T09:45:45.784 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 44057 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/initio.ko 2023-12-22T09:45:45.784 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 266537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/ipr.ko 2023-12-22T09:45:45.785 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 101881 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/ips.ko 2023-12-22T09:45:45.785 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/isci/ 2023-12-22T09:45:45.785 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 317153 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/isci/isci.ko 2023-12-22T09:45:45.785 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26385 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-12-22T09:45:45.785 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 52961 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/iscsi_tcp.ko 2023-12-22T09:45:45.785 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/libfc/ 2023-12-22T09:45:45.785 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 314865 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/libfc/libfc.ko 2023-12-22T09:45:45.785 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 145585 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/libiscsi.ko 2023-12-22T09:45:45.785 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 53521 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/libiscsi_tcp.ko 2023-12-22T09:45:45.785 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/libsas/ 2023-12-22T09:45:45.785 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 216665 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/libsas/libsas.ko 2023-12-22T09:45:45.785 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/lpfc/ 2023-12-22T09:45:45.785 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 2197249 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/lpfc/lpfc.ko 2023-12-22T09:45:45.785 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/megaraid/ 2023-12-22T09:45:45.786 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 73569 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-12-22T09:45:45.786 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 33529 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-12-22T09:45:45.786 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 310617 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-12-22T09:45:45.786 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 84721 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/megaraid.ko 2023-12-22T09:45:45.786 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/mpt3sas/ 2023-12-22T09:45:45.786 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 659825 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-12-22T09:45:45.869 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/mvsas/ 2023-12-22T09:45:45.869 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 119561 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/mvsas/mvsas.ko 2023-12-22T09:45:45.869 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 78129 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/mvumi.ko 2023-12-22T09:45:45.870 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/pcmcia/ 2023-12-22T09:45:45.870 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 81625 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-12-22T09:45:45.870 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11713 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-12-22T09:45:45.870 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20865 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-12-22T09:45:45.870 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23857 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-12-22T09:45:45.870 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/pm8001/ 2023-12-22T09:45:45.870 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 364105 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-12-22T09:45:45.870 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 123617 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/pmcraid.ko 2023-12-22T09:45:45.870 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 34513 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/ppa.ko 2023-12-22T09:45:45.870 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 55361 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/qla1280.ko 2023-12-22T09:45:45.870 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/qla2xxx/ 2023-12-22T09:45:45.870 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 1876689 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-12-22T09:45:45.870 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 85289 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-12-22T09:45:45.871 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/qla4xxx/ 2023-12-22T09:45:45.871 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 559033 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-12-22T09:45:45.871 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19025 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/qlogicfas408.ko 2023-12-22T09:45:45.871 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15993 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/raid_class.ko 2023-12-22T09:45:45.871 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 238761 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/scsi_debug.ko 2023-12-22T09:45:45.871 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 173937 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/scsi_transport_fc.ko 2023-12-22T09:45:45.871 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 279313 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-12-22T09:45:45.871 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 97729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/scsi_transport_sas.ko 2023-12-22T09:45:45.871 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 73881 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/scsi_transport_spi.ko 2023-12-22T09:45:45.871 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 44993 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/scsi_transport_srp.ko 2023-12-22T09:45:45.871 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26249 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/ses.ko 2023-12-22T09:45:45.871 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 115889 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/st.ko 2023-12-22T09:45:45.871 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 46825 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/stex.ko 2023-12-22T09:45:45.871 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/sym53c8xx_2/ 2023-12-22T09:45:45.871 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 162121 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-12-22T09:45:45.872 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 42297 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/virtio_scsi.ko 2023-12-22T09:45:45.872 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 50321 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/vmw_pvscsi.ko 2023-12-22T09:45:45.872 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 39961 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/wd719x.ko 2023-12-22T09:45:45.872 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 50025 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/scsi/xen-scsifront.ko 2023-12-22T09:45:45.872 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ssb/ 2023-12-22T09:45:45.872 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 129441 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ssb/ssb.ko 2023-12-22T09:45:45.872 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/ 2023-12-22T09:45:45.872 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/iscsi/ 2023-12-22T09:45:45.872 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 736601 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-12-22T09:45:45.872 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/loopback/ 2023-12-22T09:45:45.872 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 49985 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/loopback/tcm_loop.ko 2023-12-22T09:45:45.872 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 39713 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/target_core_file.ko 2023-12-22T09:45:45.872 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 43025 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/target_core_iblock.ko 2023-12-22T09:45:45.872 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 930257 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/target_core_mod.ko 2023-12-22T09:45:45.873 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 44305 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/target_core_pscsi.ko 2023-12-22T09:45:45.873 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 122521 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/target_core_user.ko 2023-12-22T09:45:45.873 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/tcm_fc/ 2023-12-22T09:45:45.873 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 75593 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-12-22T09:45:45.873 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/ 2023-12-22T09:45:45.873 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/ 2023-12-22T09:45:45.873 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/ 2023-12-22T09:45:45.873 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23481 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-12-22T09:45:45.873 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 29321 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-12-22T09:45:45.873 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9953 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-12-22T09:45:45.873 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10257 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-12-22T09:45:45.873 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15081 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-12-22T09:45:45.873 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16497 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-12-22T09:45:45.874 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26809 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-12-22T09:45:45.874 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20281 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-12-22T09:45:45.874 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14865 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-12-22T09:45:45.874 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14393 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-12-22T09:45:45.874 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13001 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-12-22T09:45:45.874 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 37065 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-12-22T09:45:45.874 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 30729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-12-22T09:45:45.874 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18937 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-12-22T09:45:45.874 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11521 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-12-22T09:45:45.874 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-12-22T09:45:45.874 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/ 2023-12-22T09:45:45.874 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/ipwireless/ 2023-12-22T09:45:45.874 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 78425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-12-22T09:45:45.874 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 57865 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/moxa.ko 2023-12-22T09:45:45.875 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 50953 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/mxser.ko 2023-12-22T09:45:45.875 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 108601 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/n_gsm.ko 2023-12-22T09:45:45.875 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 31961 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/n_hdlc.ko 2023-12-22T09:45:45.875 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 67929 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/nozomi.ko 2023-12-22T09:45:45.875 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/serial/ 2023-12-22T09:45:45.875 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/serial/8250/ 2023-12-22T09:45:45.875 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 35753 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-12-22T09:45:45.875 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 59497 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-12-22T09:45:45.875 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18097 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-12-22T09:45:45.875 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22577 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/serial/altera_uart.ko 2023-12-22T09:45:45.875 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/serial/arc_uart.ko 2023-12-22T09:45:45.875 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 72425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-12-22T09:45:45.875 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/serial/jsm/ 2023-12-22T09:45:45.875 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 103073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/serial/jsm/jsm.ko 2023-12-22T09:45:45.876 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28785 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/serial/rp2.ko 2023-12-22T09:45:45.876 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 52817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/tty/serial/sc16is7xx.ko 2023-12-22T09:45:45.876 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ufs/ 2023-12-22T09:45:45.876 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ufs/core/ 2023-12-22T09:45:45.876 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 531265 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ufs/core/ufshcd-core.ko 2023-12-22T09:45:45.876 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ufs/host/ 2023-12-22T09:45:45.876 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28481 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-12-22T09:45:45.876 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14601 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-12-22T09:45:45.876 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/uio/ 2023-12-22T09:45:45.876 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 44513 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/uio/uio.ko 2023-12-22T09:45:45.876 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12241 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/uio/uio_aec.ko 2023-12-22T09:45:45.876 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11281 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/uio/uio_cif.ko 2023-12-22T09:45:45.876 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18329 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/uio/uio_dmem_genirq.ko 2023-12-22T09:45:45.876 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12937 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/uio/uio_mf624.ko 2023-12-22T09:45:45.877 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12177 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/uio/uio_netx.ko 2023-12-22T09:45:45.877 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10601 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/uio/uio_pci_generic.ko 2023-12-22T09:45:45.877 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16057 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-12-22T09:45:45.877 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13633 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/uio/uio_sercos3.ko 2023-12-22T09:45:45.877 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/ 2023-12-22T09:45:45.877 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/c67x00/ 2023-12-22T09:45:45.877 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 73297 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/c67x00/c67x00.ko 2023-12-22T09:45:45.877 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/chipidea/ 2023-12-22T09:45:45.877 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 144377 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-12-22T09:45:45.877 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18505 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-12-22T09:45:45.877 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12713 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-12-22T09:45:45.877 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13057 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-12-22T09:45:45.877 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/class/ 2023-12-22T09:45:45.877 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 87089 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/class/cdc-acm.ko 2023-12-22T09:45:45.878 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 51345 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/class/cdc-wdm.ko 2023-12-22T09:45:45.878 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 47305 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/class/usblp.ko 2023-12-22T09:45:45.878 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 89857 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/class/usbtmc.ko 2023-12-22T09:45:45.878 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/common/ 2023-12-22T09:45:45.878 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22953 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/common/ulpi.ko 2023-12-22T09:45:45.878 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/dwc2/ 2023-12-22T09:45:45.878 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11529 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-12-22T09:45:45.878 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/dwc3/ 2023-12-22T09:45:45.878 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12089 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-12-22T09:45:45.878 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 30041 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-12-22T09:45:45.878 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 448505 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/dwc3/dwc3.ko 2023-12-22T09:45:45.878 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/ 2023-12-22T09:45:45.878 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/function/ 2023-12-22T09:45:45.878 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 60177 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/function/u_ether.ko 2023-12-22T09:45:45.879 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 51881 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/function/u_serial.ko 2023-12-22T09:45:45.879 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28841 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-12-22T09:45:45.879 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 42449 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-12-22T09:45:45.879 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 27953 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-12-22T09:45:45.879 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 36513 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-12-22T09:45:45.879 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 92489 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-12-22T09:45:45.879 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 51049 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-12-22T09:45:45.879 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 122081 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-12-22T09:45:45.879 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 57681 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-12-22T09:45:45.879 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22185 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-12-22T09:45:45.879 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 31265 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-12-22T09:45:45.879 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 57729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-12-22T09:45:45.879 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 85609 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-12-22T09:45:45.879 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19273 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-12-22T09:45:45.880 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 58113 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-12-22T09:45:45.880 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 67337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-12-22T09:45:45.880 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/legacy/ 2023-12-22T09:45:45.880 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21265 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-12-22T09:45:45.880 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18057 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-12-22T09:45:45.880 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18465 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-12-22T09:45:45.880 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21657 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-12-22T09:45:45.880 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28401 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-12-22T09:45:45.880 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19009 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-12-22T09:45:45.880 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20409 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-12-22T09:45:45.880 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16977 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-12-22T09:45:45.880 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 32073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-12-22T09:45:45.880 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16793 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-12-22T09:45:45.880 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19393 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-12-22T09:45:45.881 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 27201 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-12-22T09:45:45.881 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 62185 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-12-22T09:45:45.881 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15201 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-12-22T09:45:45.881 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 161225 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/libcomposite.ko 2023-12-22T09:45:45.881 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/udc/ 2023-12-22T09:45:45.881 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17705 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-12-22T09:45:45.881 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/udc/bdc/ 2023-12-22T09:45:45.881 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 157681 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-12-22T09:45:45.881 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 36089 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-12-22T09:45:45.881 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 52721 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-12-22T09:45:45.881 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 69705 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-12-22T09:45:45.881 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 56033 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-12-22T09:45:45.881 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 76057 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/udc/net2272.ko 2023-12-22T09:45:45.881 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 75073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/udc/net2280.ko 2023-12-22T09:45:45.882 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 73169 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-12-22T09:45:45.882 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 65809 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-12-22T09:45:45.882 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 66097 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-12-22T09:45:45.882 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 81505 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-12-22T09:45:45.882 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 156073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-12-22T09:45:45.882 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/host/ 2023-12-22T09:45:45.882 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11585 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/host/bcma-hcd.ko 2023-12-22T09:45:45.882 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 80113 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/host/isp116x-hcd.ko 2023-12-22T09:45:45.882 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 87353 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-12-22T09:45:45.882 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 78873 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-12-22T09:45:45.882 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 51329 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/host/sl811-hcd.ko 2023-12-22T09:45:45.882 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15593 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/host/sl811_cs.ko 2023-12-22T09:45:45.882 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13305 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/host/ssb-hcd.ko 2023-12-22T09:45:45.882 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25945 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-12-22T09:45:45.883 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/image/ 2023-12-22T09:45:45.883 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 34585 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/image/mdc800.ko 2023-12-22T09:45:45.883 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21081 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/image/microtek.ko 2023-12-22T09:45:45.883 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/ 2023-12-22T09:45:45.883 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 41721 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/adutux.ko 2023-12-22T09:45:45.883 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20713 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/appledisplay.ko 2023-12-22T09:45:45.883 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17721 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-12-22T09:45:45.883 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23049 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/cytherm.ko 2023-12-22T09:45:45.883 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/ehset.ko 2023-12-22T09:45:45.883 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15057 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/emi26.ko 2023-12-22T09:45:45.883 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15985 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/emi62.ko 2023-12-22T09:45:45.883 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11433 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/ezusb.ko 2023-12-22T09:45:45.883 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19297 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/idmouse.ko 2023-12-22T09:45:45.883 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 36553 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/iowarrior.ko 2023-12-22T09:45:45.883 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11593 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/isight_firmware.ko 2023-12-22T09:45:45.884 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 36529 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/ldusb.ko 2023-12-22T09:45:45.884 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 36265 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/legousbtower.ko 2023-12-22T09:45:45.884 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 27793 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/lvstest.ko 2023-12-22T09:45:45.884 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/sisusbvga/ 2023-12-22T09:45:45.884 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 64841 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-12-22T09:45:45.884 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12937 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/trancevibrator.ko 2023-12-22T09:45:45.884 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20473 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/usb3503.ko 2023-12-22T09:45:45.884 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25145 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/usblcd.ko 2023-12-22T09:45:45.884 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22753 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/usbsevseg.ko 2023-12-22T09:45:45.884 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 70809 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/usbtest.ko 2023-12-22T09:45:45.884 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 41905 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/uss720.ko 2023-12-22T09:45:45.884 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 27617 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/misc/yurex.ko 2023-12-22T09:45:45.884 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/mon/ 2023-12-22T09:45:45.885 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 72953 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/mon/usbmon.ko 2023-12-22T09:45:45.885 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/musb/ 2023-12-22T09:45:45.885 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 301697 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/musb/musb_hdrc.ko 2023-12-22T09:45:45.885 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/phy/ 2023-12-22T09:45:45.885 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21105 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/phy/phy-generic.ko 2023-12-22T09:45:45.885 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20177 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-12-22T09:45:45.885 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12257 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/phy/phy-isp1301.ko 2023-12-22T09:45:45.885 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21745 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/phy/phy-tahvo.ko 2023-12-22T09:45:45.885 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/ 2023-12-22T09:45:45.885 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13209 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/aircable.ko 2023-12-22T09:45:45.885 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 33329 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/ark3116.ko 2023-12-22T09:45:45.885 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26633 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/belkin_sa.ko 2023-12-22T09:45:45.885 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 38105 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/ch341.ko 2023-12-22T09:45:45.885 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 70257 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/cp210x.ko 2023-12-22T09:45:45.886 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 31057 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/cyberjack.ko 2023-12-22T09:45:45.886 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 58217 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/cypress_m8.ko 2023-12-22T09:45:45.886 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 49817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/digi_acceleport.ko 2023-12-22T09:45:45.886 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9617 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/empeg.ko 2023-12-22T09:45:45.886 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 44273 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/f81232.ko 2023-12-22T09:45:45.886 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 175137 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/ftdi_sio.ko 2023-12-22T09:45:45.886 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 53113 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/garmin_gps.ko 2023-12-22T09:45:45.886 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 137081 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/io_edgeport.ko 2023-12-22T09:45:45.886 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 124833 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/io_ti.ko 2023-12-22T09:45:45.886 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 67769 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/ipaq.ko 2023-12-22T09:45:45.886 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19161 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/ipw.ko 2023-12-22T09:45:45.886 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26897 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/ir-usb.ko 2023-12-22T09:45:45.886 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 58233 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-12-22T09:45:45.886 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 107521 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/keyspan.ko 2023-12-22T09:45:45.887 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 35617 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/keyspan_pda.ko 2023-12-22T09:45:45.887 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25665 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/kl5kusb105.ko 2023-12-22T09:45:45.887 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 33689 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/kobil_sct.ko 2023-12-22T09:45:45.887 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 32953 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/mct_u232.ko 2023-12-22T09:45:45.887 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22033 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/metro-usb.ko 2023-12-22T09:45:45.887 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 66449 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/mos7720.ko 2023-12-22T09:45:45.887 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 78217 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/mos7840.ko 2023-12-22T09:45:45.887 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 56337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/mxuport.ko 2023-12-22T09:45:45.887 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14025 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/navman.ko 2023-12-22T09:45:45.887 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12009 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/omninet.ko 2023-12-22T09:45:45.887 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24633 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/opticon.ko 2023-12-22T09:45:45.887 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 191137 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/option.ko 2023-12-22T09:45:45.887 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 39073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/oti6858.ko 2023-12-22T09:45:45.887 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 54353 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/pl2303.ko 2023-12-22T09:45:45.887 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9737 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/qcaux.ko 2023-12-22T09:45:45.888 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 37825 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/qcserial.ko 2023-12-22T09:45:45.888 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 34321 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/quatech2.ko 2023-12-22T09:45:45.888 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15393 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/safe_serial.ko 2023-12-22T09:45:45.888 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 51625 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/sierra.ko 2023-12-22T09:45:45.888 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21673 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/spcp8x5.ko 2023-12-22T09:45:45.888 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 29993 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/ssu100.ko 2023-12-22T09:45:45.888 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17265 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/symbolserial.ko 2023-12-22T09:45:45.888 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 61489 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-12-22T09:45:45.888 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-12-22T09:45:45.889 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10241 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/usb_debug.ko 2023-12-22T09:45:45.889 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 33201 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/usb_wwan.ko 2023-12-22T09:45:45.889 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 125609 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/usbserial.ko 2023-12-22T09:45:45.889 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28753 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/visor.ko 2023-12-22T09:45:45.889 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 37409 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/whiteheat.ko 2023-12-22T09:45:45.889 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/wishbone-serial.ko 2023-12-22T09:45:45.889 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9289 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/serial/xsens_mt.ko 2023-12-22T09:45:45.889 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ 2023-12-22T09:45:45.889 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 52913 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/uas.ko 2023-12-22T09:45:45.889 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26017 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-alauda.ko 2023-12-22T09:45:45.889 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13049 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-cypress.ko 2023-12-22T09:45:45.889 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22049 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-datafab.ko 2023-12-22T09:45:45.889 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 33497 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-12-22T09:45:45.890 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13745 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-freecom.ko 2023-12-22T09:45:45.890 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19769 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-isd200.ko 2023-12-22T09:45:45.890 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19361 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-12-22T09:45:45.890 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13713 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-karma.ko 2023-12-22T09:45:45.890 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17841 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-onetouch.ko 2023-12-22T09:45:45.890 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28441 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-realtek.ko 2023-12-22T09:45:45.890 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28905 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-sddr09.ko 2023-12-22T09:45:45.890 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19521 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-sddr55.ko 2023-12-22T09:45:45.890 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 35337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/ums-usbat.ko 2023-12-22T09:45:45.890 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 179969 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/storage/usb-storage.ko 2023-12-22T09:45:45.890 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/usbip/ 2023-12-22T09:45:45.890 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 67481 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/usbip/usbip-core.ko 2023-12-22T09:45:45.890 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 72177 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/usbip/usbip-host.ko 2023-12-22T09:45:45.890 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 107001 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-12-22T09:45:45.891 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vfio/ 2023-12-22T09:45:45.891 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vfio/pci/ 2023-12-22T09:45:45.891 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 154297 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-12-22T09:45:45.891 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 29537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vfio/pci/vfio-pci.ko 2023-12-22T09:45:45.891 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 108737 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vfio/vfio.ko 2023-12-22T09:45:45.891 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 77609 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-12-22T09:45:45.891 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vhost/ 2023-12-22T09:45:45.891 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 113785 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vhost/vhost.ko 2023-12-22T09:45:45.891 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17009 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vhost/vhost_iotlb.ko 2023-12-22T09:45:45.891 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 58089 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vhost/vhost_net.ko 2023-12-22T09:45:45.891 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 89249 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/vhost/vhost_scsi.ko 2023-12-22T09:45:45.891 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/ 2023-12-22T09:45:45.891 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/ 2023-12-22T09:45:45.891 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15417 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-12-22T09:45:45.891 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12393 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/aat2870_bl.ko 2023-12-22T09:45:45.892 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23305 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/adp5520_bl.ko 2023-12-22T09:45:45.892 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 32609 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/adp8860_bl.ko 2023-12-22T09:45:45.892 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 39993 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/adp8870_bl.ko 2023-12-22T09:45:45.892 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16921 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/apple_bl.ko 2023-12-22T09:45:45.892 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16777 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/as3711_bl.ko 2023-12-22T09:45:45.892 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12033 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/bd6107.ko 2023-12-22T09:45:45.892 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11409 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/da903x_bl.ko 2023-12-22T09:45:45.892 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11273 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/da9052_bl.ko 2023-12-22T09:45:45.892 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11753 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/gpio_backlight.ko 2023-12-22T09:45:45.892 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14769 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/kb3886_bl.ko 2023-12-22T09:45:45.892 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22017 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/lcd.ko 2023-12-22T09:45:45.892 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23657 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/lm3533_bl.ko 2023-12-22T09:45:45.892 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/lm3639_bl.ko 2023-12-22T09:45:45.892 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/lv5207lp.ko 2023-12-22T09:45:45.893 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14345 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/max8925_bl.ko 2023-12-22T09:45:45.893 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11313 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/pandora_bl.ko 2023-12-22T09:45:45.893 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10865 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-12-22T09:45:45.893 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10897 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/platform_lcd.ko 2023-12-22T09:45:45.893 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12721 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/video/backlight/wm831x_bl.ko 2023-12-22T09:45:45.893 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/ 2023-12-22T09:45:45.893 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/masters/ 2023-12-22T09:45:45.893 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18785 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/masters/ds2482.ko 2023-12-22T09:45:45.893 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 38985 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/masters/ds2490.ko 2023-12-22T09:45:45.893 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11265 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/masters/matrox_w1.ko 2023-12-22T09:45:45.893 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12417 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/masters/w1-gpio.ko 2023-12-22T09:45:45.893 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/ 2023-12-22T09:45:45.893 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12041 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-12-22T09:45:45.893 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22745 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-12-22T09:45:45.894 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15113 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-12-22T09:45:45.894 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10825 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-12-22T09:45:45.894 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14153 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-12-22T09:45:45.894 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11929 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-12-22T09:45:45.894 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14049 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-12-22T09:45:45.894 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14049 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-12-22T09:45:45.894 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17921 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-12-22T09:45:45.894 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7385 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_smem.ko 2023-12-22T09:45:45.894 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 56425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/slaves/w1_therm.ko 2023-12-22T09:45:45.894 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 102673 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/w1/wire.ko 2023-12-22T09:45:45.894 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/ 2023-12-22T09:45:45.894 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18793 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/acquirewdt.ko 2023-12-22T09:45:45.894 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19977 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/advantechwdt.ko 2023-12-22T09:45:45.894 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18561 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/alim1535_wdt.ko 2023-12-22T09:45:45.895 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22969 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/alim7101_wdt.ko 2023-12-22T09:45:45.895 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19113 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/cpu5wdt.ko 2023-12-22T09:45:45.895 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13617 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/da9052_wdt.ko 2023-12-22T09:45:45.895 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12777 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/da9055_wdt.ko 2023-12-22T09:45:45.895 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17409 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/da9063_wdt.ko 2023-12-22T09:45:45.895 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20169 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/dw_wdt.ko 2023-12-22T09:45:45.895 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20265 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/eurotechwdt.ko 2023-12-22T09:45:45.895 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23865 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/f71808e_wdt.ko 2023-12-22T09:45:45.895 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 27401 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/hpwdt.ko 2023-12-22T09:45:45.895 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15577 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/i6300esb.ko 2023-12-22T09:45:45.895 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10833 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-12-22T09:45:45.895 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21913 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/iTCO_wdt.ko 2023-12-22T09:45:45.895 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19241 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/ib700wdt.ko 2023-12-22T09:45:45.895 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18689 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/ibmasr.ko 2023-12-22T09:45:45.896 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19713 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-12-22T09:45:45.896 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21225 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/it8712f_wdt.ko 2023-12-22T09:45:45.896 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13841 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/it87_wdt.ko 2023-12-22T09:45:45.896 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21489 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/kempld_wdt.ko 2023-12-22T09:45:45.896 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18617 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/machzwd.ko 2023-12-22T09:45:45.896 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14721 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/mena21_wdt.ko 2023-12-22T09:45:45.896 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13217 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-12-22T09:45:45.896 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24673 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/nv_tco.ko 2023-12-22T09:45:45.896 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17737 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-12-22T09:45:45.896 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22265 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/pc87413_wdt.ko 2023-12-22T09:45:45.896 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 38657 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/pcwd_pci.ko 2023-12-22T09:45:45.896 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 31825 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/pcwd_usb.ko 2023-12-22T09:45:45.896 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13065 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/retu_wdt.ko 2023-12-22T09:45:45.896 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20449 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-12-22T09:45:45.897 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14129 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-12-22T09:45:45.897 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17321 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-12-22T09:45:45.897 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23809 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/sc1200wdt.ko 2023-12-22T09:45:45.897 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23321 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/sch311x_wdt.ko 2023-12-22T09:45:45.897 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21577 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-12-22T09:45:45.897 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17273 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/softdog.ko 2023-12-22T09:45:45.897 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22273 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/sp5100_tco.ko 2023-12-22T09:45:45.897 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/twl4030_wdt.ko 2023-12-22T09:45:45.897 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17649 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/via_wdt.ko 2023-12-22T09:45:45.897 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19161 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-12-22T09:45:45.897 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20681 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/w83877f_wdt.ko 2023-12-22T09:45:45.897 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25409 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/w83977f_wdt.ko 2023-12-22T09:45:45.897 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18497 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/wafer5823wdt.ko 2023-12-22T09:45:45.897 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28089 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/wdt_pci.ko 2023-12-22T09:45:45.898 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16257 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/wm831x_wdt.ko 2023-12-22T09:45:45.898 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13785 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/wm8350_wdt.ko 2023-12-22T09:45:45.898 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15697 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/watchdog/xen_wdt.ko 2023-12-22T09:45:45.898 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/xen/ 2023-12-22T09:45:45.898 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/xen/xen-evtchn.ko 2023-12-22T09:45:45.898 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26769 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/xen/xen-gntalloc.ko 2023-12-22T09:45:45.898 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 47865 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/xen/xen-gntdev.ko 2023-12-22T09:45:45.898 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/xen/xen-pciback/ 2023-12-22T09:45:45.898 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 176377 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-12-22T09:45:45.898 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 40121 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/xen/xen-privcmd.ko 2023-12-22T09:45:45.898 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 71249 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/xen/xen-scsiback.ko 2023-12-22T09:45:45.898 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/xen/xenfs/ 2023-12-22T09:45:45.898 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/drivers/xen/xenfs/xenfs.ko 2023-12-22T09:45:45.898 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/ 2023-12-22T09:45:45.899 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/9p/ 2023-12-22T09:45:45.899 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 166425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/9p/9p.ko 2023-12-22T09:45:45.899 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/adfs/ 2023-12-22T09:45:45.899 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 61073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/adfs/adfs.ko 2023-12-22T09:45:45.899 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/affs/ 2023-12-22T09:45:45.899 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 163593 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/affs/affs.ko 2023-12-22T09:45:45.899 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/afs/ 2023-12-22T09:45:45.899 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 932817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/afs/kafs.ko 2023-12-22T09:45:45.899 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/autofs/ 2023-12-22T09:45:45.899 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 101057 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/autofs/autofs4.ko 2023-12-22T09:45:45.900 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/befs/ 2023-12-22T09:45:45.900 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 64545 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/befs/befs.ko 2023-12-22T09:45:45.900 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/bfs/ 2023-12-22T09:45:45.900 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 41257 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/bfs/bfs.ko 2023-12-22T09:45:45.900 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 34585 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/binfmt_misc.ko 2023-12-22T09:45:45.900 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/btrfs/ 2023-12-22T09:45:45.900 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 3402729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/btrfs/btrfs.ko 2023-12-22T09:45:45.900 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/cachefiles/ 2023-12-22T09:45:45.900 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 306009 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/cachefiles/cachefiles.ko 2023-12-22T09:45:45.900 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/ceph/ 2023-12-22T09:45:45.900 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 1331857 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/ceph/ceph.ko 2023-12-22T09:45:45.900 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/coda/ 2023-12-22T09:45:45.900 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 100801 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/coda/coda.ko 2023-12-22T09:45:45.900 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/configfs/ 2023-12-22T09:45:45.901 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 108393 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/configfs/configfs.ko 2023-12-22T09:45:45.901 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/cramfs/ 2023-12-22T09:45:45.901 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 29625 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/cramfs/cramfs.ko 2023-12-22T09:45:45.901 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/dlm/ 2023-12-22T09:45:45.901 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 642513 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/dlm/dlm.ko 2023-12-22T09:45:45.901 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/efs/ 2023-12-22T09:45:45.901 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 36649 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/efs/efs.ko 2023-12-22T09:45:45.901 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/f2fs/ 2023-12-22T09:45:45.901 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 1505025 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/f2fs/f2fs.ko 2023-12-22T09:45:45.901 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/fat/ 2023-12-22T09:45:45.901 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 27929 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/fat/msdos.ko 2023-12-22T09:45:45.901 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/freevxfs/ 2023-12-22T09:45:45.901 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 42545 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/freevxfs/freevxfs.ko 2023-12-22T09:45:45.901 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/fscache/ 2023-12-22T09:45:45.902 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 226481 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/fscache/fscache.ko 2023-12-22T09:45:45.902 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/fuse/ 2023-12-22T09:45:45.902 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24489 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/fuse/cuse.ko 2023-12-22T09:45:45.902 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/gfs2/ 2023-12-22T09:45:45.902 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 1231529 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/gfs2/gfs2.ko 2023-12-22T09:45:45.902 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/hfs/ 2023-12-22T09:45:45.902 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 141209 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/hfs/hfs.ko 2023-12-22T09:45:45.902 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/hfsplus/ 2023-12-22T09:45:45.902 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 222817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/hfsplus/hfsplus.ko 2023-12-22T09:45:45.902 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/hpfs/ 2023-12-22T09:45:45.902 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 192329 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/hpfs/hpfs.ko 2023-12-22T09:45:45.902 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/isofs/ 2023-12-22T09:45:45.902 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 74065 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/isofs/isofs.ko 2023-12-22T09:45:45.902 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/jfs/ 2023-12-22T09:45:45.903 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 419497 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/jfs/jfs.ko 2023-12-22T09:45:45.903 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/lockd/ 2023-12-22T09:45:45.903 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 280313 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/lockd/lockd.ko 2023-12-22T09:45:45.903 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/minix/ 2023-12-22T09:45:45.903 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 89193 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/minix/minix.ko 2023-12-22T09:45:45.903 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/netfs/ 2023-12-22T09:45:45.903 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 124649 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/netfs/netfs.ko 2023-12-22T09:45:45.903 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs/ 2023-12-22T09:45:45.903 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs/blocklayout/ 2023-12-22T09:45:45.903 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 81449 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-12-22T09:45:45.903 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs/filelayout/ 2023-12-22T09:45:45.903 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 59449 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-12-22T09:45:45.903 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs/flexfilelayout/ 2023-12-22T09:45:45.903 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 117465 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-12-22T09:45:45.904 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 1055721 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs/nfs.ko 2023-12-22T09:45:45.904 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 66441 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs/nfsv2.ko 2023-12-22T09:45:45.904 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 120177 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs/nfsv3.ko 2023-12-22T09:45:45.904 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 2042137 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs/nfsv4.ko 2023-12-22T09:45:45.904 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs_common/ 2023-12-22T09:45:45.904 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16929 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs_common/grace.ko 2023-12-22T09:45:45.904 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16145 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfs_common/nfs_acl.ko 2023-12-22T09:45:45.904 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfsd/ 2023-12-22T09:45:45.904 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 1516873 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nfsd/nfsd.ko 2023-12-22T09:45:45.904 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nilfs2/ 2023-12-22T09:45:45.904 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 592833 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nilfs2/nilfs2.ko 2023-12-22T09:45:45.904 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/ 2023-12-22T09:45:45.904 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13793 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-celtic.ko 2023-12-22T09:45:45.904 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13169 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-centeuro.ko 2023-12-22T09:45:45.904 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13793 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-croatian.ko 2023-12-22T09:45:45.905 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12865 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-cyrillic.ko 2023-12-22T09:45:45.905 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13481 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-gaelic.ko 2023-12-22T09:45:45.905 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12857 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-greek.ko 2023-12-22T09:45:45.905 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13793 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-iceland.ko 2023-12-22T09:45:45.905 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13169 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-inuit.ko 2023-12-22T09:45:45.905 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14097 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-roman.ko 2023-12-22T09:45:45.905 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13793 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-romanian.ko 2023-12-22T09:45:45.905 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13793 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/mac-turkish.ko 2023-12-22T09:45:45.905 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11297 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_ascii.ko 2023-12-22T09:45:45.905 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp1250.ko 2023-12-22T09:45:45.905 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12233 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp1251.ko 2023-12-22T09:45:45.905 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12921 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp1255.ko 2023-12-22T09:45:45.905 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp737.ko 2023-12-22T09:45:45.906 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp775.ko 2023-12-22T09:45:45.906 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12225 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp850.ko 2023-12-22T09:45:45.906 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12225 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp852.ko 2023-12-22T09:45:45.906 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12225 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp855.ko 2023-12-22T09:45:45.906 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11913 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp857.ko 2023-12-22T09:45:45.906 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12849 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp860.ko 2023-12-22T09:45:45.906 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13161 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp861.ko 2023-12-22T09:45:45.906 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13473 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp862.ko 2023-12-22T09:45:45.906 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13161 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp863.ko 2023-12-22T09:45:45.906 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12849 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp864.ko 2023-12-22T09:45:45.906 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13161 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp865.ko 2023-12-22T09:45:45.906 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp866.ko 2023-12-22T09:45:45.906 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12225 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp869.ko 2023-12-22T09:45:45.906 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11985 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp874.ko 2023-12-22T09:45:45.907 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 94137 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp932.ko 2023-12-22T09:45:45.907 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 142673 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp936.ko 2023-12-22T09:45:45.907 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 165745 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp949.ko 2023-12-22T09:45:45.907 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 118121 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_cp950.ko 2023-12-22T09:45:45.907 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12457 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_euc-jp.ko 2023-12-22T09:45:45.907 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11305 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-1.ko 2023-12-22T09:45:45.907 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11929 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-13.ko 2023-12-22T09:45:45.907 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11929 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-14.ko 2023-12-22T09:45:45.907 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11929 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-15.ko 2023-12-22T09:45:45.907 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11921 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-2.ko 2023-12-22T09:45:45.907 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11921 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-3.ko 2023-12-22T09:45:45.907 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11921 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-4.ko 2023-12-22T09:45:45.907 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11921 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-5.ko 2023-12-22T09:45:45.907 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11617 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-6.ko 2023-12-22T09:45:45.907 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12233 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-7.ko 2023-12-22T09:45:45.908 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11617 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_iso8859-9.ko 2023-12-22T09:45:45.908 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_koi8-r.ko 2023-12-22T09:45:45.908 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8017 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_koi8-ru.ko 2023-12-22T09:45:45.908 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_koi8-u.ko 2023-12-22T09:45:45.908 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7569 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_ucs2_utils.ko 2023-12-22T09:45:45.908 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/nls/nls_utf8.ko 2023-12-22T09:45:45.908 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/ntfs/ 2023-12-22T09:45:45.908 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 219417 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/ntfs/ntfs.ko 2023-12-22T09:45:45.908 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2/ 2023-12-22T09:45:45.908 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2/cluster/ 2023-12-22T09:45:45.908 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 244409 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-12-22T09:45:45.908 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2/dlm/ 2023-12-22T09:45:45.908 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 440737 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-12-22T09:45:45.908 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2/dlmfs/ 2023-12-22T09:45:45.909 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 54049 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-12-22T09:45:45.909 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 2592433 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2/ocfs2.ko 2023-12-22T09:45:45.909 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17905 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-12-22T09:45:45.909 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 31729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-12-22T09:45:45.909 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 35897 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-12-22T09:45:45.909 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/omfs/ 2023-12-22T09:45:45.909 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 53433 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/omfs/omfs.ko 2023-12-22T09:45:45.909 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/overlayfs/ 2023-12-22T09:45:45.909 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 352161 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/overlayfs/overlay.ko 2023-12-22T09:45:45.909 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/pstore/ 2023-12-22T09:45:45.909 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 54809 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/pstore/ramoops.ko 2023-12-22T09:45:45.909 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/qnx4/ 2023-12-22T09:45:45.910 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26865 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/qnx4/qnx4.ko 2023-12-22T09:45:45.910 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/qnx6/ 2023-12-22T09:45:45.910 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 46689 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/qnx6/qnx6.ko 2023-12-22T09:45:45.910 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/quota/ 2023-12-22T09:45:45.910 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 30881 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/quota/quota_tree.ko 2023-12-22T09:45:45.910 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14297 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/quota/quota_v1.ko 2023-12-22T09:45:45.910 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22017 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/quota/quota_v2.ko 2023-12-22T09:45:45.910 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/reiserfs/ 2023-12-22T09:45:45.910 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 532673 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/reiserfs/reiserfs.ko 2023-12-22T09:45:45.910 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/romfs/ 2023-12-22T09:45:45.911 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28641 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/romfs/romfs.ko 2023-12-22T09:45:45.911 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/smb/ 2023-12-22T09:45:45.911 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/smb/client/ 2023-12-22T09:45:45.912 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 2668401 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/smb/client/cifs.ko 2023-12-22T09:45:45.913 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/smb/common/ 2023-12-22T09:45:45.913 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7161 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/smb/common/cifs_arc4.ko 2023-12-22T09:45:45.913 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11257 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/smb/common/cifs_md4.ko 2023-12-22T09:45:45.913 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/squashfs/ 2023-12-22T09:45:45.913 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 134641 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/squashfs/squashfs.ko 2023-12-22T09:45:45.913 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/sysv/ 2023-12-22T09:45:45.913 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 90721 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/sysv/sysv.ko 2023-12-22T09:45:45.914 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/udf/ 2023-12-22T09:45:45.914 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 247737 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/udf/udf.ko 2023-12-22T09:45:45.914 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/ufs/ 2023-12-22T09:45:45.914 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 162497 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/ufs/ufs.ko 2023-12-22T09:45:45.914 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/xfs/ 2023-12-22T09:45:45.914 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 4011017 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/fs/xfs/xfs.ko 2023-12-22T09:45:45.914 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/kernel/ 2023-12-22T09:45:45.914 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/kernel/locking/ 2023-12-22T09:45:45.914 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 75489 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/kernel/locking/locktorture.ko 2023-12-22T09:45:45.914 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/kernel/time/ 2023-12-22T09:45:45.915 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13737 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/kernel/time/test_udelay.ko 2023-12-22T09:45:45.915 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 60553 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/kernel/torture.ko 2023-12-22T09:45:45.915 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/ 2023-12-22T09:45:45.915 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 6833 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/crc-itu-t.ko 2023-12-22T09:45:45.915 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 6529 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/crc7.ko 2023-12-22T09:45:45.915 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7025 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/crc8.ko 2023-12-22T09:45:45.915 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/crypto/ 2023-12-22T09:45:45.915 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7097 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/crypto/libarc4.ko 2023-12-22T09:45:45.915 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 37081 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/crypto/libdes.ko 2023-12-22T09:45:45.915 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13313 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/interval_tree_test.ko 2023-12-22T09:45:45.915 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/libcrc32c.ko 2023-12-22T09:45:45.916 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24953 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/lru_cache.ko 2023-12-22T09:45:45.916 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/lz4/ 2023-12-22T09:45:45.916 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 33801 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/lz4/lz4_compress.ko 2023-12-22T09:45:45.916 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22633 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/lz4/lz4hc_compress.ko 2023-12-22T09:45:45.916 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/math/ 2023-12-22T09:45:45.916 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 6617 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/math/cordic.ko 2023-12-22T09:45:45.916 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8233 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/memory-notifier-error-inject.ko 2023-12-22T09:45:45.916 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10865 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/notifier-error-inject.ko 2023-12-22T09:45:45.916 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14089 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/percpu_test.ko 2023-12-22T09:45:45.916 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8305 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/pm-notifier-error-inject.ko 2023-12-22T09:45:45.916 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/raid6/ 2023-12-22T09:45:45.916 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 143433 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/raid6/raid6_pq.ko 2023-12-22T09:45:45.916 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21105 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/rbtree_test.ko 2023-12-22T09:45:45.917 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/reed_solomon/ 2023-12-22T09:45:45.917 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18753 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/reed_solomon/reed_solomon.ko 2023-12-22T09:45:45.917 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 38841 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/test-kstrtox.ko 2023-12-22T09:45:45.917 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26321 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/test-string_helpers.ko 2023-12-22T09:45:45.917 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 4760425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/test_bpf.ko 2023-12-22T09:45:45.917 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 49089 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/test_firmware.ko 2023-12-22T09:45:45.917 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 6369 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/test_module.ko 2023-12-22T09:45:45.917 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20801 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/test_user_copy.ko 2023-12-22T09:45:45.917 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9585 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/ts_bm.ko 2023-12-22T09:45:45.917 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11121 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/ts_fsm.ko 2023-12-22T09:45:45.917 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9625 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/ts_kmp.ko 2023-12-22T09:45:45.917 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/xz/ 2023-12-22T09:45:45.917 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13545 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/lib/xz/xz_dec_test.ko 2023-12-22T09:45:45.918 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/mm/ 2023-12-22T09:45:45.918 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/mm/hwpoison-inject.ko 2023-12-22T09:45:45.918 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ 2023-12-22T09:45:45.918 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/6lowpan/ 2023-12-22T09:45:45.918 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 55737 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/6lowpan/6lowpan.ko 2023-12-22T09:45:45.918 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7049 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/6lowpan/nhc_dest.ko 2023-12-22T09:45:45.918 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7065 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/6lowpan/nhc_fragment.ko 2023-12-22T09:45:45.918 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7049 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/6lowpan/nhc_hop.ko 2023-12-22T09:45:45.918 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 6985 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/6lowpan/nhc_ipv6.ko 2023-12-22T09:45:45.918 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7065 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/6lowpan/nhc_mobility.ko 2023-12-22T09:45:45.918 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7001 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/6lowpan/nhc_routing.ko 2023-12-22T09:45:45.918 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15329 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/6lowpan/nhc_udp.ko 2023-12-22T09:45:45.919 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/802/ 2023-12-22T09:45:45.919 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 30385 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/802/garp.ko 2023-12-22T09:45:45.919 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 34809 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/802/mrp.ko 2023-12-22T09:45:45.919 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8545 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/802/p8022.ko 2023-12-22T09:45:45.919 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16345 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/802/psnap.ko 2023-12-22T09:45:45.919 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/802/stp.ko 2023-12-22T09:45:45.919 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/8021q/ 2023-12-22T09:45:45.919 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 81737 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/8021q/8021q.ko 2023-12-22T09:45:45.919 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/9p/ 2023-12-22T09:45:45.919 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 198337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/9p/9pnet.ko 2023-12-22T09:45:45.919 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 35977 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/9p/9pnet_fd.ko 2023-12-22T09:45:45.919 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26345 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/9p/9pnet_rdma.ko 2023-12-22T09:45:45.919 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 32337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/9p/9pnet_virtio.ko 2023-12-22T09:45:45.920 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/batman-adv/ 2023-12-22T09:45:45.920 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 649297 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/batman-adv/batman-adv.ko 2023-12-22T09:45:45.920 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/ 2023-12-22T09:45:45.920 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 63809 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/br_netfilter.ko 2023-12-22T09:45:45.920 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 777689 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/bridge.ko 2023-12-22T09:45:45.920 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ 2023-12-22T09:45:45.920 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7657 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-12-22T09:45:45.920 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12385 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_among.ko 2023-12-22T09:45:45.920 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9169 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_arp.ko 2023-12-22T09:45:45.920 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-12-22T09:45:45.920 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9625 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-12-22T09:45:45.920 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8737 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_ip.ko 2023-12-22T09:45:45.921 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9145 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-12-22T09:45:45.921 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9825 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_limit.ko 2023-12-22T09:45:45.921 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13217 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_log.ko 2023-12-22T09:45:45.921 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7585 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_mark.ko 2023-12-22T09:45:45.921 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7593 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-12-22T09:45:45.921 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8385 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-12-22T09:45:45.921 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-12-22T09:45:45.921 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9593 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-12-22T09:45:45.921 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8649 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_snat.ko 2023-12-22T09:45:45.921 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8825 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_stp.ko 2023-12-22T09:45:45.921 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12401 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-12-22T09:45:45.921 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11529 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-12-22T09:45:45.921 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-12-22T09:45:45.922 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9793 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-12-22T09:45:45.922 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 55929 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/ebtables.ko 2023-12-22T09:45:45.922 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14041 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-12-22T09:45:45.922 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13945 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-12-22T09:45:45.922 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ceph/ 2023-12-22T09:45:45.922 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 1046897 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ceph/libceph.ko 2023-12-22T09:45:45.922 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/core/ 2023-12-22T09:45:45.922 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 125993 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/core/pktgen.ko 2023-12-22T09:45:45.922 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/dccp/ 2023-12-22T09:45:45.922 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 194209 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/dccp/dccp.ko 2023-12-22T09:45:45.922 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8665 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/dccp/dccp_diag.ko 2023-12-22T09:45:45.922 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 57881 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/dccp/dccp_ipv4.ko 2023-12-22T09:45:45.923 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 60337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/dccp/dccp_ipv6.ko 2023-12-22T09:45:45.923 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/dsa/ 2023-12-22T09:45:45.923 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 390473 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/dsa/dsa_core.ko 2023-12-22T09:45:45.923 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/dsa/tag_brcm.ko 2023-12-22T09:45:45.923 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12577 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/dsa/tag_dsa.ko 2023-12-22T09:45:45.923 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7721 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/dsa/tag_none.ko 2023-12-22T09:45:45.923 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8953 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/dsa/tag_trailer.ko 2023-12-22T09:45:45.923 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/hsr/ 2023-12-22T09:45:45.923 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 99729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/hsr/hsr.ko 2023-12-22T09:45:45.924 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ieee802154/ 2023-12-22T09:45:45.924 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ieee802154/6lowpan/ 2023-12-22T09:45:45.924 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 45233 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-12-22T09:45:45.924 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 254625 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ieee802154/ieee802154.ko 2023-12-22T09:45:45.924 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 47289 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ieee802154/ieee802154_socket.ko 2023-12-22T09:45:45.924 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/ 2023-12-22T09:45:45.924 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/ah4.ko 2023-12-22T09:45:45.924 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 38905 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/esp4.ko 2023-12-22T09:45:45.924 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 48337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/fou.ko 2023-12-22T09:45:45.924 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18121 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/gre.ko 2023-12-22T09:45:45.924 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 48657 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/inet_diag.ko 2023-12-22T09:45:45.924 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 60633 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/ip_gre.ko 2023-12-22T09:45:45.924 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 61225 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/ip_tunnel.ko 2023-12-22T09:45:45.924 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 34505 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/ip_vti.ko 2023-12-22T09:45:45.925 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14001 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/ipcomp.ko 2023-12-22T09:45:45.925 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28841 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/ipip.ko 2023-12-22T09:45:45.925 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/ 2023-12-22T09:45:45.925 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 37641 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/arp_tables.ko 2023-12-22T09:45:45.925 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8873 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-12-22T09:45:45.925 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10409 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-12-22T09:45:45.925 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 41609 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/ip_tables.ko 2023-12-22T09:45:45.925 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10057 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-12-22T09:45:45.925 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9681 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-12-22T09:45:45.925 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14121 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-12-22T09:45:45.925 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11177 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-12-22T09:45:45.925 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14881 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-12-22T09:45:45.926 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11305 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-12-22T09:45:45.926 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11649 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-12-22T09:45:45.926 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14905 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-12-22T09:45:45.926 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11545 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-12-22T09:45:45.926 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10409 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/iptable_security.ko 2023-12-22T09:45:45.926 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-12-22T09:45:45.926 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-12-22T09:45:45.927 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 27625 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-12-22T09:45:45.927 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18161 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-12-22T09:45:45.927 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-12-22T09:45:45.927 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20561 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-12-22T09:45:45.927 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9329 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-12-22T09:45:45.927 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15177 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-12-22T09:45:45.927 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9961 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-12-22T09:45:45.927 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17113 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-12-22T09:45:45.927 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9009 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-12-22T09:45:45.928 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_bic.ko 2023-12-22T09:45:45.928 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13737 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_dctcp.ko 2023-12-22T09:45:45.928 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15369 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_diag.ko 2023-12-22T09:45:45.928 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_highspeed.ko 2023-12-22T09:45:45.928 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12401 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_htcp.ko 2023-12-22T09:45:45.928 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10449 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_hybla.ko 2023-12-22T09:45:45.928 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11473 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_illinois.ko 2023-12-22T09:45:45.928 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10433 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_lp.ko 2023-12-22T09:45:45.928 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8329 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_scalable.ko 2023-12-22T09:45:45.928 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_vegas.ko 2023-12-22T09:45:45.928 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10089 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_veno.ko 2023-12-22T09:45:45.929 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10953 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_westwood.ko 2023-12-22T09:45:45.929 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10185 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tcp_yeah.ko 2023-12-22T09:45:45.929 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22601 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/tunnel4.ko 2023-12-22T09:45:45.929 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17097 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/udp_diag.ko 2023-12-22T09:45:45.929 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 41665 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/udp_tunnel.ko 2023-12-22T09:45:45.929 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11361 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv4/xfrm4_tunnel.ko 2023-12-22T09:45:45.929 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/ 2023-12-22T09:45:45.929 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26377 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/ah6.ko 2023-12-22T09:45:45.929 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 39537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/esp6.ko 2023-12-22T09:45:45.929 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/fou6.ko 2023-12-22T09:45:45.929 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 80897 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/ip6_gre.ko 2023-12-22T09:45:45.929 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 93577 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/ip6_tunnel.ko 2023-12-22T09:45:45.930 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10825 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-12-22T09:45:45.930 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 53273 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/ip6_vti.ko 2023-12-22T09:45:45.930 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13785 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/ipcomp6.ko 2023-12-22T09:45:45.930 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19017 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/mip6.ko 2023-12-22T09:45:45.930 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ 2023-12-22T09:45:45.930 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 42169 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-12-22T09:45:45.930 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11753 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-12-22T09:45:45.930 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9753 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-12-22T09:45:45.930 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14137 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-12-22T09:45:45.930 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14273 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-12-22T09:45:45.930 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7801 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-12-22T09:45:45.930 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16209 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-12-22T09:45:45.932 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16033 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-12-22T09:45:45.932 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8913 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-12-22T09:45:45.932 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9897 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-12-22T09:45:45.932 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10937 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-12-22T09:45:45.932 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10897 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-12-22T09:45:45.932 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11321 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-12-22T09:45:45.932 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11121 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-12-22T09:45:45.932 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15009 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-12-22T09:45:45.933 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11553 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-12-22T09:45:45.933 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10433 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-12-22T09:45:45.933 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 39113 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-12-22T09:45:45.933 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8449 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-12-22T09:45:45.933 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25945 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-12-22T09:45:45.933 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9801 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-12-22T09:45:45.933 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15393 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-12-22T09:45:45.933 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9633 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-12-22T09:45:45.933 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16025 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-12-22T09:45:45.933 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9009 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-12-22T09:45:45.934 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 74073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/sit.ko 2023-12-22T09:45:45.934 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24193 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/tunnel6.ko 2023-12-22T09:45:45.934 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23297 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/ipv6/xfrm6_tunnel.ko 2023-12-22T09:45:45.934 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/key/ 2023-12-22T09:45:45.934 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 82833 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/key/af_key.ko 2023-12-22T09:45:45.934 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/l2tp/ 2023-12-22T09:45:45.934 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 125281 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/l2tp/l2tp_core.ko 2023-12-22T09:45:45.934 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20177 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/l2tp/l2tp_debugfs.ko 2023-12-22T09:45:45.934 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25953 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/l2tp/l2tp_eth.ko 2023-12-22T09:45:45.934 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 35569 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/l2tp/l2tp_ip.ko 2023-12-22T09:45:45.934 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 36713 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/l2tp/l2tp_ip6.ko 2023-12-22T09:45:45.934 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 33001 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/l2tp/l2tp_netlink.ko 2023-12-22T09:45:45.934 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 53241 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/l2tp/l2tp_ppp.ko 2023-12-22T09:45:45.935 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/lapb/ 2023-12-22T09:45:45.935 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 47977 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/lapb/lapb.ko 2023-12-22T09:45:45.935 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/llc/ 2023-12-22T09:45:45.935 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23193 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/llc/llc.ko 2023-12-22T09:45:45.935 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 267913 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/llc/llc2.ko 2023-12-22T09:45:45.935 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/mac802154/ 2023-12-22T09:45:45.935 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 290417 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/mac802154/mac802154.ko 2023-12-22T09:45:45.935 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/mpls/ 2023-12-22T09:45:45.935 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9393 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/mpls/mpls_gso.ko 2023-12-22T09:45:45.935 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ 2023-12-22T09:45:45.935 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ 2023-12-22T09:45:45.935 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 119585 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set.ko 2023-12-22T09:45:45.936 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28353 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-12-22T09:45:45.936 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26913 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-12-22T09:45:45.936 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26369 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-12-22T09:45:45.936 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 100297 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-12-22T09:45:45.936 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 101441 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-12-22T09:45:45.936 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 102817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-12-22T09:45:45.936 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 103417 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-12-22T09:45:45.936 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 112849 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-12-22T09:45:45.936 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 60329 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-12-22T09:45:45.936 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 109593 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-12-22T09:45:45.936 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 113129 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-12-22T09:45:45.936 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 112585 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-12-22T09:45:45.936 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 111585 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-12-22T09:45:45.936 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 114465 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-12-22T09:45:45.937 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 30025 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-12-22T09:45:45.937 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ 2023-12-22T09:45:45.937 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 411729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs.ko 2023-12-22T09:45:45.937 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11961 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-12-22T09:45:45.937 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7625 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-12-22T09:45:45.937 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-12-22T09:45:45.937 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17905 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-12-22T09:45:45.937 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20673 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-12-22T09:45:45.937 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7689 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-12-22T09:45:45.937 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7689 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-12-22T09:45:45.937 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10681 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-12-22T09:45:45.937 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9233 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-12-22T09:45:45.937 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7697 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-12-22T09:45:45.938 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13521 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-12-22T09:45:45.938 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7697 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-12-22T09:45:45.938 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10993 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-12-22T09:45:45.938 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 49257 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conncount.ko 2023-12-22T09:45:45.938 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 408257 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack.ko 2023-12-22T09:45:45.938 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15985 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-12-22T09:45:45.938 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10177 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-12-22T09:45:45.938 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 33761 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-12-22T09:45:45.938 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 118145 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_h323.ko 2023-12-22T09:45:45.938 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22185 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_irc.ko 2023-12-22T09:45:45.938 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-12-22T09:45:45.938 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 107233 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-12-22T09:45:45.939 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 33633 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-12-22T09:45:45.939 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17401 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_sane.ko 2023-12-22T09:45:45.939 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 66641 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_sip.ko 2023-12-22T09:45:45.939 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11233 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-12-22T09:45:45.939 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19185 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-12-22T09:45:45.939 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10113 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_dup_netdev.ko 2023-12-22T09:45:45.939 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 89425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_flow_table.ko 2023-12-22T09:45:45.939 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9593 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_flow_table_inet.ko 2023-12-22T09:45:45.939 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 37129 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_log_syslog.ko 2023-12-22T09:45:45.939 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 95353 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_nat.ko 2023-12-22T09:45:45.939 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10129 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_nat_amanda.ko 2023-12-22T09:45:45.939 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12625 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_nat_ftp.ko 2023-12-22T09:45:45.940 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11857 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_nat_irc.ko 2023-12-22T09:45:45.940 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28929 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_nat_sip.ko 2023-12-22T09:45:45.940 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8809 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_nat_tftp.ko 2023-12-22T09:45:45.940 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 44065 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_synproxy_core.ko 2023-12-22T09:45:45.940 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 615649 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nf_tables.ko 2023-12-22T09:45:45.940 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 42561 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nfnetlink.ko 2023-12-22T09:45:45.940 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 30233 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nfnetlink_acct.ko 2023-12-22T09:45:45.940 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 30569 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-12-22T09:45:45.940 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 39785 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nfnetlink_log.ko 2023-12-22T09:45:45.940 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22921 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nfnetlink_osf.ko 2023-12-22T09:45:45.941 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 49377 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nfnetlink_queue.ko 2023-12-22T09:45:45.941 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10457 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_chain_nat.ko 2023-12-22T09:45:45.941 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 33209 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_compat.ko 2023-12-22T09:45:45.941 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 40721 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_ct.ko 2023-12-22T09:45:45.941 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9601 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_dup_netdev.ko 2023-12-22T09:45:45.941 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11401 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_fib.ko 2023-12-22T09:45:45.941 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13745 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_fwd_netdev.ko 2023-12-22T09:45:45.942 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14185 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_hash.ko 2023-12-22T09:45:45.942 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20065 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_limit.ko 2023-12-22T09:45:45.942 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15401 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_log.ko 2023-12-22T09:45:45.942 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14801 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_masq.ko 2023-12-22T09:45:45.942 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14329 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_nat.ko 2023-12-22T09:45:45.942 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13673 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_numgen.ko 2023-12-22T09:45:45.942 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11841 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_osf.ko 2023-12-22T09:45:45.943 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_queue.ko 2023-12-22T09:45:45.943 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14193 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_redir.ko 2023-12-22T09:45:45.943 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10497 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_reject.ko 2023-12-22T09:45:45.943 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10081 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_reject_inet.ko 2023-12-22T09:45:45.943 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12737 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_socket.ko 2023-12-22T09:45:45.943 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20369 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_synproxy.ko 2023-12-22T09:45:45.943 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14849 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/nft_tproxy.ko 2023-12-22T09:45:45.943 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 89313 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/x_tables.ko 2023-12-22T09:45:45.943 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12097 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_AUDIT.ko 2023-12-22T09:45:45.943 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9633 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_CHECKSUM.ko 2023-12-22T09:45:45.943 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_CLASSIFY.ko 2023-12-22T09:45:45.943 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11521 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-12-22T09:45:45.944 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18169 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_CT.ko 2023-12-22T09:45:45.944 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10497 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_DSCP.ko 2023-12-22T09:45:45.944 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9465 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_HL.ko 2023-12-22T09:45:45.944 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13369 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_HMARK.ko 2023-12-22T09:45:45.944 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 38873 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_IDLETIMER.ko 2023-12-22T09:45:45.944 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13889 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_LED.ko 2023-12-22T09:45:45.944 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11489 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_LOG.ko 2023-12-22T09:45:45.944 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11753 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_MASQUERADE.ko 2023-12-22T09:45:45.944 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11657 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_NETMAP.ko 2023-12-22T09:45:45.944 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9473 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_NFLOG.ko 2023-12-22T09:45:45.944 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13289 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_NFQUEUE.ko 2023-12-22T09:45:45.944 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19665 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_RATEEST.ko 2023-12-22T09:45:45.944 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_REDIRECT.ko 2023-12-22T09:45:45.944 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14337 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_SECMARK.ko 2023-12-22T09:45:45.945 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16057 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_TCPMSS.ko 2023-12-22T09:45:45.945 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10433 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-12-22T09:45:45.945 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17361 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_TEE.ko 2023-12-22T09:45:45.945 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16785 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_TPROXY.ko 2023-12-22T09:45:45.945 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8321 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_TRACE.ko 2023-12-22T09:45:45.945 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13897 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_addrtype.ko 2023-12-22T09:45:45.945 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13897 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_bpf.ko 2023-12-22T09:45:45.945 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15529 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_cgroup.ko 2023-12-22T09:45:45.945 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11209 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_cluster.ko 2023-12-22T09:45:45.945 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7505 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_comment.ko 2023-12-22T09:45:45.945 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10465 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_connbytes.ko 2023-12-22T09:45:45.945 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11081 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_connlabel.ko 2023-12-22T09:45:45.945 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9401 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_connlimit.ko 2023-12-22T09:45:45.946 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13129 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_connmark.ko 2023-12-22T09:45:45.946 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12401 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_conntrack.ko 2023-12-22T09:45:45.946 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_cpu.ko 2023-12-22T09:45:45.946 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10969 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_dccp.ko 2023-12-22T09:45:45.946 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7865 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_devgroup.ko 2023-12-22T09:45:45.946 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8801 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_dscp.ko 2023-12-22T09:45:45.946 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10657 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_ecn.ko 2023-12-22T09:45:45.946 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11473 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_esp.ko 2023-12-22T09:45:45.946 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 43289 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_hashlimit.ko 2023-12-22T09:45:45.946 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11313 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_helper.ko 2023-12-22T09:45:45.946 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7865 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_hl.ko 2023-12-22T09:45:45.946 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11921 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_ipcomp.ko 2023-12-22T09:45:45.946 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11473 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_iprange.ko 2023-12-22T09:45:45.947 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11785 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_ipvs.ko 2023-12-22T09:45:45.947 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16041 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_l2tp.ko 2023-12-22T09:45:45.947 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8001 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_length.ko 2023-12-22T09:45:45.947 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10209 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_limit.ko 2023-12-22T09:45:45.947 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7545 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_mac.ko 2023-12-22T09:45:45.947 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8577 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_mark.ko 2023-12-22T09:45:45.947 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11825 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_multiport.ko 2023-12-22T09:45:45.947 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_nat.ko 2023-12-22T09:45:45.947 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10105 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_nfacct.ko 2023-12-22T09:45:45.947 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8297 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_osf.ko 2023-12-22T09:45:45.947 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9553 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_owner.ko 2023-12-22T09:45:45.947 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_physdev.ko 2023-12-22T09:45:45.947 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7633 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_pkttype.ko 2023-12-22T09:45:45.947 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11985 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_policy.ko 2023-12-22T09:45:45.948 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9473 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_quota.ko 2023-12-22T09:45:45.948 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10409 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_rateest.ko 2023-12-22T09:45:45.948 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8257 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_realm.ko 2023-12-22T09:45:45.948 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 36433 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_recent.ko 2023-12-22T09:45:45.948 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13329 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_sctp.ko 2023-12-22T09:45:45.948 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 30089 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_set.ko 2023-12-22T09:45:45.948 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16089 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_socket.ko 2023-12-22T09:45:45.948 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9505 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_state.ko 2023-12-22T09:45:45.948 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9473 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_statistic.ko 2023-12-22T09:45:45.948 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8809 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_string.ko 2023-12-22T09:45:45.948 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8553 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_tcpmss.ko 2023-12-22T09:45:45.948 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15777 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_tcpudp.ko 2023-12-22T09:45:45.948 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11065 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_time.ko 2023-12-22T09:45:45.948 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9401 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netfilter/xt_u32.ko 2023-12-22T09:45:45.949 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netlink/ 2023-12-22T09:45:45.949 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13969 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/netlink/netlink_diag.ko 2023-12-22T09:45:45.949 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/nsh/ 2023-12-22T09:45:45.949 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/nsh/nsh.ko 2023-12-22T09:45:45.949 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/openvswitch/ 2023-12-22T09:45:45.949 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 380033 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/openvswitch/openvswitch.ko 2023-12-22T09:45:45.949 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10257 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/openvswitch/vport-geneve.ko 2023-12-22T09:45:45.949 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9449 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/openvswitch/vport-gre.ko 2023-12-22T09:45:45.949 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11793 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/openvswitch/vport-vxlan.ko 2023-12-22T09:45:45.949 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/packet/ 2023-12-22T09:45:45.949 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13057 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/packet/af_packet_diag.ko 2023-12-22T09:45:45.949 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/phonet/ 2023-12-22T09:45:45.950 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 110201 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/phonet/phonet.ko 2023-12-22T09:45:45.950 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 54721 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/phonet/pn_pep.ko 2023-12-22T09:45:45.950 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/rds/ 2023-12-22T09:45:45.950 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 251481 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/rds/rds.ko 2023-12-22T09:45:45.950 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 164937 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/rds/rds_rdma.ko 2023-12-22T09:45:45.950 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 67377 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/rds/rds_tcp.ko 2023-12-22T09:45:45.950 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/rxrpc/ 2023-12-22T09:45:45.950 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 819657 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/rxrpc/rxrpc.ko 2023-12-22T09:45:45.950 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/ 2023-12-22T09:45:45.950 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 32241 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/act_csum.ko 2023-12-22T09:45:45.950 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23577 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/act_gact.ko 2023-12-22T09:45:45.951 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26873 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/act_ipt.ko 2023-12-22T09:45:45.951 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 34097 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/act_mirred.ko 2023-12-22T09:45:45.951 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23401 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/act_nat.ko 2023-12-22T09:45:45.951 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 43449 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/act_pedit.ko 2023-12-22T09:45:45.951 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 31961 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/act_police.ko 2023-12-22T09:45:45.951 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20289 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/act_simple.ko 2023-12-22T09:45:45.951 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 35297 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/act_skbedit.ko 2023-12-22T09:45:45.951 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 36665 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/act_vlan.ko 2023-12-22T09:45:45.951 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26169 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/cls_basic.ko 2023-12-22T09:45:45.952 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 33961 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/cls_bpf.ko 2023-12-22T09:45:45.952 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19169 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/cls_cgroup.ko 2023-12-22T09:45:45.952 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 31401 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/cls_flow.ko 2023-12-22T09:45:45.952 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 31769 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/cls_fw.ko 2023-12-22T09:45:45.952 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 38425 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/cls_route.ko 2023-12-22T09:45:45.952 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 61409 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/cls_u32.ko 2023-12-22T09:45:45.952 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7441 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/em_cmp.ko 2023-12-22T09:45:45.952 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13409 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/em_ipset.ko 2023-12-22T09:45:45.952 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 33289 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/em_meta.ko 2023-12-22T09:45:45.952 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7897 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/em_nbyte.ko 2023-12-22T09:45:45.952 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10625 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/em_text.ko 2023-12-22T09:45:45.952 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7249 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/em_u32.ko 2023-12-22T09:45:45.952 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21649 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_choke.ko 2023-12-22T09:45:45.952 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20849 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_codel.ko 2023-12-22T09:45:45.953 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 34633 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_drr.ko 2023-12-22T09:45:45.953 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 33609 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_fq.ko 2023-12-22T09:45:45.953 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 31617 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_fq_codel.ko 2023-12-22T09:45:45.953 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 35433 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_gred.ko 2023-12-22T09:45:45.953 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 49817 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_hfsc.ko 2023-12-22T09:45:45.953 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22089 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_hhf.ko 2023-12-22T09:45:45.953 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 66393 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_htb.ko 2023-12-22T09:45:45.953 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26073 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_ingress.ko 2023-12-22T09:45:45.953 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 30273 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_mqprio.ko 2023-12-22T09:45:45.953 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10793 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_mqprio_lib.ko 2023-12-22T09:45:45.953 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26065 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_multiq.ko 2023-12-22T09:45:45.953 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 36137 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_netem.ko 2023-12-22T09:45:45.953 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 27497 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_pie.ko 2023-12-22T09:45:45.953 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10625 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_plug.ko 2023-12-22T09:45:45.954 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_prio.ko 2023-12-22T09:45:45.954 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 48729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_qfq.ko 2023-12-22T09:45:45.954 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 32905 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_red.ko 2023-12-22T09:45:45.954 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26881 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_sfb.ko 2023-12-22T09:45:45.954 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 31353 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_sfq.ko 2023-12-22T09:45:45.954 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28897 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_tbf.ko 2023-12-22T09:45:45.954 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28105 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sched/sch_teql.ko 2023-12-22T09:45:45.954 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sctp/ 2023-12-22T09:45:45.954 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 929745 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sctp/sctp.ko 2023-12-22T09:45:45.954 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19033 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sctp/sctp_diag.ko 2023-12-22T09:45:45.954 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sunrpc/ 2023-12-22T09:45:45.954 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sunrpc/auth_gss/ 2023-12-22T09:45:45.955 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 336529 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-12-22T09:45:45.955 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 54737 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-12-22T09:45:45.956 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 1520097 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sunrpc/sunrpc.ko 2023-12-22T09:45:45.956 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sunrpc/xprtrdma/ 2023-12-22T09:45:45.956 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 707657 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-12-22T09:45:45.956 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/tipc/ 2023-12-22T09:45:45.956 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10025 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/tipc/diag.ko 2023-12-22T09:45:45.956 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 862665 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/tipc/tipc.ko 2023-12-22T09:45:45.960 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/unix/ 2023-12-22T09:45:45.960 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15729 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/unix/unix_diag.ko 2023-12-22T09:45:45.960 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/vmw_vsock/ 2023-12-22T09:45:45.960 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 85409 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-12-22T09:45:45.960 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 68049 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-12-22T09:45:45.960 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 96193 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/vmw_vsock/vsock.ko 2023-12-22T09:45:45.960 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10705 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/vmw_vsock/vsock_diag.ko 2023-12-22T09:45:45.961 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17521 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/vmw_vsock/vsock_loopback.ko 2023-12-22T09:45:45.961 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/x25/ 2023-12-22T09:45:45.961 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 125177 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/x25/x25.ko 2023-12-22T09:45:45.961 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/xfrm/ 2023-12-22T09:45:45.961 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22657 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/xfrm/xfrm_algo.ko 2023-12-22T09:45:45.961 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20649 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/xfrm/xfrm_ipcomp.ko 2023-12-22T09:45:45.961 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 102257 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/net/xfrm/xfrm_user.ko 2023-12-22T09:45:45.961 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/virt/ 2023-12-22T09:45:45.961 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/virt/lib/ 2023-12-22T09:45:45.961 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15537 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/kernel/virt/lib/irqbypass.ko 2023-12-22T09:45:45.961 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 640081 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/modules.alias 2023-12-22T09:45:45.961 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 624107 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/modules.alias.bin 2023-12-22T09:45:45.961 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7663 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/modules.builtin 2023-12-22T09:45:45.961 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23428 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/modules.builtin.alias.bin 2023-12-22T09:45:45.962 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9821 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/modules.builtin.bin 2023-12-22T09:45:45.962 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 70004 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/modules.builtin.modinfo 2023-12-22T09:45:45.962 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 146313 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/modules.dep 2023-12-22T09:45:45.962 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 232548 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/modules.dep.bin 2023-12-22T09:45:45.962 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 210 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/modules.devname 2023-12-22T09:45:45.962 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 72606 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/modules.order 2023-12-22T09:45:45.962 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 879 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/modules.softdep 2023-12-22T09:45:45.962 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 254438 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/modules.symbols 2023-12-22T09:45:45.962 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 309363 2023-12-21 02:06 ./lib/modules/6.6.0-g623393c9d50c/modules.symbols.bin 2023-12-22T09:45:45.962 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./usr/ 2023-12-22T09:45:45.962 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./usr/share/ 2023-12-22T09:45:45.962 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./usr/share/doc/ 2023-12-22T09:45:45.962 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-21 02:06 ./usr/share/doc/linux-image-6.6.0-g623393c9d50c/ 2023-12-22T09:45:45.962 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 170 2023-12-21 02:06 ./usr/share/doc/linux-image-6.6.0-g623393c9d50c/changelog.Debian.gz 2023-12-22T09:45:45.962 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 691 2023-12-21 02:06 ./usr/share/doc/linux-image-6.6.0-g623393c9d50c/copyright 2023-12-22T09:45:45.963 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-g623393c9d50c 2023-12-22T09:45:45.963 INFO:teuthology.task.kernel:searching for kernel 6.6.0-g623393c9d50c 2023-12-22T09:45:45.963 DEBUG:teuthology.orchestra.run.smithi045:> egrep '(submenu|menuentry.*6.6.0-g623393c9d50c).*{' /boot/grub/grub.cfg 2023-12-22T09:45:45.972 INFO:teuthology.orchestra.run.smithi045.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-12-22T09:45:45.972 INFO:teuthology.orchestra.run.smithi045.stdout: menuentry 'Ubuntu, with Linux 6.6.0-g623393c9d50c' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-g623393c9d50c-advanced-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-12-22T09:45:45.972 INFO:teuthology.orchestra.run.smithi045.stdout: menuentry 'Ubuntu, with Linux 6.6.0-g623393c9d50c (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-g623393c9d50c-recovery-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-12-22T09:45:45.973 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-12-22T09:45:45.973 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.6.0-g623393c9d50c 2023-12-22T09:45:45.973 DEBUG:teuthology.orchestra.run.smithi045:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-12-22T09:45:45.975 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi045.front.sepia.ceph.com to complete... 2023-12-22T09:45:46.639 INFO:teuthology.orchestra.run.smithi045.stderr:Sourcing file `/etc/default/grub' 2023-12-22T09:45:46.642 INFO:teuthology.orchestra.run.smithi045.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-12-22T09:45:46.652 INFO:teuthology.orchestra.run.smithi045.stderr:Generating grub configuration file ... 2023-12-22T09:45:46.919 INFO:teuthology.orchestra.run.smithi045.stderr:Found linux image: /boot/vmlinuz-6.6.0-g623393c9d50c 2023-12-22T09:45:46.932 INFO:teuthology.orchestra.run.smithi045.stderr:Found initrd image: /boot/initrd.img-6.6.0-g623393c9d50c 2023-12-22T09:45:47.321 INFO:teuthology.orchestra.run.smithi045.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-12-22T09:45:47.333 INFO:teuthology.orchestra.run.smithi045.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-12-22T09:45:48.065 INFO:teuthology.orchestra.run.smithi045.stderr:done 2023-12-22T09:46:10.225 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-12-22T09:46:10.226 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi113.front.sepia.ceph.com' 2023-12-22T09:46:10.227 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T09:46:19.193 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-12-22T09:46:19.194 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi045.front.sepia.ceph.com' 2023-12-22T09:46:19.194 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T09:46:28.754 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.113 2023-12-22T09:46:37.761 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi113.front.sepia.ceph.com' 2023-12-22T09:46:37.762 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T09:46:40.821 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.113 2023-12-22T09:46:52.834 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi113.front.sepia.ceph.com' 2023-12-22T09:46:52.834 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T09:46:55.889 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.113 2023-12-22T09:47:10.902 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi113.front.sepia.ceph.com' 2023-12-22T09:47:10.903 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T09:47:19.201 DEBUG:teuthology.orchestra.remote:timed out 2023-12-22T09:47:28.209 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi045.front.sepia.ceph.com' 2023-12-22T09:47:28.210 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T09:47:29.425 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.113 2023-12-22T09:47:30.258 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.45 2023-12-22T09:47:42.269 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi045.front.sepia.ceph.com' 2023-12-22T09:47:42.271 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T09:47:42.515 DEBUG:teuthology.orchestra.run.smithi045:> true 2023-12-22T09:47:43.255 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi045.front.sepia.ceph.com' 2023-12-22T09:47:43.255 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.6.0-g623393c9d50c"... 2023-12-22T09:47:43.256 DEBUG:teuthology.orchestra.run.smithi045:> uname -r 2023-12-22T09:47:43.322 INFO:teuthology.orchestra.run.smithi045.stdout:6.6.0-g623393c9d50c 2023-12-22T09:47:43.322 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-g623393c9d50c vs 6.6.0-g623393c9d50c 2023-12-22T09:47:43.322 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-22T09:47:43.322 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-12-22T09:47:44.324 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-12-22T09:47:44.324 DEBUG:teuthology.orchestra.run.smithi045:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-12-22T09:47:44.437 INFO:teuthology.orchestra.run.smithi045.stdout:ttyS1 2023-12-22T09:47:44.493 DEBUG:teuthology.parallel:result is None 2023-12-22T09:47:47.426 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi113.front.sepia.ceph.com' 2023-12-22T09:47:47.427 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T09:47:47.677 DEBUG:teuthology.orchestra.run.smithi113:> true 2023-12-22T09:47:48.377 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi113.front.sepia.ceph.com' 2023-12-22T09:47:48.377 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.6.0-g623393c9d50c"... 2023-12-22T09:47:48.378 DEBUG:teuthology.orchestra.run.smithi113:> uname -r 2023-12-22T09:47:48.440 INFO:teuthology.orchestra.run.smithi113.stdout:6.6.0-g623393c9d50c 2023-12-22T09:47:48.440 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-g623393c9d50c vs 6.6.0-g623393c9d50c 2023-12-22T09:47:48.440 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-22T09:47:48.440 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-12-22T09:47:49.441 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-12-22T09:47:49.441 DEBUG:teuthology.orchestra.run.smithi113:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-12-22T09:47:49.546 INFO:teuthology.orchestra.run.smithi113.stdout:ttyS1 2023-12-22T09:47:49.602 DEBUG:teuthology.parallel:result is None 2023-12-22T09:47:49.602 INFO:teuthology.run_tasks:Running task internal.base... 2023-12-22T09:47:49.614 INFO:teuthology.task.internal:Creating test directory... 2023-12-22T09:47:49.615 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-22T09:47:49.623 DEBUG:teuthology.orchestra.run.smithi113:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-22T09:47:49.641 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-12-22T09:47:49.649 INFO:teuthology.run_tasks:Running task internal.archive... 2023-12-22T09:47:49.656 INFO:teuthology.task.internal:Creating archive directory... 2023-12-22T09:47:49.657 DEBUG:teuthology.orchestra.run.smithi045:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-22T09:47:49.687 DEBUG:teuthology.orchestra.run.smithi113:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-22T09:47:49.722 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-12-22T09:47:49.731 INFO:teuthology.task.internal:Enabling coredump saving... 2023-12-22T09:47:49.731 DEBUG:teuthology.orchestra.run.smithi045:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-22T09:47:49.762 DEBUG:teuthology.orchestra.run.smithi113:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-22T09:47:49.812 INFO:teuthology.orchestra.run.smithi113.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-22T09:47:49.812 INFO:teuthology.orchestra.run.smithi045.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-22T09:47:49.832 INFO:teuthology.orchestra.run.smithi045.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-22T09:47:49.839 INFO:teuthology.orchestra.run.smithi113.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-22T09:47:49.843 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-12-22T09:47:49.850 INFO:teuthology.task.internal:Configuring sudo... 2023-12-22T09:47:49.851 DEBUG:teuthology.orchestra.run.smithi045:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-22T09:47:49.858 DEBUG:teuthology.orchestra.run.smithi113:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-22T09:47:49.923 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-12-22T09:47:49.964 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-12-22T09:47:49.964 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-22T09:47:49.972 DEBUG:teuthology.orchestra.run.smithi113:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-22T09:47:49.991 DEBUG:teuthology.orchestra.run.smithi045:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-22T09:47:50.050 DEBUG:teuthology.orchestra.run.smithi045:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-22T09:47:50.117 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-22T09:47:50.117 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-22T09:47:50.217 DEBUG:teuthology.orchestra.run.smithi113:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-22T09:47:50.238 DEBUG:teuthology.orchestra.run.smithi113:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-22T09:47:50.304 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-22T09:47:50.305 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-22T09:47:50.392 DEBUG:teuthology.orchestra.run.smithi045:> sudo service rsyslog restart 2023-12-22T09:47:50.401 DEBUG:teuthology.orchestra.run.smithi113:> sudo service rsyslog restart 2023-12-22T09:47:50.562 INFO:teuthology.run_tasks:Running task internal.timer... 2023-12-22T09:47:50.570 INFO:teuthology.task.internal:Starting timer... 2023-12-22T09:47:50.570 INFO:teuthology.run_tasks:Running task pcp... 2023-12-22T09:47:50.586 INFO:teuthology.run_tasks:Running task selinux... 2023-12-22T09:47:50.595 DEBUG:teuthology.task.selinux:Excluding smithi045: OS 'ubuntu' does not support SELinux 2023-12-22T09:47:50.595 DEBUG:teuthology.task.selinux:Excluding smithi113: OS 'ubuntu' does not support SELinux 2023-12-22T09:47:50.596 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-12-22T09:47:50.596 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-12-22T09:47:50.596 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-12-22T09:47:50.596 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-12-22T09:47:50.605 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-12-22T09:47:50.617 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2023-12-22T09:47:50.759 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-12-22T09:47:50.775 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-12-22T09:47:50.776 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi045.front.sepia.ceph.com,smithi113.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-12-22T09:56:23.615 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi045.front.sepia.ceph.com'), Remote(name='ubuntu@smithi113.front.sepia.ceph.com')] 2023-12-22T09:56:23.616 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi045.front.sepia.ceph.com' 2023-12-22T09:56:23.617 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T09:56:23.722 DEBUG:teuthology.orchestra.run.smithi045:> true 2023-12-22T09:56:23.966 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi045.front.sepia.ceph.com' 2023-12-22T09:56:23.966 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi113.front.sepia.ceph.com' 2023-12-22T09:56:23.967 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T09:56:24.071 DEBUG:teuthology.orchestra.run.smithi113:> true 2023-12-22T09:56:24.301 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi113.front.sepia.ceph.com' 2023-12-22T09:56:24.302 INFO:teuthology.run_tasks:Running task clock... 2023-12-22T09:56:24.312 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-12-22T09:56:24.312 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-22T09:56:24.312 DEBUG:teuthology.orchestra.run.smithi045:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-22T09:56:24.320 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-22T09:56:24.320 DEBUG:teuthology.orchestra.run.smithi113:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-22T09:56:24.393 INFO:teuthology.orchestra.run.smithi045.stdout:22 Dec 09:56:24 ntpd[23341]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-12-22T09:56:24.394 INFO:teuthology.orchestra.run.smithi045.stdout:22 Dec 09:56:24 ntpd[23341]: Command line: ntpd -gq 2023-12-22T09:56:24.395 INFO:teuthology.orchestra.run.smithi045.stdout:22 Dec 09:56:24 ntpd[23341]: proto: precision = 0.046 usec (-24) 2023-12-22T09:56:24.395 INFO:teuthology.orchestra.run.smithi045.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-12-22T09:56:24.396 INFO:teuthology.orchestra.run.smithi045.stdout:22 Dec 09:56:24 ntpd[23341]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-12-22T09:56:24.396 INFO:teuthology.orchestra.run.smithi045.stdout:22 Dec 09:56:24 ntpd[23341]: restrict ::: KOD does nothing without LIMITED. 2023-12-22T09:56:24.396 INFO:teuthology.orchestra.run.smithi045.stderr:restrict ::: KOD does nothing without LIMITED. 2023-12-22T09:56:24.397 INFO:teuthology.orchestra.run.smithi045.stdout:22 Dec 09:56:24 ntpd[23341]: Listen and drop on 0 v6wildcard [::]:123 2023-12-22T09:56:24.397 INFO:teuthology.orchestra.run.smithi045.stdout:22 Dec 09:56:24 ntpd[23341]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-12-22T09:56:24.397 INFO:teuthology.orchestra.run.smithi045.stdout:22 Dec 09:56:24 ntpd[23341]: Listen normally on 2 lo 127.0.0.1:123 2023-12-22T09:56:24.398 INFO:teuthology.orchestra.run.smithi045.stdout:22 Dec 09:56:24 ntpd[23341]: Listen normally on 3 ens1f0 172.21.15.45:123 2023-12-22T09:56:24.398 INFO:teuthology.orchestra.run.smithi045.stdout:22 Dec 09:56:24 ntpd[23341]: Listen normally on 4 lo [::1]:123 2023-12-22T09:56:24.398 INFO:teuthology.orchestra.run.smithi045.stdout:22 Dec 09:56:24 ntpd[23341]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:12be%4]:123 2023-12-22T09:56:24.398 INFO:teuthology.orchestra.run.smithi045.stdout:22 Dec 09:56:24 ntpd[23341]: Listening on routing socket on fd #22 for interface updates 2023-12-22T09:56:24.420 INFO:teuthology.orchestra.run.smithi113.stdout:22 Dec 09:56:24 ntpd[23478]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-12-22T09:56:24.420 INFO:teuthology.orchestra.run.smithi113.stdout:22 Dec 09:56:24 ntpd[23478]: Command line: ntpd -gq 2023-12-22T09:56:24.421 INFO:teuthology.orchestra.run.smithi113.stdout:22 Dec 09:56:24 ntpd[23478]: proto: precision = 0.051 usec (-24) 2023-12-22T09:56:24.422 INFO:teuthology.orchestra.run.smithi113.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-12-22T09:56:24.422 INFO:teuthology.orchestra.run.smithi113.stdout:22 Dec 09:56:24 ntpd[23478]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-12-22T09:56:24.422 INFO:teuthology.orchestra.run.smithi113.stdout:22 Dec 09:56:24 ntpd[23478]: restrict ::: KOD does nothing without LIMITED. 2023-12-22T09:56:24.422 INFO:teuthology.orchestra.run.smithi113.stderr:restrict ::: KOD does nothing without LIMITED. 2023-12-22T09:56:24.423 INFO:teuthology.orchestra.run.smithi113.stdout:22 Dec 09:56:24 ntpd[23478]: Listen and drop on 0 v6wildcard [::]:123 2023-12-22T09:56:24.423 INFO:teuthology.orchestra.run.smithi113.stdout:22 Dec 09:56:24 ntpd[23478]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-12-22T09:56:24.423 INFO:teuthology.orchestra.run.smithi113.stdout:22 Dec 09:56:24 ntpd[23478]: Listen normally on 2 lo 127.0.0.1:123 2023-12-22T09:56:24.423 INFO:teuthology.orchestra.run.smithi113.stdout:22 Dec 09:56:24 ntpd[23478]: Listen normally on 3 enp3s0f1 172.21.15.113:123 2023-12-22T09:56:24.424 INFO:teuthology.orchestra.run.smithi113.stdout:22 Dec 09:56:24 ntpd[23478]: Listen normally on 4 lo [::1]:123 2023-12-22T09:56:24.424 INFO:teuthology.orchestra.run.smithi113.stdout:22 Dec 09:56:24 ntpd[23478]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d7c1%5]:123 2023-12-22T09:56:24.424 INFO:teuthology.orchestra.run.smithi113.stdout:22 Dec 09:56:24 ntpd[23478]: Listening on routing socket on fd #22 for interface updates 2023-12-22T09:56:25.394 INFO:teuthology.orchestra.run.smithi045.stderr:22 Dec 09:56:25 ntpd[23341]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-22T09:56:25.394 INFO:teuthology.orchestra.run.smithi045.stderr:22 Dec 09:56:25 ntpd[23341]: can't open /var/log/ntpstats/rawstats.20231222: Permission denied 2023-12-22T09:56:25.395 INFO:teuthology.orchestra.run.smithi045.stderr:22 Dec 09:56:25 ntpd[23341]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-22T09:56:25.395 INFO:teuthology.orchestra.run.smithi045.stderr:22 Dec 09:56:25 ntpd[23341]: can't open /var/log/ntpstats/rawstats.20231222: Permission denied 2023-12-22T09:56:25.395 INFO:teuthology.orchestra.run.smithi045.stderr:22 Dec 09:56:25 ntpd[23341]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-22T09:56:25.395 INFO:teuthology.orchestra.run.smithi045.stderr:22 Dec 09:56:25 ntpd[23341]: can't open /var/log/ntpstats/peerstats.20231222: Permission denied 2023-12-22T09:56:25.421 INFO:teuthology.orchestra.run.smithi113.stderr:22 Dec 09:56:25 ntpd[23478]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-22T09:56:25.421 INFO:teuthology.orchestra.run.smithi113.stderr:22 Dec 09:56:25 ntpd[23478]: can't open /var/log/ntpstats/rawstats.20231222: Permission denied 2023-12-22T09:56:25.422 INFO:teuthology.orchestra.run.smithi113.stderr:22 Dec 09:56:25 ntpd[23478]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-22T09:56:25.422 INFO:teuthology.orchestra.run.smithi113.stderr:22 Dec 09:56:25 ntpd[23478]: can't open /var/log/ntpstats/rawstats.20231222: Permission denied 2023-12-22T09:56:25.422 INFO:teuthology.orchestra.run.smithi113.stderr:22 Dec 09:56:25 ntpd[23478]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-22T09:56:25.422 INFO:teuthology.orchestra.run.smithi113.stderr:22 Dec 09:56:25 ntpd[23478]: can't open /var/log/ntpstats/peerstats.20231222: Permission denied 2023-12-22T09:56:26.394 INFO:teuthology.orchestra.run.smithi045.stderr:22 Dec 09:56:26 ntpd[23341]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-22T09:56:26.394 INFO:teuthology.orchestra.run.smithi045.stderr:22 Dec 09:56:26 ntpd[23341]: can't open /var/log/ntpstats/rawstats.20231222: Permission denied 2023-12-22T09:56:26.421 INFO:teuthology.orchestra.run.smithi113.stderr:22 Dec 09:56:26 ntpd[23478]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-22T09:56:26.422 INFO:teuthology.orchestra.run.smithi113.stderr:22 Dec 09:56:26 ntpd[23478]: can't open /var/log/ntpstats/rawstats.20231222: Permission denied 2023-12-22T09:56:26.422 INFO:teuthology.orchestra.run.smithi113.stderr:22 Dec 09:56:26 ntpd[23478]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-22T09:56:26.422 INFO:teuthology.orchestra.run.smithi113.stderr:22 Dec 09:56:26 ntpd[23478]: can't open /var/log/ntpstats/rawstats.20231222: Permission denied 2023-12-22T09:56:26.422 INFO:teuthology.orchestra.run.smithi113.stderr:22 Dec 09:56:26 ntpd[23478]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-22T09:56:26.422 INFO:teuthology.orchestra.run.smithi113.stderr:22 Dec 09:56:26 ntpd[23478]: can't open /var/log/ntpstats/rawstats.20231222: Permission denied 2023-12-22T09:56:26.422 INFO:teuthology.orchestra.run.smithi113.stderr:22 Dec 09:56:26 ntpd[23478]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-22T09:56:26.422 INFO:teuthology.orchestra.run.smithi113.stderr:22 Dec 09:56:26 ntpd[23478]: can't open /var/log/ntpstats/peerstats.20231222: Permission denied 2023-12-22T09:56:27.396 INFO:teuthology.orchestra.run.smithi045.stderr:22 Dec 09:56:27 ntpd[23341]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-22T09:56:27.396 INFO:teuthology.orchestra.run.smithi045.stderr:22 Dec 09:56:27 ntpd[23341]: can't open /var/log/ntpstats/rawstats.20231222: Permission denied 2023-12-22T09:56:27.396 INFO:teuthology.orchestra.run.smithi045.stderr:22 Dec 09:56:27 ntpd[23341]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-22T09:56:27.396 INFO:teuthology.orchestra.run.smithi045.stderr:22 Dec 09:56:27 ntpd[23341]: can't open /var/log/ntpstats/rawstats.20231222: Permission denied 2023-12-22T09:56:27.396 INFO:teuthology.orchestra.run.smithi045.stderr:22 Dec 09:56:27 ntpd[23341]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-22T09:56:27.396 INFO:teuthology.orchestra.run.smithi045.stderr:22 Dec 09:56:27 ntpd[23341]: can't open /var/log/ntpstats/rawstats.20231222: Permission denied 2023-12-22T09:56:27.396 INFO:teuthology.orchestra.run.smithi045.stderr:22 Dec 09:56:27 ntpd[23341]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-22T09:56:27.396 INFO:teuthology.orchestra.run.smithi045.stderr:22 Dec 09:56:27 ntpd[23341]: can't open /var/log/ntpstats/rawstats.20231222: Permission denied 2023-12-22T09:56:27.396 INFO:teuthology.orchestra.run.smithi045.stderr:22 Dec 09:56:27 ntpd[23341]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-22T09:56:27.396 INFO:teuthology.orchestra.run.smithi045.stderr:22 Dec 09:56:27 ntpd[23341]: can't open /var/log/ntpstats/peerstats.20231222: Permission denied 2023-12-22T09:56:27.397 INFO:teuthology.orchestra.run.smithi045.stderr:22 Dec 09:56:27 ntpd[23341]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-22T09:56:27.397 INFO:teuthology.orchestra.run.smithi045.stderr:22 Dec 09:56:27 ntpd[23341]: can't open /var/log/ntpstats/rawstats.20231222: Permission denied 2023-12-22T09:56:27.397 INFO:teuthology.orchestra.run.smithi045.stderr:22 Dec 09:56:27 ntpd[23341]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-22T09:56:27.397 INFO:teuthology.orchestra.run.smithi045.stderr:22 Dec 09:56:27 ntpd[23341]: can't open /var/log/ntpstats/peerstats.20231222: Permission denied 2023-12-22T09:56:27.397 INFO:teuthology.orchestra.run.smithi045.stderr:22 Dec 09:56:27 ntpd[23341]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-22T09:56:27.397 INFO:teuthology.orchestra.run.smithi045.stderr:22 Dec 09:56:27 ntpd[23341]: can't open /var/log/ntpstats/rawstats.20231222: Permission denied 2023-12-22T09:56:27.397 INFO:teuthology.orchestra.run.smithi045.stderr:22 Dec 09:56:27 ntpd[23341]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-22T09:56:27.397 INFO:teuthology.orchestra.run.smithi045.stderr:22 Dec 09:56:27 ntpd[23341]: can't open /var/log/ntpstats/peerstats.20231222: Permission denied 2023-12-22T09:56:27.421 INFO:teuthology.orchestra.run.smithi113.stderr:22 Dec 09:56:27 ntpd[23478]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-22T09:56:27.421 INFO:teuthology.orchestra.run.smithi113.stderr:22 Dec 09:56:27 ntpd[23478]: can't open /var/log/ntpstats/rawstats.20231222: Permission denied 2023-12-22T09:56:27.421 INFO:teuthology.orchestra.run.smithi113.stderr:22 Dec 09:56:27 ntpd[23478]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-22T09:56:27.422 INFO:teuthology.orchestra.run.smithi113.stderr:22 Dec 09:56:27 ntpd[23478]: can't open /var/log/ntpstats/rawstats.20231222: Permission denied 2023-12-22T09:56:27.422 INFO:teuthology.orchestra.run.smithi113.stderr:22 Dec 09:56:27 ntpd[23478]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-22T09:56:27.422 INFO:teuthology.orchestra.run.smithi113.stderr:22 Dec 09:56:27 ntpd[23478]: can't open /var/log/ntpstats/peerstats.20231222: Permission denied 2023-12-22T09:56:28.421 INFO:teuthology.orchestra.run.smithi113.stderr:22 Dec 09:56:28 ntpd[23478]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-22T09:56:28.421 INFO:teuthology.orchestra.run.smithi113.stderr:22 Dec 09:56:28 ntpd[23478]: can't open /var/log/ntpstats/rawstats.20231222: Permission denied 2023-12-22T09:56:28.421 INFO:teuthology.orchestra.run.smithi113.stderr:22 Dec 09:56:28 ntpd[23478]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-22T09:56:28.421 INFO:teuthology.orchestra.run.smithi113.stderr:22 Dec 09:56:28 ntpd[23478]: can't open /var/log/ntpstats/rawstats.20231222: Permission denied 2023-12-22T09:56:28.421 INFO:teuthology.orchestra.run.smithi113.stderr:22 Dec 09:56:28 ntpd[23478]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-22T09:56:28.422 INFO:teuthology.orchestra.run.smithi113.stderr:22 Dec 09:56:28 ntpd[23478]: can't open /var/log/ntpstats/peerstats.20231222: Permission denied 2023-12-22T09:56:29.395 INFO:teuthology.orchestra.run.smithi045.stderr:22 Dec 09:56:29 ntpd[23341]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-22T09:56:29.396 INFO:teuthology.orchestra.run.smithi045.stderr:22 Dec 09:56:29 ntpd[23341]: can't open /var/log/ntpstats/rawstats.20231222: Permission denied 2023-12-22T09:56:29.396 INFO:teuthology.orchestra.run.smithi045.stderr:22 Dec 09:56:29 ntpd[23341]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-22T09:56:29.396 INFO:teuthology.orchestra.run.smithi045.stderr:22 Dec 09:56:29 ntpd[23341]: can't open /var/log/ntpstats/rawstats.20231222: Permission denied 2023-12-22T09:56:29.396 INFO:teuthology.orchestra.run.smithi045.stderr:22 Dec 09:56:29 ntpd[23341]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-22T09:56:29.396 INFO:teuthology.orchestra.run.smithi045.stderr:22 Dec 09:56:29 ntpd[23341]: can't open /var/log/ntpstats/rawstats.20231222: Permission denied 2023-12-22T09:56:29.396 INFO:teuthology.orchestra.run.smithi045.stderr:22 Dec 09:56:29 ntpd[23341]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-22T09:56:29.396 INFO:teuthology.orchestra.run.smithi045.stderr:22 Dec 09:56:29 ntpd[23341]: can't open /var/log/ntpstats/rawstats.20231222: Permission denied 2023-12-22T09:56:29.396 INFO:teuthology.orchestra.run.smithi045.stderr:22 Dec 09:56:29 ntpd[23341]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-22T09:56:29.396 INFO:teuthology.orchestra.run.smithi045.stderr:22 Dec 09:56:29 ntpd[23341]: can't open /var/log/ntpstats/peerstats.20231222: Permission denied 2023-12-22T09:56:29.396 INFO:teuthology.orchestra.run.smithi045.stderr:22 Dec 09:56:29 ntpd[23341]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-22T09:56:29.396 INFO:teuthology.orchestra.run.smithi045.stderr:22 Dec 09:56:29 ntpd[23341]: can't open /var/log/ntpstats/rawstats.20231222: Permission denied 2023-12-22T09:56:29.397 INFO:teuthology.orchestra.run.smithi045.stderr:22 Dec 09:56:29 ntpd[23341]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-22T09:56:29.397 INFO:teuthology.orchestra.run.smithi045.stderr:22 Dec 09:56:29 ntpd[23341]: can't open /var/log/ntpstats/peerstats.20231222: Permission denied 2023-12-22T09:56:29.397 INFO:teuthology.orchestra.run.smithi045.stderr:22 Dec 09:56:29 ntpd[23341]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-22T09:56:29.397 INFO:teuthology.orchestra.run.smithi045.stderr:22 Dec 09:56:29 ntpd[23341]: can't open /var/log/ntpstats/rawstats.20231222: Permission denied 2023-12-22T09:56:29.397 INFO:teuthology.orchestra.run.smithi045.stderr:22 Dec 09:56:29 ntpd[23341]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-22T09:56:29.397 INFO:teuthology.orchestra.run.smithi045.stderr:22 Dec 09:56:29 ntpd[23341]: can't open /var/log/ntpstats/peerstats.20231222: Permission denied 2023-12-22T09:56:29.422 INFO:teuthology.orchestra.run.smithi113.stderr:22 Dec 09:56:29 ntpd[23478]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-22T09:56:29.422 INFO:teuthology.orchestra.run.smithi113.stderr:22 Dec 09:56:29 ntpd[23478]: can't open /var/log/ntpstats/rawstats.20231222: Permission denied 2023-12-22T09:56:29.422 INFO:teuthology.orchestra.run.smithi113.stderr:22 Dec 09:56:29 ntpd[23478]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-22T09:56:29.422 INFO:teuthology.orchestra.run.smithi113.stderr:22 Dec 09:56:29 ntpd[23478]: can't open /var/log/ntpstats/rawstats.20231222: Permission denied 2023-12-22T09:56:29.422 INFO:teuthology.orchestra.run.smithi113.stderr:22 Dec 09:56:29 ntpd[23478]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-22T09:56:29.422 INFO:teuthology.orchestra.run.smithi113.stderr:22 Dec 09:56:29 ntpd[23478]: can't open /var/log/ntpstats/rawstats.20231222: Permission denied 2023-12-22T09:56:29.422 INFO:teuthology.orchestra.run.smithi113.stderr:22 Dec 09:56:29 ntpd[23478]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-22T09:56:29.422 INFO:teuthology.orchestra.run.smithi113.stderr:22 Dec 09:56:29 ntpd[23478]: can't open /var/log/ntpstats/peerstats.20231222: Permission denied 2023-12-22T09:56:29.423 INFO:teuthology.orchestra.run.smithi113.stderr:22 Dec 09:56:29 ntpd[23478]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-22T09:56:29.423 INFO:teuthology.orchestra.run.smithi113.stderr:22 Dec 09:56:29 ntpd[23478]: can't open /var/log/ntpstats/rawstats.20231222: Permission denied 2023-12-22T09:56:29.423 INFO:teuthology.orchestra.run.smithi113.stderr:22 Dec 09:56:29 ntpd[23478]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-22T09:56:29.423 INFO:teuthology.orchestra.run.smithi113.stderr:22 Dec 09:56:29 ntpd[23478]: can't open /var/log/ntpstats/peerstats.20231222: Permission denied 2023-12-22T09:56:30.421 INFO:teuthology.orchestra.run.smithi113.stderr:22 Dec 09:56:30 ntpd[23478]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-22T09:56:30.421 INFO:teuthology.orchestra.run.smithi113.stderr:22 Dec 09:56:30 ntpd[23478]: can't open /var/log/ntpstats/rawstats.20231222: Permission denied 2023-12-22T09:56:30.421 INFO:teuthology.orchestra.run.smithi113.stderr:22 Dec 09:56:30 ntpd[23478]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-22T09:56:30.422 INFO:teuthology.orchestra.run.smithi113.stderr:22 Dec 09:56:30 ntpd[23478]: can't open /var/log/ntpstats/rawstats.20231222: Permission denied 2023-12-22T09:56:30.422 INFO:teuthology.orchestra.run.smithi113.stderr:22 Dec 09:56:30 ntpd[23478]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-22T09:56:30.422 INFO:teuthology.orchestra.run.smithi113.stderr:22 Dec 09:56:30 ntpd[23478]: can't open /var/log/ntpstats/peerstats.20231222: Permission denied 2023-12-22T09:56:31.395 INFO:teuthology.orchestra.run.smithi045.stderr:22 Dec 09:56:31 ntpd[23341]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-22T09:56:31.395 INFO:teuthology.orchestra.run.smithi045.stderr:22 Dec 09:56:31 ntpd[23341]: can't open /var/log/ntpstats/rawstats.20231222: Permission denied 2023-12-22T09:56:31.395 INFO:teuthology.orchestra.run.smithi045.stderr:22 Dec 09:56:31 ntpd[23341]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-22T09:56:31.395 INFO:teuthology.orchestra.run.smithi045.stderr:22 Dec 09:56:31 ntpd[23341]: can't open /var/log/ntpstats/rawstats.20231222: Permission denied 2023-12-22T09:56:31.395 INFO:teuthology.orchestra.run.smithi045.stderr:22 Dec 09:56:31 ntpd[23341]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-22T09:56:31.395 INFO:teuthology.orchestra.run.smithi045.stderr:22 Dec 09:56:31 ntpd[23341]: can't open /var/log/ntpstats/rawstats.20231222: Permission denied 2023-12-22T09:56:31.395 INFO:teuthology.orchestra.run.smithi045.stderr:22 Dec 09:56:31 ntpd[23341]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-22T09:56:31.396 INFO:teuthology.orchestra.run.smithi045.stderr:22 Dec 09:56:31 ntpd[23341]: can't open /var/log/ntpstats/rawstats.20231222: Permission denied 2023-12-22T09:56:31.396 INFO:teuthology.orchestra.run.smithi045.stderr:22 Dec 09:56:31 ntpd[23341]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-22T09:56:31.396 INFO:teuthology.orchestra.run.smithi045.stderr:22 Dec 09:56:31 ntpd[23341]: can't open /var/log/ntpstats/peerstats.20231222: Permission denied 2023-12-22T09:56:31.396 INFO:teuthology.orchestra.run.smithi045.stdout:22 Dec 09:56:31 ntpd[23341]: ntpd: time slew +0.002752 s 2023-12-22T09:56:31.396 INFO:teuthology.orchestra.run.smithi045.stdout:ntpd: time slew +0.002752s 2023-12-22T09:56:31.396 INFO:teuthology.orchestra.run.smithi045.stderr:22 Dec 09:56:31 ntpd[23341]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-12-22T09:56:31.397 INFO:teuthology.orchestra.run.smithi045.stderr:22 Dec 09:56:31 ntpd[23341]: can't open /var/log/ntpstats/loopstats.20231222: Permission denied 2023-12-22T09:56:31.421 INFO:teuthology.orchestra.run.smithi113.stderr:22 Dec 09:56:31 ntpd[23478]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-22T09:56:31.421 INFO:teuthology.orchestra.run.smithi113.stderr:22 Dec 09:56:31 ntpd[23478]: can't open /var/log/ntpstats/rawstats.20231222: Permission denied 2023-12-22T09:56:31.422 INFO:teuthology.orchestra.run.smithi113.stderr:22 Dec 09:56:31 ntpd[23478]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-22T09:56:31.422 INFO:teuthology.orchestra.run.smithi113.stderr:22 Dec 09:56:31 ntpd[23478]: can't open /var/log/ntpstats/rawstats.20231222: Permission denied 2023-12-22T09:56:31.422 INFO:teuthology.orchestra.run.smithi113.stderr:22 Dec 09:56:31 ntpd[23478]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-22T09:56:31.422 INFO:teuthology.orchestra.run.smithi113.stderr:22 Dec 09:56:31 ntpd[23478]: can't open /var/log/ntpstats/rawstats.20231222: Permission denied 2023-12-22T09:56:31.422 INFO:teuthology.orchestra.run.smithi113.stderr:22 Dec 09:56:31 ntpd[23478]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-22T09:56:31.422 INFO:teuthology.orchestra.run.smithi113.stderr:22 Dec 09:56:31 ntpd[23478]: can't open /var/log/ntpstats/peerstats.20231222: Permission denied 2023-12-22T09:56:31.422 INFO:teuthology.orchestra.run.smithi113.stdout:22 Dec 09:56:31 ntpd[23478]: ntpd: time slew +0.002771 s 2023-12-22T09:56:31.422 INFO:teuthology.orchestra.run.smithi113.stdout:ntpd: time slew +0.002771s 2023-12-22T09:56:31.423 INFO:teuthology.orchestra.run.smithi113.stderr:22 Dec 09:56:31 ntpd[23478]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-12-22T09:56:31.423 INFO:teuthology.orchestra.run.smithi113.stderr:22 Dec 09:56:31 ntpd[23478]: can't open /var/log/ntpstats/loopstats.20231222: Permission denied 2023-12-22T09:56:31.541 INFO:teuthology.orchestra.run.smithi045.stdout: remote refid st t when poll reach delay offset jitter 2023-12-22T09:56:31.541 INFO:teuthology.orchestra.run.smithi045.stdout:============================================================================== 2023-12-22T09:56:31.541 INFO:teuthology.orchestra.run.smithi045.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-12-22T09:56:31.541 INFO:teuthology.orchestra.run.smithi045.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-12-22T09:56:31.541 INFO:teuthology.orchestra.run.smithi045.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-12-22T09:56:31.541 INFO:teuthology.orchestra.run.smithi045.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-12-22T09:56:31.575 INFO:teuthology.orchestra.run.smithi113.stdout: remote refid st t when poll reach delay offset jitter 2023-12-22T09:56:31.575 INFO:teuthology.orchestra.run.smithi113.stdout:============================================================================== 2023-12-22T09:56:31.575 INFO:teuthology.orchestra.run.smithi113.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-12-22T09:56:31.575 INFO:teuthology.orchestra.run.smithi113.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-12-22T09:56:31.575 INFO:teuthology.orchestra.run.smithi113.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-12-22T09:56:31.576 INFO:teuthology.orchestra.run.smithi113.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-12-22T09:56:31.577 INFO:teuthology.run_tasks:Running task install... 2023-12-22T09:56:31.586 DEBUG:teuthology.task.install:project ceph 2023-12-22T09:56:31.586 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '4ab91a455dc86ea102fdfa1407dbcce323929634'}} 2023-12-22T09:56:31.586 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '4ab91a455dc86ea102fdfa1407dbcce323929634'} 2023-12-22T09:56:31.586 INFO:teuthology.task.install:Using flavor: default 2023-12-22T09:56:31.591 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-12-22T09:56:31.592 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-12-22T09:56:31.592 DEBUG:teuthology.orchestra.run.smithi045:> sudo apt-key list | grep Ceph 2023-12-22T09:56:31.592 DEBUG:teuthology.orchestra.run.smithi113:> sudo apt-key list | grep Ceph 2023-12-22T09:56:31.821 INFO:teuthology.orchestra.run.smithi113.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-12-22T09:56:31.841 INFO:teuthology.orchestra.run.smithi045.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-12-22T09:56:31.963 INFO:teuthology.orchestra.run.smithi113.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-12-22T09:56:31.963 INFO:teuthology.orchestra.run.smithi113.stdout:uid [ unknown] Ceph.com (release key) 2023-12-22T09:56:31.965 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-12-22T09:56:31.965 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2023-12-22T09:56:31.965 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=4ab91a455dc86ea102fdfa1407dbcce323929634 2023-12-22T09:56:31.988 INFO:teuthology.orchestra.run.smithi045.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-12-22T09:56:31.989 INFO:teuthology.orchestra.run.smithi045.stdout:uid [ unknown] Ceph.com (release key) 2023-12-22T09:56:31.990 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-12-22T09:56:31.990 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2023-12-22T09:56:31.990 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=4ab91a455dc86ea102fdfa1407dbcce323929634 2023-12-22T09:56:32.116 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-pacific/4ab91a455dc86ea102fdfa1407dbcce323929634/ubuntu/focal/flavors/default/ 2023-12-22T09:56:32.116 INFO:teuthology.task.install.deb:Package version is 16.2.14-395-g4ab91a45-1focal 2023-12-22T09:56:32.199 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-pacific/4ab91a455dc86ea102fdfa1407dbcce323929634/ubuntu/focal/flavors/default/ 2023-12-22T09:56:32.199 INFO:teuthology.task.install.deb:Package version is 16.2.14-395-g4ab91a45-1focal 2023-12-22T09:56:32.233 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-22T09:56:32.233 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-12-22T09:56:32.272 DEBUG:teuthology.orchestra.run.smithi113:> sudo apt-get update 2023-12-22T09:56:32.366 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-22T09:56:32.366 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-12-22T09:56:32.405 DEBUG:teuthology.orchestra.run.smithi045:> sudo apt-get update 2023-12-22T09:56:32.557 INFO:teuthology.orchestra.run.smithi113.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-12-22T09:56:32.557 INFO:teuthology.orchestra.run.smithi113.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-12-22T09:56:32.557 INFO:teuthology.orchestra.run.smithi113.stdout:Hit:3 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-12-22T09:56:32.564 INFO:teuthology.orchestra.run.smithi113.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-12-22T09:56:32.646 INFO:teuthology.orchestra.run.smithi113.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-pacific/4ab91a455dc86ea102fdfa1407dbcce323929634/ubuntu/focal/flavors/default focal InRelease 2023-12-22T09:56:32.669 INFO:teuthology.orchestra.run.smithi113.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-pacific/4ab91a455dc86ea102fdfa1407dbcce323929634/ubuntu/focal/flavors/default focal Release [7,680 B] 2023-12-22T09:56:32.683 INFO:teuthology.orchestra.run.smithi045.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-12-22T09:56:32.683 INFO:teuthology.orchestra.run.smithi045.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-12-22T09:56:32.693 INFO:teuthology.orchestra.run.smithi113.stdout:Ign:7 https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-pacific/4ab91a455dc86ea102fdfa1407dbcce323929634/ubuntu/focal/flavors/default focal Release.gpg 2023-12-22T09:56:32.693 INFO:teuthology.orchestra.run.smithi045.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-12-22T09:56:32.724 INFO:teuthology.orchestra.run.smithi113.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-pacific/4ab91a455dc86ea102fdfa1407dbcce323929634/ubuntu/focal/flavors/default focal/main i386 Packages [3,099 B] 2023-12-22T09:56:32.784 INFO:teuthology.orchestra.run.smithi113.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-pacific/4ab91a455dc86ea102fdfa1407dbcce323929634/ubuntu/focal/flavors/default focal/main amd64 Packages [17.3 kB] 2023-12-22T09:56:32.791 INFO:teuthology.orchestra.run.smithi045.stdout:Hit:4 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-12-22T09:56:32.799 INFO:teuthology.orchestra.run.smithi045.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-pacific/4ab91a455dc86ea102fdfa1407dbcce323929634/ubuntu/focal/flavors/default focal InRelease 2023-12-22T09:56:32.836 INFO:teuthology.orchestra.run.smithi045.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-pacific/4ab91a455dc86ea102fdfa1407dbcce323929634/ubuntu/focal/flavors/default focal Release [7,680 B] 2023-12-22T09:56:32.876 INFO:teuthology.orchestra.run.smithi045.stdout:Ign:7 https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-pacific/4ab91a455dc86ea102fdfa1407dbcce323929634/ubuntu/focal/flavors/default focal Release.gpg 2023-12-22T09:56:32.913 INFO:teuthology.orchestra.run.smithi045.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-pacific/4ab91a455dc86ea102fdfa1407dbcce323929634/ubuntu/focal/flavors/default focal/main i386 Packages [3,099 B] 2023-12-22T09:56:32.972 INFO:teuthology.orchestra.run.smithi045.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-pacific/4ab91a455dc86ea102fdfa1407dbcce323929634/ubuntu/focal/flavors/default focal/main amd64 Packages [17.3 kB] 2023-12-22T09:56:33.972 INFO:teuthology.orchestra.run.smithi113.stdout:Fetched 28.0 kB in 1s (20.6 kB/s) 2023-12-22T09:56:34.133 INFO:teuthology.orchestra.run.smithi045.stdout:Fetched 28.0 kB in 1s (20.2 kB/s) 2023-12-22T09:56:35.206 INFO:teuthology.orchestra.run.smithi113.stdout:Reading package lists... 2023-12-22T09:56:35.244 DEBUG:teuthology.orchestra.run.smithi113:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=16.2.14-395-g4ab91a45-1focal cephadm=16.2.14-395-g4ab91a45-1focal ceph-mds=16.2.14-395-g4ab91a45-1focal ceph-mgr=16.2.14-395-g4ab91a45-1focal ceph-common=16.2.14-395-g4ab91a45-1focal ceph-fuse=16.2.14-395-g4ab91a45-1focal ceph-test=16.2.14-395-g4ab91a45-1focal radosgw=16.2.14-395-g4ab91a45-1focal python3-rados=16.2.14-395-g4ab91a45-1focal python3-rgw=16.2.14-395-g4ab91a45-1focal python3-cephfs=16.2.14-395-g4ab91a45-1focal python3-rbd=16.2.14-395-g4ab91a45-1focal libcephfs2=16.2.14-395-g4ab91a45-1focal libcephfs-dev=16.2.14-395-g4ab91a45-1focal librados2=16.2.14-395-g4ab91a45-1focal librbd1=16.2.14-395-g4ab91a45-1focal rbd-fuse=16.2.14-395-g4ab91a45-1focal python3-cephfs=16.2.14-395-g4ab91a45-1focal cephfs-shell=16.2.14-395-g4ab91a45-1focal cephfs-top=16.2.14-395-g4ab91a45-1focal cephfs-mirror=16.2.14-395-g4ab91a45-1focal 2023-12-22T09:56:35.366 INFO:teuthology.orchestra.run.smithi113.stdout:Reading package lists... 2023-12-22T09:56:35.568 INFO:teuthology.orchestra.run.smithi113.stdout:Building dependency tree... 2023-12-22T09:56:35.569 INFO:teuthology.orchestra.run.smithi113.stdout:Reading state information... 2023-12-22T09:56:35.578 INFO:teuthology.orchestra.run.smithi045.stdout:Reading package lists... 2023-12-22T09:56:35.617 DEBUG:teuthology.orchestra.run.smithi045:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=16.2.14-395-g4ab91a45-1focal cephadm=16.2.14-395-g4ab91a45-1focal ceph-mds=16.2.14-395-g4ab91a45-1focal ceph-mgr=16.2.14-395-g4ab91a45-1focal ceph-common=16.2.14-395-g4ab91a45-1focal ceph-fuse=16.2.14-395-g4ab91a45-1focal ceph-test=16.2.14-395-g4ab91a45-1focal radosgw=16.2.14-395-g4ab91a45-1focal python3-rados=16.2.14-395-g4ab91a45-1focal python3-rgw=16.2.14-395-g4ab91a45-1focal python3-cephfs=16.2.14-395-g4ab91a45-1focal python3-rbd=16.2.14-395-g4ab91a45-1focal libcephfs2=16.2.14-395-g4ab91a45-1focal libcephfs-dev=16.2.14-395-g4ab91a45-1focal librados2=16.2.14-395-g4ab91a45-1focal librbd1=16.2.14-395-g4ab91a45-1focal rbd-fuse=16.2.14-395-g4ab91a45-1focal python3-cephfs=16.2.14-395-g4ab91a45-1focal cephfs-shell=16.2.14-395-g4ab91a45-1focal cephfs-top=16.2.14-395-g4ab91a45-1focal cephfs-mirror=16.2.14-395-g4ab91a45-1focal 2023-12-22T09:56:35.745 INFO:teuthology.orchestra.run.smithi045.stdout:Reading package lists... 2023-12-22T09:56:35.751 INFO:teuthology.orchestra.run.smithi113.stdout:The following packages were automatically installed and are no longer required: 2023-12-22T09:56:35.752 INFO:teuthology.orchestra.run.smithi113.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-12-22T09:56:35.752 INFO:teuthology.orchestra.run.smithi113.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-22T09:56:35.752 INFO:teuthology.orchestra.run.smithi113.stdout:The following additional packages will be installed: 2023-12-22T09:56:35.753 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-12-22T09:56:35.753 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq libjaeger 2023-12-22T09:56:35.754 INFO:teuthology.orchestra.run.smithi113.stdout: libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 libleveldb1d 2023-12-22T09:56:35.754 INFO:teuthology.orchestra.run.smithi113.stdout: liblttng-ust0 liblua5.3-0 liboath0 libonig5 librabbitmq4 libradosstriper1 2023-12-22T09:56:35.754 INFO:teuthology.orchestra.run.smithi113.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph nvme-cli python-pastedeploy-tpl 2023-12-22T09:56:35.754 INFO:teuthology.orchestra.run.smithi113.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2023-12-22T09:56:35.754 INFO:teuthology.orchestra.run.smithi113.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common 2023-12-22T09:56:35.754 INFO:teuthology.orchestra.run.smithi113.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-cryptography 2023-12-22T09:56:35.754 INFO:teuthology.orchestra.run.smithi113.stdout: python3-decorator python3-google-auth python3-html5lib python3-jinja2 2023-12-22T09:56:35.754 INFO:teuthology.orchestra.run.smithi113.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2023-12-22T09:56:35.754 INFO:teuthology.orchestra.run.smithi113.stdout: python3-mako python3-markupsafe python3-oauthlib python3-openssl 2023-12-22T09:56:35.754 INFO:teuthology.orchestra.run.smithi113.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-12-22T09:56:35.754 INFO:teuthology.orchestra.run.smithi113.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-12-22T09:56:35.754 INFO:teuthology.orchestra.run.smithi113.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-12-22T09:56:35.755 INFO:teuthology.orchestra.run.smithi113.stdout: python3-pytest python3-repoze.lru python3-requests-oauthlib python3-routes 2023-12-22T09:56:35.755 INFO:teuthology.orchestra.run.smithi113.stdout: python3-rsa python3-scipy python3-simplegeneric python3-simplejson 2023-12-22T09:56:35.755 INFO:teuthology.orchestra.run.smithi113.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-12-22T09:56:35.755 INFO:teuthology.orchestra.run.smithi113.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-12-22T09:56:35.755 INFO:teuthology.orchestra.run.smithi113.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug socat 2023-12-22T09:56:35.755 INFO:teuthology.orchestra.run.smithi113.stdout: xmlstarlet 2023-12-22T09:56:35.755 INFO:teuthology.orchestra.run.smithi113.stdout:Suggested packages: 2023-12-22T09:56:35.755 INFO:teuthology.orchestra.run.smithi113.stdout: python3-influxdb python-attr-doc python-blinker-doc python-cryptography-doc 2023-12-22T09:56:35.755 INFO:teuthology.orchestra.run.smithi113.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-12-22T09:56:35.756 INFO:teuthology.orchestra.run.smithi113.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-12-22T09:56:35.756 INFO:teuthology.orchestra.run.smithi113.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-12-22T09:56:35.756 INFO:teuthology.orchestra.run.smithi113.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-12-22T09:56:35.756 INFO:teuthology.orchestra.run.smithi113.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-12-22T09:56:35.756 INFO:teuthology.orchestra.run.smithi113.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-12-22T09:56:35.756 INFO:teuthology.orchestra.run.smithi113.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-12-22T09:56:35.756 INFO:teuthology.orchestra.run.smithi113.stdout:Recommended packages: 2023-12-22T09:56:35.756 INFO:teuthology.orchestra.run.smithi113.stdout: btrfs-tools 2023-12-22T09:56:35.947 INFO:teuthology.orchestra.run.smithi113.stdout:The following NEW packages will be installed: 2023-12-22T09:56:35.948 INFO:teuthology.orchestra.run.smithi113.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-12-22T09:56:35.948 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-12-22T09:56:35.948 INFO:teuthology.orchestra.run.smithi113.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test cephadm cephfs-mirror 2023-12-22T09:56:35.949 INFO:teuthology.orchestra.run.smithi113.stdout: cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 libjaeger libjq1 2023-12-22T09:56:35.949 INFO:teuthology.orchestra.run.smithi113.stdout: libjs-sphinxdoc libjs-underscore liblbfgsb0 libleveldb1d liblttng-ust0 2023-12-22T09:56:35.949 INFO:teuthology.orchestra.run.smithi113.stdout: liblua5.3-0 liboath0 libonig5 librabbitmq4 libradosstriper1 librdkafka1 2023-12-22T09:56:35.949 INFO:teuthology.orchestra.run.smithi113.stdout: librgw2 libsqlite3-mod-ceph nvme-cli python-pastedeploy-tpl 2023-12-22T09:56:35.949 INFO:teuthology.orchestra.run.smithi113.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2023-12-22T09:56:35.949 INFO:teuthology.orchestra.run.smithi113.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-12-22T09:56:35.949 INFO:teuthology.orchestra.run.smithi113.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-cryptography 2023-12-22T09:56:35.949 INFO:teuthology.orchestra.run.smithi113.stdout: python3-decorator python3-google-auth python3-html5lib python3-jinja2 2023-12-22T09:56:35.950 INFO:teuthology.orchestra.run.smithi113.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2023-12-22T09:56:35.950 INFO:teuthology.orchestra.run.smithi113.stdout: python3-mako python3-markupsafe python3-oauthlib python3-openssl 2023-12-22T09:56:35.950 INFO:teuthology.orchestra.run.smithi113.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-12-22T09:56:35.950 INFO:teuthology.orchestra.run.smithi113.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-12-22T09:56:35.950 INFO:teuthology.orchestra.run.smithi113.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-12-22T09:56:35.950 INFO:teuthology.orchestra.run.smithi113.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2023-12-22T09:56:35.950 INFO:teuthology.orchestra.run.smithi113.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-12-22T09:56:35.950 INFO:teuthology.orchestra.run.smithi113.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-12-22T09:56:35.950 INFO:teuthology.orchestra.run.smithi113.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-12-22T09:56:35.950 INFO:teuthology.orchestra.run.smithi113.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-12-22T09:56:35.951 INFO:teuthology.orchestra.run.smithi113.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug radosgw 2023-12-22T09:56:35.951 INFO:teuthology.orchestra.run.smithi113.stdout: rbd-fuse socat xmlstarlet 2023-12-22T09:56:35.951 INFO:teuthology.orchestra.run.smithi113.stdout:The following packages will be upgraded: 2023-12-22T09:56:35.951 INFO:teuthology.orchestra.run.smithi113.stdout: librados2 librbd1 2023-12-22T09:56:35.952 INFO:teuthology.orchestra.run.smithi045.stdout:Building dependency tree... 2023-12-22T09:56:35.952 INFO:teuthology.orchestra.run.smithi045.stdout:Reading state information... 2023-12-22T09:56:36.044 INFO:teuthology.orchestra.run.smithi113.stdout:2 upgraded, 104 newly installed, 0 to remove and 262 not upgraded. 2023-12-22T09:56:36.044 INFO:teuthology.orchestra.run.smithi113.stdout:Need to get 174 MB of archives. 2023-12-22T09:56:36.044 INFO:teuthology.orchestra.run.smithi113.stdout:After this operation, 806 MB of additional disk space will be used. 2023-12-22T09:56:36.044 INFO:teuthology.orchestra.run.smithi113.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2023-12-22T09:56:36.063 INFO:teuthology.orchestra.run.smithi113.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-12-22T09:56:36.072 INFO:teuthology.orchestra.run.smithi113.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2023-12-22T09:56:36.099 INFO:teuthology.orchestra.run.smithi113.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-12-22T09:56:36.128 INFO:teuthology.orchestra.run.smithi113.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-12-22T09:56:36.129 INFO:teuthology.orchestra.run.smithi113.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-12-22T09:56:36.139 INFO:teuthology.orchestra.run.smithi113.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-12-22T09:56:36.141 INFO:teuthology.orchestra.run.smithi113.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-12-22T09:56:36.154 INFO:teuthology.orchestra.run.smithi045.stdout:The following packages were automatically installed and are no longer required: 2023-12-22T09:56:36.155 INFO:teuthology.orchestra.run.smithi045.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-12-22T09:56:36.155 INFO:teuthology.orchestra.run.smithi045.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-22T09:56:36.155 INFO:teuthology.orchestra.run.smithi045.stdout:The following additional packages will be installed: 2023-12-22T09:56:36.156 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-12-22T09:56:36.157 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq libjaeger 2023-12-22T09:56:36.157 INFO:teuthology.orchestra.run.smithi045.stdout: libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 libleveldb1d 2023-12-22T09:56:36.157 INFO:teuthology.orchestra.run.smithi045.stdout: liblttng-ust0 liblua5.3-0 liboath0 libonig5 librabbitmq4 libradosstriper1 2023-12-22T09:56:36.157 INFO:teuthology.orchestra.run.smithi045.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph nvme-cli python-pastedeploy-tpl 2023-12-22T09:56:36.157 INFO:teuthology.orchestra.run.smithi045.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2023-12-22T09:56:36.157 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common 2023-12-22T09:56:36.157 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-cryptography 2023-12-22T09:56:36.157 INFO:teuthology.orchestra.run.smithi045.stdout: python3-decorator python3-google-auth python3-html5lib python3-jinja2 2023-12-22T09:56:36.157 INFO:teuthology.orchestra.run.smithi045.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2023-12-22T09:56:36.157 INFO:teuthology.orchestra.run.smithi045.stdout: python3-mako python3-markupsafe python3-oauthlib python3-openssl 2023-12-22T09:56:36.157 INFO:teuthology.orchestra.run.smithi045.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-12-22T09:56:36.158 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-12-22T09:56:36.158 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-12-22T09:56:36.158 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pytest python3-repoze.lru python3-requests-oauthlib python3-routes 2023-12-22T09:56:36.158 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rsa python3-scipy python3-simplegeneric python3-simplejson 2023-12-22T09:56:36.158 INFO:teuthology.orchestra.run.smithi045.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-12-22T09:56:36.158 INFO:teuthology.orchestra.run.smithi045.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-12-22T09:56:36.158 INFO:teuthology.orchestra.run.smithi045.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug socat 2023-12-22T09:56:36.158 INFO:teuthology.orchestra.run.smithi045.stdout: xmlstarlet 2023-12-22T09:56:36.158 INFO:teuthology.orchestra.run.smithi045.stdout:Suggested packages: 2023-12-22T09:56:36.159 INFO:teuthology.orchestra.run.smithi045.stdout: python3-influxdb python-attr-doc python-blinker-doc python-cryptography-doc 2023-12-22T09:56:36.159 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-12-22T09:56:36.159 INFO:teuthology.orchestra.run.smithi045.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-12-22T09:56:36.159 INFO:teuthology.orchestra.run.smithi045.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-12-22T09:56:36.159 INFO:teuthology.orchestra.run.smithi045.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-12-22T09:56:36.159 INFO:teuthology.orchestra.run.smithi045.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-12-22T09:56:36.159 INFO:teuthology.orchestra.run.smithi045.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-12-22T09:56:36.159 INFO:teuthology.orchestra.run.smithi045.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-12-22T09:56:36.159 INFO:teuthology.orchestra.run.smithi045.stdout:Recommended packages: 2023-12-22T09:56:36.159 INFO:teuthology.orchestra.run.smithi045.stdout: btrfs-tools 2023-12-22T09:56:36.160 INFO:teuthology.orchestra.run.smithi113.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 libleveldb1d amd64 1.22-3ubuntu2 [139 kB] 2023-12-22T09:56:36.160 INFO:teuthology.orchestra.run.smithi113.stdout:Get:10 https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-pacific/4ab91a455dc86ea102fdfa1407dbcce323929634/ubuntu/focal/flavors/default focal/main amd64 libjaeger amd64 16.2.14-395-g4ab91a45-1focal [3,956 B] 2023-12-22T09:56:36.163 INFO:teuthology.orchestra.run.smithi113.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-12-22T09:56:36.164 INFO:teuthology.orchestra.run.smithi113.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.2 [211 kB] 2023-12-22T09:56:36.168 INFO:teuthology.orchestra.run.smithi113.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-12-22T09:56:36.169 INFO:teuthology.orchestra.run.smithi113.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-12-22T09:56:36.170 INFO:teuthology.orchestra.run.smithi113.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-12-22T09:56:36.173 INFO:teuthology.orchestra.run.smithi113.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-12-22T09:56:36.173 INFO:teuthology.orchestra.run.smithi113.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-12-22T09:56:36.174 INFO:teuthology.orchestra.run.smithi113.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-12-22T09:56:36.181 INFO:teuthology.orchestra.run.smithi113.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-12-22T09:56:36.182 INFO:teuthology.orchestra.run.smithi113.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-12-22T09:56:36.198 INFO:teuthology.orchestra.run.smithi113.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-12-22T09:56:36.199 INFO:teuthology.orchestra.run.smithi113.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-12-22T09:56:36.201 INFO:teuthology.orchestra.run.smithi113.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-12-22T09:56:36.203 INFO:teuthology.orchestra.run.smithi113.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-12-22T09:56:36.205 INFO:teuthology.orchestra.run.smithi113.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-12-22T09:56:36.207 INFO:teuthology.orchestra.run.smithi113.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-12-22T09:56:36.207 INFO:teuthology.orchestra.run.smithi113.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-12-22T09:56:36.213 INFO:teuthology.orchestra.run.smithi113.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-12-22T09:56:36.214 INFO:teuthology.orchestra.run.smithi113.stdout:Get:29 https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-pacific/4ab91a455dc86ea102fdfa1407dbcce323929634/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 16.2.14-395-g4ab91a45-1focal [3,384 kB] 2023-12-22T09:56:36.214 INFO:teuthology.orchestra.run.smithi113.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-12-22T09:56:36.215 INFO:teuthology.orchestra.run.smithi113.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-12-22T09:56:36.232 INFO:teuthology.orchestra.run.smithi113.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-12-22T09:56:36.234 INFO:teuthology.orchestra.run.smithi113.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2023-12-22T09:56:36.238 INFO:teuthology.orchestra.run.smithi113.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-12-22T09:56:36.240 INFO:teuthology.orchestra.run.smithi113.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-12-22T09:56:36.240 INFO:teuthology.orchestra.run.smithi113.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-12-22T09:56:36.242 INFO:teuthology.orchestra.run.smithi113.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-12-22T09:56:36.244 INFO:teuthology.orchestra.run.smithi113.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-12-22T09:56:36.246 INFO:teuthology.orchestra.run.smithi113.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-12-22T09:56:36.249 INFO:teuthology.orchestra.run.smithi113.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-12-22T09:56:36.249 INFO:teuthology.orchestra.run.smithi113.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-12-22T09:56:36.343 INFO:teuthology.orchestra.run.smithi113.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-12-22T09:56:36.361 INFO:teuthology.orchestra.run.smithi045.stdout:The following NEW packages will be installed: 2023-12-22T09:56:36.361 INFO:teuthology.orchestra.run.smithi045.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-12-22T09:56:36.361 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-12-22T09:56:36.362 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test cephadm cephfs-mirror 2023-12-22T09:56:36.363 INFO:teuthology.orchestra.run.smithi045.stdout: cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 libjaeger libjq1 2023-12-22T09:56:36.363 INFO:teuthology.orchestra.run.smithi045.stdout: libjs-sphinxdoc libjs-underscore liblbfgsb0 libleveldb1d liblttng-ust0 2023-12-22T09:56:36.363 INFO:teuthology.orchestra.run.smithi045.stdout: liblua5.3-0 liboath0 libonig5 librabbitmq4 libradosstriper1 librdkafka1 2023-12-22T09:56:36.363 INFO:teuthology.orchestra.run.smithi045.stdout: librgw2 libsqlite3-mod-ceph nvme-cli python-pastedeploy-tpl 2023-12-22T09:56:36.363 INFO:teuthology.orchestra.run.smithi045.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2023-12-22T09:56:36.363 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-12-22T09:56:36.363 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-cryptography 2023-12-22T09:56:36.363 INFO:teuthology.orchestra.run.smithi045.stdout: python3-decorator python3-google-auth python3-html5lib python3-jinja2 2023-12-22T09:56:36.363 INFO:teuthology.orchestra.run.smithi045.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2023-12-22T09:56:36.364 INFO:teuthology.orchestra.run.smithi045.stdout: python3-mako python3-markupsafe python3-oauthlib python3-openssl 2023-12-22T09:56:36.364 INFO:teuthology.orchestra.run.smithi045.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-12-22T09:56:36.364 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-12-22T09:56:36.364 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-12-22T09:56:36.364 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2023-12-22T09:56:36.364 INFO:teuthology.orchestra.run.smithi045.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-12-22T09:56:36.364 INFO:teuthology.orchestra.run.smithi045.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-12-22T09:56:36.364 INFO:teuthology.orchestra.run.smithi045.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-12-22T09:56:36.364 INFO:teuthology.orchestra.run.smithi045.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-12-22T09:56:36.364 INFO:teuthology.orchestra.run.smithi045.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug radosgw 2023-12-22T09:56:36.364 INFO:teuthology.orchestra.run.smithi045.stdout: rbd-fuse socat xmlstarlet 2023-12-22T09:56:36.365 INFO:teuthology.orchestra.run.smithi113.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-12-22T09:56:36.365 INFO:teuthology.orchestra.run.smithi113.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-12-22T09:56:36.366 INFO:teuthology.orchestra.run.smithi045.stdout:The following packages will be upgraded: 2023-12-22T09:56:36.366 INFO:teuthology.orchestra.run.smithi045.stdout: librados2 librbd1 2023-12-22T09:56:36.378 INFO:teuthology.orchestra.run.smithi113.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-12-22T09:56:36.378 INFO:teuthology.orchestra.run.smithi113.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-12-22T09:56:36.379 INFO:teuthology.orchestra.run.smithi113.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-12-22T09:56:36.380 INFO:teuthology.orchestra.run.smithi113.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-12-22T09:56:36.380 INFO:teuthology.orchestra.run.smithi113.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-12-22T09:56:36.381 INFO:teuthology.orchestra.run.smithi113.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-12-22T09:56:36.381 INFO:teuthology.orchestra.run.smithi113.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-12-22T09:56:36.394 INFO:teuthology.orchestra.run.smithi113.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-12-22T09:56:36.395 INFO:teuthology.orchestra.run.smithi113.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-12-22T09:56:36.399 INFO:teuthology.orchestra.run.smithi113.stdout:Get:54 https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-pacific/4ab91a455dc86ea102fdfa1407dbcce323929634/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 16.2.14-395-g4ab91a45-1focal [3,388 kB] 2023-12-22T09:56:36.411 INFO:teuthology.orchestra.run.smithi113.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-12-22T09:56:36.415 INFO:teuthology.orchestra.run.smithi113.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-12-22T09:56:36.418 INFO:teuthology.orchestra.run.smithi113.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-12-22T09:56:36.420 INFO:teuthology.orchestra.run.smithi113.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-12-22T09:56:36.421 INFO:teuthology.orchestra.run.smithi113.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-12-22T09:56:36.425 INFO:teuthology.orchestra.run.smithi113.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-12-22T09:56:36.428 INFO:teuthology.orchestra.run.smithi113.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2023-12-22T09:56:36.429 INFO:teuthology.orchestra.run.smithi113.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-12-22T09:56:36.432 INFO:teuthology.orchestra.run.smithi113.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-12-22T09:56:36.432 INFO:teuthology.orchestra.run.smithi113.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-12-22T09:56:36.445 INFO:teuthology.orchestra.run.smithi113.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-12-22T09:56:36.446 INFO:teuthology.orchestra.run.smithi113.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-12-22T09:56:36.449 INFO:teuthology.orchestra.run.smithi113.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-12-22T09:56:36.455 INFO:teuthology.orchestra.run.smithi045.stdout:2 upgraded, 104 newly installed, 0 to remove and 262 not upgraded. 2023-12-22T09:56:36.455 INFO:teuthology.orchestra.run.smithi045.stdout:Need to get 174 MB of archives. 2023-12-22T09:56:36.455 INFO:teuthology.orchestra.run.smithi045.stdout:After this operation, 806 MB of additional disk space will be used. 2023-12-22T09:56:36.456 INFO:teuthology.orchestra.run.smithi045.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2023-12-22T09:56:36.467 INFO:teuthology.orchestra.run.smithi113.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-12-22T09:56:36.468 INFO:teuthology.orchestra.run.smithi113.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-12-22T09:56:36.468 INFO:teuthology.orchestra.run.smithi113.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-12-22T09:56:36.468 INFO:teuthology.orchestra.run.smithi113.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-12-22T09:56:36.470 INFO:teuthology.orchestra.run.smithi113.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-12-22T09:56:36.471 INFO:teuthology.orchestra.run.smithi113.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-12-22T09:56:36.471 INFO:teuthology.orchestra.run.smithi113.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-12-22T09:56:36.475 INFO:teuthology.orchestra.run.smithi045.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-12-22T09:56:36.479 INFO:teuthology.orchestra.run.smithi113.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-12-22T09:56:36.484 INFO:teuthology.orchestra.run.smithi045.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2023-12-22T09:56:36.510 INFO:teuthology.orchestra.run.smithi113.stdout:Get:76 https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-pacific/4ab91a455dc86ea102fdfa1407dbcce323929634/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 16.2.14-395-g4ab91a45-1focal [730 kB] 2023-12-22T09:56:36.511 INFO:teuthology.orchestra.run.smithi045.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-12-22T09:56:36.532 INFO:teuthology.orchestra.run.smithi113.stdout:Get:77 https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-pacific/4ab91a455dc86ea102fdfa1407dbcce323929634/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 16.2.14-395-g4ab91a45-1focal [414 kB] 2023-12-22T09:56:36.539 INFO:teuthology.orchestra.run.smithi045.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-12-22T09:56:36.540 INFO:teuthology.orchestra.run.smithi045.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-12-22T09:56:36.545 INFO:teuthology.orchestra.run.smithi113.stdout:Get:78 https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-pacific/4ab91a455dc86ea102fdfa1407dbcce323929634/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 16.2.14-395-g4ab91a45-1focal [22.2 kB] 2023-12-22T09:56:36.550 INFO:teuthology.orchestra.run.smithi045.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-12-22T09:56:36.552 INFO:teuthology.orchestra.run.smithi045.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-12-22T09:56:36.570 INFO:teuthology.orchestra.run.smithi045.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 libleveldb1d amd64 1.22-3ubuntu2 [139 kB] 2023-12-22T09:56:36.573 INFO:teuthology.orchestra.run.smithi045.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-12-22T09:56:36.574 INFO:teuthology.orchestra.run.smithi045.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.2 [211 kB] 2023-12-22T09:56:36.576 INFO:teuthology.orchestra.run.smithi045.stdout:Get:12 https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-pacific/4ab91a455dc86ea102fdfa1407dbcce323929634/ubuntu/focal/flavors/default focal/main amd64 libjaeger amd64 16.2.14-395-g4ab91a45-1focal [3,956 B] 2023-12-22T09:56:36.576 INFO:teuthology.orchestra.run.smithi113.stdout:Get:79 https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-pacific/4ab91a455dc86ea102fdfa1407dbcce323929634/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 16.2.14-395-g4ab91a45-1focal [212 kB] 2023-12-22T09:56:36.579 INFO:teuthology.orchestra.run.smithi045.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-12-22T09:56:36.580 INFO:teuthology.orchestra.run.smithi045.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-12-22T09:56:36.580 INFO:teuthology.orchestra.run.smithi045.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-12-22T09:56:36.583 INFO:teuthology.orchestra.run.smithi045.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-12-22T09:56:36.584 INFO:teuthology.orchestra.run.smithi045.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-12-22T09:56:36.585 INFO:teuthology.orchestra.run.smithi045.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-12-22T09:56:36.587 INFO:teuthology.orchestra.run.smithi113.stdout:Get:80 https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-pacific/4ab91a455dc86ea102fdfa1407dbcce323929634/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 16.2.14-395-g4ab91a45-1focal [38.4 kB] 2023-12-22T09:56:36.591 INFO:teuthology.orchestra.run.smithi045.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-12-22T09:56:36.603 INFO:teuthology.orchestra.run.smithi045.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-12-22T09:56:36.603 INFO:teuthology.orchestra.run.smithi045.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-12-22T09:56:36.604 INFO:teuthology.orchestra.run.smithi045.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-12-22T09:56:36.607 INFO:teuthology.orchestra.run.smithi045.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-12-22T09:56:36.608 INFO:teuthology.orchestra.run.smithi045.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-12-22T09:56:36.610 INFO:teuthology.orchestra.run.smithi113.stdout:Get:81 https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-pacific/4ab91a455dc86ea102fdfa1407dbcce323929634/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 16.2.14-395-g4ab91a45-1focal [387 kB] 2023-12-22T09:56:36.611 INFO:teuthology.orchestra.run.smithi045.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-12-22T09:56:36.613 INFO:teuthology.orchestra.run.smithi045.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-12-22T09:56:36.614 INFO:teuthology.orchestra.run.smithi045.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-12-22T09:56:36.619 INFO:teuthology.orchestra.run.smithi045.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-12-22T09:56:36.620 INFO:teuthology.orchestra.run.smithi045.stdout:Get:29 https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-pacific/4ab91a455dc86ea102fdfa1407dbcce323929634/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 16.2.14-395-g4ab91a45-1focal [3,384 kB] 2023-12-22T09:56:36.625 INFO:teuthology.orchestra.run.smithi045.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-12-22T09:56:36.625 INFO:teuthology.orchestra.run.smithi113.stdout:Get:82 https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-pacific/4ab91a455dc86ea102fdfa1407dbcce323929634/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 16.2.14-395-g4ab91a45-1focal [3,708 kB] 2023-12-22T09:56:36.626 INFO:teuthology.orchestra.run.smithi045.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-12-22T09:56:36.626 INFO:teuthology.orchestra.run.smithi045.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-12-22T09:56:36.643 INFO:teuthology.orchestra.run.smithi045.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2023-12-22T09:56:36.649 INFO:teuthology.orchestra.run.smithi045.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-12-22T09:56:36.652 INFO:teuthology.orchestra.run.smithi045.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-12-22T09:56:36.652 INFO:teuthology.orchestra.run.smithi045.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-12-22T09:56:36.653 INFO:teuthology.orchestra.run.smithi045.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-12-22T09:56:36.657 INFO:teuthology.orchestra.run.smithi045.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-12-22T09:56:36.657 INFO:teuthology.orchestra.run.smithi045.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-12-22T09:56:36.658 INFO:teuthology.orchestra.run.smithi045.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-12-22T09:56:36.659 INFO:teuthology.orchestra.run.smithi045.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-12-22T09:56:36.743 INFO:teuthology.orchestra.run.smithi113.stdout:Get:83 https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-pacific/4ab91a455dc86ea102fdfa1407dbcce323929634/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 16.2.14-395-g4ab91a45-1focal [116 kB] 2023-12-22T09:56:36.746 INFO:teuthology.orchestra.run.smithi113.stdout:Get:84 https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-pacific/4ab91a455dc86ea102fdfa1407dbcce323929634/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 16.2.14-395-g4ab91a45-1focal [448 kB] 2023-12-22T09:56:36.753 INFO:teuthology.orchestra.run.smithi045.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-12-22T09:56:36.760 INFO:teuthology.orchestra.run.smithi113.stdout:Get:85 https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-pacific/4ab91a455dc86ea102fdfa1407dbcce323929634/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 16.2.14-395-g4ab91a45-1focal [22.7 MB] 2023-12-22T09:56:36.772 INFO:teuthology.orchestra.run.smithi045.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-12-22T09:56:36.780 INFO:teuthology.orchestra.run.smithi045.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-12-22T09:56:36.788 INFO:teuthology.orchestra.run.smithi045.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-12-22T09:56:36.789 INFO:teuthology.orchestra.run.smithi045.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-12-22T09:56:36.789 INFO:teuthology.orchestra.run.smithi045.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-12-22T09:56:36.789 INFO:teuthology.orchestra.run.smithi045.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-12-22T09:56:36.790 INFO:teuthology.orchestra.run.smithi045.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-12-22T09:56:36.790 INFO:teuthology.orchestra.run.smithi045.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-12-22T09:56:36.791 INFO:teuthology.orchestra.run.smithi045.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-12-22T09:56:36.805 INFO:teuthology.orchestra.run.smithi045.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-12-22T09:56:36.805 INFO:teuthology.orchestra.run.smithi045.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-12-22T09:56:36.822 INFO:teuthology.orchestra.run.smithi045.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-12-22T09:56:36.827 INFO:teuthology.orchestra.run.smithi045.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-12-22T09:56:36.830 INFO:teuthology.orchestra.run.smithi045.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-12-22T09:56:36.832 INFO:teuthology.orchestra.run.smithi045.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-12-22T09:56:36.833 INFO:teuthology.orchestra.run.smithi045.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-12-22T09:56:36.836 INFO:teuthology.orchestra.run.smithi045.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-12-22T09:56:36.839 INFO:teuthology.orchestra.run.smithi045.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2023-12-22T09:56:36.840 INFO:teuthology.orchestra.run.smithi045.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-12-22T09:56:36.843 INFO:teuthology.orchestra.run.smithi045.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-12-22T09:56:36.843 INFO:teuthology.orchestra.run.smithi045.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-12-22T09:56:36.855 INFO:teuthology.orchestra.run.smithi045.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-12-22T09:56:36.856 INFO:teuthology.orchestra.run.smithi045.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-12-22T09:56:36.858 INFO:teuthology.orchestra.run.smithi045.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-12-22T09:56:36.878 INFO:teuthology.orchestra.run.smithi045.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-12-22T09:56:36.879 INFO:teuthology.orchestra.run.smithi045.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-12-22T09:56:36.879 INFO:teuthology.orchestra.run.smithi045.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-12-22T09:56:36.880 INFO:teuthology.orchestra.run.smithi045.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-12-22T09:56:36.881 INFO:teuthology.orchestra.run.smithi045.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-12-22T09:56:36.882 INFO:teuthology.orchestra.run.smithi045.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-12-22T09:56:36.882 INFO:teuthology.orchestra.run.smithi045.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-12-22T09:56:36.888 INFO:teuthology.orchestra.run.smithi045.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-12-22T09:56:37.732 INFO:teuthology.orchestra.run.smithi113.stdout:Get:86 https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-pacific/4ab91a455dc86ea102fdfa1407dbcce323929634/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 16.2.14-395-g4ab91a45-1focal [5,918 kB] 2023-12-22T09:56:37.734 INFO:teuthology.orchestra.run.smithi045.stdout:Get:75 https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-pacific/4ab91a455dc86ea102fdfa1407dbcce323929634/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 16.2.14-395-g4ab91a45-1focal [3,388 kB] 2023-12-22T09:56:37.971 INFO:teuthology.orchestra.run.smithi113.stdout:Get:87 https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-pacific/4ab91a455dc86ea102fdfa1407dbcce323929634/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 16.2.14-395-g4ab91a45-1focal [204 kB] 2023-12-22T09:56:37.977 INFO:teuthology.orchestra.run.smithi113.stdout:Get:88 https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-pacific/4ab91a455dc86ea102fdfa1407dbcce323929634/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 16.2.14-395-g4ab91a45-1focal [126 kB] 2023-12-22T09:56:37.982 INFO:teuthology.orchestra.run.smithi113.stdout:Get:89 https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-pacific/4ab91a455dc86ea102fdfa1407dbcce323929634/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 16.2.14-395-g4ab91a45-1focal [1,551 kB] 2023-12-22T09:56:38.045 INFO:teuthology.orchestra.run.smithi113.stdout:Get:90 https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-pacific/4ab91a455dc86ea102fdfa1407dbcce323929634/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 16.2.14-395-g4ab91a45-1focal [6,995 kB] 2023-12-22T09:56:38.317 INFO:teuthology.orchestra.run.smithi045.stdout:Get:76 https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-pacific/4ab91a455dc86ea102fdfa1407dbcce323929634/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 16.2.14-395-g4ab91a45-1focal [730 kB] 2023-12-22T09:56:38.336 INFO:teuthology.orchestra.run.smithi113.stdout:Get:91 https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-pacific/4ab91a455dc86ea102fdfa1407dbcce323929634/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 16.2.14-395-g4ab91a45-1focal [26.2 MB] 2023-12-22T09:56:38.417 INFO:teuthology.orchestra.run.smithi045.stdout:Get:77 https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-pacific/4ab91a455dc86ea102fdfa1407dbcce323929634/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 16.2.14-395-g4ab91a45-1focal [414 kB] 2023-12-22T09:56:38.462 INFO:teuthology.orchestra.run.smithi045.stdout:Get:78 https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-pacific/4ab91a455dc86ea102fdfa1407dbcce323929634/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 16.2.14-395-g4ab91a45-1focal [22.2 kB] 2023-12-22T09:56:38.484 INFO:teuthology.orchestra.run.smithi045.stdout:Get:79 https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-pacific/4ab91a455dc86ea102fdfa1407dbcce323929634/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 16.2.14-395-g4ab91a45-1focal [212 kB] 2023-12-22T09:56:38.520 INFO:teuthology.orchestra.run.smithi045.stdout:Get:80 https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-pacific/4ab91a455dc86ea102fdfa1407dbcce323929634/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 16.2.14-395-g4ab91a45-1focal [38.4 kB] 2023-12-22T09:56:38.522 INFO:teuthology.orchestra.run.smithi045.stdout:Get:81 https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-pacific/4ab91a455dc86ea102fdfa1407dbcce323929634/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 16.2.14-395-g4ab91a45-1focal [387 kB] 2023-12-22T09:56:38.587 INFO:teuthology.orchestra.run.smithi045.stdout:Get:82 https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-pacific/4ab91a455dc86ea102fdfa1407dbcce323929634/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 16.2.14-395-g4ab91a45-1focal [3,708 kB] 2023-12-22T09:56:39.045 INFO:teuthology.orchestra.run.smithi045.stdout:Get:83 https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-pacific/4ab91a455dc86ea102fdfa1407dbcce323929634/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 16.2.14-395-g4ab91a45-1focal [116 kB] 2023-12-22T09:56:39.047 INFO:teuthology.orchestra.run.smithi045.stdout:Get:84 https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-pacific/4ab91a455dc86ea102fdfa1407dbcce323929634/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 16.2.14-395-g4ab91a45-1focal [448 kB] 2023-12-22T09:56:39.121 INFO:teuthology.orchestra.run.smithi045.stdout:Get:85 https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-pacific/4ab91a455dc86ea102fdfa1407dbcce323929634/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 16.2.14-395-g4ab91a45-1focal [22.7 MB] 2023-12-22T09:56:39.496 INFO:teuthology.orchestra.run.smithi113.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-pacific/4ab91a455dc86ea102fdfa1407dbcce323929634/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 16.2.14-395-g4ab91a45-1focal [4,052 B] 2023-12-22T09:56:39.496 INFO:teuthology.orchestra.run.smithi113.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-pacific/4ab91a455dc86ea102fdfa1407dbcce323929634/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 16.2.14-395-g4ab91a45-1focal [835 kB] 2023-12-22T09:56:39.526 INFO:teuthology.orchestra.run.smithi113.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-pacific/4ab91a455dc86ea102fdfa1407dbcce323929634/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 16.2.14-395-g4ab91a45-1focal [2,363 kB] 2023-12-22T09:56:39.650 INFO:teuthology.orchestra.run.smithi113.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-pacific/4ab91a455dc86ea102fdfa1407dbcce323929634/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 16.2.14-395-g4ab91a45-1focal [77.4 kB] 2023-12-22T09:56:39.652 INFO:teuthology.orchestra.run.smithi113.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-pacific/4ab91a455dc86ea102fdfa1407dbcce323929634/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 16.2.14-395-g4ab91a45-1focal [100 kB] 2023-12-22T09:56:39.653 INFO:teuthology.orchestra.run.smithi113.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-pacific/4ab91a455dc86ea102fdfa1407dbcce323929634/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 16.2.14-395-g4ab91a45-1focal [2,824 kB] 2023-12-22T09:56:39.789 INFO:teuthology.orchestra.run.smithi113.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-pacific/4ab91a455dc86ea102fdfa1407dbcce323929634/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 16.2.14-395-g4ab91a45-1focal [7,877 kB] 2023-12-22T09:56:40.161 INFO:teuthology.orchestra.run.smithi113.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-pacific/4ab91a455dc86ea102fdfa1407dbcce323929634/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 16.2.14-395-g4ab91a45-1focal [4,168 B] 2023-12-22T09:56:40.161 INFO:teuthology.orchestra.run.smithi113.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-pacific/4ab91a455dc86ea102fdfa1407dbcce323929634/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 16.2.14-395-g4ab91a45-1focal [49.4 MB] 2023-12-22T09:56:41.405 INFO:teuthology.orchestra.run.smithi045.stdout:Get:86 https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-pacific/4ab91a455dc86ea102fdfa1407dbcce323929634/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 16.2.14-395-g4ab91a45-1focal [5,918 kB] 2023-12-22T09:56:41.875 INFO:teuthology.orchestra.run.smithi045.stdout:Get:87 https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-pacific/4ab91a455dc86ea102fdfa1407dbcce323929634/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 16.2.14-395-g4ab91a45-1focal [204 kB] 2023-12-22T09:56:41.879 INFO:teuthology.orchestra.run.smithi045.stdout:Get:88 https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-pacific/4ab91a455dc86ea102fdfa1407dbcce323929634/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 16.2.14-395-g4ab91a45-1focal [126 kB] 2023-12-22T09:56:41.880 INFO:teuthology.orchestra.run.smithi045.stdout:Get:89 https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-pacific/4ab91a455dc86ea102fdfa1407dbcce323929634/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 16.2.14-395-g4ab91a45-1focal [1,551 kB] 2023-12-22T09:56:42.072 INFO:teuthology.orchestra.run.smithi045.stdout:Get:90 https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-pacific/4ab91a455dc86ea102fdfa1407dbcce323929634/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 16.2.14-395-g4ab91a45-1focal [6,995 kB] 2023-12-22T09:56:42.681 INFO:teuthology.orchestra.run.smithi113.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-pacific/4ab91a455dc86ea102fdfa1407dbcce323929634/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 16.2.14-395-g4ab91a45-1focal [237 kB] 2023-12-22T09:56:42.683 INFO:teuthology.orchestra.run.smithi113.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-pacific/4ab91a455dc86ea102fdfa1407dbcce323929634/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 16.2.14-395-g4ab91a45-1focal [17.4 kB] 2023-12-22T09:56:42.684 INFO:teuthology.orchestra.run.smithi113.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-pacific/4ab91a455dc86ea102fdfa1407dbcce323929634/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 16.2.14-395-g4ab91a45-1focal [13.2 kB] 2023-12-22T09:56:42.684 INFO:teuthology.orchestra.run.smithi113.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-pacific/4ab91a455dc86ea102fdfa1407dbcce323929634/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 16.2.14-395-g4ab91a45-1focal [21.5 kB] 2023-12-22T09:56:42.685 INFO:teuthology.orchestra.run.smithi113.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-pacific/4ab91a455dc86ea102fdfa1407dbcce323929634/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 16.2.14-395-g4ab91a45-1focal [11.3 MB] 2023-12-22T09:56:42.775 INFO:teuthology.orchestra.run.smithi045.stdout:Get:91 https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-pacific/4ab91a455dc86ea102fdfa1407dbcce323929634/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 16.2.14-395-g4ab91a45-1focal [26.2 MB] 2023-12-22T09:56:43.228 INFO:teuthology.orchestra.run.smithi113.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-pacific/4ab91a455dc86ea102fdfa1407dbcce323929634/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 16.2.14-395-g4ab91a45-1focal [78.1 kB] 2023-12-22T09:56:43.951 INFO:teuthology.orchestra.run.smithi045.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-pacific/4ab91a455dc86ea102fdfa1407dbcce323929634/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 16.2.14-395-g4ab91a45-1focal [4,052 B] 2023-12-22T09:56:43.951 INFO:teuthology.orchestra.run.smithi045.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-pacific/4ab91a455dc86ea102fdfa1407dbcce323929634/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 16.2.14-395-g4ab91a45-1focal [835 kB] 2023-12-22T09:56:43.975 INFO:teuthology.orchestra.run.smithi045.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-pacific/4ab91a455dc86ea102fdfa1407dbcce323929634/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 16.2.14-395-g4ab91a45-1focal [2,363 kB] 2023-12-22T09:56:44.044 INFO:teuthology.orchestra.run.smithi045.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-pacific/4ab91a455dc86ea102fdfa1407dbcce323929634/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 16.2.14-395-g4ab91a45-1focal [77.4 kB] 2023-12-22T09:56:44.046 INFO:teuthology.orchestra.run.smithi045.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-pacific/4ab91a455dc86ea102fdfa1407dbcce323929634/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 16.2.14-395-g4ab91a45-1focal [100 kB] 2023-12-22T09:56:44.048 INFO:teuthology.orchestra.run.smithi045.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-pacific/4ab91a455dc86ea102fdfa1407dbcce323929634/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 16.2.14-395-g4ab91a45-1focal [2,824 kB] 2023-12-22T09:56:44.124 INFO:teuthology.orchestra.run.smithi113.stdout:Fetched 174 MB in 7s (24.0 MB/s) 2023-12-22T09:56:44.143 INFO:teuthology.orchestra.run.smithi045.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-pacific/4ab91a455dc86ea102fdfa1407dbcce323929634/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 16.2.14-395-g4ab91a45-1focal [7,877 kB] 2023-12-22T09:56:44.309 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-pyperclip. 2023-12-22T09:56:44.381 INFO:teuthology.orchestra.run.smithi113.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 107756 files and directories currently installed.) 2023-12-22T09:56:44.384 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2023-12-22T09:56:44.404 INFO:teuthology.orchestra.run.smithi045.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-pacific/4ab91a455dc86ea102fdfa1407dbcce323929634/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 16.2.14-395-g4ab91a45-1focal [4,168 B] 2023-12-22T09:56:44.405 INFO:teuthology.orchestra.run.smithi045.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-pacific/4ab91a455dc86ea102fdfa1407dbcce323929634/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 16.2.14-395-g4ab91a45-1focal [49.4 MB] 2023-12-22T09:56:44.430 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2023-12-22T09:56:44.808 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-wcwidth. 2023-12-22T09:56:44.828 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-12-22T09:56:44.866 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-12-22T09:56:45.202 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-cmd2. 2023-12-22T09:56:45.225 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2023-12-22T09:56:45.268 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2023-12-22T09:56:45.555 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package libjaeger. 2023-12-22T09:56:45.575 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../003-libjaeger_16.2.14-395-g4ab91a45-1focal_amd64.deb ... 2023-12-22T09:56:45.613 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking libjaeger (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:56:45.999 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-12-22T09:56:46.019 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../004-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-12-22T09:56:46.043 INFO:teuthology.orchestra.run.smithi045.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-pacific/4ab91a455dc86ea102fdfa1407dbcce323929634/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 16.2.14-395-g4ab91a45-1focal [237 kB] 2023-12-22T09:56:46.045 INFO:teuthology.orchestra.run.smithi045.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-pacific/4ab91a455dc86ea102fdfa1407dbcce323929634/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 16.2.14-395-g4ab91a45-1focal [17.4 kB] 2023-12-22T09:56:46.046 INFO:teuthology.orchestra.run.smithi045.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-pacific/4ab91a455dc86ea102fdfa1407dbcce323929634/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 16.2.14-395-g4ab91a45-1focal [13.2 kB] 2023-12-22T09:56:46.046 INFO:teuthology.orchestra.run.smithi045.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-pacific/4ab91a455dc86ea102fdfa1407dbcce323929634/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 16.2.14-395-g4ab91a45-1focal [21.5 kB] 2023-12-22T09:56:46.046 INFO:teuthology.orchestra.run.smithi045.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-pacific/4ab91a455dc86ea102fdfa1407dbcce323929634/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 16.2.14-395-g4ab91a45-1focal [11.3 MB] 2023-12-22T09:56:46.099 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-12-22T09:56:46.466 INFO:teuthology.orchestra.run.smithi045.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-pacific/4ab91a455dc86ea102fdfa1407dbcce323929634/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 16.2.14-395-g4ab91a45-1focal [78.1 kB] 2023-12-22T09:56:46.532 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../005-librbd1_16.2.14-395-g4ab91a45-1focal_amd64.deb ... 2023-12-22T09:56:46.654 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking librbd1 (16.2.14-395-g4ab91a45-1focal) over (15.2.17-0ubuntu0.20.04.5) ... 2023-12-22T09:56:47.376 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../006-librados2_16.2.14-395-g4ab91a45-1focal_amd64.deb ... 2023-12-22T09:56:47.438 INFO:teuthology.orchestra.run.smithi045.stdout:Fetched 174 MB in 10s (17.3 MB/s) 2023-12-22T09:56:47.525 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking librados2 (16.2.14-395-g4ab91a45-1focal) over (15.2.17-0ubuntu0.20.04.5) ... 2023-12-22T09:56:47.597 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-pyperclip. 2023-12-22T09:56:47.667 INFO:teuthology.orchestra.run.smithi045.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 107756 files and directories currently installed.) 2023-12-22T09:56:47.670 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2023-12-22T09:56:47.727 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2023-12-22T09:56:48.038 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-wcwidth. 2023-12-22T09:56:48.056 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-12-22T09:56:48.096 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-12-22T09:56:48.237 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package libcephfs2. 2023-12-22T09:56:48.256 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../007-libcephfs2_16.2.14-395-g4ab91a45-1focal_amd64.deb ... 2023-12-22T09:56:48.295 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking libcephfs2 (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:56:48.449 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-cmd2. 2023-12-22T09:56:48.468 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2023-12-22T09:56:48.516 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2023-12-22T09:56:48.681 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-rados. 2023-12-22T09:56:48.701 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../008-python3-rados_16.2.14-395-g4ab91a45-1focal_amd64.deb ... 2023-12-22T09:56:48.740 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-rados (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:56:48.852 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libjaeger. 2023-12-22T09:56:48.865 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../003-libjaeger_16.2.14-395-g4ab91a45-1focal_amd64.deb ... 2023-12-22T09:56:48.902 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libjaeger (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:56:49.151 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-12-22T09:56:49.169 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../009-python3-ceph-argparse_16.2.14-395-g4ab91a45-1focal_all.deb ... 2023-12-22T09:56:49.209 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-ceph-argparse (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:56:49.272 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-12-22T09:56:49.292 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../004-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-12-22T09:56:49.371 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-12-22T09:56:49.520 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-cephfs. 2023-12-22T09:56:49.540 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../010-python3-cephfs_16.2.14-395-g4ab91a45-1focal_amd64.deb ... 2023-12-22T09:56:49.578 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-cephfs (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:56:49.781 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../005-librbd1_16.2.14-395-g4ab91a45-1focal_amd64.deb ... 2023-12-22T09:56:49.901 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking librbd1 (16.2.14-395-g4ab91a45-1focal) over (15.2.17-0ubuntu0.20.04.5) ... 2023-12-22T09:56:50.132 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-ceph-common. 2023-12-22T09:56:50.151 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../011-python3-ceph-common_16.2.14-395-g4ab91a45-1focal_all.deb ... 2023-12-22T09:56:50.190 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-ceph-common (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:56:50.576 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-prettytable. 2023-12-22T09:56:50.593 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../012-python3-prettytable_0.7.2-5_all.deb ... 2023-12-22T09:56:50.634 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-12-22T09:56:50.647 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../006-librados2_16.2.14-395-g4ab91a45-1focal_amd64.deb ... 2023-12-22T09:56:50.797 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking librados2 (16.2.14-395-g4ab91a45-1focal) over (15.2.17-0ubuntu0.20.04.5) ... 2023-12-22T09:56:50.904 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-rbd. 2023-12-22T09:56:50.921 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../013-python3-rbd_16.2.14-395-g4ab91a45-1focal_amd64.deb ... 2023-12-22T09:56:50.954 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-rbd (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:56:51.340 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-12-22T09:56:51.360 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../014-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-12-22T09:56:51.398 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-12-22T09:56:51.677 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libcephfs2. 2023-12-22T09:56:51.697 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../007-libcephfs2_16.2.14-395-g4ab91a45-1focal_amd64.deb ... 2023-12-22T09:56:51.735 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libcephfs2 (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:56:51.818 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-12-22T09:56:51.838 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../015-librabbitmq4_0.10.0-1_amd64.deb ... 2023-12-22T09:56:51.876 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-12-22T09:56:52.130 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-rados. 2023-12-22T09:56:52.150 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../008-python3-rados_16.2.14-395-g4ab91a45-1focal_amd64.deb ... 2023-12-22T09:56:52.179 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-rados (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:56:52.280 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-12-22T09:56:52.300 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../016-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-12-22T09:56:52.338 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-12-22T09:56:52.599 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-12-22T09:56:52.619 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../009-python3-ceph-argparse_16.2.14-395-g4ab91a45-1focal_all.deb ... 2023-12-22T09:56:52.657 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-ceph-argparse (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:56:52.729 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package librgw2. 2023-12-22T09:56:52.753 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../017-librgw2_16.2.14-395-g4ab91a45-1focal_amd64.deb ... 2023-12-22T09:56:52.799 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking librgw2 (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:56:53.102 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-cephfs. 2023-12-22T09:56:53.119 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../010-python3-cephfs_16.2.14-395-g4ab91a45-1focal_amd64.deb ... 2023-12-22T09:56:53.160 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-cephfs (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:56:53.485 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-rgw. 2023-12-22T09:56:53.506 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../018-python3-rgw_16.2.14-395-g4ab91a45-1focal_amd64.deb ... 2023-12-22T09:56:53.543 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-rgw (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:56:53.555 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-ceph-common. 2023-12-22T09:56:53.575 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../011-python3-ceph-common_16.2.14-395-g4ab91a45-1focal_all.deb ... 2023-12-22T09:56:53.613 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-ceph-common (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:56:53.921 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package libleveldb1d:amd64. 2023-12-22T09:56:53.940 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../019-libleveldb1d_1.22-3ubuntu2_amd64.deb ... 2023-12-22T09:56:53.979 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking libleveldb1d:amd64 (1.22-3ubuntu2) ... 2023-12-22T09:56:54.016 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-prettytable. 2023-12-22T09:56:54.037 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../012-python3-prettytable_0.7.2-5_all.deb ... 2023-12-22T09:56:54.082 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-12-22T09:56:54.307 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package liboath0. 2023-12-22T09:56:54.325 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../020-liboath0_2.6.1-1.3_amd64.deb ... 2023-12-22T09:56:54.360 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-rbd. 2023-12-22T09:56:54.365 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-12-22T09:56:54.382 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../013-python3-rbd_16.2.14-395-g4ab91a45-1focal_amd64.deb ... 2023-12-22T09:56:54.452 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-rbd (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:56:54.718 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package libradosstriper1. 2023-12-22T09:56:54.739 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../021-libradosstriper1_16.2.14-395-g4ab91a45-1focal_amd64.deb ... 2023-12-22T09:56:54.793 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking libradosstriper1 (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:56:54.830 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-12-22T09:56:54.852 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../014-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-12-22T09:56:54.888 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-12-22T09:56:55.240 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package ceph-common. 2023-12-22T09:56:55.249 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-12-22T09:56:55.261 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../022-ceph-common_16.2.14-395-g4ab91a45-1focal_amd64.deb ... 2023-12-22T09:56:55.270 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../015-librabbitmq4_0.10.0-1_amd64.deb ... 2023-12-22T09:56:55.298 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking ceph-common (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:56:55.307 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-12-22T09:56:55.695 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-12-22T09:56:55.714 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../016-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-12-22T09:56:55.752 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-12-22T09:56:56.156 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package librgw2. 2023-12-22T09:56:56.174 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../017-librgw2_16.2.14-395-g4ab91a45-1focal_amd64.deb ... 2023-12-22T09:56:56.214 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking librgw2 (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:56:56.842 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-rgw. 2023-12-22T09:56:56.862 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../018-python3-rgw_16.2.14-395-g4ab91a45-1focal_amd64.deb ... 2023-12-22T09:56:56.899 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-rgw (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:56:57.303 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libleveldb1d:amd64. 2023-12-22T09:56:57.323 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../019-libleveldb1d_1.22-3ubuntu2_amd64.deb ... 2023-12-22T09:56:57.361 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libleveldb1d:amd64 (1.22-3ubuntu2) ... 2023-12-22T09:56:57.595 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package ceph-base. 2023-12-22T09:56:57.617 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../023-ceph-base_16.2.14-395-g4ab91a45-1focal_amd64.deb ... 2023-12-22T09:56:57.684 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking ceph-base (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:56:57.747 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package liboath0. 2023-12-22T09:56:57.767 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../020-liboath0_2.6.1-1.3_amd64.deb ... 2023-12-22T09:56:57.805 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-12-22T09:56:58.192 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libradosstriper1. 2023-12-22T09:56:58.211 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../021-libradosstriper1_16.2.14-395-g4ab91a45-1focal_amd64.deb ... 2023-12-22T09:56:58.250 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libradosstriper1 (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:56:58.699 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-cryptography. 2023-12-22T09:56:58.713 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../024-python3-cryptography_2.8-3ubuntu0.2_amd64.deb ... 2023-12-22T09:56:58.757 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.2) ... 2023-12-22T09:56:58.787 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package ceph-common. 2023-12-22T09:56:58.807 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../022-ceph-common_16.2.14-395-g4ab91a45-1focal_amd64.deb ... 2023-12-22T09:56:58.845 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking ceph-common (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:56:59.212 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-openssl. 2023-12-22T09:56:59.231 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../025-python3-openssl_19.0.0-1build1_all.deb ... 2023-12-22T09:56:59.278 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-12-22T09:56:59.581 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-12-22T09:56:59.603 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../026-ceph-mgr-modules-core_16.2.14-395-g4ab91a45-1focal_all.deb ... 2023-12-22T09:56:59.647 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking ceph-mgr-modules-core (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:57:00.111 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-bcrypt. 2023-12-22T09:57:00.131 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../027-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-12-22T09:57:00.169 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-12-22T09:57:00.547 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-cherrypy3. 2023-12-22T09:57:00.571 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../028-python3-cherrypy3_8.9.1-6_all.deb ... 2023-12-22T09:57:00.613 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-12-22T09:57:01.025 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-jwt. 2023-12-22T09:57:01.038 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../029-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-12-22T09:57:01.075 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-12-22T09:57:01.268 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package ceph-base. 2023-12-22T09:57:01.292 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../023-ceph-base_16.2.14-395-g4ab91a45-1focal_amd64.deb ... 2023-12-22T09:57:01.357 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking ceph-base (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:57:01.386 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-logutils. 2023-12-22T09:57:01.404 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../030-python3-logutils_0.3.3-7_all.deb ... 2023-12-22T09:57:01.436 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-12-22T09:57:01.798 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-markupsafe. 2023-12-22T09:57:01.820 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../031-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-12-22T09:57:01.864 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-12-22T09:57:02.226 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-mako. 2023-12-22T09:57:02.246 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../032-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-12-22T09:57:02.284 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-12-22T09:57:02.630 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-cryptography. 2023-12-22T09:57:02.644 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../024-python3-cryptography_2.8-3ubuntu0.2_amd64.deb ... 2023-12-22T09:57:02.701 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-simplegeneric. 2023-12-22T09:57:02.714 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../033-python3-simplegeneric_0.8.1-3_all.deb ... 2023-12-22T09:57:02.730 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.2) ... 2023-12-22T09:57:02.762 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-12-22T09:57:03.057 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-singledispatch. 2023-12-22T09:57:03.077 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../034-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-12-22T09:57:03.114 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-12-22T09:57:03.143 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-openssl. 2023-12-22T09:57:03.159 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../025-python3-openssl_19.0.0-1build1_all.deb ... 2023-12-22T09:57:03.234 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-12-22T09:57:03.476 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-webob. 2023-12-22T09:57:03.497 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../035-python3-webob_1%3a1.8.5-2_all.deb ... 2023-12-22T09:57:03.520 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-12-22T09:57:03.534 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-12-22T09:57:03.542 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../026-ceph-mgr-modules-core_16.2.14-395-g4ab91a45-1focal_all.deb ... 2023-12-22T09:57:03.586 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking ceph-mgr-modules-core (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:57:03.904 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-soupsieve. 2023-12-22T09:57:03.924 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../036-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-12-22T09:57:03.962 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-12-22T09:57:04.050 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-bcrypt. 2023-12-22T09:57:04.070 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../027-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-12-22T09:57:04.108 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-12-22T09:57:04.232 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-bs4. 2023-12-22T09:57:04.251 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../037-python3-bs4_4.8.2-1_all.deb ... 2023-12-22T09:57:04.281 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-12-22T09:57:04.453 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-cherrypy3. 2023-12-22T09:57:04.474 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../028-python3-cherrypy3_8.9.1-6_all.deb ... 2023-12-22T09:57:04.519 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-12-22T09:57:04.709 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-waitress. 2023-12-22T09:57:04.722 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../038-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-12-22T09:57:04.774 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-12-22T09:57:04.898 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-jwt. 2023-12-22T09:57:04.916 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../029-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-12-22T09:57:04.956 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-12-22T09:57:05.163 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-tempita. 2023-12-22T09:57:05.181 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../039-python3-tempita_0.5.2-6_all.deb ... 2023-12-22T09:57:05.221 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-12-22T09:57:05.318 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-logutils. 2023-12-22T09:57:05.338 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../030-python3-logutils_0.3.3-7_all.deb ... 2023-12-22T09:57:05.376 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-12-22T09:57:05.583 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-paste. 2023-12-22T09:57:05.603 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../040-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-12-22T09:57:05.640 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-12-22T09:57:05.687 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-markupsafe. 2023-12-22T09:57:05.707 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../031-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-12-22T09:57:05.766 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-12-22T09:57:05.994 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-12-22T09:57:06.012 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../041-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-12-22T09:57:06.052 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-12-22T09:57:06.090 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-mako. 2023-12-22T09:57:06.111 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../032-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-12-22T09:57:06.156 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-12-22T09:57:06.439 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-pastedeploy. 2023-12-22T09:57:06.459 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../042-python3-pastedeploy_2.1.0-1_all.deb ... 2023-12-22T09:57:06.505 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-12-22T09:57:06.858 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-webtest. 2023-12-22T09:57:06.878 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../043-python3-webtest_2.0.32-2_all.deb ... 2023-12-22T09:57:06.916 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-12-22T09:57:07.185 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-simplegeneric. 2023-12-22T09:57:07.205 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../033-python3-simplegeneric_0.8.1-3_all.deb ... 2023-12-22T09:57:07.243 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-12-22T09:57:07.252 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-pecan. 2023-12-22T09:57:07.272 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../044-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-12-22T09:57:07.335 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-12-22T09:57:07.572 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-singledispatch. 2023-12-22T09:57:07.590 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../034-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-12-22T09:57:07.654 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-12-22T09:57:07.741 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-werkzeug. 2023-12-22T09:57:07.762 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../045-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2023-12-22T09:57:07.807 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-12-22T09:57:07.991 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-webob. 2023-12-22T09:57:08.008 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../035-python3-webob_1%3a1.8.5-2_all.deb ... 2023-12-22T09:57:08.049 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-12-22T09:57:08.211 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-12-22T09:57:08.228 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../046-libsqlite3-mod-ceph_16.2.14-395-g4ab91a45-1focal_amd64.deb ... 2023-12-22T09:57:08.268 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking libsqlite3-mod-ceph (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:57:08.435 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-soupsieve. 2023-12-22T09:57:08.458 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../036-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-12-22T09:57:08.501 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-12-22T09:57:08.689 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package ceph-mgr. 2023-12-22T09:57:08.709 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../047-ceph-mgr_16.2.14-395-g4ab91a45-1focal_amd64.deb ... 2023-12-22T09:57:08.755 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking ceph-mgr (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:57:08.880 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-bs4. 2023-12-22T09:57:08.901 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../037-python3-bs4_4.8.2-1_all.deb ... 2023-12-22T09:57:08.938 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-12-22T09:57:09.283 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package ceph-mon. 2023-12-22T09:57:09.301 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../048-ceph-mon_16.2.14-395-g4ab91a45-1focal_amd64.deb ... 2023-12-22T09:57:09.333 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-waitress. 2023-12-22T09:57:09.341 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking ceph-mon (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:57:09.355 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../038-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-12-22T09:57:09.404 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-12-22T09:57:09.770 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-tempita. 2023-12-22T09:57:09.790 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../039-python3-tempita_0.5.2-6_all.deb ... 2023-12-22T09:57:09.827 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-12-22T09:57:10.189 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-paste. 2023-12-22T09:57:10.208 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../040-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-12-22T09:57:10.247 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-12-22T09:57:10.592 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-12-22T09:57:10.614 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../041-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-12-22T09:57:10.658 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-12-22T09:57:11.020 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-pastedeploy. 2023-12-22T09:57:11.041 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../042-python3-pastedeploy_2.1.0-1_all.deb ... 2023-12-22T09:57:11.086 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-12-22T09:57:11.145 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package ceph-osd. 2023-12-22T09:57:11.165 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../049-ceph-osd_16.2.14-395-g4ab91a45-1focal_amd64.deb ... 2023-12-22T09:57:11.203 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking ceph-osd (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:57:11.449 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-webtest. 2023-12-22T09:57:11.469 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../043-python3-webtest_2.0.32-2_all.deb ... 2023-12-22T09:57:11.506 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-12-22T09:57:11.868 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-pecan. 2023-12-22T09:57:11.889 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../044-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-12-22T09:57:11.926 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-12-22T09:57:12.382 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-werkzeug. 2023-12-22T09:57:12.402 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../045-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2023-12-22T09:57:12.448 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-12-22T09:57:12.845 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-12-22T09:57:12.863 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../046-libsqlite3-mod-ceph_16.2.14-395-g4ab91a45-1focal_amd64.deb ... 2023-12-22T09:57:12.903 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libsqlite3-mod-ceph (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:57:13.315 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package ceph-mgr. 2023-12-22T09:57:13.342 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../047-ceph-mgr_16.2.14-395-g4ab91a45-1focal_amd64.deb ... 2023-12-22T09:57:13.381 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking ceph-mgr (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:57:13.592 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package ceph. 2023-12-22T09:57:13.616 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../050-ceph_16.2.14-395-g4ab91a45-1focal_amd64.deb ... 2023-12-22T09:57:13.658 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking ceph (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:57:13.967 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package ceph-mon. 2023-12-22T09:57:13.981 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../048-ceph-mon_16.2.14-395-g4ab91a45-1focal_amd64.deb ... 2023-12-22T09:57:14.025 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking ceph-mon (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:57:14.028 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package ceph-fuse. 2023-12-22T09:57:14.048 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../051-ceph-fuse_16.2.14-395-g4ab91a45-1focal_amd64.deb ... 2023-12-22T09:57:14.086 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking ceph-fuse (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:57:14.515 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package ceph-mds. 2023-12-22T09:57:14.534 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../052-ceph-mds_16.2.14-395-g4ab91a45-1focal_amd64.deb ... 2023-12-22T09:57:14.597 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking ceph-mds (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:57:15.122 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package ceph-osd. 2023-12-22T09:57:15.139 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../049-ceph-osd_16.2.14-395-g4ab91a45-1focal_amd64.deb ... 2023-12-22T09:57:15.179 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking ceph-osd (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:57:15.201 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package cephadm. 2023-12-22T09:57:15.219 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../053-cephadm_16.2.14-395-g4ab91a45-1focal_amd64.deb ... 2023-12-22T09:57:15.259 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking cephadm (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:57:15.595 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-jinja2. 2023-12-22T09:57:15.615 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../054-python3-jinja2_2.10.1-2_all.deb ... 2023-12-22T09:57:15.653 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-12-22T09:57:16.081 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-12-22T09:57:16.101 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../055-ceph-mgr-cephadm_16.2.14-395-g4ab91a45-1focal_all.deb ... 2023-12-22T09:57:16.139 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking ceph-mgr-cephadm (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:57:16.518 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-repoze.lru. 2023-12-22T09:57:16.539 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../056-python3-repoze.lru_0.7-2_all.deb ... 2023-12-22T09:57:16.584 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-12-22T09:57:16.904 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package libjs-underscore. 2023-12-22T09:57:16.922 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../057-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-12-22T09:57:16.962 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-12-22T09:57:17.264 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-12-22T09:57:17.281 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../058-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-12-22T09:57:17.322 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-12-22T09:57:17.635 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package ceph. 2023-12-22T09:57:17.650 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../050-ceph_16.2.14-395-g4ab91a45-1focal_amd64.deb ... 2023-12-22T09:57:17.693 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking ceph (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:57:17.700 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-routes. 2023-12-22T09:57:17.720 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../059-python3-routes_2.4.1-2_all.deb ... 2023-12-22T09:57:17.758 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-12-22T09:57:18.080 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package ceph-fuse. 2023-12-22T09:57:18.100 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../051-ceph-fuse_16.2.14-395-g4ab91a45-1focal_amd64.deb ... 2023-12-22T09:57:18.129 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking ceph-fuse (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:57:18.154 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-12-22T09:57:18.176 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../060-ceph-mgr-dashboard_16.2.14-395-g4ab91a45-1focal_all.deb ... 2023-12-22T09:57:18.219 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking ceph-mgr-dashboard (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:57:18.617 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package ceph-mds. 2023-12-22T09:57:18.637 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../052-ceph-mds_16.2.14-395-g4ab91a45-1focal_amd64.deb ... 2023-12-22T09:57:18.674 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking ceph-mds (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:57:19.253 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package cephadm. 2023-12-22T09:57:19.274 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../053-cephadm_16.2.14-395-g4ab91a45-1focal_amd64.deb ... 2023-12-22T09:57:19.311 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking cephadm (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:57:19.460 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-decorator. 2023-12-22T09:57:19.481 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../061-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-12-22T09:57:19.518 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-12-22T09:57:19.672 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-jinja2. 2023-12-22T09:57:19.693 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../054-python3-jinja2_2.10.1-2_all.deb ... 2023-12-22T09:57:19.738 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-12-22T09:57:19.863 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-12-22T09:57:19.885 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../062-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-12-22T09:57:19.929 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-12-22T09:57:20.108 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-12-22T09:57:20.129 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../055-ceph-mgr-cephadm_16.2.14-395-g4ab91a45-1focal_all.deb ... 2023-12-22T09:57:20.166 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking ceph-mgr-cephadm (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:57:20.274 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-scipy. 2023-12-22T09:57:20.296 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../063-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-12-22T09:57:20.340 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-12-22T09:57:20.570 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-repoze.lru. 2023-12-22T09:57:20.591 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../056-python3-repoze.lru_0.7-2_all.deb ... 2023-12-22T09:57:20.636 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-12-22T09:57:20.923 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libjs-underscore. 2023-12-22T09:57:20.940 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../057-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-12-22T09:57:21.014 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-12-22T09:57:21.325 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-12-22T09:57:21.347 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../058-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-12-22T09:57:21.391 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-12-22T09:57:21.819 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-routes. 2023-12-22T09:57:21.840 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../059-python3-routes_2.4.1-2_all.deb ... 2023-12-22T09:57:21.885 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-12-22T09:57:21.958 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-12-22T09:57:21.979 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../064-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-12-22T09:57:22.016 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-12-22T09:57:22.296 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-12-22T09:57:22.315 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../060-ceph-mgr-dashboard_16.2.14-395-g4ab91a45-1focal_all.deb ... 2023-12-22T09:57:22.381 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking ceph-mgr-dashboard (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:57:22.586 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-joblib. 2023-12-22T09:57:22.607 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../065-python3-joblib_0.14.0-3_all.deb ... 2023-12-22T09:57:22.644 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-12-22T09:57:23.102 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-sklearn. 2023-12-22T09:57:23.123 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../066-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-12-22T09:57:23.168 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-12-22T09:57:23.631 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-decorator. 2023-12-22T09:57:23.653 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../061-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-12-22T09:57:23.697 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-12-22T09:57:23.984 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-12-22T09:57:24.005 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../067-ceph-mgr-diskprediction-local_16.2.14-395-g4ab91a45-1focal_all.deb ... 2023-12-22T09:57:24.042 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking ceph-mgr-diskprediction-local (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:57:24.067 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-12-22T09:57:24.089 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../062-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-12-22T09:57:24.133 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-12-22T09:57:24.478 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-scipy. 2023-12-22T09:57:24.496 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../063-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-12-22T09:57:24.561 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-12-22T09:57:25.312 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-cachetools. 2023-12-22T09:57:25.330 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../068-python3-cachetools_4.0.0-1_all.deb ... 2023-12-22T09:57:25.370 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-12-22T09:57:25.732 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-pyasn1. 2023-12-22T09:57:25.752 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../069-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-12-22T09:57:25.789 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-12-22T09:57:26.049 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-12-22T09:57:26.068 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../064-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-12-22T09:57:26.107 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-12-22T09:57:26.169 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-12-22T09:57:26.186 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../070-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-12-22T09:57:26.226 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-12-22T09:57:26.596 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-rsa. 2023-12-22T09:57:26.616 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../071-python3-rsa_4.0-3_all.deb ... 2023-12-22T09:57:26.654 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-rsa (4.0-3) ... 2023-12-22T09:57:26.711 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-joblib. 2023-12-22T09:57:26.732 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../065-python3-joblib_0.14.0-3_all.deb ... 2023-12-22T09:57:26.777 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-12-22T09:57:27.033 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-google-auth. 2023-12-22T09:57:27.052 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../072-python3-google-auth_1.5.1-2_all.deb ... 2023-12-22T09:57:27.091 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-12-22T09:57:27.198 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-sklearn. 2023-12-22T09:57:27.218 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../066-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-12-22T09:57:27.255 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-12-22T09:57:27.469 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-blinker. 2023-12-22T09:57:27.490 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../073-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-12-22T09:57:27.536 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-12-22T09:57:27.880 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-oauthlib. 2023-12-22T09:57:27.901 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../074-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-12-22T09:57:27.946 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-12-22T09:57:28.082 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-12-22T09:57:28.104 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../067-ceph-mgr-diskprediction-local_16.2.14-395-g4ab91a45-1focal_all.deb ... 2023-12-22T09:57:28.148 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking ceph-mgr-diskprediction-local (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:57:28.500 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-12-22T09:57:28.520 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../075-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-12-22T09:57:28.583 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-12-22T09:57:28.936 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-websocket. 2023-12-22T09:57:28.955 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../076-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-12-22T09:57:28.994 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-12-22T09:57:29.398 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-kubernetes. 2023-12-22T09:57:29.419 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../077-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-12-22T09:57:29.464 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-12-22T09:57:29.501 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-cachetools. 2023-12-22T09:57:29.522 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../068-python3-cachetools_4.0.0-1_all.deb ... 2023-12-22T09:57:29.559 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-12-22T09:57:29.921 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-pyasn1. 2023-12-22T09:57:29.939 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../069-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-12-22T09:57:29.978 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-12-22T09:57:30.094 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-12-22T09:57:30.115 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../078-ceph-mgr-k8sevents_16.2.14-395-g4ab91a45-1focal_all.deb ... 2023-12-22T09:57:30.160 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking ceph-mgr-k8sevents (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:57:30.365 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-12-22T09:57:30.387 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../070-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-12-22T09:57:30.431 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-12-22T09:57:30.540 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package libonig5:amd64. 2023-12-22T09:57:30.562 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../079-libonig5_6.9.4-1_amd64.deb ... 2023-12-22T09:57:30.607 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-12-22T09:57:30.818 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-rsa. 2023-12-22T09:57:30.839 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../071-python3-rsa_4.0-3_all.deb ... 2023-12-22T09:57:30.876 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-rsa (4.0-3) ... 2023-12-22T09:57:30.985 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package libjq1:amd64. 2023-12-22T09:57:31.006 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../080-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-12-22T09:57:31.050 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-12-22T09:57:31.230 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-google-auth. 2023-12-22T09:57:31.251 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../072-python3-google-auth_1.5.1-2_all.deb ... 2023-12-22T09:57:31.304 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-12-22T09:57:31.491 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package jq. 2023-12-22T09:57:31.510 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../081-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-12-22T09:57:31.549 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-12-22T09:57:31.675 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-blinker. 2023-12-22T09:57:31.695 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../073-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-12-22T09:57:31.732 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-12-22T09:57:31.835 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package socat. 2023-12-22T09:57:31.856 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../082-socat_1.7.3.3-2_amd64.deb ... 2023-12-22T09:57:31.901 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking socat (1.7.3.3-2) ... 2023-12-22T09:57:32.086 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-oauthlib. 2023-12-22T09:57:32.107 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../074-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-12-22T09:57:32.152 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-12-22T09:57:32.297 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package xmlstarlet. 2023-12-22T09:57:32.320 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../083-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-12-22T09:57:32.363 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-12-22T09:57:32.580 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-12-22T09:57:32.603 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../075-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-12-22T09:57:32.786 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package ceph-test. 2023-12-22T09:57:32.807 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../084-ceph-test_16.2.14-395-g4ab91a45-1focal_amd64.deb ... 2023-12-22T09:57:32.852 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking ceph-test (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:57:32.863 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-12-22T09:57:33.208 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-websocket. 2023-12-22T09:57:33.227 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../076-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-12-22T09:57:33.266 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-12-22T09:57:33.645 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-kubernetes. 2023-12-22T09:57:33.665 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../077-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-12-22T09:57:33.702 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-12-22T09:57:34.409 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-12-22T09:57:34.431 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../078-ceph-mgr-k8sevents_16.2.14-395-g4ab91a45-1focal_all.deb ... 2023-12-22T09:57:34.475 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking ceph-mgr-k8sevents (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:57:34.828 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libonig5:amd64. 2023-12-22T09:57:34.848 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../079-libonig5_6.9.4-1_amd64.deb ... 2023-12-22T09:57:34.911 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-12-22T09:57:35.298 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libjq1:amd64. 2023-12-22T09:57:35.319 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../080-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-12-22T09:57:35.364 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-12-22T09:57:35.769 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package jq. 2023-12-22T09:57:35.783 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../081-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-12-22T09:57:35.827 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-12-22T09:57:36.148 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package socat. 2023-12-22T09:57:36.171 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../082-socat_1.7.3.3-2_amd64.deb ... 2023-12-22T09:57:36.214 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking socat (1.7.3.3-2) ... 2023-12-22T09:57:36.568 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package xmlstarlet. 2023-12-22T09:57:36.591 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../083-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-12-22T09:57:36.634 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-12-22T09:57:37.073 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package ceph-test. 2023-12-22T09:57:37.094 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../084-ceph-test_16.2.14-395-g4ab91a45-1focal_amd64.deb ... 2023-12-22T09:57:37.123 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package cephfs-mirror. 2023-12-22T09:57:37.139 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking ceph-test (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:57:37.143 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../085-cephfs-mirror_16.2.14-395-g4ab91a45-1focal_amd64.deb ... 2023-12-22T09:57:37.190 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking cephfs-mirror (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:57:37.576 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-colorama. 2023-12-22T09:57:37.594 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../086-python3-colorama_0.4.3-1build1_all.deb ... 2023-12-22T09:57:37.633 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2023-12-22T09:57:37.912 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package cephfs-shell. 2023-12-22T09:57:37.932 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../087-cephfs-shell_16.2.14-395-g4ab91a45-1focal_all.deb ... 2023-12-22T09:57:37.986 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking cephfs-shell (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:57:38.265 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package cephfs-top. 2023-12-22T09:57:38.286 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../088-cephfs-top_16.2.14-395-g4ab91a45-1focal_all.deb ... 2023-12-22T09:57:38.330 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking cephfs-top (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:57:38.642 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package libcephfs-dev. 2023-12-22T09:57:38.663 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../089-libcephfs-dev_16.2.14-395-g4ab91a45-1focal_amd64.deb ... 2023-12-22T09:57:38.708 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking libcephfs-dev (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:57:39.170 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package nvme-cli. 2023-12-22T09:57:39.191 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../090-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-12-22T09:57:39.270 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-12-22T09:57:39.691 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-atomicwrites. 2023-12-22T09:57:39.705 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../091-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-12-22T09:57:39.750 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-12-22T09:57:40.070 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-attr. 2023-12-22T09:57:40.092 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../092-python3-attr_19.3.0-2_all.deb ... 2023-12-22T09:57:40.136 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-12-22T09:57:40.522 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-webencodings. 2023-12-22T09:57:40.543 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../093-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-12-22T09:57:40.588 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-12-22T09:57:40.951 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-html5lib. 2023-12-22T09:57:40.970 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../094-python3-html5lib_1.0.1-2_all.deb ... 2023-12-22T09:57:41.009 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-12-22T09:57:41.327 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package cephfs-mirror. 2023-12-22T09:57:41.349 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../085-cephfs-mirror_16.2.14-395-g4ab91a45-1focal_amd64.deb ... 2023-12-22T09:57:41.379 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-12-22T09:57:41.393 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking cephfs-mirror (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:57:41.400 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../095-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-12-22T09:57:41.470 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-12-22T09:57:41.772 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-colorama. 2023-12-22T09:57:41.794 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../086-python3-colorama_0.4.3-1build1_all.deb ... 2023-12-22T09:57:41.838 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2023-12-22T09:57:41.974 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-packaging. 2023-12-22T09:57:41.995 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../096-python3-packaging_20.3-1_all.deb ... 2023-12-22T09:57:42.048 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-packaging (20.3-1) ... 2023-12-22T09:57:42.150 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package cephfs-shell. 2023-12-22T09:57:42.171 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../087-cephfs-shell_16.2.14-395-g4ab91a45-1focal_all.deb ... 2023-12-22T09:57:42.215 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking cephfs-shell (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:57:42.385 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-pastescript. 2023-12-22T09:57:42.408 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../097-python3-pastescript_2.0.2-4_all.deb ... 2023-12-22T09:57:42.451 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-12-22T09:57:42.485 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package cephfs-top. 2023-12-22T09:57:42.507 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../088-cephfs-top_16.2.14-395-g4ab91a45-1focal_all.deb ... 2023-12-22T09:57:42.551 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking cephfs-top (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:57:42.847 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-pluggy. 2023-12-22T09:57:42.860 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../098-python3-pluggy_0.13.0-2_all.deb ... 2023-12-22T09:57:42.872 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libcephfs-dev. 2023-12-22T09:57:42.891 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../089-libcephfs-dev_16.2.14-395-g4ab91a45-1focal_amd64.deb ... 2023-12-22T09:57:42.905 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-12-22T09:57:42.930 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libcephfs-dev (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:57:43.275 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-psutil. 2023-12-22T09:57:43.298 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../099-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-12-22T09:57:43.341 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-12-22T09:57:43.384 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package nvme-cli. 2023-12-22T09:57:43.406 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../090-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-12-22T09:57:43.488 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-12-22T09:57:43.746 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-py. 2023-12-22T09:57:43.766 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../100-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-12-22T09:57:43.806 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-12-22T09:57:43.990 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-atomicwrites. 2023-12-22T09:57:44.011 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../091-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-12-22T09:57:44.055 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-12-22T09:57:44.168 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-pyinotify. 2023-12-22T09:57:44.190 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../101-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-12-22T09:57:44.234 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-12-22T09:57:44.417 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-attr. 2023-12-22T09:57:44.439 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../092-python3-attr_19.3.0-2_all.deb ... 2023-12-22T09:57:44.483 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-12-22T09:57:44.604 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-pytest. 2023-12-22T09:57:44.625 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../102-python3-pytest_4.6.9-1_all.deb ... 2023-12-22T09:57:44.670 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-12-22T09:57:44.854 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-webencodings. 2023-12-22T09:57:44.875 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../093-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-12-22T09:57:44.920 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-12-22T09:57:45.074 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package python3-simplejson. 2023-12-22T09:57:45.099 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../103-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-12-22T09:57:45.140 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-12-22T09:57:45.290 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-html5lib. 2023-12-22T09:57:45.311 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../094-python3-html5lib_1.0.1-2_all.deb ... 2023-12-22T09:57:45.356 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-12-22T09:57:45.627 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package radosgw. 2023-12-22T09:57:45.649 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../104-radosgw_16.2.14-395-g4ab91a45-1focal_amd64.deb ... 2023-12-22T09:57:45.685 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking radosgw (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:57:45.760 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-12-22T09:57:45.783 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../095-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-12-22T09:57:45.826 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-12-22T09:57:46.325 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-packaging. 2023-12-22T09:57:46.347 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../096-python3-packaging_20.3-1_all.deb ... 2023-12-22T09:57:46.391 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-packaging (20.3-1) ... 2023-12-22T09:57:46.753 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-pastescript. 2023-12-22T09:57:46.774 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../097-python3-pastescript_2.0.2-4_all.deb ... 2023-12-22T09:57:46.819 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-12-22T09:57:46.915 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package rbd-fuse. 2023-12-22T09:57:46.933 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../105-rbd-fuse_16.2.14-395-g4ab91a45-1focal_amd64.deb ... 2023-12-22T09:57:46.972 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking rbd-fuse (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:57:47.164 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-pluggy. 2023-12-22T09:57:47.179 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../098-python3-pluggy_0.13.0-2_all.deb ... 2023-12-22T09:57:47.247 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-12-22T09:57:47.337 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-attr (19.3.0-2) ... 2023-12-22T09:57:47.576 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-psutil. 2023-12-22T09:57:47.599 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../099-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-12-22T09:57:47.641 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-12-22T09:57:47.707 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up libleveldb1d:amd64 (1.22-3ubuntu2) ... 2023-12-22T09:57:47.858 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-12-22T09:57:47.984 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-12-22T09:57:48.095 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-py. 2023-12-22T09:57:48.116 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../100-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-12-22T09:57:48.161 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-12-22T09:57:48.203 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up cephadm (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:57:48.550 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-pyinotify. 2023-12-22T09:57:48.571 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../101-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-12-22T09:57:48.615 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-12-22T09:57:48.888 INFO:teuthology.orchestra.run.smithi113.stdout:Adding system user cephadm....done 2023-12-22T09:57:48.994 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-pytest. 2023-12-22T09:57:49.016 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../102-python3-pytest_4.6.9-1_all.deb ... 2023-12-22T09:57:49.059 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-12-22T09:57:49.112 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-12-22T09:57:49.470 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-simplejson. 2023-12-22T09:57:49.488 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../103-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-12-22T09:57:49.527 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-12-22T09:57:49.577 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-12-22T09:57:49.940 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-12-22T09:57:49.998 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package radosgw. 2023-12-22T09:57:50.019 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../104-radosgw_16.2.14-395-g4ab91a45-1focal_amd64.deb ... 2023-12-22T09:57:50.064 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking radosgw (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:57:50.065 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-12-22T09:57:50.501 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-12-22T09:57:50.977 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-12-22T09:57:51.303 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package rbd-fuse. 2023-12-22T09:57:51.325 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../105-rbd-fuse_16.2.14-395-g4ab91a45-1focal_amd64.deb ... 2023-12-22T09:57:51.345 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-12-22T09:57:51.377 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking rbd-fuse (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:57:51.733 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-attr (19.3.0-2) ... 2023-12-22T09:57:51.880 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2023-12-22T09:57:52.141 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libleveldb1d:amd64 (1.22-3ubuntu2) ... 2023-12-22T09:57:52.240 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-12-22T09:57:52.267 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-12-22T09:57:52.427 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-12-22T09:57:52.591 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-12-22T09:57:52.645 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up cephadm (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:57:52.966 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-ceph-argparse (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:57:53.336 INFO:teuthology.orchestra.run.smithi045.stdout:Adding system user cephadm....done 2023-12-22T09:57:53.351 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-12-22T09:57:53.477 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2023-12-22T09:57:53.551 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-12-22T09:57:53.845 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-12-22T09:57:53.994 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-12-22T09:57:54.204 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-12-22T09:57:54.362 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-12-22T09:57:54.513 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-12-22T09:57:54.555 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-12-22T09:57:54.940 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-12-22T09:57:55.007 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-12-22T09:57:55.358 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-12-22T09:57:55.475 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-12-22T09:57:55.768 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-12-22T09:57:55.843 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-12-22T09:57:56.118 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up libjaeger (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:57:56.228 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2023-12-22T09:57:56.244 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-12-22T09:57:56.587 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-12-22T09:57:56.663 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-12-22T09:57:56.985 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-12-22T09:57:57.132 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-packaging (20.3-1) ... 2023-12-22T09:57:57.356 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-ceph-argparse (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:57:57.501 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-12-22T09:57:57.660 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-12-22T09:57:57.724 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-12-22T09:57:57.842 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2023-12-22T09:57:58.020 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-12-22T09:57:58.228 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-12-22T09:57:58.505 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2023-12-22T09:57:58.596 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-12-22T09:57:58.873 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-12-22T09:57:58.947 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-12-22T09:57:59.308 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-cryptography (2.8-3ubuntu0.2) ... 2023-12-22T09:57:59.449 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-12-22T09:57:59.788 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up socat (1.7.3.3-2) ... 2023-12-22T09:57:59.825 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-12-22T09:57:59.939 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-ceph-common (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:58:00.234 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-12-22T09:58:00.340 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-12-22T09:58:00.594 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libjaeger (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:58:00.733 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-12-22T09:58:00.766 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-12-22T09:58:00.892 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-12-22T09:58:01.019 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-12-22T09:58:01.158 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-12-22T09:58:01.411 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-12-22T09:58:01.517 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-packaging (20.3-1) ... 2023-12-22T09:58:01.807 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-12-22T09:58:01.909 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-12-22T09:58:01.932 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-12-22T09:58:02.035 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-12-22T09:58:02.342 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-12-22T09:58:02.428 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-12-22T09:58:02.694 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-12-22T09:58:02.905 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2023-12-22T09:58:03.053 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-12-22T09:58:03.179 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-12-22T09:58:03.291 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-12-22T09:58:03.538 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-12-22T09:58:03.890 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-12-22T09:58:04.026 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-cryptography (2.8-3ubuntu0.2) ... 2023-12-22T09:58:04.299 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-12-22T09:58:04.486 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up socat (1.7.3.3-2) ... 2023-12-22T09:58:04.612 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-ceph-common (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:58:04.754 INFO:teuthology.orchestra.run.smithi113.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-12-22T09:58:05.030 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-12-22T09:58:05.101 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-12-22T09:58:05.261 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-12-22T09:58:05.456 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-12-22T09:58:05.566 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-12-22T09:58:05.662 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-12-22T09:58:05.717 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-12-22T09:58:06.076 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-12-22T09:58:06.131 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-12-22T09:58:06.256 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-12-22T09:58:06.415 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-12-22T09:58:06.494 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-12-22T09:58:06.620 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-12-22T09:58:06.817 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-12-22T09:58:07.080 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-12-22T09:58:07.209 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up librados2 (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:58:07.335 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-12-22T09:58:07.448 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-12-22T09:58:07.807 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-12-22T09:58:07.933 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-12-22T09:58:08.301 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-12-22T09:58:08.660 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-12-22T09:58:09.070 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-12-22T09:58:09.133 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up librgw2 (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:58:09.284 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up libsqlite3-mod-ceph (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:58:09.410 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-12-22T09:58:09.464 INFO:teuthology.orchestra.run.smithi045.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-12-22T09:58:09.536 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-12-22T09:58:09.814 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-12-22T09:58:09.948 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-12-22T09:58:09.996 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-12-22T09:58:10.358 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-12-22T09:58:10.397 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-12-22T09:58:10.748 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-12-22T09:58:10.826 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-12-22T09:58:10.952 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-12-22T09:58:11.078 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-12-22T09:58:11.174 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up libcephfs2 (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:58:11.300 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-12-22T09:58:11.495 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-12-22T09:58:11.702 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up libradosstriper1 (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:58:11.828 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-12-22T09:58:11.855 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up librados2 (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:58:11.981 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-12-22T09:58:12.238 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-12-22T09:58:13.477 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up librbd1 (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:58:13.611 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-12-22T09:58:13.737 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-12-22T09:58:13.888 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-rsa (4.0-3) ... 2023-12-22T09:58:13.889 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up librgw2 (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:58:14.021 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libsqlite3-mod-ceph (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:58:14.147 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-12-22T09:58:14.248 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-12-22T09:58:14.282 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-12-22T09:58:14.629 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up ceph-mgr-modules-core (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:58:14.750 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up ceph-fuse (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:58:14.791 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-12-22T09:58:15.004 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-12-22T09:58:15.004 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-12-22T09:58:15.192 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-12-22T09:58:15.560 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-12-22T09:58:15.793 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up libcephfs-dev (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:58:15.918 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-12-22T09:58:15.978 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libcephfs2 (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:58:16.095 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-12-22T09:58:16.262 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-12-22T09:58:16.515 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libradosstriper1 (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:58:16.640 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-12-22T09:58:16.646 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-12-22T09:58:17.066 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-12-22T09:58:17.082 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-rados (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:58:17.458 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up cephfs-top (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:58:17.687 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-rbd (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:58:17.813 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up rbd-fuse (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:58:17.939 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-routes (2.4.1-2) ... 2023-12-22T09:58:18.332 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-12-22T09:58:18.396 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up librbd1 (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:58:18.556 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-12-22T09:58:18.700 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-rgw (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:58:18.826 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-cephfs (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:58:18.838 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-12-22T09:58:19.151 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-rsa (4.0-3) ... 2023-12-22T09:58:19.204 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up cephfs-shell (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:58:19.337 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-12-22T09:58:19.544 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-12-22T09:58:19.911 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up ceph-mgr-modules-core (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:58:20.062 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up ceph-fuse (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:58:20.331 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-12-22T09:58:20.331 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-12-22T09:58:20.475 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up ceph-common (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:58:21.135 INFO:teuthology.orchestra.run.smithi113.stdout:Adding group ceph....done 2023-12-22T09:58:21.222 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libcephfs-dev (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:58:21.348 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-12-22T09:58:21.607 INFO:teuthology.orchestra.run.smithi113.stdout:Adding system user ceph....done 2023-12-22T09:58:21.725 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-12-22T09:58:21.831 INFO:teuthology.orchestra.run.smithi113.stdout:Setting system user ceph properties....done 2023-12-22T09:58:21.859 INFO:teuthology.orchestra.run.smithi113.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-12-22T09:58:22.052 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-12-22T09:58:22.134 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-12-22T09:58:22.570 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-12-22T09:58:22.615 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-rados (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:58:22.745 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up cephfs-top (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:58:22.974 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-rbd (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:58:23.136 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up rbd-fuse (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:58:23.262 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-routes (2.4.1-2) ... 2023-12-22T09:58:23.459 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up cephfs-mirror (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:58:23.646 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-12-22T09:58:23.724 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-12-22T09:58:23.724 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-12-22T09:58:24.031 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-rgw (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:58:24.494 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up ceph-test (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:58:24.502 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-cephfs (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:58:24.630 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up radosgw (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:58:24.887 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up cephfs-shell (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:58:24.942 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-12-22T09:58:24.942 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-12-22T09:58:25.014 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-12-22T09:58:26.157 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up ceph-base (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:58:26.202 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up ceph-common (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:58:26.635 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-12-22T09:58:26.851 INFO:teuthology.orchestra.run.smithi045.stdout:Adding group ceph....done 2023-12-22T09:58:27.338 INFO:teuthology.orchestra.run.smithi045.stdout:Adding system user ceph....done 2023-12-22T09:58:27.492 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up ceph-mds (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:58:27.563 INFO:teuthology.orchestra.run.smithi045.stdout:Setting system user ceph properties....done 2023-12-22T09:58:27.606 INFO:teuthology.orchestra.run.smithi045.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-12-22T09:58:27.766 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-12-22T09:58:27.767 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-12-22T09:58:27.810 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-12-22T09:58:28.386 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-12-22T09:58:28.610 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up ceph-mgr (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:58:28.890 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-12-22T09:58:28.890 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-12-22T09:58:29.362 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up cephfs-mirror (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:58:29.635 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-12-22T09:58:29.635 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-12-22T09:58:29.736 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up ceph-osd (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:58:30.531 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-12-22T09:58:30.531 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-12-22T09:58:30.555 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up ceph-test (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:58:30.690 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up radosgw (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:58:31.012 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-12-22T09:58:31.012 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-12-22T09:58:31.346 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up ceph-mgr-k8sevents (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:58:31.472 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up ceph-mgr-diskprediction-local (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:58:31.623 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up ceph-mon (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:58:31.883 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-12-22T09:58:31.884 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-12-22T09:58:32.301 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up ceph-base (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:58:32.750 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up ceph-mgr-cephadm (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:58:32.859 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-12-22T09:58:32.901 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up ceph (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:58:33.061 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up ceph-mgr-dashboard (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:58:33.213 INFO:teuthology.orchestra.run.smithi113.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-12-22T09:58:33.647 INFO:teuthology.orchestra.run.smithi113.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-12-22T09:58:33.777 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up ceph-mds (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:58:34.062 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-12-22T09:58:34.063 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-12-22T09:58:34.937 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up ceph-mgr (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:58:35.249 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-12-22T09:58:35.249 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-12-22T09:58:36.130 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up ceph-osd (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:58:36.971 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-12-22T09:58:36.971 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-12-22T09:58:37.840 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up ceph-mgr-k8sevents (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:58:37.966 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up ceph-mgr-diskprediction-local (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:58:38.150 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up ceph-mon (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:58:38.404 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-12-22T09:58:38.405 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-12-22T09:58:38.790 INFO:teuthology.orchestra.run.smithi113.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-12-22T09:58:39.293 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up ceph-mgr-cephadm (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:58:39.420 INFO:teuthology.orchestra.run.smithi113.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-22T09:58:39.426 DEBUG:teuthology.orchestra.run.smithi113:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2023-12-22T09:58:39.444 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up ceph (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:58:39.554 INFO:teuthology.orchestra.run.smithi113.stdout:Reading package lists... 2023-12-22T09:58:39.593 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up ceph-mgr-dashboard (16.2.14-395-g4ab91a45-1focal) ... 2023-12-22T09:58:39.747 INFO:teuthology.orchestra.run.smithi045.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-12-22T09:58:39.759 INFO:teuthology.orchestra.run.smithi113.stdout:Building dependency tree... 2023-12-22T09:58:39.760 INFO:teuthology.orchestra.run.smithi113.stdout:Reading state information... 2023-12-22T09:58:39.961 INFO:teuthology.orchestra.run.smithi113.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2023-12-22T09:58:39.961 INFO:teuthology.orchestra.run.smithi113.stdout:flex is already the newest version (2.6.4-6.2). 2023-12-22T09:58:39.961 INFO:teuthology.orchestra.run.smithi113.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2023-12-22T09:58:39.961 INFO:teuthology.orchestra.run.smithi113.stdout:libtool-bin is already the newest version (2.4.6-14). 2023-12-22T09:58:39.961 INFO:teuthology.orchestra.run.smithi113.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2023-12-22T09:58:39.961 INFO:teuthology.orchestra.run.smithi113.stdout:The following packages were automatically installed and are no longer required: 2023-12-22T09:58:39.962 INFO:teuthology.orchestra.run.smithi113.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-12-22T09:58:39.962 INFO:teuthology.orchestra.run.smithi113.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-22T09:58:39.962 INFO:teuthology.orchestra.run.smithi113.stdout:The following additional packages will be installed: 2023-12-22T09:58:39.963 INFO:teuthology.orchestra.run.smithi113.stdout: libbluetooth3 libdw1 libelf1 liblzo2-2 libmbim-glib4 libmbim-proxy 2023-12-22T09:58:39.963 INFO:teuthology.orchestra.run.smithi113.stdout: libmm-glib0 libndp0 libnm0 libqmi-glib5 libqmi-proxy libssl1.1 libteamdctl0 2023-12-22T09:58:39.963 INFO:teuthology.orchestra.run.smithi113.stdout: libuuid1 modemmanager network-manager-pptp ppp pptp-linux usb-modeswitch 2023-12-22T09:58:39.963 INFO:teuthology.orchestra.run.smithi113.stdout: usb-modeswitch-data wpasupplicant 2023-12-22T09:58:39.964 INFO:teuthology.orchestra.run.smithi113.stdout:Suggested packages: 2023-12-22T09:58:39.964 INFO:teuthology.orchestra.run.smithi113.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils comgt wvdial 2023-12-22T09:58:39.965 INFO:teuthology.orchestra.run.smithi113.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2023-12-22T09:58:40.056 INFO:teuthology.orchestra.run.smithi113.stdout:The following NEW packages will be installed: 2023-12-22T09:58:40.056 INFO:teuthology.orchestra.run.smithi113.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2023-12-22T09:58:40.056 INFO:teuthology.orchestra.run.smithi113.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libqmi-glib5 libqmi-proxy 2023-12-22T09:58:40.057 INFO:teuthology.orchestra.run.smithi113.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2023-12-22T09:58:40.057 INFO:teuthology.orchestra.run.smithi113.stdout: ppp pptp-linux usb-modeswitch usb-modeswitch-data wpasupplicant 2023-12-22T09:58:40.058 INFO:teuthology.orchestra.run.smithi113.stdout:The following packages will be upgraded: 2023-12-22T09:58:40.059 INFO:teuthology.orchestra.run.smithi113.stdout: libdw1 libelf1 libssl1.1 libuuid1 util-linux uuid-dev 2023-12-22T09:58:40.248 INFO:teuthology.orchestra.run.smithi045.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-12-22T09:58:40.277 INFO:teuthology.orchestra.run.smithi113.stdout:6 upgraded, 23 newly installed, 0 to remove and 256 not upgraded. 2023-12-22T09:58:40.277 INFO:teuthology.orchestra.run.smithi113.stdout:Need to get 10.4 MB of archives. 2023-12-22T09:58:40.277 INFO:teuthology.orchestra.run.smithi113.stdout:After this operation, 33.5 MB of additional disk space will be used. 2023-12-22T09:58:40.277 INFO:teuthology.orchestra.run.smithi113.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.4 [1,021 kB] 2023-12-22T09:58:40.916 INFO:teuthology.orchestra.run.smithi113.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.4 [33.6 kB] 2023-12-22T09:58:40.918 INFO:teuthology.orchestra.run.smithi113.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.4 [20.0 kB] 2023-12-22T09:58:40.919 INFO:teuthology.orchestra.run.smithi113.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2023-12-22T09:58:40.932 INFO:teuthology.orchestra.run.smithi113.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2023-12-22T09:58:40.934 INFO:teuthology.orchestra.run.smithi113.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.20 [1,321 kB] 2023-12-22T09:58:41.032 INFO:teuthology.orchestra.run.smithi113.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2023-12-22T09:58:41.034 INFO:teuthology.orchestra.run.smithi113.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2023-12-22T09:58:41.042 INFO:teuthology.orchestra.run.smithi113.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 indent amd64 2.2.12-1ubuntu0.20.04.1 [86.6 kB] 2023-12-22T09:58:41.046 INFO:teuthology.orchestra.run.smithi113.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2023-12-22T09:58:41.047 INFO:teuthology.orchestra.run.smithi113.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.7 [60.7 kB] 2023-12-22T09:58:41.215 INFO:teuthology.orchestra.run.smithi113.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2023-12-22T09:58:41.485 INFO:teuthology.orchestra.run.smithi113.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2023-12-22T09:58:41.629 INFO:teuthology.orchestra.run.smithi113.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2023-12-22T09:58:41.633 INFO:teuthology.orchestra.run.smithi113.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2023-12-22T09:58:41.736 INFO:teuthology.orchestra.run.smithi113.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 libndp0 amd64 1.7-0ubuntu1 [10.9 kB] 2023-12-22T09:58:41.740 INFO:teuthology.orchestra.run.smithi113.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.3 [370 kB] 2023-12-22T09:58:41.820 INFO:teuthology.orchestra.run.smithi113.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2023-12-22T09:58:41.896 INFO:teuthology.orchestra.run.smithi113.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2023-12-22T09:58:41.896 INFO:teuthology.orchestra.run.smithi113.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.20 [1,584 kB] 2023-12-22T09:58:41.985 INFO:teuthology.orchestra.run.smithi113.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2023-12-22T09:58:41.985 INFO:teuthology.orchestra.run.smithi113.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2023-12-22T09:58:42.178 INFO:teuthology.orchestra.run.smithi113.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.3 [1,183 kB] 2023-12-22T09:58:42.833 INFO:teuthology.orchestra.run.smithi113.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.3 [1,855 kB] 2023-12-22T09:58:42.948 INFO:teuthology.orchestra.run.smithi113.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2023-12-22T09:58:42.961 INFO:teuthology.orchestra.run.smithi113.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2023-12-22T09:58:42.963 INFO:teuthology.orchestra.run.smithi113.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2023-12-22T09:58:42.964 INFO:teuthology.orchestra.run.smithi113.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2023-12-22T09:58:42.966 INFO:teuthology.orchestra.run.smithi113.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2023-12-22T09:58:43.415 INFO:teuthology.orchestra.run.smithi113.stdout:Preconfiguring packages ... 2023-12-22T09:58:43.600 INFO:teuthology.orchestra.run.smithi113.stdout:Fetched 10.4 MB in 3s (3,599 kB/s) 2023-12-22T09:58:43.913 INFO:teuthology.orchestra.run.smithi113.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 115277 files and directories currently installed.) 2023-12-22T09:58:43.916 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.4_amd64.deb ... 2023-12-22T09:58:44.124 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking util-linux (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-12-22T09:58:45.575 INFO:teuthology.orchestra.run.smithi045.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-12-22T09:58:45.774 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up util-linux (2.34-0.1ubuntu9.4) ... 2023-12-22T09:58:46.246 INFO:teuthology.orchestra.run.smithi045.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-22T09:58:46.250 DEBUG:teuthology.orchestra.run.smithi045:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2023-12-22T09:58:46.380 INFO:teuthology.orchestra.run.smithi045.stdout:Reading package lists... 2023-12-22T09:58:46.590 INFO:teuthology.orchestra.run.smithi045.stdout:Building dependency tree... 2023-12-22T09:58:46.590 INFO:teuthology.orchestra.run.smithi045.stdout:Reading state information... 2023-12-22T09:58:46.805 INFO:teuthology.orchestra.run.smithi045.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2023-12-22T09:58:46.805 INFO:teuthology.orchestra.run.smithi045.stdout:flex is already the newest version (2.6.4-6.2). 2023-12-22T09:58:46.805 INFO:teuthology.orchestra.run.smithi045.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2023-12-22T09:58:46.806 INFO:teuthology.orchestra.run.smithi045.stdout:libtool-bin is already the newest version (2.4.6-14). 2023-12-22T09:58:46.806 INFO:teuthology.orchestra.run.smithi045.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2023-12-22T09:58:46.806 INFO:teuthology.orchestra.run.smithi045.stdout:The following packages were automatically installed and are no longer required: 2023-12-22T09:58:46.807 INFO:teuthology.orchestra.run.smithi045.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-12-22T09:58:46.807 INFO:teuthology.orchestra.run.smithi045.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-22T09:58:46.808 INFO:teuthology.orchestra.run.smithi045.stdout:The following additional packages will be installed: 2023-12-22T09:58:46.808 INFO:teuthology.orchestra.run.smithi045.stdout: libbluetooth3 libdw1 libelf1 liblzo2-2 libmbim-glib4 libmbim-proxy 2023-12-22T09:58:46.808 INFO:teuthology.orchestra.run.smithi045.stdout: libmm-glib0 libndp0 libnm0 libqmi-glib5 libqmi-proxy libssl1.1 libteamdctl0 2023-12-22T09:58:46.808 INFO:teuthology.orchestra.run.smithi045.stdout: libuuid1 modemmanager network-manager-pptp ppp pptp-linux usb-modeswitch 2023-12-22T09:58:46.808 INFO:teuthology.orchestra.run.smithi045.stdout: usb-modeswitch-data wpasupplicant 2023-12-22T09:58:46.809 INFO:teuthology.orchestra.run.smithi045.stdout:Suggested packages: 2023-12-22T09:58:46.809 INFO:teuthology.orchestra.run.smithi045.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils comgt wvdial 2023-12-22T09:58:46.809 INFO:teuthology.orchestra.run.smithi045.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2023-12-22T09:58:46.903 INFO:teuthology.orchestra.run.smithi045.stdout:The following NEW packages will be installed: 2023-12-22T09:58:46.903 INFO:teuthology.orchestra.run.smithi045.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2023-12-22T09:58:46.903 INFO:teuthology.orchestra.run.smithi045.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libqmi-glib5 libqmi-proxy 2023-12-22T09:58:46.904 INFO:teuthology.orchestra.run.smithi045.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2023-12-22T09:58:46.904 INFO:teuthology.orchestra.run.smithi045.stdout: ppp pptp-linux usb-modeswitch usb-modeswitch-data wpasupplicant 2023-12-22T09:58:46.906 INFO:teuthology.orchestra.run.smithi045.stdout:The following packages will be upgraded: 2023-12-22T09:58:46.907 INFO:teuthology.orchestra.run.smithi045.stdout: libdw1 libelf1 libssl1.1 libuuid1 util-linux uuid-dev 2023-12-22T09:58:46.983 INFO:teuthology.orchestra.run.smithi045.stdout:6 upgraded, 23 newly installed, 0 to remove and 256 not upgraded. 2023-12-22T09:58:46.983 INFO:teuthology.orchestra.run.smithi045.stdout:Need to get 10.4 MB of archives. 2023-12-22T09:58:46.983 INFO:teuthology.orchestra.run.smithi045.stdout:After this operation, 33.5 MB of additional disk space will be used. 2023-12-22T09:58:46.983 INFO:teuthology.orchestra.run.smithi045.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.4 [1,021 kB] 2023-12-22T09:58:47.142 INFO:teuthology.orchestra.run.smithi045.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.4 [33.6 kB] 2023-12-22T09:58:47.144 INFO:teuthology.orchestra.run.smithi045.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.4 [20.0 kB] 2023-12-22T09:58:47.145 INFO:teuthology.orchestra.run.smithi045.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2023-12-22T09:58:47.152 INFO:teuthology.orchestra.run.smithi045.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2023-12-22T09:58:47.152 INFO:teuthology.orchestra.run.smithi045.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.20 [1,321 kB] 2023-12-22T09:58:47.174 INFO:teuthology.orchestra.run.smithi045.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2023-12-22T09:58:47.175 INFO:teuthology.orchestra.run.smithi045.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2023-12-22T09:58:47.177 INFO:teuthology.orchestra.run.smithi045.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 indent amd64 2.2.12-1ubuntu0.20.04.1 [86.6 kB] 2023-12-22T09:58:47.178 INFO:teuthology.orchestra.run.smithi045.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2023-12-22T09:58:47.179 INFO:teuthology.orchestra.run.smithi045.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.7 [60.7 kB] 2023-12-22T09:58:47.181 INFO:teuthology.orchestra.run.smithi045.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2023-12-22T09:58:47.182 INFO:teuthology.orchestra.run.smithi045.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2023-12-22T09:58:47.184 INFO:teuthology.orchestra.run.smithi045.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2023-12-22T09:58:47.184 INFO:teuthology.orchestra.run.smithi045.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2023-12-22T09:58:47.201 INFO:teuthology.orchestra.run.smithi045.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 libndp0 amd64 1.7-0ubuntu1 [10.9 kB] 2023-12-22T09:58:47.202 INFO:teuthology.orchestra.run.smithi045.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.3 [370 kB] 2023-12-22T09:58:47.212 INFO:teuthology.orchestra.run.smithi045.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2023-12-22T09:58:47.219 INFO:teuthology.orchestra.run.smithi045.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2023-12-22T09:58:47.220 INFO:teuthology.orchestra.run.smithi045.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.20 [1,584 kB] 2023-12-22T09:58:47.238 INFO:teuthology.orchestra.run.smithi045.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2023-12-22T09:58:47.239 INFO:teuthology.orchestra.run.smithi045.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2023-12-22T09:58:47.248 INFO:teuthology.orchestra.run.smithi045.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.3 [1,183 kB] 2023-12-22T09:58:47.261 INFO:teuthology.orchestra.run.smithi045.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.3 [1,855 kB] 2023-12-22T09:58:47.279 INFO:teuthology.orchestra.run.smithi045.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2023-12-22T09:58:47.282 INFO:teuthology.orchestra.run.smithi045.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2023-12-22T09:58:47.282 INFO:teuthology.orchestra.run.smithi045.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2023-12-22T09:58:47.283 INFO:teuthology.orchestra.run.smithi045.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2023-12-22T09:58:47.283 INFO:teuthology.orchestra.run.smithi045.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2023-12-22T09:58:47.729 INFO:teuthology.orchestra.run.smithi045.stdout:Preconfiguring packages ... 2023-12-22T09:58:47.736 INFO:teuthology.orchestra.run.smithi113.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 115277 files and directories currently installed.) 2023-12-22T09:58:47.740 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.4_amd64.deb ... 2023-12-22T09:58:47.863 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-12-22T09:58:47.915 INFO:teuthology.orchestra.run.smithi045.stdout:Fetched 10.4 MB in 0s (28.4 MB/s) 2023-12-22T09:58:48.238 INFO:teuthology.orchestra.run.smithi045.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 115277 files and directories currently installed.) 2023-12-22T09:58:48.241 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.4_amd64.deb ... 2023-12-22T09:58:48.445 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking util-linux (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-12-22T09:58:48.616 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.4_amd64.deb ... 2023-12-22T09:58:48.786 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-12-22T09:58:49.155 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.4) ... 2023-12-22T09:58:49.675 INFO:teuthology.orchestra.run.smithi113.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 115277 files and directories currently installed.) 2023-12-22T09:58:49.678 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../00-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-12-22T09:58:49.836 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-12-22T09:58:50.349 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../01-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-12-22T09:58:50.462 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up util-linux (2.34-0.1ubuntu9.4) ... 2023-12-22T09:58:50.483 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-12-22T09:58:51.034 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../02-libssl1.1_1.1.1f-1ubuntu2.20_amd64.deb ... 2023-12-22T09:58:51.171 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.20) over (1.1.1f-1ubuntu2.16) ... 2023-12-22T09:58:51.734 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-12-22T09:58:51.747 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2023-12-22T09:58:51.800 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2023-12-22T09:58:52.119 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package dump. 2023-12-22T09:58:52.133 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2023-12-22T09:58:52.169 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking dump (0.4b46-6) ... 2023-12-22T09:58:52.481 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package indent. 2023-12-22T09:58:52.500 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../05-indent_2.2.12-1ubuntu0.20.04.1_amd64.deb ... 2023-12-22T09:58:52.539 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking indent (2.2.12-1ubuntu0.20.04.1) ... 2023-12-22T09:58:52.550 INFO:teuthology.orchestra.run.smithi045.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 115277 files and directories currently installed.) 2023-12-22T09:58:52.553 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.4_amd64.deb ... 2023-12-22T09:58:52.683 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-12-22T09:58:52.910 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-12-22T09:58:52.933 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2023-12-22T09:58:52.976 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2023-12-22T09:58:53.149 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.4_amd64.deb ... 2023-12-22T09:58:53.331 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-12-22T09:58:53.371 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-12-22T09:58:53.392 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../07-libbluetooth3_5.53-0ubuntu3.7_amd64.deb ... 2023-12-22T09:58:53.429 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.7) ... 2023-12-22T09:58:53.716 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.4) ... 2023-12-22T09:58:53.977 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-12-22T09:58:53.991 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../08-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2023-12-22T09:58:54.027 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-12-22T09:58:54.372 INFO:teuthology.orchestra.run.smithi045.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 115277 files and directories currently installed.) 2023-12-22T09:58:54.376 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../00-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-12-22T09:58:54.455 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-12-22T09:58:54.476 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../09-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-12-22T09:58:54.521 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-12-22T09:58:54.555 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-12-22T09:58:54.824 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package libmbim-proxy. 2023-12-22T09:58:54.845 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../10-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-12-22T09:58:54.882 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-12-22T09:58:55.085 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../01-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-12-22T09:58:55.219 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-12-22T09:58:55.260 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-12-22T09:58:55.274 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../11-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-12-22T09:58:55.319 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-12-22T09:58:55.705 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package libndp0:amd64. 2023-12-22T09:58:55.726 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../12-libndp0_1.7-0ubuntu1_amd64.deb ... 2023-12-22T09:58:55.771 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1) ... 2023-12-22T09:58:55.862 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../02-libssl1.1_1.1.1f-1ubuntu2.20_amd64.deb ... 2023-12-22T09:58:56.041 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.20) over (1.1.1f-1ubuntu2.16) ... 2023-12-22T09:58:56.158 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package libnm0:amd64. 2023-12-22T09:58:56.181 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../13-libnm0_1.22.10-1ubuntu2.3_amd64.deb ... 2023-12-22T09:58:56.224 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-12-22T09:58:56.619 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-12-22T09:58:56.639 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../14-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-12-22T09:58:56.708 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-12-22T09:58:56.719 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-12-22T09:58:56.734 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2023-12-22T09:58:56.778 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2023-12-22T09:58:57.080 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package libqmi-proxy. 2023-12-22T09:58:57.099 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../15-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-12-22T09:58:57.138 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-12-22T09:58:57.200 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package dump. 2023-12-22T09:58:57.222 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2023-12-22T09:58:57.266 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking dump (0.4b46-6) ... 2023-12-22T09:58:57.441 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-12-22T09:58:57.459 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../16-libssl-dev_1.1.1f-1ubuntu2.20_amd64.deb ... 2023-12-22T09:58:57.499 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.20) ... 2023-12-22T09:58:57.636 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package indent. 2023-12-22T09:58:57.658 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../05-indent_2.2.12-1ubuntu0.20.04.1_amd64.deb ... 2023-12-22T09:58:57.702 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking indent (2.2.12-1ubuntu0.20.04.1) ... 2023-12-22T09:58:58.044 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-12-22T09:58:58.064 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../17-libteamdctl0_1.30-1_amd64.deb ... 2023-12-22T09:58:58.072 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-12-22T09:58:58.092 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2023-12-22T09:58:58.102 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2023-12-22T09:58:58.130 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2023-12-22T09:58:58.450 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-12-22T09:58:58.469 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../07-libbluetooth3_5.53-0ubuntu3.7_amd64.deb ... 2023-12-22T09:58:58.500 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.7) ... 2023-12-22T09:58:58.547 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package modemmanager. 2023-12-22T09:58:58.569 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../18-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-12-22T09:58:58.637 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-12-22T09:58:58.803 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-12-22T09:58:58.824 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../08-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2023-12-22T09:58:58.869 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-12-22T09:58:59.287 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package wpasupplicant. 2023-12-22T09:58:59.289 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-12-22T09:58:59.309 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../19-wpasupplicant_2%3a2.9-1ubuntu4.3_amd64.deb ... 2023-12-22T09:58:59.310 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../09-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-12-22T09:58:59.353 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-12-22T09:58:59.355 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-12-22T09:58:59.692 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libmbim-proxy. 2023-12-22T09:58:59.713 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../10-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-12-22T09:58:59.758 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-12-22T09:58:59.950 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package network-manager. 2023-12-22T09:58:59.964 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../20-network-manager_1.22.10-1ubuntu2.3_amd64.deb ... 2023-12-22T09:59:00.052 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking network-manager (1.22.10-1ubuntu2.3) ... 2023-12-22T09:59:00.144 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-12-22T09:59:00.167 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../11-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-12-22T09:59:00.211 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-12-22T09:59:00.774 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libndp0:amd64. 2023-12-22T09:59:00.795 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../12-libndp0_1.7-0ubuntu1_amd64.deb ... 2023-12-22T09:59:00.839 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1) ... 2023-12-22T09:59:00.874 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package ppp. 2023-12-22T09:59:00.895 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../21-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2023-12-22T09:59:01.227 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libnm0:amd64. 2023-12-22T09:59:01.247 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../13-libnm0_1.22.10-1ubuntu2.3_amd64.deb ... 2023-12-22T09:59:01.292 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-12-22T09:59:01.410 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-12-22T09:59:01.728 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-12-22T09:59:01.747 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../14-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-12-22T09:59:01.779 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package pptp-linux. 2023-12-22T09:59:01.786 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-12-22T09:59:01.801 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../22-pptp-linux_1.10.0-1build1_amd64.deb ... 2023-12-22T09:59:01.846 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2023-12-22T09:59:02.173 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libqmi-proxy. 2023-12-22T09:59:02.195 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../15-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-12-22T09:59:02.239 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-12-22T09:59:02.265 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package network-manager-pptp. 2023-12-22T09:59:02.287 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../23-network-manager-pptp_1.2.8-2_amd64.deb ... 2023-12-22T09:59:02.367 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2023-12-22T09:59:02.500 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-12-22T09:59:02.522 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../16-libssl-dev_1.1.1f-1ubuntu2.20_amd64.deb ... 2023-12-22T09:59:02.566 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.20) ... 2023-12-22T09:59:02.660 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-12-22T09:59:02.681 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../24-usb-modeswitch-data_20191128-3_all.deb ... 2023-12-22T09:59:02.726 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2023-12-22T09:59:03.161 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-12-22T09:59:03.163 INFO:teuthology.orchestra.run.smithi113.stdout:Selecting previously unselected package usb-modeswitch. 2023-12-22T09:59:03.181 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../17-libteamdctl0_1.30-1_amd64.deb ... 2023-12-22T09:59:03.184 INFO:teuthology.orchestra.run.smithi113.stdout:Preparing to unpack .../25-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2023-12-22T09:59:03.219 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2023-12-22T09:59:03.251 INFO:teuthology.orchestra.run.smithi113.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-12-22T09:59:03.600 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.20) ... 2023-12-22T09:59:03.652 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package modemmanager. 2023-12-22T09:59:03.673 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../18-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-12-22T09:59:03.747 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-12-22T09:59:04.002 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2023-12-22T09:59:04.128 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2023-12-22T09:59:04.254 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-12-22T09:59:04.412 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package wpasupplicant. 2023-12-22T09:59:04.431 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../19-wpasupplicant_2%3a2.9-1ubuntu4.3_amd64.deb ... 2023-12-22T09:59:04.469 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-12-22T09:59:04.707 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-12-22T09:59:04.707 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-12-22T09:59:05.058 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package network-manager. 2023-12-22T09:59:05.077 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../20-network-manager_1.22.10-1ubuntu2.3_amd64.deb ... 2023-12-22T09:59:05.172 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking network-manager (1.22.10-1ubuntu2.3) ... 2023-12-22T09:59:05.565 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.4) ... 2023-12-22T09:59:05.691 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2023-12-22T09:59:05.817 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.20) ... 2023-12-22T09:59:05.943 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2023-12-22T09:59:05.965 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package ppp. 2023-12-22T09:59:05.986 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../21-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2023-12-22T09:59:06.103 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-12-22T09:59:06.229 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-12-22T09:59:06.493 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-12-22T09:59:06.936 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package pptp-linux. 2023-12-22T09:59:06.956 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../22-pptp-linux_1.10.0-1build1_amd64.deb ... 2023-12-22T09:59:06.994 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2023-12-22T09:59:07.406 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package network-manager-pptp. 2023-12-22T09:59:07.425 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../23-network-manager-pptp_1.2.8-2_amd64.deb ... 2023-12-22T09:59:07.456 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2023-12-22T09:59:07.500 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2023-12-22T09:59:07.809 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-12-22T09:59:07.830 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../24-usb-modeswitch-data_20191128-3_all.deb ... 2023-12-22T09:59:07.874 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2023-12-22T09:59:07.893 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up dump (0.4b46-6) ... 2023-12-22T09:59:08.000 INFO:teuthology.orchestra.run.smithi113.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-12-22T09:59:08.070 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-12-22T09:59:08.195 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.7) ... 2023-12-22T09:59:08.320 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package usb-modeswitch. 2023-12-22T09:59:08.342 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../25-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2023-12-22T09:59:08.346 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up indent (2.2.12-1ubuntu0.20.04.1) ... 2023-12-22T09:59:08.409 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-12-22T09:59:08.474 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-12-22T09:59:08.666 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1) ... 2023-12-22T09:59:08.769 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.20) ... 2023-12-22T09:59:08.792 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2023-12-22T09:59:08.943 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-12-22T09:59:09.086 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2023-12-22T09:59:09.125 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2023-12-22T09:59:09.242 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2023-12-22T09:59:09.262 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2023-12-22T09:59:09.388 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up network-manager (1.22.10-1ubuntu2.3) ... 2023-12-22T09:59:09.401 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-12-22T09:59:09.840 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-12-22T09:59:09.840 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-12-22T09:59:10.596 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-22T09:59:10.596 INFO:teuthology.orchestra.run.smithi113.stdout:The following network interfaces were found in /etc/network/interfaces 2023-12-22T09:59:10.597 INFO:teuthology.orchestra.run.smithi113.stdout:which means they are currently configured by ifupdown: 2023-12-22T09:59:10.597 INFO:teuthology.orchestra.run.smithi113.stdout:- enp3s0f1 2023-12-22T09:59:10.597 INFO:teuthology.orchestra.run.smithi113.stdout:If you want to manage those interfaces with NetworkManager instead 2023-12-22T09:59:10.597 INFO:teuthology.orchestra.run.smithi113.stdout:remove their configuration from /etc/network/interfaces. 2023-12-22T09:59:10.597 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-22T09:59:10.833 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-12-22T09:59:10.862 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.4) ... 2023-12-22T09:59:10.988 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2023-12-22T09:59:11.123 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.20) ... 2023-12-22T09:59:11.249 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2023-12-22T09:59:11.376 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-12-22T09:59:11.408 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-12-22T09:59:11.534 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-12-22T09:59:12.325 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-12-22T09:59:12.813 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2023-12-22T09:59:13.258 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-12-22T09:59:13.265 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up dump (0.4b46-6) ... 2023-12-22T09:59:13.364 INFO:teuthology.orchestra.run.smithi045.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-12-22T09:59:13.393 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2023-12-22T09:59:13.450 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-12-22T09:59:13.575 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.7) ... 2023-12-22T09:59:13.577 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-12-22T09:59:13.702 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up indent (2.2.12-1ubuntu0.20.04.1) ... 2023-12-22T09:59:13.703 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-12-22T09:59:13.827 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-12-22T09:59:13.829 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-12-22T09:59:13.947 INFO:teuthology.orchestra.run.smithi113.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-12-22T09:59:14.062 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1) ... 2023-12-22T09:59:14.188 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2023-12-22T09:59:14.300 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-12-22T09:59:14.300 INFO:teuthology.orchestra.run.smithi113.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-12-22T09:59:14.314 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-12-22T09:59:14.465 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2023-12-22T09:59:14.625 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2023-12-22T09:59:14.751 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up network-manager (1.22.10-1ubuntu2.3) ... 2023-12-22T09:59:15.266 INFO:teuthology.orchestra.run.smithi113.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2023-12-22T09:59:15.376 INFO:teuthology.orchestra.run.smithi113.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-12-22T09:59:15.501 INFO:teuthology.orchestra.run.smithi113.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-12-22T09:59:15.653 INFO:teuthology.orchestra.run.smithi113.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-12-22T09:59:15.991 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T09:59:15.991 INFO:teuthology.orchestra.run.smithi045.stdout:The following network interfaces were found in /etc/network/interfaces 2023-12-22T09:59:15.991 INFO:teuthology.orchestra.run.smithi045.stdout:which means they are currently configured by ifupdown: 2023-12-22T09:59:15.991 INFO:teuthology.orchestra.run.smithi045.stdout:- ens1f0 2023-12-22T09:59:15.991 INFO:teuthology.orchestra.run.smithi045.stdout:If you want to manage those interfaces with NetworkManager instead 2023-12-22T09:59:15.991 INFO:teuthology.orchestra.run.smithi045.stdout:remove their configuration from /etc/network/interfaces. 2023-12-22T09:59:15.991 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T09:59:16.104 INFO:teuthology.orchestra.run.smithi113.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-12-22T09:59:16.237 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-12-22T09:59:16.813 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-12-22T09:59:17.768 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-12-22T09:59:18.737 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-12-22T09:59:18.871 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2023-12-22T09:59:19.056 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-12-22T09:59:19.182 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-12-22T09:59:19.308 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-12-22T09:59:19.434 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-12-22T09:59:19.794 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-12-22T09:59:19.794 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-12-22T09:59:20.786 INFO:teuthology.orchestra.run.smithi045.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2023-12-22T09:59:21.149 INFO:teuthology.orchestra.run.smithi045.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-12-22T09:59:21.771 INFO:teuthology.orchestra.run.smithi045.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-12-22T09:59:21.940 INFO:teuthology.orchestra.run.smithi045.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-12-22T09:59:22.425 INFO:teuthology.orchestra.run.smithi045.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-12-22T09:59:23.039 INFO:teuthology.orchestra.run.smithi113.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2023-12-22T09:59:23.156 INFO:teuthology.orchestra.run.smithi113.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2023-12-22T09:59:24.397 INFO:teuthology.orchestra.run.smithi113.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-22T09:59:24.410 DEBUG:teuthology.parallel:result is None 2023-12-22T09:59:29.460 INFO:teuthology.orchestra.run.smithi045.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2023-12-22T09:59:29.559 INFO:teuthology.orchestra.run.smithi045.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2023-12-22T09:59:30.845 INFO:teuthology.orchestra.run.smithi045.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-22T09:59:30.853 DEBUG:teuthology.parallel:result is None 2023-12-22T09:59:30.853 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=4ab91a455dc86ea102fdfa1407dbcce323929634 2023-12-22T09:59:30.996 DEBUG:teuthology.orchestra.run.smithi045:> dpkg-query -W -f '${Version}' ceph 2023-12-22T09:59:31.035 INFO:teuthology.orchestra.run.smithi045.stdout:16.2.14-395-g4ab91a45-1focal 2023-12-22T09:59:31.035 INFO:teuthology.packaging:The installed version of ceph is 16.2.14-395-g4ab91a45-1focal 2023-12-22T09:59:31.036 INFO:teuthology.task.install:The correct ceph version 16.2.14-395-g4ab91a45-1focal is installed. 2023-12-22T09:59:31.037 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=4ab91a455dc86ea102fdfa1407dbcce323929634 2023-12-22T09:59:31.189 DEBUG:teuthology.orchestra.run.smithi113:> dpkg-query -W -f '${Version}' ceph 2023-12-22T09:59:31.225 INFO:teuthology.orchestra.run.smithi113.stdout:16.2.14-395-g4ab91a45-1focal 2023-12-22T09:59:31.226 INFO:teuthology.packaging:The installed version of ceph is 16.2.14-395-g4ab91a45-1focal 2023-12-22T09:59:31.226 INFO:teuthology.task.install:The correct ceph version 16.2.14-395-g4ab91a45-1focal is installed. 2023-12-22T09:59:31.228 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-12-22T09:59:31.228 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-22T09:59:31.228 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-22T09:59:31.263 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-22T09:59:31.263 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-22T09:59:31.305 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-12-22T09:59:31.305 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-22T09:59:31.305 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/usr/bin/daemon-helper 2023-12-22T09:59:31.341 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-22T09:59:31.417 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-22T09:59:31.417 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd of=/usr/bin/daemon-helper 2023-12-22T09:59:31.448 DEBUG:teuthology.orchestra.run.smithi113:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-22T09:59:31.523 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-12-22T09:59:31.523 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-22T09:59:31.523 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-22T09:59:31.557 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-22T09:59:31.642 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-22T09:59:31.642 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-22T09:59:31.679 DEBUG:teuthology.orchestra.run.smithi113:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-22T09:59:31.758 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-12-22T09:59:31.758 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-22T09:59:31.758 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/usr/bin/stdin-killer 2023-12-22T09:59:31.793 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-22T09:59:31.878 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-22T09:59:31.904 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd of=/usr/bin/stdin-killer 2023-12-22T09:59:31.942 DEBUG:teuthology.orchestra.run.smithi113:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-22T09:59:32.021 INFO:teuthology.run_tasks:Running task ceph... 2023-12-22T09:59:32.121 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-12-22T09:59:32.122 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 777 /var/log/ceph 2023-12-22T09:59:32.129 DEBUG:teuthology.orchestra.run.smithi113:> sudo chmod 777 /var/log/ceph 2023-12-22T09:59:32.166 INFO:tasks.ceph:Disabling ceph logrotate... 2023-12-22T09:59:32.166 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-22T09:59:32.212 DEBUG:teuthology.orchestra.run.smithi113:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-22T09:59:32.244 INFO:tasks.ceph:Creating extra log directories... 2023-12-22T09:59:32.244 DEBUG:teuthology.orchestra.run.smithi045:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-22T09:59:32.288 DEBUG:teuthology.orchestra.run.smithi113:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-22T09:59:32.331 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-12-22T09:59:32.331 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-12-22T09:59:32.331 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-12-22T09:59:32.332 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-22T09:59:32.332 DEBUG:teuthology.orchestra.run.smithi045:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-12-22T09:59:32.380 DEBUG:teuthology.orchestra.run.smithi045:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-12-22T09:59:32.510 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-22T09:59:32.510 DEBUG:teuthology.orchestra.run.smithi113:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-12-22T09:59:32.527 DEBUG:teuthology.orchestra.run.smithi113:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-12-22T09:59:32.664 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-12-22T09:59:32.664 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'bad backtrace', 'object missing on disk', 'error reading table object', 'error reading sessionmap', 'unmatched fragstat', 'unmatched rstat', 'was unreadable, recreating it now', 'Scrub error on inode', 'Metadata damage detected', 'MDS_FAILED', 'MDS_DAMAGE'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-12-22T09:59:32.664 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2023-12-22_08:19:05-fs-rishabh-mdscap-pacific-testing-default-smithi/7499495', 'branch': 'rishabh-mdscap-pacific', 'description': 'fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/alternate-pool}', 'email': None, 'first_in_suite': False, 'job_id': '7499495', 'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '623393c9d50c04c7ea1d88824b8e92712e3e5611'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'rishabh-2023-12-22_08:19:05-fs-rishabh-mdscap-pacific-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '20.04', 'overrides': {'admin_socket': {'branch': 'rishabh-mdscap-pacific'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'bad backtrace', 'object missing on disk', 'error reading table object', 'error reading sessionmap', 'unmatched fragstat', 'unmatched rstat', 'was unreadable, recreating it now', 'Scrub error on inode', 'Metadata damage detected', 'MDS_FAILED', 'MDS_DAMAGE'], 'sha1': '4ab91a455dc86ea102fdfa1407dbcce323929634'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '4ab91a455dc86ea102fdfa1407dbcce323929634'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'rishabh-mdscap-pacific', 'sha1': '4ab91a455dc86ea102fdfa1407dbcce323929634'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 70, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 405, 'sha1': '4ab91a455dc86ea102fdfa1407dbcce323929634', 'sleep_before_teardown': 0, 'subset': '293/512', 'suite': 'fs', 'suite_branch': 'rishabh-mdscap-pacific', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_4ab91a455dc86ea102fdfa1407dbcce323929634/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '4ab91a455dc86ea102fdfa1407dbcce323929634', 'targets': {'smithi045.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM=', 'smithi113.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '623393c9d50c04c7ea1d88824b8e92712e3e5611'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '4ab91a455dc86ea102fdfa1407dbcce323929634'}}, {'ceph': None}, {'ceph-fuse': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_recovery_pool']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '9680d2aba1e76f64ade295c81599c97907457848', 'timestamp': '2023-12-22_08:19:05', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.1485078'} 2023-12-22T09:59:32.665 DEBUG:teuthology.orchestra.run.smithi045:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-12-22T09:59:32.673 DEBUG:teuthology.orchestra.run.smithi113:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-12-22T09:59:32.691 DEBUG:teuthology.orchestra.run.smithi045:> sudo install -d -m0777 -- /var/run/ceph 2023-12-22T09:59:32.737 DEBUG:teuthology.orchestra.run.smithi113:> sudo install -d -m0777 -- /var/run/ceph 2023-12-22T09:59:32.779 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-22T09:59:32.779 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/scratch_devs of=/dev/stdout 2023-12-22T09:59:32.826 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-22T09:59:32.826 DEBUG:teuthology.orchestra.run.smithi045:> stat /dev/vg_nvme/lv_1 2023-12-22T09:59:32.889 INFO:teuthology.orchestra.run.smithi045.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-22T09:59:32.890 INFO:teuthology.orchestra.run.smithi045.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-22T09:59:32.890 INFO:teuthology.orchestra.run.smithi045.stdout:Device: 5h/5d Inode: 493 Links: 1 2023-12-22T09:59:32.890 INFO:teuthology.orchestra.run.smithi045.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-22T09:59:32.890 INFO:teuthology.orchestra.run.smithi045.stdout:Access: 2023-12-22 09:54:25.030158961 +0000 2023-12-22T09:59:32.890 INFO:teuthology.orchestra.run.smithi045.stdout:Modify: 2023-12-22 09:54:24.530166490 +0000 2023-12-22T09:59:32.890 INFO:teuthology.orchestra.run.smithi045.stdout:Change: 2023-12-22 09:54:24.530166490 +0000 2023-12-22T09:59:32.890 INFO:teuthology.orchestra.run.smithi045.stdout: Birth: - 2023-12-22T09:59:32.891 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-22T09:59:32.967 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records in 2023-12-22T09:59:32.967 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records out 2023-12-22T09:59:32.967 INFO:teuthology.orchestra.run.smithi045.stderr:512 bytes copied, 0.000638086 s, 802 kB/s 2023-12-22T09:59:32.969 DEBUG:teuthology.orchestra.run.smithi045:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-22T09:59:33.036 DEBUG:teuthology.orchestra.run.smithi045:> stat /dev/vg_nvme/lv_2 2023-12-22T09:59:33.096 INFO:teuthology.orchestra.run.smithi045.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-22T09:59:33.096 INFO:teuthology.orchestra.run.smithi045.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-22T09:59:33.096 INFO:teuthology.orchestra.run.smithi045.stdout:Device: 5h/5d Inode: 500 Links: 1 2023-12-22T09:59:33.096 INFO:teuthology.orchestra.run.smithi045.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-22T09:59:33.096 INFO:teuthology.orchestra.run.smithi045.stdout:Access: 2023-12-22 09:54:25.810146475 +0000 2023-12-22T09:59:33.096 INFO:teuthology.orchestra.run.smithi045.stdout:Modify: 2023-12-22 09:54:25.302154607 +0000 2023-12-22T09:59:33.096 INFO:teuthology.orchestra.run.smithi045.stdout:Change: 2023-12-22 09:54:25.302154607 +0000 2023-12-22T09:59:33.096 INFO:teuthology.orchestra.run.smithi045.stdout: Birth: - 2023-12-22T09:59:33.097 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-22T09:59:33.171 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records in 2023-12-22T09:59:33.171 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records out 2023-12-22T09:59:33.171 INFO:teuthology.orchestra.run.smithi045.stderr:512 bytes copied, 0.000591917 s, 865 kB/s 2023-12-22T09:59:33.174 DEBUG:teuthology.orchestra.run.smithi045:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-22T09:59:33.242 DEBUG:teuthology.orchestra.run.smithi045:> stat /dev/vg_nvme/lv_3 2023-12-22T09:59:33.303 INFO:teuthology.orchestra.run.smithi045.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-22T09:59:33.303 INFO:teuthology.orchestra.run.smithi045.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-22T09:59:33.304 INFO:teuthology.orchestra.run.smithi045.stdout:Device: 5h/5d Inode: 506 Links: 1 2023-12-22T09:59:33.304 INFO:teuthology.orchestra.run.smithi045.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-22T09:59:33.304 INFO:teuthology.orchestra.run.smithi045.stdout:Access: 2023-12-22 09:54:26.706132133 +0000 2023-12-22T09:59:33.304 INFO:teuthology.orchestra.run.smithi045.stdout:Modify: 2023-12-22 09:54:26.202140200 +0000 2023-12-22T09:59:33.304 INFO:teuthology.orchestra.run.smithi045.stdout:Change: 2023-12-22 09:54:26.202140200 +0000 2023-12-22T09:59:33.304 INFO:teuthology.orchestra.run.smithi045.stdout: Birth: - 2023-12-22T09:59:33.304 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-22T09:59:33.377 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records in 2023-12-22T09:59:33.377 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records out 2023-12-22T09:59:33.378 INFO:teuthology.orchestra.run.smithi045.stderr:512 bytes copied, 0.000639709 s, 800 kB/s 2023-12-22T09:59:33.381 DEBUG:teuthology.orchestra.run.smithi045:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-22T09:59:33.449 DEBUG:teuthology.orchestra.run.smithi045:> stat /dev/vg_nvme/lv_4 2023-12-22T09:59:33.513 INFO:teuthology.orchestra.run.smithi045.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-22T09:59:33.513 INFO:teuthology.orchestra.run.smithi045.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-22T09:59:33.513 INFO:teuthology.orchestra.run.smithi045.stdout:Device: 5h/5d Inode: 511 Links: 1 2023-12-22T09:59:33.513 INFO:teuthology.orchestra.run.smithi045.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-22T09:59:33.513 INFO:teuthology.orchestra.run.smithi045.stdout:Access: 2023-12-22 09:54:27.498119456 +0000 2023-12-22T09:59:33.513 INFO:teuthology.orchestra.run.smithi045.stdout:Modify: 2023-12-22 09:54:26.982127715 +0000 2023-12-22T09:59:33.513 INFO:teuthology.orchestra.run.smithi045.stdout:Change: 2023-12-22 09:54:26.982127715 +0000 2023-12-22T09:59:33.514 INFO:teuthology.orchestra.run.smithi045.stdout: Birth: - 2023-12-22T09:59:33.514 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-22T09:59:33.590 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records in 2023-12-22T09:59:33.590 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records out 2023-12-22T09:59:33.590 INFO:teuthology.orchestra.run.smithi045.stderr:512 bytes copied, 0.000581548 s, 880 kB/s 2023-12-22T09:59:33.594 DEBUG:teuthology.orchestra.run.smithi045:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-22T09:59:33.665 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-22T09:59:33.665 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-22T09:59:33.665 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/scratch_devs of=/dev/stdout 2023-12-22T09:59:33.682 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-22T09:59:33.683 DEBUG:teuthology.orchestra.run.smithi113:> stat /dev/vg_nvme/lv_1 2023-12-22T09:59:33.749 INFO:teuthology.orchestra.run.smithi113.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-22T09:59:33.749 INFO:teuthology.orchestra.run.smithi113.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-22T09:59:33.749 INFO:teuthology.orchestra.run.smithi113.stdout:Device: 5h/5d Inode: 496 Links: 1 2023-12-22T09:59:33.749 INFO:teuthology.orchestra.run.smithi113.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-22T09:59:33.749 INFO:teuthology.orchestra.run.smithi113.stdout:Access: 2023-12-22 09:54:19.127221251 +0000 2023-12-22T09:59:33.749 INFO:teuthology.orchestra.run.smithi113.stdout:Modify: 2023-12-22 09:54:18.647256678 +0000 2023-12-22T09:59:33.750 INFO:teuthology.orchestra.run.smithi113.stdout:Change: 2023-12-22 09:54:18.647256678 +0000 2023-12-22T09:59:33.750 INFO:teuthology.orchestra.run.smithi113.stdout: Birth: - 2023-12-22T09:59:33.750 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-22T09:59:33.827 INFO:teuthology.orchestra.run.smithi113.stderr:1+0 records in 2023-12-22T09:59:33.827 INFO:teuthology.orchestra.run.smithi113.stderr:1+0 records out 2023-12-22T09:59:33.827 INFO:teuthology.orchestra.run.smithi113.stderr:512 bytes copied, 0.000713874 s, 717 kB/s 2023-12-22T09:59:33.829 DEBUG:teuthology.orchestra.run.smithi113:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-22T09:59:33.894 DEBUG:teuthology.orchestra.run.smithi113:> stat /dev/vg_nvme/lv_2 2023-12-22T09:59:33.957 INFO:teuthology.orchestra.run.smithi113.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-22T09:59:33.957 INFO:teuthology.orchestra.run.smithi113.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-22T09:59:33.957 INFO:teuthology.orchestra.run.smithi113.stdout:Device: 5h/5d Inode: 501 Links: 1 2023-12-22T09:59:33.957 INFO:teuthology.orchestra.run.smithi113.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-22T09:59:33.957 INFO:teuthology.orchestra.run.smithi113.stdout:Access: 2023-12-22 09:54:19.935162217 +0000 2023-12-22T09:59:33.958 INFO:teuthology.orchestra.run.smithi113.stdout:Modify: 2023-12-22 09:54:19.439198456 +0000 2023-12-22T09:59:33.958 INFO:teuthology.orchestra.run.smithi113.stdout:Change: 2023-12-22 09:54:19.439198456 +0000 2023-12-22T09:59:33.958 INFO:teuthology.orchestra.run.smithi113.stdout: Birth: - 2023-12-22T09:59:33.958 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-22T09:59:34.031 INFO:teuthology.orchestra.run.smithi113.stderr:1+0 records in 2023-12-22T09:59:34.031 INFO:teuthology.orchestra.run.smithi113.stderr:1+0 records out 2023-12-22T09:59:34.031 INFO:teuthology.orchestra.run.smithi113.stderr:512 bytes copied, 0.000551161 s, 929 kB/s 2023-12-22T09:59:34.033 DEBUG:teuthology.orchestra.run.smithi113:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-22T09:59:34.102 DEBUG:teuthology.orchestra.run.smithi113:> stat /dev/vg_nvme/lv_3 2023-12-22T09:59:34.164 INFO:teuthology.orchestra.run.smithi113.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-22T09:59:34.164 INFO:teuthology.orchestra.run.smithi113.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-22T09:59:34.164 INFO:teuthology.orchestra.run.smithi113.stdout:Device: 5h/5d Inode: 508 Links: 1 2023-12-22T09:59:34.164 INFO:teuthology.orchestra.run.smithi113.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-22T09:59:34.164 INFO:teuthology.orchestra.run.smithi113.stdout:Access: 2023-12-22 09:54:20.687108640 +0000 2023-12-22T09:59:34.164 INFO:teuthology.orchestra.run.smithi113.stdout:Modify: 2023-12-22 09:54:20.231141043 +0000 2023-12-22T09:59:34.164 INFO:teuthology.orchestra.run.smithi113.stdout:Change: 2023-12-22 09:54:20.231141043 +0000 2023-12-22T09:59:34.164 INFO:teuthology.orchestra.run.smithi113.stdout: Birth: - 2023-12-22T09:59:34.164 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-22T09:59:34.237 INFO:teuthology.orchestra.run.smithi113.stderr:1+0 records in 2023-12-22T09:59:34.237 INFO:teuthology.orchestra.run.smithi113.stderr:1+0 records out 2023-12-22T09:59:34.237 INFO:teuthology.orchestra.run.smithi113.stderr:512 bytes copied, 0.000770216 s, 665 kB/s 2023-12-22T09:59:34.240 DEBUG:teuthology.orchestra.run.smithi113:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-22T09:59:34.309 DEBUG:teuthology.orchestra.run.smithi113:> stat /dev/vg_nvme/lv_4 2023-12-22T09:59:34.368 INFO:teuthology.orchestra.run.smithi113.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-22T09:59:34.368 INFO:teuthology.orchestra.run.smithi113.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-22T09:59:34.368 INFO:teuthology.orchestra.run.smithi113.stdout:Device: 5h/5d Inode: 514 Links: 1 2023-12-22T09:59:34.368 INFO:teuthology.orchestra.run.smithi113.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-22T09:59:34.368 INFO:teuthology.orchestra.run.smithi113.stdout:Access: 2023-12-22 09:54:21.483052553 +0000 2023-12-22T09:59:34.368 INFO:teuthology.orchestra.run.smithi113.stdout:Modify: 2023-12-22 09:54:21.007085902 +0000 2023-12-22T09:59:34.368 INFO:teuthology.orchestra.run.smithi113.stdout:Change: 2023-12-22 09:54:21.007085902 +0000 2023-12-22T09:59:34.368 INFO:teuthology.orchestra.run.smithi113.stdout: Birth: - 2023-12-22T09:59:34.368 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-22T09:59:34.443 INFO:teuthology.orchestra.run.smithi113.stderr:1+0 records in 2023-12-22T09:59:34.444 INFO:teuthology.orchestra.run.smithi113.stderr:1+0 records out 2023-12-22T09:59:34.444 INFO:teuthology.orchestra.run.smithi113.stderr:512 bytes copied, 0.000488254 s, 1.0 MB/s 2023-12-22T09:59:34.446 DEBUG:teuthology.orchestra.run.smithi113:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-22T09:59:34.510 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-22T09:59:34.510 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi045.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi113.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-12-22T09:59:34.510 INFO:tasks.ceph:Generating config... 2023-12-22T09:59:34.511 INFO:tasks.ceph:[client] client mount timeout = 600 2023-12-22T09:59:34.512 INFO:tasks.ceph:[client] debug client = 20 2023-12-22T09:59:34.512 INFO:tasks.ceph:[client] debug ms = 1 2023-12-22T09:59:34.512 INFO:tasks.ceph:[client] pid file = 2023-12-22T09:59:34.512 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-12-22T09:59:34.512 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-12-22T09:59:34.512 INFO:tasks.ceph:[mds] debug mds = 20 2023-12-22T09:59:34.512 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-12-22T09:59:34.512 INFO:tasks.ceph:[mds] debug ms = 1 2023-12-22T09:59:34.512 INFO:tasks.ceph:[mds] mds debug frag = True 2023-12-22T09:59:34.512 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-12-22T09:59:34.512 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-12-22T09:59:34.512 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-12-22T09:59:34.512 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-12-22T09:59:34.512 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-12-22T09:59:34.513 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-12-22T09:59:34.513 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-12-22T09:59:34.513 INFO:tasks.ceph:[mgr] debug ms = 1 2023-12-22T09:59:34.513 INFO:tasks.ceph:[mon] debug mon = 20 2023-12-22T09:59:34.513 INFO:tasks.ceph:[mon] debug ms = 1 2023-12-22T09:59:34.513 INFO:tasks.ceph:[mon] debug paxos = 20 2023-12-22T09:59:34.513 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-12-22T09:59:34.513 INFO:tasks.ceph:[osd] bdev async discard = True 2023-12-22T09:59:34.513 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-12-22T09:59:34.513 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-12-22T09:59:34.513 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-12-22T09:59:34.513 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-12-22T09:59:34.513 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-12-22T09:59:34.514 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-12-22T09:59:34.514 INFO:tasks.ceph:[osd] debug ms = 1 2023-12-22T09:59:34.514 INFO:tasks.ceph:[osd] debug osd = 20 2023-12-22T09:59:34.514 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-12-22T09:59:34.514 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-12-22T09:59:34.514 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-12-22T09:59:34.514 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-12-22T09:59:34.514 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-12-22T09:59:34.514 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-12-22T09:59:34.514 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-12-22T09:59:34.514 INFO:tasks.ceph:Setting up mon.a... 2023-12-22T09:59:34.514 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-12-22T09:59:34.593 INFO:teuthology.orchestra.run.smithi045.stdout:creating /etc/ceph/ceph.keyring 2023-12-22T09:59:34.598 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-12-22T09:59:34.661 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-22T09:59:34.698 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.45'), ('mon.b', '172.21.15.113'), ('mon.c', '[v2:172.21.15.113:3301,v1:172.21.15.113:6790]')] 2023-12-22T09:59:34.699 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.45,172.21.15.113,[v2:172.21.15.113:3301,v1:172.21.15.113:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-12-22T09:59:34.700 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-22T09:59:34.700 DEBUG:teuthology.orchestra.run.smithi045:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-12-22T09:59:34.760 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.45 --add b 172.21.15.113 --addv c '[v2:172.21.15.113:3301,v1:172.21.15.113:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-12-22T09:59:34.860 INFO:teuthology.orchestra.run.smithi045.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-12-22T09:59:34.860 INFO:teuthology.orchestra.run.smithi045.stdout:monmaptool: generated fsid 98b0837e-5e68-4c8f-a1a0-e9424baaad8f 2023-12-22T09:59:34.860 INFO:teuthology.orchestra.run.smithi045.stdout:epoch 0 2023-12-22T09:59:34.860 INFO:teuthology.orchestra.run.smithi045.stdout:fsid 98b0837e-5e68-4c8f-a1a0-e9424baaad8f 2023-12-22T09:59:34.860 INFO:teuthology.orchestra.run.smithi045.stdout:last_changed 2023-12-22T09:59:34.865576+0000 2023-12-22T09:59:34.860 INFO:teuthology.orchestra.run.smithi045.stdout:created 2023-12-22T09:59:34.865576+0000 2023-12-22T09:59:34.860 INFO:teuthology.orchestra.run.smithi045.stdout:min_mon_release 0 (unknown) 2023-12-22T09:59:34.861 INFO:teuthology.orchestra.run.smithi045.stdout:election_strategy: 1 2023-12-22T09:59:34.861 INFO:teuthology.orchestra.run.smithi045.stdout:0: [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] mon.a 2023-12-22T09:59:34.861 INFO:teuthology.orchestra.run.smithi045.stdout:1: [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] mon.b 2023-12-22T09:59:34.861 INFO:teuthology.orchestra.run.smithi045.stdout:2: [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] mon.c 2023-12-22T09:59:34.861 INFO:teuthology.orchestra.run.smithi045.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-12-22T09:59:34.862 DEBUG:teuthology.orchestra.run.smithi045:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-12-22T09:59:34.881 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 98b0837e-5e68-4c8f-a1a0-e9424baaad8f... 2023-12-22T09:59:34.881 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-22T09:59:34.932 DEBUG:teuthology.orchestra.run.smithi113:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-22T09:59:35.008 INFO:teuthology.orchestra.run.smithi045.stdout:[global] 2023-12-22T09:59:35.009 INFO:teuthology.orchestra.run.smithi045.stdout: chdir = "" 2023-12-22T09:59:35.009 INFO:teuthology.orchestra.run.smithi045.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-22T09:59:35.009 INFO:teuthology.orchestra.run.smithi045.stdout: auth supported = cephx 2023-12-22T09:59:35.009 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T09:59:35.009 INFO:teuthology.orchestra.run.smithi045.stdout: filestore xattr use omap = true 2023-12-22T09:59:35.009 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T09:59:35.009 INFO:teuthology.orchestra.run.smithi045.stdout: mon clock drift allowed = 1.000 2023-12-22T09:59:35.009 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T09:59:35.009 INFO:teuthology.orchestra.run.smithi045.stdout: osd crush chooseleaf type = 0 2023-12-22T09:59:35.009 INFO:teuthology.orchestra.run.smithi045.stdout: auth debug = true 2023-12-22T09:59:35.009 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T09:59:35.010 INFO:teuthology.orchestra.run.smithi045.stdout: ms die on old message = true 2023-12-22T09:59:35.010 INFO:teuthology.orchestra.run.smithi045.stdout: ms die on bug = true 2023-12-22T09:59:35.010 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T09:59:35.010 INFO:teuthology.orchestra.run.smithi045.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-22T09:59:35.010 INFO:teuthology.orchestra.run.smithi045.stdout: mon pg warn max object skew = 0 2023-12-22T09:59:35.010 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T09:59:35.010 INFO:teuthology.orchestra.run.smithi045.stdout: # disable pg_autoscaler by default for new pools 2023-12-22T09:59:35.010 INFO:teuthology.orchestra.run.smithi045.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-22T09:59:35.010 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T09:59:35.010 INFO:teuthology.orchestra.run.smithi045.stdout: osd pool default size = 2 2023-12-22T09:59:35.010 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T09:59:35.010 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd allow primary affinity = true 2023-12-22T09:59:35.010 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd allow pg remap = true 2023-12-22T09:59:35.010 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on legacy crush tunables = false 2023-12-22T09:59:35.011 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on crush straw calc version zero = false 2023-12-22T09:59:35.011 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on no sortbitwise = false 2023-12-22T09:59:35.011 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on osd down out interval zero = false 2023-12-22T09:59:35.011 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on too few osds = false 2023-12-22T09:59:35.011 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-22T09:59:35.011 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-22T09:59:35.011 INFO:teuthology.orchestra.run.smithi045.stdout: mon_allow_pool_size_one = true 2023-12-22T09:59:35.011 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T09:59:35.011 INFO:teuthology.orchestra.run.smithi045.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2023-12-22T09:59:35.011 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T09:59:35.011 INFO:teuthology.orchestra.run.smithi045.stdout: osd default data pool replay window = 5 2023-12-22T09:59:35.011 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T09:59:35.012 INFO:teuthology.orchestra.run.smithi045.stdout: mon allow pool delete = true 2023-12-22T09:59:35.012 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T09:59:35.012 INFO:teuthology.orchestra.run.smithi045.stdout: mon cluster log file level = debug 2023-12-22T09:59:35.012 INFO:teuthology.orchestra.run.smithi045.stdout: debug asserts on shutdown = true 2023-12-22T09:59:35.012 INFO:teuthology.orchestra.run.smithi045.stdout: mon health detail to clog = false 2023-12-22T09:59:35.012 INFO:teuthology.orchestra.run.smithi045.stdout: mon host = "172.21.15.45,172.21.15.113,[v2:172.21.15.113:3301,v1:172.21.15.113:6790]" 2023-12-22T09:59:35.012 INFO:teuthology.orchestra.run.smithi045.stdout: fsid = 98b0837e-5e68-4c8f-a1a0-e9424baaad8f 2023-12-22T09:59:35.012 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T09:59:35.012 INFO:teuthology.orchestra.run.smithi045.stdout:[osd] 2023-12-22T09:59:35.012 INFO:teuthology.orchestra.run.smithi045.stdout: osd journal size = 100 2023-12-22T09:59:35.012 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T09:59:35.012 INFO:teuthology.orchestra.run.smithi045.stdout: osd scrub load threshold = 5.0 2023-12-22T09:59:35.013 INFO:teuthology.orchestra.run.smithi045.stdout: osd scrub max interval = 600 2023-12-22T09:59:35.013 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T09:59:35.013 INFO:teuthology.orchestra.run.smithi045.stdout: osd recover clone overlap = true 2023-12-22T09:59:35.013 INFO:teuthology.orchestra.run.smithi045.stdout: osd recovery max chunk = 1048576 2023-12-22T09:59:35.013 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T09:59:35.013 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug shutdown = true 2023-12-22T09:59:35.013 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug op order = true 2023-12-22T09:59:35.013 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug verify stray on activate = true 2023-12-22T09:59:35.013 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T09:59:35.013 INFO:teuthology.orchestra.run.smithi045.stdout: osd open classes on start = true 2023-12-22T09:59:35.013 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug pg log writeout = true 2023-12-22T09:59:35.013 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T09:59:35.014 INFO:teuthology.orchestra.run.smithi045.stdout: osd deep scrub update digest min age = 30 2023-12-22T09:59:35.014 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T09:59:35.014 INFO:teuthology.orchestra.run.smithi045.stdout: osd map max advance = 10 2023-12-22T09:59:35.014 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T09:59:35.014 INFO:teuthology.orchestra.run.smithi045.stdout: journal zero on create = true 2023-12-22T09:59:35.014 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T09:59:35.014 INFO:teuthology.orchestra.run.smithi045.stdout: filestore ondisk finisher threads = 3 2023-12-22T09:59:35.014 INFO:teuthology.orchestra.run.smithi045.stdout: filestore apply finisher threads = 3 2023-12-22T09:59:35.014 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T09:59:35.014 INFO:teuthology.orchestra.run.smithi045.stdout: bdev debug aio = true 2023-12-22T09:59:35.014 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug misdirected ops = true 2023-12-22T09:59:35.014 INFO:teuthology.orchestra.run.smithi045.stdout: bdev async discard = True 2023-12-22T09:59:35.014 INFO:teuthology.orchestra.run.smithi045.stdout: bdev enable discard = True 2023-12-22T09:59:35.015 INFO:teuthology.orchestra.run.smithi045.stdout: bluestore allocator = bitmap 2023-12-22T09:59:35.015 INFO:teuthology.orchestra.run.smithi045.stdout: bluestore block size = 96636764160 2023-12-22T09:59:35.015 INFO:teuthology.orchestra.run.smithi045.stdout: bluestore fsck on mount = True 2023-12-22T09:59:35.015 INFO:teuthology.orchestra.run.smithi045.stdout: debug bluefs = 1/20 2023-12-22T09:59:35.015 INFO:teuthology.orchestra.run.smithi045.stdout: debug bluestore = 1/20 2023-12-22T09:59:35.015 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-12-22T09:59:35.015 INFO:teuthology.orchestra.run.smithi045.stdout: debug osd = 20 2023-12-22T09:59:35.015 INFO:teuthology.orchestra.run.smithi045.stdout: debug rocksdb = 4/10 2023-12-22T09:59:35.015 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd backfillfull_ratio = 0.85 2023-12-22T09:59:35.015 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd full ratio = 0.9 2023-12-22T09:59:35.015 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd nearfull ratio = 0.8 2023-12-22T09:59:35.015 INFO:teuthology.orchestra.run.smithi045.stdout: osd failsafe full ratio = 0.95 2023-12-22T09:59:35.015 INFO:teuthology.orchestra.run.smithi045.stdout: osd objectstore = bluestore 2023-12-22T09:59:35.015 INFO:teuthology.orchestra.run.smithi045.stdout: osd op complaint time = 180 2023-12-22T09:59:35.016 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T09:59:35.016 INFO:teuthology.orchestra.run.smithi045.stdout:[mgr] 2023-12-22T09:59:35.016 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-12-22T09:59:35.016 INFO:teuthology.orchestra.run.smithi045.stdout: debug mgr = 20 2023-12-22T09:59:35.016 INFO:teuthology.orchestra.run.smithi045.stdout: debug mon = 20 2023-12-22T09:59:35.016 INFO:teuthology.orchestra.run.smithi045.stdout: debug auth = 20 2023-12-22T09:59:35.016 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min pgs per osd = 4 2023-12-22T09:59:35.016 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min bytes per osd = 10 2023-12-22T09:59:35.016 INFO:teuthology.orchestra.run.smithi045.stdout: mgr/telemetry/nag = false 2023-12-22T09:59:35.016 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T09:59:35.016 INFO:teuthology.orchestra.run.smithi045.stdout:[mon] 2023-12-22T09:59:35.016 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-12-22T09:59:35.016 INFO:teuthology.orchestra.run.smithi045.stdout: debug mon = 20 2023-12-22T09:59:35.016 INFO:teuthology.orchestra.run.smithi045.stdout: debug paxos = 20 2023-12-22T09:59:35.016 INFO:teuthology.orchestra.run.smithi045.stdout: debug auth = 20 2023-12-22T09:59:35.017 INFO:teuthology.orchestra.run.smithi045.stdout: mon data avail warn = 5 2023-12-22T09:59:35.017 INFO:teuthology.orchestra.run.smithi045.stdout: mon mgr mkfs grace = 240 2023-12-22T09:59:35.017 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min pgs per osd = 4 2023-12-22T09:59:35.017 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd reporter subtree level = osd 2023-12-22T09:59:35.017 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd prime pg temp = true 2023-12-22T09:59:35.017 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min bytes per osd = 10 2023-12-22T09:59:35.017 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T09:59:35.017 INFO:teuthology.orchestra.run.smithi045.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-22T09:59:35.017 INFO:teuthology.orchestra.run.smithi045.stdout: auth mon ticket ttl = 660 # 11m 2023-12-22T09:59:35.017 INFO:teuthology.orchestra.run.smithi045.stdout: auth service ticket ttl = 240 # 4m 2023-12-22T09:59:35.017 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T09:59:35.017 INFO:teuthology.orchestra.run.smithi045.stdout: # don't complain about insecure global_id in the test suite 2023-12-22T09:59:35.017 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-22T09:59:35.018 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-22T09:59:35.018 INFO:teuthology.orchestra.run.smithi045.stdout: mon op complaint time = 120 2023-12-22T09:59:35.018 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T09:59:35.018 INFO:teuthology.orchestra.run.smithi045.stdout:[client] 2023-12-22T09:59:35.018 INFO:teuthology.orchestra.run.smithi045.stdout: rgw cache enabled = true 2023-12-22T09:59:35.018 INFO:teuthology.orchestra.run.smithi045.stdout: rgw enable ops log = true 2023-12-22T09:59:35.018 INFO:teuthology.orchestra.run.smithi045.stdout: rgw enable usage log = true 2023-12-22T09:59:35.018 INFO:teuthology.orchestra.run.smithi045.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-22T09:59:35.018 INFO:teuthology.orchestra.run.smithi045.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-22T09:59:35.018 INFO:teuthology.orchestra.run.smithi045.stdout: client mount timeout = 600 2023-12-22T09:59:35.018 INFO:teuthology.orchestra.run.smithi045.stdout: debug client = 20 2023-12-22T09:59:35.018 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-12-22T09:59:35.018 INFO:teuthology.orchestra.run.smithi045.stdout: pid file = "" 2023-12-22T09:59:35.019 INFO:teuthology.orchestra.run.smithi045.stdout: rados mon op timeout = 900 2023-12-22T09:59:35.019 INFO:teuthology.orchestra.run.smithi045.stdout: rados osd op timeout = 900 2023-12-22T09:59:35.019 INFO:teuthology.orchestra.run.smithi045.stdout:[mon.a] 2023-12-22T09:59:35.019 INFO:teuthology.orchestra.run.smithi045.stdout:[mon.b] 2023-12-22T09:59:35.019 INFO:teuthology.orchestra.run.smithi045.stdout:[mon.c] 2023-12-22T09:59:35.019 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.a] 2023-12-22T09:59:35.019 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.c] 2023-12-22T09:59:35.019 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.b] 2023-12-22T09:59:35.019 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.d] 2023-12-22T09:59:35.019 INFO:teuthology.orchestra.run.smithi045.stdout:[mds] 2023-12-22T09:59:35.019 INFO:teuthology.orchestra.run.smithi045.stdout: debug mds = 20 2023-12-22T09:59:35.019 INFO:teuthology.orchestra.run.smithi045.stdout: debug mds balancer = 20 2023-12-22T09:59:35.019 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-12-22T09:59:35.019 INFO:teuthology.orchestra.run.smithi045.stdout: mds debug frag = True 2023-12-22T09:59:35.020 INFO:teuthology.orchestra.run.smithi045.stdout: mds debug scatterstat = True 2023-12-22T09:59:35.020 INFO:teuthology.orchestra.run.smithi045.stdout: mds op complaint time = 180 2023-12-22T09:59:35.020 INFO:teuthology.orchestra.run.smithi045.stdout: mds verify scatter = True 2023-12-22T09:59:35.020 INFO:teuthology.orchestra.run.smithi045.stdout: osd op complaint time = 180 2023-12-22T09:59:35.020 INFO:teuthology.orchestra.run.smithi045.stdout: rados mon op timeout = 900 2023-12-22T09:59:35.020 INFO:teuthology.orchestra.run.smithi045.stdout: rados osd op timeout = 900 2023-12-22T09:59:35.020 INFO:teuthology.orchestra.run.smithi113.stdout:[global] 2023-12-22T09:59:35.021 INFO:teuthology.orchestra.run.smithi113.stdout: chdir = "" 2023-12-22T09:59:35.021 INFO:teuthology.orchestra.run.smithi113.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-22T09:59:35.021 INFO:teuthology.orchestra.run.smithi113.stdout: auth supported = cephx 2023-12-22T09:59:35.021 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-22T09:59:35.021 INFO:teuthology.orchestra.run.smithi113.stdout: filestore xattr use omap = true 2023-12-22T09:59:35.021 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-22T09:59:35.021 INFO:teuthology.orchestra.run.smithi113.stdout: mon clock drift allowed = 1.000 2023-12-22T09:59:35.021 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-22T09:59:35.021 INFO:teuthology.orchestra.run.smithi113.stdout: osd crush chooseleaf type = 0 2023-12-22T09:59:35.021 INFO:teuthology.orchestra.run.smithi113.stdout: auth debug = true 2023-12-22T09:59:35.021 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-22T09:59:35.021 INFO:teuthology.orchestra.run.smithi113.stdout: ms die on old message = true 2023-12-22T09:59:35.021 INFO:teuthology.orchestra.run.smithi113.stdout: ms die on bug = true 2023-12-22T09:59:35.021 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-22T09:59:35.022 INFO:teuthology.orchestra.run.smithi113.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-22T09:59:35.022 INFO:teuthology.orchestra.run.smithi113.stdout: mon pg warn max object skew = 0 2023-12-22T09:59:35.022 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-22T09:59:35.022 INFO:teuthology.orchestra.run.smithi113.stdout: # disable pg_autoscaler by default for new pools 2023-12-22T09:59:35.022 INFO:teuthology.orchestra.run.smithi113.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-22T09:59:35.022 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-22T09:59:35.022 INFO:teuthology.orchestra.run.smithi113.stdout: osd pool default size = 2 2023-12-22T09:59:35.022 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-22T09:59:35.022 INFO:teuthology.orchestra.run.smithi113.stdout: mon osd allow primary affinity = true 2023-12-22T09:59:35.022 INFO:teuthology.orchestra.run.smithi113.stdout: mon osd allow pg remap = true 2023-12-22T09:59:35.022 INFO:teuthology.orchestra.run.smithi113.stdout: mon warn on legacy crush tunables = false 2023-12-22T09:59:35.022 INFO:teuthology.orchestra.run.smithi113.stdout: mon warn on crush straw calc version zero = false 2023-12-22T09:59:35.022 INFO:teuthology.orchestra.run.smithi113.stdout: mon warn on no sortbitwise = false 2023-12-22T09:59:35.022 INFO:teuthology.orchestra.run.smithi113.stdout: mon warn on osd down out interval zero = false 2023-12-22T09:59:35.023 INFO:teuthology.orchestra.run.smithi113.stdout: mon warn on too few osds = false 2023-12-22T09:59:35.023 INFO:teuthology.orchestra.run.smithi113.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-22T09:59:35.023 INFO:teuthology.orchestra.run.smithi113.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-22T09:59:35.023 INFO:teuthology.orchestra.run.smithi113.stdout: mon_allow_pool_size_one = true 2023-12-22T09:59:35.023 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-22T09:59:35.023 INFO:teuthology.orchestra.run.smithi113.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2023-12-22T09:59:35.023 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-22T09:59:35.023 INFO:teuthology.orchestra.run.smithi113.stdout: osd default data pool replay window = 5 2023-12-22T09:59:35.023 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-22T09:59:35.023 INFO:teuthology.orchestra.run.smithi113.stdout: mon allow pool delete = true 2023-12-22T09:59:35.023 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-22T09:59:35.023 INFO:teuthology.orchestra.run.smithi113.stdout: mon cluster log file level = debug 2023-12-22T09:59:35.023 INFO:teuthology.orchestra.run.smithi113.stdout: debug asserts on shutdown = true 2023-12-22T09:59:35.023 INFO:teuthology.orchestra.run.smithi113.stdout: mon health detail to clog = false 2023-12-22T09:59:35.024 INFO:teuthology.orchestra.run.smithi113.stdout: mon host = "172.21.15.45,172.21.15.113,[v2:172.21.15.113:3301,v1:172.21.15.113:6790]" 2023-12-22T09:59:35.024 INFO:teuthology.orchestra.run.smithi113.stdout: fsid = 98b0837e-5e68-4c8f-a1a0-e9424baaad8f 2023-12-22T09:59:35.024 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-22T09:59:35.024 INFO:teuthology.orchestra.run.smithi113.stdout:[osd] 2023-12-22T09:59:35.024 INFO:teuthology.orchestra.run.smithi113.stdout: osd journal size = 100 2023-12-22T09:59:35.024 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-22T09:59:35.024 INFO:teuthology.orchestra.run.smithi113.stdout: osd scrub load threshold = 5.0 2023-12-22T09:59:35.024 INFO:teuthology.orchestra.run.smithi113.stdout: osd scrub max interval = 600 2023-12-22T09:59:35.024 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-22T09:59:35.024 INFO:teuthology.orchestra.run.smithi113.stdout: osd recover clone overlap = true 2023-12-22T09:59:35.024 INFO:teuthology.orchestra.run.smithi113.stdout: osd recovery max chunk = 1048576 2023-12-22T09:59:35.024 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-22T09:59:35.024 INFO:teuthology.orchestra.run.smithi113.stdout: osd debug shutdown = true 2023-12-22T09:59:35.024 INFO:teuthology.orchestra.run.smithi113.stdout: osd debug op order = true 2023-12-22T09:59:35.024 INFO:teuthology.orchestra.run.smithi113.stdout: osd debug verify stray on activate = true 2023-12-22T09:59:35.025 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-22T09:59:35.025 INFO:teuthology.orchestra.run.smithi113.stdout: osd open classes on start = true 2023-12-22T09:59:35.025 INFO:teuthology.orchestra.run.smithi113.stdout: osd debug pg log writeout = true 2023-12-22T09:59:35.025 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-22T09:59:35.025 INFO:teuthology.orchestra.run.smithi113.stdout: osd deep scrub update digest min age = 30 2023-12-22T09:59:35.025 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-22T09:59:35.025 INFO:teuthology.orchestra.run.smithi113.stdout: osd map max advance = 10 2023-12-22T09:59:35.025 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-22T09:59:35.025 INFO:teuthology.orchestra.run.smithi113.stdout: journal zero on create = true 2023-12-22T09:59:35.025 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-22T09:59:35.025 INFO:teuthology.orchestra.run.smithi113.stdout: filestore ondisk finisher threads = 3 2023-12-22T09:59:35.025 INFO:teuthology.orchestra.run.smithi113.stdout: filestore apply finisher threads = 3 2023-12-22T09:59:35.025 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-22T09:59:35.025 INFO:teuthology.orchestra.run.smithi113.stdout: bdev debug aio = true 2023-12-22T09:59:35.026 INFO:teuthology.orchestra.run.smithi113.stdout: osd debug misdirected ops = true 2023-12-22T09:59:35.026 INFO:teuthology.orchestra.run.smithi113.stdout: bdev async discard = True 2023-12-22T09:59:35.026 INFO:teuthology.orchestra.run.smithi113.stdout: bdev enable discard = True 2023-12-22T09:59:35.026 INFO:teuthology.orchestra.run.smithi113.stdout: bluestore allocator = bitmap 2023-12-22T09:59:35.026 INFO:teuthology.orchestra.run.smithi113.stdout: bluestore block size = 96636764160 2023-12-22T09:59:35.026 INFO:teuthology.orchestra.run.smithi113.stdout: bluestore fsck on mount = True 2023-12-22T09:59:35.026 INFO:teuthology.orchestra.run.smithi113.stdout: debug bluefs = 1/20 2023-12-22T09:59:35.026 INFO:teuthology.orchestra.run.smithi113.stdout: debug bluestore = 1/20 2023-12-22T09:59:35.026 INFO:teuthology.orchestra.run.smithi113.stdout: debug ms = 1 2023-12-22T09:59:35.026 INFO:teuthology.orchestra.run.smithi113.stdout: debug osd = 20 2023-12-22T09:59:35.026 INFO:teuthology.orchestra.run.smithi113.stdout: debug rocksdb = 4/10 2023-12-22T09:59:35.026 INFO:teuthology.orchestra.run.smithi113.stdout: mon osd backfillfull_ratio = 0.85 2023-12-22T09:59:35.026 INFO:teuthology.orchestra.run.smithi113.stdout: mon osd full ratio = 0.9 2023-12-22T09:59:35.026 INFO:teuthology.orchestra.run.smithi113.stdout: mon osd nearfull ratio = 0.8 2023-12-22T09:59:35.027 INFO:teuthology.orchestra.run.smithi113.stdout: osd failsafe full ratio = 0.95 2023-12-22T09:59:35.027 INFO:teuthology.orchestra.run.smithi113.stdout: osd objectstore = bluestore 2023-12-22T09:59:35.027 INFO:teuthology.orchestra.run.smithi113.stdout: osd op complaint time = 180 2023-12-22T09:59:35.027 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-22T09:59:35.027 INFO:teuthology.orchestra.run.smithi113.stdout:[mgr] 2023-12-22T09:59:35.027 INFO:teuthology.orchestra.run.smithi113.stdout: debug ms = 1 2023-12-22T09:59:35.027 INFO:teuthology.orchestra.run.smithi113.stdout: debug mgr = 20 2023-12-22T09:59:35.027 INFO:teuthology.orchestra.run.smithi113.stdout: debug mon = 20 2023-12-22T09:59:35.027 INFO:teuthology.orchestra.run.smithi113.stdout: debug auth = 20 2023-12-22T09:59:35.027 INFO:teuthology.orchestra.run.smithi113.stdout: mon reweight min pgs per osd = 4 2023-12-22T09:59:35.027 INFO:teuthology.orchestra.run.smithi113.stdout: mon reweight min bytes per osd = 10 2023-12-22T09:59:35.027 INFO:teuthology.orchestra.run.smithi113.stdout: mgr/telemetry/nag = false 2023-12-22T09:59:35.027 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-22T09:59:35.027 INFO:teuthology.orchestra.run.smithi113.stdout:[mon] 2023-12-22T09:59:35.028 INFO:teuthology.orchestra.run.smithi113.stdout: debug ms = 1 2023-12-22T09:59:35.028 INFO:teuthology.orchestra.run.smithi113.stdout: debug mon = 20 2023-12-22T09:59:35.028 INFO:teuthology.orchestra.run.smithi113.stdout: debug paxos = 20 2023-12-22T09:59:35.029 INFO:teuthology.orchestra.run.smithi113.stdout: debug auth = 20 2023-12-22T09:59:35.032 INFO:teuthology.orchestra.run.smithi113.stdout: mon data avail warn = 5 2023-12-22T09:59:35.032 INFO:teuthology.orchestra.run.smithi113.stdout: mon mgr mkfs grace = 240 2023-12-22T09:59:35.032 INFO:teuthology.orchestra.run.smithi113.stdout: mon reweight min pgs per osd = 4 2023-12-22T09:59:35.032 INFO:teuthology.orchestra.run.smithi113.stdout: mon osd reporter subtree level = osd 2023-12-22T09:59:35.032 INFO:teuthology.orchestra.run.smithi113.stdout: mon osd prime pg temp = true 2023-12-22T09:59:35.032 INFO:teuthology.orchestra.run.smithi113.stdout: mon reweight min bytes per osd = 10 2023-12-22T09:59:35.032 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-22T09:59:35.032 INFO:teuthology.orchestra.run.smithi113.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-22T09:59:35.032 INFO:teuthology.orchestra.run.smithi113.stdout: auth mon ticket ttl = 660 # 11m 2023-12-22T09:59:35.032 INFO:teuthology.orchestra.run.smithi113.stdout: auth service ticket ttl = 240 # 4m 2023-12-22T09:59:35.032 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-22T09:59:35.032 INFO:teuthology.orchestra.run.smithi113.stdout: # don't complain about insecure global_id in the test suite 2023-12-22T09:59:35.032 INFO:teuthology.orchestra.run.smithi113.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-22T09:59:35.033 INFO:teuthology.orchestra.run.smithi113.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-22T09:59:35.033 INFO:teuthology.orchestra.run.smithi113.stdout: mon op complaint time = 120 2023-12-22T09:59:35.033 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-22T09:59:35.033 INFO:teuthology.orchestra.run.smithi113.stdout:[client] 2023-12-22T09:59:35.033 INFO:teuthology.orchestra.run.smithi113.stdout: rgw cache enabled = true 2023-12-22T09:59:35.033 INFO:teuthology.orchestra.run.smithi113.stdout: rgw enable ops log = true 2023-12-22T09:59:35.033 INFO:teuthology.orchestra.run.smithi113.stdout: rgw enable usage log = true 2023-12-22T09:59:35.033 INFO:teuthology.orchestra.run.smithi113.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-22T09:59:35.033 INFO:teuthology.orchestra.run.smithi113.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-22T09:59:35.033 INFO:teuthology.orchestra.run.smithi113.stdout: client mount timeout = 600 2023-12-22T09:59:35.033 INFO:teuthology.orchestra.run.smithi113.stdout: debug client = 20 2023-12-22T09:59:35.033 INFO:teuthology.orchestra.run.smithi113.stdout: debug ms = 1 2023-12-22T09:59:35.033 INFO:teuthology.orchestra.run.smithi113.stdout: pid file = "" 2023-12-22T09:59:35.033 INFO:teuthology.orchestra.run.smithi113.stdout: rados mon op timeout = 900 2023-12-22T09:59:35.033 INFO:teuthology.orchestra.run.smithi113.stdout: rados osd op timeout = 900 2023-12-22T09:59:35.034 INFO:teuthology.orchestra.run.smithi113.stdout:[mon.a] 2023-12-22T09:59:35.034 INFO:teuthology.orchestra.run.smithi113.stdout:[mon.b] 2023-12-22T09:59:35.034 INFO:teuthology.orchestra.run.smithi113.stdout:[mon.c] 2023-12-22T09:59:35.034 INFO:teuthology.orchestra.run.smithi113.stdout:[mds.a] 2023-12-22T09:59:35.034 INFO:teuthology.orchestra.run.smithi113.stdout:[mds.c] 2023-12-22T09:59:35.034 INFO:teuthology.orchestra.run.smithi113.stdout:[mds.b] 2023-12-22T09:59:35.034 INFO:teuthology.orchestra.run.smithi113.stdout:[mds.d] 2023-12-22T09:59:35.034 INFO:teuthology.orchestra.run.smithi113.stdout:[mds] 2023-12-22T09:59:35.034 INFO:teuthology.orchestra.run.smithi113.stdout: debug mds = 20 2023-12-22T09:59:35.034 INFO:teuthology.orchestra.run.smithi113.stdout: debug mds balancer = 20 2023-12-22T09:59:35.034 INFO:teuthology.orchestra.run.smithi113.stdout: debug ms = 1 2023-12-22T09:59:35.034 INFO:teuthology.orchestra.run.smithi113.stdout: mds debug frag = True 2023-12-22T09:59:35.034 INFO:teuthology.orchestra.run.smithi113.stdout: mds debug scatterstat = True 2023-12-22T09:59:35.035 INFO:teuthology.orchestra.run.smithi113.stdout: mds op complaint time = 180 2023-12-22T09:59:35.035 INFO:teuthology.orchestra.run.smithi113.stdout: mds verify scatter = True 2023-12-22T09:59:35.035 INFO:teuthology.orchestra.run.smithi113.stdout: osd op complaint time = 180 2023-12-22T09:59:35.035 INFO:teuthology.orchestra.run.smithi113.stdout: rados mon op timeout = 900 2023-12-22T09:59:35.035 INFO:teuthology.orchestra.run.smithi113.stdout: rados osd op timeout = 900 2023-12-22T09:59:35.037 INFO:tasks.ceph:Creating admin key on mon.a... 2023-12-22T09:59:35.037 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-12-22T09:59:35.154 INFO:tasks.ceph:Copying monmap to all nodes... 2023-12-22T09:59:35.155 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-22T09:59:35.155 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-12-22T09:59:35.171 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-22T09:59:35.172 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-12-22T09:59:35.238 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi045.front.sepia.ceph.com 2023-12-22T09:59:35.238 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-22T09:59:35.238 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/etc/ceph/ceph.keyring 2023-12-22T09:59:35.238 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-22T09:59:35.342 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-22T09:59:35.342 DEBUG:teuthology.orchestra.run.smithi045:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-12-22T09:59:35.408 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi113.front.sepia.ceph.com 2023-12-22T09:59:35.408 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-22T09:59:35.408 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd of=/etc/ceph/ceph.keyring 2023-12-22T09:59:35.408 DEBUG:teuthology.orchestra.run.smithi113:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-22T09:59:35.471 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-22T09:59:35.471 DEBUG:teuthology.orchestra.run.smithi113:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-12-22T09:59:35.534 INFO:tasks.ceph:Setting up mon nodes... 2023-12-22T09:59:35.534 INFO:tasks.ceph:Setting up mgr nodes... 2023-12-22T09:59:35.535 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-12-22T09:59:35.624 INFO:teuthology.orchestra.run.smithi045.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-12-22T09:59:35.631 DEBUG:teuthology.orchestra.run.smithi113:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-12-22T09:59:35.747 INFO:teuthology.orchestra.run.smithi113.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-12-22T09:59:35.754 INFO:tasks.ceph:Setting up mds nodes... 2023-12-22T09:59:35.754 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-12-22T09:59:35.846 INFO:teuthology.orchestra.run.smithi045.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-12-22T09:59:35.850 DEBUG:teuthology.orchestra.run.smithi045:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-12-22T09:59:35.886 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-12-22T09:59:36.018 INFO:teuthology.orchestra.run.smithi045.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-12-22T09:59:36.024 DEBUG:teuthology.orchestra.run.smithi045:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-12-22T09:59:36.065 DEBUG:teuthology.orchestra.run.smithi113:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-12-22T09:59:36.154 INFO:teuthology.orchestra.run.smithi113.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-12-22T09:59:36.161 DEBUG:teuthology.orchestra.run.smithi113:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-12-22T09:59:36.194 DEBUG:teuthology.orchestra.run.smithi113:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-12-22T09:59:36.320 INFO:teuthology.orchestra.run.smithi113.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-12-22T09:59:36.326 DEBUG:teuthology.orchestra.run.smithi113:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-12-22T09:59:36.359 INFO:tasks.ceph_client:Setting up client nodes... 2023-12-22T09:59:36.359 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-12-22T09:59:36.428 INFO:teuthology.orchestra.run.smithi045.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-12-22T09:59:36.456 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-12-22T09:59:36.517 INFO:teuthology.orchestra.run.smithi045.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-12-22T09:59:36.546 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-12-22T09:59:36.608 INFO:teuthology.orchestra.run.smithi113.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-12-22T09:59:36.633 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-12-22T09:59:36.696 INFO:teuthology.orchestra.run.smithi113.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-12-22T09:59:36.721 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-12-22T09:59:36.721 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi045.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi113.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-12-22T09:59:36.721 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-12-22T09:59:36.761 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-22T09:59:36.761 INFO:tasks.ceph:role: osd.0 2023-12-22T09:59:36.761 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi045.front.sepia.ceph.com 2023-12-22T09:59:36.761 DEBUG:teuthology.orchestra.run.smithi045:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-12-22T09:59:36.868 INFO:teuthology.orchestra.run.smithi045.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-12-22T09:59:36.868 INFO:teuthology.orchestra.run.smithi045.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-22T09:59:36.868 INFO:teuthology.orchestra.run.smithi045.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-22T09:59:36.868 INFO:teuthology.orchestra.run.smithi045.stdout: = reflink=1 2023-12-22T09:59:36.869 INFO:teuthology.orchestra.run.smithi045.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-22T09:59:36.869 INFO:teuthology.orchestra.run.smithi045.stdout: = sunit=0 swidth=0 blks 2023-12-22T09:59:36.869 INFO:teuthology.orchestra.run.smithi045.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-22T09:59:36.869 INFO:teuthology.orchestra.run.smithi045.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-22T09:59:36.869 INFO:teuthology.orchestra.run.smithi045.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-22T09:59:36.869 INFO:teuthology.orchestra.run.smithi045.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-22T09:59:36.873 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi045.front.sepia.ceph.com -o noatime 2023-12-22T09:59:36.873 DEBUG:teuthology.orchestra.run.smithi045:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-12-22T09:59:36.911 DEBUG:teuthology.orchestra.run.smithi045:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-12-22T09:59:36.986 INFO:teuthology.orchestra.run.smithi045.stderr:sudo: /sbin/restorecon: command not found 2023-12-22T09:59:36.987 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-22T09:59:36.987 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-12-22T09:59:37.062 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-22T09:59:37.062 INFO:tasks.ceph:role: osd.1 2023-12-22T09:59:37.063 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi045.front.sepia.ceph.com 2023-12-22T09:59:37.063 DEBUG:teuthology.orchestra.run.smithi045:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-12-22T09:59:37.179 INFO:teuthology.orchestra.run.smithi045.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-12-22T09:59:37.179 INFO:teuthology.orchestra.run.smithi045.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-22T09:59:37.179 INFO:teuthology.orchestra.run.smithi045.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-22T09:59:37.179 INFO:teuthology.orchestra.run.smithi045.stdout: = reflink=1 2023-12-22T09:59:37.179 INFO:teuthology.orchestra.run.smithi045.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-22T09:59:37.179 INFO:teuthology.orchestra.run.smithi045.stdout: = sunit=0 swidth=0 blks 2023-12-22T09:59:37.179 INFO:teuthology.orchestra.run.smithi045.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-22T09:59:37.179 INFO:teuthology.orchestra.run.smithi045.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-22T09:59:37.179 INFO:teuthology.orchestra.run.smithi045.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-22T09:59:37.179 INFO:teuthology.orchestra.run.smithi045.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-22T09:59:37.183 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi045.front.sepia.ceph.com -o noatime 2023-12-22T09:59:37.184 DEBUG:teuthology.orchestra.run.smithi045:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-12-22T09:59:37.224 DEBUG:teuthology.orchestra.run.smithi045:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-12-22T09:59:37.295 INFO:teuthology.orchestra.run.smithi045.stderr:sudo: /sbin/restorecon: command not found 2023-12-22T09:59:37.296 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-22T09:59:37.297 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-12-22T09:59:37.378 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-22T09:59:37.378 INFO:tasks.ceph:role: osd.2 2023-12-22T09:59:37.378 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi045.front.sepia.ceph.com 2023-12-22T09:59:37.378 DEBUG:teuthology.orchestra.run.smithi045:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-12-22T09:59:37.495 INFO:teuthology.orchestra.run.smithi045.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-12-22T09:59:37.495 INFO:teuthology.orchestra.run.smithi045.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-22T09:59:37.495 INFO:teuthology.orchestra.run.smithi045.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-22T09:59:37.495 INFO:teuthology.orchestra.run.smithi045.stdout: = reflink=1 2023-12-22T09:59:37.495 INFO:teuthology.orchestra.run.smithi045.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-22T09:59:37.495 INFO:teuthology.orchestra.run.smithi045.stdout: = sunit=0 swidth=0 blks 2023-12-22T09:59:37.495 INFO:teuthology.orchestra.run.smithi045.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-22T09:59:37.495 INFO:teuthology.orchestra.run.smithi045.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-22T09:59:37.495 INFO:teuthology.orchestra.run.smithi045.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-22T09:59:37.495 INFO:teuthology.orchestra.run.smithi045.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-22T09:59:37.500 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi045.front.sepia.ceph.com -o noatime 2023-12-22T09:59:37.500 DEBUG:teuthology.orchestra.run.smithi045:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-12-22T09:59:37.540 DEBUG:teuthology.orchestra.run.smithi045:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-12-22T09:59:37.606 INFO:teuthology.orchestra.run.smithi045.stderr:sudo: /sbin/restorecon: command not found 2023-12-22T09:59:37.607 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-22T09:59:37.608 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-12-22T09:59:37.682 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-22T09:59:37.682 INFO:tasks.ceph:role: osd.3 2023-12-22T09:59:37.682 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi045.front.sepia.ceph.com 2023-12-22T09:59:37.682 DEBUG:teuthology.orchestra.run.smithi045:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-12-22T09:59:37.796 INFO:teuthology.orchestra.run.smithi045.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-12-22T09:59:37.796 INFO:teuthology.orchestra.run.smithi045.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-22T09:59:37.796 INFO:teuthology.orchestra.run.smithi045.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-22T09:59:37.796 INFO:teuthology.orchestra.run.smithi045.stdout: = reflink=1 2023-12-22T09:59:37.796 INFO:teuthology.orchestra.run.smithi045.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-22T09:59:37.797 INFO:teuthology.orchestra.run.smithi045.stdout: = sunit=0 swidth=0 blks 2023-12-22T09:59:37.797 INFO:teuthology.orchestra.run.smithi045.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-22T09:59:37.797 INFO:teuthology.orchestra.run.smithi045.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-22T09:59:37.797 INFO:teuthology.orchestra.run.smithi045.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-22T09:59:37.797 INFO:teuthology.orchestra.run.smithi045.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-22T09:59:37.802 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi045.front.sepia.ceph.com -o noatime 2023-12-22T09:59:37.802 DEBUG:teuthology.orchestra.run.smithi045:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-12-22T09:59:37.843 DEBUG:teuthology.orchestra.run.smithi045:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-12-22T09:59:37.915 INFO:teuthology.orchestra.run.smithi045.stderr:sudo: /sbin/restorecon: command not found 2023-12-22T09:59:37.916 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-22T09:59:37.917 DEBUG:teuthology.orchestra.run.smithi045:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-22T09:59:38.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T09:59:38.078+0000 7f68fd6ea200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-12-22T09:59:38.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T09:59:38.078+0000 7f68fd6ea200 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-12-22T09:59:38.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T09:59:38.078+0000 7f68fd6ea200 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-22T09:59:38.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T09:59:38.078+0000 7f68fd6ea200 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-22T09:59:38.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T09:59:38.078+0000 7f68fd6ea200 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-22T09:59:38.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T09:59:38.082+0000 7f68fd6ea200 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-12-22T09:59:41.627 DEBUG:teuthology.orchestra.run.smithi045:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-12-22T09:59:41.663 DEBUG:teuthology.orchestra.run.smithi045:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-22T09:59:41.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T09:59:41.782+0000 7fc8a3cf3200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-12-22T09:59:41.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T09:59:41.786+0000 7fc8a3cf3200 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-12-22T09:59:41.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T09:59:41.786+0000 7fc8a3cf3200 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-22T09:59:41.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T09:59:41.786+0000 7fc8a3cf3200 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-22T09:59:41.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T09:59:41.786+0000 7fc8a3cf3200 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-22T09:59:41.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T09:59:41.786+0000 7fc8a3cf3200 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-12-22T09:59:45.311 DEBUG:teuthology.orchestra.run.smithi045:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-12-22T09:59:45.346 DEBUG:teuthology.orchestra.run.smithi045:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-22T09:59:45.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T09:59:45.470+0000 7f3f70308200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-12-22T09:59:45.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T09:59:45.470+0000 7f3f70308200 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-12-22T09:59:45.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T09:59:45.470+0000 7f3f70308200 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-22T09:59:45.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T09:59:45.470+0000 7f3f70308200 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-22T09:59:45.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T09:59:45.470+0000 7f3f70308200 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-22T09:59:45.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T09:59:45.474+0000 7f3f70308200 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-12-22T09:59:49.026 DEBUG:teuthology.orchestra.run.smithi045:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-12-22T09:59:49.064 DEBUG:teuthology.orchestra.run.smithi045:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-22T09:59:49.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T09:59:49.186+0000 7f44b16dc200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-12-22T09:59:49.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T09:59:49.190+0000 7f44b16dc200 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-12-22T09:59:49.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T09:59:49.190+0000 7f44b16dc200 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-22T09:59:49.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T09:59:49.190+0000 7f44b16dc200 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-22T09:59:49.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T09:59:49.190+0000 7f44b16dc200 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-22T09:59:49.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T09:59:49.190+0000 7f44b16dc200 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-12-22T09:59:52.718 DEBUG:teuthology.orchestra.run.smithi045:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-12-22T09:59:52.755 DEBUG:teuthology.orchestra.run.smithi113:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-12-22T09:59:52.792 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-22T09:59:52.792 INFO:tasks.ceph:role: osd.4 2023-12-22T09:59:52.792 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi113.front.sepia.ceph.com 2023-12-22T09:59:52.792 DEBUG:teuthology.orchestra.run.smithi113:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-12-22T09:59:53.477 INFO:teuthology.orchestra.run.smithi113.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-12-22T09:59:53.477 INFO:teuthology.orchestra.run.smithi113.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-22T09:59:53.477 INFO:teuthology.orchestra.run.smithi113.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-22T09:59:53.477 INFO:teuthology.orchestra.run.smithi113.stdout: = reflink=1 2023-12-22T09:59:53.477 INFO:teuthology.orchestra.run.smithi113.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-22T09:59:53.477 INFO:teuthology.orchestra.run.smithi113.stdout: = sunit=0 swidth=0 blks 2023-12-22T09:59:53.477 INFO:teuthology.orchestra.run.smithi113.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-22T09:59:53.477 INFO:teuthology.orchestra.run.smithi113.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-22T09:59:53.478 INFO:teuthology.orchestra.run.smithi113.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-22T09:59:53.478 INFO:teuthology.orchestra.run.smithi113.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-22T09:59:53.483 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi113.front.sepia.ceph.com -o noatime 2023-12-22T09:59:53.483 DEBUG:teuthology.orchestra.run.smithi113:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-12-22T09:59:53.576 DEBUG:teuthology.orchestra.run.smithi113:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-12-22T09:59:53.603 INFO:teuthology.orchestra.run.smithi113.stderr:sudo: /sbin/restorecon: command not found 2023-12-22T09:59:53.603 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-22T09:59:53.604 DEBUG:teuthology.orchestra.run.smithi113:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-12-22T09:59:53.687 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-22T09:59:53.687 INFO:tasks.ceph:role: osd.5 2023-12-22T09:59:53.687 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi113.front.sepia.ceph.com 2023-12-22T09:59:53.687 DEBUG:teuthology.orchestra.run.smithi113:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-12-22T09:59:54.358 INFO:teuthology.orchestra.run.smithi113.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-12-22T09:59:54.358 INFO:teuthology.orchestra.run.smithi113.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-22T09:59:54.358 INFO:teuthology.orchestra.run.smithi113.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-22T09:59:54.358 INFO:teuthology.orchestra.run.smithi113.stdout: = reflink=1 2023-12-22T09:59:54.358 INFO:teuthology.orchestra.run.smithi113.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-22T09:59:54.358 INFO:teuthology.orchestra.run.smithi113.stdout: = sunit=0 swidth=0 blks 2023-12-22T09:59:54.358 INFO:teuthology.orchestra.run.smithi113.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-22T09:59:54.358 INFO:teuthology.orchestra.run.smithi113.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-22T09:59:54.358 INFO:teuthology.orchestra.run.smithi113.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-22T09:59:54.358 INFO:teuthology.orchestra.run.smithi113.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-22T09:59:54.363 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi113.front.sepia.ceph.com -o noatime 2023-12-22T09:59:54.363 DEBUG:teuthology.orchestra.run.smithi113:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-12-22T09:59:54.485 DEBUG:teuthology.orchestra.run.smithi113:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-12-22T09:59:54.508 INFO:teuthology.orchestra.run.smithi113.stderr:sudo: /sbin/restorecon: command not found 2023-12-22T09:59:54.508 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-22T09:59:54.509 DEBUG:teuthology.orchestra.run.smithi113:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-12-22T09:59:54.585 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-22T09:59:54.585 INFO:tasks.ceph:role: osd.6 2023-12-22T09:59:54.585 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi113.front.sepia.ceph.com 2023-12-22T09:59:54.586 DEBUG:teuthology.orchestra.run.smithi113:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-12-22T09:59:55.260 INFO:teuthology.orchestra.run.smithi113.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-12-22T09:59:55.260 INFO:teuthology.orchestra.run.smithi113.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-22T09:59:55.261 INFO:teuthology.orchestra.run.smithi113.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-22T09:59:55.261 INFO:teuthology.orchestra.run.smithi113.stdout: = reflink=1 2023-12-22T09:59:55.261 INFO:teuthology.orchestra.run.smithi113.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-22T09:59:55.261 INFO:teuthology.orchestra.run.smithi113.stdout: = sunit=0 swidth=0 blks 2023-12-22T09:59:55.261 INFO:teuthology.orchestra.run.smithi113.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-22T09:59:55.261 INFO:teuthology.orchestra.run.smithi113.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-22T09:59:55.261 INFO:teuthology.orchestra.run.smithi113.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-22T09:59:55.261 INFO:teuthology.orchestra.run.smithi113.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-22T09:59:55.266 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi113.front.sepia.ceph.com -o noatime 2023-12-22T09:59:55.266 DEBUG:teuthology.orchestra.run.smithi113:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-12-22T09:59:55.372 DEBUG:teuthology.orchestra.run.smithi113:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-12-22T09:59:55.395 INFO:teuthology.orchestra.run.smithi113.stderr:sudo: /sbin/restorecon: command not found 2023-12-22T09:59:55.396 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-22T09:59:55.396 DEBUG:teuthology.orchestra.run.smithi113:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-12-22T09:59:55.476 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-22T09:59:55.477 INFO:tasks.ceph:role: osd.7 2023-12-22T09:59:55.477 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi113.front.sepia.ceph.com 2023-12-22T09:59:55.477 DEBUG:teuthology.orchestra.run.smithi113:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-12-22T09:59:56.152 INFO:teuthology.orchestra.run.smithi113.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-12-22T09:59:56.152 INFO:teuthology.orchestra.run.smithi113.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-22T09:59:56.152 INFO:teuthology.orchestra.run.smithi113.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-22T09:59:56.152 INFO:teuthology.orchestra.run.smithi113.stdout: = reflink=1 2023-12-22T09:59:56.153 INFO:teuthology.orchestra.run.smithi113.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-22T09:59:56.153 INFO:teuthology.orchestra.run.smithi113.stdout: = sunit=0 swidth=0 blks 2023-12-22T09:59:56.153 INFO:teuthology.orchestra.run.smithi113.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-22T09:59:56.153 INFO:teuthology.orchestra.run.smithi113.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-22T09:59:56.153 INFO:teuthology.orchestra.run.smithi113.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-22T09:59:56.153 INFO:teuthology.orchestra.run.smithi113.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-22T09:59:56.159 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi113.front.sepia.ceph.com -o noatime 2023-12-22T09:59:56.159 DEBUG:teuthology.orchestra.run.smithi113:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-12-22T09:59:56.268 DEBUG:teuthology.orchestra.run.smithi113:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-12-22T09:59:56.287 INFO:teuthology.orchestra.run.smithi113.stderr:sudo: /sbin/restorecon: command not found 2023-12-22T09:59:56.288 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-22T09:59:56.289 DEBUG:teuthology.orchestra.run.smithi113:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-22T09:59:56.439 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T09:59:56.440+0000 7fb4c199f200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-12-22T09:59:56.442 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T09:59:56.444+0000 7fb4c199f200 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-12-22T09:59:56.442 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T09:59:56.444+0000 7fb4c199f200 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-22T09:59:56.442 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T09:59:56.444+0000 7fb4c199f200 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-22T09:59:56.442 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T09:59:56.444+0000 7fb4c199f200 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-22T09:59:56.448 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T09:59:56.452+0000 7fb4c199f200 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-12-22T09:59:59.991 DEBUG:teuthology.orchestra.run.smithi113:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-12-22T10:00:00.027 DEBUG:teuthology.orchestra.run.smithi113:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-22T10:00:00.142 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:00.144+0000 7f3a77ae4200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-12-22T10:00:00.144 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:00.148+0000 7f3a77ae4200 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-12-22T10:00:00.144 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:00.148+0000 7f3a77ae4200 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-22T10:00:00.144 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:00.148+0000 7f3a77ae4200 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-22T10:00:00.144 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:00.148+0000 7f3a77ae4200 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-22T10:00:00.145 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:00.148+0000 7f3a77ae4200 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-12-22T10:00:02.666 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:00:02.673 DEBUG:teuthology.orchestra.run.smithi113:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:00:03.720 DEBUG:teuthology.orchestra.run.smithi113:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-12-22T10:00:03.755 DEBUG:teuthology.orchestra.run.smithi113:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-22T10:00:03.872 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:03.876+0000 7fe4d04d9200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-12-22T10:00:03.873 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:03.876+0000 7fe4d04d9200 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-12-22T10:00:03.873 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:03.876+0000 7fe4d04d9200 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-22T10:00:03.873 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:03.876+0000 7fe4d04d9200 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-22T10:00:03.873 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:03.876+0000 7fe4d04d9200 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-22T10:00:03.878 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:03.880+0000 7fe4d04d9200 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-12-22T10:00:07.421 DEBUG:teuthology.orchestra.run.smithi113:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-12-22T10:00:07.453 DEBUG:teuthology.orchestra.run.smithi113:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-22T10:00:07.573 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:07.575+0000 7f8d8deef200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-12-22T10:00:07.574 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:07.575+0000 7f8d8deef200 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-12-22T10:00:07.574 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:07.575+0000 7f8d8deef200 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-22T10:00:07.574 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:07.575+0000 7f8d8deef200 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-22T10:00:07.574 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:07.575+0000 7f8d8deef200 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-22T10:00:07.576 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:07.579+0000 7f8d8deef200 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-12-22T10:00:11.117 DEBUG:teuthology.orchestra.run.smithi113:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-12-22T10:00:11.153 INFO:tasks.ceph:Reading keys from all nodes... 2023-12-22T10:00:11.154 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-22T10:00:11.154 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-12-22T10:00:11.191 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-22T10:00:11.191 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-12-22T10:00:11.268 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-22T10:00:11.268 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-12-22T10:00:11.345 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-22T10:00:11.345 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-12-22T10:00:11.425 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-22T10:00:11.425 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-12-22T10:00:11.505 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-22T10:00:11.505 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-12-22T10:00:11.585 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-22T10:00:11.585 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-12-22T10:00:11.664 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-22T10:00:11.665 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-12-22T10:00:11.699 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-22T10:00:11.699 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-12-22T10:00:11.775 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-22T10:00:11.775 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-12-22T10:00:11.861 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-22T10:00:11.861 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-12-22T10:00:11.936 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-22T10:00:11.936 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-12-22T10:00:12.018 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-22T10:00:12.019 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-12-22T10:00:12.092 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-22T10:00:12.092 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-12-22T10:00:12.176 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-22T10:00:12.176 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-12-22T10:00:12.198 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-22T10:00:12.199 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-12-22T10:00:12.264 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-22T10:00:12.264 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-12-22T10:00:12.281 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-22T10:00:12.281 DEBUG:teuthology.orchestra.run.smithi113:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-12-22T10:00:12.339 INFO:tasks.ceph:Adding keys to all mons... 2023-12-22T10:00:12.340 DEBUG:teuthology.orchestra.run.smithi045:> sudo tee -a /etc/ceph/ceph.keyring 2023-12-22T10:00:12.347 DEBUG:teuthology.orchestra.run.smithi113:> sudo tee -a /etc/ceph/ceph.keyring 2023-12-22T10:00:12.391 INFO:teuthology.orchestra.run.smithi045.stdout:[mgr.y] 2023-12-22T10:00:12.391 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQAHXoVlZcGGJRAAxSVvfqKMEi08ilZlO7XowQ== 2023-12-22T10:00:12.391 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.a] 2023-12-22T10:00:12.391 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQAHXoVlqc61MhAAPD8joFf9bw/GcDPT6N8/3w== 2023-12-22T10:00:12.391 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.c] 2023-12-22T10:00:12.391 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQAIXoVl+/VuARAAS7BSMEweIw+gJSXfsBYiqA== 2023-12-22T10:00:12.391 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.0] 2023-12-22T10:00:12.391 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQAKXoVla+TQBBAAWfXaheCMCXIvlomPbXhO/g== 2023-12-22T10:00:12.391 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.1] 2023-12-22T10:00:12.391 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQANXoVlzD/rLhAAh4CLB2zVod4fxnP/TId6aA== 2023-12-22T10:00:12.391 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.2] 2023-12-22T10:00:12.392 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQARXoVlCVgtHBAACxKO/3tVUdVowe/c+cOF+w== 2023-12-22T10:00:12.392 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.3] 2023-12-22T10:00:12.392 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQAVXoVlSl5mCxAAYUAAa9xI4bFitu8+eGp+vg== 2023-12-22T10:00:12.392 INFO:teuthology.orchestra.run.smithi045.stdout:[mgr.x] 2023-12-22T10:00:12.392 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQAHXoVlwlHvLBAAR/rp51Gi4gA94bQfB9/+EA== 2023-12-22T10:00:12.392 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.b] 2023-12-22T10:00:12.392 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQAIXoVlovyZCRAAFWq+P1UMNexooN7YnmR4Mg== 2023-12-22T10:00:12.392 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.d] 2023-12-22T10:00:12.392 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQAIXoVlm4aAExAAt1TQj2/UrmuvttPaBtXEtw== 2023-12-22T10:00:12.392 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.4] 2023-12-22T10:00:12.392 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQAcXoVl38KFGhAA9u2gcU9/rvZwg6kRF0sdXA== 2023-12-22T10:00:12.392 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.5] 2023-12-22T10:00:12.392 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQAgXoVloe3UCBAAlI19r9B60/VgkTbKmRJ77g== 2023-12-22T10:00:12.393 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.6] 2023-12-22T10:00:12.393 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQAjXoVlVgFaNBAAIjAa/m8tbt0y256h+NvA4Q== 2023-12-22T10:00:12.393 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.7] 2023-12-22T10:00:12.393 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQAnXoVlZOR/IhAAlnxdbjYLlrLtXfP3mPu0dw== 2023-12-22T10:00:12.393 INFO:teuthology.orchestra.run.smithi045.stdout:[client.0] 2023-12-22T10:00:12.393 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQAIXoVl5rrdGRAAyhekUq4nON03SOMbtnxU0w== 2023-12-22T10:00:12.393 INFO:teuthology.orchestra.run.smithi045.stdout:[client.2] 2023-12-22T10:00:12.393 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQAIXoVlW9EnHxAAjfP6mm3JJRqZTWF6fc8vWA== 2023-12-22T10:00:12.393 INFO:teuthology.orchestra.run.smithi045.stdout:[client.1] 2023-12-22T10:00:12.393 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQAIXoVlWoihJBAAmHWLfHGqngUrp6ezLgDb/Q== 2023-12-22T10:00:12.393 INFO:teuthology.orchestra.run.smithi045.stdout:[client.3] 2023-12-22T10:00:12.393 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQAIXoVlOCbgKRAAL+EeTyy93asMce+2PSmB0w== 2023-12-22T10:00:12.418 INFO:teuthology.orchestra.run.smithi113.stdout:[mgr.y] 2023-12-22T10:00:12.418 INFO:teuthology.orchestra.run.smithi113.stdout: key = AQAHXoVlZcGGJRAAxSVvfqKMEi08ilZlO7XowQ== 2023-12-22T10:00:12.419 INFO:teuthology.orchestra.run.smithi113.stdout:[mds.a] 2023-12-22T10:00:12.419 INFO:teuthology.orchestra.run.smithi113.stdout: key = AQAHXoVlqc61MhAAPD8joFf9bw/GcDPT6N8/3w== 2023-12-22T10:00:12.419 INFO:teuthology.orchestra.run.smithi113.stdout:[mds.c] 2023-12-22T10:00:12.419 INFO:teuthology.orchestra.run.smithi113.stdout: key = AQAIXoVl+/VuARAAS7BSMEweIw+gJSXfsBYiqA== 2023-12-22T10:00:12.419 INFO:teuthology.orchestra.run.smithi113.stdout:[osd.0] 2023-12-22T10:00:12.419 INFO:teuthology.orchestra.run.smithi113.stdout: key = AQAKXoVla+TQBBAAWfXaheCMCXIvlomPbXhO/g== 2023-12-22T10:00:12.419 INFO:teuthology.orchestra.run.smithi113.stdout:[osd.1] 2023-12-22T10:00:12.419 INFO:teuthology.orchestra.run.smithi113.stdout: key = AQANXoVlzD/rLhAAh4CLB2zVod4fxnP/TId6aA== 2023-12-22T10:00:12.419 INFO:teuthology.orchestra.run.smithi113.stdout:[osd.2] 2023-12-22T10:00:12.419 INFO:teuthology.orchestra.run.smithi113.stdout: key = AQARXoVlCVgtHBAACxKO/3tVUdVowe/c+cOF+w== 2023-12-22T10:00:12.419 INFO:teuthology.orchestra.run.smithi113.stdout:[osd.3] 2023-12-22T10:00:12.419 INFO:teuthology.orchestra.run.smithi113.stdout: key = AQAVXoVlSl5mCxAAYUAAa9xI4bFitu8+eGp+vg== 2023-12-22T10:00:12.419 INFO:teuthology.orchestra.run.smithi113.stdout:[mgr.x] 2023-12-22T10:00:12.419 INFO:teuthology.orchestra.run.smithi113.stdout: key = AQAHXoVlwlHvLBAAR/rp51Gi4gA94bQfB9/+EA== 2023-12-22T10:00:12.420 INFO:teuthology.orchestra.run.smithi113.stdout:[mds.b] 2023-12-22T10:00:12.420 INFO:teuthology.orchestra.run.smithi113.stdout: key = AQAIXoVlovyZCRAAFWq+P1UMNexooN7YnmR4Mg== 2023-12-22T10:00:12.420 INFO:teuthology.orchestra.run.smithi113.stdout:[mds.d] 2023-12-22T10:00:12.420 INFO:teuthology.orchestra.run.smithi113.stdout: key = AQAIXoVlm4aAExAAt1TQj2/UrmuvttPaBtXEtw== 2023-12-22T10:00:12.420 INFO:teuthology.orchestra.run.smithi113.stdout:[osd.4] 2023-12-22T10:00:12.420 INFO:teuthology.orchestra.run.smithi113.stdout: key = AQAcXoVl38KFGhAA9u2gcU9/rvZwg6kRF0sdXA== 2023-12-22T10:00:12.420 INFO:teuthology.orchestra.run.smithi113.stdout:[osd.5] 2023-12-22T10:00:12.420 INFO:teuthology.orchestra.run.smithi113.stdout: key = AQAgXoVloe3UCBAAlI19r9B60/VgkTbKmRJ77g== 2023-12-22T10:00:12.420 INFO:teuthology.orchestra.run.smithi113.stdout:[osd.6] 2023-12-22T10:00:12.420 INFO:teuthology.orchestra.run.smithi113.stdout: key = AQAjXoVlVgFaNBAAIjAa/m8tbt0y256h+NvA4Q== 2023-12-22T10:00:12.420 INFO:teuthology.orchestra.run.smithi113.stdout:[osd.7] 2023-12-22T10:00:12.420 INFO:teuthology.orchestra.run.smithi113.stdout: key = AQAnXoVlZOR/IhAAlnxdbjYLlrLtXfP3mPu0dw== 2023-12-22T10:00:12.420 INFO:teuthology.orchestra.run.smithi113.stdout:[client.0] 2023-12-22T10:00:12.420 INFO:teuthology.orchestra.run.smithi113.stdout: key = AQAIXoVl5rrdGRAAyhekUq4nON03SOMbtnxU0w== 2023-12-22T10:00:12.421 INFO:teuthology.orchestra.run.smithi113.stdout:[client.2] 2023-12-22T10:00:12.421 INFO:teuthology.orchestra.run.smithi113.stdout: key = AQAIXoVlW9EnHxAAjfP6mm3JJRqZTWF6fc8vWA== 2023-12-22T10:00:12.421 INFO:teuthology.orchestra.run.smithi113.stdout:[client.1] 2023-12-22T10:00:12.421 INFO:teuthology.orchestra.run.smithi113.stdout: key = AQAIXoVlWoihJBAAmHWLfHGqngUrp6ezLgDb/Q== 2023-12-22T10:00:12.421 INFO:teuthology.orchestra.run.smithi113.stdout:[client.3] 2023-12-22T10:00:12.421 INFO:teuthology.orchestra.run.smithi113.stdout: key = AQAIXoVlOCbgKRAAL+EeTyy93asMce+2PSmB0w== 2023-12-22T10:00:12.423 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-22T10:00:12.448 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-22T10:00:12.536 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-22T10:00:12.544 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-22T10:00:12.620 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-22T10:00:12.627 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-22T10:00:12.700 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-22T10:00:12.707 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-22T10:00:12.779 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-22T10:00:12.786 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-22T10:00:12.858 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-22T10:00:12.865 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-22T10:00:12.937 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-22T10:00:12.944 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-22T10:00:13.014 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-22T10:00:13.021 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-22T10:00:13.093 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-22T10:00:13.100 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-22T10:00:13.174 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-22T10:00:13.181 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-22T10:00:13.260 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-22T10:00:13.266 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-22T10:00:13.339 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-22T10:00:13.346 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-22T10:00:13.418 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-22T10:00:13.425 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-22T10:00:13.496 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-22T10:00:13.503 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-22T10:00:13.573 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-22T10:00:13.581 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-22T10:00:13.655 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-22T10:00:13.663 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-22T10:00:13.736 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-22T10:00:13.742 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-22T10:00:13.814 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-22T10:00:13.821 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-22T10:00:13.894 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-12-22T10:00:13.894 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-12-22T10:00:13.931 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-22T10:00:14.063 DEBUG:teuthology.orchestra.run.smithi045:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-12-22T10:00:14.100 DEBUG:teuthology.orchestra.run.smithi113:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-12-22T10:00:14.139 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-22T10:00:14.280 DEBUG:teuthology.orchestra.run.smithi113:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-12-22T10:00:14.316 DEBUG:teuthology.orchestra.run.smithi113:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-12-22T10:00:14.400 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-22T10:00:14.535 DEBUG:teuthology.orchestra.run.smithi113:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-12-22T10:00:14.568 DEBUG:teuthology.orchestra.run.smithi045:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-12-22T10:00:14.576 DEBUG:teuthology.orchestra.run.smithi113:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-12-22T10:00:14.627 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-12-22T10:00:14.628 INFO:tasks.ceph.mon.a:Restarting daemon 2023-12-22T10:00:14.628 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-12-22T10:00:14.634 INFO:tasks.ceph.mon.a:Started 2023-12-22T10:00:14.635 INFO:tasks.ceph.mon.b:Restarting daemon 2023-12-22T10:00:14.635 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-12-22T10:00:14.678 INFO:tasks.ceph.mon.b:Started 2023-12-22T10:00:14.678 INFO:tasks.ceph.mon.c:Restarting daemon 2023-12-22T10:00:14.678 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-12-22T10:00:14.684 INFO:tasks.ceph.mon.c:Started 2023-12-22T10:00:14.684 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-12-22T10:00:14.685 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-12-22T10:00:14.685 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-12-22T10:00:14.692 INFO:tasks.ceph.mgr.y:Started 2023-12-22T10:00:14.692 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-12-22T10:00:14.692 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-12-22T10:00:14.699 INFO:tasks.ceph.mgr.x:Started 2023-12-22T10:00:14.699 INFO:tasks.ceph:Setting crush tunables to default 2023-12-22T10:00:14.699 DEBUG:teuthology.orchestra.run.smithi045:> sudo ceph --cluster ceph osd crush tunables default 2023-12-22T10:00:14.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:14.862+0000 7f53bef46700 1 Processor -- start 2023-12-22T10:00:14.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:14.862+0000 7f53bef46700 1 -- start start 2023-12-22T10:00:14.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:14.862+0000 7f53bef46700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f53b8150880 0x7f53b80a6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:14.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:14.862+0000 7f53bef46700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f53b8150c60 0x7f53b80a6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:14.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:14.866+0000 7f53bef46700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53b8062650 con 0x7f53b8063a60 2023-12-22T10:00:14.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:14.866+0000 7f53bef46700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53b80c2ba0 con 0x7f53b8150880 2023-12-22T10:00:14.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:14.866+0000 7f53bef46700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53b80a70e0 con 0x7f53b8150c60 2023-12-22T10:00:14.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:14.866+0000 7f53bcce2700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f53b8150880 0x7f53b80a6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:14.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:14.866+0000 7f53bcce2700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f53b8150880 0x7f53b80a6700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.45:33050/0 (socket says 172.21.15.45:33050) 2023-12-22T10:00:14.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:14.866+0000 7f53bcce2700 1 -- 172.21.15.45:0/2900979919 learned_addr learned my addr 172.21.15.45:0/2900979919 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:14.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:14.866+0000 7f53b7fff700 1 --2- 172.21.15.45:0/2900979919 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f53b8150c60 0x7f53b80a6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:14.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:14.866+0000 7f53bd4e3700 1 --1- 172.21.15.45:0/2900979919 >> v1:172.21.15.113:6789/0 conn(0x7f53b8063a60 0x7f53b8063e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.45:44620/0 (socket says 172.21.15.45:44620) 2023-12-22T10:00:14.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:14.866+0000 7f53bcce2700 1 -- 172.21.15.45:0/2900979919 >> v2:172.21.15.113:3300/0 conn(0x7f53b8150880 msgr2=0x7f53b80a6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-22T10:00:14.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:14.866+0000 7f53bcce2700 1 -- 172.21.15.45:0/2900979919 >> v2:172.21.15.113:3300/0 conn(0x7f53b8150880 msgr2=0x7f53b80a6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-22T10:00:14.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:14.866+0000 7f53bcce2700 1 --2- 172.21.15.45:0/2900979919 >> v2:172.21.15.113:3300/0 conn(0x7f53b8150880 0x7f53b80a6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-12-22T10:00:14.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:14.866+0000 7f53bcce2700 1 --2- 172.21.15.45:0/2900979919 >> v2:172.21.15.113:3300/0 conn(0x7f53b8150880 0x7f53b80a6700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2023-12-22T10:00:14.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:14.866+0000 7f53b7fff700 1 -- 172.21.15.45:0/2900979919 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f53b8150c60 msgr2=0x7f53b80a6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-12-22T10:00:14.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:14.866+0000 7f53b7fff700 1 -- 172.21.15.45:0/2900979919 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f53b8150c60 msgr2=0x7f53b80a6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-22T10:00:14.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:14.866+0000 7f53b7fff700 1 --2- 172.21.15.45:0/2900979919 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f53b8150c60 0x7f53b80a6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-12-22T10:00:14.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:14.866+0000 7f53b7fff700 1 --2- 172.21.15.45:0/2900979919 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f53b8150c60 0x7f53b80a6bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2023-12-22T10:00:15.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:15.030+0000 7f53b77fe700 1 -- 172.21.15.45:0/2900979919 <== mon.1 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3073021411 0 0) 0x7f53b8062650 con 0x7f53b8063a60 2023-12-22T10:00:15.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:15.030+0000 7f53b77fe700 1 -- 172.21.15.45:0/2900979919 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53a80033f0 con 0x7f53b8063a60 2023-12-22T10:00:15.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:15.034+0000 7f53b77fe700 1 -- 172.21.15.45:0/2900979919 <== mon.1 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3302720248 0 0) 0x7f53a80033f0 con 0x7f53b8063a60 2023-12-22T10:00:15.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:15.034+0000 7f53b77fe700 1 -- 172.21.15.45:0/2900979919 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f53b8150c60 msgr2=0x7f53b80a6bf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-22T10:00:15.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:15.034+0000 7f53b77fe700 1 --2- 172.21.15.45:0/2900979919 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f53b8150c60 0x7f53b80a6bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:15.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:15.034+0000 7f53b77fe700 1 -- 172.21.15.45:0/2900979919 >> v2:172.21.15.113:3300/0 conn(0x7f53b8150880 msgr2=0x7f53b80a6700 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-22T10:00:15.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:15.034+0000 7f53b77fe700 1 --2- 172.21.15.45:0/2900979919 >> v2:172.21.15.113:3300/0 conn(0x7f53b8150880 0x7f53b80a6700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:15.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:15.034+0000 7f53b77fe700 1 -- 172.21.15.45:0/2900979919 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53b80c1f90 con 0x7f53b8063a60 2023-12-22T10:00:15.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:15.034+0000 7f53b77fe700 1 -- 172.21.15.45:0/2900979919 <== mon.1 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2619163070 0 0) 0x7f53b00017f0 con 0x7f53b8063a60 2023-12-22T10:00:15.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:15.034+0000 7f53b77fe700 1 -- 172.21.15.45:0/2900979919 >> v1:172.21.15.113:6789/0 conn(0x7f53b8063a60 legacy=0x7f53b8063e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:15.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:15.034+0000 7f53b77fe700 1 --2- 172.21.15.45:0/2900979919 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53a80038e0 0x7f53a8003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:15.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:15.034+0000 7f53b77fe700 1 --2- 172.21.15.45:0/2900979919 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f53a8004690 0x7f53a8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:15.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:15.034+0000 7f53b77fe700 1 --2- 172.21.15.45:0/2900979919 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f53a8005000 0x7f53a800fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:15.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:15.034+0000 7f53b77fe700 1 -- 172.21.15.45:0/2900979919 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53b80c2ba0 con 0x7f53a80038e0 2023-12-22T10:00:15.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:15.034+0000 7f53b77fe700 1 -- 172.21.15.45:0/2900979919 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53b80a70e0 con 0x7f53a8004690 2023-12-22T10:00:15.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:15.034+0000 7f53b77fe700 1 -- 172.21.15.45:0/2900979919 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53a80101e0 con 0x7f53a8005000 2023-12-22T10:00:15.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:15.034+0000 7f53bcce2700 1 --2- 172.21.15.45:0/2900979919 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53a80038e0 0x7f53a8003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:15.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:15.034+0000 7f53b7fff700 1 --2- 172.21.15.45:0/2900979919 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f53a8004690 0x7f53a8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:15.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:15.034+0000 7f53bd4e3700 1 --2- 172.21.15.45:0/2900979919 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f53a8005000 0x7f53a800fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:15.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:15.034+0000 7f53bcce2700 1 -- 172.21.15.45:0/2900979919 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f53a8005000 msgr2=0x7f53a800fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:00:15.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:15.034+0000 7f53bcce2700 1 --2- 172.21.15.45:0/2900979919 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f53a8005000 0x7f53a800fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:15.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:15.038+0000 7f53bcce2700 1 -- 172.21.15.45:0/2900979919 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f53a8004690 msgr2=0x7f53a8004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:00:15.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:15.038+0000 7f53bcce2700 1 --2- 172.21.15.45:0/2900979919 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f53a8004690 0x7f53a8004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:15.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:15.038+0000 7f53bcce2700 1 -- 172.21.15.45:0/2900979919 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53a80033f0 con 0x7f53a80038e0 2023-12-22T10:00:15.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:15.038+0000 7f53bd4e3700 1 --2- 172.21.15.45:0/2900979919 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f53a8005000 0x7f53a800fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-12-22T10:00:15.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:15.038+0000 7f53bcce2700 1 --2- 172.21.15.45:0/2900979919 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53a80038e0 0x7f53a8003d00 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f53ac00ba80 tx=0x7f53ac008040).ready entity=mon.0 client_cookie=8187cecaf015b671 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:15.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:15.038+0000 7f53b77fe700 1 -- 172.21.15.45:0/2900979919 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53ac00b3f0 con 0x7f53a80038e0 2023-12-22T10:00:15.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:15.038+0000 7f53b77fe700 1 -- 172.21.15.45:0/2900979919 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53ac00d5d0 con 0x7f53a80038e0 2023-12-22T10:00:15.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:15.038+0000 7f53b77fe700 1 -- 172.21.15.45:0/2900979919 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53ac00d950 con 0x7f53a80038e0 2023-12-22T10:00:15.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:15.038+0000 7f53bef46700 1 -- 172.21.15.45:0/2900979919 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53a80038e0 msgr2=0x7f53a8003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:15.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:15.038+0000 7f53bef46700 1 --2- 172.21.15.45:0/2900979919 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53a80038e0 0x7f53a8003d00 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f53ac00ba80 tx=0x7f53ac008040).stop 2023-12-22T10:00:15.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:15.038+0000 7f53bd4e3700 1 -- 172.21.15.45:0/2900979919 reap_dead start 2023-12-22T10:00:15.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:15.038+0000 7f53bef46700 1 -- 172.21.15.45:0/2900979919 shutdown_connections 2023-12-22T10:00:15.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:15.038+0000 7f53bef46700 1 -- 172.21.15.45:0/2900979919 >> 172.21.15.45:0/2900979919 conn(0x7f53b8068650 msgr2=0x7f53b80c7850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:15.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:15.038+0000 7f53bef46700 1 -- 172.21.15.45:0/2900979919 shutdown_connections 2023-12-22T10:00:15.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:15.038+0000 7f53bef46700 1 -- 172.21.15.45:0/2900979919 wait complete. 2023-12-22T10:00:15.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:15.042+0000 7f53bef46700 1 Processor -- start 2023-12-22T10:00:15.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:15.042+0000 7f53bef46700 1 -- start start 2023-12-22T10:00:15.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:15.042+0000 7f53bef46700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f53a80038e0 0x7f53b814c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:15.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:15.042+0000 7f53bef46700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53b8162f70 0x7f53b81633f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:15.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:15.042+0000 7f53bef46700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f53b80bc7b0 0x7f53b80bcc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:15.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:15.042+0000 7f53bef46700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53b81638e0 con 0x7f53b8162f70 2023-12-22T10:00:15.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:15.042+0000 7f53bef46700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53b80a6480 con 0x7f53b80bc7b0 2023-12-22T10:00:15.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:15.042+0000 7f53bef46700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53b814d4a0 con 0x7f53a80038e0 2023-12-22T10:00:15.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:15.042+0000 7f53b7fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53b8162f70 0x7f53b81633f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:15.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:15.042+0000 7f53b7fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53b8162f70 0x7f53b81633f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47638/0 (socket says 172.21.15.45:47638) 2023-12-22T10:00:15.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:15.046+0000 7f53bcce2700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f53a80038e0 0x7f53b814c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:15.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:15.046+0000 7f53b7fff700 1 -- 172.21.15.45:0/3911132893 learned_addr learned my addr 172.21.15.45:0/3911132893 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:15.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:15.046+0000 7f53bd4e3700 1 --2- 172.21.15.45:0/3911132893 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f53b80bc7b0 0x7f53b80bcc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:15.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:15.046+0000 7f53bcce2700 1 -- 172.21.15.45:0/3911132893 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f53b80bc7b0 msgr2=0x7f53b80bcc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:15.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:15.046+0000 7f53bcce2700 1 --2- 172.21.15.45:0/3911132893 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f53b80bc7b0 0x7f53b80bcc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:15.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:15.046+0000 7f53bcce2700 1 -- 172.21.15.45:0/3911132893 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53b8162f70 msgr2=0x7f53b81633f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:15.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:15.046+0000 7f53bcce2700 1 --2- 172.21.15.45:0/3911132893 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53b8162f70 0x7f53b81633f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:15.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:15.046+0000 7f53bcce2700 1 -- 172.21.15.45:0/3911132893 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53b80bd100 con 0x7f53a80038e0 2023-12-22T10:00:15.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:15.046+0000 7f53bcce2700 1 --2- 172.21.15.45:0/3911132893 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f53a80038e0 0x7f53b814c370 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f53ac016000 tx=0x7f53ac008040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:15.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:15.046+0000 7f53b4ff9700 1 -- 172.21.15.45:0/3911132893 <== mon.2 v2:172.21.15.113:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53ac00dcc0 con 0x7f53a80038e0 2023-12-22T10:00:15.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:15.046+0000 7f53b4ff9700 1 -- 172.21.15.45:0/3911132893 <== mon.2 v2:172.21.15.113:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53ac00de20 con 0x7f53a80038e0 2023-12-22T10:00:15.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:15.046+0000 7f53bef46700 1 -- 172.21.15.45:0/3911132893 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53b8163ae0 con 0x7f53a80038e0 2023-12-22T10:00:15.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:15.046+0000 7f53b4ff9700 1 -- 172.21.15.45:0/3911132893 <== mon.2 v2:172.21.15.113:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53ac006040 con 0x7f53a80038e0 2023-12-22T10:00:15.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:15.046+0000 7f53bef46700 1 -- 172.21.15.45:0/3911132893 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53b814d130 con 0x7f53a80038e0 2023-12-22T10:00:15.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:15.046+0000 7f53b4ff9700 1 -- 172.21.15.45:0/3911132893 <== mon.2 v2:172.21.15.113:3301/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f53ac023020 con 0x7f53a80038e0 2023-12-22T10:00:15.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:15.046+0000 7f53b4ff9700 1 -- 172.21.15.45:0/3911132893 <== mon.2 v2:172.21.15.113:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7f53ac026790 con 0x7f53a80038e0 2023-12-22T10:00:15.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:15.050+0000 7f53bef46700 1 -- 172.21.15.45:0/3911132893 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53b806c070 con 0x7f53a80038e0 2023-12-22T10:00:15.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:15.054+0000 7f53b4ff9700 1 -- 172.21.15.45:0/3911132893 <== mon.2 v2:172.21.15.113:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7f53ac045e50 con 0x7f53a80038e0 2023-12-22T10:00:15.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:15.126+0000 7f53bef46700 1 -- 172.21.15.45:0/3911132893 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f53b80be370 con 0x7f53a80038e0 2023-12-22T10:00:15.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:15.138+0000 7f53b4ff9700 1 -- 172.21.15.45:0/3911132893 <== mon.2 v2:172.21.15.113:3301/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f53ac034070 con 0x7f53a80038e0 2023-12-22T10:00:15.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:15.138+0000 7f53bef46700 1 -- 172.21.15.45:0/3911132893 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f53a80038e0 msgr2=0x7f53b814c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:15.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:15.138+0000 7f53bef46700 1 --2- 172.21.15.45:0/3911132893 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f53a80038e0 0x7f53b814c370 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f53ac016000 tx=0x7f53ac008040).stop 2023-12-22T10:00:15.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:15.138+0000 7f53bef46700 1 -- 172.21.15.45:0/3911132893 shutdown_connections 2023-12-22T10:00:15.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:15.138+0000 7f53bef46700 1 --2- 172.21.15.45:0/3911132893 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f53b80bc7b0 0x7f53b80bcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:15.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:15.138+0000 7f53bef46700 1 --2- 172.21.15.45:0/3911132893 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53b8162f70 0x7f53b81633f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:15.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:15.138+0000 7f53bef46700 1 --2- 172.21.15.45:0/3911132893 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f53a80038e0 0x7f53b814c370 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:15.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:15.138+0000 7f53bef46700 1 -- 172.21.15.45:0/3911132893 >> 172.21.15.45:0/3911132893 conn(0x7f53b8068650 msgr2=0x7f53b80c73c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:15.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:15.138+0000 7f53bef46700 1 -- 172.21.15.45:0/3911132893 shutdown_connections 2023-12-22T10:00:15.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:15.138+0000 7f53bef46700 1 -- 172.21.15.45:0/3911132893 wait complete. 2023-12-22T10:00:15.138 INFO:teuthology.orchestra.run.smithi045.stderr:adjusted tunables profile to default 2023-12-22T10:00:15.155 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-12-22T10:00:15.156 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-22T10:00:15.156 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-12-22T10:00:15.190 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-22T10:00:15.190 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-12-22T10:00:15.266 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-22T10:00:15.266 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-12-22T10:00:15.272 INFO:tasks.ceph.mgr.x.smithi113.stderr:2023-12-22T10:00:15.275+0000 7f34c0937500 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-22T10:00:15.275 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-12-22T10:00:15.278+0000 7fba07145500 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-22T10:00:15.308 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-22T10:00:15.308 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-12-22T10:00:15.356 INFO:tasks.ceph.mgr.x.smithi113.stderr:2023-12-22T10:00:15.359+0000 7f34c0937500 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-22T10:00:15.368 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-12-22T10:00:15.370+0000 7fba07145500 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-22T10:00:15.385 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-22T10:00:15.385 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-12-22T10:00:15.415 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-22T10:00:15.415 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-12-22T10:00:15.494 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-22T10:00:15.494 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-12-22T10:00:15.567 DEBUG:teuthology.orchestra.run.smithi113:> set -ex 2023-12-22T10:00:15.567 DEBUG:teuthology.orchestra.run.smithi113:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-12-22T10:00:15.649 DEBUG:teuthology.orchestra.run.smithi113:> sudo ceph --cluster ceph osd new e19943a0-1c6b-47df-b6bb-383472077890 0 2023-12-22T10:00:15.839 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:15.839+0000 7fd4f6f79700 1 Processor -- start 2023-12-22T10:00:15.840 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:15.843+0000 7fd4f6f79700 1 -- start start 2023-12-22T10:00:15.843 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:15.843+0000 7fd4f6f79700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fd4f0153830 0x7fd4f00656f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:15.843 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:15.843+0000 7fd4f6f79700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd4f00bd300 0x7fd4f0065be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:15.843 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:15.843+0000 7fd4f6f79700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd4f0067440 0x7fd4f00660d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:15.843 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:15.843+0000 7fd4f6f79700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4f00665c0 con 0x7fd4f00bd300 2023-12-22T10:00:15.843 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:15.843+0000 7fd4f6f79700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4f00bce70 con 0x7fd4f0153830 2023-12-22T10:00:15.843 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:15.843+0000 7fd4f6f79700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4f0067960 con 0x7fd4f0067440 2023-12-22T10:00:15.843 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:15.843+0000 7fd4f5f77700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fd4f0153830 0x7fd4f00656f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:15.843 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:15.843+0000 7fd4f6778700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd4f0067440 0x7fd4f00660d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:15.843 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:15.843+0000 7fd4f5f77700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fd4f0153830 0x7fd4f00656f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:52284/0 (socket says 172.21.15.113:52284) 2023-12-22T10:00:15.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:15.843+0000 7fd4f5f77700 1 -- 172.21.15.113:0/4037331394 learned_addr learned my addr 172.21.15.113:0/4037331394 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-22T10:00:15.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:15.843+0000 7fd4f5776700 1 --2- 172.21.15.113:0/4037331394 >> v2:172.21.15.45:3300/0 conn(0x7fd4f00bd300 0x7fd4f0065be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:15.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:15.843+0000 7fd4f5f77700 1 -- 172.21.15.113:0/4037331394 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd4f0067440 msgr2=0x7fd4f00660d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:00:15.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:15.843+0000 7fd4f5f77700 1 --2- 172.21.15.113:0/4037331394 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd4f0067440 0x7fd4f00660d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:15.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:15.843+0000 7fd4f5f77700 1 -- 172.21.15.113:0/4037331394 >> v2:172.21.15.45:3300/0 conn(0x7fd4f00bd300 msgr2=0x7fd4f0065be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:00:15.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:15.843+0000 7fd4f5f77700 1 --2- 172.21.15.113:0/4037331394 >> v2:172.21.15.45:3300/0 conn(0x7fd4f00bd300 0x7fd4f0065be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:15.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:15.843+0000 7fd4f5f77700 1 -- 172.21.15.113:0/4037331394 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4f00bc540 con 0x7fd4f0153830 2023-12-22T10:00:15.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:15.843+0000 7fd4f5776700 1 --2- 172.21.15.113:0/4037331394 >> v2:172.21.15.45:3300/0 conn(0x7fd4f00bd300 0x7fd4f0065be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T10:00:15.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:15.843+0000 7fd4f5f77700 1 --2- 172.21.15.113:0/4037331394 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd4f0153830 0x7fd4f00656f0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7fd4f0064c40 tx=0x7fd4ec0090f0).ready entity=mon.1 client_cookie=18433cd76b923755 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:15.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:15.843+0000 7fd4f4f75700 1 -- 172.21.15.113:0/4037331394 <== mon.1 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4ec00b520 con 0x7fd4f0153830 2023-12-22T10:00:15.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:15.843+0000 7fd4f4f75700 1 -- 172.21.15.113:0/4037331394 <== mon.1 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4ec00b680 con 0x7fd4f0153830 2023-12-22T10:00:15.844 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:15.843+0000 7fd4f4f75700 1 -- 172.21.15.113:0/4037331394 <== mon.1 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4ec00ba00 con 0x7fd4f0153830 2023-12-22T10:00:15.845 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:15.847+0000 7fd4f6f79700 1 -- 172.21.15.113:0/4037331394 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd4f0153830 msgr2=0x7fd4f00656f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:15.845 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:15.847+0000 7fd4f6f79700 1 --2- 172.21.15.113:0/4037331394 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd4f0153830 0x7fd4f00656f0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7fd4f0064c40 tx=0x7fd4ec0090f0).stop 2023-12-22T10:00:15.845 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:15.847+0000 7fd4f6f79700 1 -- 172.21.15.113:0/4037331394 shutdown_connections 2023-12-22T10:00:15.845 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:15.847+0000 7fd4f6f79700 1 --2- 172.21.15.113:0/4037331394 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd4f0067440 0x7fd4f00660d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:15.845 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:15.847+0000 7fd4f6f79700 1 --2- 172.21.15.113:0/4037331394 >> v2:172.21.15.45:3300/0 conn(0x7fd4f00bd300 0x7fd4f0065be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:15.846 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:15.847+0000 7fd4f6f79700 1 --2- 172.21.15.113:0/4037331394 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd4f0153830 0x7fd4f00656f0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:15.846 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:15.847+0000 7fd4f6f79700 1 -- 172.21.15.113:0/4037331394 >> 172.21.15.113:0/4037331394 conn(0x7fd4f0068610 msgr2=0x7fd4f00c3fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:15.846 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:15.847+0000 7fd4f6f79700 1 -- 172.21.15.113:0/4037331394 shutdown_connections 2023-12-22T10:00:15.846 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:15.847+0000 7fd4f6f79700 1 -- 172.21.15.113:0/4037331394 wait complete. 2023-12-22T10:00:15.847 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:15.847+0000 7fd4f6f79700 1 Processor -- start 2023-12-22T10:00:15.847 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:15.851+0000 7fd4f6f79700 1 -- start start 2023-12-22T10:00:15.849 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:15.851+0000 7fd4f6f79700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd4f0067440 0x7fd4f013ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:15.849 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:15.851+0000 7fd4f6f79700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd4f00bd300 0x7fd4f00c4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:15.849 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:15.851+0000 7fd4f6f79700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd4f0153830 0x7fd4f00c52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:15.849 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:15.851+0000 7fd4f6f79700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4f00c58b0 con 0x7fd4f0153830 2023-12-22T10:00:15.849 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:15.851+0000 7fd4f6f79700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4f00c5b90 con 0x7fd4f0067440 2023-12-22T10:00:15.849 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:15.851+0000 7fd4f6f79700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4f00c5e70 con 0x7fd4f00bd300 2023-12-22T10:00:15.850 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:15.851+0000 7fd4f5f77700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd4f0067440 0x7fd4f013ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:15.850 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:15.851+0000 7fd4f5776700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd4f00bd300 0x7fd4f00c4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:15.850 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:15.851+0000 7fd4f5f77700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd4f0067440 0x7fd4f013ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:52300/0 (socket says 172.21.15.113:52300) 2023-12-22T10:00:15.851 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:15.851+0000 7fd4f5f77700 1 -- 172.21.15.113:0/3088859954 learned_addr learned my addr 172.21.15.113:0/3088859954 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-22T10:00:15.851 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:15.851+0000 7fd4f6778700 1 --2- 172.21.15.113:0/3088859954 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd4f0153830 0x7fd4f00c52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:15.851 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:15.851+0000 7fd4f5f77700 1 -- 172.21.15.113:0/3088859954 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd4f00bd300 msgr2=0x7fd4f00c4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:15.851 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:15.851+0000 7fd4f5f77700 1 --2- 172.21.15.113:0/3088859954 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd4f00bd300 0x7fd4f00c4df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:15.851 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:15.851+0000 7fd4f5f77700 1 -- 172.21.15.113:0/3088859954 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd4f0153830 msgr2=0x7fd4f00c52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:15.851 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:15.851+0000 7fd4f5f77700 1 --2- 172.21.15.113:0/3088859954 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd4f0153830 0x7fd4f00c52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:15.851 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:15.851+0000 7fd4f5f77700 1 -- 172.21.15.113:0/3088859954 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4ec009370 con 0x7fd4f0067440 2023-12-22T10:00:15.851 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:15.851+0000 7fd4f5776700 1 --2- 172.21.15.113:0/3088859954 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd4f00bd300 0x7fd4f00c4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-12-22T10:00:15.852 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:15.851+0000 7fd4f5f77700 1 --2- 172.21.15.113:0/3088859954 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd4f0067440 0x7fd4f013ab40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7fd4f00c35a0 tx=0x7fd4ec017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:15.852 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:15.851+0000 7fd4e5ffb700 1 -- 172.21.15.113:0/3088859954 <== mon.1 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4ec00be90 con 0x7fd4f0067440 2023-12-22T10:00:15.852 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:15.855+0000 7fd4e5ffb700 1 -- 172.21.15.113:0/3088859954 <== mon.1 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4ec00b7f0 con 0x7fd4f0067440 2023-12-22T10:00:15.852 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:15.855+0000 7fd4f6f79700 1 -- 172.21.15.113:0/3088859954 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4f00c6150 con 0x7fd4f0067440 2023-12-22T10:00:15.852 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:15.855+0000 7fd4e5ffb700 1 -- 172.21.15.113:0/3088859954 <== mon.1 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4ec01b620 con 0x7fd4f0067440 2023-12-22T10:00:15.853 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:15.855+0000 7fd4f6f79700 1 -- 172.21.15.113:0/3088859954 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4f014e9e0 con 0x7fd4f0067440 2023-12-22T10:00:15.853 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:15.855+0000 7fd4e5ffb700 1 -- 172.21.15.113:0/3088859954 <== mon.1 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7fd4ec01bc70 con 0x7fd4f0067440 2023-12-22T10:00:15.853 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:15.855+0000 7fd4e5ffb700 1 -- 172.21.15.113:0/3088859954 <== mon.1 v2:172.21.15.113:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 754+0+0 (secure 0 0 0) 0x7fd4ec026a10 con 0x7fd4f0067440 2023-12-22T10:00:15.853 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:15.855+0000 7fd4f6f79700 1 -- 172.21.15.113:0/3088859954 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4f0047060 con 0x7fd4f0067440 2023-12-22T10:00:15.858 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:15.859+0000 7fd4e5ffb700 1 -- 172.21.15.113:0/3088859954 <== mon.1 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7fd4ec02b060 con 0x7fd4f0067440 2023-12-22T10:00:15.937 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:15.939+0000 7fd4f6f79700 1 -- 172.21.15.113:0/3088859954 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e19943a0-1c6b-47df-b6bb-383472077890", "id": 0} v 0) v1 -- 0x7fd4f00bc820 con 0x7fd4f0067440 2023-12-22T10:00:15.948 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:15.951+0000 7fd4e5ffb700 1 -- 172.21.15.113:0/3088859954 <== mon.1 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e19943a0-1c6b-47df-b6bb-383472077890", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd4ec021070 con 0x7fd4f0067440 2023-12-22T10:00:15.948 INFO:teuthology.orchestra.run.smithi113.stdout:0 2023-12-22T10:00:15.950 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:15.951+0000 7fd4f6f79700 1 -- 172.21.15.113:0/3088859954 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd4f0067440 msgr2=0x7fd4f013ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:15.950 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:15.951+0000 7fd4f6f79700 1 --2- 172.21.15.113:0/3088859954 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd4f0067440 0x7fd4f013ab40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7fd4f00c35a0 tx=0x7fd4ec017000).stop 2023-12-22T10:00:15.950 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:15.951+0000 7fd4f6f79700 1 -- 172.21.15.113:0/3088859954 shutdown_connections 2023-12-22T10:00:15.950 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:15.951+0000 7fd4f6f79700 1 --2- 172.21.15.113:0/3088859954 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd4f0153830 0x7fd4f00c52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:15.950 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:15.951+0000 7fd4f6f79700 1 --2- 172.21.15.113:0/3088859954 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd4f00bd300 0x7fd4f00c4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:15.950 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:15.951+0000 7fd4f6f79700 1 --2- 172.21.15.113:0/3088859954 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd4f0067440 0x7fd4f013ab40 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:15.950 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:15.951+0000 7fd4f6f79700 1 -- 172.21.15.113:0/3088859954 >> 172.21.15.113:0/3088859954 conn(0x7fd4f0068610 msgr2=0x7fd4f00c1fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:15.950 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:15.951+0000 7fd4f6f79700 1 -- 172.21.15.113:0/3088859954 shutdown_connections 2023-12-22T10:00:15.950 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:15.951+0000 7fd4f6f79700 1 -- 172.21.15.113:0/3088859954 wait complete. 2023-12-22T10:00:15.968 DEBUG:teuthology.orchestra.run.smithi113:> sudo ceph --cluster ceph osd new 69670f34-f082-45a7-8f67-e962acc136e6 1 2023-12-22T10:00:16.074 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-12-22T10:00:16.078+0000 7fba07145500 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-22T10:00:16.111 INFO:tasks.ceph.mgr.x.smithi113.stderr:2023-12-22T10:00:16.111+0000 7f34c0937500 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-22T10:00:16.122 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.123+0000 7ff4c19b9700 1 Processor -- start 2023-12-22T10:00:16.122 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.123+0000 7ff4c19b9700 1 -- start start 2023-12-22T10:00:16.125 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.127+0000 7ff4c19b9700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ff4bc13b440 0x7ff4bc063c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:16.125 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.127+0000 7ff4c19b9700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff4bc0640f0 0x7ff4bc0c2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:16.125 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.127+0000 7ff4c19b9700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4bc0be5e0 con 0x7ff4bc13b060 2023-12-22T10:00:16.125 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.127+0000 7ff4c19b9700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4bc0a5ad0 con 0x7ff4bc0640f0 2023-12-22T10:00:16.125 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.127+0000 7ff4c19b9700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4bc0bd9d0 con 0x7ff4bc13b440 2023-12-22T10:00:16.125 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.127+0000 7ff4c09b7700 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7ff4bc13b060 0x7ff4bc0a53c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:44300/0 (socket says 172.21.15.113:44300) 2023-12-22T10:00:16.125 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.127+0000 7ff4c09b7700 1 -- 172.21.15.113:0/4229738373 learned_addr learned my addr 172.21.15.113:0/4229738373 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-22T10:00:16.127 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.127+0000 7ff4bbfff700 1 --2- 172.21.15.113:0/4229738373 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ff4bc13b440 0x7ff4bc063c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:16.127 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.127+0000 7ff4c11b8700 1 --2- 172.21.15.113:0/4229738373 >> v2:172.21.15.45:3300/0 conn(0x7ff4bc0640f0 0x7ff4bc0c2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:16.127 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.127+0000 7ff4bb7fe700 1 -- 172.21.15.113:0/4229738373 <== mon.1 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 686929908 0 0) 0x7ff4bc0be5e0 con 0x7ff4bc13b060 2023-12-22T10:00:16.127 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.127+0000 7ff4bb7fe700 1 -- 172.21.15.113:0/4229738373 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4ac0033f0 con 0x7ff4bc13b060 2023-12-22T10:00:16.128 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.127+0000 7ff4bb7fe700 1 -- 172.21.15.113:0/4229738373 <== mon.1 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2847366510 0 0) 0x7ff4ac0033f0 con 0x7ff4bc13b060 2023-12-22T10:00:16.128 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.127+0000 7ff4bb7fe700 1 -- 172.21.15.113:0/4229738373 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ff4bc13b440 msgr2=0x7ff4bc063c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:00:16.128 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.127+0000 7ff4bb7fe700 1 --2- 172.21.15.113:0/4229738373 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ff4bc13b440 0x7ff4bc063c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:16.128 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.127+0000 7ff4bb7fe700 1 -- 172.21.15.113:0/4229738373 >> v2:172.21.15.45:3300/0 conn(0x7ff4bc0640f0 msgr2=0x7ff4bc0c2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:00:16.128 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.127+0000 7ff4bb7fe700 1 --2- 172.21.15.113:0/4229738373 >> v2:172.21.15.45:3300/0 conn(0x7ff4bc0640f0 0x7ff4bc0c2ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:16.128 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.127+0000 7ff4bb7fe700 1 -- 172.21.15.113:0/4229738373 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4bc0bdcb0 con 0x7ff4bc13b060 2023-12-22T10:00:16.128 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.127+0000 7ff4bb7fe700 1 -- 172.21.15.113:0/4229738373 <== mon.1 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2619163070 0 0) 0x7ff4b0001470 con 0x7ff4bc13b060 2023-12-22T10:00:16.128 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.127+0000 7ff4bb7fe700 1 -- 172.21.15.113:0/4229738373 >> v1:172.21.15.113:6789/0 conn(0x7ff4bc13b060 legacy=0x7ff4bc0a53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:16.128 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.127+0000 7ff4bb7fe700 1 --2- 172.21.15.113:0/4229738373 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ff4bc13b440 0x7ff4ac0038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:16.128 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.127+0000 7ff4bb7fe700 1 --2- 172.21.15.113:0/4229738373 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4ac003e10 0x7ff4ac004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:16.128 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.127+0000 7ff4bb7fe700 1 --2- 172.21.15.113:0/4229738373 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff4ac004b80 0x7ff4ac005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:16.128 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.127+0000 7ff4bb7fe700 1 -- 172.21.15.113:0/4229738373 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4bc0a5ad0 con 0x7ff4ac003e10 2023-12-22T10:00:16.128 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.127+0000 7ff4bb7fe700 1 -- 172.21.15.113:0/4229738373 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4bc0bd9d0 con 0x7ff4ac004b80 2023-12-22T10:00:16.128 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.127+0000 7ff4bb7fe700 1 -- 172.21.15.113:0/4229738373 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4ac00b8e0 con 0x7ff4bc13b440 2023-12-22T10:00:16.129 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.127+0000 7ff4c11b8700 1 --2- 172.21.15.113:0/4229738373 >> v2:172.21.15.45:3300/0 conn(0x7ff4bc0640f0 0x7ff4bc0c2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-12-22T10:00:16.129 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.127+0000 7ff4c09b7700 1 --2- 172.21.15.113:0/4229738373 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ff4bc13b440 0x7ff4ac0038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:16.129 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.131+0000 7ff4bbfff700 1 --2- 172.21.15.113:0/4229738373 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4ac003e10 0x7ff4ac004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:16.129 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.131+0000 7ff4c11b8700 1 --2- 172.21.15.113:0/4229738373 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff4ac004b80 0x7ff4ac005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:16.130 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.131+0000 7ff4c09b7700 1 -- 172.21.15.113:0/4229738373 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff4ac004b80 msgr2=0x7ff4ac005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:00:16.130 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.131+0000 7ff4c09b7700 1 --2- 172.21.15.113:0/4229738373 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff4ac004b80 0x7ff4ac005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:16.130 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.131+0000 7ff4c09b7700 1 -- 172.21.15.113:0/4229738373 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4ac003e10 msgr2=0x7ff4ac004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:00:16.131 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.131+0000 7ff4c09b7700 1 --2- 172.21.15.113:0/4229738373 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4ac003e10 0x7ff4ac004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:16.131 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.131+0000 7ff4c09b7700 1 -- 172.21.15.113:0/4229738373 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4ac0033f0 con 0x7ff4bc13b440 2023-12-22T10:00:16.131 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.131+0000 7ff4c09b7700 1 --2- 172.21.15.113:0/4229738373 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ff4bc13b440 0x7ff4ac0038e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7ff4b000c210 tx=0x7ff4b0001e90).ready entity=mon.2 client_cookie=963670314729b26 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:16.131 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.131+0000 7ff4bb7fe700 1 -- 172.21.15.113:0/4229738373 <== mon.2 v2:172.21.15.113:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b0007a60 con 0x7ff4bc13b440 2023-12-22T10:00:16.131 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.131+0000 7ff4bb7fe700 1 -- 172.21.15.113:0/4229738373 <== mon.2 v2:172.21.15.113:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4b000cae0 con 0x7ff4bc13b440 2023-12-22T10:00:16.131 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.131+0000 7ff4bb7fe700 1 -- 172.21.15.113:0/4229738373 <== mon.2 v2:172.21.15.113:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b000ce80 con 0x7ff4bc13b440 2023-12-22T10:00:16.131 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.131+0000 7ff4c19b9700 1 -- 172.21.15.113:0/4229738373 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ff4bc13b440 msgr2=0x7ff4ac0038e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:16.131 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.131+0000 7ff4c19b9700 1 --2- 172.21.15.113:0/4229738373 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ff4bc13b440 0x7ff4ac0038e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7ff4b000c210 tx=0x7ff4b0001e90).stop 2023-12-22T10:00:16.131 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.131+0000 7ff4c11b8700 1 -- 172.21.15.113:0/4229738373 reap_dead start 2023-12-22T10:00:16.131 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.131+0000 7ff4c19b9700 1 -- 172.21.15.113:0/4229738373 shutdown_connections 2023-12-22T10:00:16.131 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.131+0000 7ff4c19b9700 1 -- 172.21.15.113:0/4229738373 >> 172.21.15.113:0/4229738373 conn(0x7ff4bc067500 msgr2=0x7ff4bc0c8690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:16.131 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.131+0000 7ff4c19b9700 1 -- 172.21.15.113:0/4229738373 shutdown_connections 2023-12-22T10:00:16.131 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.131+0000 7ff4c19b9700 1 -- 172.21.15.113:0/4229738373 wait complete. 2023-12-22T10:00:16.132 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.135+0000 7ff4c19b9700 1 Processor -- start 2023-12-22T10:00:16.132 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.135+0000 7ff4c19b9700 1 -- start start 2023-12-22T10:00:16.135 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.135+0000 7ff4c19b9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4bc13b440 0x7ff4bc154a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:16.135 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.135+0000 7ff4c19b9700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ff4bc137960 0x7ff4bc0ad060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:16.136 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.135+0000 7ff4c19b9700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff4bc0ad550 0x7ff4bc0ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:16.136 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.135+0000 7ff4c19b9700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4bc0acbd0 con 0x7ff4bc13b440 2023-12-22T10:00:16.136 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.135+0000 7ff4c19b9700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4bc0c5b40 con 0x7ff4bc0ad550 2023-12-22T10:00:16.136 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.135+0000 7ff4c19b9700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4bc0c5e20 con 0x7ff4bc137960 2023-12-22T10:00:16.136 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.135+0000 7ff4bbfff700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ff4bc137960 0x7ff4bc0ad060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:16.136 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.135+0000 7ff4c11b8700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff4bc0ad550 0x7ff4bc0ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:16.136 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.135+0000 7ff4bbfff700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ff4bc137960 0x7ff4bc0ad060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.113:3301/0 says I am v2:172.21.15.113:36726/0 (socket says 172.21.15.113:36726) 2023-12-22T10:00:16.136 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.135+0000 7ff4bbfff700 1 -- 172.21.15.113:0/3907780481 learned_addr learned my addr 172.21.15.113:0/3907780481 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-22T10:00:16.136 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.135+0000 7ff4c09b7700 1 --2- 172.21.15.113:0/3907780481 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4bc13b440 0x7ff4bc154a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:16.136 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.139+0000 7ff4bbfff700 1 -- 172.21.15.113:0/3907780481 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff4bc0ad550 msgr2=0x7ff4bc0ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:16.136 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.139+0000 7ff4bbfff700 1 --2- 172.21.15.113:0/3907780481 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff4bc0ad550 0x7ff4bc0ad9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:16.136 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.139+0000 7ff4bbfff700 1 -- 172.21.15.113:0/3907780481 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4bc13b440 msgr2=0x7ff4bc154a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:16.136 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.139+0000 7ff4bbfff700 1 --2- 172.21.15.113:0/3907780481 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4bc13b440 0x7ff4bc154a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:16.137 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.139+0000 7ff4bbfff700 1 -- 172.21.15.113:0/3907780481 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4bc0c6100 con 0x7ff4bc137960 2023-12-22T10:00:16.137 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.139+0000 7ff4c09b7700 1 --2- 172.21.15.113:0/3907780481 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4bc13b440 0x7ff4bc154a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T10:00:16.138 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.139+0000 7ff4bbfff700 1 --2- 172.21.15.113:0/3907780481 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ff4bc137960 0x7ff4bc0ad060 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7ff4a8011a70 tx=0x7ff4a8009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:16.138 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.139+0000 7ff4b8ff9700 1 -- 172.21.15.113:0/3907780481 <== mon.2 v2:172.21.15.113:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a800f860 con 0x7ff4bc137960 2023-12-22T10:00:16.138 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.139+0000 7ff4b8ff9700 1 -- 172.21.15.113:0/3907780481 <== mon.2 v2:172.21.15.113:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4a800f9c0 con 0x7ff4bc137960 2023-12-22T10:00:16.138 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.139+0000 7ff4b8ff9700 1 -- 172.21.15.113:0/3907780481 <== mon.2 v2:172.21.15.113:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a800fd40 con 0x7ff4bc137960 2023-12-22T10:00:16.138 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.139+0000 7ff4c19b9700 1 -- 172.21.15.113:0/3907780481 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4bc0adea0 con 0x7ff4bc137960 2023-12-22T10:00:16.138 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.139+0000 7ff4c19b9700 1 -- 172.21.15.113:0/3907780481 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4bc137de0 con 0x7ff4bc137960 2023-12-22T10:00:16.138 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.139+0000 7ff4b8ff9700 1 -- 172.21.15.113:0/3907780481 <== mon.2 v2:172.21.15.113:3301/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7ff4a80148b0 con 0x7ff4bc137960 2023-12-22T10:00:16.138 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.139+0000 7ff4b8ff9700 1 -- 172.21.15.113:0/3907780481 <== mon.2 v2:172.21.15.113:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 869+0+0 (secure 0 0 0) 0x7ff4a801d440 con 0x7ff4bc137960 2023-12-22T10:00:16.138 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.139+0000 7ff4c19b9700 1 -- 172.21.15.113:0/3907780481 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4bc0acd40 con 0x7ff4bc137960 2023-12-22T10:00:16.141 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.143+0000 7ff4b8ff9700 1 -- 172.21.15.113:0/3907780481 <== mon.2 v2:172.21.15.113:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7ff4a803ce50 con 0x7ff4bc137960 2023-12-22T10:00:16.221 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.223+0000 7ff4c19b9700 1 -- 172.21.15.113:0/3907780481 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_command({"prefix": "osd new", "uuid": "69670f34-f082-45a7-8f67-e962acc136e6", "id": 1} v 0) v1 -- 0x7ff4bc047060 con 0x7ff4bc137960 2023-12-22T10:00:16.232 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.235+0000 7ff4b8ff9700 1 -- 172.21.15.113:0/3907780481 <== mon.2 v2:172.21.15.113:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "69670f34-f082-45a7-8f67-e962acc136e6", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff4a802b030 con 0x7ff4bc137960 2023-12-22T10:00:16.232 INFO:teuthology.orchestra.run.smithi113.stdout:1 2023-12-22T10:00:16.233 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.235+0000 7ff4c19b9700 1 -- 172.21.15.113:0/3907780481 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ff4bc137960 msgr2=0x7ff4bc0ad060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:16.233 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.235+0000 7ff4c19b9700 1 --2- 172.21.15.113:0/3907780481 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ff4bc137960 0x7ff4bc0ad060 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7ff4a8011a70 tx=0x7ff4a8009060).stop 2023-12-22T10:00:16.233 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.235+0000 7ff4c19b9700 1 -- 172.21.15.113:0/3907780481 shutdown_connections 2023-12-22T10:00:16.234 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.235+0000 7ff4c19b9700 1 --2- 172.21.15.113:0/3907780481 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff4bc0ad550 0x7ff4bc0ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:16.234 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.235+0000 7ff4c19b9700 1 --2- 172.21.15.113:0/3907780481 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ff4bc137960 0x7ff4bc0ad060 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:16.234 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.235+0000 7ff4c19b9700 1 --2- 172.21.15.113:0/3907780481 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4bc13b440 0x7ff4bc154a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:16.234 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.235+0000 7ff4c19b9700 1 -- 172.21.15.113:0/3907780481 >> 172.21.15.113:0/3907780481 conn(0x7ff4bc067500 msgr2=0x7ff4bc0c2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:16.234 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.235+0000 7ff4c19b9700 1 -- 172.21.15.113:0/3907780481 shutdown_connections 2023-12-22T10:00:16.234 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.235+0000 7ff4c19b9700 1 -- 172.21.15.113:0/3907780481 wait complete. 2023-12-22T10:00:16.254 DEBUG:teuthology.orchestra.run.smithi113:> sudo ceph --cluster ceph osd new d909d49b-82b8-401b-9947-e49dd167bb95 2 2023-12-22T10:00:16.411 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.411+0000 7f0708db9700 1 Processor -- start 2023-12-22T10:00:16.411 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.415+0000 7f0708db9700 1 -- start start 2023-12-22T10:00:16.415 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.415+0000 7f0708db9700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0704151d20 0x7f07040656f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:16.415 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.415+0000 7f0708db9700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f0704066e50 0x7f0704065be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:16.415 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.415+0000 7f0708db9700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07040c4a70 con 0x7f07040660d0 2023-12-22T10:00:16.416 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.419+0000 7f0708db9700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07040a7740 con 0x7f0704151d20 2023-12-22T10:00:16.416 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.419+0000 7f0708db9700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0704066580 con 0x7f0704066e50 2023-12-22T10:00:16.416 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.419+0000 7f0703fff700 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f07040660d0 0x7f0704062230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:44314/0 (socket says 172.21.15.113:44314) 2023-12-22T10:00:16.416 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.419+0000 7f0703fff700 1 -- 172.21.15.113:0/259270311 learned_addr learned my addr 172.21.15.113:0/259270311 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-22T10:00:16.417 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.419+0000 7f07037fe700 1 --2- 172.21.15.113:0/259270311 >> v2:172.21.15.45:3300/0 conn(0x7f0704151d20 0x7f07040656f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:16.417 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.419+0000 7f07027fc700 1 -- 172.21.15.113:0/259270311 <== mon.1 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3304337343 0 0) 0x7f07040c4a70 con 0x7f07040660d0 2023-12-22T10:00:16.417 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.419+0000 7f07027fc700 1 -- 172.21.15.113:0/259270311 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06ec0033f0 con 0x7f07040660d0 2023-12-22T10:00:16.417 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.419+0000 7f0702ffd700 1 --2- 172.21.15.113:0/259270311 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f0704066e50 0x7f0704065be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:16.417 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.419+0000 7f07027fc700 1 -- 172.21.15.113:0/259270311 <== mon.1 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2702424627 0 0) 0x7f06ec0033f0 con 0x7f07040660d0 2023-12-22T10:00:16.417 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.419+0000 7f07027fc700 1 -- 172.21.15.113:0/259270311 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f0704066e50 msgr2=0x7f0704065be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:00:16.417 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.419+0000 7f07027fc700 1 --2- 172.21.15.113:0/259270311 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f0704066e50 0x7f0704065be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:16.417 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.419+0000 7f07027fc700 1 -- 172.21.15.113:0/259270311 >> v2:172.21.15.45:3300/0 conn(0x7f0704151d20 msgr2=0x7f07040656f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:00:16.417 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.419+0000 7f07027fc700 1 --2- 172.21.15.113:0/259270311 >> v2:172.21.15.45:3300/0 conn(0x7f0704151d20 0x7f07040656f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:16.417 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.419+0000 7f07027fc700 1 -- 172.21.15.113:0/259270311 --> v1:172.21.15.113:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07040672a0 con 0x7f07040660d0 2023-12-22T10:00:16.417 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.419+0000 7f07027fc700 1 -- 172.21.15.113:0/259270311 <== mon.1 v1:172.21.15.113:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2619163070 0 0) 0x7f06fc0017f0 con 0x7f07040660d0 2023-12-22T10:00:16.418 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.419+0000 7f07027fc700 1 -- 172.21.15.113:0/259270311 >> v1:172.21.15.113:6789/0 conn(0x7f07040660d0 legacy=0x7f0704062230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:16.419 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.419+0000 7f07027fc700 1 --2- 172.21.15.113:0/259270311 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f06ec0038e0 0x7f06ec003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:16.419 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.419+0000 7f07027fc700 1 --2- 172.21.15.113:0/259270311 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f0704066e50 0x7f06ec004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:16.419 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.419+0000 7f07027fc700 1 --2- 172.21.15.113:0/259270311 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06ec004b80 0x7f06ec005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:16.419 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.419+0000 7f07027fc700 1 -- 172.21.15.113:0/259270311 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07040a7740 con 0x7f06ec004b80 2023-12-22T10:00:16.419 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.419+0000 7f07027fc700 1 -- 172.21.15.113:0/259270311 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0704066580 con 0x7f06ec0038e0 2023-12-22T10:00:16.419 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.419+0000 7f07027fc700 1 -- 172.21.15.113:0/259270311 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06ec00b8e0 con 0x7f0704066e50 2023-12-22T10:00:16.419 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.419+0000 7f0702ffd700 1 --2- 172.21.15.113:0/259270311 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f0704066e50 0x7f06ec004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:16.419 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.419+0000 7f07037fe700 1 --2- 172.21.15.113:0/259270311 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f06ec0038e0 0x7f06ec003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:16.419 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.419+0000 7f0703fff700 1 --2- 172.21.15.113:0/259270311 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06ec004b80 0x7f06ec005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:16.419 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.419+0000 7f0702ffd700 1 -- 172.21.15.113:0/259270311 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f06ec0038e0 msgr2=0x7f06ec003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:00:16.419 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.419+0000 7f0702ffd700 1 --2- 172.21.15.113:0/259270311 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f06ec0038e0 0x7f06ec003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:16.419 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.419+0000 7f0702ffd700 1 -- 172.21.15.113:0/259270311 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06ec004b80 msgr2=0x7f06ec005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:00:16.420 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.419+0000 7f0702ffd700 1 --2- 172.21.15.113:0/259270311 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06ec004b80 0x7f06ec005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:16.420 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.419+0000 7f0702ffd700 1 -- 172.21.15.113:0/259270311 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06ec0033f0 con 0x7f0704066e50 2023-12-22T10:00:16.420 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.419+0000 7f0702ffd700 1 --2- 172.21.15.113:0/259270311 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f0704066e50 0x7f06ec004690 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f06f800b9d0 tx=0x7f06f8008040).ready entity=mon.2 client_cookie=741b9e6132096c07 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:16.420 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.419+0000 7f07027fc700 1 -- 172.21.15.113:0/259270311 <== mon.2 v2:172.21.15.113:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f800b340 con 0x7f0704066e50 2023-12-22T10:00:16.420 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.419+0000 7f07027fc700 1 -- 172.21.15.113:0/259270311 <== mon.2 v2:172.21.15.113:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06f8013480 con 0x7f0704066e50 2023-12-22T10:00:16.420 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.419+0000 7f07027fc700 1 -- 172.21.15.113:0/259270311 <== mon.2 v2:172.21.15.113:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f8013800 con 0x7f0704066e50 2023-12-22T10:00:16.421 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.423+0000 7f0708db9700 1 -- 172.21.15.113:0/259270311 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f0704066e50 msgr2=0x7f06ec004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:16.421 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.423+0000 7f0708db9700 1 --2- 172.21.15.113:0/259270311 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f0704066e50 0x7f06ec004690 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f06f800b9d0 tx=0x7f06f8008040).stop 2023-12-22T10:00:16.421 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.423+0000 7f0703fff700 1 -- 172.21.15.113:0/259270311 reap_dead start 2023-12-22T10:00:16.421 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.423+0000 7f0708db9700 1 -- 172.21.15.113:0/259270311 shutdown_connections 2023-12-22T10:00:16.421 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.423+0000 7f0708db9700 1 -- 172.21.15.113:0/259270311 >> 172.21.15.113:0/259270311 conn(0x7f0704068610 msgr2=0x7f07040c3fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:16.421 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.423+0000 7f0708db9700 1 -- 172.21.15.113:0/259270311 shutdown_connections 2023-12-22T10:00:16.421 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.423+0000 7f0708db9700 1 -- 172.21.15.113:0/259270311 wait complete. 2023-12-22T10:00:16.421 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.423+0000 7f0708db9700 1 Processor -- start 2023-12-22T10:00:16.422 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.423+0000 7f0708db9700 1 -- start start 2023-12-22T10:00:16.422 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.423+0000 7f0708db9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0704066e50 0x7f070414a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:16.422 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.423+0000 7f0708db9700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f07040aa4f0 0x7f07040c05d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:16.423 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.423+0000 7f0708db9700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f07040aba70 0x7f07040abef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:16.423 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.423+0000 7f0708db9700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07040ab5e0 con 0x7f0704066e50 2023-12-22T10:00:16.423 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.423+0000 7f0708db9700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f070414ccc0 con 0x7f07040aa4f0 2023-12-22T10:00:16.423 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.423+0000 7f0708db9700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07040aa9d0 con 0x7f07040aba70 2023-12-22T10:00:16.423 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.423+0000 7f0702ffd700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f07040aa4f0 0x7f07040c05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:16.423 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.423+0000 7f0703fff700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f07040aba70 0x7f07040abef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:16.423 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.423+0000 7f0702ffd700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f07040aa4f0 0x7f07040c05d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:52342/0 (socket says 172.21.15.113:52342) 2023-12-22T10:00:16.423 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.423+0000 7f0702ffd700 1 -- 172.21.15.113:0/3576044438 learned_addr learned my addr 172.21.15.113:0/3576044438 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-22T10:00:16.424 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.423+0000 7f07037fe700 1 --2- 172.21.15.113:0/3576044438 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0704066e50 0x7f070414a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:16.424 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.427+0000 7f0702ffd700 1 -- 172.21.15.113:0/3576044438 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f07040aba70 msgr2=0x7f07040abef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:16.424 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.427+0000 7f0702ffd700 1 --2- 172.21.15.113:0/3576044438 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f07040aba70 0x7f07040abef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:16.424 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.427+0000 7f0702ffd700 1 -- 172.21.15.113:0/3576044438 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0704066e50 msgr2=0x7f070414a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:16.424 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.427+0000 7f0702ffd700 1 --2- 172.21.15.113:0/3576044438 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0704066e50 0x7f070414a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:16.424 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.427+0000 7f0702ffd700 1 -- 172.21.15.113:0/3576044438 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07040aacb0 con 0x7f07040aa4f0 2023-12-22T10:00:16.425 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.427+0000 7f0702ffd700 1 --2- 172.21.15.113:0/3576044438 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f07040aa4f0 0x7f07040c05d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f06ec00ba20 tx=0x7f06f8008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:16.425 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.427+0000 7f06eb7fe700 1 -- 172.21.15.113:0/3576044438 <== mon.1 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f8012840 con 0x7f07040aa4f0 2023-12-22T10:00:16.425 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.427+0000 7f06eb7fe700 1 -- 172.21.15.113:0/3576044438 <== mon.1 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06f80129a0 con 0x7f07040aa4f0 2023-12-22T10:00:16.425 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.427+0000 7f0708db9700 1 -- 172.21.15.113:0/3576044438 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07040aaf90 con 0x7f07040aa4f0 2023-12-22T10:00:16.425 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.427+0000 7f06eb7fe700 1 -- 172.21.15.113:0/3576044438 <== mon.1 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f8012d40 con 0x7f07040aa4f0 2023-12-22T10:00:16.425 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.427+0000 7f0708db9700 1 -- 172.21.15.113:0/3576044438 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f070414ae00 con 0x7f07040aa4f0 2023-12-22T10:00:16.425 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.427+0000 7f06eb7fe700 1 -- 172.21.15.113:0/3576044438 <== mon.1 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f06f8005ae0 con 0x7f07040aa4f0 2023-12-22T10:00:16.425 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.427+0000 7f06eb7fe700 1 -- 172.21.15.113:0/3576044438 <== mon.1 v2:172.21.15.113:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 984+0+0 (secure 0 0 0) 0x7f06f80065b0 con 0x7f07040aa4f0 2023-12-22T10:00:16.426 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.427+0000 7f0708db9700 1 -- 172.21.15.113:0/3576044438 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07040c45e0 con 0x7f07040aa4f0 2023-12-22T10:00:16.430 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.431+0000 7f06eb7fe700 1 -- 172.21.15.113:0/3576044438 <== mon.1 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7f07040c45e0 con 0x7f07040aa4f0 2023-12-22T10:00:16.507 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.507+0000 7f0708db9700 1 -- 172.21.15.113:0/3576044438 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d909d49b-82b8-401b-9947-e49dd167bb95", "id": 2} v 0) v1 -- 0x7f07040ab410 con 0x7f07040aa4f0 2023-12-22T10:00:16.517 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.519+0000 7f06eb7fe700 1 -- 172.21.15.113:0/3576044438 <== mon.1 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d909d49b-82b8-401b-9947-e49dd167bb95", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f06f8018070 con 0x7f07040aa4f0 2023-12-22T10:00:16.517 INFO:teuthology.orchestra.run.smithi113.stdout:2 2023-12-22T10:00:16.519 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.519+0000 7f0708db9700 1 -- 172.21.15.113:0/3576044438 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f07040aa4f0 msgr2=0x7f07040c05d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:16.519 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.519+0000 7f0708db9700 1 --2- 172.21.15.113:0/3576044438 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f07040aa4f0 0x7f07040c05d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f06ec00ba20 tx=0x7f06f8008040).stop 2023-12-22T10:00:16.519 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.519+0000 7f0708db9700 1 -- 172.21.15.113:0/3576044438 shutdown_connections 2023-12-22T10:00:16.519 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.519+0000 7f0708db9700 1 --2- 172.21.15.113:0/3576044438 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f07040aba70 0x7f07040abef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:16.519 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.519+0000 7f0708db9700 1 --2- 172.21.15.113:0/3576044438 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f07040aa4f0 0x7f07040c05d0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:16.519 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.519+0000 7f0708db9700 1 --2- 172.21.15.113:0/3576044438 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0704066e50 0x7f070414a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:16.519 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.519+0000 7f0708db9700 1 -- 172.21.15.113:0/3576044438 >> 172.21.15.113:0/3576044438 conn(0x7f0704068610 msgr2=0x7f0704149950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:16.519 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.519+0000 7f0708db9700 1 -- 172.21.15.113:0/3576044438 shutdown_connections 2023-12-22T10:00:16.519 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.519+0000 7f0708db9700 1 -- 172.21.15.113:0/3576044438 wait complete. 2023-12-22T10:00:16.539 DEBUG:teuthology.orchestra.run.smithi113:> sudo ceph --cluster ceph osd new db104ca9-3a94-4d39-a2be-bd06db888095 3 2023-12-22T10:00:16.686 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.687+0000 7f54a929b700 1 Processor -- start 2023-12-22T10:00:16.686 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.687+0000 7f54a929b700 1 -- start start 2023-12-22T10:00:16.688 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.691+0000 7f54a929b700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f54a414e080 0x7f54a40c93c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:16.689 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.691+0000 7f54a929b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f54a40ca160 0x7f54a4157610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:16.689 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.691+0000 7f54a929b700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54a41542c0 con 0x7f54a4157b00 2023-12-22T10:00:16.689 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.691+0000 7f54a929b700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54a4154040 con 0x7f54a40ca160 2023-12-22T10:00:16.689 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.691+0000 7f54a929b700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54a40ca820 con 0x7f54a414e080 2023-12-22T10:00:16.689 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.691+0000 7f54a2ffd700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f54a414e080 0x7f54a40c93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:16.689 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.691+0000 7f54a2ffd700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f54a414e080 0x7f54a40c93c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.113:3301/0 says I am v2:172.21.15.113:36760/0 (socket says 172.21.15.113:36760) 2023-12-22T10:00:16.689 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.691+0000 7f54a2ffd700 1 -- 172.21.15.113:0/2356672936 learned_addr learned my addr 172.21.15.113:0/2356672936 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-22T10:00:16.690 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.691+0000 7f54a27fc700 1 --2- 172.21.15.113:0/2356672936 >> v2:172.21.15.45:3300/0 conn(0x7f54a40ca160 0x7f54a4157610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:16.690 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.691+0000 7f54a2ffd700 1 -- 172.21.15.113:0/2356672936 >> v2:172.21.15.45:3300/0 conn(0x7f54a40ca160 msgr2=0x7f54a4157610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:00:16.691 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.691+0000 7f54a2ffd700 1 --2- 172.21.15.113:0/2356672936 >> v2:172.21.15.45:3300/0 conn(0x7f54a40ca160 0x7f54a4157610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:16.691 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.691+0000 7f54a2ffd700 1 -- 172.21.15.113:0/2356672936 >> v1:172.21.15.45:6789/0 conn(0x7f54a4157b00 legacy=0x7f54a4154750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:00:16.691 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.691+0000 7f54a2ffd700 1 -- 172.21.15.113:0/2356672936 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54a40ca5c0 con 0x7f54a414e080 2023-12-22T10:00:16.691 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.691+0000 7f54a27fc700 1 --2- 172.21.15.113:0/2356672936 >> v2:172.21.15.45:3300/0 conn(0x7f54a40ca160 0x7f54a4157610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-12-22T10:00:16.691 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.691+0000 7f54a2ffd700 1 --2- 172.21.15.113:0/2356672936 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f54a414e080 0x7f54a40c93c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f54a40ca960 tx=0x7f54940090f0).ready entity=mon.2 client_cookie=dce147cca0e01b51 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:16.691 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.691+0000 7f54a1ffb700 1 -- 172.21.15.113:0/2356672936 <== mon.2 v2:172.21.15.113:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f549400b5a0 con 0x7f54a414e080 2023-12-22T10:00:16.691 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.691+0000 7f54a1ffb700 1 -- 172.21.15.113:0/2356672936 <== mon.2 v2:172.21.15.113:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f549400b700 con 0x7f54a414e080 2023-12-22T10:00:16.691 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.691+0000 7f54a1ffb700 1 -- 172.21.15.113:0/2356672936 <== mon.2 v2:172.21.15.113:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f549400ba80 con 0x7f54a414e080 2023-12-22T10:00:16.692 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.691+0000 7f54a929b700 1 -- 172.21.15.113:0/2356672936 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f54a414e080 msgr2=0x7f54a40c93c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:16.693 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.691+0000 7f54a929b700 1 --2- 172.21.15.113:0/2356672936 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f54a414e080 0x7f54a40c93c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f54a40ca960 tx=0x7f54940090f0).stop 2023-12-22T10:00:16.693 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.691+0000 7f54a929b700 1 -- 172.21.15.113:0/2356672936 shutdown_connections 2023-12-22T10:00:16.693 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.691+0000 7f54a929b700 1 --2- 172.21.15.113:0/2356672936 >> v2:172.21.15.45:3300/0 conn(0x7f54a40ca160 0x7f54a4157610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:16.693 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.691+0000 7f54a929b700 1 --2- 172.21.15.113:0/2356672936 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f54a414e080 0x7f54a40c93c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:16.693 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.691+0000 7f54a929b700 1 -- 172.21.15.113:0/2356672936 >> 172.21.15.113:0/2356672936 conn(0x7f54a4066a70 msgr2=0x7f54a4066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:16.693 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.695+0000 7f54a929b700 1 -- 172.21.15.113:0/2356672936 shutdown_connections 2023-12-22T10:00:16.693 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.695+0000 7f54a929b700 1 -- 172.21.15.113:0/2356672936 wait complete. 2023-12-22T10:00:16.695 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.695+0000 7f54a929b700 1 Processor -- start 2023-12-22T10:00:16.695 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.699+0000 7f54a929b700 1 -- start start 2023-12-22T10:00:16.697 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.699+0000 7f54a929b700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f54a40ca160 0x7f54a413c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:16.697 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.699+0000 7f54a929b700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f54a414e080 0x7f54a40c41c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:16.697 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.699+0000 7f54a929b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54a4157b00 0x7f54a40cabf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:16.697 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.699+0000 7f54a929b700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a40c3d30 con 0x7f54a4157b00 2023-12-22T10:00:16.697 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.699+0000 7f54a929b700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a413cc80 con 0x7f54a414e080 2023-12-22T10:00:16.697 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.699+0000 7f54a929b700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54a40c3120 con 0x7f54a40ca160 2023-12-22T10:00:16.699 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.699+0000 7f54a2ffd700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f54a40ca160 0x7f54a413c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:16.700 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.699+0000 7f54a2ffd700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f54a40ca160 0x7f54a413c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.113:3301/0 says I am v2:172.21.15.113:36762/0 (socket says 172.21.15.113:36762) 2023-12-22T10:00:16.700 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.699+0000 7f54a2ffd700 1 -- 172.21.15.113:0/1581205678 learned_addr learned my addr 172.21.15.113:0/1581205678 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-22T10:00:16.700 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.699+0000 7f54a27fc700 1 --2- 172.21.15.113:0/1581205678 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f54a414e080 0x7f54a40c41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:16.700 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.699+0000 7f54a37fe700 1 --2- 172.21.15.113:0/1581205678 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54a4157b00 0x7f54a40cabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:16.700 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.699+0000 7f54a2ffd700 1 -- 172.21.15.113:0/1581205678 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f54a414e080 msgr2=0x7f54a40c41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:16.700 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.699+0000 7f54a2ffd700 1 --2- 172.21.15.113:0/1581205678 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f54a414e080 0x7f54a40c41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:16.700 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.699+0000 7f54a2ffd700 1 -- 172.21.15.113:0/1581205678 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54a4157b00 msgr2=0x7f54a40cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:16.700 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.699+0000 7f54a2ffd700 1 --2- 172.21.15.113:0/1581205678 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54a4157b00 0x7f54a40cabf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:16.700 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.699+0000 7f54a2ffd700 1 -- 172.21.15.113:0/1581205678 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5494009370 con 0x7f54a40ca160 2023-12-22T10:00:16.700 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.699+0000 7f54a2ffd700 1 --2- 172.21.15.113:0/1581205678 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f54a40ca160 0x7f54a413c790 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f54a4083fa0 tx=0x7f5494015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:16.700 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.699+0000 7f548affd700 1 -- 172.21.15.113:0/1581205678 <== mon.2 v2:172.21.15.113:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f549400b870 con 0x7f54a40ca160 2023-12-22T10:00:16.700 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.699+0000 7f548affd700 1 -- 172.21.15.113:0/1581205678 <== mon.2 v2:172.21.15.113:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f549400b9d0 con 0x7f54a40ca160 2023-12-22T10:00:16.700 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.699+0000 7f54a929b700 1 -- 172.21.15.113:0/1581205678 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54a40c3400 con 0x7f54a40ca160 2023-12-22T10:00:16.701 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.699+0000 7f548affd700 1 -- 172.21.15.113:0/1581205678 <== mon.2 v2:172.21.15.113:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f549401c670 con 0x7f54a40ca160 2023-12-22T10:00:16.701 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.703+0000 7f54a929b700 1 -- 172.21.15.113:0/1581205678 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54a40c39c0 con 0x7f54a40ca160 2023-12-22T10:00:16.701 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.703+0000 7f548affd700 1 -- 172.21.15.113:0/1581205678 <== mon.2 v2:172.21.15.113:3301/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f549401cc80 con 0x7f54a40ca160 2023-12-22T10:00:16.701 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.703+0000 7f548affd700 1 -- 172.21.15.113:0/1581205678 <== mon.2 v2:172.21.15.113:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1099+0+0 (secure 0 0 0) 0x7f5494006af0 con 0x7f54a40ca160 2023-12-22T10:00:16.701 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.703+0000 7f54a929b700 1 -- 172.21.15.113:0/1581205678 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54a406c070 con 0x7f54a40ca160 2023-12-22T10:00:16.703 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.707+0000 7f548affd700 1 -- 172.21.15.113:0/1581205678 <== mon.2 v2:172.21.15.113:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7f5494044e50 con 0x7f54a40ca160 2023-12-22T10:00:16.781 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-12-22T10:00:16.786+0000 7fba07145500 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-22T10:00:16.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.791+0000 7f54a929b700 1 -- 172.21.15.113:0/1581205678 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_command({"prefix": "osd new", "uuid": "db104ca9-3a94-4d39-a2be-bd06db888095", "id": 3} v 0) v1 -- 0x7f54a40c87d0 con 0x7f54a40ca160 2023-12-22T10:00:16.798 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.799+0000 7f548affd700 1 -- 172.21.15.113:0/1581205678 <== mon.2 v2:172.21.15.113:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "db104ca9-3a94-4d39-a2be-bd06db888095", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5494033020 con 0x7f54a40ca160 2023-12-22T10:00:16.799 INFO:teuthology.orchestra.run.smithi113.stdout:3 2023-12-22T10:00:16.800 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.803+0000 7f54a929b700 1 -- 172.21.15.113:0/1581205678 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f54a40ca160 msgr2=0x7f54a413c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:16.800 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.803+0000 7f54a929b700 1 --2- 172.21.15.113:0/1581205678 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f54a40ca160 0x7f54a413c790 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f54a4083fa0 tx=0x7f5494015000).stop 2023-12-22T10:00:16.800 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.803+0000 7f54a929b700 1 -- 172.21.15.113:0/1581205678 shutdown_connections 2023-12-22T10:00:16.801 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.803+0000 7f54a929b700 1 --2- 172.21.15.113:0/1581205678 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54a4157b00 0x7f54a40cabf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:16.801 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.803+0000 7f54a929b700 1 --2- 172.21.15.113:0/1581205678 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f54a414e080 0x7f54a40c41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:16.801 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.803+0000 7f54a929b700 1 --2- 172.21.15.113:0/1581205678 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f54a40ca160 0x7f54a413c790 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:16.801 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.803+0000 7f54a929b700 1 -- 172.21.15.113:0/1581205678 >> 172.21.15.113:0/1581205678 conn(0x7f54a4066a70 msgr2=0x7f54a40c1020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:16.801 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.803+0000 7f54a929b700 1 -- 172.21.15.113:0/1581205678 shutdown_connections 2023-12-22T10:00:16.801 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.803+0000 7f54a929b700 1 -- 172.21.15.113:0/1581205678 wait complete. 2023-12-22T10:00:16.817 DEBUG:teuthology.orchestra.run.smithi113:> sudo ceph --cluster ceph osd new 9f4eaff4-e433-4479-a0d1-ee7a33375ca6 4 2023-12-22T10:00:16.867 INFO:tasks.ceph.mgr.x.smithi113.stderr:2023-12-22T10:00:16.867+0000 7f34c0937500 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-22T10:00:16.967 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.967+0000 7f8cba6e4700 1 Processor -- start 2023-12-22T10:00:16.968 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.971+0000 7f8cba6e4700 1 -- start start 2023-12-22T10:00:16.971 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.971+0000 7f8cba6e4700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8cb4150550 0x7f8cb40c5a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:16.971 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.971+0000 7f8cba6e4700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f8cb40c5f30 0x7f8cb40c28f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:16.971 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.971+0000 7f8cba6e4700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cb4155130 con 0x7f8cb4150930 2023-12-22T10:00:16.972 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.971+0000 7f8cba6e4700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cb4154310 con 0x7f8cb4150550 2023-12-22T10:00:16.972 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.975+0000 7f8cba6e4700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb4154520 con 0x7f8cb40c5f30 2023-12-22T10:00:16.972 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.975+0000 7f8cb96e2700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8cb4150550 0x7f8cb40c5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:16.972 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.975+0000 7f8cb96e2700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8cb4150550 0x7f8cb40c5a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:52370/0 (socket says 172.21.15.113:52370) 2023-12-22T10:00:16.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.975+0000 7f8cb96e2700 1 -- 172.21.15.113:0/1444783953 learned_addr learned my addr 172.21.15.113:0/1444783953 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-22T10:00:16.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.975+0000 7f8cb9ee3700 1 --2- 172.21.15.113:0/1444783953 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f8cb40c5f30 0x7f8cb40c28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:16.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.975+0000 7f8cb9ee3700 1 -- 172.21.15.113:0/1444783953 >> v2:172.21.15.113:3300/0 conn(0x7f8cb4150550 msgr2=0x7f8cb40c5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:00:16.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.975+0000 7f8cb9ee3700 1 --2- 172.21.15.113:0/1444783953 >> v2:172.21.15.113:3300/0 conn(0x7f8cb4150550 0x7f8cb40c5a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:16.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.975+0000 7f8cb9ee3700 1 -- 172.21.15.113:0/1444783953 >> v1:172.21.15.113:6789/0 conn(0x7f8cb4150930 legacy=0x7f8cb40c21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:16.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.975+0000 7f8cb9ee3700 1 -- 172.21.15.113:0/1444783953 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cb4154800 con 0x7f8cb40c5f30 2023-12-22T10:00:16.973 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.975+0000 7f8cb9ee3700 1 --2- 172.21.15.113:0/1444783953 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f8cb40c5f30 0x7f8cb40c28f0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f8cac009e60 tx=0x7f8cac009780).ready entity=mon.2 client_cookie=57c3b7ca05a0df03 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:16.974 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.975+0000 7f8cabfff700 1 -- 172.21.15.113:0/1444783953 <== mon.2 v2:172.21.15.113:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cac00e070 con 0x7f8cb40c5f30 2023-12-22T10:00:16.974 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.975+0000 7f8cabfff700 1 -- 172.21.15.113:0/1444783953 <== mon.2 v2:172.21.15.113:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cac00bb60 con 0x7f8cb40c5f30 2023-12-22T10:00:16.974 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.975+0000 7f8cabfff700 1 -- 172.21.15.113:0/1444783953 <== mon.2 v2:172.21.15.113:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cac012410 con 0x7f8cb40c5f30 2023-12-22T10:00:16.975 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.975+0000 7f8cba6e4700 1 -- 172.21.15.113:0/1444783953 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f8cb40c5f30 msgr2=0x7f8cb40c28f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:16.975 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.975+0000 7f8cba6e4700 1 --2- 172.21.15.113:0/1444783953 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f8cb40c5f30 0x7f8cb40c28f0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f8cac009e60 tx=0x7f8cac009780).stop 2023-12-22T10:00:16.975 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.975+0000 7f8cba6e4700 1 -- 172.21.15.113:0/1444783953 shutdown_connections 2023-12-22T10:00:16.975 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.975+0000 7f8cba6e4700 1 --2- 172.21.15.113:0/1444783953 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f8cb40c5f30 0x7f8cb40c28f0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:16.975 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.975+0000 7f8cba6e4700 1 --2- 172.21.15.113:0/1444783953 >> v2:172.21.15.113:3300/0 conn(0x7f8cb4150550 0x7f8cb40c5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:16.975 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.975+0000 7f8cba6e4700 1 -- 172.21.15.113:0/1444783953 >> 172.21.15.113:0/1444783953 conn(0x7f8cb4067500 msgr2=0x7f8cb40c6440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:16.976 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.975+0000 7f8cba6e4700 1 -- 172.21.15.113:0/1444783953 shutdown_connections 2023-12-22T10:00:16.976 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.975+0000 7f8cba6e4700 1 -- 172.21.15.113:0/1444783953 wait complete. 2023-12-22T10:00:16.976 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.979+0000 7f8cba6e4700 1 Processor -- start 2023-12-22T10:00:16.976 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.979+0000 7f8cba6e4700 1 -- start start 2023-12-22T10:00:16.978 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.979+0000 7f8cba6e4700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f8cb40c5f30 0x7f8cb4160e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:16.978 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.979+0000 7f8cba6e4700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8cb4150550 0x7f8cb4150db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:16.978 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.979+0000 7f8cba6e4700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cb4150930 0x7f8cb414e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:16.978 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.979+0000 7f8cba6e4700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb41521a0 con 0x7f8cb4150930 2023-12-22T10:00:16.978 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.979+0000 7f8cba6e4700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb4151590 con 0x7f8cb4150550 2023-12-22T10:00:16.978 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.979+0000 7f8cba6e4700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb4151870 con 0x7f8cb40c5f30 2023-12-22T10:00:16.978 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.979+0000 7f8cb96e2700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f8cb40c5f30 0x7f8cb4160e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:16.978 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.979+0000 7f8cb8ee1700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8cb4150550 0x7f8cb4150db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:16.978 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.979+0000 7f8cb8ee1700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8cb4150550 0x7f8cb4150db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:52380/0 (socket says 172.21.15.113:52380) 2023-12-22T10:00:16.978 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.979+0000 7f8cb8ee1700 1 -- 172.21.15.113:0/1219497293 learned_addr learned my addr 172.21.15.113:0/1219497293 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-22T10:00:16.980 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.979+0000 7f8cb9ee3700 1 --2- 172.21.15.113:0/1219497293 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cb4150930 0x7f8cb414e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:16.980 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.979+0000 7f8cb8ee1700 1 -- 172.21.15.113:0/1219497293 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f8cb40c5f30 msgr2=0x7f8cb4160e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:16.980 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.979+0000 7f8cb8ee1700 1 --2- 172.21.15.113:0/1219497293 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f8cb40c5f30 0x7f8cb4160e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:16.980 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.979+0000 7f8cb8ee1700 1 -- 172.21.15.113:0/1219497293 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cb4150930 msgr2=0x7f8cb414e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:16.980 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.979+0000 7f8cb8ee1700 1 --2- 172.21.15.113:0/1219497293 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cb4150930 0x7f8cb414e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:16.980 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.979+0000 7f8cb8ee1700 1 -- 172.21.15.113:0/1219497293 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cac009a20 con 0x7f8cb4150550 2023-12-22T10:00:16.980 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.979+0000 7f8cb9ee3700 1 --2- 172.21.15.113:0/1219497293 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cb4150930 0x7f8cb414e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-12-22T10:00:16.980 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.979+0000 7f8cb96e2700 1 --2- 172.21.15.113:0/1219497293 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f8cb40c5f30 0x7f8cb4160e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-12-22T10:00:16.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.979+0000 7f8cb8ee1700 1 --2- 172.21.15.113:0/1219497293 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8cb4150550 0x7f8cb4150db0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f8ca400c440 tx=0x7f8ca4007e00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:16.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.979+0000 7f8ca97fa700 1 -- 172.21.15.113:0/1219497293 <== mon.1 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca400ce40 con 0x7f8cb4150550 2023-12-22T10:00:16.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.979+0000 7f8ca97fa700 1 -- 172.21.15.113:0/1219497293 <== mon.1 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ca4007020 con 0x7f8cb4150550 2023-12-22T10:00:16.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.983+0000 7f8cba6e4700 1 -- 172.21.15.113:0/1219497293 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cb4151b50 con 0x7f8cb4150550 2023-12-22T10:00:16.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.983+0000 7f8ca97fa700 1 -- 172.21.15.113:0/1219497293 <== mon.1 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca40073c0 con 0x7f8cb4150550 2023-12-22T10:00:16.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.983+0000 7f8cba6e4700 1 -- 172.21.15.113:0/1219497293 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cb41512a0 con 0x7f8cb4150550 2023-12-22T10:00:16.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.983+0000 7f8ca97fa700 1 -- 172.21.15.113:0/1219497293 <== mon.1 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f8ca4006b10 con 0x7f8cb4150550 2023-12-22T10:00:16.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.983+0000 7f8ca97fa700 1 -- 172.21.15.113:0/1219497293 <== mon.1 v2:172.21.15.113:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1214+0+0 (secure 0 0 0) 0x7f8ca4007520 con 0x7f8cb4150550 2023-12-22T10:00:16.981 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.983+0000 7f8cba6e4700 1 -- 172.21.15.113:0/1219497293 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cb40bd2e0 con 0x7f8cb4150550 2023-12-22T10:00:16.985 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:16.987+0000 7f8ca97fa700 1 -- 172.21.15.113:0/1219497293 <== mon.1 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7f8cb40bd2e0 con 0x7f8cb4150550 2023-12-22T10:00:16.998 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-12-22T10:00:17.002+0000 7fba07145500 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-22T10:00:17.067 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.067+0000 7f8cba6e4700 1 -- 172.21.15.113:0/1219497293 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9f4eaff4-e433-4479-a0d1-ee7a33375ca6", "id": 4} v 0) v1 -- 0x7f8cb4047060 con 0x7f8cb4150550 2023-12-22T10:00:17.078 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.079+0000 7f8ca97fa700 1 -- 172.21.15.113:0/1219497293 <== mon.1 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9f4eaff4-e433-4479-a0d1-ee7a33375ca6", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8ca4020060 con 0x7f8cb4150550 2023-12-22T10:00:17.079 INFO:teuthology.orchestra.run.smithi113.stdout:4 2023-12-22T10:00:17.079 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.079+0000 7f8cba6e4700 1 -- 172.21.15.113:0/1219497293 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8cb4150550 msgr2=0x7f8cb4150db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:17.079 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.079+0000 7f8cba6e4700 1 --2- 172.21.15.113:0/1219497293 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8cb4150550 0x7f8cb4150db0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f8ca400c440 tx=0x7f8ca4007e00).stop 2023-12-22T10:00:17.081 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.079+0000 7f8cba6e4700 1 -- 172.21.15.113:0/1219497293 shutdown_connections 2023-12-22T10:00:17.081 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.079+0000 7f8cba6e4700 1 --2- 172.21.15.113:0/1219497293 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cb4150930 0x7f8cb414e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:17.081 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.079+0000 7f8cba6e4700 1 --2- 172.21.15.113:0/1219497293 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8cb4150550 0x7f8cb4150db0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:17.081 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.079+0000 7f8cba6e4700 1 --2- 172.21.15.113:0/1219497293 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f8cb40c5f30 0x7f8cb4160e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:17.082 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.079+0000 7f8cba6e4700 1 -- 172.21.15.113:0/1219497293 >> 172.21.15.113:0/1219497293 conn(0x7f8cb4067500 msgr2=0x7f8cb4064620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:17.082 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.083+0000 7f8cba6e4700 1 -- 172.21.15.113:0/1219497293 shutdown_connections 2023-12-22T10:00:17.082 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.083+0000 7f8cba6e4700 1 -- 172.21.15.113:0/1219497293 wait complete. 2023-12-22T10:00:17.089 INFO:tasks.ceph.mgr.x.smithi113.stderr:2023-12-22T10:00:17.091+0000 7f34c0937500 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-22T10:00:17.094 DEBUG:teuthology.orchestra.run.smithi113:> sudo ceph --cluster ceph osd new 1efc5591-180b-43af-8611-0068aadc5aa1 5 2023-12-22T10:00:17.236 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.239+0000 7fb43069b700 1 Processor -- start 2023-12-22T10:00:17.236 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.239+0000 7fb43069b700 1 -- start start 2023-12-22T10:00:17.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.239+0000 7fb43069b700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb4280c1d80 0x7fb428158120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:17.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.239+0000 7fb43069b700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb428069180 con 0x7fb428157d40 2023-12-22T10:00:17.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.239+0000 7fb43069b700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb428069460 con 0x7fb428065930 2023-12-22T10:00:17.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.239+0000 7fb43069b700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb428069e00 con 0x7fb4280c1d80 2023-12-22T10:00:17.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.239+0000 7fb42dc36700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb4280c1d80 0x7fb428158120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:17.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.239+0000 7fb42dc36700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb4280c1d80 0x7fb428158120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:52390/0 (socket says 172.21.15.113:52390) 2023-12-22T10:00:17.238 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.239+0000 7fb42dc36700 1 -- 172.21.15.113:0/248478524 learned_addr learned my addr 172.21.15.113:0/248478524 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-22T10:00:17.239 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.239+0000 7fb42dc36700 1 -- 172.21.15.113:0/248478524 >> v1:172.21.15.113:6789/0 conn(0x7fb428065930 legacy=0x7fb4280a5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:17.239 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.239+0000 7fb42dc36700 1 -- 172.21.15.113:0/248478524 >> v1:172.21.15.45:6789/0 conn(0x7fb428157d40 legacy=0x7fb4280c1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:17.239 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.239+0000 7fb42dc36700 1 -- 172.21.15.113:0/248478524 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb428069740 con 0x7fb4280c1d80 2023-12-22T10:00:17.239 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.243+0000 7fb42dc36700 1 --2- 172.21.15.113:0/248478524 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb4280c1d80 0x7fb428158120 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7fb418006fd0 tx=0x7fb4180090f0).ready entity=mon.1 client_cookie=fe5eb45c7daf4f4b server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:17.240 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.243+0000 7fb42d435700 1 -- 172.21.15.113:0/248478524 <== mon.1 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb41800b600 con 0x7fb4280c1d80 2023-12-22T10:00:17.240 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.243+0000 7fb42d435700 1 -- 172.21.15.113:0/248478524 <== mon.1 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb41800b760 con 0x7fb4280c1d80 2023-12-22T10:00:17.240 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.243+0000 7fb42d435700 1 -- 172.21.15.113:0/248478524 <== mon.1 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb41800bb00 con 0x7fb4280c1d80 2023-12-22T10:00:17.241 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.243+0000 7fb43069b700 1 -- 172.21.15.113:0/248478524 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb4280c1d80 msgr2=0x7fb428158120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:17.241 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.243+0000 7fb43069b700 1 --2- 172.21.15.113:0/248478524 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb4280c1d80 0x7fb428158120 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7fb418006fd0 tx=0x7fb4180090f0).stop 2023-12-22T10:00:17.241 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.243+0000 7fb43069b700 1 -- 172.21.15.113:0/248478524 shutdown_connections 2023-12-22T10:00:17.241 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.243+0000 7fb43069b700 1 --2- 172.21.15.113:0/248478524 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb4280c1d80 0x7fb428158120 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:17.241 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.243+0000 7fb43069b700 1 -- 172.21.15.113:0/248478524 >> 172.21.15.113:0/248478524 conn(0x7fb428066a70 msgr2=0x7fb428066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:17.241 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.243+0000 7fb43069b700 1 -- 172.21.15.113:0/248478524 shutdown_connections 2023-12-22T10:00:17.241 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.243+0000 7fb43069b700 1 -- 172.21.15.113:0/248478524 wait complete. 2023-12-22T10:00:17.242 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.243+0000 7fb43069b700 1 Processor -- start 2023-12-22T10:00:17.242 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.243+0000 7fb43069b700 1 -- start start 2023-12-22T10:00:17.246 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.247+0000 7fb43069b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb428065930 0x7fb428168e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:17.246 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.247+0000 7fb43069b700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb4280c1d80 0x7fb42816c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:17.247 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.247+0000 7fb43069b700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb428157d40 0x7fb4280c6430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:17.247 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.247+0000 7fb43069b700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4280bd710 con 0x7fb428065930 2023-12-22T10:00:17.247 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.247+0000 7fb43069b700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4280c56b0 con 0x7fb428157d40 2023-12-22T10:00:17.247 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.247+0000 7fb43069b700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4280c5950 con 0x7fb4280c1d80 2023-12-22T10:00:17.247 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.247+0000 7fb42dc36700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb4280c1d80 0x7fb42816c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:17.247 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.247+0000 7fb42dc36700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb4280c1d80 0x7fb42816c550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.113:3301/0 says I am v2:172.21.15.113:36798/0 (socket says 172.21.15.113:36798) 2023-12-22T10:00:17.247 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.247+0000 7fb42dc36700 1 -- 172.21.15.113:0/1351869039 learned_addr learned my addr 172.21.15.113:0/1351869039 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-22T10:00:17.247 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.247+0000 7fb42ec38700 1 --2- 172.21.15.113:0/1351869039 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb428157d40 0x7fb4280c6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:17.247 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.247+0000 7fb42e437700 1 --2- 172.21.15.113:0/1351869039 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb428065930 0x7fb428168e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:17.247 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.247+0000 7fb42dc36700 1 -- 172.21.15.113:0/1351869039 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb428157d40 msgr2=0x7fb4280c6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:17.247 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.247+0000 7fb42dc36700 1 --2- 172.21.15.113:0/1351869039 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb428157d40 0x7fb4280c6430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:17.247 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.247+0000 7fb42dc36700 1 -- 172.21.15.113:0/1351869039 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb428065930 msgr2=0x7fb428168e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:17.247 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.247+0000 7fb42dc36700 1 --2- 172.21.15.113:0/1351869039 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb428065930 0x7fb428168e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:17.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.247+0000 7fb42dc36700 1 -- 172.21.15.113:0/1351869039 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb418009370 con 0x7fb4280c1d80 2023-12-22T10:00:17.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.247+0000 7fb42ec38700 1 --2- 172.21.15.113:0/1351869039 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb428157d40 0x7fb4280c6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T10:00:17.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.247+0000 7fb42dc36700 1 --2- 172.21.15.113:0/1351869039 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb4280c1d80 0x7fb42816c550 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7fb418009f50 tx=0x7fb418017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:17.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.247+0000 7fb41e7fc700 1 -- 172.21.15.113:0/1351869039 <== mon.2 v2:172.21.15.113:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb418006910 con 0x7fb4280c1d80 2023-12-22T10:00:17.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.247+0000 7fb41e7fc700 1 -- 172.21.15.113:0/1351869039 <== mon.2 v2:172.21.15.113:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb41800b8d0 con 0x7fb4280c1d80 2023-12-22T10:00:17.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.247+0000 7fb43069b700 1 -- 172.21.15.113:0/1351869039 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4280c5c30 con 0x7fb4280c1d80 2023-12-22T10:00:17.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.247+0000 7fb41e7fc700 1 -- 172.21.15.113:0/1351869039 <== mon.2 v2:172.21.15.113:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb418024470 con 0x7fb4280c1d80 2023-12-22T10:00:17.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.247+0000 7fb43069b700 1 -- 172.21.15.113:0/1351869039 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb428169300 con 0x7fb4280c1d80 2023-12-22T10:00:17.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.247+0000 7fb41e7fc700 1 -- 172.21.15.113:0/1351869039 <== mon.2 v2:172.21.15.113:3301/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7fb418021070 con 0x7fb4280c1d80 2023-12-22T10:00:17.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.247+0000 7fb41e7fc700 1 -- 172.21.15.113:0/1351869039 <== mon.2 v2:172.21.15.113:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1329+0+0 (secure 0 0 0) 0x7fb41801b9c0 con 0x7fb4280c1d80 2023-12-22T10:00:17.248 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.247+0000 7fb43069b700 1 -- 172.21.15.113:0/1351869039 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4281695e0 con 0x7fb4280c1d80 2023-12-22T10:00:17.249 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.251+0000 7fb41e7fc700 1 -- 172.21.15.113:0/1351869039 <== mon.2 v2:172.21.15.113:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7fb4281695e0 con 0x7fb4280c1d80 2023-12-22T10:00:17.305 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-12-22T10:00:17.306+0000 7fba07145500 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-22T10:00:17.327 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.327+0000 7fb43069b700 1 -- 172.21.15.113:0/1351869039 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_command({"prefix": "osd new", "uuid": "1efc5591-180b-43af-8611-0068aadc5aa1", "id": 5} v 0) v1 -- 0x7fb4280c6130 con 0x7fb4280c1d80 2023-12-22T10:00:17.337 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.339+0000 7fb41e7fc700 1 -- 172.21.15.113:0/1351869039 <== mon.2 v2:172.21.15.113:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1efc5591-180b-43af-8611-0068aadc5aa1", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb418029020 con 0x7fb4280c1d80 2023-12-22T10:00:17.337 INFO:teuthology.orchestra.run.smithi113.stdout:5 2023-12-22T10:00:17.339 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.339+0000 7fb43069b700 1 -- 172.21.15.113:0/1351869039 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb4280c1d80 msgr2=0x7fb42816c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:17.339 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.339+0000 7fb43069b700 1 --2- 172.21.15.113:0/1351869039 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb4280c1d80 0x7fb42816c550 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7fb418009f50 tx=0x7fb418017000).stop 2023-12-22T10:00:17.339 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.339+0000 7fb43069b700 1 -- 172.21.15.113:0/1351869039 shutdown_connections 2023-12-22T10:00:17.339 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.339+0000 7fb43069b700 1 --2- 172.21.15.113:0/1351869039 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb428157d40 0x7fb4280c6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:17.339 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.339+0000 7fb43069b700 1 --2- 172.21.15.113:0/1351869039 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb4280c1d80 0x7fb42816c550 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:17.339 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.339+0000 7fb43069b700 1 --2- 172.21.15.113:0/1351869039 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb428065930 0x7fb428168e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:17.339 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.339+0000 7fb43069b700 1 -- 172.21.15.113:0/1351869039 >> 172.21.15.113:0/1351869039 conn(0x7fb428066a70 msgr2=0x7fb4280abb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:17.339 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.339+0000 7fb43069b700 1 -- 172.21.15.113:0/1351869039 shutdown_connections 2023-12-22T10:00:17.339 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.339+0000 7fb43069b700 1 -- 172.21.15.113:0/1351869039 wait complete. 2023-12-22T10:00:17.356 DEBUG:teuthology.orchestra.run.smithi113:> sudo ceph --cluster ceph osd new 6c89d9d8-c153-4a48-afa9-97e4c403f1ee 6 2023-12-22T10:00:17.429 INFO:tasks.ceph.mgr.x.smithi113.stderr:2023-12-22T10:00:17.431+0000 7f34c0937500 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-22T10:00:17.500 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-12-22T10:00:17.502+0000 7fba07145500 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-22T10:00:17.509 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.511+0000 7f1be78db700 1 Processor -- start 2023-12-22T10:00:17.509 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.511+0000 7f1be78db700 1 -- start start 2023-12-22T10:00:17.512 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.515+0000 7f1be78db700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1be00ac0e0 0x7f1be00a7050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:17.512 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.515+0000 7f1be78db700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1be00ac4c0 0x7f1be0155660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:17.513 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.515+0000 7f1be78db700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1be01521b0 con 0x7f1be0155b50 2023-12-22T10:00:17.513 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.515+0000 7f1be78db700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1be0151fa0 con 0x7f1be00ac4c0 2023-12-22T10:00:17.513 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.515+0000 7f1be78db700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1be00c36e0 con 0x7f1be00ac0e0 2023-12-22T10:00:17.513 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.515+0000 7f1be5677700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1be00ac0e0 0x7f1be00a7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:17.513 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.515+0000 7f1be5677700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1be00ac0e0 0x7f1be00a7050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.113:3301/0 says I am v2:172.21.15.113:36802/0 (socket says 172.21.15.113:36802) 2023-12-22T10:00:17.513 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.515+0000 7f1be5677700 1 -- 172.21.15.113:0/2892653416 learned_addr learned my addr 172.21.15.113:0/2892653416 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-22T10:00:17.513 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.515+0000 7f1be4e76700 1 --2- 172.21.15.113:0/2892653416 >> v2:172.21.15.45:3300/0 conn(0x7f1be00ac4c0 0x7f1be0155660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:17.514 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.515+0000 7f1be5677700 1 -- 172.21.15.113:0/2892653416 >> v2:172.21.15.45:3300/0 conn(0x7f1be00ac4c0 msgr2=0x7f1be0155660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:00:17.514 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.515+0000 7f1be5677700 1 --2- 172.21.15.113:0/2892653416 >> v2:172.21.15.45:3300/0 conn(0x7f1be00ac4c0 0x7f1be0155660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:17.514 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.515+0000 7f1be5677700 1 -- 172.21.15.113:0/2892653416 >> v1:172.21.15.45:6789/0 conn(0x7f1be0155b50 legacy=0x7f1be00a5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:17.514 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.515+0000 7f1bd7fff700 1 -- 172.21.15.113:0/2892653416 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 833998411 0 0) 0x7f1be01521b0 con 0x7f1be0155b50 2023-12-22T10:00:17.514 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.515+0000 7f1be5677700 1 -- 172.21.15.113:0/2892653416 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1be00c39c0 con 0x7f1be00ac0e0 2023-12-22T10:00:17.515 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.515+0000 7f1be5677700 1 --2- 172.21.15.113:0/2892653416 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1be00ac0e0 0x7f1be00a7050 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f1bdc006fd0 tx=0x7f1bdc0090f0).ready entity=mon.2 client_cookie=f5b6a207fbb8bc7d server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:17.515 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.515+0000 7f1bd7fff700 1 -- 172.21.15.113:0/2892653416 <== mon.2 v2:172.21.15.113:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bdc00b580 con 0x7f1be00ac0e0 2023-12-22T10:00:17.515 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.515+0000 7f1bd7fff700 1 -- 172.21.15.113:0/2892653416 <== mon.2 v2:172.21.15.113:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bdc00b6e0 con 0x7f1be00ac0e0 2023-12-22T10:00:17.515 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.515+0000 7f1bd7fff700 1 -- 172.21.15.113:0/2892653416 <== mon.2 v2:172.21.15.113:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bdc00ba60 con 0x7f1be00ac0e0 2023-12-22T10:00:17.516 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.519+0000 7f1be78db700 1 -- 172.21.15.113:0/2892653416 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1be00ac0e0 msgr2=0x7f1be00a7050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:17.516 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.519+0000 7f1be78db700 1 --2- 172.21.15.113:0/2892653416 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1be00ac0e0 0x7f1be00a7050 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f1bdc006fd0 tx=0x7f1bdc0090f0).stop 2023-12-22T10:00:17.516 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.519+0000 7f1be78db700 1 -- 172.21.15.113:0/2892653416 shutdown_connections 2023-12-22T10:00:17.516 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.519+0000 7f1be78db700 1 --2- 172.21.15.113:0/2892653416 >> v2:172.21.15.45:3300/0 conn(0x7f1be00ac4c0 0x7f1be0155660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:17.516 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.519+0000 7f1be78db700 1 --2- 172.21.15.113:0/2892653416 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1be00ac0e0 0x7f1be00a7050 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:17.516 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.519+0000 7f1be78db700 1 -- 172.21.15.113:0/2892653416 >> 172.21.15.113:0/2892653416 conn(0x7f1be0066a70 msgr2=0x7f1be0066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:17.516 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.519+0000 7f1be78db700 1 -- 172.21.15.113:0/2892653416 shutdown_connections 2023-12-22T10:00:17.516 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.519+0000 7f1be78db700 1 -- 172.21.15.113:0/2892653416 wait complete. 2023-12-22T10:00:17.518 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.519+0000 7f1be78db700 1 Processor -- start 2023-12-22T10:00:17.519 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.519+0000 7f1be78db700 1 -- start start 2023-12-22T10:00:17.522 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.523+0000 7f1be78db700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1be00ac0e0 0x7f1be01422d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:17.522 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.523+0000 7f1be78db700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1be0155b50 0x7f1be00c2700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:17.522 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.523+0000 7f1be78db700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1be009f580 0x7f1be00bfbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:17.522 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.523+0000 7f1be78db700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1be01427c0 con 0x7f1be0155b50 2023-12-22T10:00:17.522 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.523+0000 7f1be78db700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1be0164150 con 0x7f1be009f580 2023-12-22T10:00:17.522 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.523+0000 7f1be78db700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1be0164fa0 con 0x7f1be00ac0e0 2023-12-22T10:00:17.522 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.523+0000 7f1be5677700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1be00ac0e0 0x7f1be01422d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:17.522 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.523+0000 7f1be5e78700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1be009f580 0x7f1be00bfbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:17.522 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.523+0000 7f1be5677700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1be00ac0e0 0x7f1be01422d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.113:3301/0 says I am v2:172.21.15.113:36808/0 (socket says 172.21.15.113:36808) 2023-12-22T10:00:17.522 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.523+0000 7f1be5677700 1 -- 172.21.15.113:0/752480221 learned_addr learned my addr 172.21.15.113:0/752480221 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-22T10:00:17.522 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.523+0000 7f1be4e76700 1 --2- 172.21.15.113:0/752480221 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1be0155b50 0x7f1be00c2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:17.522 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.523+0000 7f1be5677700 1 -- 172.21.15.113:0/752480221 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1be009f580 msgr2=0x7f1be00bfbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:17.523 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.523+0000 7f1be5677700 1 --2- 172.21.15.113:0/752480221 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1be009f580 0x7f1be00bfbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:17.523 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.523+0000 7f1be5677700 1 -- 172.21.15.113:0/752480221 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1be0155b50 msgr2=0x7f1be00c2700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:17.523 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.523+0000 7f1be5677700 1 --2- 172.21.15.113:0/752480221 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1be0155b50 0x7f1be00c2700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:17.523 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.523+0000 7f1be5677700 1 -- 172.21.15.113:0/752480221 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bdc009370 con 0x7f1be00ac0e0 2023-12-22T10:00:17.523 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.523+0000 7f1be5677700 1 --2- 172.21.15.113:0/752480221 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1be00ac0e0 0x7f1be01422d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f1be0063de0 tx=0x7f1bdc017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:17.524 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.523+0000 7f1bd57fa700 1 -- 172.21.15.113:0/752480221 <== mon.2 v2:172.21.15.113:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bdc000bc0 con 0x7f1be00ac0e0 2023-12-22T10:00:17.524 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.523+0000 7f1bd57fa700 1 -- 172.21.15.113:0/752480221 <== mon.2 v2:172.21.15.113:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bdc00b850 con 0x7f1be00ac0e0 2023-12-22T10:00:17.524 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.523+0000 7f1be78db700 1 -- 172.21.15.113:0/752480221 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1be0164390 con 0x7f1be00ac0e0 2023-12-22T10:00:17.524 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.523+0000 7f1bd57fa700 1 -- 172.21.15.113:0/752480221 <== mon.2 v2:172.21.15.113:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bdc01c670 con 0x7f1be00ac0e0 2023-12-22T10:00:17.524 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.523+0000 7f1be78db700 1 -- 172.21.15.113:0/752480221 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1be0164950 con 0x7f1be00ac0e0 2023-12-22T10:00:17.524 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.527+0000 7f1bd57fa700 1 -- 172.21.15.113:0/752480221 <== mon.2 v2:172.21.15.113:3301/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f1bdc01ccc0 con 0x7f1be00ac0e0 2023-12-22T10:00:17.524 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.527+0000 7f1bd57fa700 1 -- 172.21.15.113:0/752480221 <== mon.2 v2:172.21.15.113:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1444+0+0 (secure 0 0 0) 0x7f1bdc006af0 con 0x7f1be00ac0e0 2023-12-22T10:00:17.525 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.527+0000 7f1be78db700 1 -- 172.21.15.113:0/752480221 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1be006c070 con 0x7f1be00ac0e0 2023-12-22T10:00:17.528 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.531+0000 7f1bd57fa700 1 -- 172.21.15.113:0/752480221 <== mon.2 v2:172.21.15.113:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7f1bdc02a060 con 0x7f1be00ac0e0 2023-12-22T10:00:17.573 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-12-22T10:00:17.578+0000 7fba07145500 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-22T10:00:17.607 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.607+0000 7f1be78db700 1 -- 172.21.15.113:0/752480221 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_command({"prefix": "osd new", "uuid": "6c89d9d8-c153-4a48-afa9-97e4c403f1ee", "id": 6} v 0) v1 -- 0x7f1be00c3ca0 con 0x7f1be00ac0e0 2023-12-22T10:00:17.618 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.619+0000 7f1bd57fa700 1 -- 172.21.15.113:0/752480221 <== mon.2 v2:172.21.15.113:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6c89d9d8-c153-4a48-afa9-97e4c403f1ee", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1bdc034020 con 0x7f1be00ac0e0 2023-12-22T10:00:17.618 INFO:teuthology.orchestra.run.smithi113.stdout:6 2023-12-22T10:00:17.620 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.623+0000 7f1be78db700 1 -- 172.21.15.113:0/752480221 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1be00ac0e0 msgr2=0x7f1be01422d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:17.620 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.623+0000 7f1be78db700 1 --2- 172.21.15.113:0/752480221 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1be00ac0e0 0x7f1be01422d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f1be0063de0 tx=0x7f1bdc017000).stop 2023-12-22T10:00:17.620 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.623+0000 7f1be78db700 1 -- 172.21.15.113:0/752480221 shutdown_connections 2023-12-22T10:00:17.620 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.623+0000 7f1be78db700 1 --2- 172.21.15.113:0/752480221 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1be009f580 0x7f1be00bfbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:17.620 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.623+0000 7f1be78db700 1 --2- 172.21.15.113:0/752480221 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1be0155b50 0x7f1be00c2700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:17.620 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.623+0000 7f1be78db700 1 --2- 172.21.15.113:0/752480221 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1be00ac0e0 0x7f1be01422d0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:17.620 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.623+0000 7f1be78db700 1 -- 172.21.15.113:0/752480221 >> 172.21.15.113:0/752480221 conn(0x7f1be0066a70 msgr2=0x7f1be00a6e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:17.620 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.623+0000 7f1be78db700 1 -- 172.21.15.113:0/752480221 shutdown_connections 2023-12-22T10:00:17.620 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.623+0000 7f1be78db700 1 -- 172.21.15.113:0/752480221 wait complete. 2023-12-22T10:00:17.642 DEBUG:teuthology.orchestra.run.smithi113:> sudo ceph --cluster ceph osd new 1855e70c-23f6-4c08-ad7f-774c2148235b 7 2023-12-22T10:00:17.646 INFO:tasks.ceph.mgr.x.smithi113.stderr:2023-12-22T10:00:17.647+0000 7f34c0937500 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-22T10:00:17.661 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-12-22T10:00:17.662+0000 7fba07145500 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-22T10:00:17.725 INFO:tasks.ceph.mgr.x.smithi113.stderr:2023-12-22T10:00:17.727+0000 7f34c0937500 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-22T10:00:17.746 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-12-22T10:00:17.750+0000 7fba07145500 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-22T10:00:17.786 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.787+0000 7f826061b700 1 Processor -- start 2023-12-22T10:00:17.786 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.787+0000 7f826061b700 1 -- start start 2023-12-22T10:00:17.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.791+0000 7f826061b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f82580ac4c0 0x7f8258155660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:17.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.791+0000 7f826061b700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82581521b0 con 0x7f8258155b50 2023-12-22T10:00:17.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.791+0000 7f826061b700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8258151fa0 con 0x7f82580ac0e0 2023-12-22T10:00:17.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.791+0000 7f826061b700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82580c36e0 con 0x7f82580ac4c0 2023-12-22T10:00:17.788 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.791+0000 7f825e3b7700 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f82580ac0e0 0x7f82580a7050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:44344/0 (socket says 172.21.15.113:44344) 2023-12-22T10:00:17.789 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.791+0000 7f825e3b7700 1 -- 172.21.15.113:0/1249299419 learned_addr learned my addr 172.21.15.113:0/1249299419 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-22T10:00:17.789 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.791+0000 7f825dbb6700 1 --2- 172.21.15.113:0/1249299419 >> v2:172.21.15.45:3300/0 conn(0x7f82580ac4c0 0x7f8258155660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:17.789 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.791+0000 7f825ebb8700 1 --1- 172.21.15.113:0/1249299419 >> v1:172.21.15.45:6789/0 conn(0x7f8258155b50 0x7f82580a5890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.113:46624/0 (socket says 172.21.15.113:46624) 2023-12-22T10:00:17.789 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.791+0000 7f825dbb6700 1 -- 172.21.15.113:0/1249299419 >> v1:172.21.15.113:6789/0 conn(0x7f82580ac0e0 legacy=0x7f82580a7050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:17.790 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.791+0000 7f825d3b5700 1 -- 172.21.15.113:0/1249299419 <== mon.1 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1522538159 0 0) 0x7f8258151fa0 con 0x7f82580ac0e0 2023-12-22T10:00:17.790 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.791+0000 7f825dbb6700 1 -- 172.21.15.113:0/1249299419 >> v1:172.21.15.45:6789/0 conn(0x7f8258155b50 legacy=0x7f82580a5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:17.790 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.791+0000 7f825dbb6700 1 -- 172.21.15.113:0/1249299419 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82580c39c0 con 0x7f82580ac4c0 2023-12-22T10:00:17.791 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.791+0000 7f825dbb6700 1 --2- 172.21.15.113:0/1249299419 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82580ac4c0 0x7f8258155660 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f8248009760 tx=0x7f8248009060).ready entity=mon.0 client_cookie=eaa29ebe0a40dfbc server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:17.791 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.791+0000 7f825d3b5700 1 -- 172.21.15.113:0/1249299419 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f824800f510 con 0x7f82580ac4c0 2023-12-22T10:00:17.791 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.791+0000 7f825d3b5700 1 -- 172.21.15.113:0/1249299419 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f824800f670 con 0x7f82580ac4c0 2023-12-22T10:00:17.791 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.791+0000 7f825d3b5700 1 -- 172.21.15.113:0/1249299419 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f824800f9f0 con 0x7f82580ac4c0 2023-12-22T10:00:17.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.795+0000 7f826061b700 1 -- 172.21.15.113:0/1249299419 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82580ac4c0 msgr2=0x7f8258155660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:17.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.795+0000 7f826061b700 1 --2- 172.21.15.113:0/1249299419 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82580ac4c0 0x7f8258155660 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f8248009760 tx=0x7f8248009060).stop 2023-12-22T10:00:17.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.795+0000 7f826061b700 1 -- 172.21.15.113:0/1249299419 shutdown_connections 2023-12-22T10:00:17.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.795+0000 7f826061b700 1 --2- 172.21.15.113:0/1249299419 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82580ac4c0 0x7f8258155660 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:17.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.795+0000 7f826061b700 1 -- 172.21.15.113:0/1249299419 >> 172.21.15.113:0/1249299419 conn(0x7f8258066a70 msgr2=0x7f8258066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:17.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.795+0000 7f826061b700 1 -- 172.21.15.113:0/1249299419 shutdown_connections 2023-12-22T10:00:17.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.795+0000 7f826061b700 1 -- 172.21.15.113:0/1249299419 wait complete. 2023-12-22T10:00:17.793 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.795+0000 7f826061b700 1 Processor -- start 2023-12-22T10:00:17.793 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.795+0000 7f826061b700 1 -- start start 2023-12-22T10:00:17.794 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.795+0000 7f826061b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82580ac0e0 0x7f8258149510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:17.794 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.795+0000 7f826061b700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f8258155b50 0x7f82580bfbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:17.794 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.795+0000 7f826061b700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f82580c00c0 0x7f82580c4540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:17.794 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.795+0000 7f826061b700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82580c68c0 con 0x7f82580ac0e0 2023-12-22T10:00:17.794 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.795+0000 7f826061b700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82580c0540 con 0x7f82580c00c0 2023-12-22T10:00:17.795 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.795+0000 7f826061b700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82580c51c0 con 0x7f8258155b50 2023-12-22T10:00:17.795 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.795+0000 7f825dbb6700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f8258155b50 0x7f82580bfbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:17.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.795+0000 7f825ebb8700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f82580c00c0 0x7f82580c4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:17.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.795+0000 7f825dbb6700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f8258155b50 0x7f82580bfbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.113:3301/0 says I am v2:172.21.15.113:36822/0 (socket says 172.21.15.113:36822) 2023-12-22T10:00:17.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.795+0000 7f825dbb6700 1 -- 172.21.15.113:0/3698665978 learned_addr learned my addr 172.21.15.113:0/3698665978 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-22T10:00:17.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.795+0000 7f825e3b7700 1 --2- 172.21.15.113:0/3698665978 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82580ac0e0 0x7f8258149510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:17.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.799+0000 7f825ebb8700 1 -- 172.21.15.113:0/3698665978 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f8258155b50 msgr2=0x7f82580bfbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:17.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.799+0000 7f825ebb8700 1 --2- 172.21.15.113:0/3698665978 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f8258155b50 0x7f82580bfbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:17.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.799+0000 7f825ebb8700 1 -- 172.21.15.113:0/3698665978 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82580ac0e0 msgr2=0x7f8258149510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:17.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.799+0000 7f825ebb8700 1 --2- 172.21.15.113:0/3698665978 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82580ac0e0 0x7f8258149510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:17.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.799+0000 7f825ebb8700 1 -- 172.21.15.113:0/3698665978 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82480092a0 con 0x7f82580c00c0 2023-12-22T10:00:17.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.799+0000 7f825ebb8700 1 --2- 172.21.15.113:0/3698665978 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f82580c00c0 0x7f82580c4540 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f825000c7e0 tx=0x7f8250001550).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:17.797 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.799+0000 7f824e7fc700 1 -- 172.21.15.113:0/3698665978 <== mon.1 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8250005c70 con 0x7f82580c00c0 2023-12-22T10:00:17.798 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.799+0000 7f824e7fc700 1 -- 172.21.15.113:0/3698665978 <== mon.1 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8250005e10 con 0x7f82580c00c0 2023-12-22T10:00:17.798 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.799+0000 7f824e7fc700 1 -- 172.21.15.113:0/3698665978 <== mon.1 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8250007320 con 0x7f82580c00c0 2023-12-22T10:00:17.798 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.799+0000 7f826061b700 1 -- 172.21.15.113:0/3698665978 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82580c54a0 con 0x7f82580c00c0 2023-12-22T10:00:17.798 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.799+0000 7f826061b700 1 -- 172.21.15.113:0/3698665978 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f825814b680 con 0x7f82580c00c0 2023-12-22T10:00:17.798 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.799+0000 7f824e7fc700 1 -- 172.21.15.113:0/3698665978 <== mon.1 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f8250013450 con 0x7f82580c00c0 2023-12-22T10:00:17.798 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.799+0000 7f824e7fc700 1 -- 172.21.15.113:0/3698665978 <== mon.1 v2:172.21.15.113:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1559+0+0 (secure 0 0 0) 0x7f82500015e0 con 0x7f82580c00c0 2023-12-22T10:00:17.798 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.799+0000 7f826061b700 1 -- 172.21.15.113:0/3698665978 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f825806c070 con 0x7f82580c00c0 2023-12-22T10:00:17.801 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.803+0000 7f824e7fc700 1 -- 172.21.15.113:0/3698665978 <== mon.1 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7f8250033e50 con 0x7f82580c00c0 2023-12-22T10:00:17.822 INFO:tasks.ceph.mgr.x.smithi113.stderr:2023-12-22T10:00:17.823+0000 7f34c0937500 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-22T10:00:17.879 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.879+0000 7f826061b700 1 -- 172.21.15.113:0/3698665978 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1855e70c-23f6-4c08-ad7f-774c2148235b", "id": 7} v 0) v1 -- 0x7f8258067660 con 0x7f82580c00c0 2023-12-22T10:00:17.887 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.887+0000 7f824e7fc700 1 -- 172.21.15.113:0/3698665978 <== mon.1 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1855e70c-23f6-4c08-ad7f-774c2148235b", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8250022030 con 0x7f82580c00c0 2023-12-22T10:00:17.887 INFO:teuthology.orchestra.run.smithi113.stdout:7 2023-12-22T10:00:17.889 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.891+0000 7f826061b700 1 -- 172.21.15.113:0/3698665978 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f82580c00c0 msgr2=0x7f82580c4540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:17.889 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.891+0000 7f826061b700 1 --2- 172.21.15.113:0/3698665978 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f82580c00c0 0x7f82580c4540 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f825000c7e0 tx=0x7f8250001550).stop 2023-12-22T10:00:17.889 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.891+0000 7f826061b700 1 -- 172.21.15.113:0/3698665978 shutdown_connections 2023-12-22T10:00:17.889 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.891+0000 7f826061b700 1 --2- 172.21.15.113:0/3698665978 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f82580c00c0 0x7f82580c4540 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:17.889 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.891+0000 7f826061b700 1 --2- 172.21.15.113:0/3698665978 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f8258155b50 0x7f82580bfbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:17.889 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.891+0000 7f826061b700 1 --2- 172.21.15.113:0/3698665978 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82580ac0e0 0x7f8258149510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:17.889 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.891+0000 7f826061b700 1 -- 172.21.15.113:0/3698665978 >> 172.21.15.113:0/3698665978 conn(0x7f8258066a70 msgr2=0x7f8258064890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:17.889 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.891+0000 7f826061b700 1 -- 172.21.15.113:0/3698665978 shutdown_connections 2023-12-22T10:00:17.889 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:17.891+0000 7f826061b700 1 -- 172.21.15.113:0/3698665978 wait complete. 2023-12-22T10:00:17.905 INFO:tasks.ceph.osd.0:Restarting daemon 2023-12-22T10:00:17.905 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-12-22T10:00:17.909 INFO:tasks.ceph.mgr.x.smithi113.stderr:2023-12-22T10:00:17.911+0000 7f34c0937500 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-22T10:00:17.912 INFO:tasks.ceph.osd.0:Started 2023-12-22T10:00:17.912 INFO:tasks.ceph.osd.1:Restarting daemon 2023-12-22T10:00:17.913 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-12-22T10:00:17.916 INFO:tasks.ceph.osd.1:Started 2023-12-22T10:00:17.916 INFO:tasks.ceph.osd.2:Restarting daemon 2023-12-22T10:00:17.917 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-12-22T10:00:17.921 INFO:tasks.ceph.osd.2:Started 2023-12-22T10:00:17.921 INFO:tasks.ceph.osd.3:Restarting daemon 2023-12-22T10:00:17.921 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-12-22T10:00:17.927 INFO:tasks.ceph.osd.3:Started 2023-12-22T10:00:17.928 INFO:tasks.ceph.osd.4:Restarting daemon 2023-12-22T10:00:17.928 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-12-22T10:00:17.938 INFO:tasks.ceph.osd.4:Started 2023-12-22T10:00:17.961 INFO:tasks.ceph.osd.5:Restarting daemon 2023-12-22T10:00:17.961 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-12-22T10:00:17.966 INFO:tasks.ceph.osd.5:Started 2023-12-22T10:00:17.966 INFO:tasks.ceph.osd.6:Restarting daemon 2023-12-22T10:00:17.966 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-12-22T10:00:17.974 INFO:tasks.ceph.osd.6:Started 2023-12-22T10:00:17.974 INFO:tasks.ceph.osd.7:Restarting daemon 2023-12-22T10:00:17.974 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-12-22T10:00:17.980 INFO:tasks.ceph.osd.7:Started 2023-12-22T10:00:17.980 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T10:00:18.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:18.134+0000 7fa01cff9700 1 Processor -- start 2023-12-22T10:00:18.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:18.134+0000 7fa01cff9700 1 -- start start 2023-12-22T10:00:18.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:18.134+0000 7fa01cff9700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fa0180a9ed0 0x7fa0180c1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:18.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:18.134+0000 7fa01cff9700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fa0180bf910 0x7fa0180bfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:18.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:18.134+0000 7fa01cff9700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0180c0f70 con 0x7fa0180c5960 2023-12-22T10:00:18.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:18.134+0000 7fa01cff9700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0180aa2b0 con 0x7fa0180bf910 2023-12-22T10:00:18.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:18.134+0000 7fa01cff9700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0180c0360 con 0x7fa0180a9ed0 2023-12-22T10:00:18.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:18.134+0000 7fa017fff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fa0180c5960 0x7fa0180c5e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33530/0 (socket says 172.21.15.45:33530) 2023-12-22T10:00:18.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:18.134+0000 7fa017fff700 1 -- 172.21.15.45:0/2722048872 learned_addr learned my addr 172.21.15.45:0/2722048872 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:00:18.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:18.134+0000 7fa0177fe700 1 --2- 172.21.15.45:0/2722048872 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fa0180a9ed0 0x7fa0180c1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:18.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:18.134+0000 7fa0167fc700 1 -- 172.21.15.45:0/2722048872 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2967416673 0 0) 0x7fa0180c0f70 con 0x7fa0180c5960 2023-12-22T10:00:18.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:18.134+0000 7fa016ffd700 1 --2- 172.21.15.45:0/2722048872 >> v2:172.21.15.113:3300/0 conn(0x7fa0180bf910 0x7fa0180bfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:18.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:18.134+0000 7fa0167fc700 1 -- 172.21.15.45:0/2722048872 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0000033f0 con 0x7fa0180c5960 2023-12-22T10:00:18.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:18.138+0000 7fa0167fc700 1 -- 172.21.15.45:0/2722048872 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1414689123 0 0) 0x7fa0000033f0 con 0x7fa0180c5960 2023-12-22T10:00:18.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:18.138+0000 7fa0167fc700 1 -- 172.21.15.45:0/2722048872 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fa0180a9ed0 msgr2=0x7fa0180c1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:00:18.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:18.138+0000 7fa0167fc700 1 --2- 172.21.15.45:0/2722048872 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fa0180a9ed0 0x7fa0180c1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:18.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:18.138+0000 7fa0167fc700 1 -- 172.21.15.45:0/2722048872 >> v2:172.21.15.113:3300/0 conn(0x7fa0180bf910 msgr2=0x7fa0180bfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:00:18.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:18.138+0000 7fa0167fc700 1 --2- 172.21.15.45:0/2722048872 >> v2:172.21.15.113:3300/0 conn(0x7fa0180bf910 0x7fa0180bfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:18.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:18.138+0000 7fa0167fc700 1 -- 172.21.15.45:0/2722048872 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0180c0640 con 0x7fa0180c5960 2023-12-22T10:00:18.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:18.138+0000 7fa0167fc700 1 -- 172.21.15.45:0/2722048872 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2619163070 0 0) 0x7fa0100017f0 con 0x7fa0180c5960 2023-12-22T10:00:18.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:18.138+0000 7fa0177fe700 1 --2- 172.21.15.45:0/2722048872 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fa0180a9ed0 0x7fa0180c1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T10:00:18.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:18.138+0000 7fa0167fc700 1 -- 172.21.15.45:0/2722048872 >> v1:172.21.15.45:6789/0 conn(0x7fa0180c5960 legacy=0x7fa0180c5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:18.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:18.138+0000 7fa0167fc700 1 --2- 172.21.15.45:0/2722048872 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fa0180a9ed0 0x7fa0000038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:18.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:18.138+0000 7fa0167fc700 1 --2- 172.21.15.45:0/2722048872 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa000003dd0 0x7fa000004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:18.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:18.138+0000 7fa0167fc700 1 --2- 172.21.15.45:0/2722048872 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa000004b80 0x7fa000005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:18.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:18.138+0000 7fa0167fc700 1 -- 172.21.15.45:0/2722048872 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0180aa2b0 con 0x7fa000003dd0 2023-12-22T10:00:18.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:18.138+0000 7fa0167fc700 1 -- 172.21.15.45:0/2722048872 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0180c0360 con 0x7fa000004b80 2023-12-22T10:00:18.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:18.138+0000 7fa0167fc700 1 -- 172.21.15.45:0/2722048872 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa00000b8e0 con 0x7fa0180a9ed0 2023-12-22T10:00:18.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:18.138+0000 7fa016ffd700 1 --2- 172.21.15.45:0/2722048872 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa000003dd0 0x7fa000004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:18.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:18.138+0000 7fa017fff700 1 --2- 172.21.15.45:0/2722048872 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa000004b80 0x7fa000005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:18.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:18.138+0000 7fa0177fe700 1 --2- 172.21.15.45:0/2722048872 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fa0180a9ed0 0x7fa0000038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:18.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:18.138+0000 7fa016ffd700 1 -- 172.21.15.45:0/2722048872 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fa0180a9ed0 msgr2=0x7fa0000038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:00:18.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:18.138+0000 7fa016ffd700 1 --2- 172.21.15.45:0/2722048872 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fa0180a9ed0 0x7fa0000038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:18.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:18.138+0000 7fa016ffd700 1 -- 172.21.15.45:0/2722048872 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa000004b80 msgr2=0x7fa000005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:00:18.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:18.138+0000 7fa016ffd700 1 --2- 172.21.15.45:0/2722048872 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa000004b80 0x7fa000005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:18.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:18.138+0000 7fa016ffd700 1 -- 172.21.15.45:0/2722048872 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0000033f0 con 0x7fa000003dd0 2023-12-22T10:00:18.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:18.138+0000 7fa016ffd700 1 --2- 172.21.15.45:0/2722048872 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa000003dd0 0x7fa000004690 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fa00c009a80 tx=0x7fa00c009060).ready entity=mon.0 client_cookie=92233e83472fbdf5 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:18.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:18.138+0000 7fa0167fc700 1 -- 172.21.15.45:0/2722048872 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa00c009430 con 0x7fa000003dd0 2023-12-22T10:00:18.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:18.138+0000 7fa0167fc700 1 -- 172.21.15.45:0/2722048872 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa00c00e640 con 0x7fa000003dd0 2023-12-22T10:00:18.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:18.138+0000 7fa0167fc700 1 -- 172.21.15.45:0/2722048872 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa00c00e9c0 con 0x7fa000003dd0 2023-12-22T10:00:18.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:18.138+0000 7fa01cff9700 1 -- 172.21.15.45:0/2722048872 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa000003dd0 msgr2=0x7fa000004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:18.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:18.138+0000 7fa01cff9700 1 --2- 172.21.15.45:0/2722048872 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa000003dd0 0x7fa000004690 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fa00c009a80 tx=0x7fa00c009060).stop 2023-12-22T10:00:18.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:18.138+0000 7fa017fff700 1 -- 172.21.15.45:0/2722048872 reap_dead start 2023-12-22T10:00:18.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:18.138+0000 7fa01cff9700 1 -- 172.21.15.45:0/2722048872 shutdown_connections 2023-12-22T10:00:18.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:18.138+0000 7fa01cff9700 1 -- 172.21.15.45:0/2722048872 >> 172.21.15.45:0/2722048872 conn(0x7fa018067500 msgr2=0x7fa0180ca9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:18.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:18.138+0000 7fa01cff9700 1 -- 172.21.15.45:0/2722048872 shutdown_connections 2023-12-22T10:00:18.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:18.138+0000 7fa01cff9700 1 -- 172.21.15.45:0/2722048872 wait complete. 2023-12-22T10:00:18.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:18.142+0000 7fa01cff9700 1 Processor -- start 2023-12-22T10:00:18.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:18.142+0000 7fa01cff9700 1 -- start start 2023-12-22T10:00:18.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:18.146+0000 7fa01cff9700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa000003dd0 0x7fa018154b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:18.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:18.146+0000 7fa01cff9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0180c8ed0 0x7fa0181526b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:18.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:18.146+0000 7fa01cff9700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fa018156fd0 0x7fa018157450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:18.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:18.146+0000 7fa01cff9700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0180a18c0 con 0x7fa0180c8ed0 2023-12-22T10:00:18.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:18.146+0000 7fa01cff9700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa018157940 con 0x7fa000003dd0 2023-12-22T10:00:18.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:18.146+0000 7fa01cff9700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0180c9740 con 0x7fa018156fd0 2023-12-22T10:00:18.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:18.146+0000 7fa016ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0180c8ed0 0x7fa0181526b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:18.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:18.146+0000 7fa016ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0180c8ed0 0x7fa0181526b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36200/0 (socket says 172.21.15.45:36200) 2023-12-22T10:00:18.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:18.146+0000 7fa016ffd700 1 -- 172.21.15.45:0/3487743078 learned_addr learned my addr 172.21.15.45:0/3487743078 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:18.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:18.146+0000 7fa0177fe700 1 --2- 172.21.15.45:0/3487743078 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa000003dd0 0x7fa018154b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:18.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:18.146+0000 7fa017fff700 1 --2- 172.21.15.45:0/3487743078 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fa018156fd0 0x7fa018157450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:18.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:18.146+0000 7fa016ffd700 1 -- 172.21.15.45:0/3487743078 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fa018156fd0 msgr2=0x7fa018157450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:18.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:18.146+0000 7fa016ffd700 1 --2- 172.21.15.45:0/3487743078 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fa018156fd0 0x7fa018157450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:18.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:18.146+0000 7fa016ffd700 1 -- 172.21.15.45:0/3487743078 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa000003dd0 msgr2=0x7fa018154b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:18.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:18.146+0000 7fa016ffd700 1 --2- 172.21.15.45:0/3487743078 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa000003dd0 0x7fa018154b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:18.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:18.146+0000 7fa016ffd700 1 -- 172.21.15.45:0/3487743078 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0180c9a20 con 0x7fa0180c8ed0 2023-12-22T10:00:18.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:18.146+0000 7fa0177fe700 1 --2- 172.21.15.45:0/3487743078 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa000003dd0 0x7fa018154b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T10:00:18.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:18.146+0000 7fa017fff700 1 --2- 172.21.15.45:0/3487743078 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fa018156fd0 0x7fa018157450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-12-22T10:00:18.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:18.146+0000 7fa016ffd700 1 --2- 172.21.15.45:0/3487743078 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0180c8ed0 0x7fa0181526b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fa00c006d50 tx=0x7fa00c01a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:18.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:18.146+0000 7f9fff7fe700 1 -- 172.21.15.45:0/3487743078 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa00c00ed30 con 0x7fa0180c8ed0 2023-12-22T10:00:18.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:18.146+0000 7f9fff7fe700 1 -- 172.21.15.45:0/3487743078 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa00c00eeb0 con 0x7fa0180c8ed0 2023-12-22T10:00:18.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:18.146+0000 7f9fff7fe700 1 -- 172.21.15.45:0/3487743078 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa00c026440 con 0x7fa0180c8ed0 2023-12-22T10:00:18.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:18.146+0000 7fa01cff9700 1 -- 172.21.15.45:0/3487743078 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0180c9d00 con 0x7fa0180c8ed0 2023-12-22T10:00:18.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:18.146+0000 7fa01cff9700 1 -- 172.21.15.45:0/3487743078 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0180c9350 con 0x7fa0180c8ed0 2023-12-22T10:00:18.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:18.146+0000 7f9fff7fe700 1 -- 172.21.15.45:0/3487743078 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7fa00c026a90 con 0x7fa0180c8ed0 2023-12-22T10:00:18.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:18.146+0000 7f9fff7fe700 1 -- 172.21.15.45:0/3487743078 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1674+0+0 (secure 0 0 0) 0x7fa00c026d40 con 0x7fa0180c8ed0 2023-12-22T10:00:18.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:18.150+0000 7fa01cff9700 1 -- 172.21.15.45:0/3487743078 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa018047060 con 0x7fa0180c8ed0 2023-12-22T10:00:18.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:18.154+0000 7f9fff7fe700 1 -- 172.21.15.45:0/3487743078 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7fa00c046e50 con 0x7fa0180c8ed0 2023-12-22T10:00:18.161 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-12-22T10:00:18.166+0000 7fba07145500 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-22T10:00:18.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:18.218+0000 7fa01cff9700 1 -- 172.21.15.45:0/3487743078 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa0180c0920 con 0x7fa0180c8ed0 2023-12-22T10:00:18.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:18.222+0000 7f9fff7fe700 1 -- 172.21.15.45:0/3487743078 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7045 (secure 0 0 0) 0x7fa00c035070 con 0x7fa0180c8ed0 2023-12-22T10:00:18.217 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:00:18.218 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":10,"fsid":"98b0837e-5e68-4c8f-a1a0-e9424baaad8f","created":"2023-12-22T10:00:15.010174+0000","modified":"2023-12-22T10:00:17.887172+0000","last_up_change":"0.000000","last_in_change":"2023-12-22T10:00:17.887172+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[],"osds":[{"osd":0,"uuid":"e19943a0-1c6b-47df-b6bb-383472077890","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"69670f34-f082-45a7-8f67-e962acc136e6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d909d49b-82b8-401b-9947-e49dd167bb95","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"db104ca9-3a94-4d39-a2be-bd06db888095","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"9f4eaff4-e433-4479-a0d1-ee7a33375ca6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"1efc5591-180b-43af-8611-0068aadc5aa1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"6c89d9d8-c153-4a48-afa9-97e4c403f1ee","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"1855e70c-23f6-4c08-ad7f-774c2148235b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T10:00:18.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:18.222+0000 7fa01cff9700 1 -- 172.21.15.45:0/3487743078 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0180c8ed0 msgr2=0x7fa0181526b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:18.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:18.222+0000 7fa01cff9700 1 --2- 172.21.15.45:0/3487743078 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0180c8ed0 0x7fa0181526b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fa00c006d50 tx=0x7fa00c01a000).stop 2023-12-22T10:00:18.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:18.222+0000 7fa01cff9700 1 -- 172.21.15.45:0/3487743078 shutdown_connections 2023-12-22T10:00:18.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:18.222+0000 7fa01cff9700 1 --2- 172.21.15.45:0/3487743078 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fa018156fd0 0x7fa018157450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:18.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:18.222+0000 7fa01cff9700 1 --2- 172.21.15.45:0/3487743078 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0180c8ed0 0x7fa0181526b0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:18.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:18.222+0000 7fa01cff9700 1 --2- 172.21.15.45:0/3487743078 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa000003dd0 0x7fa018154b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:18.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:18.222+0000 7fa01cff9700 1 -- 172.21.15.45:0/3487743078 >> 172.21.15.45:0/3487743078 conn(0x7fa018067500 msgr2=0x7fa0180b0070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:18.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:18.222+0000 7fa01cff9700 1 -- 172.21.15.45:0/3487743078 shutdown_connections 2023-12-22T10:00:18.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:18.222+0000 7fa01cff9700 1 -- 172.21.15.45:0/3487743078 wait complete. 2023-12-22T10:00:18.238 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-12-22T10:00:18.238 INFO:tasks.ceph:Waiting for OSDs to come up 2023-12-22T10:00:18.324 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-12-22T10:00:18.326+0000 7fba07145500 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-22T10:00:18.340 INFO:tasks.ceph.mgr.x.smithi113.stderr:2023-12-22T10:00:18.339+0000 7f34c0937500 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-22T10:00:18.514 INFO:tasks.ceph.mgr.x.smithi113.stderr:2023-12-22T10:00:18.515+0000 7f34c0937500 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-22T10:00:18.563 INFO:tasks.ceph.osd.2.smithi045.stderr:2023-12-22T10:00:18.566+0000 7f3463edc200 -1 Falling back to public interface 2023-12-22T10:00:18.582 INFO:tasks.ceph.osd.1.smithi045.stderr:2023-12-22T10:00:18.586+0000 7fa6a014f200 -1 Falling back to public interface 2023-12-22T10:00:18.591 INFO:tasks.ceph.osd.3.smithi045.stderr:2023-12-22T10:00:18.594+0000 7f31612f2200 -1 Falling back to public interface 2023-12-22T10:00:18.594 INFO:tasks.ceph.osd.0.smithi045.stderr:2023-12-22T10:00:18.598+0000 7f3477edb200 -1 Falling back to public interface 2023-12-22T10:00:18.622 INFO:tasks.ceph.osd.5.smithi113.stderr:2023-12-22T10:00:18.623+0000 7fd3aaf1b200 -1 Falling back to public interface 2023-12-22T10:00:18.634 INFO:tasks.ceph.osd.6.smithi113.stderr:2023-12-22T10:00:18.635+0000 7fd9434f1200 -1 Falling back to public interface 2023-12-22T10:00:18.634 INFO:tasks.ceph.osd.4.smithi113.stderr:2023-12-22T10:00:18.635+0000 7f74f26e5200 -1 Falling back to public interface 2023-12-22T10:00:18.641 INFO:tasks.ceph.osd.7.smithi113.stderr:2023-12-22T10:00:18.643+0000 7f762b31a200 -1 Falling back to public interface 2023-12-22T10:00:18.648 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-12-22T10:00:18.650+0000 7fba07145500 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-22T10:00:18.751 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-12-22T10:00:18.754+0000 7fba07145500 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-22T10:00:18.836 INFO:tasks.ceph.mgr.x.smithi113.stderr:2023-12-22T10:00:18.839+0000 7f34c0937500 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-22T10:00:18.925 INFO:tasks.ceph.mgr.x.smithi113.stderr:2023-12-22T10:00:18.927+0000 7f34c0937500 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-22T10:00:19.043 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-22T10:00:19.050 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-12-22T10:00:19.050+0000 7fba07145500 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-22T10:00:19.136 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-12-22T10:00:19.138+0000 7fba07145500 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-22T10:00:19.176 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:19.178+0000 7f9a2641b700 1 Processor -- start 2023-12-22T10:00:19.177 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:19.178+0000 7f9a2641b700 1 -- start start 2023-12-22T10:00:19.179 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:19.182+0000 7f9a2641b700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f9a2005de10 0x7f9a20154d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:19.179 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:19.182+0000 7f9a2641b700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a200c7120 con 0x7f9a2014dc50 2023-12-22T10:00:19.179 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:19.182+0000 7f9a2641b700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a20062b10 con 0x7f9a2005e1f0 2023-12-22T10:00:19.179 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:19.182+0000 7f9a2641b700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a20066210 con 0x7f9a2005de10 2023-12-22T10:00:19.180 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:19.182+0000 7f9a249b8700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f9a2014dc50 0x7f9a2014e100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33544/0 (socket says 172.21.15.45:33544) 2023-12-22T10:00:19.180 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:19.182+0000 7f9a249b8700 1 -- 172.21.15.45:0/2415918570 learned_addr learned my addr 172.21.15.45:0/2415918570 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:00:19.180 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:19.182+0000 7f9a1ffff700 1 --2- 172.21.15.45:0/2415918570 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f9a2005de10 0x7f9a20154d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:19.182 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:19.182+0000 7f9a1effd700 1 -- 172.21.15.45:0/2415918570 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3869615606 0 0) 0x7f9a200c7120 con 0x7f9a2014dc50 2023-12-22T10:00:19.182 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:19.182+0000 7f9a1effd700 1 -- 172.21.15.45:0/2415918570 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a080033f0 con 0x7f9a2014dc50 2023-12-22T10:00:19.182 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:19.182+0000 7f9a1effd700 1 -- 172.21.15.45:0/2415918570 <== mon.1 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1339365051 0 0) 0x7f9a20062b10 con 0x7f9a2005e1f0 2023-12-22T10:00:19.182 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:19.182+0000 7f9a1effd700 1 -- 172.21.15.45:0/2415918570 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a200c7120 con 0x7f9a2005e1f0 2023-12-22T10:00:19.182 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:19.182+0000 7f9a1effd700 1 -- 172.21.15.45:0/2415918570 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1089479603 0 0) 0x7f9a080033f0 con 0x7f9a2014dc50 2023-12-22T10:00:19.182 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:19.182+0000 7f9a1effd700 1 -- 172.21.15.45:0/2415918570 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f9a2005de10 msgr2=0x7f9a20154d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:00:19.182 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:19.182+0000 7f9a1effd700 1 --2- 172.21.15.45:0/2415918570 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f9a2005de10 0x7f9a20154d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:19.182 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:19.182+0000 7f9a1effd700 1 -- 172.21.15.45:0/2415918570 >> v1:172.21.15.113:6789/0 conn(0x7f9a2005e1f0 legacy=0x7f9a200656a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:19.182 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:19.182+0000 7f9a1effd700 1 -- 172.21.15.45:0/2415918570 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a200664f0 con 0x7f9a2014dc50 2023-12-22T10:00:19.182 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:19.182+0000 7f9a1effd700 1 -- 172.21.15.45:0/2415918570 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2619163070 0 0) 0x7f9a180017f0 con 0x7f9a2014dc50 2023-12-22T10:00:19.182 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:19.186+0000 7f9a1effd700 1 -- 172.21.15.45:0/2415918570 >> v1:172.21.15.45:6789/0 conn(0x7f9a2014dc50 legacy=0x7f9a2014e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:19.182 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:19.186+0000 7f9a1effd700 1 --2- 172.21.15.45:0/2415918570 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9a08003aa0 0x7f9a08003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:19.183 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:19.186+0000 7f9a1effd700 1 --2- 172.21.15.45:0/2415918570 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f9a2005de10 0x7f9a08004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:19.183 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:19.186+0000 7f9a1effd700 1 --2- 172.21.15.45:0/2415918570 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9a08004b80 0x7f9a08005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:19.183 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:19.186+0000 7f9a1effd700 1 -- 172.21.15.45:0/2415918570 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a20066210 con 0x7f9a08003aa0 2023-12-22T10:00:19.183 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:19.186+0000 7f9a1effd700 1 -- 172.21.15.45:0/2415918570 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0800b910 con 0x7f9a08004b80 2023-12-22T10:00:19.183 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:19.186+0000 7f9a1effd700 1 -- 172.21.15.45:0/2415918570 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0800bad0 con 0x7f9a2005de10 2023-12-22T10:00:19.183 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:19.186+0000 7f9a1ffff700 1 --2- 172.21.15.45:0/2415918570 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9a08003aa0 0x7f9a08003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:19.183 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:19.186+0000 7f9a1f7fe700 1 --2- 172.21.15.45:0/2415918570 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f9a2005de10 0x7f9a08004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:19.183 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:19.186+0000 7f9a249b8700 1 --2- 172.21.15.45:0/2415918570 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9a08004b80 0x7f9a08005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:19.184 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:19.186+0000 7f9a1f7fe700 1 -- 172.21.15.45:0/2415918570 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9a08004b80 msgr2=0x7f9a08005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:00:19.184 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:19.186+0000 7f9a1f7fe700 1 --2- 172.21.15.45:0/2415918570 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9a08004b80 0x7f9a08005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:19.185 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:19.186+0000 7f9a1f7fe700 1 -- 172.21.15.45:0/2415918570 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9a08003aa0 msgr2=0x7f9a08003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:00:19.185 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:19.186+0000 7f9a1f7fe700 1 --2- 172.21.15.45:0/2415918570 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9a08003aa0 0x7f9a08003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:19.185 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:19.186+0000 7f9a1f7fe700 1 -- 172.21.15.45:0/2415918570 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a080033f0 con 0x7f9a2005de10 2023-12-22T10:00:19.185 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:19.186+0000 7f9a1f7fe700 1 --2- 172.21.15.45:0/2415918570 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f9a2005de10 0x7f9a08004690 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f9a14001860 tx=0x7f9a14007bb0).ready entity=mon.2 client_cookie=391556d76b9c1ea5 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:19.185 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:19.186+0000 7f9a1effd700 1 -- 172.21.15.45:0/2415918570 <== mon.2 v2:172.21.15.113:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a14007020 con 0x7f9a2005de10 2023-12-22T10:00:19.185 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:19.186+0000 7f9a1effd700 1 -- 172.21.15.45:0/2415918570 <== mon.2 v2:172.21.15.113:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a14007180 con 0x7f9a2005de10 2023-12-22T10:00:19.185 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:19.186+0000 7f9a1effd700 1 -- 172.21.15.45:0/2415918570 <== mon.2 v2:172.21.15.113:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a14007500 con 0x7f9a2005de10 2023-12-22T10:00:19.185 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:19.186+0000 7f9a2641b700 1 -- 172.21.15.45:0/2415918570 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f9a2005de10 msgr2=0x7f9a08004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:19.185 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:19.186+0000 7f9a2641b700 1 --2- 172.21.15.45:0/2415918570 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f9a2005de10 0x7f9a08004690 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f9a14001860 tx=0x7f9a14007bb0).stop 2023-12-22T10:00:19.185 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:19.186+0000 7f9a249b8700 1 -- 172.21.15.45:0/2415918570 reap_dead start 2023-12-22T10:00:19.185 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:19.186+0000 7f9a2641b700 1 -- 172.21.15.45:0/2415918570 shutdown_connections 2023-12-22T10:00:19.186 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:19.186+0000 7f9a2641b700 1 -- 172.21.15.45:0/2415918570 >> 172.21.15.45:0/2415918570 conn(0x7f9a20063850 msgr2=0x7f9a20063c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:19.186 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:19.186+0000 7f9a2641b700 1 -- 172.21.15.45:0/2415918570 shutdown_connections 2023-12-22T10:00:19.186 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:19.186+0000 7f9a2641b700 1 -- 172.21.15.45:0/2415918570 wait complete. 2023-12-22T10:00:19.187 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:19.190+0000 7f9a2641b700 1 Processor -- start 2023-12-22T10:00:19.188 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:19.190+0000 7f9a2641b700 1 -- start start 2023-12-22T10:00:19.190 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:19.194+0000 7f9a2641b700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f9a2005de10 0x7f9a2013c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:19.190 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:19.194+0000 7f9a2641b700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9a200ae8e0 0x7f9a200ada00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:19.190 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:19.194+0000 7f9a2641b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9a200aed60 0x7f9a200adef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:19.190 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:19.194+0000 7f9a2641b700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a200ae3e0 con 0x7f9a200aed60 2023-12-22T10:00:19.190 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:19.194+0000 7f9a2641b700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a20164a70 con 0x7f9a200ae8e0 2023-12-22T10:00:19.190 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:19.194+0000 7f9a2641b700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a20164160 con 0x7f9a2005de10 2023-12-22T10:00:19.191 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:19.194+0000 7f9a249b8700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9a200aed60 0x7f9a200adef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:19.191 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:19.194+0000 7f9a249b8700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9a200aed60 0x7f9a200adef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36210/0 (socket says 172.21.15.45:36210) 2023-12-22T10:00:19.191 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:19.194+0000 7f9a249b8700 1 -- 172.21.15.45:0/413555285 learned_addr learned my addr 172.21.15.45:0/413555285 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:19.191 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:19.194+0000 7f9a1ffff700 1 --2- 172.21.15.45:0/413555285 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f9a2005de10 0x7f9a2013c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:19.191 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:19.194+0000 7f9a1f7fe700 1 --2- 172.21.15.45:0/413555285 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9a200ae8e0 0x7f9a200ada00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:19.191 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:19.194+0000 7f9a249b8700 1 -- 172.21.15.45:0/413555285 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f9a2005de10 msgr2=0x7f9a2013c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:19.191 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:19.194+0000 7f9a249b8700 1 --2- 172.21.15.45:0/413555285 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f9a2005de10 0x7f9a2013c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:19.191 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:19.194+0000 7f9a249b8700 1 -- 172.21.15.45:0/413555285 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9a200ae8e0 msgr2=0x7f9a200ada00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:19.191 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:19.194+0000 7f9a249b8700 1 --2- 172.21.15.45:0/413555285 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9a200ae8e0 0x7f9a200ada00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:19.192 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:19.194+0000 7f9a249b8700 1 -- 172.21.15.45:0/413555285 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a200af2c0 con 0x7f9a200aed60 2023-12-22T10:00:19.192 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:19.194+0000 7f9a249b8700 1 --2- 172.21.15.45:0/413555285 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9a200aed60 0x7f9a200adef0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f9a2014e030 tx=0x7f9a18007f20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:19.193 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:19.194+0000 7f9a07fff700 1 -- 172.21.15.45:0/413555285 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a1800f8a0 con 0x7f9a200aed60 2023-12-22T10:00:19.193 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:19.194+0000 7f9a07fff700 1 -- 172.21.15.45:0/413555285 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a1800fa00 con 0x7f9a200aed60 2023-12-22T10:00:19.193 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:19.194+0000 7f9a2641b700 1 -- 172.21.15.45:0/413555285 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a20164420 con 0x7f9a200aed60 2023-12-22T10:00:19.193 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:19.194+0000 7f9a07fff700 1 -- 172.21.15.45:0/413555285 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a1800fda0 con 0x7f9a200aed60 2023-12-22T10:00:19.193 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:19.194+0000 7f9a2641b700 1 -- 172.21.15.45:0/413555285 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a2013c8b0 con 0x7f9a200aed60 2023-12-22T10:00:19.193 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:19.194+0000 7f9a07fff700 1 -- 172.21.15.45:0/413555285 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f9a180127c0 con 0x7f9a200aed60 2023-12-22T10:00:19.193 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:19.194+0000 7f9a07fff700 1 -- 172.21.15.45:0/413555285 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1674+0+0 (secure 0 0 0) 0x7f9a1801dab0 con 0x7f9a200aed60 2023-12-22T10:00:19.193 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:19.198+0000 7f9a2641b700 1 -- 172.21.15.45:0/413555285 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a20164be0 con 0x7f9a200aed60 2023-12-22T10:00:19.198 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:19.202+0000 7f9a07fff700 1 -- 172.21.15.45:0/413555285 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7f9a18019070 con 0x7f9a200aed60 2023-12-22T10:00:19.213 INFO:tasks.ceph.mgr.x.smithi113.stderr:2023-12-22T10:00:19.215+0000 7f34c0937500 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-22T10:00:19.264 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:19.266+0000 7f9a2641b700 1 -- 172.21.15.45:0/413555285 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9a20154220 con 0x7f9a200aed60 2023-12-22T10:00:19.265 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:19.270+0000 7f9a07fff700 1 -- 172.21.15.45:0/413555285 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7045 (secure 0 0 0) 0x7f9a1801dcf0 con 0x7f9a200aed60 2023-12-22T10:00:19.266 INFO:teuthology.misc.health.smithi045.stdout: 2023-12-22T10:00:19.266 INFO:teuthology.misc.health.smithi045.stdout:{"epoch":10,"fsid":"98b0837e-5e68-4c8f-a1a0-e9424baaad8f","created":"2023-12-22T10:00:15.010174+0000","modified":"2023-12-22T10:00:17.887172+0000","last_up_change":"0.000000","last_in_change":"2023-12-22T10:00:17.887172+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[],"osds":[{"osd":0,"uuid":"e19943a0-1c6b-47df-b6bb-383472077890","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"69670f34-f082-45a7-8f67-e962acc136e6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d909d49b-82b8-401b-9947-e49dd167bb95","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"db104ca9-3a94-4d39-a2be-bd06db888095","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"9f4eaff4-e433-4479-a0d1-ee7a33375ca6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"1efc5591-180b-43af-8611-0068aadc5aa1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"6c89d9d8-c153-4a48-afa9-97e4c403f1ee","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"1855e70c-23f6-4c08-ad7f-774c2148235b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T10:00:19.267 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:19.270+0000 7f9a2641b700 1 -- 172.21.15.45:0/413555285 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9a200aed60 msgr2=0x7f9a200adef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:19.267 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:19.270+0000 7f9a2641b700 1 --2- 172.21.15.45:0/413555285 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9a200aed60 0x7f9a200adef0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f9a2014e030 tx=0x7f9a18007f20).stop 2023-12-22T10:00:19.267 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:19.270+0000 7f9a2641b700 1 -- 172.21.15.45:0/413555285 shutdown_connections 2023-12-22T10:00:19.267 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:19.270+0000 7f9a2641b700 1 --2- 172.21.15.45:0/413555285 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9a200aed60 0x7f9a200adef0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:19.267 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:19.270+0000 7f9a2641b700 1 --2- 172.21.15.45:0/413555285 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9a200ae8e0 0x7f9a200ada00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:19.267 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:19.270+0000 7f9a2641b700 1 --2- 172.21.15.45:0/413555285 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f9a2005de10 0x7f9a2013c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:19.268 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:19.270+0000 7f9a2641b700 1 -- 172.21.15.45:0/413555285 >> 172.21.15.45:0/413555285 conn(0x7f9a20063850 msgr2=0x7f9a20155640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:19.268 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:19.270+0000 7f9a2641b700 1 -- 172.21.15.45:0/413555285 shutdown_connections 2023-12-22T10:00:19.268 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:19.270+0000 7f9a2641b700 1 -- 172.21.15.45:0/413555285 wait complete. 2023-12-22T10:00:19.287 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-12-22T10:00:19.296 INFO:tasks.ceph.mgr.x.smithi113.stderr:2023-12-22T10:00:19.299+0000 7f34c0937500 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-22T10:00:19.330 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-12-22T10:00:19.334+0000 7fba07145500 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-22T10:00:19.471 INFO:tasks.ceph.mgr.x.smithi113.stderr:2023-12-22T10:00:19.471+0000 7f34c0937500 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-22T10:00:19.474 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-12-22T10:00:19.478+0000 7fba07145500 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-22T10:00:19.590 INFO:tasks.ceph.mgr.x.smithi113.stderr:2023-12-22T10:00:19.591+0000 7f34c0937500 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-22T10:00:19.665 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-12-22T10:00:19.666+0000 7fba07145500 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-22T10:00:19.770 INFO:tasks.ceph.mgr.x.smithi113.stderr:2023-12-22T10:00:19.771+0000 7f34c0937500 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-22T10:00:19.921 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-12-22T10:00:19.922+0000 7fba07145500 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-22T10:00:20.010 INFO:tasks.ceph.mgr.x.smithi113.stderr:2023-12-22T10:00:20.011+0000 7f34c0937500 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-22T10:00:20.958 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-12-22T10:00:20.962+0000 7fb9e769a700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-12-22T10:00:20.959 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-12-22T10:00:20.962+0000 7fb9e769a700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-12-22T10:00:22.726 INFO:tasks.ceph.osd.2.smithi045.stderr:2023-12-22T10:00:22.730+0000 7f3463edc200 -1 osd.2 0 log_to_monitors {default=true} 2023-12-22T10:00:22.811 INFO:tasks.ceph.osd.7.smithi113.stderr:2023-12-22T10:00:22.811+0000 7f762b31a200 -1 osd.7 0 log_to_monitors {default=true} 2023-12-22T10:00:22.812 INFO:tasks.ceph.osd.0.smithi045.stderr:2023-12-22T10:00:22.814+0000 7f3477edb200 -1 osd.0 0 log_to_monitors {default=true} 2023-12-22T10:00:22.840 INFO:tasks.ceph.osd.1.smithi045.stderr:2023-12-22T10:00:22.842+0000 7fa6a014f200 -1 osd.1 0 log_to_monitors {default=true} 2023-12-22T10:00:22.860 INFO:tasks.ceph.osd.3.smithi045.stderr:2023-12-22T10:00:22.862+0000 7f31612f2200 -1 osd.3 0 log_to_monitors {default=true} 2023-12-22T10:00:22.899 INFO:tasks.ceph.osd.6.smithi113.stderr:2023-12-22T10:00:22.903+0000 7fd9434f1200 -1 osd.6 0 log_to_monitors {default=true} 2023-12-22T10:00:22.912 INFO:tasks.ceph.osd.5.smithi113.stderr:2023-12-22T10:00:22.915+0000 7fd3aaf1b200 -1 osd.5 0 log_to_monitors {default=true} 2023-12-22T10:00:22.932 INFO:tasks.ceph.osd.4.smithi113.stderr:2023-12-22T10:00:22.935+0000 7f74f26e5200 -1 osd.4 0 log_to_monitors {default=true} 2023-12-22T10:00:23.977 INFO:tasks.ceph.osd.5.smithi113.stderr:2023-12-22T10:00:23.979+0000 7fd3a5ec2700 -1 osd.5 0 waiting for initial osdmap 2023-12-22T10:00:23.977 INFO:tasks.ceph.osd.7.smithi113.stderr:2023-12-22T10:00:23.979+0000 7f76262b1700 -1 osd.7 0 waiting for initial osdmap 2023-12-22T10:00:23.979 INFO:tasks.ceph.osd.2.smithi045.stderr:2023-12-22T10:00:23.982+0000 7f345ecf8700 -1 osd.2 0 waiting for initial osdmap 2023-12-22T10:00:23.979 INFO:tasks.ceph.osd.4.smithi113.stderr:2023-12-22T10:00:23.979+0000 7f74ed685700 -1 osd.4 0 waiting for initial osdmap 2023-12-22T10:00:23.980 INFO:tasks.ceph.osd.0.smithi045.stderr:2023-12-22T10:00:23.982+0000 7f3472e82700 -1 osd.0 0 waiting for initial osdmap 2023-12-22T10:00:23.980 INFO:tasks.ceph.osd.6.smithi113.stderr:2023-12-22T10:00:23.983+0000 7fd93e47b700 -1 osd.6 0 waiting for initial osdmap 2023-12-22T10:00:23.980 INFO:tasks.ceph.osd.1.smithi045.stderr:2023-12-22T10:00:23.982+0000 7fa69b8ef700 -1 osd.1 0 waiting for initial osdmap 2023-12-22T10:00:23.981 INFO:tasks.ceph.osd.3.smithi045.stderr:2023-12-22T10:00:23.982+0000 7f315c1e0700 -1 osd.3 0 waiting for initial osdmap 2023-12-22T10:00:23.989 INFO:tasks.ceph.osd.4.smithi113.stderr:2023-12-22T10:00:23.991+0000 7f74ea3f9700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-22T10:00:23.990 INFO:tasks.ceph.osd.5.smithi113.stderr:2023-12-22T10:00:23.991+0000 7fd3a2c36700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-22T10:00:23.990 INFO:tasks.ceph.osd.6.smithi113.stderr:2023-12-22T10:00:23.991+0000 7fd93b1ef700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-22T10:00:23.991 INFO:tasks.ceph.osd.7.smithi113.stderr:2023-12-22T10:00:23.995+0000 7f7623025700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-22T10:00:23.992 INFO:tasks.ceph.osd.0.smithi045.stderr:2023-12-22T10:00:23.994+0000 7f346fbf6700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-22T10:00:23.992 INFO:tasks.ceph.osd.1.smithi045.stderr:2023-12-22T10:00:23.994+0000 7fa698663700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-22T10:00:23.992 INFO:tasks.ceph.osd.3.smithi045.stderr:2023-12-22T10:00:23.994+0000 7f3158f54700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-22T10:00:23.992 INFO:tasks.ceph.osd.2.smithi045.stderr:2023-12-22T10:00:23.994+0000 7f345ba6c700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-22T10:00:26.095 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-22T10:00:26.261 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:26.262+0000 7fdfcde1b700 1 Processor -- start 2023-12-22T10:00:26.262 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:26.262+0000 7fdfcde1b700 1 -- start start 2023-12-22T10:00:26.262 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:26.266+0000 7fdfcde1b700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fdfc8151980 0x7fdfc80a5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:26.262 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:26.266+0000 7fdfcde1b700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fdfc80ac060 0x7fdfc80a7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:26.262 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:26.266+0000 7fdfcde1b700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfc80c0f30 con 0x7fdfc80a62c0 2023-12-22T10:00:26.262 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:26.266+0000 7fdfcde1b700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfc80a7640 con 0x7fdfc8151980 2023-12-22T10:00:26.262 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:26.266+0000 7fdfcde1b700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc80a6a30 con 0x7fdfc80ac060 2023-12-22T10:00:26.265 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:26.266+0000 7fdfbeffd700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fdfc80a62c0 0x7fdfc80ab950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33552/0 (socket says 172.21.15.45:33552) 2023-12-22T10:00:26.265 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:26.266+0000 7fdfbeffd700 1 -- 172.21.15.45:0/3159724909 learned_addr learned my addr 172.21.15.45:0/3159724909 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:00:26.265 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:26.266+0000 7fdfc7fff700 1 --2- 172.21.15.45:0/3159724909 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fdfc80ac060 0x7fdfc80a7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:26.266 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:26.266+0000 7fdfc77fe700 1 --2- 172.21.15.45:0/3159724909 >> v2:172.21.15.113:3300/0 conn(0x7fdfc8151980 0x7fdfc80a5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:26.266 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:26.266+0000 7fdfc6ffd700 1 -- 172.21.15.45:0/3159724909 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 221372159 0 0) 0x7fdfc80c0f30 con 0x7fdfc80a62c0 2023-12-22T10:00:26.266 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:26.266+0000 7fdfc6ffd700 1 -- 172.21.15.45:0/3159724909 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdfb40033f0 con 0x7fdfc80a62c0 2023-12-22T10:00:26.266 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:26.266+0000 7fdfc77fe700 1 -- 172.21.15.45:0/3159724909 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fdfc80ac060 msgr2=0x7fdfc80a7ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:00:26.266 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:26.266+0000 7fdfc77fe700 1 --2- 172.21.15.45:0/3159724909 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fdfc80ac060 0x7fdfc80a7ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:26.266 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:26.266+0000 7fdfc77fe700 1 -- 172.21.15.45:0/3159724909 >> v1:172.21.15.45:6789/0 conn(0x7fdfc80a62c0 legacy=0x7fdfc80ab950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:26.266 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:26.266+0000 7fdfc77fe700 1 -- 172.21.15.45:0/3159724909 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfc80a6d10 con 0x7fdfc8151980 2023-12-22T10:00:26.267 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:26.266+0000 7fdfc7fff700 1 --2- 172.21.15.45:0/3159724909 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fdfc80ac060 0x7fdfc80a7ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-12-22T10:00:26.267 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:26.266+0000 7fdfc77fe700 1 --2- 172.21.15.45:0/3159724909 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdfc8151980 0x7fdfc80a5ba0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fdfb8009760 tx=0x7fdfb8009060).ready entity=mon.1 client_cookie=dcc5d4130cb87970 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:26.267 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:26.266+0000 7fdfc6ffd700 1 -- 172.21.15.45:0/3159724909 <== mon.1 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb800d4a0 con 0x7fdfc8151980 2023-12-22T10:00:26.267 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:26.266+0000 7fdfc6ffd700 1 -- 172.21.15.45:0/3159724909 <== mon.1 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfb800d600 con 0x7fdfc8151980 2023-12-22T10:00:26.267 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:26.266+0000 7fdfc6ffd700 1 -- 172.21.15.45:0/3159724909 <== mon.1 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb800d980 con 0x7fdfc8151980 2023-12-22T10:00:26.267 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:26.270+0000 7fdfcde1b700 1 -- 172.21.15.45:0/3159724909 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdfc8151980 msgr2=0x7fdfc80a5ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:26.267 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:26.270+0000 7fdfcde1b700 1 --2- 172.21.15.45:0/3159724909 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdfc8151980 0x7fdfc80a5ba0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fdfb8009760 tx=0x7fdfb8009060).stop 2023-12-22T10:00:26.268 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:26.270+0000 7fdfcde1b700 1 -- 172.21.15.45:0/3159724909 shutdown_connections 2023-12-22T10:00:26.268 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:26.270+0000 7fdfcde1b700 1 --2- 172.21.15.45:0/3159724909 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fdfc80ac060 0x7fdfc80a7ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:26.268 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:26.270+0000 7fdfcde1b700 1 --2- 172.21.15.45:0/3159724909 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdfc8151980 0x7fdfc80a5ba0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:26.268 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:26.270+0000 7fdfcde1b700 1 -- 172.21.15.45:0/3159724909 >> 172.21.15.45:0/3159724909 conn(0x7fdfc80679b0 msgr2=0x7fdfc8067dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:26.268 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:26.270+0000 7fdfcde1b700 1 -- 172.21.15.45:0/3159724909 shutdown_connections 2023-12-22T10:00:26.268 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:26.270+0000 7fdfcde1b700 1 -- 172.21.15.45:0/3159724909 wait complete. 2023-12-22T10:00:26.268 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:26.270+0000 7fdfcde1b700 1 Processor -- start 2023-12-22T10:00:26.269 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:26.270+0000 7fdfcde1b700 1 -- start start 2023-12-22T10:00:26.270 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:26.274+0000 7fdfcde1b700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fdfc80a62c0 0x7fdfc814ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:26.270 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:26.274+0000 7fdfcde1b700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdfc80ac060 0x7fdfc8153330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:26.270 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:26.274+0000 7fdfcde1b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfc8151980 0x7fdfc814f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:26.270 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:26.274+0000 7fdfcde1b700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc814f0d0 con 0x7fdfc8151980 2023-12-22T10:00:26.270 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:26.274+0000 7fdfcde1b700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc8167480 con 0x7fdfc80ac060 2023-12-22T10:00:26.270 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:26.274+0000 7fdfcde1b700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc8153d80 con 0x7fdfc80a62c0 2023-12-22T10:00:26.271 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:26.274+0000 7fdfc7fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfc8151980 0x7fdfc814f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:26.272 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:26.274+0000 7fdfc7fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfc8151980 0x7fdfc814f7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36316/0 (socket says 172.21.15.45:36316) 2023-12-22T10:00:26.272 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:26.274+0000 7fdfc7fff700 1 -- 172.21.15.45:0/2865049277 learned_addr learned my addr 172.21.15.45:0/2865049277 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:26.272 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:26.274+0000 7fdfc77fe700 1 --2- 172.21.15.45:0/2865049277 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fdfc80a62c0 0x7fdfc814ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:26.272 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:26.274+0000 7fdfbeffd700 1 --2- 172.21.15.45:0/2865049277 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdfc80ac060 0x7fdfc8153330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:26.272 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:26.274+0000 7fdfc7fff700 1 -- 172.21.15.45:0/2865049277 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fdfc80a62c0 msgr2=0x7fdfc814ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:26.272 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:26.274+0000 7fdfc7fff700 1 --2- 172.21.15.45:0/2865049277 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fdfc80a62c0 0x7fdfc814ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:26.272 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:26.274+0000 7fdfc7fff700 1 -- 172.21.15.45:0/2865049277 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdfc80ac060 msgr2=0x7fdfc8153330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:26.272 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:26.274+0000 7fdfc7fff700 1 --2- 172.21.15.45:0/2865049277 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdfc80ac060 0x7fdfc8153330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:26.272 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:26.274+0000 7fdfc7fff700 1 -- 172.21.15.45:0/2865049277 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfc00092a0 con 0x7fdfc8151980 2023-12-22T10:00:26.272 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:26.274+0000 7fdfc77fe700 1 --2- 172.21.15.45:0/2865049277 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fdfc80a62c0 0x7fdfc814ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T10:00:26.273 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:26.274+0000 7fdfc7fff700 1 --2- 172.21.15.45:0/2865049277 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfc8151980 0x7fdfc814f7e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fdfc000e980 tx=0x7fdfc0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:26.273 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:26.274+0000 7fdfbffff700 1 -- 172.21.15.45:0/2865049277 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc000c850 con 0x7fdfc8151980 2023-12-22T10:00:26.273 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:26.274+0000 7fdfbffff700 1 -- 172.21.15.45:0/2865049277 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfc000c9b0 con 0x7fdfc8151980 2023-12-22T10:00:26.273 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:26.274+0000 7fdfcde1b700 1 -- 172.21.15.45:0/2865049277 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfb80092a0 con 0x7fdfc8151980 2023-12-22T10:00:26.273 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:26.274+0000 7fdfbffff700 1 -- 172.21.15.45:0/2865049277 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc000cd50 con 0x7fdfc8151980 2023-12-22T10:00:26.274 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:26.274+0000 7fdfcde1b700 1 -- 172.21.15.45:0/2865049277 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfc8167a00 con 0x7fdfc8151980 2023-12-22T10:00:26.274 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:26.278+0000 7fdfcde1b700 1 -- 172.21.15.45:0/2865049277 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfc806bb80 con 0x7fdfc8151980 2023-12-22T10:00:26.275 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:26.278+0000 7fdfbffff700 1 -- 172.21.15.45:0/2865049277 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fdfc0012600 con 0x7fdfc8151980 2023-12-22T10:00:26.276 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:26.278+0000 7fdfbffff700 1 --2- 172.21.15.45:0/2865049277 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fdfa805a540 0x7fdfa805ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:26.276 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:26.278+0000 7fdfbffff700 1 -- 172.21.15.45:0/2865049277 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4892+0+0 (secure 0 0 0) 0x7fdfc0074890 con 0x7fdfc8151980 2023-12-22T10:00:26.276 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:26.278+0000 7fdfc77fe700 1 --2- 172.21.15.45:0/2865049277 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fdfa805a540 0x7fdfa805ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:26.277 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:26.282+0000 7fdfc77fe700 1 --2- 172.21.15.45:0/2865049277 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fdfa805a540 0x7fdfa805ca00 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fdfb800d260 tx=0x7fdfb8016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:26.282 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:26.286+0000 7fdfbffff700 1 -- 172.21.15.45:0/2865049277 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fdfc0048540 con 0x7fdfc8151980 2023-12-22T10:00:26.453 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:26.458+0000 7fdfcde1b700 1 -- 172.21.15.45:0/2865049277 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdfc80a6ff0 con 0x7fdfc8151980 2023-12-22T10:00:26.455 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:26.458+0000 7fdfbffff700 1 -- 172.21.15.45:0/2865049277 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+12180 (secure 0 0 0) 0x7fdfc0016020 con 0x7fdfc8151980 2023-12-22T10:00:26.455 INFO:teuthology.misc.health.smithi045.stdout: 2023-12-22T10:00:26.456 INFO:teuthology.misc.health.smithi045.stdout:{"epoch":14,"fsid":"98b0837e-5e68-4c8f-a1a0-e9424baaad8f","created":"2023-12-22T10:00:15.010174+0000","modified":"2023-12-22T10:00:25.998963+0000","last_up_change":"2023-12-22T10:00:24.980513+0000","last_in_change":"2023-12-22T10:00:17.887172+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-12-22T10:00:25.069641+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{}}],"osds":[{"osd":0,"uuid":"e19943a0-1c6b-47df-b6bb-383472077890","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":33777},{"type":"v1","addr":"172.21.15.45:6819","nonce":33777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":33777},{"type":"v1","addr":"172.21.15.45:6822","nonce":33777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":33777},{"type":"v1","addr":"172.21.15.45:6830","nonce":33777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":33777},{"type":"v1","addr":"172.21.15.45:6826","nonce":33777}]},"public_addr":"172.21.15.45:6819/33777","cluster_addr":"172.21.15.45:6822/33777","heartbeat_back_addr":"172.21.15.45:6830/33777","heartbeat_front_addr":"172.21.15.45:6826/33777","state":["exists","up"]},{"osd":1,"uuid":"69670f34-f082-45a7-8f67-e962acc136e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":33775},{"type":"v1","addr":"172.21.15.45:6809","nonce":33775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":33775},{"type":"v1","addr":"172.21.15.45:6811","nonce":33775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":33775},{"type":"v1","addr":"172.21.15.45:6815","nonce":33775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":33775},{"type":"v1","addr":"172.21.15.45:6813","nonce":33775}]},"public_addr":"172.21.15.45:6809/33775","cluster_addr":"172.21.15.45:6811/33775","heartbeat_back_addr":"172.21.15.45:6815/33775","heartbeat_front_addr":"172.21.15.45:6813/33775","state":["exists","up"]},{"osd":2,"uuid":"d909d49b-82b8-401b-9947-e49dd167bb95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":33776},{"type":"v1","addr":"172.21.15.45:6801","nonce":33776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":33776},{"type":"v1","addr":"172.21.15.45:6803","nonce":33776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":33776},{"type":"v1","addr":"172.21.15.45:6807","nonce":33776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":33776},{"type":"v1","addr":"172.21.15.45:6805","nonce":33776}]},"public_addr":"172.21.15.45:6801/33776","cluster_addr":"172.21.15.45:6803/33776","heartbeat_back_addr":"172.21.15.45:6807/33776","heartbeat_front_addr":"172.21.15.45:6805/33776","state":["exists","up"]},{"osd":3,"uuid":"db104ca9-3a94-4d39-a2be-bd06db888095","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":33782},{"type":"v1","addr":"172.21.15.45:6817","nonce":33782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":33782},{"type":"v1","addr":"172.21.15.45:6823","nonce":33782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":33782},{"type":"v1","addr":"172.21.15.45:6831","nonce":33782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":33782},{"type":"v1","addr":"172.21.15.45:6827","nonce":33782}]},"public_addr":"172.21.15.45:6817/33782","cluster_addr":"172.21.15.45:6823/33782","heartbeat_back_addr":"172.21.15.45:6831/33782","heartbeat_front_addr":"172.21.15.45:6827/33782","state":["exists","up"]},{"osd":4,"uuid":"9f4eaff4-e433-4479-a0d1-ee7a33375ca6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":34099},{"type":"v1","addr":"172.21.15.113:6811","nonce":34099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":34099},{"type":"v1","addr":"172.21.15.113:6815","nonce":34099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":34099},{"type":"v1","addr":"172.21.15.113:6823","nonce":34099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6816","nonce":34099},{"type":"v1","addr":"172.21.15.113:6818","nonce":34099}]},"public_addr":"172.21.15.113:6811/34099","cluster_addr":"172.21.15.113:6815/34099","heartbeat_back_addr":"172.21.15.113:6823/34099","heartbeat_front_addr":"172.21.15.113:6818/34099","state":["exists","up"]},{"osd":5,"uuid":"1efc5591-180b-43af-8611-0068aadc5aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":34100},{"type":"v1","addr":"172.21.15.113:6801","nonce":34100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":34100},{"type":"v1","addr":"172.21.15.113:6803","nonce":34100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":34100},{"type":"v1","addr":"172.21.15.113:6807","nonce":34100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":34100},{"type":"v1","addr":"172.21.15.113:6805","nonce":34100}]},"public_addr":"172.21.15.113:6801/34100","cluster_addr":"172.21.15.113:6803/34100","heartbeat_back_addr":"172.21.15.113:6807/34100","heartbeat_front_addr":"172.21.15.113:6805/34100","state":["exists","up"]},{"osd":6,"uuid":"6c89d9d8-c153-4a48-afa9-97e4c403f1ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":34101},{"type":"v1","addr":"172.21.15.113:6810","nonce":34101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6812","nonce":34101},{"type":"v1","addr":"172.21.15.113:6814","nonce":34101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6822","nonce":34101},{"type":"v1","addr":"172.21.15.113:6824","nonce":34101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":34101},{"type":"v1","addr":"172.21.15.113:6819","nonce":34101}]},"public_addr":"172.21.15.113:6810/34101","cluster_addr":"172.21.15.113:6814/34101","heartbeat_back_addr":"172.21.15.113:6824/34101","heartbeat_front_addr":"172.21.15.113:6819/34101","state":["exists","up"]},{"osd":7,"uuid":"1855e70c-23f6-4c08-ad7f-774c2148235b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6821","nonce":34102},{"type":"v1","addr":"172.21.15.113:6825","nonce":34102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":34102},{"type":"v1","addr":"172.21.15.113:6827","nonce":34102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":34102},{"type":"v1","addr":"172.21.15.113:6831","nonce":34102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6828","nonce":34102},{"type":"v1","addr":"172.21.15.113:6829","nonce":34102}]},"public_addr":"172.21.15.113:6825/34102","cluster_addr":"172.21.15.113:6827/34102","heartbeat_back_addr":"172.21.15.113:6831/34102","heartbeat_front_addr":"172.21.15.113:6829/34102","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.812672+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.825045+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.700105+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.856563+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.954683+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.883234+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.883994+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.821686+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T10:00:26.457 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:26.462+0000 7fdfcde1b700 1 -- 172.21.15.45:0/2865049277 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fdfa805a540 msgr2=0x7fdfa805ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:26.457 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:26.462+0000 7fdfcde1b700 1 --2- 172.21.15.45:0/2865049277 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fdfa805a540 0x7fdfa805ca00 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fdfb800d260 tx=0x7fdfb8016000).stop 2023-12-22T10:00:26.457 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:26.462+0000 7fdfcde1b700 1 -- 172.21.15.45:0/2865049277 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfc8151980 msgr2=0x7fdfc814f7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:26.457 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:26.462+0000 7fdfcde1b700 1 --2- 172.21.15.45:0/2865049277 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfc8151980 0x7fdfc814f7e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fdfc000e980 tx=0x7fdfc0009060).stop 2023-12-22T10:00:26.458 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:26.462+0000 7fdfcde1b700 1 -- 172.21.15.45:0/2865049277 shutdown_connections 2023-12-22T10:00:26.458 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:26.462+0000 7fdfcde1b700 1 --2- 172.21.15.45:0/2865049277 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfc8151980 0x7fdfc814f7e0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:26.458 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:26.462+0000 7fdfcde1b700 1 --2- 172.21.15.45:0/2865049277 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdfc80ac060 0x7fdfc8153330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:26.458 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:26.462+0000 7fdfcde1b700 1 --2- 172.21.15.45:0/2865049277 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fdfa805a540 0x7fdfa805ca00 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:26.458 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:26.462+0000 7fdfcde1b700 1 --2- 172.21.15.45:0/2865049277 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fdfc80a62c0 0x7fdfc814ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:26.459 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:26.462+0000 7fdfcde1b700 1 -- 172.21.15.45:0/2865049277 >> 172.21.15.45:0/2865049277 conn(0x7fdfc80679b0 msgr2=0x7fdfc8150930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:26.459 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:26.462+0000 7fdfcde1b700 1 -- 172.21.15.45:0/2865049277 shutdown_connections 2023-12-22T10:00:26.459 INFO:teuthology.misc.health.smithi045.stderr:2023-12-22T10:00:26.462+0000 7fdfcde1b700 1 -- 172.21.15.45:0/2865049277 wait complete. 2023-12-22T10:00:26.475 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-12-22T10:00:26.476 INFO:tasks.ceph:Creating RBD pool 2023-12-22T10:00:26.476 DEBUG:teuthology.orchestra.run.smithi045:> sudo ceph --cluster ceph osd pool create rbd 8 2023-12-22T10:00:26.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:26.638+0000 7f1ca6bb9700 1 Processor -- start 2023-12-22T10:00:26.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:26.638+0000 7f1ca6bb9700 1 -- start start 2023-12-22T10:00:26.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:26.642+0000 7f1ca6bb9700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1ca00c9d20 0x7f1ca00ad080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:26.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:26.642+0000 7f1ca6bb9700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ca00c5810 con 0x7f1ca00691c0 2023-12-22T10:00:26.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:26.642+0000 7f1ca6bb9700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ca00c8d90 con 0x7f1ca00acca0 2023-12-22T10:00:26.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:26.642+0000 7f1ca6bb9700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ca00c9350 con 0x7f1ca00c9d20 2023-12-22T10:00:26.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:26.642+0000 7f1ca53b6700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f1ca00691c0 0x7f1ca00aa5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33556/0 (socket says 172.21.15.45:33556) 2023-12-22T10:00:26.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:26.642+0000 7f1ca53b6700 1 -- 172.21.15.45:0/3420361195 learned_addr learned my addr 172.21.15.45:0/3420361195 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:00:26.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:26.642+0000 7f1ca63b8700 1 --2- 172.21.15.45:0/3420361195 >> v2:172.21.15.45:3300/0 conn(0x7f1ca00c9d20 0x7f1ca00ad080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:26.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:26.646+0000 7f1ca4bb5700 1 -- 172.21.15.45:0/3420361195 <== mon.1 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2527982127 0 0) 0x7f1ca00c8d90 con 0x7f1ca00acca0 2023-12-22T10:00:26.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:26.646+0000 7f1ca4bb5700 1 -- 172.21.15.45:0/3420361195 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c8c0033f0 con 0x7f1ca00acca0 2023-12-22T10:00:26.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:26.646+0000 7f1ca4bb5700 1 -- 172.21.15.45:0/3420361195 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2687149575 0 0) 0x7f1ca00c5810 con 0x7f1ca00691c0 2023-12-22T10:00:26.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:26.646+0000 7f1ca4bb5700 1 -- 172.21.15.45:0/3420361195 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ca00c8d90 con 0x7f1ca00691c0 2023-12-22T10:00:26.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:26.646+0000 7f1ca63b8700 1 -- 172.21.15.45:0/3420361195 >> v1:172.21.15.113:6789/0 conn(0x7f1ca00acca0 legacy=0x7f1ca0068ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:26.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:26.646+0000 7f1ca63b8700 1 -- 172.21.15.45:0/3420361195 >> v1:172.21.15.45:6789/0 conn(0x7f1ca00691c0 legacy=0x7f1ca00aa5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:26.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:26.646+0000 7f1ca63b8700 1 -- 172.21.15.45:0/3420361195 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ca0154070 con 0x7f1ca00c9d20 2023-12-22T10:00:26.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:26.646+0000 7f1ca63b8700 1 --2- 172.21.15.45:0/3420361195 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ca00c9d20 0x7f1ca00ad080 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f1c98009e60 tx=0x7f1c98009780).ready entity=mon.0 client_cookie=c88ed3bd8fa68b7d server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:26.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:26.646+0000 7f1ca4bb5700 1 -- 172.21.15.45:0/3420361195 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c9800e070 con 0x7f1ca00c9d20 2023-12-22T10:00:26.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:26.646+0000 7f1ca4bb5700 1 -- 172.21.15.45:0/3420361195 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c9800bab0 con 0x7f1ca00c9d20 2023-12-22T10:00:26.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:26.646+0000 7f1ca4bb5700 1 -- 172.21.15.45:0/3420361195 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c9800be30 con 0x7f1ca00c9d20 2023-12-22T10:00:26.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:26.646+0000 7f1ca6bb9700 1 -- 172.21.15.45:0/3420361195 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ca00c9d20 msgr2=0x7f1ca00ad080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:26.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:26.646+0000 7f1ca6bb9700 1 --2- 172.21.15.45:0/3420361195 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ca00c9d20 0x7f1ca00ad080 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f1c98009e60 tx=0x7f1c98009780).stop 2023-12-22T10:00:26.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:26.646+0000 7f1ca6bb9700 1 -- 172.21.15.45:0/3420361195 shutdown_connections 2023-12-22T10:00:26.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:26.646+0000 7f1ca6bb9700 1 --2- 172.21.15.45:0/3420361195 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ca00c9d20 0x7f1ca00ad080 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:26.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:26.646+0000 7f1ca6bb9700 1 -- 172.21.15.45:0/3420361195 >> 172.21.15.45:0/3420361195 conn(0x7f1ca00674f0 msgr2=0x7f1ca00ca820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:26.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:26.646+0000 7f1ca6bb9700 1 -- 172.21.15.45:0/3420361195 shutdown_connections 2023-12-22T10:00:26.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:26.646+0000 7f1ca6bb9700 1 -- 172.21.15.45:0/3420361195 wait complete. 2023-12-22T10:00:26.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:26.650+0000 7f1ca6bb9700 1 Processor -- start 2023-12-22T10:00:26.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:26.650+0000 7f1ca6bb9700 1 -- start start 2023-12-22T10:00:26.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:26.654+0000 7f1ca6bb9700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1ca00691c0 0x7f1ca00c2290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:26.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:26.654+0000 7f1ca6bb9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ca00acca0 0x7f1ca0152130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:26.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:26.654+0000 7f1ca6bb9700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1ca00c9d20 0x7f1ca0154580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:26.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:26.654+0000 7f1ca6bb9700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca00aeed0 con 0x7f1ca00acca0 2023-12-22T10:00:26.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:26.654+0000 7f1ca6bb9700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca00c2ab0 con 0x7f1ca00c9d20 2023-12-22T10:00:26.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:26.654+0000 7f1ca6bb9700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca00c2d90 con 0x7f1ca00691c0 2023-12-22T10:00:26.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:26.654+0000 7f1ca53b6700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ca00acca0 0x7f1ca0152130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:26.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:26.654+0000 7f1ca53b6700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ca00acca0 0x7f1ca0152130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36344/0 (socket says 172.21.15.45:36344) 2023-12-22T10:00:26.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:26.654+0000 7f1ca53b6700 1 -- 172.21.15.45:0/3707676257 learned_addr learned my addr 172.21.15.45:0/3707676257 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:26.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:26.654+0000 7f1ca63b8700 1 --2- 172.21.15.45:0/3707676257 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1ca00c9d20 0x7f1ca0154580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:26.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:26.654+0000 7f1ca5bb7700 1 --2- 172.21.15.45:0/3707676257 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1ca00691c0 0x7f1ca00c2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:26.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:26.654+0000 7f1ca53b6700 1 -- 172.21.15.45:0/3707676257 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1ca00691c0 msgr2=0x7f1ca00c2290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:26.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:26.654+0000 7f1ca53b6700 1 --2- 172.21.15.45:0/3707676257 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1ca00691c0 0x7f1ca00c2290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:26.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:26.654+0000 7f1ca53b6700 1 -- 172.21.15.45:0/3707676257 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1ca00c9d20 msgr2=0x7f1ca0154580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:26.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:26.654+0000 7f1ca53b6700 1 --2- 172.21.15.45:0/3707676257 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1ca00c9d20 0x7f1ca0154580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:26.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:26.654+0000 7f1ca53b6700 1 -- 172.21.15.45:0/3707676257 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c98009a20 con 0x7f1ca00acca0 2023-12-22T10:00:26.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:26.654+0000 7f1ca53b6700 1 --2- 172.21.15.45:0/3707676257 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ca00acca0 0x7f1ca0152130 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f1c9000c4c0 tx=0x7f1c90007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:26.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:26.654+0000 7f1c95ffb700 1 -- 172.21.15.45:0/3707676257 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c9000ce70 con 0x7f1ca00acca0 2023-12-22T10:00:26.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:26.654+0000 7f1c95ffb700 1 -- 172.21.15.45:0/3707676257 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c900072e0 con 0x7f1ca00acca0 2023-12-22T10:00:26.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:26.654+0000 7f1c95ffb700 1 -- 172.21.15.45:0/3707676257 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c900057a0 con 0x7f1ca00acca0 2023-12-22T10:00:26.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:26.654+0000 7f1ca6bb9700 1 -- 172.21.15.45:0/3707676257 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ca00c3070 con 0x7f1ca00acca0 2023-12-22T10:00:26.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:26.654+0000 7f1ca6bb9700 1 -- 172.21.15.45:0/3707676257 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ca00aeaf0 con 0x7f1ca00acca0 2023-12-22T10:00:26.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:26.658+0000 7f1ca6bb9700 1 -- 172.21.15.45:0/3707676257 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ca00af080 con 0x7f1ca00acca0 2023-12-22T10:00:26.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:26.658+0000 7f1c95ffb700 1 -- 172.21.15.45:0/3707676257 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f1c90005bd0 con 0x7f1ca00acca0 2023-12-22T10:00:26.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:26.662+0000 7f1c95ffb700 1 --2- 172.21.15.45:0/3707676257 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f1c8405a540 0x7f1c8405ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:26.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:26.662+0000 7f1c95ffb700 1 -- 172.21.15.45:0/3707676257 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4892+0+0 (secure 0 0 0) 0x7f1c90073a40 con 0x7f1ca00acca0 2023-12-22T10:00:26.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:26.662+0000 7f1ca5bb7700 1 --2- 172.21.15.45:0/3707676257 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f1c8405a540 0x7f1c8405ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:26.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:26.662+0000 7f1ca5bb7700 1 --2- 172.21.15.45:0/3707676257 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f1c8405a540 0x7f1c8405ca00 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f1c9c003930 tx=0x7f1c9c007bd0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:26.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:26.666+0000 7f1c95ffb700 1 -- 172.21.15.45:0/3707676257 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f1ca00af080 con 0x7f1ca00acca0 2023-12-22T10:00:26.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:26.830+0000 7f1ca6bb9700 1 -- 172.21.15.45:0/3707676257 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f1ca0047060 con 0x7f1ca00acca0 2023-12-22T10:00:27.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:27.010+0000 7f1c95ffb700 1 -- 172.21.15.45:0/3707676257 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v15) v1 ==== 109+0+0 (secure 0 0 0) 0x7f1c90047630 con 0x7f1ca00acca0 2023-12-22T10:00:27.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:27.018+0000 7f1ca6bb9700 1 -- 172.21.15.45:0/3707676257 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f1c8405a540 msgr2=0x7f1c8405ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:27.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:27.018+0000 7f1ca6bb9700 1 --2- 172.21.15.45:0/3707676257 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f1c8405a540 0x7f1c8405ca00 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f1c9c003930 tx=0x7f1c9c007bd0).stop 2023-12-22T10:00:27.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:27.018+0000 7f1ca6bb9700 1 -- 172.21.15.45:0/3707676257 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ca00acca0 msgr2=0x7f1ca0152130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:27.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:27.018+0000 7f1ca6bb9700 1 --2- 172.21.15.45:0/3707676257 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ca00acca0 0x7f1ca0152130 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f1c9000c4c0 tx=0x7f1c90007c50).stop 2023-12-22T10:00:27.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:27.018+0000 7f1ca6bb9700 1 -- 172.21.15.45:0/3707676257 shutdown_connections 2023-12-22T10:00:27.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:27.018+0000 7f1ca6bb9700 1 --2- 172.21.15.45:0/3707676257 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1ca00c9d20 0x7f1ca0154580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:27.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:27.018+0000 7f1ca6bb9700 1 --2- 172.21.15.45:0/3707676257 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ca00acca0 0x7f1ca0152130 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:27.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:27.018+0000 7f1ca6bb9700 1 --2- 172.21.15.45:0/3707676257 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f1c8405a540 0x7f1c8405ca00 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:27.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:27.018+0000 7f1ca6bb9700 1 --2- 172.21.15.45:0/3707676257 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1ca00691c0 0x7f1ca00c2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:27.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:27.018+0000 7f1ca6bb9700 1 -- 172.21.15.45:0/3707676257 >> 172.21.15.45:0/3707676257 conn(0x7f1ca00674f0 msgr2=0x7f1ca00aa720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:27.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:27.018+0000 7f1ca6bb9700 1 -- 172.21.15.45:0/3707676257 shutdown_connections 2023-12-22T10:00:27.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:27.018+0000 7f1ca6bb9700 1 -- 172.21.15.45:0/3707676257 wait complete. 2023-12-22T10:00:27.017 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'rbd' created 2023-12-22T10:00:27.034 DEBUG:teuthology.orchestra.run.smithi045:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-12-22T10:00:27.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:27.198+0000 7f822ca39700 1 Processor -- start 2023-12-22T10:00:27.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:27.198+0000 7f822ca39700 1 -- start start 2023-12-22T10:00:27.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:27.202+0000 7f822ca39700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f82280a9b00 0x7f82281527e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:27.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:27.202+0000 7f822ca39700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8228152cd0 con 0x7f8228065890 2023-12-22T10:00:27.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:27.202+0000 7f822ca39700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82280bc990 con 0x7f82280a9ee0 2023-12-22T10:00:27.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:27.202+0000 7f822ca39700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82280c7980 con 0x7f82280a9b00 2023-12-22T10:00:27.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:27.202+0000 7f8227fff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f8228065890 0x7f82280c4390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33562/0 (socket says 172.21.15.45:33562) 2023-12-22T10:00:27.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:27.202+0000 7f8227fff700 1 -- 172.21.15.45:0/293459090 learned_addr learned my addr 172.21.15.45:0/293459090 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:00:27.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:27.202+0000 7f82277fe700 1 --2- 172.21.15.45:0/293459090 >> v2:172.21.15.45:3300/0 conn(0x7f82280a9b00 0x7f82281527e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:27.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:27.202+0000 7f8226ffd700 1 -- 172.21.15.45:0/293459090 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 654473469 0 0) 0x7f8228152cd0 con 0x7f8228065890 2023-12-22T10:00:27.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:27.202+0000 7f8226ffd700 1 -- 172.21.15.45:0/293459090 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82140033f0 con 0x7f8228065890 2023-12-22T10:00:27.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:27.202+0000 7f82277fe700 1 -- 172.21.15.45:0/293459090 >> v1:172.21.15.113:6789/0 conn(0x7f82280a9ee0 legacy=0x7f8228152f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:27.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:27.202+0000 7f82277fe700 1 -- 172.21.15.45:0/293459090 >> v1:172.21.15.45:6789/0 conn(0x7f8228065890 legacy=0x7f82280c4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:27.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:27.202+0000 7f82277fe700 1 -- 172.21.15.45:0/293459090 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82280c7c60 con 0x7f82280a9b00 2023-12-22T10:00:27.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:27.202+0000 7f82277fe700 1 --2- 172.21.15.45:0/293459090 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82280a9b00 0x7f82281527e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f8218009790 tx=0x7f8218009060).ready entity=mon.0 client_cookie=4e4ff3128c8011c6 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:27.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:27.202+0000 7f8226ffd700 1 -- 172.21.15.45:0/293459090 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f821800f510 con 0x7f82280a9b00 2023-12-22T10:00:27.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:27.202+0000 7f8226ffd700 1 -- 172.21.15.45:0/293459090 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f821800f670 con 0x7f82280a9b00 2023-12-22T10:00:27.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:27.202+0000 7f8226ffd700 1 -- 172.21.15.45:0/293459090 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f821800f9f0 con 0x7f82280a9b00 2023-12-22T10:00:27.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:27.206+0000 7f822ca39700 1 -- 172.21.15.45:0/293459090 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82280a9b00 msgr2=0x7f82281527e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:27.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:27.206+0000 7f822ca39700 1 --2- 172.21.15.45:0/293459090 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82280a9b00 0x7f82281527e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f8218009790 tx=0x7f8218009060).stop 2023-12-22T10:00:27.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:27.206+0000 7f822ca39700 1 -- 172.21.15.45:0/293459090 shutdown_connections 2023-12-22T10:00:27.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:27.206+0000 7f822ca39700 1 --2- 172.21.15.45:0/293459090 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82280a9b00 0x7f82281527e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:27.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:27.206+0000 7f822ca39700 1 -- 172.21.15.45:0/293459090 >> 172.21.15.45:0/293459090 conn(0x7f8228062230 msgr2=0x7f8228062610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:27.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:27.206+0000 7f822ca39700 1 -- 172.21.15.45:0/293459090 shutdown_connections 2023-12-22T10:00:27.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:27.206+0000 7f822ca39700 1 -- 172.21.15.45:0/293459090 wait complete. 2023-12-22T10:00:27.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:27.206+0000 7f822ca39700 1 Processor -- start 2023-12-22T10:00:27.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:27.206+0000 7f822ca39700 1 -- start start 2023-12-22T10:00:27.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:27.210+0000 7f822ca39700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f8228065890 0x7f822814a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:27.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:27.210+0000 7f822ca39700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82280a9b00 0x7f822814e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:27.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:27.210+0000 7f822ca39700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f82280a9ee0 0x7f822814ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:27.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:27.210+0000 7f822ca39700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82280c58c0 con 0x7f82280a9b00 2023-12-22T10:00:27.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:27.210+0000 7f822ca39700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f822814ff80 con 0x7f82280a9ee0 2023-12-22T10:00:27.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:27.210+0000 7f822ca39700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f822814f390 con 0x7f8228065890 2023-12-22T10:00:27.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:27.210+0000 7f821ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82280a9b00 0x7f822814e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:27.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:27.210+0000 7f821ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82280a9b00 0x7f822814e810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36356/0 (socket says 172.21.15.45:36356) 2023-12-22T10:00:27.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:27.210+0000 7f821ffff700 1 -- 172.21.15.45:0/3065837995 learned_addr learned my addr 172.21.15.45:0/3065837995 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:27.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:27.210+0000 7f8227fff700 1 --2- 172.21.15.45:0/3065837995 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f82280a9ee0 0x7f822814ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:27.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:27.210+0000 7f82277fe700 1 --2- 172.21.15.45:0/3065837995 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f8228065890 0x7f822814a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:27.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:27.210+0000 7f821ffff700 1 -- 172.21.15.45:0/3065837995 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f8228065890 msgr2=0x7f822814a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:27.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:27.210+0000 7f821ffff700 1 --2- 172.21.15.45:0/3065837995 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f8228065890 0x7f822814a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:27.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:27.210+0000 7f821ffff700 1 -- 172.21.15.45:0/3065837995 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f82280a9ee0 msgr2=0x7f822814ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:27.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:27.210+0000 7f821ffff700 1 --2- 172.21.15.45:0/3065837995 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f82280a9ee0 0x7f822814ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:27.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:27.210+0000 7f821ffff700 1 -- 172.21.15.45:0/3065837995 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82180092a0 con 0x7f82280a9b00 2023-12-22T10:00:27.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:27.210+0000 7f8227fff700 1 --2- 172.21.15.45:0/3065837995 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f82280a9ee0 0x7f822814ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T10:00:27.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:27.210+0000 7f82277fe700 1 --2- 172.21.15.45:0/3065837995 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f8228065890 0x7f822814a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T10:00:27.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:27.210+0000 7f821ffff700 1 --2- 172.21.15.45:0/3065837995 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82280a9b00 0x7f822814e810 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f821000c440 tx=0x7f8210007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:27.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:27.210+0000 7f821f7fe700 1 -- 172.21.15.45:0/3065837995 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8210007020 con 0x7f82280a9b00 2023-12-22T10:00:27.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:27.210+0000 7f822ca39700 1 -- 172.21.15.45:0/3065837995 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8228150410 con 0x7f82280a9b00 2023-12-22T10:00:27.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:27.210+0000 7f821f7fe700 1 -- 172.21.15.45:0/3065837995 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8210007180 con 0x7f82280a9b00 2023-12-22T10:00:27.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:27.210+0000 7f821f7fe700 1 -- 172.21.15.45:0/3065837995 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8210007520 con 0x7f82280a9b00 2023-12-22T10:00:27.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:27.210+0000 7f822ca39700 1 -- 172.21.15.45:0/3065837995 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f822814f930 con 0x7f82280a9b00 2023-12-22T10:00:27.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:27.214+0000 7f822ca39700 1 -- 172.21.15.45:0/3065837995 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8228150130 con 0x7f82280a9b00 2023-12-22T10:00:27.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:27.214+0000 7f821f7fe700 1 -- 172.21.15.45:0/3065837995 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f82100068b0 con 0x7f82280a9b00 2023-12-22T10:00:27.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:27.218+0000 7f821f7fe700 1 --2- 172.21.15.45:0/3065837995 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f820805a510 0x7f820805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:27.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:27.218+0000 7f821f7fe700 1 -- 172.21.15.45:0/3065837995 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 5258+0+0 (secure 0 0 0) 0x7f8210073850 con 0x7f82280a9b00 2023-12-22T10:00:27.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:27.218+0000 7f82277fe700 1 --2- 172.21.15.45:0/3065837995 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f820805a510 0x7f820805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:27.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:27.218+0000 7f82277fe700 1 --2- 172.21.15.45:0/3065837995 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f820805a510 0x7f820805c9d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f8218006e00 tx=0x7f8218017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:27.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:27.222+0000 7f821f7fe700 1 -- 172.21.15.45:0/3065837995 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f8210047390 con 0x7f82280a9b00 2023-12-22T10:00:27.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:27.386+0000 7f822ca39700 1 -- 172.21.15.45:0/3065837995 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f8228047060 con 0x7f82280a9b00 2023-12-22T10:00:28.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.014+0000 7f821f7fe700 1 -- 172.21.15.45:0/3065837995 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v16) v1 ==== 173+0+0 (secure 0 0 0) 0x7f821004a9b0 con 0x7f82280a9b00 2023-12-22T10:00:28.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.022+0000 7f822ca39700 1 -- 172.21.15.45:0/3065837995 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f820805a510 msgr2=0x7f820805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:28.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.022+0000 7f822ca39700 1 --2- 172.21.15.45:0/3065837995 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f820805a510 0x7f820805c9d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f8218006e00 tx=0x7f8218017000).stop 2023-12-22T10:00:28.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.022+0000 7f822ca39700 1 -- 172.21.15.45:0/3065837995 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82280a9b00 msgr2=0x7f822814e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:28.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.022+0000 7f822ca39700 1 --2- 172.21.15.45:0/3065837995 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82280a9b00 0x7f822814e810 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f821000c440 tx=0x7f8210007e00).stop 2023-12-22T10:00:28.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.022+0000 7f822ca39700 1 -- 172.21.15.45:0/3065837995 shutdown_connections 2023-12-22T10:00:28.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.022+0000 7f822ca39700 1 --2- 172.21.15.45:0/3065837995 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f82280a9ee0 0x7f822814ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:28.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.022+0000 7f822ca39700 1 --2- 172.21.15.45:0/3065837995 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82280a9b00 0x7f822814e810 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:28.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.022+0000 7f822ca39700 1 --2- 172.21.15.45:0/3065837995 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f820805a510 0x7f820805c9d0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:28.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.022+0000 7f822ca39700 1 --2- 172.21.15.45:0/3065837995 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f8228065890 0x7f822814a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:28.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.022+0000 7f822ca39700 1 -- 172.21.15.45:0/3065837995 >> 172.21.15.45:0/3065837995 conn(0x7f8228062230 msgr2=0x7f8228066a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:28.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.022+0000 7f822ca39700 1 -- 172.21.15.45:0/3065837995 shutdown_connections 2023-12-22T10:00:28.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.022+0000 7f822ca39700 1 -- 172.21.15.45:0/3065837995 wait complete. 2023-12-22T10:00:28.025 INFO:teuthology.orchestra.run.smithi045.stderr:enabled application 'rbd' on pool 'rbd' 2023-12-22T10:00:28.044 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-12-22T10:00:28.044 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-22T10:00:28.044 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-22T10:00:28.048 INFO:tasks.ceph.mds.a:Started 2023-12-22T10:00:28.048 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-22T10:00:28.049 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-22T10:00:28.052 INFO:tasks.ceph.mds.c:Started 2023-12-22T10:00:28.052 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-22T10:00:28.052 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-22T10:00:28.059 INFO:tasks.ceph.mds.b:Started 2023-12-22T10:00:28.060 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-22T10:00:28.060 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-22T10:00:28.068 INFO:tasks.ceph.mds.d:Started 2023-12-22T10:00:28.068 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-12-22T10:00:28.068 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T10:00:28.157 INFO:tasks.ceph.mds.c.smithi045.stdout:starting mds.c at 2023-12-22T10:00:28.159 INFO:tasks.ceph.mds.a.smithi045.stdout:starting mds.a at 2023-12-22T10:00:28.176 INFO:tasks.ceph.mds.b.smithi113.stdout:starting mds.b at 2023-12-22T10:00:28.182 INFO:tasks.ceph.mds.d.smithi113.stdout:starting mds.d at 2023-12-22T10:00:28.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.230+0000 7fa823a1b700 1 Processor -- start 2023-12-22T10:00:28.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.234+0000 7fa823a1b700 1 -- start start 2023-12-22T10:00:28.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.234+0000 7fa823a1b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa81c0a8080 0x7fa81c162c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:28.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.234+0000 7fa823a1b700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa81c0a68b0 con 0x7fa81c1581f0 2023-12-22T10:00:28.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.234+0000 7fa823a1b700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa81c065610 con 0x7fa81c157e10 2023-12-22T10:00:28.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.234+0000 7fa823a1b700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa81c0658f0 con 0x7fa81c0a8080 2023-12-22T10:00:28.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.238+0000 7fa821fb8700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa81c0a8080 0x7fa81c162c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:28.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.238+0000 7fa820fb6700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fa81c1581f0 0x7fa81c0c3080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:46500/0 (socket says 172.21.15.45:46500) 2023-12-22T10:00:28.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.238+0000 7fa820fb6700 1 -- 172.21.15.45:0/768382701 learned_addr learned my addr 172.21.15.45:0/768382701 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:00:28.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.238+0000 7fa813fff700 1 -- 172.21.15.45:0/768382701 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 730445396 0 0) 0x7fa81c0a68b0 con 0x7fa81c1581f0 2023-12-22T10:00:28.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.238+0000 7fa813fff700 1 -- 172.21.15.45:0/768382701 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8080033f0 con 0x7fa81c1581f0 2023-12-22T10:00:28.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.238+0000 7fa821fb8700 1 -- 172.21.15.45:0/768382701 >> v1:172.21.15.113:6789/0 conn(0x7fa81c157e10 legacy=0x7fa81c0c1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:28.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.238+0000 7fa821fb8700 1 -- 172.21.15.45:0/768382701 >> v1:172.21.15.45:6789/0 conn(0x7fa81c1581f0 legacy=0x7fa81c0c3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:28.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.238+0000 7fa821fb8700 1 -- 172.21.15.45:0/768382701 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa81c065bd0 con 0x7fa81c0a8080 2023-12-22T10:00:28.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.238+0000 7fa821fb8700 1 --2- 172.21.15.45:0/768382701 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa81c0a8080 0x7fa81c162c20 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fa814009e60 tx=0x7fa814009780).ready entity=mon.0 client_cookie=d9e8acf48dc68c2f server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:28.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.238+0000 7fa813fff700 1 -- 172.21.15.45:0/768382701 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa81400e070 con 0x7fa81c0a8080 2023-12-22T10:00:28.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.238+0000 7fa813fff700 1 -- 172.21.15.45:0/768382701 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa81400bb60 con 0x7fa81c0a8080 2023-12-22T10:00:28.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.238+0000 7fa813fff700 1 -- 172.21.15.45:0/768382701 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa814012410 con 0x7fa81c0a8080 2023-12-22T10:00:28.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.238+0000 7fa823a1b700 1 -- 172.21.15.45:0/768382701 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa81c0a8080 msgr2=0x7fa81c162c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:28.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.238+0000 7fa823a1b700 1 --2- 172.21.15.45:0/768382701 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa81c0a8080 0x7fa81c162c20 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fa814009e60 tx=0x7fa814009780).stop 2023-12-22T10:00:28.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.238+0000 7fa823a1b700 1 -- 172.21.15.45:0/768382701 shutdown_connections 2023-12-22T10:00:28.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.238+0000 7fa823a1b700 1 --2- 172.21.15.45:0/768382701 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa81c0a8080 0x7fa81c162c20 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:28.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.238+0000 7fa823a1b700 1 -- 172.21.15.45:0/768382701 >> 172.21.15.45:0/768382701 conn(0x7fa81c066a70 msgr2=0x7fa81c066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:28.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.238+0000 7fa823a1b700 1 -- 172.21.15.45:0/768382701 shutdown_connections 2023-12-22T10:00:28.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.238+0000 7fa823a1b700 1 -- 172.21.15.45:0/768382701 wait complete. 2023-12-22T10:00:28.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.242+0000 7fa823a1b700 1 Processor -- start 2023-12-22T10:00:28.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.242+0000 7fa823a1b700 1 -- start start 2023-12-22T10:00:28.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.242+0000 7fa823a1b700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa81c0a8080 0x7fa81c0bc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:28.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.242+0000 7fa823a1b700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fa81c157e10 0x7fa81c0aacd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:28.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.242+0000 7fa823a1b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa81c1581f0 0x7fa81c0abd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:28.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.242+0000 7fa823a1b700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa81c0ac690 con 0x7fa81c1581f0 2023-12-22T10:00:28.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.242+0000 7fa823a1b700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa81c0bb960 con 0x7fa81c0a8080 2023-12-22T10:00:28.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.242+0000 7fa823a1b700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa81c0bbc00 con 0x7fa81c157e10 2023-12-22T10:00:28.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.242+0000 7fa821fb8700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa81c1581f0 0x7fa81c0abd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:28.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.242+0000 7fa821fb8700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa81c1581f0 0x7fa81c0abd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42156/0 (socket says 172.21.15.45:42156) 2023-12-22T10:00:28.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.242+0000 7fa821fb8700 1 -- 172.21.15.45:0/3297086825 learned_addr learned my addr 172.21.15.45:0/3297086825 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:28.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.242+0000 7fa820fb6700 1 --2- 172.21.15.45:0/3297086825 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fa81c157e10 0x7fa81c0aacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:28.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.242+0000 7fa8217b7700 1 --2- 172.21.15.45:0/3297086825 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa81c0a8080 0x7fa81c0bc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:28.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.246+0000 7fa821fb8700 1 -- 172.21.15.45:0/3297086825 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fa81c157e10 msgr2=0x7fa81c0aacd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:28.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.246+0000 7fa821fb8700 1 --2- 172.21.15.45:0/3297086825 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fa81c157e10 0x7fa81c0aacd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:28.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.246+0000 7fa821fb8700 1 -- 172.21.15.45:0/3297086825 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa81c0a8080 msgr2=0x7fa81c0bc6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:28.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.246+0000 7fa821fb8700 1 --2- 172.21.15.45:0/3297086825 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa81c0a8080 0x7fa81c0bc6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:28.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.246+0000 7fa821fb8700 1 -- 172.21.15.45:0/3297086825 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa814009a20 con 0x7fa81c1581f0 2023-12-22T10:00:28.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.246+0000 7fa821fb8700 1 --2- 172.21.15.45:0/3297086825 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa81c1581f0 0x7fa81c0abd40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fa814011000 tx=0x7fa814009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:28.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.246+0000 7fa8117fa700 1 -- 172.21.15.45:0/3297086825 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa81401d630 con 0x7fa81c1581f0 2023-12-22T10:00:28.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.246+0000 7fa8117fa700 1 -- 172.21.15.45:0/3297086825 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa81401d790 con 0x7fa81c1581f0 2023-12-22T10:00:28.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.246+0000 7fa8117fa700 1 -- 172.21.15.45:0/3297086825 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa81401db50 con 0x7fa81c1581f0 2023-12-22T10:00:28.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.246+0000 7fa823a1b700 1 -- 172.21.15.45:0/3297086825 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa81c0bbee0 con 0x7fa81c1581f0 2023-12-22T10:00:28.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.246+0000 7fa823a1b700 1 -- 172.21.15.45:0/3297086825 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa81c0bcbd0 con 0x7fa81c1581f0 2023-12-22T10:00:28.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.246+0000 7fa823a1b700 1 -- 172.21.15.45:0/3297086825 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa81c06c070 con 0x7fa81c1581f0 2023-12-22T10:00:28.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.246+0000 7fa8117fa700 1 -- 172.21.15.45:0/3297086825 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fa814026410 con 0x7fa81c1581f0 2023-12-22T10:00:28.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.250+0000 7fa8117fa700 1 --2- 172.21.15.45:0/3297086825 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fa80005a540 0x7fa80005ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:28.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.250+0000 7fa8117fa700 1 -- 172.21.15.45:0/3297086825 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fa8140762d0 con 0x7fa81c1581f0 2023-12-22T10:00:28.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.250+0000 7fa8217b7700 1 --2- 172.21.15.45:0/3297086825 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fa80005a540 0x7fa80005ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:28.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.250+0000 7fa8217b7700 1 --2- 172.21.15.45:0/3297086825 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fa80005a540 0x7fa80005ca00 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fa8180036d0 tx=0x7fa818009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:28.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.258+0000 7fa8117fa700 1 -- 172.21.15.45:0/3297086825 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fa814049d60 con 0x7fa81c1581f0 2023-12-22T10:00:28.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.426+0000 7fa823a1b700 1 -- 172.21.15.45:0/3297086825 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa81c0a6b50 con 0x7fa81c1581f0 2023-12-22T10:00:28.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.426+0000 7fa8117fa700 1 -- 172.21.15.45:0/3297086825 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+13722 (secure 0 0 0) 0x7fa81404d380 con 0x7fa81c1581f0 2023-12-22T10:00:28.423 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:00:28.424 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":16,"fsid":"98b0837e-5e68-4c8f-a1a0-e9424baaad8f","created":"2023-12-22T10:00:15.010174+0000","modified":"2023-12-22T10:00:28.007363+0000","last_up_change":"2023-12-22T10:00:24.980513+0000","last_in_change":"2023-12-22T10:00:17.887172+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-12-22T10:00:25.069641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-12-22T10:00:26.906399+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"e19943a0-1c6b-47df-b6bb-383472077890","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":33777},{"type":"v1","addr":"172.21.15.45:6819","nonce":33777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":33777},{"type":"v1","addr":"172.21.15.45:6822","nonce":33777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":33777},{"type":"v1","addr":"172.21.15.45:6830","nonce":33777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":33777},{"type":"v1","addr":"172.21.15.45:6826","nonce":33777}]},"public_addr":"172.21.15.45:6819/33777","cluster_addr":"172.21.15.45:6822/33777","heartbeat_back_addr":"172.21.15.45:6830/33777","heartbeat_front_addr":"172.21.15.45:6826/33777","state":["exists","up"]},{"osd":1,"uuid":"69670f34-f082-45a7-8f67-e962acc136e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":33775},{"type":"v1","addr":"172.21.15.45:6809","nonce":33775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":33775},{"type":"v1","addr":"172.21.15.45:6811","nonce":33775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":33775},{"type":"v1","addr":"172.21.15.45:6815","nonce":33775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":33775},{"type":"v1","addr":"172.21.15.45:6813","nonce":33775}]},"public_addr":"172.21.15.45:6809/33775","cluster_addr":"172.21.15.45:6811/33775","heartbeat_back_addr":"172.21.15.45:6815/33775","heartbeat_front_addr":"172.21.15.45:6813/33775","state":["exists","up"]},{"osd":2,"uuid":"d909d49b-82b8-401b-9947-e49dd167bb95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":33776},{"type":"v1","addr":"172.21.15.45:6801","nonce":33776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":33776},{"type":"v1","addr":"172.21.15.45:6803","nonce":33776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":33776},{"type":"v1","addr":"172.21.15.45:6807","nonce":33776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":33776},{"type":"v1","addr":"172.21.15.45:6805","nonce":33776}]},"public_addr":"172.21.15.45:6801/33776","cluster_addr":"172.21.15.45:6803/33776","heartbeat_back_addr":"172.21.15.45:6807/33776","heartbeat_front_addr":"172.21.15.45:6805/33776","state":["exists","up"]},{"osd":3,"uuid":"db104ca9-3a94-4d39-a2be-bd06db888095","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":33782},{"type":"v1","addr":"172.21.15.45:6817","nonce":33782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":33782},{"type":"v1","addr":"172.21.15.45:6823","nonce":33782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":33782},{"type":"v1","addr":"172.21.15.45:6831","nonce":33782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":33782},{"type":"v1","addr":"172.21.15.45:6827","nonce":33782}]},"public_addr":"172.21.15.45:6817/33782","cluster_addr":"172.21.15.45:6823/33782","heartbeat_back_addr":"172.21.15.45:6831/33782","heartbeat_front_addr":"172.21.15.45:6827/33782","state":["exists","up"]},{"osd":4,"uuid":"9f4eaff4-e433-4479-a0d1-ee7a33375ca6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":34099},{"type":"v1","addr":"172.21.15.113:6811","nonce":34099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":34099},{"type":"v1","addr":"172.21.15.113:6815","nonce":34099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":34099},{"type":"v1","addr":"172.21.15.113:6823","nonce":34099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6816","nonce":34099},{"type":"v1","addr":"172.21.15.113:6818","nonce":34099}]},"public_addr":"172.21.15.113:6811/34099","cluster_addr":"172.21.15.113:6815/34099","heartbeat_back_addr":"172.21.15.113:6823/34099","heartbeat_front_addr":"172.21.15.113:6818/34099","state":["exists","up"]},{"osd":5,"uuid":"1efc5591-180b-43af-8611-0068aadc5aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":34100},{"type":"v1","addr":"172.21.15.113:6801","nonce":34100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":34100},{"type":"v1","addr":"172.21.15.113:6803","nonce":34100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":34100},{"type":"v1","addr":"172.21.15.113:6807","nonce":34100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":34100},{"type":"v1","addr":"172.21.15.113:6805","nonce":34100}]},"public_addr":"172.21.15.113:6801/34100","cluster_addr":"172.21.15.113:6803/34100","heartbeat_back_addr":"172.21.15.113:6807/34100","heartbeat_front_addr":"172.21.15.113:6805/34100","state":["exists","up"]},{"osd":6,"uuid":"6c89d9d8-c153-4a48-afa9-97e4c403f1ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":34101},{"type":"v1","addr":"172.21.15.113:6810","nonce":34101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6812","nonce":34101},{"type":"v1","addr":"172.21.15.113:6814","nonce":34101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6822","nonce":34101},{"type":"v1","addr":"172.21.15.113:6824","nonce":34101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":34101},{"type":"v1","addr":"172.21.15.113:6819","nonce":34101}]},"public_addr":"172.21.15.113:6810/34101","cluster_addr":"172.21.15.113:6814/34101","heartbeat_back_addr":"172.21.15.113:6824/34101","heartbeat_front_addr":"172.21.15.113:6819/34101","state":["exists","up"]},{"osd":7,"uuid":"1855e70c-23f6-4c08-ad7f-774c2148235b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6821","nonce":34102},{"type":"v1","addr":"172.21.15.113:6825","nonce":34102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":34102},{"type":"v1","addr":"172.21.15.113:6827","nonce":34102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":34102},{"type":"v1","addr":"172.21.15.113:6831","nonce":34102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6828","nonce":34102},{"type":"v1","addr":"172.21.15.113:6829","nonce":34102}]},"public_addr":"172.21.15.113:6825/34102","cluster_addr":"172.21.15.113:6827/34102","heartbeat_back_addr":"172.21.15.113:6831/34102","heartbeat_front_addr":"172.21.15.113:6829/34102","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.812672+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.825045+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.700105+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.856563+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.954683+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.883234+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.883994+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.821686+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T10:00:28.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.430+0000 7fa823a1b700 1 -- 172.21.15.45:0/3297086825 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fa80005a540 msgr2=0x7fa80005ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:28.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.430+0000 7fa823a1b700 1 --2- 172.21.15.45:0/3297086825 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fa80005a540 0x7fa80005ca00 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fa8180036d0 tx=0x7fa818009040).stop 2023-12-22T10:00:28.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.430+0000 7fa823a1b700 1 -- 172.21.15.45:0/3297086825 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa81c1581f0 msgr2=0x7fa81c0abd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:28.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.430+0000 7fa823a1b700 1 --2- 172.21.15.45:0/3297086825 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa81c1581f0 0x7fa81c0abd40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fa814011000 tx=0x7fa814009780).stop 2023-12-22T10:00:28.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.430+0000 7fa823a1b700 1 -- 172.21.15.45:0/3297086825 shutdown_connections 2023-12-22T10:00:28.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.430+0000 7fa823a1b700 1 --2- 172.21.15.45:0/3297086825 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa81c1581f0 0x7fa81c0abd40 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:28.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.430+0000 7fa823a1b700 1 --2- 172.21.15.45:0/3297086825 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fa80005a540 0x7fa80005ca00 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:28.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.430+0000 7fa823a1b700 1 --2- 172.21.15.45:0/3297086825 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fa81c157e10 0x7fa81c0aacd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:28.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.430+0000 7fa823a1b700 1 --2- 172.21.15.45:0/3297086825 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa81c0a8080 0x7fa81c0bc6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:28.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.430+0000 7fa823a1b700 1 -- 172.21.15.45:0/3297086825 >> 172.21.15.45:0/3297086825 conn(0x7fa81c066a70 msgr2=0x7fa81c154990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:28.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.430+0000 7fa823a1b700 1 -- 172.21.15.45:0/3297086825 shutdown_connections 2023-12-22T10:00:28.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.430+0000 7fa823a1b700 1 -- 172.21.15.45:0/3297086825 wait complete. 2023-12-22T10:00:28.447 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-12-22T10:00:25.069641+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-12-22T10:00:26.906399+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-12-22T10:00:28.447 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-12-22T10:00:28.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.618+0000 7f7bed31b700 1 Processor -- start 2023-12-22T10:00:28.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.618+0000 7f7bed31b700 1 -- start start 2023-12-22T10:00:28.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.622+0000 7f7bed31b700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7be80c3320 0x7f7be80c3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:28.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.622+0000 7f7bed31b700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7be80c23f0 0x7f7be80c2880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:28.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.622+0000 7f7bed31b700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7be8065020 con 0x7f7be8153a50 2023-12-22T10:00:28.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.622+0000 7f7bed31b700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7be8065300 con 0x7f7be80c3320 2023-12-22T10:00:28.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.622+0000 7f7bed31b700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7be80655e0 con 0x7f7be80c23f0 2023-12-22T10:00:28.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.622+0000 7f7be67fc700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7be80c3320 0x7f7be80c3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:28.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.622+0000 7f7be67fc700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7be80c3320 0x7f7be80c3750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.45:49190/0 (socket says 172.21.15.45:49190) 2023-12-22T10:00:28.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.622+0000 7f7be67fc700 1 -- 172.21.15.45:0/2333348636 learned_addr learned my addr 172.21.15.45:0/2333348636 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:28.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.622+0000 7f7be77fe700 1 --2- 172.21.15.45:0/2333348636 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7be80c23f0 0x7f7be80c2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:28.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.622+0000 7f7be67fc700 1 -- 172.21.15.45:0/2333348636 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7be80c23f0 msgr2=0x7f7be80c2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:00:28.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.622+0000 7f7be67fc700 1 --2- 172.21.15.45:0/2333348636 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7be80c23f0 0x7f7be80c2880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:28.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.622+0000 7f7be67fc700 1 -- 172.21.15.45:0/2333348636 >> v1:172.21.15.113:6789/0 conn(0x7f7be8153a50 legacy=0x7f7be8153e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:28.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.622+0000 7f7be67fc700 1 -- 172.21.15.45:0/2333348636 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7be80658c0 con 0x7f7be80c3320 2023-12-22T10:00:28.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.622+0000 7f7be67fc700 1 --2- 172.21.15.45:0/2333348636 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7be80c3320 0x7f7be80c3750 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f7bdc006fd0 tx=0x7f7bdc0090f0).ready entity=mon.1 client_cookie=892983aa6462a706 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:28.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.626+0000 7f7be5ffb700 1 -- 172.21.15.45:0/2333348636 <== mon.1 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bdc00b610 con 0x7f7be80c3320 2023-12-22T10:00:28.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.626+0000 7f7be5ffb700 1 -- 172.21.15.45:0/2333348636 <== mon.1 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bdc00b770 con 0x7f7be80c3320 2023-12-22T10:00:28.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.626+0000 7f7be5ffb700 1 -- 172.21.15.45:0/2333348636 <== mon.1 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bdc00baf0 con 0x7f7be80c3320 2023-12-22T10:00:28.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.626+0000 7f7bed31b700 1 -- 172.21.15.45:0/2333348636 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7be80c3320 msgr2=0x7f7be80c3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:28.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.626+0000 7f7bed31b700 1 --2- 172.21.15.45:0/2333348636 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7be80c3320 0x7f7be80c3750 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f7bdc006fd0 tx=0x7f7bdc0090f0).stop 2023-12-22T10:00:28.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.626+0000 7f7bed31b700 1 -- 172.21.15.45:0/2333348636 shutdown_connections 2023-12-22T10:00:28.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.626+0000 7f7bed31b700 1 --2- 172.21.15.45:0/2333348636 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7be80c23f0 0x7f7be80c2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:28.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.626+0000 7f7bed31b700 1 --2- 172.21.15.45:0/2333348636 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7be80c3320 0x7f7be80c3750 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:28.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.626+0000 7f7bed31b700 1 -- 172.21.15.45:0/2333348636 >> 172.21.15.45:0/2333348636 conn(0x7f7be8066a70 msgr2=0x7f7be8066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:28.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.626+0000 7f7bed31b700 1 -- 172.21.15.45:0/2333348636 shutdown_connections 2023-12-22T10:00:28.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.626+0000 7f7bed31b700 1 -- 172.21.15.45:0/2333348636 wait complete. 2023-12-22T10:00:28.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.630+0000 7f7bed31b700 1 Processor -- start 2023-12-22T10:00:28.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.630+0000 7f7bed31b700 1 -- start start 2023-12-22T10:00:28.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.630+0000 7f7bed31b700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7be80c23f0 0x7f7be80a8d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:28.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.630+0000 7f7bed31b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7be80c3320 0x7f7be8167bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:28.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.630+0000 7f7bed31b700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7be8153a50 0x7f7be8151550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:28.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.630+0000 7f7bed31b700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7be80a9260 con 0x7f7be80c3320 2023-12-22T10:00:28.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.630+0000 7f7bed31b700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7be81680b0 con 0x7f7be8153a50 2023-12-22T10:00:28.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.630+0000 7f7bed31b700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7be81682c0 con 0x7f7be80c23f0 2023-12-22T10:00:28.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.630+0000 7f7be67fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7be80c3320 0x7f7be8167bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:28.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.630+0000 7f7be67fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7be80c3320 0x7f7be8167bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42166/0 (socket says 172.21.15.45:42166) 2023-12-22T10:00:28.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.630+0000 7f7be67fc700 1 -- 172.21.15.45:0/3979885780 learned_addr learned my addr 172.21.15.45:0/3979885780 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:28.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.630+0000 7f7be77fe700 1 --2- 172.21.15.45:0/3979885780 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7be8153a50 0x7f7be8151550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:28.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.630+0000 7f7be6ffd700 1 --2- 172.21.15.45:0/3979885780 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7be80c23f0 0x7f7be80a8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:28.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.630+0000 7f7be67fc700 1 -- 172.21.15.45:0/3979885780 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7be80c23f0 msgr2=0x7f7be80a8d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:28.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.630+0000 7f7be67fc700 1 --2- 172.21.15.45:0/3979885780 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7be80c23f0 0x7f7be80a8d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:28.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.630+0000 7f7be67fc700 1 -- 172.21.15.45:0/3979885780 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7be8153a50 msgr2=0x7f7be8151550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:28.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.630+0000 7f7be67fc700 1 --2- 172.21.15.45:0/3979885780 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7be8153a50 0x7f7be8151550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:28.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.630+0000 7f7be67fc700 1 -- 172.21.15.45:0/3979885780 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bdc009370 con 0x7f7be80c3320 2023-12-22T10:00:28.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.630+0000 7f7be6ffd700 1 --2- 172.21.15.45:0/3979885780 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7be80c23f0 0x7f7be80a8d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T10:00:28.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.634+0000 7f7be67fc700 1 --2- 172.21.15.45:0/3979885780 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7be80c3320 0x7f7be8167bc0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f7bdc009130 tx=0x7f7bdc017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:28.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.634+0000 7f7bceffd700 1 -- 172.21.15.45:0/3979885780 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bdc00b8e0 con 0x7f7be80c3320 2023-12-22T10:00:28.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.634+0000 7f7bceffd700 1 -- 172.21.15.45:0/3979885780 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bdc00ba40 con 0x7f7be80c3320 2023-12-22T10:00:28.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.634+0000 7f7bceffd700 1 -- 172.21.15.45:0/3979885780 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bdc01c670 con 0x7f7be80c3320 2023-12-22T10:00:28.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.634+0000 7f7bed31b700 1 -- 172.21.15.45:0/3979885780 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7be81685a0 con 0x7f7be80c3320 2023-12-22T10:00:28.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.634+0000 7f7bed31b700 1 -- 172.21.15.45:0/3979885780 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7be8154800 con 0x7f7be80c3320 2023-12-22T10:00:28.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.634+0000 7f7bed31b700 1 -- 172.21.15.45:0/3979885780 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7be8168aa0 con 0x7f7be80c3320 2023-12-22T10:00:28.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.638+0000 7f7bceffd700 1 -- 172.21.15.45:0/3979885780 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f7bdc01ca20 con 0x7f7be80c3320 2023-12-22T10:00:28.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.638+0000 7f7bceffd700 1 --2- 172.21.15.45:0/3979885780 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f7bd405a510 0x7f7bd405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:28.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.638+0000 7f7bceffd700 1 -- 172.21.15.45:0/3979885780 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f7bdc0762b0 con 0x7f7be80c3320 2023-12-22T10:00:28.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.638+0000 7f7be6ffd700 1 --2- 172.21.15.45:0/3979885780 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f7bd405a510 0x7f7bd405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:28.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.638+0000 7f7be6ffd700 1 --2- 172.21.15.45:0/3979885780 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f7bd405a510 0x7f7bd405c9d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f7bd8001690 tx=0x7f7bd8009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:28.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.642+0000 7f7bceffd700 1 -- 172.21.15.45:0/3979885780 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f7bdc049d20 con 0x7f7be80c3320 2023-12-22T10:00:28.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.806+0000 7f7bed31b700 1 -- 172.21.15.45:0/3979885780 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f7be81549f0 con 0x7f7be80c3320 2023-12-22T10:00:28.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.806+0000 7f7bceffd700 1 -- 172.21.15.45:0/3979885780 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v16) v1 ==== 110+0+10 (secure 0 0 0) 0x7f7bdc020020 con 0x7f7be80c3320 2023-12-22T10:00:28.804 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-12-22T10:00:28.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.810+0000 7f7bed31b700 1 -- 172.21.15.45:0/3979885780 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f7bd405a510 msgr2=0x7f7bd405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:28.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.810+0000 7f7bed31b700 1 --2- 172.21.15.45:0/3979885780 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f7bd405a510 0x7f7bd405c9d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f7bd8001690 tx=0x7f7bd8009040).stop 2023-12-22T10:00:28.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.810+0000 7f7bed31b700 1 -- 172.21.15.45:0/3979885780 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7be80c3320 msgr2=0x7f7be8167bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:28.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.810+0000 7f7bed31b700 1 --2- 172.21.15.45:0/3979885780 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7be80c3320 0x7f7be8167bc0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f7bdc009130 tx=0x7f7bdc017000).stop 2023-12-22T10:00:28.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.810+0000 7f7bed31b700 1 -- 172.21.15.45:0/3979885780 shutdown_connections 2023-12-22T10:00:28.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.810+0000 7f7bed31b700 1 --2- 172.21.15.45:0/3979885780 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7be8153a50 0x7f7be8151550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:28.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.810+0000 7f7bed31b700 1 --2- 172.21.15.45:0/3979885780 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7be80c3320 0x7f7be8167bc0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:28.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.810+0000 7f7bed31b700 1 --2- 172.21.15.45:0/3979885780 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f7bd405a510 0x7f7bd405c9d0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:28.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.810+0000 7f7bed31b700 1 --2- 172.21.15.45:0/3979885780 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7be80c23f0 0x7f7be80a8d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:28.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.810+0000 7f7bed31b700 1 -- 172.21.15.45:0/3979885780 >> 172.21.15.45:0/3979885780 conn(0x7f7be8066a70 msgr2=0x7f7be8151d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:28.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.814+0000 7f7bed31b700 1 -- 172.21.15.45:0/3979885780 shutdown_connections 2023-12-22T10:00:28.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:28.814+0000 7f7bed31b700 1 -- 172.21.15.45:0/3979885780 wait complete. 2023-12-22T10:00:28.830 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-12-22T10:00:29.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.002+0000 7fac98c8f700 1 Processor -- start 2023-12-22T10:00:29.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.002+0000 7fac98c8f700 1 -- start start 2023-12-22T10:00:29.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.006+0000 7fac98c8f700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fac940691c0 0x7fac940ad080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:29.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.006+0000 7fac98c8f700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fac940c9d20 0x7fac940c97e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:29.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.006+0000 7fac98c8f700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac940c5810 con 0x7fac940acca0 2023-12-22T10:00:29.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.006+0000 7fac98c8f700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac940c8d90 con 0x7fac940691c0 2023-12-22T10:00:29.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.006+0000 7fac98c8f700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac940c9350 con 0x7fac940c9d20 2023-12-22T10:00:29.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.006+0000 7fac92ffd700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fac940691c0 0x7fac940ad080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:29.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.006+0000 7fac937fe700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fac940acca0 0x7fac94068ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:46504/0 (socket says 172.21.15.45:46504) 2023-12-22T10:00:29.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.006+0000 7fac937fe700 1 -- 172.21.15.45:0/1633353435 learned_addr learned my addr 172.21.15.45:0/1633353435 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:00:29.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.006+0000 7fac93fff700 1 --2- 172.21.15.45:0/1633353435 >> v2:172.21.15.113:3300/0 conn(0x7fac940c9d20 0x7fac940c97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:29.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.006+0000 7fac92ffd700 1 -- 172.21.15.45:0/1633353435 >> v2:172.21.15.113:3300/0 conn(0x7fac940c9d20 msgr2=0x7fac940c97e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:00:29.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.006+0000 7fac92ffd700 1 --2- 172.21.15.45:0/1633353435 >> v2:172.21.15.113:3300/0 conn(0x7fac940c9d20 0x7fac940c97e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:29.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.006+0000 7fac927fc700 1 -- 172.21.15.45:0/1633353435 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1286982200 0 0) 0x7fac940c5810 con 0x7fac940acca0 2023-12-22T10:00:29.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.006+0000 7fac92ffd700 1 -- 172.21.15.45:0/1633353435 >> v1:172.21.15.45:6789/0 conn(0x7fac940acca0 legacy=0x7fac94068ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:29.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.006+0000 7fac92ffd700 1 -- 172.21.15.45:0/1633353435 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac94154070 con 0x7fac940691c0 2023-12-22T10:00:29.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.006+0000 7fac92ffd700 1 --2- 172.21.15.45:0/1633353435 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac940691c0 0x7fac940ad080 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fac94069680 tx=0x7fac88009060).ready entity=mon.0 client_cookie=3f36a1b5ba8ba4c0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:29.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.006+0000 7fac927fc700 1 -- 172.21.15.45:0/1633353435 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac8800f510 con 0x7fac940691c0 2023-12-22T10:00:29.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.006+0000 7fac927fc700 1 -- 172.21.15.45:0/1633353435 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac8800f670 con 0x7fac940691c0 2023-12-22T10:00:29.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.006+0000 7fac927fc700 1 -- 172.21.15.45:0/1633353435 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac8800f9f0 con 0x7fac940691c0 2023-12-22T10:00:29.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.006+0000 7fac98c8f700 1 -- 172.21.15.45:0/1633353435 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac940691c0 msgr2=0x7fac940ad080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:29.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.006+0000 7fac98c8f700 1 --2- 172.21.15.45:0/1633353435 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac940691c0 0x7fac940ad080 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fac94069680 tx=0x7fac88009060).stop 2023-12-22T10:00:29.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.006+0000 7fac98c8f700 1 -- 172.21.15.45:0/1633353435 shutdown_connections 2023-12-22T10:00:29.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.006+0000 7fac98c8f700 1 --2- 172.21.15.45:0/1633353435 >> v2:172.21.15.113:3300/0 conn(0x7fac940c9d20 0x7fac940c97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:29.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.006+0000 7fac98c8f700 1 --2- 172.21.15.45:0/1633353435 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac940691c0 0x7fac940ad080 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:29.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.006+0000 7fac98c8f700 1 -- 172.21.15.45:0/1633353435 >> 172.21.15.45:0/1633353435 conn(0x7fac940674f0 msgr2=0x7fac940ca820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:29.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.010+0000 7fac98c8f700 1 -- 172.21.15.45:0/1633353435 shutdown_connections 2023-12-22T10:00:29.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.010+0000 7fac98c8f700 1 -- 172.21.15.45:0/1633353435 wait complete. 2023-12-22T10:00:29.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.010+0000 7fac98c8f700 1 Processor -- start 2023-12-22T10:00:29.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.010+0000 7fac98c8f700 1 -- start start 2023-12-22T10:00:29.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.010+0000 7fac98c8f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac940691c0 0x7fac940adcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:29.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.014+0000 7fac98c8f700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fac940acca0 0x7fac941670a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:29.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.014+0000 7fac98c8f700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fac940c9d20 0x7fac94163c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:29.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.014+0000 7fac98c8f700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac940ae500 con 0x7fac940691c0 2023-12-22T10:00:29.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.014+0000 7fac98c8f700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac941678a0 con 0x7fac940c9d20 2023-12-22T10:00:29.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.014+0000 7fac98c8f700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac94167b80 con 0x7fac940acca0 2023-12-22T10:00:29.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.014+0000 7fac937fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac940691c0 0x7fac940adcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:29.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.014+0000 7fac937fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac940691c0 0x7fac940adcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42184/0 (socket says 172.21.15.45:42184) 2023-12-22T10:00:29.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.014+0000 7fac937fe700 1 -- 172.21.15.45:0/3916764909 learned_addr learned my addr 172.21.15.45:0/3916764909 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:29.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.014+0000 7fac92ffd700 1 --2- 172.21.15.45:0/3916764909 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fac940acca0 0x7fac941670a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:29.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.014+0000 7fac93fff700 1 --2- 172.21.15.45:0/3916764909 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fac940c9d20 0x7fac94163c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:29.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.014+0000 7fac937fe700 1 -- 172.21.15.45:0/3916764909 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fac940acca0 msgr2=0x7fac941670a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:29.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.014+0000 7fac937fe700 1 --2- 172.21.15.45:0/3916764909 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fac940acca0 0x7fac941670a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:29.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.014+0000 7fac937fe700 1 -- 172.21.15.45:0/3916764909 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fac940c9d20 msgr2=0x7fac94163c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:29.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.014+0000 7fac937fe700 1 --2- 172.21.15.45:0/3916764909 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fac940c9d20 0x7fac94163c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:29.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.014+0000 7fac937fe700 1 -- 172.21.15.45:0/3916764909 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac880092a0 con 0x7fac940691c0 2023-12-22T10:00:29.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.014+0000 7fac93fff700 1 --2- 172.21.15.45:0/3916764909 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fac940c9d20 0x7fac94163c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-12-22T10:00:29.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.014+0000 7fac937fe700 1 --2- 172.21.15.45:0/3916764909 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac940691c0 0x7fac940adcf0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fac8400c4e0 tx=0x7fac84007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:29.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.014+0000 7fac7b7fe700 1 -- 172.21.15.45:0/3916764909 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac840072e0 con 0x7fac940691c0 2023-12-22T10:00:29.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.014+0000 7fac7b7fe700 1 -- 172.21.15.45:0/3916764909 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac84007440 con 0x7fac940691c0 2023-12-22T10:00:29.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.014+0000 7fac7b7fe700 1 -- 172.21.15.45:0/3916764909 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac840057a0 con 0x7fac940691c0 2023-12-22T10:00:29.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.014+0000 7fac98c8f700 1 -- 172.21.15.45:0/3916764909 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac94167e60 con 0x7fac940691c0 2023-12-22T10:00:29.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.014+0000 7fac98c8f700 1 -- 172.21.15.45:0/3916764909 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac941640f0 con 0x7fac940691c0 2023-12-22T10:00:29.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.014+0000 7fac98c8f700 1 -- 172.21.15.45:0/3916764909 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac941642e0 con 0x7fac940691c0 2023-12-22T10:00:29.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.018+0000 7fac7b7fe700 1 -- 172.21.15.45:0/3916764909 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fac84005bd0 con 0x7fac940691c0 2023-12-22T10:00:29.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.018+0000 7fac7b7fe700 1 --2- 172.21.15.45:0/3916764909 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fac8005a540 0x7fac8005ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:29.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.018+0000 7fac7b7fe700 1 -- 172.21.15.45:0/3916764909 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fac84073c80 con 0x7fac940691c0 2023-12-22T10:00:29.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.018+0000 7fac92ffd700 1 --2- 172.21.15.45:0/3916764909 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fac8005a540 0x7fac8005ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:29.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.018+0000 7fac92ffd700 1 --2- 172.21.15.45:0/3916764909 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fac8005a540 0x7fac8005ca00 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fac940695c0 tx=0x7fac88017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:29.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.026+0000 7fac7b7fe700 1 -- 172.21.15.45:0/3916764909 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fac840476f0 con 0x7fac940691c0 2023-12-22T10:00:29.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.194+0000 7fac98c8f700 1 -- 172.21.15.45:0/3916764909 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fac94168050 con 0x7fac940691c0 2023-12-22T10:00:29.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.194+0000 7fac7b7fe700 1 -- 172.21.15.45:0/3916764909 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v17) v1 ==== 92+0+10 (secure 0 0 0) 0x7fac8404ad10 con 0x7fac940691c0 2023-12-22T10:00:29.190 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-12-22T10:00:29.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.194+0000 7fac98c8f700 1 -- 172.21.15.45:0/3916764909 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fac8005a540 msgr2=0x7fac8005ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:29.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.194+0000 7fac98c8f700 1 --2- 172.21.15.45:0/3916764909 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fac8005a540 0x7fac8005ca00 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fac940695c0 tx=0x7fac88017000).stop 2023-12-22T10:00:29.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.194+0000 7fac98c8f700 1 -- 172.21.15.45:0/3916764909 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac940691c0 msgr2=0x7fac940adcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:29.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.194+0000 7fac98c8f700 1 --2- 172.21.15.45:0/3916764909 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac940691c0 0x7fac940adcf0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fac8400c4e0 tx=0x7fac84007c70).stop 2023-12-22T10:00:29.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.194+0000 7fac98c8f700 1 -- 172.21.15.45:0/3916764909 shutdown_connections 2023-12-22T10:00:29.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.194+0000 7fac98c8f700 1 --2- 172.21.15.45:0/3916764909 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fac940c9d20 0x7fac94163c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:29.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.198+0000 7fac98c8f700 1 --2- 172.21.15.45:0/3916764909 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fac8005a540 0x7fac8005ca00 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:29.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.198+0000 7fac98c8f700 1 --2- 172.21.15.45:0/3916764909 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fac940acca0 0x7fac941670a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:29.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.198+0000 7fac98c8f700 1 --2- 172.21.15.45:0/3916764909 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac940691c0 0x7fac940adcf0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:29.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.198+0000 7fac98c8f700 1 -- 172.21.15.45:0/3916764909 >> 172.21.15.45:0/3916764909 conn(0x7fac940674f0 msgr2=0x7fac940aaa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:29.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.198+0000 7fac98c8f700 1 -- 172.21.15.45:0/3916764909 shutdown_connections 2023-12-22T10:00:29.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.198+0000 7fac98c8f700 1 -- 172.21.15.45:0/3916764909 wait complete. 2023-12-22T10:00:29.214 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T10:00:29.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.378+0000 7ffb32db9700 1 Processor -- start 2023-12-22T10:00:29.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.378+0000 7ffb32db9700 1 -- start start 2023-12-22T10:00:29.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.382+0000 7ffb32db9700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ffb2c0a8eb0 0x7ffb2c065860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:29.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.382+0000 7ffb32db9700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7ffb2c15bb60 0x7ffb2c15bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:29.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.382+0000 7ffb32db9700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb2c0c17e0 con 0x7ffb2c0a8ad0 2023-12-22T10:00:29.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.382+0000 7ffb32db9700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb2c0c2630 con 0x7ffb2c0a8eb0 2023-12-22T10:00:29.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.382+0000 7ffb32db9700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb2c1584c0 con 0x7ffb2c15bb60 2023-12-22T10:00:29.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.382+0000 7ffb315b6700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ffb2c0a8eb0 0x7ffb2c065860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:29.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.382+0000 7ffb315b6700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ffb2c0a8eb0 0x7ffb2c065860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42198/0 (socket says 172.21.15.45:42198) 2023-12-22T10:00:29.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.382+0000 7ffb315b6700 1 -- 172.21.15.45:0/3929644736 learned_addr learned my addr 172.21.15.45:0/3929644736 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:29.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.382+0000 7ffb31db7700 1 --1- 172.21.15.45:0/3929644736 >> v1:172.21.15.45:6789/0 conn(0x7ffb2c0a8ad0 0x7ffb2c0c10d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:46516/0 (socket says 172.21.15.45:46516) 2023-12-22T10:00:29.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.382+0000 7ffb325b8700 1 --2- 172.21.15.45:0/3929644736 >> v2:172.21.15.113:3300/0 conn(0x7ffb2c15bb60 0x7ffb2c15bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:29.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.382+0000 7ffb315b6700 1 -- 172.21.15.45:0/3929644736 >> v2:172.21.15.113:3300/0 conn(0x7ffb2c15bb60 msgr2=0x7ffb2c15bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:00:29.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.382+0000 7ffb315b6700 1 --2- 172.21.15.45:0/3929644736 >> v2:172.21.15.113:3300/0 conn(0x7ffb2c15bb60 0x7ffb2c15bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:29.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.382+0000 7ffb315b6700 1 -- 172.21.15.45:0/3929644736 >> v1:172.21.15.45:6789/0 conn(0x7ffb2c0a8ad0 legacy=0x7ffb2c0c10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:29.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.382+0000 7ffb315b6700 1 -- 172.21.15.45:0/3929644736 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb2c15c4e0 con 0x7ffb2c0a8eb0 2023-12-22T10:00:29.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.382+0000 7ffb30db5700 1 -- 172.21.15.45:0/3929644736 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3784046554 0 0) 0x7ffb28001110 con 0x7ffb2c0a8ad0 2023-12-22T10:00:29.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.386+0000 7ffb315b6700 1 --2- 172.21.15.45:0/3929644736 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb2c0a8eb0 0x7ffb2c065860 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7ffb2c0bb490 tx=0x7ffb1c0090f0).ready entity=mon.0 client_cookie=620a7db5b55de3c6 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:29.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.386+0000 7ffb30db5700 1 -- 172.21.15.45:0/3929644736 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb1c00b520 con 0x7ffb2c0a8eb0 2023-12-22T10:00:29.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.386+0000 7ffb30db5700 1 -- 172.21.15.45:0/3929644736 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb1c00b680 con 0x7ffb2c0a8eb0 2023-12-22T10:00:29.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.386+0000 7ffb30db5700 1 -- 172.21.15.45:0/3929644736 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb1c00ba00 con 0x7ffb2c0a8eb0 2023-12-22T10:00:29.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.386+0000 7ffb32db9700 1 -- 172.21.15.45:0/3929644736 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb2c0a8eb0 msgr2=0x7ffb2c065860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:29.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.386+0000 7ffb32db9700 1 --2- 172.21.15.45:0/3929644736 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb2c0a8eb0 0x7ffb2c065860 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7ffb2c0bb490 tx=0x7ffb1c0090f0).stop 2023-12-22T10:00:29.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.386+0000 7ffb32db9700 1 -- 172.21.15.45:0/3929644736 shutdown_connections 2023-12-22T10:00:29.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.386+0000 7ffb32db9700 1 --2- 172.21.15.45:0/3929644736 >> v2:172.21.15.113:3300/0 conn(0x7ffb2c15bb60 0x7ffb2c15bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:29.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.386+0000 7ffb32db9700 1 --2- 172.21.15.45:0/3929644736 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb2c0a8eb0 0x7ffb2c065860 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:29.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.386+0000 7ffb32db9700 1 -- 172.21.15.45:0/3929644736 >> 172.21.15.45:0/3929644736 conn(0x7ffb2c067540 msgr2=0x7ffb2c0c6460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:29.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.386+0000 7ffb32db9700 1 -- 172.21.15.45:0/3929644736 shutdown_connections 2023-12-22T10:00:29.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.386+0000 7ffb32db9700 1 -- 172.21.15.45:0/3929644736 wait complete. 2023-12-22T10:00:29.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.390+0000 7ffb32db9700 1 Processor -- start 2023-12-22T10:00:29.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.390+0000 7ffb32db9700 1 -- start start 2023-12-22T10:00:29.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.390+0000 7ffb32db9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb2c0a8ad0 0x7ffb2c0a9900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:29.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.390+0000 7ffb32db9700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ffb2c15bb60 0x7ffb2c0aa890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:29.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.390+0000 7ffb32db9700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffb2c158680 0x7ffb2c0c4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:29.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.390+0000 7ffb32db9700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb2c159e00 con 0x7ffb2c0a8ad0 2023-12-22T10:00:29.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.390+0000 7ffb32db9700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb2c15a0e0 con 0x7ffb2c158680 2023-12-22T10:00:29.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.390+0000 7ffb32db9700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb2c158ed0 con 0x7ffb2c15bb60 2023-12-22T10:00:29.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.394+0000 7ffb31db7700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb2c0a8ad0 0x7ffb2c0a9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:29.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.394+0000 7ffb31db7700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb2c0a8ad0 0x7ffb2c0a9900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42212/0 (socket says 172.21.15.45:42212) 2023-12-22T10:00:29.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.394+0000 7ffb31db7700 1 -- 172.21.15.45:0/3940364063 learned_addr learned my addr 172.21.15.45:0/3940364063 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:29.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.394+0000 7ffb315b6700 1 --2- 172.21.15.45:0/3940364063 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ffb2c15bb60 0x7ffb2c0aa890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:29.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.394+0000 7ffb325b8700 1 --2- 172.21.15.45:0/3940364063 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffb2c158680 0x7ffb2c0c4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:29.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.394+0000 7ffb31db7700 1 -- 172.21.15.45:0/3940364063 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ffb2c15bb60 msgr2=0x7ffb2c0aa890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:29.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.394+0000 7ffb31db7700 1 --2- 172.21.15.45:0/3940364063 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ffb2c15bb60 0x7ffb2c0aa890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:29.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.394+0000 7ffb31db7700 1 -- 172.21.15.45:0/3940364063 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffb2c158680 msgr2=0x7ffb2c0c4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:29.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.394+0000 7ffb31db7700 1 --2- 172.21.15.45:0/3940364063 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffb2c158680 0x7ffb2c0c4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:29.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.394+0000 7ffb31db7700 1 -- 172.21.15.45:0/3940364063 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb1c009370 con 0x7ffb2c0a8ad0 2023-12-22T10:00:29.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.394+0000 7ffb31db7700 1 --2- 172.21.15.45:0/3940364063 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb2c0a8ad0 0x7ffb2c0a9900 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7ffb2800c510 tx=0x7ffb28007ad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:29.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.394+0000 7ffb21ffb700 1 -- 172.21.15.45:0/3940364063 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb280072e0 con 0x7ffb2c0a8ad0 2023-12-22T10:00:29.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.394+0000 7ffb21ffb700 1 -- 172.21.15.45:0/3940364063 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb28007440 con 0x7ffb2c0a8ad0 2023-12-22T10:00:29.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.394+0000 7ffb21ffb700 1 -- 172.21.15.45:0/3940364063 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb28005910 con 0x7ffb2c0a8ad0 2023-12-22T10:00:29.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.394+0000 7ffb32db9700 1 -- 172.21.15.45:0/3940364063 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb2c1591b0 con 0x7ffb2c0a8ad0 2023-12-22T10:00:29.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.394+0000 7ffb32db9700 1 -- 172.21.15.45:0/3940364063 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb2c0aad80 con 0x7ffb2c0a8ad0 2023-12-22T10:00:29.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.394+0000 7ffb32db9700 1 -- 172.21.15.45:0/3940364063 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb2c047060 con 0x7ffb2c0a8ad0 2023-12-22T10:00:29.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.398+0000 7ffb21ffb700 1 -- 172.21.15.45:0/3940364063 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7ffb28005d00 con 0x7ffb2c0a8ad0 2023-12-22T10:00:29.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.398+0000 7ffb21ffb700 1 --2- 172.21.15.45:0/3940364063 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7ffb1005a510 0x7ffb1005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:29.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.398+0000 7ffb21ffb700 1 -- 172.21.15.45:0/3940364063 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5269+0+0 (secure 0 0 0) 0x7ffb28073a10 con 0x7ffb2c0a8ad0 2023-12-22T10:00:29.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.398+0000 7ffb315b6700 1 --2- 172.21.15.45:0/3940364063 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7ffb1005a510 0x7ffb1005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:29.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.398+0000 7ffb315b6700 1 --2- 172.21.15.45:0/3940364063 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7ffb1005a510 0x7ffb1005c9d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7ffb2c0bb490 tx=0x7ffb1c017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:29.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.406+0000 7ffb21ffb700 1 -- 172.21.15.45:0/3940364063 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ffb28047540 con 0x7ffb2c0a8ad0 2023-12-22T10:00:29.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.614+0000 7ffb32db9700 1 -- 172.21.15.45:0/3940364063 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffb2c0c17e0 con 0x7ffb2c0a8ad0 2023-12-22T10:00:29.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.618+0000 7ffb21ffb700 1 -- 172.21.15.45:0/3940364063 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3530 (secure 0 0 0) 0x7ffb2c0c17e0 con 0x7ffb2c0a8ad0 2023-12-22T10:00:29.614 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:00:29.614 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6833/3021221178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6832","nonce":3021221178},{"type":"v1","addr":"172.21.15.113:6833","nonce":3021221178}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6835/1307046651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":1307046651},{"type":"v1","addr":"172.21.15.113:6835","nonce":1307046651}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/3043486757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":3043486757},{"type":"v1","addr":"172.21.15.45:6835","nonce":3043486757}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/1007404834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":1007404834},{"type":"v1","addr":"172.21.15.45:6837","nonce":1007404834}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-12-22T10:00:29.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.618+0000 7ffb32db9700 1 -- 172.21.15.45:0/3940364063 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7ffb1005a510 msgr2=0x7ffb1005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:29.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.618+0000 7ffb32db9700 1 --2- 172.21.15.45:0/3940364063 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7ffb1005a510 0x7ffb1005c9d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7ffb2c0bb490 tx=0x7ffb1c017000).stop 2023-12-22T10:00:29.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.618+0000 7ffb32db9700 1 -- 172.21.15.45:0/3940364063 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb2c0a8ad0 msgr2=0x7ffb2c0a9900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:29.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.618+0000 7ffb32db9700 1 --2- 172.21.15.45:0/3940364063 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb2c0a8ad0 0x7ffb2c0a9900 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7ffb2800c510 tx=0x7ffb28007ad0).stop 2023-12-22T10:00:29.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.618+0000 7ffb32db9700 1 -- 172.21.15.45:0/3940364063 shutdown_connections 2023-12-22T10:00:29.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.618+0000 7ffb32db9700 1 --2- 172.21.15.45:0/3940364063 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffb2c158680 0x7ffb2c0c4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:29.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.618+0000 7ffb32db9700 1 --2- 172.21.15.45:0/3940364063 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7ffb1005a510 0x7ffb1005c9d0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:29.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.618+0000 7ffb32db9700 1 --2- 172.21.15.45:0/3940364063 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ffb2c15bb60 0x7ffb2c0aa890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:29.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.618+0000 7ffb32db9700 1 --2- 172.21.15.45:0/3940364063 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb2c0a8ad0 0x7ffb2c0a9900 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:29.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.618+0000 7ffb32db9700 1 -- 172.21.15.45:0/3940364063 >> 172.21.15.45:0/3940364063 conn(0x7ffb2c067540 msgr2=0x7ffb2c069f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:29.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.622+0000 7ffb32db9700 1 -- 172.21.15.45:0/3940364063 shutdown_connections 2023-12-22T10:00:29.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.622+0000 7ffb32db9700 1 -- 172.21.15.45:0/3940364063 wait complete. 2023-12-22T10:00:29.619 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 3 2023-12-22T10:00:29.637 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T10:00:29.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.806+0000 7fcb35479700 1 Processor -- start 2023-12-22T10:00:29.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.806+0000 7fcb35479700 1 -- start start 2023-12-22T10:00:29.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.810+0000 7fcb35479700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fcb300a9ed0 0x7fcb300c1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:29.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.810+0000 7fcb35479700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcb300bf910 0x7fcb300bfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:29.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.810+0000 7fcb35479700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb300c0f70 con 0x7fcb300c5960 2023-12-22T10:00:29.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.810+0000 7fcb35479700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb300aa2b0 con 0x7fcb300bf910 2023-12-22T10:00:29.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.810+0000 7fcb35479700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb300c0360 con 0x7fcb300a9ed0 2023-12-22T10:00:29.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.810+0000 7fcb27fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcb300bf910 0x7fcb300bfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:29.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.810+0000 7fcb27fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcb300bf910 0x7fcb300bfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42228/0 (socket says 172.21.15.45:42228) 2023-12-22T10:00:29.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.810+0000 7fcb27fff700 1 -- 172.21.15.45:0/1046952000 learned_addr learned my addr 172.21.15.45:0/1046952000 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:29.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.810+0000 7fcb2ffff700 1 --2- 172.21.15.45:0/1046952000 >> v2:172.21.15.113:3300/0 conn(0x7fcb300a9ed0 0x7fcb300c1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:29.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.814+0000 7fcb27fff700 1 -- 172.21.15.45:0/1046952000 >> v2:172.21.15.113:3300/0 conn(0x7fcb300a9ed0 msgr2=0x7fcb300c1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:00:29.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.814+0000 7fcb27fff700 1 --2- 172.21.15.45:0/1046952000 >> v2:172.21.15.113:3300/0 conn(0x7fcb300a9ed0 0x7fcb300c1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:29.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.814+0000 7fcb27fff700 1 -- 172.21.15.45:0/1046952000 >> v1:172.21.15.113:6789/0 conn(0x7fcb300c5960 legacy=0x7fcb300c5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:29.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.814+0000 7fcb27fff700 1 -- 172.21.15.45:0/1046952000 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb300c0640 con 0x7fcb300bf910 2023-12-22T10:00:29.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.814+0000 7fcb2ffff700 1 --2- 172.21.15.45:0/1046952000 >> v2:172.21.15.113:3300/0 conn(0x7fcb300a9ed0 0x7fcb300c1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T10:00:29.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.814+0000 7fcb27fff700 1 --2- 172.21.15.45:0/1046952000 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb300bf910 0x7fcb300bfd70 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fcb30046db0 tx=0x7fcb180090f0).ready entity=mon.0 client_cookie=b8a0310c576a5daf server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:29.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.814+0000 7fcb2f7fe700 1 -- 172.21.15.45:0/1046952000 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb1800b600 con 0x7fcb300bf910 2023-12-22T10:00:29.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.814+0000 7fcb2f7fe700 1 -- 172.21.15.45:0/1046952000 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb1800b760 con 0x7fcb300bf910 2023-12-22T10:00:29.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.814+0000 7fcb2f7fe700 1 -- 172.21.15.45:0/1046952000 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb1800bae0 con 0x7fcb300bf910 2023-12-22T10:00:29.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.814+0000 7fcb35479700 1 -- 172.21.15.45:0/1046952000 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb300bf910 msgr2=0x7fcb300bfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:29.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.814+0000 7fcb35479700 1 --2- 172.21.15.45:0/1046952000 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb300bf910 0x7fcb300bfd70 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fcb30046db0 tx=0x7fcb180090f0).stop 2023-12-22T10:00:29.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.814+0000 7fcb35479700 1 -- 172.21.15.45:0/1046952000 shutdown_connections 2023-12-22T10:00:29.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.814+0000 7fcb35479700 1 --2- 172.21.15.45:0/1046952000 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb300bf910 0x7fcb300bfd70 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:29.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.814+0000 7fcb35479700 1 --2- 172.21.15.45:0/1046952000 >> v2:172.21.15.113:3300/0 conn(0x7fcb300a9ed0 0x7fcb300c1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:29.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.814+0000 7fcb35479700 1 -- 172.21.15.45:0/1046952000 >> 172.21.15.45:0/1046952000 conn(0x7fcb30067500 msgr2=0x7fcb300ca9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:29.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.814+0000 7fcb35479700 1 -- 172.21.15.45:0/1046952000 shutdown_connections 2023-12-22T10:00:29.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.814+0000 7fcb35479700 1 -- 172.21.15.45:0/1046952000 wait complete. 2023-12-22T10:00:29.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.818+0000 7fcb35479700 1 Processor -- start 2023-12-22T10:00:29.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.818+0000 7fcb35479700 1 -- start start 2023-12-22T10:00:29.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.818+0000 7fcb35479700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcb300a9ed0 0x7fcb301681b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:29.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.818+0000 7fcb35479700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb300bf910 0x7fcb30166f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:29.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.818+0000 7fcb35479700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fcb300c5960 0x7fcb300affc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:29.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.818+0000 7fcb35479700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb30159d90 con 0x7fcb300bf910 2023-12-22T10:00:29.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.818+0000 7fcb35479700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb3015a070 con 0x7fcb300a9ed0 2023-12-22T10:00:29.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.818+0000 7fcb35479700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb3015a350 con 0x7fcb300c5960 2023-12-22T10:00:29.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.818+0000 7fcb27fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb300bf910 0x7fcb30166f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:29.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.818+0000 7fcb27fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb300bf910 0x7fcb30166f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42232/0 (socket says 172.21.15.45:42232) 2023-12-22T10:00:29.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.818+0000 7fcb27fff700 1 -- 172.21.15.45:0/3659870308 learned_addr learned my addr 172.21.15.45:0/3659870308 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:29.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.818+0000 7fcb2ffff700 1 --2- 172.21.15.45:0/3659870308 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcb300a9ed0 0x7fcb301681b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:29.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.822+0000 7fcb34c78700 1 --2- 172.21.15.45:0/3659870308 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fcb300c5960 0x7fcb300affc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:29.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.822+0000 7fcb27fff700 1 -- 172.21.15.45:0/3659870308 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fcb300c5960 msgr2=0x7fcb300affc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:29.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.822+0000 7fcb27fff700 1 --2- 172.21.15.45:0/3659870308 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fcb300c5960 0x7fcb300affc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:29.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.822+0000 7fcb27fff700 1 -- 172.21.15.45:0/3659870308 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcb300a9ed0 msgr2=0x7fcb301681b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:29.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.822+0000 7fcb27fff700 1 --2- 172.21.15.45:0/3659870308 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcb300a9ed0 0x7fcb301681b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:29.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.822+0000 7fcb27fff700 1 -- 172.21.15.45:0/3659870308 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb18009370 con 0x7fcb300bf910 2023-12-22T10:00:29.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.822+0000 7fcb34c78700 1 --2- 172.21.15.45:0/3659870308 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fcb300c5960 0x7fcb300affc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T10:00:29.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.822+0000 7fcb27fff700 1 --2- 172.21.15.45:0/3659870308 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb300bf910 0x7fcb30166f10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fcb30046d80 tx=0x7fcb18017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:29.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.822+0000 7fcb2cff9700 1 -- 172.21.15.45:0/3659870308 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb1800b8d0 con 0x7fcb300bf910 2023-12-22T10:00:29.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.822+0000 7fcb2cff9700 1 -- 172.21.15.45:0/3659870308 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb1800ba50 con 0x7fcb300bf910 2023-12-22T10:00:29.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.822+0000 7fcb35479700 1 -- 172.21.15.45:0/3659870308 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb3015a630 con 0x7fcb300bf910 2023-12-22T10:00:29.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.822+0000 7fcb2cff9700 1 -- 172.21.15.45:0/3659870308 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb1801b660 con 0x7fcb300bf910 2023-12-22T10:00:29.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.822+0000 7fcb35479700 1 -- 172.21.15.45:0/3659870308 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb3015abf0 con 0x7fcb300bf910 2023-12-22T10:00:29.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.822+0000 7fcb35479700 1 -- 172.21.15.45:0/3659870308 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb30047060 con 0x7fcb300bf910 2023-12-22T10:00:29.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.826+0000 7fcb2cff9700 1 -- 172.21.15.45:0/3659870308 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fcb1801b9d0 con 0x7fcb300bf910 2023-12-22T10:00:29.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.826+0000 7fcb2cff9700 1 --2- 172.21.15.45:0/3659870308 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fcb1005a510 0x7fcb1005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:29.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.826+0000 7fcb2cff9700 1 -- 172.21.15.45:0/3659870308 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fcb180759e0 con 0x7fcb300bf910 2023-12-22T10:00:29.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.826+0000 7fcb2ffff700 1 --2- 172.21.15.45:0/3659870308 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fcb1005a510 0x7fcb1005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:29.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.826+0000 7fcb2ffff700 1 --2- 172.21.15.45:0/3659870308 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fcb1005a510 0x7fcb1005c9d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fcb20006d80 tx=0x7fcb20008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:29.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.834+0000 7fcb2cff9700 1 -- 172.21.15.45:0/3659870308 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fcb180494d0 con 0x7fcb300bf910 2023-12-22T10:00:29.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.994+0000 7fcb35479700 1 -- 172.21.15.45:0/3659870308 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcb300c0920 con 0x7fcb300bf910 2023-12-22T10:00:29.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.994+0000 7fcb2cff9700 1 -- 172.21.15.45:0/3659870308 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+13709 (secure 0 0 0) 0x7fcb1801f020 con 0x7fcb300bf910 2023-12-22T10:00:29.992 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:00:29.992 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":17,"fsid":"98b0837e-5e68-4c8f-a1a0-e9424baaad8f","created":"2023-12-22T10:00:15.010174+0000","modified":"2023-12-22T10:00:29.027991+0000","last_up_change":"2023-12-22T10:00:24.980513+0000","last_in_change":"2023-12-22T10:00:17.887172+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-12-22T10:00:25.069641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-12-22T10:00:26.906399+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"e19943a0-1c6b-47df-b6bb-383472077890","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":33777},{"type":"v1","addr":"172.21.15.45:6819","nonce":33777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":33777},{"type":"v1","addr":"172.21.15.45:6822","nonce":33777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":33777},{"type":"v1","addr":"172.21.15.45:6830","nonce":33777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":33777},{"type":"v1","addr":"172.21.15.45:6826","nonce":33777}]},"public_addr":"172.21.15.45:6819/33777","cluster_addr":"172.21.15.45:6822/33777","heartbeat_back_addr":"172.21.15.45:6830/33777","heartbeat_front_addr":"172.21.15.45:6826/33777","state":["exists","up"]},{"osd":1,"uuid":"69670f34-f082-45a7-8f67-e962acc136e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":33775},{"type":"v1","addr":"172.21.15.45:6809","nonce":33775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":33775},{"type":"v1","addr":"172.21.15.45:6811","nonce":33775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":33775},{"type":"v1","addr":"172.21.15.45:6815","nonce":33775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":33775},{"type":"v1","addr":"172.21.15.45:6813","nonce":33775}]},"public_addr":"172.21.15.45:6809/33775","cluster_addr":"172.21.15.45:6811/33775","heartbeat_back_addr":"172.21.15.45:6815/33775","heartbeat_front_addr":"172.21.15.45:6813/33775","state":["exists","up"]},{"osd":2,"uuid":"d909d49b-82b8-401b-9947-e49dd167bb95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":33776},{"type":"v1","addr":"172.21.15.45:6801","nonce":33776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":33776},{"type":"v1","addr":"172.21.15.45:6803","nonce":33776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":33776},{"type":"v1","addr":"172.21.15.45:6807","nonce":33776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":33776},{"type":"v1","addr":"172.21.15.45:6805","nonce":33776}]},"public_addr":"172.21.15.45:6801/33776","cluster_addr":"172.21.15.45:6803/33776","heartbeat_back_addr":"172.21.15.45:6807/33776","heartbeat_front_addr":"172.21.15.45:6805/33776","state":["exists","up"]},{"osd":3,"uuid":"db104ca9-3a94-4d39-a2be-bd06db888095","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":33782},{"type":"v1","addr":"172.21.15.45:6817","nonce":33782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":33782},{"type":"v1","addr":"172.21.15.45:6823","nonce":33782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":33782},{"type":"v1","addr":"172.21.15.45:6831","nonce":33782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":33782},{"type":"v1","addr":"172.21.15.45:6827","nonce":33782}]},"public_addr":"172.21.15.45:6817/33782","cluster_addr":"172.21.15.45:6823/33782","heartbeat_back_addr":"172.21.15.45:6831/33782","heartbeat_front_addr":"172.21.15.45:6827/33782","state":["exists","up"]},{"osd":4,"uuid":"9f4eaff4-e433-4479-a0d1-ee7a33375ca6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":34099},{"type":"v1","addr":"172.21.15.113:6811","nonce":34099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":34099},{"type":"v1","addr":"172.21.15.113:6815","nonce":34099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":34099},{"type":"v1","addr":"172.21.15.113:6823","nonce":34099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6816","nonce":34099},{"type":"v1","addr":"172.21.15.113:6818","nonce":34099}]},"public_addr":"172.21.15.113:6811/34099","cluster_addr":"172.21.15.113:6815/34099","heartbeat_back_addr":"172.21.15.113:6823/34099","heartbeat_front_addr":"172.21.15.113:6818/34099","state":["exists","up"]},{"osd":5,"uuid":"1efc5591-180b-43af-8611-0068aadc5aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":34100},{"type":"v1","addr":"172.21.15.113:6801","nonce":34100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":34100},{"type":"v1","addr":"172.21.15.113:6803","nonce":34100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":34100},{"type":"v1","addr":"172.21.15.113:6807","nonce":34100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":34100},{"type":"v1","addr":"172.21.15.113:6805","nonce":34100}]},"public_addr":"172.21.15.113:6801/34100","cluster_addr":"172.21.15.113:6803/34100","heartbeat_back_addr":"172.21.15.113:6807/34100","heartbeat_front_addr":"172.21.15.113:6805/34100","state":["exists","up"]},{"osd":6,"uuid":"6c89d9d8-c153-4a48-afa9-97e4c403f1ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":34101},{"type":"v1","addr":"172.21.15.113:6810","nonce":34101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6812","nonce":34101},{"type":"v1","addr":"172.21.15.113:6814","nonce":34101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6822","nonce":34101},{"type":"v1","addr":"172.21.15.113:6824","nonce":34101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":34101},{"type":"v1","addr":"172.21.15.113:6819","nonce":34101}]},"public_addr":"172.21.15.113:6810/34101","cluster_addr":"172.21.15.113:6814/34101","heartbeat_back_addr":"172.21.15.113:6824/34101","heartbeat_front_addr":"172.21.15.113:6819/34101","state":["exists","up"]},{"osd":7,"uuid":"1855e70c-23f6-4c08-ad7f-774c2148235b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6821","nonce":34102},{"type":"v1","addr":"172.21.15.113:6825","nonce":34102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":34102},{"type":"v1","addr":"172.21.15.113:6827","nonce":34102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":34102},{"type":"v1","addr":"172.21.15.113:6831","nonce":34102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6828","nonce":34102},{"type":"v1","addr":"172.21.15.113:6829","nonce":34102}]},"public_addr":"172.21.15.113:6825/34102","cluster_addr":"172.21.15.113:6827/34102","heartbeat_back_addr":"172.21.15.113:6831/34102","heartbeat_front_addr":"172.21.15.113:6829/34102","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.812672+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.825045+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.700105+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.856563+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.954683+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.883234+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.883994+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.821686+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T10:00:29.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.998+0000 7fcb35479700 1 -- 172.21.15.45:0/3659870308 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fcb1005a510 msgr2=0x7fcb1005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:29.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.998+0000 7fcb35479700 1 --2- 172.21.15.45:0/3659870308 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fcb1005a510 0x7fcb1005c9d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fcb20006d80 tx=0x7fcb20008040).stop 2023-12-22T10:00:29.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.998+0000 7fcb35479700 1 -- 172.21.15.45:0/3659870308 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb300bf910 msgr2=0x7fcb30166f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:29.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.998+0000 7fcb35479700 1 --2- 172.21.15.45:0/3659870308 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb300bf910 0x7fcb30166f10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fcb30046d80 tx=0x7fcb18017000).stop 2023-12-22T10:00:29.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.998+0000 7fcb35479700 1 -- 172.21.15.45:0/3659870308 shutdown_connections 2023-12-22T10:00:29.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.998+0000 7fcb35479700 1 --2- 172.21.15.45:0/3659870308 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fcb1005a510 0x7fcb1005c9d0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:29.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.998+0000 7fcb35479700 1 --2- 172.21.15.45:0/3659870308 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fcb300c5960 0x7fcb300affc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:29.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.998+0000 7fcb35479700 1 --2- 172.21.15.45:0/3659870308 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb300bf910 0x7fcb30166f10 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:29.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.998+0000 7fcb35479700 1 --2- 172.21.15.45:0/3659870308 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcb300a9ed0 0x7fcb301681b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:29.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:29.998+0000 7fcb35479700 1 -- 172.21.15.45:0/3659870308 >> 172.21.15.45:0/3659870308 conn(0x7fcb30067500 msgr2=0x7fcb300ab870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:29.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.002+0000 7fcb35479700 1 -- 172.21.15.45:0/3659870308 shutdown_connections 2023-12-22T10:00:29.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.002+0000 7fcb35479700 1 -- 172.21.15.45:0/3659870308 wait complete. 2023-12-22T10:00:30.018 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-12-22T10:00:25.069641+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-12-22T10:00:26.906399+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-12-22T10:00:30.019 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-12-22T10:00:30.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.194+0000 7fd26d879700 1 Processor -- start 2023-12-22T10:00:30.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.194+0000 7fd26d879700 1 -- start start 2023-12-22T10:00:30.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.198+0000 7fd26d879700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd2680c9d20 0x7fd2680ad080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:30.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.198+0000 7fd26d879700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2680c5810 con 0x7fd2680acca0 2023-12-22T10:00:30.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.198+0000 7fd26d879700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2680c8d90 con 0x7fd2680691c0 2023-12-22T10:00:30.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.198+0000 7fd26d879700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2680c9350 con 0x7fd2680c9d20 2023-12-22T10:00:30.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.198+0000 7fd26d078700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd2680c9d20 0x7fd2680ad080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:30.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.198+0000 7fd26d078700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd2680c9d20 0x7fd2680ad080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42242/0 (socket says 172.21.15.45:42242) 2023-12-22T10:00:30.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.198+0000 7fd26d078700 1 -- 172.21.15.45:0/2904951011 learned_addr learned my addr 172.21.15.45:0/2904951011 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:30.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.198+0000 7fd26c877700 1 --1- 172.21.15.45:0/2904951011 >> v1:172.21.15.45:6789/0 conn(0x7fd2680acca0 0x7fd268068ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:46526/0 (socket says 172.21.15.45:46526) 2023-12-22T10:00:30.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.198+0000 7fd26d078700 1 -- 172.21.15.45:0/2904951011 >> v1:172.21.15.113:6789/0 conn(0x7fd2680691c0 legacy=0x7fd2680aa5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:30.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.198+0000 7fd26d078700 1 -- 172.21.15.45:0/2904951011 >> v1:172.21.15.45:6789/0 conn(0x7fd2680acca0 legacy=0x7fd268068ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:30.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.198+0000 7fd26d078700 1 -- 172.21.15.45:0/2904951011 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd268154070 con 0x7fd2680c9d20 2023-12-22T10:00:30.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.198+0000 7fd26d078700 1 --2- 172.21.15.45:0/2904951011 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2680c9d20 0x7fd2680ad080 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fd260009f20 tx=0x7fd260009840).ready entity=mon.0 client_cookie=f47489c3cc32eb8b server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:30.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.202+0000 7fd2677fe700 1 -- 172.21.15.45:0/2904951011 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd26000e070 con 0x7fd2680c9d20 2023-12-22T10:00:30.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.202+0000 7fd2677fe700 1 -- 172.21.15.45:0/2904951011 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd26000ba80 con 0x7fd2680c9d20 2023-12-22T10:00:30.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.202+0000 7fd2677fe700 1 -- 172.21.15.45:0/2904951011 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd26000be00 con 0x7fd2680c9d20 2023-12-22T10:00:30.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.202+0000 7fd26d879700 1 -- 172.21.15.45:0/2904951011 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2680c9d20 msgr2=0x7fd2680ad080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:30.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.202+0000 7fd26d879700 1 --2- 172.21.15.45:0/2904951011 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2680c9d20 0x7fd2680ad080 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fd260009f20 tx=0x7fd260009840).stop 2023-12-22T10:00:30.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.202+0000 7fd26d879700 1 -- 172.21.15.45:0/2904951011 shutdown_connections 2023-12-22T10:00:30.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.202+0000 7fd26d879700 1 --2- 172.21.15.45:0/2904951011 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2680c9d20 0x7fd2680ad080 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:30.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.202+0000 7fd26d879700 1 -- 172.21.15.45:0/2904951011 >> 172.21.15.45:0/2904951011 conn(0x7fd2680674f0 msgr2=0x7fd2680ca820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:30.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.202+0000 7fd26d879700 1 -- 172.21.15.45:0/2904951011 shutdown_connections 2023-12-22T10:00:30.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.202+0000 7fd26d879700 1 -- 172.21.15.45:0/2904951011 wait complete. 2023-12-22T10:00:30.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.206+0000 7fd26d879700 1 Processor -- start 2023-12-22T10:00:30.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.206+0000 7fd26d879700 1 -- start start 2023-12-22T10:00:30.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.206+0000 7fd26d879700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd2680691c0 0x7fd268151600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:30.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.206+0000 7fd26d879700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2680acca0 0x7fd268154230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:30.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.206+0000 7fd26d879700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd2680c9d20 0x7fd2680c0750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:30.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.206+0000 7fd26d879700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2680adb40 con 0x7fd2680acca0 2023-12-22T10:00:30.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.206+0000 7fd26d879700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd268154ba0 con 0x7fd2680691c0 2023-12-22T10:00:30.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.206+0000 7fd26d879700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd268154e80 con 0x7fd2680c9d20 2023-12-22T10:00:30.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.210+0000 7fd26c877700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd2680691c0 0x7fd268151600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:30.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.210+0000 7fd267fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2680acca0 0x7fd268154230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:30.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.210+0000 7fd26c877700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd2680691c0 0x7fd268151600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.45:49258/0 (socket says 172.21.15.45:49258) 2023-12-22T10:00:30.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.210+0000 7fd26c877700 1 -- 172.21.15.45:0/774439612 learned_addr learned my addr 172.21.15.45:0/774439612 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:30.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.210+0000 7fd26d078700 1 --2- 172.21.15.45:0/774439612 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd2680c9d20 0x7fd2680c0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:30.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.210+0000 7fd26d078700 1 -- 172.21.15.45:0/774439612 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd2680691c0 msgr2=0x7fd268151600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:30.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.210+0000 7fd26d078700 1 --2- 172.21.15.45:0/774439612 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd2680691c0 0x7fd268151600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:30.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.210+0000 7fd26d078700 1 -- 172.21.15.45:0/774439612 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2680acca0 msgr2=0x7fd268154230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:30.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.210+0000 7fd26d078700 1 --2- 172.21.15.45:0/774439612 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2680acca0 0x7fd268154230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:30.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.210+0000 7fd26d078700 1 -- 172.21.15.45:0/774439612 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd260009ae0 con 0x7fd2680c9d20 2023-12-22T10:00:30.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.210+0000 7fd26d078700 1 --2- 172.21.15.45:0/774439612 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd2680c9d20 0x7fd2680c0750 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fd260013000 tx=0x7fd260009840).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:30.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.210+0000 7fd264ff9700 1 -- 172.21.15.45:0/774439612 <== mon.2 v2:172.21.15.113:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2600092e0 con 0x7fd2680c9d20 2023-12-22T10:00:30.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.210+0000 7fd264ff9700 1 -- 172.21.15.45:0/774439612 <== mon.2 v2:172.21.15.113:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd26001d410 con 0x7fd2680c9d20 2023-12-22T10:00:30.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.210+0000 7fd264ff9700 1 -- 172.21.15.45:0/774439612 <== mon.2 v2:172.21.15.113:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd26001d7d0 con 0x7fd2680c9d20 2023-12-22T10:00:30.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.210+0000 7fd26d879700 1 -- 172.21.15.45:0/774439612 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd268155160 con 0x7fd2680c9d20 2023-12-22T10:00:30.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.210+0000 7fd26d879700 1 -- 172.21.15.45:0/774439612 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd268151af0 con 0x7fd2680c9d20 2023-12-22T10:00:30.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.214+0000 7fd26d879700 1 -- 172.21.15.45:0/774439612 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2680adcb0 con 0x7fd2680c9d20 2023-12-22T10:00:30.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.214+0000 7fd264ff9700 1 -- 172.21.15.45:0/774439612 <== mon.2 v2:172.21.15.113:3301/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fd26001dc00 con 0x7fd2680c9d20 2023-12-22T10:00:30.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.214+0000 7fd264ff9700 1 --2- 172.21.15.45:0/774439612 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fd24c05a540 0x7fd24c05ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:30.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.214+0000 7fd264ff9700 1 -- 172.21.15.45:0/774439612 <== mon.2 v2:172.21.15.113:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fd260075fe0 con 0x7fd2680c9d20 2023-12-22T10:00:30.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.218+0000 7fd26c877700 1 --2- 172.21.15.45:0/774439612 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fd24c05a540 0x7fd24c05ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:30.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.218+0000 7fd26c877700 1 --2- 172.21.15.45:0/774439612 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fd24c05a540 0x7fd24c05ca00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fd25c007fd0 tx=0x7fd25c007df0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:30.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.226+0000 7fd264ff9700 1 -- 172.21.15.45:0/774439612 <== mon.2 v2:172.21.15.113:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd2600a4b00 con 0x7fd2680c9d20 2023-12-22T10:00:30.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.398+0000 7fd26d879700 1 -- 172.21.15.45:0/774439612 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fd268154fc0 con 0x7fd2680c9d20 2023-12-22T10:00:30.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.402+0000 7fd264ff9700 1 -- 172.21.15.45:0/774439612 <== mon.2 v2:172.21.15.113:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v17) v1 ==== 110+0+10 (secure 0 0 0) 0x7fd268154fc0 con 0x7fd2680c9d20 2023-12-22T10:00:30.397 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-12-22T10:00:30.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.402+0000 7fd26d879700 1 -- 172.21.15.45:0/774439612 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fd24c05a540 msgr2=0x7fd24c05ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:30.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.402+0000 7fd26d879700 1 --2- 172.21.15.45:0/774439612 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fd24c05a540 0x7fd24c05ca00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fd25c007fd0 tx=0x7fd25c007df0).stop 2023-12-22T10:00:30.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.402+0000 7fd26d879700 1 -- 172.21.15.45:0/774439612 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd2680c9d20 msgr2=0x7fd2680c0750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:30.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.402+0000 7fd26d879700 1 --2- 172.21.15.45:0/774439612 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd2680c9d20 0x7fd2680c0750 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fd260013000 tx=0x7fd260009840).stop 2023-12-22T10:00:30.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.402+0000 7fd26d879700 1 -- 172.21.15.45:0/774439612 shutdown_connections 2023-12-22T10:00:30.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.402+0000 7fd26d879700 1 --2- 172.21.15.45:0/774439612 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fd24c05a540 0x7fd24c05ca00 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:30.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.402+0000 7fd26d879700 1 --2- 172.21.15.45:0/774439612 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd2680c9d20 0x7fd2680c0750 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:30.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.402+0000 7fd26d879700 1 --2- 172.21.15.45:0/774439612 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2680acca0 0x7fd268154230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:30.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.402+0000 7fd26d879700 1 --2- 172.21.15.45:0/774439612 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd2680691c0 0x7fd268151600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:30.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.402+0000 7fd26d879700 1 -- 172.21.15.45:0/774439612 >> 172.21.15.45:0/774439612 conn(0x7fd2680674f0 msgr2=0x7fd2681524d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:30.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.402+0000 7fd26d879700 1 -- 172.21.15.45:0/774439612 shutdown_connections 2023-12-22T10:00:30.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.402+0000 7fd26d879700 1 -- 172.21.15.45:0/774439612 wait complete. 2023-12-22T10:00:30.420 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-12-22T10:00:30.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.590+0000 7fc6be4db700 1 Processor -- start 2023-12-22T10:00:30.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.590+0000 7fc6be4db700 1 -- start start 2023-12-22T10:00:30.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.594+0000 7fc6be4db700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fc6b8157d40 0x7fc6b8158120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:30.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.594+0000 7fc6be4db700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc6b80c1670 0x7fc6b80c1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:30.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.594+0000 7fc6be4db700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6b80c1fe0 con 0x7fc6b80a5810 2023-12-22T10:00:30.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.594+0000 7fc6be4db700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6b8069e00 con 0x7fc6b8157d40 2023-12-22T10:00:30.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.594+0000 7fc6be4db700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b8069180 con 0x7fc6b80c1670 2023-12-22T10:00:30.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.594+0000 7fc6b7fff700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fc6b8157d40 0x7fc6b8158120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:30.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.594+0000 7fc6affff700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc6b80c1670 0x7fc6b80c1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:30.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.594+0000 7fc6bca78700 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fc6b80a5810 0x7fc6b80a5ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.45:42772/0 (socket says 172.21.15.45:42772) 2023-12-22T10:00:30.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.594+0000 7fc6b7fff700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fc6b8157d40 0x7fc6b8158120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.45:49270/0 (socket says 172.21.15.45:49270) 2023-12-22T10:00:30.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.594+0000 7fc6bca78700 1 -- 172.21.15.45:0/1569198597 learned_addr learned my addr 172.21.15.45:0/1569198597 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:00:30.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.594+0000 7fc6b7fff700 1 -- 172.21.15.45:0/1569198597 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc6b80c1670 msgr2=0x7fc6b80c1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:00:30.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.594+0000 7fc6b7fff700 1 --2- 172.21.15.45:0/1569198597 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc6b80c1670 0x7fc6b80c1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:30.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.594+0000 7fc6b77fe700 1 -- 172.21.15.45:0/1569198597 <== mon.1 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2688065872 0 0) 0x7fc6b80c1fe0 con 0x7fc6b80a5810 2023-12-22T10:00:30.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.594+0000 7fc6b7fff700 1 -- 172.21.15.45:0/1569198597 >> v1:172.21.15.113:6789/0 conn(0x7fc6b80a5810 legacy=0x7fc6b80a5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:30.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.594+0000 7fc6b7fff700 1 -- 172.21.15.45:0/1569198597 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6b8069460 con 0x7fc6b8157d40 2023-12-22T10:00:30.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.594+0000 7fc6b7fff700 1 --2- 172.21.15.45:0/1569198597 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc6b8157d40 0x7fc6b8158120 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fc6a8009760 tx=0x7fc6a8009060).ready entity=mon.1 client_cookie=6eaa2f221351bf96 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:30.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.598+0000 7fc6b77fe700 1 -- 172.21.15.45:0/1569198597 <== mon.1 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a800f510 con 0x7fc6b8157d40 2023-12-22T10:00:30.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.598+0000 7fc6b77fe700 1 -- 172.21.15.45:0/1569198597 <== mon.1 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6a800f670 con 0x7fc6b8157d40 2023-12-22T10:00:30.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.598+0000 7fc6b77fe700 1 -- 172.21.15.45:0/1569198597 <== mon.1 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a800f9f0 con 0x7fc6b8157d40 2023-12-22T10:00:30.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.598+0000 7fc6be4db700 1 -- 172.21.15.45:0/1569198597 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc6b8157d40 msgr2=0x7fc6b8158120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:30.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.598+0000 7fc6be4db700 1 --2- 172.21.15.45:0/1569198597 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc6b8157d40 0x7fc6b8158120 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fc6a8009760 tx=0x7fc6a8009060).stop 2023-12-22T10:00:30.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.598+0000 7fc6be4db700 1 -- 172.21.15.45:0/1569198597 shutdown_connections 2023-12-22T10:00:30.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.598+0000 7fc6be4db700 1 --2- 172.21.15.45:0/1569198597 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc6b80c1670 0x7fc6b80c1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:30.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.598+0000 7fc6be4db700 1 --2- 172.21.15.45:0/1569198597 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc6b8157d40 0x7fc6b8158120 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:30.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.598+0000 7fc6be4db700 1 -- 172.21.15.45:0/1569198597 >> 172.21.15.45:0/1569198597 conn(0x7fc6b8066a70 msgr2=0x7fc6b8066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:30.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.598+0000 7fc6be4db700 1 -- 172.21.15.45:0/1569198597 shutdown_connections 2023-12-22T10:00:30.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.598+0000 7fc6be4db700 1 -- 172.21.15.45:0/1569198597 wait complete. 2023-12-22T10:00:30.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.602+0000 7fc6be4db700 1 Processor -- start 2023-12-22T10:00:30.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.602+0000 7fc6be4db700 1 -- start start 2023-12-22T10:00:30.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.602+0000 7fc6be4db700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc6b80a5810 0x7fc6b8151520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:30.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.602+0000 7fc6be4db700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6b80c1670 0x7fc6b80c6420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:30.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.602+0000 7fc6be4db700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc6b8157d40 0x7fc6b81528b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:30.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.602+0000 7fc6be4db700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b815d5c0 con 0x7fc6b80c1670 2023-12-22T10:00:30.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.602+0000 7fc6be4db700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b815d130 con 0x7fc6b8157d40 2023-12-22T10:00:30.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.602+0000 7fc6be4db700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b815c520 con 0x7fc6b80a5810 2023-12-22T10:00:30.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.602+0000 7fc6affff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6b80c1670 0x7fc6b80c6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:30.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.602+0000 7fc6affff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6b80c1670 0x7fc6b80c6420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42260/0 (socket says 172.21.15.45:42260) 2023-12-22T10:00:30.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.602+0000 7fc6affff700 1 -- 172.21.15.45:0/2019809675 learned_addr learned my addr 172.21.15.45:0/2019809675 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:30.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.606+0000 7fc6bca78700 1 --2- 172.21.15.45:0/2019809675 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc6b8157d40 0x7fc6b81528b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:30.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.606+0000 7fc6b7fff700 1 --2- 172.21.15.45:0/2019809675 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc6b80a5810 0x7fc6b8151520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:30.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.606+0000 7fc6affff700 1 -- 172.21.15.45:0/2019809675 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc6b80a5810 msgr2=0x7fc6b8151520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:30.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.606+0000 7fc6affff700 1 --2- 172.21.15.45:0/2019809675 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc6b80a5810 0x7fc6b8151520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:30.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.606+0000 7fc6affff700 1 -- 172.21.15.45:0/2019809675 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc6b8157d40 msgr2=0x7fc6b81528b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:30.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.606+0000 7fc6affff700 1 --2- 172.21.15.45:0/2019809675 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc6b8157d40 0x7fc6b81528b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:30.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.606+0000 7fc6affff700 1 -- 172.21.15.45:0/2019809675 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6a80092a0 con 0x7fc6b80c1670 2023-12-22T10:00:30.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.606+0000 7fc6bca78700 1 --2- 172.21.15.45:0/2019809675 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc6b8157d40 0x7fc6b81528b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T10:00:30.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.606+0000 7fc6affff700 1 --2- 172.21.15.45:0/2019809675 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6b80c1670 0x7fc6b80c6420 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fc6a000e930 tx=0x7fc6a0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:30.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.606+0000 7fc6b4ff9700 1 -- 172.21.15.45:0/2019809675 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a000eed0 con 0x7fc6b80c1670 2023-12-22T10:00:30.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.606+0000 7fc6b4ff9700 1 -- 172.21.15.45:0/2019809675 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6a000c850 con 0x7fc6b80c1670 2023-12-22T10:00:30.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.606+0000 7fc6be4db700 1 -- 172.21.15.45:0/2019809675 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6b815c800 con 0x7fc6b80c1670 2023-12-22T10:00:30.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.606+0000 7fc6b4ff9700 1 -- 172.21.15.45:0/2019809675 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a000cbd0 con 0x7fc6b80c1670 2023-12-22T10:00:30.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.606+0000 7fc6be4db700 1 -- 172.21.15.45:0/2019809675 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6b815cdc0 con 0x7fc6b80c1670 2023-12-22T10:00:30.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.606+0000 7fc6be4db700 1 -- 172.21.15.45:0/2019809675 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6b806c070 con 0x7fc6b80c1670 2023-12-22T10:00:30.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.610+0000 7fc6b4ff9700 1 -- 172.21.15.45:0/2019809675 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fc6a001b400 con 0x7fc6b80c1670 2023-12-22T10:00:30.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.610+0000 7fc6b4ff9700 1 --2- 172.21.15.45:0/2019809675 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fc69805a510 0x7fc69805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:30.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.610+0000 7fc6b4ff9700 1 -- 172.21.15.45:0/2019809675 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fc6a0074a50 con 0x7fc6b80c1670 2023-12-22T10:00:30.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.610+0000 7fc6b7fff700 1 --2- 172.21.15.45:0/2019809675 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fc69805a510 0x7fc69805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:30.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.610+0000 7fc6b7fff700 1 --2- 172.21.15.45:0/2019809675 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fc69805a510 0x7fc69805c9d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fc6a8009760 tx=0x7fc6a8017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:30.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.618+0000 7fc6b4ff9700 1 -- 172.21.15.45:0/2019809675 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc6a0048460 con 0x7fc6b80c1670 2023-12-22T10:00:30.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.774+0000 7fc6be4db700 1 -- 172.21.15.45:0/2019809675 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc6b80c0af0 con 0x7fc6b80c1670 2023-12-22T10:00:30.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.778+0000 7fc6b4ff9700 1 -- 172.21.15.45:0/2019809675 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v17) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc6a004ba80 con 0x7fc6b80c1670 2023-12-22T10:00:30.773 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-12-22T10:00:30.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.778+0000 7fc6be4db700 1 -- 172.21.15.45:0/2019809675 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fc69805a510 msgr2=0x7fc69805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:30.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.778+0000 7fc6be4db700 1 --2- 172.21.15.45:0/2019809675 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fc69805a510 0x7fc69805c9d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fc6a8009760 tx=0x7fc6a8017000).stop 2023-12-22T10:00:30.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.778+0000 7fc6be4db700 1 -- 172.21.15.45:0/2019809675 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6b80c1670 msgr2=0x7fc6b80c6420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:30.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.778+0000 7fc6be4db700 1 --2- 172.21.15.45:0/2019809675 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6b80c1670 0x7fc6b80c6420 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fc6a000e930 tx=0x7fc6a0009060).stop 2023-12-22T10:00:30.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.778+0000 7fc6be4db700 1 -- 172.21.15.45:0/2019809675 shutdown_connections 2023-12-22T10:00:30.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.778+0000 7fc6be4db700 1 --2- 172.21.15.45:0/2019809675 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc6b8157d40 0x7fc6b81528b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:30.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.778+0000 7fc6be4db700 1 --2- 172.21.15.45:0/2019809675 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6b80c1670 0x7fc6b80c6420 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:30.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.778+0000 7fc6be4db700 1 --2- 172.21.15.45:0/2019809675 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fc69805a510 0x7fc69805c9d0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:30.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.778+0000 7fc6be4db700 1 --2- 172.21.15.45:0/2019809675 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc6b80a5810 0x7fc6b8151520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:30.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.778+0000 7fc6be4db700 1 -- 172.21.15.45:0/2019809675 >> 172.21.15.45:0/2019809675 conn(0x7fc6b8066a70 msgr2=0x7fc6b80aa460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:30.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.778+0000 7fc6be4db700 1 -- 172.21.15.45:0/2019809675 shutdown_connections 2023-12-22T10:00:30.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.778+0000 7fc6be4db700 1 -- 172.21.15.45:0/2019809675 wait complete. 2023-12-22T10:00:30.799 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-22T10:00:30.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.958+0000 7fc61e01b700 1 Processor -- start 2023-12-22T10:00:30.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.958+0000 7fc61e01b700 1 -- start start 2023-12-22T10:00:30.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.962+0000 7fc61e01b700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc6180c5900 0x7fc6181580d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:30.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.962+0000 7fc61e01b700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6180c9720 con 0x7fc6180ac5c0 2023-12-22T10:00:30.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.962+0000 7fc61e01b700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc618153ec0 con 0x7fc6180c7430 2023-12-22T10:00:30.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.962+0000 7fc61e01b700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6181585c0 con 0x7fc6180c5900 2023-12-22T10:00:30.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.962+0000 7fc616ffd700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc6180c5900 0x7fc6181580d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:30.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.962+0000 7fc6177fe700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fc6180ac5c0 0x7fc6180aa660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:46540/0 (socket says 172.21.15.45:46540) 2023-12-22T10:00:30.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.962+0000 7fc6177fe700 1 -- 172.21.15.45:0/948772529 learned_addr learned my addr 172.21.15.45:0/948772529 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:00:30.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.962+0000 7fc616ffd700 1 -- 172.21.15.45:0/948772529 >> v1:172.21.15.113:6789/0 conn(0x7fc6180c7430 legacy=0x7fc6180c9bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:30.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.962+0000 7fc616ffd700 1 -- 172.21.15.45:0/948772529 >> v1:172.21.15.45:6789/0 conn(0x7fc6180ac5c0 legacy=0x7fc6180aa660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:30.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.962+0000 7fc616ffd700 1 -- 172.21.15.45:0/948772529 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6180c5d60 con 0x7fc6180c5900 2023-12-22T10:00:30.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.962+0000 7fc6167fc700 1 -- 172.21.15.45:0/948772529 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3861960374 0 0) 0x7fc6180c9720 con 0x7fc6180ac5c0 2023-12-22T10:00:30.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.966+0000 7fc616ffd700 1 --2- 172.21.15.45:0/948772529 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc6180c5900 0x7fc6181580d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fc60c009790 tx=0x7fc60c009060).ready entity=mon.2 client_cookie=a5c73e53e07f75df server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:30.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.966+0000 7fc6167fc700 1 -- 172.21.15.45:0/948772529 <== mon.2 v2:172.21.15.113:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc60c00b630 con 0x7fc6180c5900 2023-12-22T10:00:30.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.966+0000 7fc6167fc700 1 -- 172.21.15.45:0/948772529 <== mon.2 v2:172.21.15.113:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc60c00b790 con 0x7fc6180c5900 2023-12-22T10:00:30.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.966+0000 7fc6167fc700 1 -- 172.21.15.45:0/948772529 <== mon.2 v2:172.21.15.113:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc60c00bb10 con 0x7fc6180c5900 2023-12-22T10:00:30.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.966+0000 7fc61e01b700 1 -- 172.21.15.45:0/948772529 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc6180c5900 msgr2=0x7fc6181580d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:30.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.966+0000 7fc61e01b700 1 --2- 172.21.15.45:0/948772529 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc6180c5900 0x7fc6181580d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fc60c009790 tx=0x7fc60c009060).stop 2023-12-22T10:00:30.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.966+0000 7fc61e01b700 1 -- 172.21.15.45:0/948772529 shutdown_connections 2023-12-22T10:00:30.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.966+0000 7fc61e01b700 1 --2- 172.21.15.45:0/948772529 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc6180c5900 0x7fc6181580d0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:30.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.966+0000 7fc61e01b700 1 -- 172.21.15.45:0/948772529 >> 172.21.15.45:0/948772529 conn(0x7fc618082a30 msgr2=0x7fc618066a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:30.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.966+0000 7fc61e01b700 1 -- 172.21.15.45:0/948772529 shutdown_connections 2023-12-22T10:00:30.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.966+0000 7fc61e01b700 1 -- 172.21.15.45:0/948772529 wait complete. 2023-12-22T10:00:30.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.970+0000 7fc61e01b700 1 Processor -- start 2023-12-22T10:00:30.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.970+0000 7fc61e01b700 1 -- start start 2023-12-22T10:00:30.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.970+0000 7fc61e01b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6180ac5c0 0x7fc6180c2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:30.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.970+0000 7fc61e01b700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc6180c5900 0x7fc6180c40c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:30.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.970+0000 7fc61e01b700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc6180c7430 0x7fc6180c45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:30.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.970+0000 7fc61e01b700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6180c4aa0 con 0x7fc6180ac5c0 2023-12-22T10:00:30.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.970+0000 7fc61e01b700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6180c29a0 con 0x7fc6180c7430 2023-12-22T10:00:30.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.970+0000 7fc61e01b700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6180c2c80 con 0x7fc6180c5900 2023-12-22T10:00:30.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.970+0000 7fc6177fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6180ac5c0 0x7fc6180c2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:30.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.970+0000 7fc6177fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6180ac5c0 0x7fc6180c2080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42266/0 (socket says 172.21.15.45:42266) 2023-12-22T10:00:30.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.970+0000 7fc6177fe700 1 -- 172.21.15.45:0/4195390332 learned_addr learned my addr 172.21.15.45:0/4195390332 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:30.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.970+0000 7fc616ffd700 1 --2- 172.21.15.45:0/4195390332 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc6180c5900 0x7fc6180c40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:30.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.970+0000 7fc617fff700 1 --2- 172.21.15.45:0/4195390332 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc6180c7430 0x7fc6180c45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:30.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.970+0000 7fc6177fe700 1 -- 172.21.15.45:0/4195390332 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc6180c5900 msgr2=0x7fc6180c40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:30.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.970+0000 7fc6177fe700 1 --2- 172.21.15.45:0/4195390332 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc6180c5900 0x7fc6180c40c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:30.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.970+0000 7fc6177fe700 1 -- 172.21.15.45:0/4195390332 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc6180c7430 msgr2=0x7fc6180c45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:30.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.970+0000 7fc6177fe700 1 --2- 172.21.15.45:0/4195390332 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc6180c7430 0x7fc6180c45b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:30.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.970+0000 7fc6177fe700 1 -- 172.21.15.45:0/4195390332 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc60c0092a0 con 0x7fc6180ac5c0 2023-12-22T10:00:30.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.970+0000 7fc616ffd700 1 --2- 172.21.15.45:0/4195390332 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc6180c5900 0x7fc6180c40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T10:00:30.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.974+0000 7fc6177fe700 1 --2- 172.21.15.45:0/4195390332 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6180ac5c0 0x7fc6180c2080 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fc60800c490 tx=0x7fc608007e40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:30.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.974+0000 7fc5ff7fe700 1 -- 172.21.15.45:0/4195390332 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6080072e0 con 0x7fc6180ac5c0 2023-12-22T10:00:30.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.974+0000 7fc5ff7fe700 1 -- 172.21.15.45:0/4195390332 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc608007440 con 0x7fc6180ac5c0 2023-12-22T10:00:30.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.974+0000 7fc61e01b700 1 -- 172.21.15.45:0/4195390332 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6180c2f60 con 0x7fc6180ac5c0 2023-12-22T10:00:30.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.974+0000 7fc5ff7fe700 1 -- 172.21.15.45:0/4195390332 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6080057a0 con 0x7fc6180ac5c0 2023-12-22T10:00:30.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.974+0000 7fc61e01b700 1 -- 172.21.15.45:0/4195390332 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6180c3520 con 0x7fc6180ac5c0 2023-12-22T10:00:30.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.974+0000 7fc61e01b700 1 -- 172.21.15.45:0/4195390332 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc61806c070 con 0x7fc6180ac5c0 2023-12-22T10:00:30.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.974+0000 7fc5ff7fe700 1 -- 172.21.15.45:0/4195390332 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fc608005b90 con 0x7fc6180ac5c0 2023-12-22T10:00:30.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.978+0000 7fc5ff7fe700 1 --2- 172.21.15.45:0/4195390332 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fc60405a510 0x7fc60405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:30.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.978+0000 7fc5ff7fe700 1 -- 172.21.15.45:0/4195390332 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fc608073cd0 con 0x7fc6180ac5c0 2023-12-22T10:00:30.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.978+0000 7fc616ffd700 1 --2- 172.21.15.45:0/4195390332 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fc60405a510 0x7fc60405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:30.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.978+0000 7fc616ffd700 1 --2- 172.21.15.45:0/4195390332 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fc60405a510 0x7fc60405c9d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fc60c0096e0 tx=0x7fc60c015000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:30.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:30.982+0000 7fc5ff7fe700 1 -- 172.21.15.45:0/4195390332 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc608047800 con 0x7fc6180ac5c0 2023-12-22T10:00:31.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:31.158+0000 7fc61e01b700 1 -- 172.21.15.45:0/4195390332 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fc6180c3710 con 0x7fc6180ac5c0 2023-12-22T10:00:31.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:31.158+0000 7fc5ff7fe700 1 -- 172.21.15.45:0/4195390332 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+143 (secure 0 0 0) 0x7fc608018030 con 0x7fc6180ac5c0 2023-12-22T10:00:31.156 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:00:31.156 INFO:teuthology.orchestra.run.smithi045.stdout:[ 2023-12-22T10:00:31.156 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:00:31.156 INFO:teuthology.orchestra.run.smithi045.stdout: "poolnum": 1, 2023-12-22T10:00:31.156 INFO:teuthology.orchestra.run.smithi045.stdout: "poolname": "device_health_metrics" 2023-12-22T10:00:31.157 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:00:31.157 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:00:31.157 INFO:teuthology.orchestra.run.smithi045.stdout: "poolnum": 2, 2023-12-22T10:00:31.157 INFO:teuthology.orchestra.run.smithi045.stdout: "poolname": "rbd" 2023-12-22T10:00:31.157 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-22T10:00:31.157 INFO:teuthology.orchestra.run.smithi045.stdout:] 2023-12-22T10:00:31.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:31.166+0000 7fc61e01b700 1 -- 172.21.15.45:0/4195390332 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fc60405a510 msgr2=0x7fc60405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:31.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:31.166+0000 7fc61e01b700 1 --2- 172.21.15.45:0/4195390332 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fc60405a510 0x7fc60405c9d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fc60c0096e0 tx=0x7fc60c015000).stop 2023-12-22T10:00:31.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:31.166+0000 7fc61e01b700 1 -- 172.21.15.45:0/4195390332 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6180ac5c0 msgr2=0x7fc6180c2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:31.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:31.166+0000 7fc61e01b700 1 --2- 172.21.15.45:0/4195390332 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6180ac5c0 0x7fc6180c2080 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fc60800c490 tx=0x7fc608007e40).stop 2023-12-22T10:00:31.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:31.166+0000 7fc61e01b700 1 -- 172.21.15.45:0/4195390332 shutdown_connections 2023-12-22T10:00:31.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:31.166+0000 7fc61e01b700 1 --2- 172.21.15.45:0/4195390332 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc6180c7430 0x7fc6180c45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:31.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:31.166+0000 7fc61e01b700 1 --2- 172.21.15.45:0/4195390332 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fc60405a510 0x7fc60405c9d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:31.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:31.166+0000 7fc61e01b700 1 --2- 172.21.15.45:0/4195390332 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc6180c5900 0x7fc6180c40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:31.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:31.166+0000 7fc61e01b700 1 --2- 172.21.15.45:0/4195390332 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6180ac5c0 0x7fc6180c2080 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:31.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:31.166+0000 7fc61e01b700 1 -- 172.21.15.45:0/4195390332 >> 172.21.15.45:0/4195390332 conn(0x7fc618082a30 msgr2=0x7fc618156090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:31.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:31.166+0000 7fc61e01b700 1 -- 172.21.15.45:0/4195390332 shutdown_connections 2023-12-22T10:00:31.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:31.166+0000 7fc61e01b700 1 -- 172.21.15.45:0/4195390332 wait complete. 2023-12-22T10:00:31.183 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-22T10:00:31.183 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-12-22T10:00:31.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:31.358+0000 7f58f5f07700 1 Processor -- start 2023-12-22T10:00:31.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:31.358+0000 7f58f5f07700 1 -- start start 2023-12-22T10:00:31.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:31.358+0000 7f58f5f07700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f58f00acca0 0x7f58f00ad080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:31.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:31.358+0000 7f58f5f07700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f58f00c9d20 0x7f58f00c97e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:31.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:31.358+0000 7f58f5f07700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f58f00ca230 0x7f58f0068ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:31.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:31.358+0000 7f58f5f07700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58f00c5810 con 0x7f58f00ca230 2023-12-22T10:00:31.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:31.358+0000 7f58f5f07700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58f00c8d90 con 0x7f58f00c9d20 2023-12-22T10:00:31.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:31.358+0000 7f58f5f07700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58f00c9350 con 0x7f58f00acca0 2023-12-22T10:00:31.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:31.362+0000 7f58f5706700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f58f00ca230 0x7f58f0068ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:31.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:31.362+0000 7f58f5706700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f58f00ca230 0x7f58f0068ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42276/0 (socket says 172.21.15.45:42276) 2023-12-22T10:00:31.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:31.362+0000 7f58f5706700 1 -- 172.21.15.45:0/2237324261 learned_addr learned my addr 172.21.15.45:0/2237324261 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:31.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:31.362+0000 7f58f4f05700 1 --2- 172.21.15.45:0/2237324261 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f58f00acca0 0x7f58f00ad080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:31.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:31.362+0000 7f58e7fff700 1 --2- 172.21.15.45:0/2237324261 >> v2:172.21.15.113:3300/0 conn(0x7f58f00c9d20 0x7f58f00c97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:31.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:31.362+0000 7f58f5706700 1 -- 172.21.15.45:0/2237324261 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f58f00acca0 msgr2=0x7f58f00ad080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:00:31.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:31.362+0000 7f58f5706700 1 --2- 172.21.15.45:0/2237324261 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f58f00acca0 0x7f58f00ad080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:31.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:31.362+0000 7f58f5706700 1 -- 172.21.15.45:0/2237324261 >> v2:172.21.15.113:3300/0 conn(0x7f58f00c9d20 msgr2=0x7f58f00c97e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:00:31.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:31.362+0000 7f58f5706700 1 --2- 172.21.15.45:0/2237324261 >> v2:172.21.15.113:3300/0 conn(0x7f58f00c9d20 0x7f58f00c97e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:31.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:31.362+0000 7f58f5706700 1 -- 172.21.15.45:0/2237324261 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58f0154070 con 0x7f58f00ca230 2023-12-22T10:00:31.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:31.362+0000 7f58f4f05700 1 --2- 172.21.15.45:0/2237324261 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f58f00acca0 0x7f58f00ad080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T10:00:31.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:31.362+0000 7f58f5706700 1 --2- 172.21.15.45:0/2237324261 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58f00ca230 0x7f58f0068ab0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f58f0083b60 tx=0x7f58e8009840).ready entity=mon.0 client_cookie=d71528ab7ff0f12f server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:31.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:31.362+0000 7f58e77fe700 1 -- 172.21.15.45:0/2237324261 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e800e070 con 0x7f58f00ca230 2023-12-22T10:00:31.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:31.362+0000 7f58e77fe700 1 -- 172.21.15.45:0/2237324261 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58e800ba50 con 0x7f58f00ca230 2023-12-22T10:00:31.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:31.362+0000 7f58e77fe700 1 -- 172.21.15.45:0/2237324261 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e800bdd0 con 0x7f58f00ca230 2023-12-22T10:00:31.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:31.362+0000 7f58f5f07700 1 -- 172.21.15.45:0/2237324261 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58f00ca230 msgr2=0x7f58f0068ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:31.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:31.362+0000 7f58f5f07700 1 --2- 172.21.15.45:0/2237324261 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58f00ca230 0x7f58f0068ab0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f58f0083b60 tx=0x7f58e8009840).stop 2023-12-22T10:00:31.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:31.362+0000 7f58f5f07700 1 -- 172.21.15.45:0/2237324261 shutdown_connections 2023-12-22T10:00:31.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:31.362+0000 7f58f5f07700 1 --2- 172.21.15.45:0/2237324261 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58f00ca230 0x7f58f0068ab0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:31.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:31.362+0000 7f58f5f07700 1 --2- 172.21.15.45:0/2237324261 >> v2:172.21.15.113:3300/0 conn(0x7f58f00c9d20 0x7f58f00c97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:31.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:31.362+0000 7f58f5f07700 1 --2- 172.21.15.45:0/2237324261 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f58f00acca0 0x7f58f00ad080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:31.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:31.362+0000 7f58f5f07700 1 -- 172.21.15.45:0/2237324261 >> 172.21.15.45:0/2237324261 conn(0x7f58f00674f0 msgr2=0x7f58f00ca820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:31.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:31.362+0000 7f58f5f07700 1 -- 172.21.15.45:0/2237324261 shutdown_connections 2023-12-22T10:00:31.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:31.362+0000 7f58f5f07700 1 -- 172.21.15.45:0/2237324261 wait complete. 2023-12-22T10:00:31.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:31.366+0000 7f58f5f07700 1 Processor -- start 2023-12-22T10:00:31.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:31.366+0000 7f58f5f07700 1 -- start start 2023-12-22T10:00:31.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:31.366+0000 7f58f5f07700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f58f00acca0 0x7f58f014a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:31.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:31.366+0000 7f58f5f07700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58f00c9d20 0x7f58f00c0a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:31.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:31.366+0000 7f58f5f07700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f58f00ca230 0x7f58f00c0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:31.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:31.366+0000 7f58f5f07700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58f0169300 con 0x7f58f00c9d20 2023-12-22T10:00:31.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:31.366+0000 7f58f5f07700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58f00c13e0 con 0x7f58f00acca0 2023-12-22T10:00:31.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:31.366+0000 7f58f5f07700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58f00c31e0 con 0x7f58f00ca230 2023-12-22T10:00:31.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:31.366+0000 7f58e7fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58f00c9d20 0x7f58f00c0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:31.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:31.366+0000 7f58e7fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58f00c9d20 0x7f58f00c0a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42286/0 (socket says 172.21.15.45:42286) 2023-12-22T10:00:31.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:31.366+0000 7f58e7fff700 1 -- 172.21.15.45:0/3240971804 learned_addr learned my addr 172.21.15.45:0/3240971804 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:31.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:31.366+0000 7f58f5706700 1 --2- 172.21.15.45:0/3240971804 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f58f00ca230 0x7f58f00c0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:31.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:31.366+0000 7f58f4f05700 1 --2- 172.21.15.45:0/3240971804 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f58f00acca0 0x7f58f014a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:31.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:31.370+0000 7f58e7fff700 1 -- 172.21.15.45:0/3240971804 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f58f00ca230 msgr2=0x7f58f00c0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:31.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:31.370+0000 7f58e7fff700 1 --2- 172.21.15.45:0/3240971804 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f58f00ca230 0x7f58f00c0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:31.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:31.370+0000 7f58e7fff700 1 -- 172.21.15.45:0/3240971804 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f58f00acca0 msgr2=0x7f58f014a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:31.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:31.370+0000 7f58e7fff700 1 --2- 172.21.15.45:0/3240971804 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f58f00acca0 0x7f58f014a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:31.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:31.370+0000 7f58e7fff700 1 -- 172.21.15.45:0/3240971804 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58e8009ae0 con 0x7f58f00c9d20 2023-12-22T10:00:31.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:31.370+0000 7f58e7fff700 1 --2- 172.21.15.45:0/3240971804 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58f00c9d20 0x7f58f00c0a00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f58e000d890 tx=0x7f58e0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:31.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:31.370+0000 7f58e4ff9700 1 -- 172.21.15.45:0/3240971804 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e000f520 con 0x7f58f00c9d20 2023-12-22T10:00:31.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:31.370+0000 7f58e4ff9700 1 -- 172.21.15.45:0/3240971804 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58e000f680 con 0x7f58f00c9d20 2023-12-22T10:00:31.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:31.370+0000 7f58e4ff9700 1 -- 172.21.15.45:0/3240971804 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e000fa00 con 0x7f58f00c9d20 2023-12-22T10:00:31.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:31.370+0000 7f58f5f07700 1 -- 172.21.15.45:0/3240971804 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58f0169020 con 0x7f58f00c9d20 2023-12-22T10:00:31.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:31.370+0000 7f58f5f07700 1 -- 172.21.15.45:0/3240971804 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58f00c2e70 con 0x7f58f00c9d20 2023-12-22T10:00:31.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:31.370+0000 7f58f5f07700 1 -- 172.21.15.45:0/3240971804 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58f00c3350 con 0x7f58f00c9d20 2023-12-22T10:00:31.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:31.374+0000 7f58e4ff9700 1 -- 172.21.15.45:0/3240971804 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f58e0013480 con 0x7f58f00c9d20 2023-12-22T10:00:31.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:31.374+0000 7f58e4ff9700 1 --2- 172.21.15.45:0/3240971804 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f58dc05a560 0x7f58dc05ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:31.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:31.374+0000 7f58e4ff9700 1 -- 172.21.15.45:0/3240971804 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f58e0073fc0 con 0x7f58f00c9d20 2023-12-22T10:00:31.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:31.374+0000 7f58f4f05700 1 --2- 172.21.15.45:0/3240971804 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f58dc05a560 0x7f58dc05ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:31.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:31.374+0000 7f58f4f05700 1 --2- 172.21.15.45:0/3240971804 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f58dc05a560 0x7f58dc05ca20 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f58f0151300 tx=0x7f58ec008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:31.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:31.378+0000 7f58e4ff9700 1 -- 172.21.15.45:0/3240971804 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f58e0047a50 con 0x7f58f00c9d20 2023-12-22T10:00:31.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:31.550+0000 7f58f5f07700 1 -- 172.21.15.45:0/3240971804 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f58f0047060 con 0x7f58f00c9d20 2023-12-22T10:00:32.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:32.066+0000 7f58e4ff9700 1 -- 172.21.15.45:0/3240971804 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 152+0+0 (secure 0 0 0) 0x7f58e004b070 con 0x7f58f00c9d20 2023-12-22T10:00:32.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:32.074+0000 7f58f5f07700 1 -- 172.21.15.45:0/3240971804 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f58dc05a560 msgr2=0x7f58dc05ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:32.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:32.074+0000 7f58f5f07700 1 --2- 172.21.15.45:0/3240971804 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f58dc05a560 0x7f58dc05ca20 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f58f0151300 tx=0x7f58ec008040).stop 2023-12-22T10:00:32.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:32.074+0000 7f58f5f07700 1 -- 172.21.15.45:0/3240971804 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58f00c9d20 msgr2=0x7f58f00c0a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:32.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:32.074+0000 7f58f5f07700 1 --2- 172.21.15.45:0/3240971804 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58f00c9d20 0x7f58f00c0a00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f58e000d890 tx=0x7f58e0008040).stop 2023-12-22T10:00:32.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:32.074+0000 7f58f5f07700 1 -- 172.21.15.45:0/3240971804 shutdown_connections 2023-12-22T10:00:32.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:32.074+0000 7f58f5f07700 1 --2- 172.21.15.45:0/3240971804 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f58dc05a560 0x7f58dc05ca20 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:32.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:32.074+0000 7f58f5f07700 1 --2- 172.21.15.45:0/3240971804 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f58f00ca230 0x7f58f00c0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:32.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:32.074+0000 7f58f5f07700 1 --2- 172.21.15.45:0/3240971804 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58f00c9d20 0x7f58f00c0a00 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:32.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:32.074+0000 7f58f5f07700 1 --2- 172.21.15.45:0/3240971804 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f58f00acca0 0x7f58f014a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:32.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:32.074+0000 7f58f5f07700 1 -- 172.21.15.45:0/3240971804 >> 172.21.15.45:0/3240971804 conn(0x7f58f00674f0 msgr2=0x7f58f0068ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:32.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:32.074+0000 7f58f5f07700 1 -- 172.21.15.45:0/3240971804 shutdown_connections 2023-12-22T10:00:32.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:32.074+0000 7f58f5f07700 1 -- 172.21.15.45:0/3240971804 wait complete. 2023-12-22T10:00:32.076 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_metadata' created 2023-12-22T10:00:32.096 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-22T10:00:32.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:32.270+0000 7ffbd61f9700 1 Processor -- start 2023-12-22T10:00:32.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:32.274+0000 7ffbd61f9700 1 -- start start 2023-12-22T10:00:32.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:32.274+0000 7ffbd61f9700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ffbd00acca0 0x7ffbd00ad080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:32.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:32.274+0000 7ffbd61f9700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ffbd00c9d20 0x7ffbd00c97e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:32.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:32.274+0000 7ffbd61f9700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7ffbd00ca230 0x7ffbd0068ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:32.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:32.274+0000 7ffbd61f9700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbd00c5810 con 0x7ffbd00c9d20 2023-12-22T10:00:32.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:32.274+0000 7ffbd61f9700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbd00c8d90 con 0x7ffbd00ca230 2023-12-22T10:00:32.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:32.274+0000 7ffbd61f9700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd00c9350 con 0x7ffbd00acca0 2023-12-22T10:00:32.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:32.278+0000 7ffbd49f6700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ffbd00c9d20 0x7ffbd00c97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:32.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:32.278+0000 7ffbd49f6700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ffbd00c9d20 0x7ffbd00c97e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42294/0 (socket says 172.21.15.45:42294) 2023-12-22T10:00:32.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:32.278+0000 7ffbd49f6700 1 -- 172.21.15.45:0/1058534258 learned_addr learned my addr 172.21.15.45:0/1058534258 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:32.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:32.278+0000 7ffbd51f7700 1 --2- 172.21.15.45:0/1058534258 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ffbd00acca0 0x7ffbd00ad080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:32.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:32.278+0000 7ffbd59f8700 1 --2- 172.21.15.45:0/1058534258 >> v2:172.21.15.113:3300/0 conn(0x7ffbd00ca230 0x7ffbd0068ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:32.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:32.278+0000 7ffbd49f6700 1 -- 172.21.15.45:0/1058534258 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ffbd00acca0 msgr2=0x7ffbd00ad080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:00:32.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:32.278+0000 7ffbd49f6700 1 --2- 172.21.15.45:0/1058534258 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ffbd00acca0 0x7ffbd00ad080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:32.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:32.278+0000 7ffbd49f6700 1 -- 172.21.15.45:0/1058534258 >> v2:172.21.15.113:3300/0 conn(0x7ffbd00ca230 msgr2=0x7ffbd0068ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:00:32.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:32.278+0000 7ffbd49f6700 1 --2- 172.21.15.45:0/1058534258 >> v2:172.21.15.113:3300/0 conn(0x7ffbd00ca230 0x7ffbd0068ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:32.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:32.278+0000 7ffbd49f6700 1 -- 172.21.15.45:0/1058534258 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbd0154070 con 0x7ffbd00c9d20 2023-12-22T10:00:32.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:32.278+0000 7ffbd59f8700 1 --2- 172.21.15.45:0/1058534258 >> v2:172.21.15.113:3300/0 conn(0x7ffbd00ca230 0x7ffbd0068ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T10:00:32.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:32.278+0000 7ffbd49f6700 1 --2- 172.21.15.45:0/1058534258 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffbd00c9d20 0x7ffbd00c97e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7ffbd0069680 tx=0x7ffbc00090f0).ready entity=mon.0 client_cookie=36af8bd0a34ad729 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:32.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:32.278+0000 7ffbc7fff700 1 -- 172.21.15.45:0/1058534258 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc000b520 con 0x7ffbd00c9d20 2023-12-22T10:00:32.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:32.278+0000 7ffbc7fff700 1 -- 172.21.15.45:0/1058534258 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbc000b680 con 0x7ffbd00c9d20 2023-12-22T10:00:32.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:32.278+0000 7ffbc7fff700 1 -- 172.21.15.45:0/1058534258 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc000ba00 con 0x7ffbd00c9d20 2023-12-22T10:00:32.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:32.278+0000 7ffbd61f9700 1 -- 172.21.15.45:0/1058534258 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffbd00c9d20 msgr2=0x7ffbd00c97e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:32.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:32.278+0000 7ffbd61f9700 1 --2- 172.21.15.45:0/1058534258 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffbd00c9d20 0x7ffbd00c97e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7ffbd0069680 tx=0x7ffbc00090f0).stop 2023-12-22T10:00:32.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:32.278+0000 7ffbd61f9700 1 -- 172.21.15.45:0/1058534258 shutdown_connections 2023-12-22T10:00:32.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:32.278+0000 7ffbd61f9700 1 --2- 172.21.15.45:0/1058534258 >> v2:172.21.15.113:3300/0 conn(0x7ffbd00ca230 0x7ffbd0068ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:32.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:32.278+0000 7ffbd61f9700 1 --2- 172.21.15.45:0/1058534258 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffbd00c9d20 0x7ffbd00c97e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:32.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:32.278+0000 7ffbd61f9700 1 --2- 172.21.15.45:0/1058534258 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ffbd00acca0 0x7ffbd00ad080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:32.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:32.278+0000 7ffbd61f9700 1 -- 172.21.15.45:0/1058534258 >> 172.21.15.45:0/1058534258 conn(0x7ffbd00674f0 msgr2=0x7ffbd00ca820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:32.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:32.278+0000 7ffbd61f9700 1 -- 172.21.15.45:0/1058534258 shutdown_connections 2023-12-22T10:00:32.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:32.278+0000 7ffbd61f9700 1 -- 172.21.15.45:0/1058534258 wait complete. 2023-12-22T10:00:32.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:32.282+0000 7ffbd61f9700 1 Processor -- start 2023-12-22T10:00:32.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:32.282+0000 7ffbd61f9700 1 -- start start 2023-12-22T10:00:32.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:32.286+0000 7ffbd61f9700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffbd00acca0 0x7ffbd00ae350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:32.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:32.286+0000 7ffbd61f9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffbd00c9d20 0x7ffbd00b02b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:32.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:32.286+0000 7ffbd61f9700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ffbd00ca230 0x7ffbd00c7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:32.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:32.286+0000 7ffbd61f9700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd00b07a0 con 0x7ffbd00c9d20 2023-12-22T10:00:32.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:32.286+0000 7ffbd61f9700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd0164e80 con 0x7ffbd00acca0 2023-12-22T10:00:32.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:32.286+0000 7ffbd61f9700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd0164ba0 con 0x7ffbd00ca230 2023-12-22T10:00:32.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:32.286+0000 7ffbd49f6700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffbd00c9d20 0x7ffbd00b02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:32.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:32.286+0000 7ffbd49f6700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffbd00c9d20 0x7ffbd00b02b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42296/0 (socket says 172.21.15.45:42296) 2023-12-22T10:00:32.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:32.286+0000 7ffbd49f6700 1 -- 172.21.15.45:0/3729085172 learned_addr learned my addr 172.21.15.45:0/3729085172 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:32.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:32.286+0000 7ffbd51f7700 1 --2- 172.21.15.45:0/3729085172 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffbd00acca0 0x7ffbd00ae350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:32.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:32.286+0000 7ffbd59f8700 1 --2- 172.21.15.45:0/3729085172 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ffbd00ca230 0x7ffbd00c7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:32.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:32.286+0000 7ffbd49f6700 1 -- 172.21.15.45:0/3729085172 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ffbd00ca230 msgr2=0x7ffbd00c7180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:32.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:32.286+0000 7ffbd49f6700 1 --2- 172.21.15.45:0/3729085172 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ffbd00ca230 0x7ffbd00c7180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:32.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:32.286+0000 7ffbd49f6700 1 -- 172.21.15.45:0/3729085172 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffbd00acca0 msgr2=0x7ffbd00ae350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:32.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:32.286+0000 7ffbd49f6700 1 --2- 172.21.15.45:0/3729085172 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffbd00acca0 0x7ffbd00ae350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:32.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:32.286+0000 7ffbd49f6700 1 -- 172.21.15.45:0/3729085172 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbc0009370 con 0x7ffbd00c9d20 2023-12-22T10:00:32.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:32.286+0000 7ffbd51f7700 1 --2- 172.21.15.45:0/3729085172 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffbd00acca0 0x7ffbd00ae350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T10:00:32.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:32.286+0000 7ffbd49f6700 1 --2- 172.21.15.45:0/3729085172 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffbd00c9d20 0x7ffbd00b02b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7ffbc0011000 tx=0x7ffbc0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:32.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:32.286+0000 7ffbc57fa700 1 -- 172.21.15.45:0/3729085172 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc0000bc0 con 0x7ffbd00c9d20 2023-12-22T10:00:32.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:32.286+0000 7ffbc57fa700 1 -- 172.21.15.45:0/3729085172 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbc000b7f0 con 0x7ffbd00c9d20 2023-12-22T10:00:32.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:32.286+0000 7ffbd61f9700 1 -- 172.21.15.45:0/3729085172 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbd00ad870 con 0x7ffbd00c9d20 2023-12-22T10:00:32.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:32.286+0000 7ffbc57fa700 1 -- 172.21.15.45:0/3729085172 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc0000d20 con 0x7ffbd00c9d20 2023-12-22T10:00:32.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:32.286+0000 7ffbd61f9700 1 -- 172.21.15.45:0/3729085172 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbd00ade30 con 0x7ffbd00c9d20 2023-12-22T10:00:32.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:32.290+0000 7ffbd61f9700 1 -- 172.21.15.45:0/3729085172 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbd0047060 con 0x7ffbd00c9d20 2023-12-22T10:00:32.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:32.290+0000 7ffbc57fa700 1 -- 172.21.15.45:0/3729085172 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7ffbc001b8b0 con 0x7ffbd00c9d20 2023-12-22T10:00:32.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:32.294+0000 7ffbc57fa700 1 --2- 172.21.15.45:0/3729085172 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7ffbb405a4e0 0x7ffbb405c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:32.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:32.294+0000 7ffbc57fa700 1 -- 172.21.15.45:0/3729085172 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5639+0+0 (secure 0 0 0) 0x7ffbc0075f30 con 0x7ffbd00c9d20 2023-12-22T10:00:32.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:32.294+0000 7ffbd51f7700 1 --2- 172.21.15.45:0/3729085172 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7ffbb405a4e0 0x7ffbb405c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:32.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:32.294+0000 7ffbd51f7700 1 --2- 172.21.15.45:0/3729085172 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7ffbb405a4e0 0x7ffbb405c9a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7ffbcc009b60 tx=0x7ffbcc008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:32.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:32.302+0000 7ffbc57fa700 1 -- 172.21.15.45:0/3729085172 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ffbc0049830 con 0x7ffbd00c9d20 2023-12-22T10:00:32.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:32.466+0000 7ffbd61f9700 1 -- 172.21.15.45:0/3729085172 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7ffbd00ae020 con 0x7ffbd00c9d20 2023-12-22T10:00:32.814 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:00:32.822 DEBUG:teuthology.orchestra.run.smithi113:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:00:33.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.078+0000 7ffbc57fa700 1 -- 172.21.15.45:0/3729085172 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v19) v1 ==== 170+0+0 (secure 0 0 0) 0x7ffbc0029070 con 0x7ffbd00c9d20 2023-12-22T10:00:33.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.090+0000 7ffbd61f9700 1 -- 172.21.15.45:0/3729085172 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7ffbb405a4e0 msgr2=0x7ffbb405c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:33.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.090+0000 7ffbd61f9700 1 --2- 172.21.15.45:0/3729085172 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7ffbb405a4e0 0x7ffbb405c9a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7ffbcc009b60 tx=0x7ffbcc008040).stop 2023-12-22T10:00:33.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.090+0000 7ffbd61f9700 1 -- 172.21.15.45:0/3729085172 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffbd00c9d20 msgr2=0x7ffbd00b02b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:33.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.090+0000 7ffbd61f9700 1 --2- 172.21.15.45:0/3729085172 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffbd00c9d20 0x7ffbd00b02b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7ffbc0011000 tx=0x7ffbc0017000).stop 2023-12-22T10:00:33.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.090+0000 7ffbd61f9700 1 -- 172.21.15.45:0/3729085172 shutdown_connections 2023-12-22T10:00:33.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.090+0000 7ffbd61f9700 1 --2- 172.21.15.45:0/3729085172 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7ffbb405a4e0 0x7ffbb405c9a0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:33.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.090+0000 7ffbd61f9700 1 --2- 172.21.15.45:0/3729085172 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ffbd00ca230 0x7ffbd00c7180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:33.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.090+0000 7ffbd61f9700 1 --2- 172.21.15.45:0/3729085172 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffbd00c9d20 0x7ffbd00b02b0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:33.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.090+0000 7ffbd61f9700 1 --2- 172.21.15.45:0/3729085172 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffbd00acca0 0x7ffbd00ae350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:33.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.090+0000 7ffbd61f9700 1 -- 172.21.15.45:0/3729085172 >> 172.21.15.45:0/3729085172 conn(0x7ffbd00674f0 msgr2=0x7ffbd0068ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:33.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.098+0000 7ffbd61f9700 1 -- 172.21.15.45:0/3729085172 shutdown_connections 2023-12-22T10:00:33.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.098+0000 7ffbd61f9700 1 -- 172.21.15.45:0/3729085172 wait complete. 2023-12-22T10:00:33.102 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data' created 2023-12-22T10:00:33.132 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-22T10:00:33.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.294+0000 7f5ace25b700 1 Processor -- start 2023-12-22T10:00:33.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.298+0000 7f5ace25b700 1 -- start start 2023-12-22T10:00:33.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.298+0000 7f5ace25b700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f5ac80ac4c0 0x7f5ac8155660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:33.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.298+0000 7f5ace25b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5ac8155b50 0x7f5ac80a5890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:33.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.298+0000 7f5ace25b700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ac81521b0 con 0x7f5ac80ac0e0 2023-12-22T10:00:33.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.298+0000 7f5ace25b700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ac8151fa0 con 0x7f5ac8155b50 2023-12-22T10:00:33.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.298+0000 7f5ace25b700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ac80c36e0 con 0x7f5ac80ac4c0 2023-12-22T10:00:33.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.298+0000 7f5ac7fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5ac8155b50 0x7f5ac80a5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:33.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.298+0000 7f5ac6ffd700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f5ac80ac4c0 0x7f5ac8155660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:33.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.298+0000 7f5ac77fe700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f5ac80ac0e0 0x7f5ac80a7050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:46542/0 (socket says 172.21.15.45:46542) 2023-12-22T10:00:33.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.298+0000 7f5ac7fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5ac8155b50 0x7f5ac80a5890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42312/0 (socket says 172.21.15.45:42312) 2023-12-22T10:00:33.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.298+0000 7f5ac77fe700 1 -- 172.21.15.45:0/1462505158 learned_addr learned my addr 172.21.15.45:0/1462505158 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:00:33.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.302+0000 7f5ac7fff700 1 -- 172.21.15.45:0/1462505158 >> v2:172.21.15.113:3300/0 conn(0x7f5ac80ac4c0 msgr2=0x7f5ac8155660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:00:33.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.302+0000 7f5ac7fff700 1 --2- 172.21.15.45:0/1462505158 >> v2:172.21.15.113:3300/0 conn(0x7f5ac80ac4c0 0x7f5ac8155660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:33.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.302+0000 7f5ac7fff700 1 -- 172.21.15.45:0/1462505158 >> v1:172.21.15.45:6789/0 conn(0x7f5ac80ac0e0 legacy=0x7f5ac80a7050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:33.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.302+0000 7f5ac7fff700 1 -- 172.21.15.45:0/1462505158 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ac80c39c0 con 0x7f5ac8155b50 2023-12-22T10:00:33.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.302+0000 7f5ac7fff700 1 --2- 172.21.15.45:0/1462505158 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ac8155b50 0x7f5ac80a5890 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f5ac8064790 tx=0x7f5ac0009780).ready entity=mon.0 client_cookie=6ebbaffc0d508cac server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:33.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.302+0000 7f5ac67fc700 1 -- 172.21.15.45:0/1462505158 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac000e070 con 0x7f5ac8155b50 2023-12-22T10:00:33.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.302+0000 7f5ac67fc700 1 -- 172.21.15.45:0/1462505158 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ac000bb60 con 0x7f5ac8155b50 2023-12-22T10:00:33.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.302+0000 7f5ac67fc700 1 -- 172.21.15.45:0/1462505158 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac0012410 con 0x7f5ac8155b50 2023-12-22T10:00:33.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.302+0000 7f5ace25b700 1 -- 172.21.15.45:0/1462505158 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ac8155b50 msgr2=0x7f5ac80a5890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:33.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.302+0000 7f5ace25b700 1 --2- 172.21.15.45:0/1462505158 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ac8155b50 0x7f5ac80a5890 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f5ac8064790 tx=0x7f5ac0009780).stop 2023-12-22T10:00:33.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.302+0000 7f5ace25b700 1 -- 172.21.15.45:0/1462505158 shutdown_connections 2023-12-22T10:00:33.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.302+0000 7f5ace25b700 1 --2- 172.21.15.45:0/1462505158 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ac8155b50 0x7f5ac80a5890 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:33.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.302+0000 7f5ace25b700 1 --2- 172.21.15.45:0/1462505158 >> v2:172.21.15.113:3300/0 conn(0x7f5ac80ac4c0 0x7f5ac8155660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:33.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.302+0000 7f5ace25b700 1 -- 172.21.15.45:0/1462505158 >> 172.21.15.45:0/1462505158 conn(0x7f5ac8066a70 msgr2=0x7f5ac8066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:33.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.302+0000 7f5ace25b700 1 -- 172.21.15.45:0/1462505158 shutdown_connections 2023-12-22T10:00:33.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.302+0000 7f5ace25b700 1 -- 172.21.15.45:0/1462505158 wait complete. 2023-12-22T10:00:33.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.306+0000 7f5ace25b700 1 Processor -- start 2023-12-22T10:00:33.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.306+0000 7f5ace25b700 1 -- start start 2023-12-22T10:00:33.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.306+0000 7f5ace25b700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5ac80ac0e0 0x7f5ac80c2640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:33.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.306+0000 7f5ace25b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ac8155b50 0x7f5ac80c1d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:33.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.306+0000 7f5ace25b700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f5ac80c2230 0x7f5ac8167a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:33.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.306+0000 7f5ace25b700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac814edd0 con 0x7f5ac8155b50 2023-12-22T10:00:33.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.306+0000 7f5ace25b700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac81672d0 con 0x7f5ac80ac0e0 2023-12-22T10:00:33.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.306+0000 7f5ace25b700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac8153b10 con 0x7f5ac80c2230 2023-12-22T10:00:33.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.306+0000 7f5ac6ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ac8155b50 0x7f5ac80c1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:33.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.306+0000 7f5ac77fe700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5ac80ac0e0 0x7f5ac80c2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:33.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.306+0000 7f5ac6ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ac8155b50 0x7f5ac80c1d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42322/0 (socket says 172.21.15.45:42322) 2023-12-22T10:00:33.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.306+0000 7f5ac6ffd700 1 -- 172.21.15.45:0/3936875961 learned_addr learned my addr 172.21.15.45:0/3936875961 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:33.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.306+0000 7f5ac7fff700 1 --2- 172.21.15.45:0/3936875961 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f5ac80c2230 0x7f5ac8167a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:33.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.310+0000 7f5ac6ffd700 1 -- 172.21.15.45:0/3936875961 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f5ac80c2230 msgr2=0x7f5ac8167a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:33.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.310+0000 7f5ac6ffd700 1 --2- 172.21.15.45:0/3936875961 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f5ac80c2230 0x7f5ac8167a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:33.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.310+0000 7f5ac6ffd700 1 -- 172.21.15.45:0/3936875961 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5ac80ac0e0 msgr2=0x7f5ac80c2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:33.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.310+0000 7f5ac6ffd700 1 --2- 172.21.15.45:0/3936875961 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5ac80ac0e0 0x7f5ac80c2640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:33.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.310+0000 7f5ac6ffd700 1 -- 172.21.15.45:0/3936875961 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ac0009a20 con 0x7f5ac8155b50 2023-12-22T10:00:33.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.310+0000 7f5ac6ffd700 1 --2- 172.21.15.45:0/3936875961 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ac8155b50 0x7f5ac80c1d40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f5abc00e930 tx=0x7f5abc009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:33.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.310+0000 7f5aaf7fe700 1 -- 172.21.15.45:0/3936875961 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5abc012600 con 0x7f5ac8155b50 2023-12-22T10:00:33.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.310+0000 7f5aaf7fe700 1 -- 172.21.15.45:0/3936875961 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5abc012760 con 0x7f5ac8155b50 2023-12-22T10:00:33.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.310+0000 7f5aaf7fe700 1 -- 172.21.15.45:0/3936875961 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5abc012ae0 con 0x7f5ac8155b50 2023-12-22T10:00:33.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.310+0000 7f5ace25b700 1 -- 172.21.15.45:0/3936875961 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ac8153df0 con 0x7f5ac8155b50 2023-12-22T10:00:33.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.310+0000 7f5ace25b700 1 -- 172.21.15.45:0/3936875961 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ac8167520 con 0x7f5ac8155b50 2023-12-22T10:00:33.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.310+0000 7f5ace25b700 1 -- 172.21.15.45:0/3936875961 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ac806c070 con 0x7f5ac8155b50 2023-12-22T10:00:33.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.314+0000 7f5aaf7fe700 1 -- 172.21.15.45:0/3936875961 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f5abc01b400 con 0x7f5ac8155b50 2023-12-22T10:00:33.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.314+0000 7f5aaf7fe700 1 --2- 172.21.15.45:0/3936875961 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f5ab405a510 0x7f5ab405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:33.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.314+0000 7f5aaf7fe700 1 -- 172.21.15.45:0/3936875961 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 6021+0+0 (secure 0 0 0) 0x7f5abc074c20 con 0x7f5ac8155b50 2023-12-22T10:00:33.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.314+0000 7f5ac77fe700 1 --2- 172.21.15.45:0/3936875961 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f5ab405a510 0x7f5ab405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:33.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.314+0000 7f5ac77fe700 1 --2- 172.21.15.45:0/3936875961 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f5ab405a510 0x7f5ab405c9d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f5ab8007fd0 tx=0x7f5ab8007d30).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:33.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.322+0000 7f5aaf7fe700 1 -- 172.21.15.45:0/3936875961 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f5abc048340 con 0x7f5ac8155b50 2023-12-22T10:00:33.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.518+0000 7f5ace25b700 1 -- 172.21.15.45:0/3936875961 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f5ac8067660 con 0x7f5ac8155b50 2023-12-22T10:00:33.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.530+0000 7f5aaf7fe700 1 -- 172.21.15.45:0/3936875961 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f5abc04b960 con 0x7f5ac8155b50 2023-12-22T10:00:33.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.534+0000 7f5ace25b700 1 -- 172.21.15.45:0/3936875961 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f5ab405a510 msgr2=0x7f5ab405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:33.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.534+0000 7f5ace25b700 1 --2- 172.21.15.45:0/3936875961 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f5ab405a510 0x7f5ab405c9d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f5ab8007fd0 tx=0x7f5ab8007d30).stop 2023-12-22T10:00:33.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.534+0000 7f5ace25b700 1 -- 172.21.15.45:0/3936875961 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ac8155b50 msgr2=0x7f5ac80c1d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:33.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.534+0000 7f5ace25b700 1 --2- 172.21.15.45:0/3936875961 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ac8155b50 0x7f5ac80c1d40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f5abc00e930 tx=0x7f5abc009060).stop 2023-12-22T10:00:33.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.534+0000 7f5ace25b700 1 -- 172.21.15.45:0/3936875961 shutdown_connections 2023-12-22T10:00:33.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.534+0000 7f5ace25b700 1 --2- 172.21.15.45:0/3936875961 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f5ab405a510 0x7f5ab405c9d0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:33.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.534+0000 7f5ace25b700 1 --2- 172.21.15.45:0/3936875961 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f5ac80c2230 0x7f5ac8167a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:33.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.534+0000 7f5ace25b700 1 --2- 172.21.15.45:0/3936875961 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ac8155b50 0x7f5ac80c1d40 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:33.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.534+0000 7f5ace25b700 1 --2- 172.21.15.45:0/3936875961 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5ac80ac0e0 0x7f5ac80c2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:33.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.534+0000 7f5ace25b700 1 -- 172.21.15.45:0/3936875961 >> 172.21.15.45:0/3936875961 conn(0x7f5ac8066a70 msgr2=0x7f5ac814fbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:33.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.534+0000 7f5ace25b700 1 -- 172.21.15.45:0/3936875961 shutdown_connections 2023-12-22T10:00:33.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.538+0000 7f5ace25b700 1 -- 172.21.15.45:0/3936875961 wait complete. 2023-12-22T10:00:33.543 INFO:teuthology.orchestra.run.smithi045.stderr:new fs with metadata pool 3 and data pool 4 2023-12-22T10:00:33.563 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T10:00:33.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.718+0000 7f16d2547700 1 Processor -- start 2023-12-22T10:00:33.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.718+0000 7f16d2547700 1 -- start start 2023-12-22T10:00:33.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.722+0000 7f16d2547700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f16cc0c6070 0x7f16cc0aa940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:33.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.722+0000 7f16d2547700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16cc0c0f70 con 0x7f16cc0a9ed0 2023-12-22T10:00:33.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.722+0000 7f16d2547700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16cc0aa2b0 con 0x7f16cc0c1400 2023-12-22T10:00:33.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.722+0000 7f16d2547700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16cc0c1860 con 0x7f16cc0c6070 2023-12-22T10:00:33.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.722+0000 7f16d1545700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f16cc0a9ed0 0x7f16cc0bf910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:46558/0 (socket says 172.21.15.45:46558) 2023-12-22T10:00:33.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.722+0000 7f16d1545700 1 -- 172.21.15.45:0/3952098535 learned_addr learned my addr 172.21.15.45:0/3952098535 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:00:33.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.722+0000 7f16d1d46700 1 --2- 172.21.15.45:0/3952098535 >> v2:172.21.15.113:3300/0 conn(0x7f16cc0c6070 0x7f16cc0aa940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:33.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.726+0000 7f16c3fff700 1 -- 172.21.15.45:0/3952098535 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 513625356 0 0) 0x7f16cc0c0f70 con 0x7f16cc0a9ed0 2023-12-22T10:00:33.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.726+0000 7f16c3fff700 1 -- 172.21.15.45:0/3952098535 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16b80033f0 con 0x7f16cc0a9ed0 2023-12-22T10:00:33.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.726+0000 7f16c3fff700 1 -- 172.21.15.45:0/3952098535 <== mon.1 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1155269284 0 0) 0x7f16cc0aa2b0 con 0x7f16cc0c1400 2023-12-22T10:00:33.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.726+0000 7f16c3fff700 1 -- 172.21.15.45:0/3952098535 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16cc0c0f70 con 0x7f16cc0c1400 2023-12-22T10:00:33.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.726+0000 7f16c3fff700 1 -- 172.21.15.45:0/3952098535 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3094504725 0 0) 0x7f16b80033f0 con 0x7f16cc0a9ed0 2023-12-22T10:00:33.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.726+0000 7f16c3fff700 1 -- 172.21.15.45:0/3952098535 >> v2:172.21.15.113:3300/0 conn(0x7f16cc0c6070 msgr2=0x7f16cc0aa940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:00:33.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.726+0000 7f16c3fff700 1 --2- 172.21.15.45:0/3952098535 >> v2:172.21.15.113:3300/0 conn(0x7f16cc0c6070 0x7f16cc0aa940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:33.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.726+0000 7f16c3fff700 1 -- 172.21.15.45:0/3952098535 >> v1:172.21.15.113:6789/0 conn(0x7f16cc0c1400 legacy=0x7f16cc0c5960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:33.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.726+0000 7f16c3fff700 1 -- 172.21.15.45:0/3952098535 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16cc0c0360 con 0x7f16cc0a9ed0 2023-12-22T10:00:33.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.726+0000 7f16c3fff700 1 -- 172.21.15.45:0/3952098535 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2619163070 0 0) 0x7f16c8001470 con 0x7f16cc0a9ed0 2023-12-22T10:00:33.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.726+0000 7f16c3fff700 1 -- 172.21.15.45:0/3952098535 >> v1:172.21.15.45:6789/0 conn(0x7f16cc0a9ed0 legacy=0x7f16cc0bf910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:33.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.726+0000 7f16c3fff700 1 --2- 172.21.15.45:0/3952098535 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16b8003a70 0x7f16b8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:33.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.726+0000 7f16c3fff700 1 --2- 172.21.15.45:0/3952098535 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f16b8004690 0x7f16b8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:33.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.726+0000 7f16c3fff700 1 --2- 172.21.15.45:0/3952098535 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f16b8005000 0x7f16b800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:33.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.726+0000 7f16c3fff700 1 -- 172.21.15.45:0/3952098535 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16b800bf60 con 0x7f16b8003a70 2023-12-22T10:00:33.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.726+0000 7f16c3fff700 1 -- 172.21.15.45:0/3952098535 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16b800c0a0 con 0x7f16b8004690 2023-12-22T10:00:33.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.726+0000 7f16c3fff700 1 -- 172.21.15.45:0/3952098535 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16b800c210 con 0x7f16b8005000 2023-12-22T10:00:33.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.726+0000 7f16d1d46700 1 --2- 172.21.15.45:0/3952098535 >> v2:172.21.15.113:3300/0 conn(0x7f16cc0c6070 0x7f16cc0aa940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-12-22T10:00:33.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.726+0000 7f16d1545700 1 --2- 172.21.15.45:0/3952098535 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16b8003a70 0x7f16b8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:33.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.726+0000 7f16d0d44700 1 --2- 172.21.15.45:0/3952098535 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f16b8004690 0x7f16b8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:33.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.726+0000 7f16d1d46700 1 --2- 172.21.15.45:0/3952098535 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f16b8005000 0x7f16b800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:33.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.726+0000 7f16d1545700 1 -- 172.21.15.45:0/3952098535 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f16b8005000 msgr2=0x7f16b800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:00:33.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.726+0000 7f16d1545700 1 --2- 172.21.15.45:0/3952098535 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f16b8005000 0x7f16b800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:33.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.726+0000 7f16d1545700 1 -- 172.21.15.45:0/3952098535 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f16b8004690 msgr2=0x7f16b8004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:00:33.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.726+0000 7f16d1545700 1 --2- 172.21.15.45:0/3952098535 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f16b8004690 0x7f16b8004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:33.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.726+0000 7f16d1545700 1 -- 172.21.15.45:0/3952098535 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16b80033f0 con 0x7f16b8003a70 2023-12-22T10:00:33.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.726+0000 7f16d1d46700 1 -- 172.21.15.45:0/3952098535 reap_dead start 2023-12-22T10:00:33.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.726+0000 7f16d1545700 1 --2- 172.21.15.45:0/3952098535 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16b8003a70 0x7f16b8003e70 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f16c800c190 tx=0x7f16c8001e10).ready entity=mon.0 client_cookie=b01feceebf7b4a4a server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:33.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.726+0000 7f16c3fff700 1 -- 172.21.15.45:0/3952098535 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c800ca00 con 0x7f16b8003a70 2023-12-22T10:00:33.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.726+0000 7f16c3fff700 1 -- 172.21.15.45:0/3952098535 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16c800cb60 con 0x7f16b8003a70 2023-12-22T10:00:33.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.726+0000 7f16c3fff700 1 -- 172.21.15.45:0/3952098535 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c80070d0 con 0x7f16b8003a70 2023-12-22T10:00:33.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.730+0000 7f16d2547700 1 -- 172.21.15.45:0/3952098535 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16b8003a70 msgr2=0x7f16b8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:33.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.730+0000 7f16d2547700 1 --2- 172.21.15.45:0/3952098535 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16b8003a70 0x7f16b8003e70 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f16c800c190 tx=0x7f16c8001e10).stop 2023-12-22T10:00:33.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.730+0000 7f16d2547700 1 -- 172.21.15.45:0/3952098535 shutdown_connections 2023-12-22T10:00:33.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.730+0000 7f16d2547700 1 --2- 172.21.15.45:0/3952098535 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16b8003a70 0x7f16b8003e70 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:33.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.730+0000 7f16d2547700 1 -- 172.21.15.45:0/3952098535 >> 172.21.15.45:0/3952098535 conn(0x7f16cc067500 msgr2=0x7f16cc0ca9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:33.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.730+0000 7f16d2547700 1 -- 172.21.15.45:0/3952098535 shutdown_connections 2023-12-22T10:00:33.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.730+0000 7f16d2547700 1 -- 172.21.15.45:0/3952098535 wait complete. 2023-12-22T10:00:33.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.730+0000 7f16d2547700 1 Processor -- start 2023-12-22T10:00:33.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.730+0000 7f16d2547700 1 -- start start 2023-12-22T10:00:33.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.734+0000 7f16d2547700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f16b8003a70 0x7f16cc0c4b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:33.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.734+0000 7f16d2547700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f16cc1570b0 0x7f16cc164c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:33.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.734+0000 7f16d2547700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16cc0a8dd0 0x7f16cc0c1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:33.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.734+0000 7f16d2547700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16cc157530 con 0x7f16cc0a8dd0 2023-12-22T10:00:33.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.734+0000 7f16d2547700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16cc165160 con 0x7f16cc1570b0 2023-12-22T10:00:33.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.734+0000 7f16d2547700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16cc157720 con 0x7f16b8003a70 2023-12-22T10:00:33.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.734+0000 7f16d1d46700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16cc0a8dd0 0x7f16cc0c1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:33.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.734+0000 7f16d1d46700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16cc0a8dd0 0x7f16cc0c1a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42344/0 (socket says 172.21.15.45:42344) 2023-12-22T10:00:33.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.734+0000 7f16d1d46700 1 -- 172.21.15.45:0/2806158315 learned_addr learned my addr 172.21.15.45:0/2806158315 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:33.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.734+0000 7f16d0d44700 1 --2- 172.21.15.45:0/2806158315 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f16cc1570b0 0x7f16cc164c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:33.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.734+0000 7f16d1545700 1 --2- 172.21.15.45:0/2806158315 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f16b8003a70 0x7f16cc0c4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:33.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.734+0000 7f16d1d46700 1 -- 172.21.15.45:0/2806158315 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f16b8003a70 msgr2=0x7f16cc0c4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:33.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.734+0000 7f16d1d46700 1 --2- 172.21.15.45:0/2806158315 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f16b8003a70 0x7f16cc0c4b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:33.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.734+0000 7f16d1d46700 1 -- 172.21.15.45:0/2806158315 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f16cc1570b0 msgr2=0x7f16cc164c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:33.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.734+0000 7f16d1d46700 1 --2- 172.21.15.45:0/2806158315 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f16cc1570b0 0x7f16cc164c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:33.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.734+0000 7f16d1d46700 1 -- 172.21.15.45:0/2806158315 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16cc0c4030 con 0x7f16cc0a8dd0 2023-12-22T10:00:33.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.734+0000 7f16d1d46700 1 --2- 172.21.15.45:0/2806158315 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16cc0a8dd0 0x7f16cc0c1a50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f16cc0c6510 tx=0x7f16c400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:33.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.734+0000 7f16c17fa700 1 -- 172.21.15.45:0/2806158315 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c400e070 con 0x7f16cc0a8dd0 2023-12-22T10:00:33.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.734+0000 7f16c17fa700 1 -- 172.21.15.45:0/2806158315 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16c4011d00 con 0x7f16cc0a8dd0 2023-12-22T10:00:33.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.734+0000 7f16c17fa700 1 -- 172.21.15.45:0/2806158315 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c4016660 con 0x7f16cc0a8dd0 2023-12-22T10:00:33.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.734+0000 7f16d2547700 1 -- 172.21.15.45:0/2806158315 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16cc0c4310 con 0x7f16cc0a8dd0 2023-12-22T10:00:33.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.738+0000 7f16d2547700 1 -- 172.21.15.45:0/2806158315 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16cc0a9210 con 0x7f16cc0a8dd0 2023-12-22T10:00:33.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.738+0000 7f16d2547700 1 -- 172.21.15.45:0/2806158315 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16cc0c4810 con 0x7f16cc0a8dd0 2023-12-22T10:00:33.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.738+0000 7f16c17fa700 1 -- 172.21.15.45:0/2806158315 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f16c4016a10 con 0x7f16cc0a8dd0 2023-12-22T10:00:33.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.742+0000 7f16c17fa700 1 --2- 172.21.15.45:0/2806158315 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f16b005a510 0x7f16b005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:33.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.742+0000 7f16c17fa700 1 -- 172.21.15.45:0/2806158315 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f16c4074f00 con 0x7f16cc0a8dd0 2023-12-22T10:00:33.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.742+0000 7f16d1545700 1 --2- 172.21.15.45:0/2806158315 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f16b005a510 0x7f16b005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:33.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.742+0000 7f16d1545700 1 --2- 172.21.15.45:0/2806158315 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f16b005a510 0x7f16b005c9d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f16c8001e70 tx=0x7f16c8015000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:33.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.746+0000 7f16c17fa700 1 -- 172.21.15.45:0/2806158315 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f16c4048730 con 0x7f16cc0a8dd0 2023-12-22T10:00:33.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.918+0000 7f16d2547700 1 -- 172.21.15.45:0/2806158315 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f16cc047060 con 0x7f16cc0a8dd0 2023-12-22T10:00:33.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.918+0000 7f16c17fa700 1 -- 172.21.15.45:0/2806158315 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16941 (secure 0 0 0) 0x7f16c404bd50 con 0x7f16cc0a8dd0 2023-12-22T10:00:33.917 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:00:33.917 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":20,"fsid":"98b0837e-5e68-4c8f-a1a0-e9424baaad8f","created":"2023-12-22T10:00:15.010174+0000","modified":"2023-12-22T10:00:33.521737+0000","last_up_change":"2023-12-22T10:00:24.980513+0000","last_in_change":"2023-12-22T10:00:17.887172+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-12-22T10:00:25.069641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-12-22T10:00:26.906399+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-12-22T10:00:31.621311+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-12-22T10:00:32.538053+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e19943a0-1c6b-47df-b6bb-383472077890","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":33777},{"type":"v1","addr":"172.21.15.45:6819","nonce":33777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":33777},{"type":"v1","addr":"172.21.15.45:6822","nonce":33777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":33777},{"type":"v1","addr":"172.21.15.45:6830","nonce":33777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":33777},{"type":"v1","addr":"172.21.15.45:6826","nonce":33777}]},"public_addr":"172.21.15.45:6819/33777","cluster_addr":"172.21.15.45:6822/33777","heartbeat_back_addr":"172.21.15.45:6830/33777","heartbeat_front_addr":"172.21.15.45:6826/33777","state":["exists","up"]},{"osd":1,"uuid":"69670f34-f082-45a7-8f67-e962acc136e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":33775},{"type":"v1","addr":"172.21.15.45:6809","nonce":33775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":33775},{"type":"v1","addr":"172.21.15.45:6811","nonce":33775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":33775},{"type":"v1","addr":"172.21.15.45:6815","nonce":33775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":33775},{"type":"v1","addr":"172.21.15.45:6813","nonce":33775}]},"public_addr":"172.21.15.45:6809/33775","cluster_addr":"172.21.15.45:6811/33775","heartbeat_back_addr":"172.21.15.45:6815/33775","heartbeat_front_addr":"172.21.15.45:6813/33775","state":["exists","up"]},{"osd":2,"uuid":"d909d49b-82b8-401b-9947-e49dd167bb95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":33776},{"type":"v1","addr":"172.21.15.45:6801","nonce":33776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":33776},{"type":"v1","addr":"172.21.15.45:6803","nonce":33776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":33776},{"type":"v1","addr":"172.21.15.45:6807","nonce":33776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":33776},{"type":"v1","addr":"172.21.15.45:6805","nonce":33776}]},"public_addr":"172.21.15.45:6801/33776","cluster_addr":"172.21.15.45:6803/33776","heartbeat_back_addr":"172.21.15.45:6807/33776","heartbeat_front_addr":"172.21.15.45:6805/33776","state":["exists","up"]},{"osd":3,"uuid":"db104ca9-3a94-4d39-a2be-bd06db888095","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":33782},{"type":"v1","addr":"172.21.15.45:6817","nonce":33782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":33782},{"type":"v1","addr":"172.21.15.45:6823","nonce":33782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":33782},{"type":"v1","addr":"172.21.15.45:6831","nonce":33782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":33782},{"type":"v1","addr":"172.21.15.45:6827","nonce":33782}]},"public_addr":"172.21.15.45:6817/33782","cluster_addr":"172.21.15.45:6823/33782","heartbeat_back_addr":"172.21.15.45:6831/33782","heartbeat_front_addr":"172.21.15.45:6827/33782","state":["exists","up"]},{"osd":4,"uuid":"9f4eaff4-e433-4479-a0d1-ee7a33375ca6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":34099},{"type":"v1","addr":"172.21.15.113:6811","nonce":34099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":34099},{"type":"v1","addr":"172.21.15.113:6815","nonce":34099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":34099},{"type":"v1","addr":"172.21.15.113:6823","nonce":34099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6816","nonce":34099},{"type":"v1","addr":"172.21.15.113:6818","nonce":34099}]},"public_addr":"172.21.15.113:6811/34099","cluster_addr":"172.21.15.113:6815/34099","heartbeat_back_addr":"172.21.15.113:6823/34099","heartbeat_front_addr":"172.21.15.113:6818/34099","state":["exists","up"]},{"osd":5,"uuid":"1efc5591-180b-43af-8611-0068aadc5aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":34100},{"type":"v1","addr":"172.21.15.113:6801","nonce":34100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":34100},{"type":"v1","addr":"172.21.15.113:6803","nonce":34100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":34100},{"type":"v1","addr":"172.21.15.113:6807","nonce":34100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":34100},{"type":"v1","addr":"172.21.15.113:6805","nonce":34100}]},"public_addr":"172.21.15.113:6801/34100","cluster_addr":"172.21.15.113:6803/34100","heartbeat_back_addr":"172.21.15.113:6807/34100","heartbeat_front_addr":"172.21.15.113:6805/34100","state":["exists","up"]},{"osd":6,"uuid":"6c89d9d8-c153-4a48-afa9-97e4c403f1ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":34101},{"type":"v1","addr":"172.21.15.113:6810","nonce":34101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6812","nonce":34101},{"type":"v1","addr":"172.21.15.113:6814","nonce":34101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6822","nonce":34101},{"type":"v1","addr":"172.21.15.113:6824","nonce":34101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":34101},{"type":"v1","addr":"172.21.15.113:6819","nonce":34101}]},"public_addr":"172.21.15.113:6810/34101","cluster_addr":"172.21.15.113:6814/34101","heartbeat_back_addr":"172.21.15.113:6824/34101","heartbeat_front_addr":"172.21.15.113:6819/34101","state":["exists","up"]},{"osd":7,"uuid":"1855e70c-23f6-4c08-ad7f-774c2148235b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6821","nonce":34102},{"type":"v1","addr":"172.21.15.113:6825","nonce":34102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":34102},{"type":"v1","addr":"172.21.15.113:6827","nonce":34102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":34102},{"type":"v1","addr":"172.21.15.113:6831","nonce":34102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6828","nonce":34102},{"type":"v1","addr":"172.21.15.113:6829","nonce":34102}]},"public_addr":"172.21.15.113:6825/34102","cluster_addr":"172.21.15.113:6827/34102","heartbeat_back_addr":"172.21.15.113:6831/34102","heartbeat_front_addr":"172.21.15.113:6829/34102","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.812672+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.825045+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.700105+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.856563+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.954683+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.883234+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.883994+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.821686+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T10:00:33.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.922+0000 7f16d2547700 1 -- 172.21.15.45:0/2806158315 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f16b005a510 msgr2=0x7f16b005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:33.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.922+0000 7f16d2547700 1 --2- 172.21.15.45:0/2806158315 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f16b005a510 0x7f16b005c9d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f16c8001e70 tx=0x7f16c8015000).stop 2023-12-22T10:00:33.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.922+0000 7f16d2547700 1 -- 172.21.15.45:0/2806158315 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16cc0a8dd0 msgr2=0x7f16cc0c1a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:33.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.922+0000 7f16d2547700 1 --2- 172.21.15.45:0/2806158315 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16cc0a8dd0 0x7f16cc0c1a50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f16cc0c6510 tx=0x7f16c400b040).stop 2023-12-22T10:00:33.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.922+0000 7f16d2547700 1 -- 172.21.15.45:0/2806158315 shutdown_connections 2023-12-22T10:00:33.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.922+0000 7f16d2547700 1 --2- 172.21.15.45:0/2806158315 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16cc0a8dd0 0x7f16cc0c1a50 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:33.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.922+0000 7f16d2547700 1 --2- 172.21.15.45:0/2806158315 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f16cc1570b0 0x7f16cc164c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:33.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.922+0000 7f16d2547700 1 --2- 172.21.15.45:0/2806158315 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f16b005a510 0x7f16b005c9d0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:33.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.922+0000 7f16d2547700 1 --2- 172.21.15.45:0/2806158315 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f16b8003a70 0x7f16cc0c4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:33.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.922+0000 7f16d2547700 1 -- 172.21.15.45:0/2806158315 >> 172.21.15.45:0/2806158315 conn(0x7f16cc067500 msgr2=0x7f16cc153470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:33.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.922+0000 7f16d2547700 1 -- 172.21.15.45:0/2806158315 shutdown_connections 2023-12-22T10:00:33.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:33.922+0000 7f16d2547700 1 -- 172.21.15.45:0/2806158315 wait complete. 2023-12-22T10:00:33.940 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T10:00:34.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.106+0000 7fc3b7147700 1 Processor -- start 2023-12-22T10:00:34.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.106+0000 7fc3b7147700 1 -- start start 2023-12-22T10:00:34.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.110+0000 7fc3b7147700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc3b00c5fa0 0x7fc3b015e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:34.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.110+0000 7fc3b7147700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3b0158520 con 0x7fc3b00aa040 2023-12-22T10:00:34.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.110+0000 7fc3b7147700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3b00bfdb0 con 0x7fc3b00a9c60 2023-12-22T10:00:34.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.110+0000 7fc3b7147700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b0157cb0 con 0x7fc3b00c5fa0 2023-12-22T10:00:34.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.110+0000 7fc3b5944700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fc3b00aa040 0x7fc3b00c5890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:46572/0 (socket says 172.21.15.45:46572) 2023-12-22T10:00:34.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.110+0000 7fc3b5944700 1 -- 172.21.15.45:0/3063803758 learned_addr learned my addr 172.21.15.45:0/3063803758 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:00:34.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.110+0000 7fc3b6946700 1 --2- 172.21.15.45:0/3063803758 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc3b00c5fa0 0x7fc3b015e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:34.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.110+0000 7fc3b5143700 1 -- 172.21.15.45:0/3063803758 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1266543742 0 0) 0x7fc3b0158520 con 0x7fc3b00aa040 2023-12-22T10:00:34.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.110+0000 7fc3b5143700 1 -- 172.21.15.45:0/3063803758 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc39c0033f0 con 0x7fc3b00aa040 2023-12-22T10:00:34.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.110+0000 7fc3b5143700 1 -- 172.21.15.45:0/3063803758 <== mon.1 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1120006861 0 0) 0x7fc3b00bfdb0 con 0x7fc3b00a9c60 2023-12-22T10:00:34.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.110+0000 7fc3b5143700 1 -- 172.21.15.45:0/3063803758 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3b0158520 con 0x7fc3b00a9c60 2023-12-22T10:00:34.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.110+0000 7fc3b6946700 1 -- 172.21.15.45:0/3063803758 >> v1:172.21.15.113:6789/0 conn(0x7fc3b00a9c60 legacy=0x7fc3b01575a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:34.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.110+0000 7fc3b6946700 1 -- 172.21.15.45:0/3063803758 >> v1:172.21.15.45:6789/0 conn(0x7fc3b00aa040 legacy=0x7fc3b00c5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:34.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.110+0000 7fc3b6946700 1 -- 172.21.15.45:0/3063803758 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3b0157f60 con 0x7fc3b00c5fa0 2023-12-22T10:00:34.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.110+0000 7fc3b6946700 1 --2- 172.21.15.45:0/3063803758 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc3b00c5fa0 0x7fc3b015e940 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fc3a8009e90 tx=0x7fc3a8009780).ready entity=mon.2 client_cookie=74db3227f208b7ac server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:34.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.110+0000 7fc3b5143700 1 -- 172.21.15.45:0/3063803758 <== mon.2 v2:172.21.15.113:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a800e070 con 0x7fc3b00c5fa0 2023-12-22T10:00:34.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.110+0000 7fc3b5143700 1 -- 172.21.15.45:0/3063803758 <== mon.2 v2:172.21.15.113:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3a800bab0 con 0x7fc3b00c5fa0 2023-12-22T10:00:34.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.110+0000 7fc3b5143700 1 -- 172.21.15.45:0/3063803758 <== mon.2 v2:172.21.15.113:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a800be30 con 0x7fc3b00c5fa0 2023-12-22T10:00:34.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.110+0000 7fc3b7147700 1 -- 172.21.15.45:0/3063803758 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc3b00c5fa0 msgr2=0x7fc3b015e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:34.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.110+0000 7fc3b7147700 1 --2- 172.21.15.45:0/3063803758 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc3b00c5fa0 0x7fc3b015e940 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fc3a8009e90 tx=0x7fc3a8009780).stop 2023-12-22T10:00:34.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.114+0000 7fc3b7147700 1 -- 172.21.15.45:0/3063803758 shutdown_connections 2023-12-22T10:00:34.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.114+0000 7fc3b7147700 1 --2- 172.21.15.45:0/3063803758 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc3b00c5fa0 0x7fc3b015e940 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:34.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.114+0000 7fc3b7147700 1 -- 172.21.15.45:0/3063803758 >> 172.21.15.45:0/3063803758 conn(0x7fc3b0067500 msgr2=0x7fc3b00ca9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:34.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.114+0000 7fc3b7147700 1 -- 172.21.15.45:0/3063803758 shutdown_connections 2023-12-22T10:00:34.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.114+0000 7fc3b7147700 1 -- 172.21.15.45:0/3063803758 wait complete. 2023-12-22T10:00:34.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.114+0000 7fc3b7147700 1 Processor -- start 2023-12-22T10:00:34.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.114+0000 7fc3b7147700 1 -- start start 2023-12-22T10:00:34.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.114+0000 7fc3b7147700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3b00a9c60 0x7fc3b00c4950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:34.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.114+0000 7fc3b7147700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc3b00aa040 0x7fc3b00aef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:34.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.114+0000 7fc3b7147700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc3b00c5fa0 0x7fc3b0156030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:34.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.114+0000 7fc3b7147700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b0156520 con 0x7fc3b00a9c60 2023-12-22T10:00:34.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.114+0000 7fc3b7147700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b00af5a0 con 0x7fc3b00c5fa0 2023-12-22T10:00:34.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.114+0000 7fc3b7147700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b00af880 con 0x7fc3b00aa040 2023-12-22T10:00:34.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.114+0000 7fc3b6145700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3b00a9c60 0x7fc3b00c4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:34.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.118+0000 7fc3b5944700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc3b00aa040 0x7fc3b00aef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:34.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.118+0000 7fc3b5944700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc3b00aa040 0x7fc3b00aef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.113:3301/0 says I am v2:172.21.15.45:38940/0 (socket says 172.21.15.45:38940) 2023-12-22T10:00:34.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.118+0000 7fc3b6946700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc3b00c5fa0 0x7fc3b0156030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:34.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.118+0000 7fc3b5944700 1 -- 172.21.15.45:0/3042353736 learned_addr learned my addr 172.21.15.45:0/3042353736 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:34.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.118+0000 7fc3b6145700 1 -- 172.21.15.45:0/3042353736 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc3b00aa040 msgr2=0x7fc3b00aef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:34.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.118+0000 7fc3b6145700 1 --2- 172.21.15.45:0/3042353736 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc3b00aa040 0x7fc3b00aef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:34.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.118+0000 7fc3b6145700 1 -- 172.21.15.45:0/3042353736 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc3b00c5fa0 msgr2=0x7fc3b0156030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:34.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.118+0000 7fc3b6145700 1 --2- 172.21.15.45:0/3042353736 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc3b00c5fa0 0x7fc3b0156030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:34.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.118+0000 7fc3b6145700 1 -- 172.21.15.45:0/3042353736 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3a8009a20 con 0x7fc3b00a9c60 2023-12-22T10:00:34.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.118+0000 7fc3b6145700 1 --2- 172.21.15.45:0/3042353736 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3b00a9c60 0x7fc3b00c4950 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7fc3ac00c420 tx=0x7fc3ac007bd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:34.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.118+0000 7fc3a67fc700 1 -- 172.21.15.45:0/3042353736 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3ac012400 con 0x7fc3b00a9c60 2023-12-22T10:00:34.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.118+0000 7fc3a67fc700 1 -- 172.21.15.45:0/3042353736 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3ac012560 con 0x7fc3b00a9c60 2023-12-22T10:00:34.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.118+0000 7fc3a67fc700 1 -- 172.21.15.45:0/3042353736 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3ac012920 con 0x7fc3b00a9c60 2023-12-22T10:00:34.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.118+0000 7fc3b7147700 1 -- 172.21.15.45:0/3042353736 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3b00afb60 con 0x7fc3b00a9c60 2023-12-22T10:00:34.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.118+0000 7fc3b7147700 1 -- 172.21.15.45:0/3042353736 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3b00ab9a0 con 0x7fc3b00a9c60 2023-12-22T10:00:34.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.122+0000 7fc3b7147700 1 -- 172.21.15.45:0/3042353736 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3b00c2940 con 0x7fc3b00a9c60 2023-12-22T10:00:34.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.122+0000 7fc3a67fc700 1 -- 172.21.15.45:0/3042353736 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fc3ac01b3b0 con 0x7fc3b00a9c60 2023-12-22T10:00:34.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.122+0000 7fc3a67fc700 1 --2- 172.21.15.45:0/3042353736 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fc39405a510 0x7fc39405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:34.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.122+0000 7fc3a67fc700 1 -- 172.21.15.45:0/3042353736 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fc3ac073eb0 con 0x7fc3b00a9c60 2023-12-22T10:00:34.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.122+0000 7fc3b5944700 1 --2- 172.21.15.45:0/3042353736 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fc39405a510 0x7fc39405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:34.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.122+0000 7fc3b5944700 1 --2- 172.21.15.45:0/3042353736 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fc39405a510 0x7fc39405c9d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fc3b00ac550 tx=0x7fc3a0009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:34.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.130+0000 7fc3a67fc700 1 -- 172.21.15.45:0/3042353736 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc3ac047630 con 0x7fc3b00a9c60 2023-12-22T10:00:34.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.302+0000 7fc3b7147700 1 -- 172.21.15.45:0/3042353736 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc3b0047060 con 0x7fc3b00a9c60 2023-12-22T10:00:34.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.306+0000 7fc3a67fc700 1 -- 172.21.15.45:0/3042353736 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16941 (secure 0 0 0) 0x7fc3ac04ac50 con 0x7fc3b00a9c60 2023-12-22T10:00:34.301 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:00:34.301 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":20,"fsid":"98b0837e-5e68-4c8f-a1a0-e9424baaad8f","created":"2023-12-22T10:00:15.010174+0000","modified":"2023-12-22T10:00:33.521737+0000","last_up_change":"2023-12-22T10:00:24.980513+0000","last_in_change":"2023-12-22T10:00:17.887172+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-12-22T10:00:25.069641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-12-22T10:00:26.906399+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-12-22T10:00:31.621311+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-12-22T10:00:32.538053+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e19943a0-1c6b-47df-b6bb-383472077890","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":33777},{"type":"v1","addr":"172.21.15.45:6819","nonce":33777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":33777},{"type":"v1","addr":"172.21.15.45:6822","nonce":33777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":33777},{"type":"v1","addr":"172.21.15.45:6830","nonce":33777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":33777},{"type":"v1","addr":"172.21.15.45:6826","nonce":33777}]},"public_addr":"172.21.15.45:6819/33777","cluster_addr":"172.21.15.45:6822/33777","heartbeat_back_addr":"172.21.15.45:6830/33777","heartbeat_front_addr":"172.21.15.45:6826/33777","state":["exists","up"]},{"osd":1,"uuid":"69670f34-f082-45a7-8f67-e962acc136e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":33775},{"type":"v1","addr":"172.21.15.45:6809","nonce":33775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":33775},{"type":"v1","addr":"172.21.15.45:6811","nonce":33775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":33775},{"type":"v1","addr":"172.21.15.45:6815","nonce":33775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":33775},{"type":"v1","addr":"172.21.15.45:6813","nonce":33775}]},"public_addr":"172.21.15.45:6809/33775","cluster_addr":"172.21.15.45:6811/33775","heartbeat_back_addr":"172.21.15.45:6815/33775","heartbeat_front_addr":"172.21.15.45:6813/33775","state":["exists","up"]},{"osd":2,"uuid":"d909d49b-82b8-401b-9947-e49dd167bb95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":33776},{"type":"v1","addr":"172.21.15.45:6801","nonce":33776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":33776},{"type":"v1","addr":"172.21.15.45:6803","nonce":33776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":33776},{"type":"v1","addr":"172.21.15.45:6807","nonce":33776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":33776},{"type":"v1","addr":"172.21.15.45:6805","nonce":33776}]},"public_addr":"172.21.15.45:6801/33776","cluster_addr":"172.21.15.45:6803/33776","heartbeat_back_addr":"172.21.15.45:6807/33776","heartbeat_front_addr":"172.21.15.45:6805/33776","state":["exists","up"]},{"osd":3,"uuid":"db104ca9-3a94-4d39-a2be-bd06db888095","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":33782},{"type":"v1","addr":"172.21.15.45:6817","nonce":33782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":33782},{"type":"v1","addr":"172.21.15.45:6823","nonce":33782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":33782},{"type":"v1","addr":"172.21.15.45:6831","nonce":33782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":33782},{"type":"v1","addr":"172.21.15.45:6827","nonce":33782}]},"public_addr":"172.21.15.45:6817/33782","cluster_addr":"172.21.15.45:6823/33782","heartbeat_back_addr":"172.21.15.45:6831/33782","heartbeat_front_addr":"172.21.15.45:6827/33782","state":["exists","up"]},{"osd":4,"uuid":"9f4eaff4-e433-4479-a0d1-ee7a33375ca6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":34099},{"type":"v1","addr":"172.21.15.113:6811","nonce":34099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":34099},{"type":"v1","addr":"172.21.15.113:6815","nonce":34099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":34099},{"type":"v1","addr":"172.21.15.113:6823","nonce":34099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6816","nonce":34099},{"type":"v1","addr":"172.21.15.113:6818","nonce":34099}]},"public_addr":"172.21.15.113:6811/34099","cluster_addr":"172.21.15.113:6815/34099","heartbeat_back_addr":"172.21.15.113:6823/34099","heartbeat_front_addr":"172.21.15.113:6818/34099","state":["exists","up"]},{"osd":5,"uuid":"1efc5591-180b-43af-8611-0068aadc5aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":34100},{"type":"v1","addr":"172.21.15.113:6801","nonce":34100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":34100},{"type":"v1","addr":"172.21.15.113:6803","nonce":34100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":34100},{"type":"v1","addr":"172.21.15.113:6807","nonce":34100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":34100},{"type":"v1","addr":"172.21.15.113:6805","nonce":34100}]},"public_addr":"172.21.15.113:6801/34100","cluster_addr":"172.21.15.113:6803/34100","heartbeat_back_addr":"172.21.15.113:6807/34100","heartbeat_front_addr":"172.21.15.113:6805/34100","state":["exists","up"]},{"osd":6,"uuid":"6c89d9d8-c153-4a48-afa9-97e4c403f1ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":34101},{"type":"v1","addr":"172.21.15.113:6810","nonce":34101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6812","nonce":34101},{"type":"v1","addr":"172.21.15.113:6814","nonce":34101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6822","nonce":34101},{"type":"v1","addr":"172.21.15.113:6824","nonce":34101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":34101},{"type":"v1","addr":"172.21.15.113:6819","nonce":34101}]},"public_addr":"172.21.15.113:6810/34101","cluster_addr":"172.21.15.113:6814/34101","heartbeat_back_addr":"172.21.15.113:6824/34101","heartbeat_front_addr":"172.21.15.113:6819/34101","state":["exists","up"]},{"osd":7,"uuid":"1855e70c-23f6-4c08-ad7f-774c2148235b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6821","nonce":34102},{"type":"v1","addr":"172.21.15.113:6825","nonce":34102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":34102},{"type":"v1","addr":"172.21.15.113:6827","nonce":34102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":34102},{"type":"v1","addr":"172.21.15.113:6831","nonce":34102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6828","nonce":34102},{"type":"v1","addr":"172.21.15.113:6829","nonce":34102}]},"public_addr":"172.21.15.113:6825/34102","cluster_addr":"172.21.15.113:6827/34102","heartbeat_back_addr":"172.21.15.113:6831/34102","heartbeat_front_addr":"172.21.15.113:6829/34102","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.812672+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.825045+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.700105+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.856563+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.954683+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.883234+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.883994+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.821686+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T10:00:34.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.310+0000 7fc3b7147700 1 -- 172.21.15.45:0/3042353736 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fc39405a510 msgr2=0x7fc39405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:34.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.310+0000 7fc3b7147700 1 --2- 172.21.15.45:0/3042353736 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fc39405a510 0x7fc39405c9d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fc3b00ac550 tx=0x7fc3a0009040).stop 2023-12-22T10:00:34.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.310+0000 7fc3b7147700 1 -- 172.21.15.45:0/3042353736 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3b00a9c60 msgr2=0x7fc3b00c4950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:34.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.310+0000 7fc3b7147700 1 --2- 172.21.15.45:0/3042353736 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3b00a9c60 0x7fc3b00c4950 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7fc3ac00c420 tx=0x7fc3ac007bd0).stop 2023-12-22T10:00:34.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.310+0000 7fc3b7147700 1 -- 172.21.15.45:0/3042353736 shutdown_connections 2023-12-22T10:00:34.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.310+0000 7fc3b7147700 1 --2- 172.21.15.45:0/3042353736 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc3b00c5fa0 0x7fc3b0156030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:34.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.310+0000 7fc3b7147700 1 --2- 172.21.15.45:0/3042353736 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fc39405a510 0x7fc39405c9d0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:34.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.310+0000 7fc3b7147700 1 --2- 172.21.15.45:0/3042353736 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc3b00aa040 0x7fc3b00aef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:34.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.310+0000 7fc3b7147700 1 --2- 172.21.15.45:0/3042353736 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3b00a9c60 0x7fc3b00c4950 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:34.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.310+0000 7fc3b7147700 1 -- 172.21.15.45:0/3042353736 >> 172.21.15.45:0/3042353736 conn(0x7fc3b0067500 msgr2=0x7fc3b00c9980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:34.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.310+0000 7fc3b7147700 1 -- 172.21.15.45:0/3042353736 shutdown_connections 2023-12-22T10:00:34.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.310+0000 7fc3b7147700 1 -- 172.21.15.45:0/3042353736 wait complete. 2023-12-22T10:00:34.327 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-22T10:00:34.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.502+0000 7f31de5db700 1 Processor -- start 2023-12-22T10:00:34.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.502+0000 7f31de5db700 1 -- start start 2023-12-22T10:00:34.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.506+0000 7f31de5db700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31d80be850 0x7f31d8095010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:34.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.506+0000 7f31de5db700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31d8068b50 con 0x7f31d8153990 2023-12-22T10:00:34.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.506+0000 7f31de5db700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31d8068560 con 0x7f31d8153d70 2023-12-22T10:00:34.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.506+0000 7f31de5db700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31d80c3630 con 0x7f31d80be850 2023-12-22T10:00:34.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.506+0000 7f31dcb78700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31d80be850 0x7f31d8095010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:34.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.506+0000 7f31dcb78700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31d80be850 0x7f31d8095010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42372/0 (socket says 172.21.15.45:42372) 2023-12-22T10:00:34.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.506+0000 7f31dcb78700 1 -- 172.21.15.45:0/2669062650 learned_addr learned my addr 172.21.15.45:0/2669062650 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:34.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.506+0000 7f31dcb78700 1 -- 172.21.15.45:0/2669062650 >> v1:172.21.15.113:6789/0 conn(0x7f31d8153d70 legacy=0x7f31d80be140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:34.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.506+0000 7f31dcb78700 1 -- 172.21.15.45:0/2669062650 >> v1:172.21.15.45:6789/0 conn(0x7f31d8153990 legacy=0x7f31d80c2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:00:34.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.506+0000 7f31dcb78700 1 -- 172.21.15.45:0/2669062650 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31d80956a0 con 0x7f31d80be850 2023-12-22T10:00:34.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.506+0000 7f31dcb78700 1 --2- 172.21.15.45:0/2669062650 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31d80be850 0x7f31d8095010 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f31d0009f20 tx=0x7f31d0009840).ready entity=mon.0 client_cookie=3a0ed0fcdd3a9efc server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:34.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.510+0000 7f31d77fe700 1 -- 172.21.15.45:0/2669062650 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d000e070 con 0x7f31d80be850 2023-12-22T10:00:34.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.510+0000 7f31d77fe700 1 -- 172.21.15.45:0/2669062650 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31d000ba80 con 0x7f31d80be850 2023-12-22T10:00:34.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.510+0000 7f31d77fe700 1 -- 172.21.15.45:0/2669062650 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d000be00 con 0x7f31d80be850 2023-12-22T10:00:34.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.510+0000 7f31de5db700 1 -- 172.21.15.45:0/2669062650 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31d80be850 msgr2=0x7f31d8095010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:34.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.510+0000 7f31de5db700 1 --2- 172.21.15.45:0/2669062650 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31d80be850 0x7f31d8095010 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f31d0009f20 tx=0x7f31d0009840).stop 2023-12-22T10:00:34.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.510+0000 7f31de5db700 1 -- 172.21.15.45:0/2669062650 shutdown_connections 2023-12-22T10:00:34.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.510+0000 7f31de5db700 1 --2- 172.21.15.45:0/2669062650 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31d80be850 0x7f31d8095010 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:34.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.510+0000 7f31de5db700 1 -- 172.21.15.45:0/2669062650 >> 172.21.15.45:0/2669062650 conn(0x7f31d80c8880 msgr2=0x7f31d80c8c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:34.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.510+0000 7f31de5db700 1 -- 172.21.15.45:0/2669062650 shutdown_connections 2023-12-22T10:00:34.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.510+0000 7f31de5db700 1 -- 172.21.15.45:0/2669062650 wait complete. 2023-12-22T10:00:34.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.510+0000 7f31de5db700 1 Processor -- start 2023-12-22T10:00:34.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.510+0000 7f31de5db700 1 -- start start 2023-12-22T10:00:34.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.514+0000 7f31de5db700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31d80be850 0x7f31d81462a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:34.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.514+0000 7f31de5db700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f31d8153990 0x7f31d80a8340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:34.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.514+0000 7f31de5db700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f31d8153d70 0x7f31d80aa880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:34.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.514+0000 7f31de5db700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31d80a8d90 con 0x7f31d80be850 2023-12-22T10:00:34.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.514+0000 7f31de5db700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31d80a9070 con 0x7f31d8153990 2023-12-22T10:00:34.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.514+0000 7f31de5db700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31d80a9350 con 0x7f31d8153d70 2023-12-22T10:00:34.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.514+0000 7f31d7fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31d80be850 0x7f31d81462a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:34.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.514+0000 7f31d7fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31d80be850 0x7f31d81462a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42378/0 (socket says 172.21.15.45:42378) 2023-12-22T10:00:34.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.514+0000 7f31d7fff700 1 -- 172.21.15.45:0/1266065989 learned_addr learned my addr 172.21.15.45:0/1266065989 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:34.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.514+0000 7f31dcb78700 1 --2- 172.21.15.45:0/1266065989 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f31d8153d70 0x7f31d80aa880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:34.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.514+0000 7f31cffff700 1 --2- 172.21.15.45:0/1266065989 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f31d8153990 0x7f31d80a8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:34.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.514+0000 7f31d7fff700 1 -- 172.21.15.45:0/1266065989 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f31d8153d70 msgr2=0x7f31d80aa880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:34.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.514+0000 7f31d7fff700 1 --2- 172.21.15.45:0/1266065989 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f31d8153d70 0x7f31d80aa880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:34.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.514+0000 7f31d7fff700 1 -- 172.21.15.45:0/1266065989 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f31d8153990 msgr2=0x7f31d80a8340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:34.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.514+0000 7f31d7fff700 1 --2- 172.21.15.45:0/1266065989 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f31d8153990 0x7f31d80a8340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:34.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.514+0000 7f31d7fff700 1 -- 172.21.15.45:0/1266065989 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31d0009ae0 con 0x7f31d80be850 2023-12-22T10:00:34.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.514+0000 7f31d7fff700 1 --2- 172.21.15.45:0/1266065989 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31d80be850 0x7f31d81462a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f31c800c4c0 tx=0x7f31c8007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:34.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.514+0000 7f31d4ff9700 1 -- 172.21.15.45:0/1266065989 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c800ce70 con 0x7f31d80be850 2023-12-22T10:00:34.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.514+0000 7f31d4ff9700 1 -- 172.21.15.45:0/1266065989 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31c8001e90 con 0x7f31d80be850 2023-12-22T10:00:34.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.514+0000 7f31d4ff9700 1 -- 172.21.15.45:0/1266065989 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c8007250 con 0x7f31d80be850 2023-12-22T10:00:34.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.514+0000 7f31de5db700 1 -- 172.21.15.45:0/1266065989 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31d80a9630 con 0x7f31d80be850 2023-12-22T10:00:34.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.514+0000 7f31de5db700 1 -- 172.21.15.45:0/1266065989 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31d814d7c0 con 0x7f31d80be850 2023-12-22T10:00:34.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.518+0000 7f31de5db700 1 -- 172.21.15.45:0/1266065989 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31d806c070 con 0x7f31d80be850 2023-12-22T10:00:34.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.518+0000 7f31d4ff9700 1 -- 172.21.15.45:0/1266065989 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f31c80066a0 con 0x7f31d80be850 2023-12-22T10:00:34.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.518+0000 7f31d4ff9700 1 --2- 172.21.15.45:0/1266065989 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f31b805a510 0x7f31b805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:34.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.518+0000 7f31d4ff9700 1 -- 172.21.15.45:0/1266065989 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f31c80740b0 con 0x7f31d80be850 2023-12-22T10:00:34.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.522+0000 7f31cffff700 1 --2- 172.21.15.45:0/1266065989 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f31b805a510 0x7f31b805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:34.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.522+0000 7f31cffff700 1 --2- 172.21.15.45:0/1266065989 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f31b805a510 0x7f31b805c9d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f31d814dda0 tx=0x7f31c0007d40).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:34.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.526+0000 7f31d4ff9700 1 -- 172.21.15.45:0/1266065989 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f31c80477d0 con 0x7f31d80be850 2023-12-22T10:00:34.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:34.734+0000 7f31de5db700 1 -- 172.21.15.45:0/1266065989 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f31d8095980 con 0x7f31d80be850 2023-12-22T10:00:35.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:35.550+0000 7f31d4ff9700 1 -- 172.21.15.45:0/1266065989 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7f31c804adf0 con 0x7f31d80be850 2023-12-22T10:00:35.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:35.554+0000 7f31de5db700 1 -- 172.21.15.45:0/1266065989 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f31b805a510 msgr2=0x7f31b805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:35.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:35.554+0000 7f31de5db700 1 --2- 172.21.15.45:0/1266065989 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f31b805a510 0x7f31b805c9d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f31d814dda0 tx=0x7f31c0007d40).stop 2023-12-22T10:00:35.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:35.554+0000 7f31de5db700 1 -- 172.21.15.45:0/1266065989 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31d80be850 msgr2=0x7f31d81462a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:35.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:35.554+0000 7f31de5db700 1 --2- 172.21.15.45:0/1266065989 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31d80be850 0x7f31d81462a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f31c800c4c0 tx=0x7f31c8007e00).stop 2023-12-22T10:00:35.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:35.554+0000 7f31de5db700 1 -- 172.21.15.45:0/1266065989 shutdown_connections 2023-12-22T10:00:35.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:35.554+0000 7f31de5db700 1 --2- 172.21.15.45:0/1266065989 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f31b805a510 0x7f31b805c9d0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:35.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:35.554+0000 7f31de5db700 1 --2- 172.21.15.45:0/1266065989 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f31d8153d70 0x7f31d80aa880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:35.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:35.554+0000 7f31de5db700 1 --2- 172.21.15.45:0/1266065989 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f31d8153990 0x7f31d80a8340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:35.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:35.554+0000 7f31de5db700 1 --2- 172.21.15.45:0/1266065989 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31d80be850 0x7f31d81462a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:35.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:35.554+0000 7f31de5db700 1 -- 172.21.15.45:0/1266065989 >> 172.21.15.45:0/1266065989 conn(0x7f31d80c8880 msgr2=0x7f31d80be140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:35.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:35.554+0000 7f31de5db700 1 -- 172.21.15.45:0/1266065989 shutdown_connections 2023-12-22T10:00:35.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:35.558+0000 7f31de5db700 1 -- 172.21.15.45:0/1266065989 wait complete. 2023-12-22T10:00:35.575 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-22T10:00:35.576 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-22T10:00:35.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:35.754+0000 7f4c2759e700 1 Processor -- start 2023-12-22T10:00:35.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:35.754+0000 7f4c2759e700 1 -- start start 2023-12-22T10:00:35.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:35.754+0000 7f4c2759e700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f4c280691c0 0x7f4c280ad080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:35.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:35.754+0000 7f4c2759e700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c280c5810 con 0x7f4c280c9d20 2023-12-22T10:00:35.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:35.754+0000 7f4c2759e700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c280c8d90 con 0x7f4c280acca0 2023-12-22T10:00:35.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:35.754+0000 7f4c2759e700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c280c9350 con 0x7f4c280691c0 2023-12-22T10:00:35.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:35.754+0000 7f4c26d9d700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f4c280c9d20 0x7f4c280aa5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:46580/0 (socket says 172.21.15.45:46580) 2023-12-22T10:00:35.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:35.754+0000 7f4c26d9d700 1 -- 172.21.15.45:0/2661651769 learned_addr learned my addr 172.21.15.45:0/2661651769 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:00:35.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:35.758+0000 7f4c25d9b700 1 --2- 172.21.15.45:0/2661651769 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f4c280691c0 0x7f4c280ad080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:35.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:35.758+0000 7f4c2559a700 1 -- 172.21.15.45:0/2661651769 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1203414979 0 0) 0x7f4c280c5810 con 0x7f4c280c9d20 2023-12-22T10:00:35.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:35.758+0000 7f4c2559a700 1 -- 172.21.15.45:0/2661651769 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c100033f0 con 0x7f4c280c9d20 2023-12-22T10:00:35.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:35.758+0000 7f4c2559a700 1 -- 172.21.15.45:0/2661651769 <== mon.1 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3486108645 0 0) 0x7f4c280c8d90 con 0x7f4c280acca0 2023-12-22T10:00:35.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:35.758+0000 7f4c2559a700 1 -- 172.21.15.45:0/2661651769 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c280c5810 con 0x7f4c280acca0 2023-12-22T10:00:35.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:35.758+0000 7f4c2559a700 1 -- 172.21.15.45:0/2661651769 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4255005576 0 0) 0x7f4c100033f0 con 0x7f4c280c9d20 2023-12-22T10:00:35.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:35.758+0000 7f4c25d9b700 1 -- 172.21.15.45:0/2661651769 >> v1:172.21.15.113:6789/0 conn(0x7f4c280acca0 legacy=0x7f4c28068ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:35.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:35.758+0000 7f4c25d9b700 1 -- 172.21.15.45:0/2661651769 >> v1:172.21.15.45:6789/0 conn(0x7f4c280c9d20 legacy=0x7f4c280aa5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:35.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:35.758+0000 7f4c25d9b700 1 -- 172.21.15.45:0/2661651769 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c28154070 con 0x7f4c280691c0 2023-12-22T10:00:35.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:35.758+0000 7f4c25d9b700 1 --2- 172.21.15.45:0/2661651769 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f4c280691c0 0x7f4c280ad080 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f4c1c009790 tx=0x7f4c1c009060).ready entity=mon.2 client_cookie=a1f17f9be41e28c0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:35.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:35.758+0000 7f4c2559a700 1 -- 172.21.15.45:0/2661651769 <== mon.2 v2:172.21.15.113:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c200017f0 con 0x7f4c280691c0 2023-12-22T10:00:35.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:35.758+0000 7f4c2559a700 1 -- 172.21.15.45:0/2661651769 <== mon.2 v2:172.21.15.113:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c1c011400 con 0x7f4c280691c0 2023-12-22T10:00:35.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:35.758+0000 7f4c2559a700 1 -- 172.21.15.45:0/2661651769 <== mon.2 v2:172.21.15.113:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1c011780 con 0x7f4c280691c0 2023-12-22T10:00:35.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:35.758+0000 7f4c2759e700 1 -- 172.21.15.45:0/2661651769 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f4c280691c0 msgr2=0x7f4c280ad080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:35.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:35.758+0000 7f4c2759e700 1 --2- 172.21.15.45:0/2661651769 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f4c280691c0 0x7f4c280ad080 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f4c1c009790 tx=0x7f4c1c009060).stop 2023-12-22T10:00:35.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:35.758+0000 7f4c2759e700 1 -- 172.21.15.45:0/2661651769 shutdown_connections 2023-12-22T10:00:35.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:35.758+0000 7f4c2759e700 1 --2- 172.21.15.45:0/2661651769 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f4c280691c0 0x7f4c280ad080 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:35.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:35.758+0000 7f4c2759e700 1 -- 172.21.15.45:0/2661651769 >> 172.21.15.45:0/2661651769 conn(0x7f4c280674f0 msgr2=0x7f4c280ca820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:35.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:35.758+0000 7f4c2759e700 1 -- 172.21.15.45:0/2661651769 shutdown_connections 2023-12-22T10:00:35.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:35.758+0000 7f4c2759e700 1 -- 172.21.15.45:0/2661651769 wait complete. 2023-12-22T10:00:35.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:35.762+0000 7f4c2759e700 1 Processor -- start 2023-12-22T10:00:35.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:35.762+0000 7f4c2759e700 1 -- start start 2023-12-22T10:00:35.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:35.766+0000 7f4c2759e700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f4c280691c0 0x7f4c28149c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:35.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:35.766+0000 7f4c2759e700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4c280acca0 0x7f4c280bf780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:35.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:35.766+0000 7f4c2759e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c280c9d20 0x7f4c280bfc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:35.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:35.766+0000 7f4c2759e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c280c2c10 con 0x7f4c280c9d20 2023-12-22T10:00:35.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:35.766+0000 7f4c2759e700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c280c0160 con 0x7f4c280acca0 2023-12-22T10:00:35.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:35.766+0000 7f4c2759e700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c28167170 con 0x7f4c280691c0 2023-12-22T10:00:35.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:35.766+0000 7f4c26d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c280c9d20 0x7f4c280bfc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:35.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:35.766+0000 7f4c26d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c280c9d20 0x7f4c280bfc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42380/0 (socket says 172.21.15.45:42380) 2023-12-22T10:00:35.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:35.766+0000 7f4c26d9d700 1 -- 172.21.15.45:0/2282568051 learned_addr learned my addr 172.21.15.45:0/2282568051 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:35.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:35.766+0000 7f4c25d9b700 1 --2- 172.21.15.45:0/2282568051 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4c280acca0 0x7f4c280bf780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:35.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:35.766+0000 7f4c2659c700 1 --2- 172.21.15.45:0/2282568051 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f4c280691c0 0x7f4c28149c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:35.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:35.766+0000 7f4c26d9d700 1 -- 172.21.15.45:0/2282568051 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f4c280691c0 msgr2=0x7f4c28149c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:35.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:35.766+0000 7f4c26d9d700 1 --2- 172.21.15.45:0/2282568051 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f4c280691c0 0x7f4c28149c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:35.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:35.766+0000 7f4c26d9d700 1 -- 172.21.15.45:0/2282568051 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4c280acca0 msgr2=0x7f4c280bf780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:35.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:35.766+0000 7f4c26d9d700 1 --2- 172.21.15.45:0/2282568051 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4c280acca0 0x7f4c280bf780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:35.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:35.766+0000 7f4c26d9d700 1 -- 172.21.15.45:0/2282568051 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c1c0092a0 con 0x7f4c280c9d20 2023-12-22T10:00:35.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:35.766+0000 7f4c2659c700 1 --2- 172.21.15.45:0/2282568051 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f4c280691c0 0x7f4c28149c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T10:00:35.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:35.766+0000 7f4c26d9d700 1 --2- 172.21.15.45:0/2282568051 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c280c9d20 0x7f4c280bfc70 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f4c2000cb50 tx=0x7f4c20001e80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:35.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:35.766+0000 7f4c167fc700 1 -- 172.21.15.45:0/2282568051 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c20004c40 con 0x7f4c280c9d20 2023-12-22T10:00:35.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:35.766+0000 7f4c167fc700 1 -- 172.21.15.45:0/2282568051 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c20004da0 con 0x7f4c280c9d20 2023-12-22T10:00:35.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:35.766+0000 7f4c2759e700 1 -- 172.21.15.45:0/2282568051 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c280c3440 con 0x7f4c280c9d20 2023-12-22T10:00:35.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:35.766+0000 7f4c167fc700 1 -- 172.21.15.45:0/2282568051 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c200073a0 con 0x7f4c280c9d20 2023-12-22T10:00:35.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:35.766+0000 7f4c2759e700 1 -- 172.21.15.45:0/2282568051 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c280c2df0 con 0x7f4c280c9d20 2023-12-22T10:00:35.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:35.770+0000 7f4c2759e700 1 -- 172.21.15.45:0/2282568051 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c280c35d0 con 0x7f4c280c9d20 2023-12-22T10:00:35.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:35.770+0000 7f4c167fc700 1 -- 172.21.15.45:0/2282568051 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f4c20007750 con 0x7f4c280c9d20 2023-12-22T10:00:35.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:35.770+0000 7f4c167fc700 1 --2- 172.21.15.45:0/2282568051 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f4c0805a510 0x7f4c0805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:35.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:35.774+0000 7f4c167fc700 1 -- 172.21.15.45:0/2282568051 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f4c20074930 con 0x7f4c280c9d20 2023-12-22T10:00:35.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:35.774+0000 7f4c2659c700 1 --2- 172.21.15.45:0/2282568051 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f4c0805a510 0x7f4c0805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:35.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:35.774+0000 7f4c2659c700 1 --2- 172.21.15.45:0/2282568051 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f4c0805a510 0x7f4c0805c9d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f4c18007fd0 tx=0x7f4c18009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:35.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:35.778+0000 7f4c167fc700 1 -- 172.21.15.45:0/2282568051 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f4c20048050 con 0x7f4c280c9d20 2023-12-22T10:00:35.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:35.982+0000 7f4c2759e700 1 -- 172.21.15.45:0/2282568051 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f4c28047060 con 0x7f4c280c9d20 2023-12-22T10:00:36.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:36.562+0000 7f4c167fc700 1 -- 172.21.15.45:0/2282568051 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4c20001f10 con 0x7f4c280c9d20 2023-12-22T10:00:36.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:36.566+0000 7f4c2759e700 1 -- 172.21.15.45:0/2282568051 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f4c0805a510 msgr2=0x7f4c0805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:36.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:36.566+0000 7f4c2759e700 1 --2- 172.21.15.45:0/2282568051 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f4c0805a510 0x7f4c0805c9d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f4c18007fd0 tx=0x7f4c18009040).stop 2023-12-22T10:00:36.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:36.566+0000 7f4c2759e700 1 -- 172.21.15.45:0/2282568051 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c280c9d20 msgr2=0x7f4c280bfc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:36.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:36.566+0000 7f4c2759e700 1 --2- 172.21.15.45:0/2282568051 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c280c9d20 0x7f4c280bfc70 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f4c2000cb50 tx=0x7f4c20001e80).stop 2023-12-22T10:00:36.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:36.566+0000 7f4c2759e700 1 -- 172.21.15.45:0/2282568051 shutdown_connections 2023-12-22T10:00:36.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:36.566+0000 7f4c2759e700 1 --2- 172.21.15.45:0/2282568051 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c280c9d20 0x7f4c280bfc70 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:36.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:36.566+0000 7f4c2759e700 1 --2- 172.21.15.45:0/2282568051 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4c280acca0 0x7f4c280bf780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:36.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:36.566+0000 7f4c2759e700 1 --2- 172.21.15.45:0/2282568051 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f4c0805a510 0x7f4c0805c9d0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:36.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:36.566+0000 7f4c2759e700 1 --2- 172.21.15.45:0/2282568051 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f4c280691c0 0x7f4c28149c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:36.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:36.566+0000 7f4c2759e700 1 -- 172.21.15.45:0/2282568051 >> 172.21.15.45:0/2282568051 conn(0x7f4c280674f0 msgr2=0x7f4c280c0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:36.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:36.566+0000 7f4c2759e700 1 -- 172.21.15.45:0/2282568051 shutdown_connections 2023-12-22T10:00:36.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:36.566+0000 7f4c2759e700 1 -- 172.21.15.45:0/2282568051 wait complete. 2023-12-22T10:00:36.586 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-22T10:00:36.586 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T10:00:36.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:36.758+0000 7f47b081b700 1 Processor -- start 2023-12-22T10:00:36.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:36.758+0000 7f47b081b700 1 -- start start 2023-12-22T10:00:36.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:36.762+0000 7f47b081b700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f47ac1518f0 0x7f47ac064890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:36.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:36.762+0000 7f47b081b700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f47ac151cd0 0x7f47ac0a6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:36.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:36.766+0000 7f47b081b700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47ac155740 con 0x7f47ac064d80 2023-12-22T10:00:36.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:36.766+0000 7f47b081b700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47ac0c40f0 con 0x7f47ac1518f0 2023-12-22T10:00:36.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:36.766+0000 7f47b081b700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47ac0a61b0 con 0x7f47ac151cd0 2023-12-22T10:00:36.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:36.766+0000 7f47aad9d700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f47ac064d80 0x7f47ac0c3160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:46588/0 (socket says 172.21.15.45:46588) 2023-12-22T10:00:36.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:36.766+0000 7f47aad9d700 1 -- 172.21.15.45:0/165284786 learned_addr learned my addr 172.21.15.45:0/165284786 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:00:36.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:36.766+0000 7f47aa59c700 1 --2- 172.21.15.45:0/165284786 >> v2:172.21.15.113:3300/0 conn(0x7f47ac1518f0 0x7f47ac064890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:36.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:36.766+0000 7f47a9d9b700 1 --2- 172.21.15.45:0/165284786 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f47ac151cd0 0x7f47ac0a6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:36.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:36.766+0000 7f47a959a700 1 -- 172.21.15.45:0/165284786 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1782107037 0 0) 0x7f47ac155740 con 0x7f47ac064d80 2023-12-22T10:00:36.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:36.766+0000 7f47a959a700 1 -- 172.21.15.45:0/165284786 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47940033f0 con 0x7f47ac064d80 2023-12-22T10:00:36.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:36.766+0000 7f47aa59c700 1 -- 172.21.15.45:0/165284786 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f47ac151cd0 msgr2=0x7f47ac0a6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:00:36.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:36.766+0000 7f47aa59c700 1 --2- 172.21.15.45:0/165284786 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f47ac151cd0 0x7f47ac0a6d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:36.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:36.766+0000 7f47aa59c700 1 -- 172.21.15.45:0/165284786 >> v1:172.21.15.45:6789/0 conn(0x7f47ac064d80 legacy=0x7f47ac0c3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:36.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:36.766+0000 7f47aa59c700 1 -- 172.21.15.45:0/165284786 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47ac0a5910 con 0x7f47ac1518f0 2023-12-22T10:00:36.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:36.766+0000 7f47a9d9b700 1 --2- 172.21.15.45:0/165284786 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f47ac151cd0 0x7f47ac0a6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-12-22T10:00:36.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:36.766+0000 7f47aa59c700 1 --2- 172.21.15.45:0/165284786 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f47ac1518f0 0x7f47ac064890 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f479c009760 tx=0x7f479c009060).ready entity=mon.1 client_cookie=7b01be1672c83c6c server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:36.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:36.766+0000 7f47a959a700 1 -- 172.21.15.45:0/165284786 <== mon.1 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f479c00d4a0 con 0x7f47ac1518f0 2023-12-22T10:00:36.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:36.766+0000 7f47a959a700 1 -- 172.21.15.45:0/165284786 <== mon.1 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f479c00d600 con 0x7f47ac1518f0 2023-12-22T10:00:36.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:36.766+0000 7f47a959a700 1 -- 172.21.15.45:0/165284786 <== mon.1 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f479c00d980 con 0x7f47ac1518f0 2023-12-22T10:00:36.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:36.770+0000 7f47b081b700 1 -- 172.21.15.45:0/165284786 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f47ac1518f0 msgr2=0x7f47ac064890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:36.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:36.770+0000 7f47b081b700 1 --2- 172.21.15.45:0/165284786 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f47ac1518f0 0x7f47ac064890 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f479c009760 tx=0x7f479c009060).stop 2023-12-22T10:00:36.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:36.770+0000 7f47b081b700 1 -- 172.21.15.45:0/165284786 shutdown_connections 2023-12-22T10:00:36.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:36.770+0000 7f47b081b700 1 --2- 172.21.15.45:0/165284786 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f47ac151cd0 0x7f47ac0a6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:36.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:36.770+0000 7f47b081b700 1 --2- 172.21.15.45:0/165284786 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f47ac1518f0 0x7f47ac064890 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:36.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:36.770+0000 7f47b081b700 1 -- 172.21.15.45:0/165284786 >> 172.21.15.45:0/165284786 conn(0x7f47ac066a70 msgr2=0x7f47ac066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:36.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:36.770+0000 7f47b081b700 1 -- 172.21.15.45:0/165284786 shutdown_connections 2023-12-22T10:00:36.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:36.770+0000 7f47b081b700 1 -- 172.21.15.45:0/165284786 wait complete. 2023-12-22T10:00:36.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:36.770+0000 7f47b081b700 1 Processor -- start 2023-12-22T10:00:36.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:36.774+0000 7f47b081b700 1 -- start start 2023-12-22T10:00:36.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:36.774+0000 7f47b081b700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f47ac064d80 0x7f47ac1520b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:36.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:36.774+0000 7f47b081b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47ac1518f0 0x7f47ac149bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:36.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:36.774+0000 7f47b081b700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f47ac151cd0 0x7f47ac0abbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:36.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:36.774+0000 7f47b081b700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47ac14a500 con 0x7f47ac1518f0 2023-12-22T10:00:36.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:36.774+0000 7f47b081b700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47ac0a9a10 con 0x7f47ac064d80 2023-12-22T10:00:36.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:36.774+0000 7f47b081b700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47ac0a9cf0 con 0x7f47ac151cd0 2023-12-22T10:00:36.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:36.774+0000 7f47a9d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47ac1518f0 0x7f47ac149bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:36.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:36.774+0000 7f47a9d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47ac1518f0 0x7f47ac149bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42394/0 (socket says 172.21.15.45:42394) 2023-12-22T10:00:36.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:36.774+0000 7f47a9d9b700 1 -- 172.21.15.45:0/2483775149 learned_addr learned my addr 172.21.15.45:0/2483775149 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:36.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:36.774+0000 7f47aa59c700 1 --2- 172.21.15.45:0/2483775149 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f47ac064d80 0x7f47ac1520b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:36.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:36.774+0000 7f47aad9d700 1 --2- 172.21.15.45:0/2483775149 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f47ac151cd0 0x7f47ac0abbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:36.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:36.774+0000 7f47a9d9b700 1 -- 172.21.15.45:0/2483775149 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f47ac151cd0 msgr2=0x7f47ac0abbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:36.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:36.774+0000 7f47a9d9b700 1 --2- 172.21.15.45:0/2483775149 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f47ac151cd0 0x7f47ac0abbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:36.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:36.774+0000 7f47a9d9b700 1 -- 172.21.15.45:0/2483775149 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f47ac064d80 msgr2=0x7f47ac1520b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:36.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:36.774+0000 7f47a9d9b700 1 --2- 172.21.15.45:0/2483775149 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f47ac064d80 0x7f47ac1520b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:36.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:36.774+0000 7f47a9d9b700 1 -- 172.21.15.45:0/2483775149 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47a00092a0 con 0x7f47ac1518f0 2023-12-22T10:00:36.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:36.774+0000 7f47aad9d700 1 --2- 172.21.15.45:0/2483775149 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f47ac151cd0 0x7f47ac0abbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-12-22T10:00:36.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:36.774+0000 7f47a9d9b700 1 --2- 172.21.15.45:0/2483775149 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47ac1518f0 0x7f47ac149bd0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f47a000e980 tx=0x7f47a0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:36.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:36.774+0000 7f479a7fc700 1 -- 172.21.15.45:0/2483775149 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a000c850 con 0x7f47ac1518f0 2023-12-22T10:00:36.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:36.774+0000 7f479a7fc700 1 -- 172.21.15.45:0/2483775149 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47a000c9b0 con 0x7f47ac1518f0 2023-12-22T10:00:36.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:36.774+0000 7f47b081b700 1 -- 172.21.15.45:0/2483775149 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f479c0092a0 con 0x7f47ac1518f0 2023-12-22T10:00:36.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:36.774+0000 7f479a7fc700 1 -- 172.21.15.45:0/2483775149 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a000cd30 con 0x7f47ac1518f0 2023-12-22T10:00:36.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:36.778+0000 7f47b081b700 1 -- 172.21.15.45:0/2483775149 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47ac0aa2b0 con 0x7f47ac1518f0 2023-12-22T10:00:36.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:36.778+0000 7f47b081b700 1 -- 172.21.15.45:0/2483775149 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47ac06c070 con 0x7f47ac1518f0 2023-12-22T10:00:36.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:36.778+0000 7f479a7fc700 1 -- 172.21.15.45:0/2483775149 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f47a0012600 con 0x7f47ac1518f0 2023-12-22T10:00:36.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:36.782+0000 7f479a7fc700 1 --2- 172.21.15.45:0/2483775149 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f478c05a4e0 0x7f478c05c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:36.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:36.782+0000 7f479a7fc700 1 -- 172.21.15.45:0/2483775149 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f47a0074e70 con 0x7f47ac1518f0 2023-12-22T10:00:36.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:36.782+0000 7f47aa59c700 1 --2- 172.21.15.45:0/2483775149 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f478c05a4e0 0x7f478c05c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:36.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:36.782+0000 7f47aa59c700 1 --2- 172.21.15.45:0/2483775149 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f478c05a4e0 0x7f478c05c9a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f479c00d260 tx=0x7f479c016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:36.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:36.786+0000 7f479a7fc700 1 -- 172.21.15.45:0/2483775149 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f47a0048590 con 0x7f47ac1518f0 2023-12-22T10:00:36.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:36.986+0000 7f47b081b700 1 -- 172.21.15.45:0/2483775149 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f47ac14dc00 con 0x7f47ac1518f0 2023-12-22T10:00:36.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:36.986+0000 7f479a7fc700 1 -- 172.21.15.45:0/2483775149 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4489 (secure 0 0 0) 0x7f47a004bbb0 con 0x7f47ac1518f0 2023-12-22T10:00:36.983 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:00:36.983 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6833/3021221178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6832","nonce":3021221178},{"type":"v1","addr":"172.21.15.113:6833","nonce":3021221178}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6835/1307046651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":1307046651},{"type":"v1","addr":"172.21.15.113:6835","nonce":1307046651}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/3043486757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":3043486757},{"type":"v1","addr":"172.21.15.45:6835","nonce":3043486757}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T10:00:33.522493+0000","modified":"2023-12-22T10:00:36.550815+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6837/1007404834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":1007404834},{"type":"v1","addr":"172.21.15.45:6837","nonce":1007404834}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-12-22T10:00:36.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:36.990+0000 7f47b081b700 1 -- 172.21.15.45:0/2483775149 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f478c05a4e0 msgr2=0x7f478c05c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:36.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:36.990+0000 7f47b081b700 1 --2- 172.21.15.45:0/2483775149 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f478c05a4e0 0x7f478c05c9a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f479c00d260 tx=0x7f479c016000).stop 2023-12-22T10:00:36.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:36.990+0000 7f47b081b700 1 -- 172.21.15.45:0/2483775149 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47ac1518f0 msgr2=0x7f47ac149bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:36.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:36.990+0000 7f47b081b700 1 --2- 172.21.15.45:0/2483775149 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47ac1518f0 0x7f47ac149bd0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f47a000e980 tx=0x7f47a0009060).stop 2023-12-22T10:00:36.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:36.990+0000 7f47b081b700 1 -- 172.21.15.45:0/2483775149 shutdown_connections 2023-12-22T10:00:36.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:36.990+0000 7f47b081b700 1 --2- 172.21.15.45:0/2483775149 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f478c05a4e0 0x7f478c05c9a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:36.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:36.990+0000 7f47b081b700 1 --2- 172.21.15.45:0/2483775149 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f47ac151cd0 0x7f47ac0abbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:36.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:36.990+0000 7f47b081b700 1 --2- 172.21.15.45:0/2483775149 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47ac1518f0 0x7f47ac149bd0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:36.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:36.990+0000 7f47b081b700 1 --2- 172.21.15.45:0/2483775149 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f47ac064d80 0x7f47ac1520b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:36.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:36.990+0000 7f47b081b700 1 -- 172.21.15.45:0/2483775149 >> 172.21.15.45:0/2483775149 conn(0x7f47ac066a70 msgr2=0x7f47ac14bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:36.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:36.990+0000 7f47b081b700 1 -- 172.21.15.45:0/2483775149 shutdown_connections 2023-12-22T10:00:36.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:36.990+0000 7f47b081b700 1 -- 172.21.15.45:0/2483775149 wait complete. 2023-12-22T10:00:36.989 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 8 2023-12-22T10:00:37.007 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T10:00:37.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.178+0000 7f5eabfff700 1 Processor -- start 2023-12-22T10:00:37.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.178+0000 7f5eabfff700 1 -- start start 2023-12-22T10:00:37.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.182+0000 7f5eabfff700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f5eac0a9ed0 0x7f5eac0c1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:37.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.182+0000 7f5eabfff700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f5eac0bf910 0x7f5eac0bfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:37.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.182+0000 7f5eabfff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5eac0c5960 0x7f5eac0c5e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:37.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.182+0000 7f5eabfff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5eac0c0f70 con 0x7f5eac0c5960 2023-12-22T10:00:37.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.182+0000 7f5eabfff700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5eac0aa2b0 con 0x7f5eac0bf910 2023-12-22T10:00:37.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.182+0000 7f5eabfff700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5eac0c0360 con 0x7f5eac0a9ed0 2023-12-22T10:00:37.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.182+0000 7f5eab7fe700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5eac0c5960 0x7f5eac0c5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:37.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.182+0000 7f5eaa7fc700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f5eac0bf910 0x7f5eac0bfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:37.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.182+0000 7f5eaaffd700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f5eac0a9ed0 0x7f5eac0c1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:37.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.182+0000 7f5eab7fe700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5eac0c5960 0x7f5eac0c5e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42402/0 (socket says 172.21.15.45:42402) 2023-12-22T10:00:37.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.182+0000 7f5eab7fe700 1 -- 172.21.15.45:0/3840702583 learned_addr learned my addr 172.21.15.45:0/3840702583 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:37.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.182+0000 7f5eaa7fc700 1 -- 172.21.15.45:0/3840702583 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f5eac0a9ed0 msgr2=0x7f5eac0c1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:00:37.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.182+0000 7f5eaa7fc700 1 --2- 172.21.15.45:0/3840702583 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f5eac0a9ed0 0x7f5eac0c1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:37.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.182+0000 7f5eaa7fc700 1 -- 172.21.15.45:0/3840702583 >> v2:172.21.15.45:3300/0 conn(0x7f5eac0c5960 msgr2=0x7f5eac0c5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:00:37.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.182+0000 7f5eaa7fc700 1 --2- 172.21.15.45:0/3840702583 >> v2:172.21.15.45:3300/0 conn(0x7f5eac0c5960 0x7f5eac0c5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:37.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.182+0000 7f5eaa7fc700 1 -- 172.21.15.45:0/3840702583 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eac0c0640 con 0x7f5eac0bf910 2023-12-22T10:00:37.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.186+0000 7f5eaa7fc700 1 --2- 172.21.15.45:0/3840702583 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5eac0bf910 0x7f5eac0bfd70 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f5eac060540 tx=0x7f5ea0009060).ready entity=mon.1 client_cookie=484bad099f6d3200 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:37.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.186+0000 7f5ea9ffb700 1 -- 172.21.15.45:0/3840702583 <== mon.1 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea000d4a0 con 0x7f5eac0bf910 2023-12-22T10:00:37.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.186+0000 7f5ea9ffb700 1 -- 172.21.15.45:0/3840702583 <== mon.1 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ea000d600 con 0x7f5eac0bf910 2023-12-22T10:00:37.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.186+0000 7f5ea9ffb700 1 -- 172.21.15.45:0/3840702583 <== mon.1 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea000d980 con 0x7f5eac0bf910 2023-12-22T10:00:37.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.186+0000 7f5eabfff700 1 -- 172.21.15.45:0/3840702583 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5eac0bf910 msgr2=0x7f5eac0bfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:37.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.186+0000 7f5eabfff700 1 --2- 172.21.15.45:0/3840702583 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5eac0bf910 0x7f5eac0bfd70 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f5eac060540 tx=0x7f5ea0009060).stop 2023-12-22T10:00:37.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.186+0000 7f5eabfff700 1 -- 172.21.15.45:0/3840702583 shutdown_connections 2023-12-22T10:00:37.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.186+0000 7f5eabfff700 1 --2- 172.21.15.45:0/3840702583 >> v2:172.21.15.45:3300/0 conn(0x7f5eac0c5960 0x7f5eac0c5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:37.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.186+0000 7f5eabfff700 1 --2- 172.21.15.45:0/3840702583 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5eac0bf910 0x7f5eac0bfd70 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:37.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.186+0000 7f5eabfff700 1 --2- 172.21.15.45:0/3840702583 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f5eac0a9ed0 0x7f5eac0c1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:37.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.186+0000 7f5eabfff700 1 -- 172.21.15.45:0/3840702583 >> 172.21.15.45:0/3840702583 conn(0x7f5eac067500 msgr2=0x7f5eac0ca9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:37.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.186+0000 7f5eabfff700 1 -- 172.21.15.45:0/3840702583 shutdown_connections 2023-12-22T10:00:37.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.186+0000 7f5eabfff700 1 -- 172.21.15.45:0/3840702583 wait complete. 2023-12-22T10:00:37.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.190+0000 7f5eabfff700 1 Processor -- start 2023-12-22T10:00:37.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.190+0000 7f5eabfff700 1 -- start start 2023-12-22T10:00:37.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.190+0000 7f5eabfff700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5eac0a9ed0 0x7f5eac14ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:37.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.190+0000 7f5eabfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5eac0bf910 0x7f5eac0af300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:37.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.190+0000 7f5eabfff700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f5eac0c5960 0x7f5eac0af7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:37.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.190+0000 7f5eabfff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eac0a6e50 con 0x7f5eac0bf910 2023-12-22T10:00:37.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.190+0000 7f5eabfff700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eac0a6840 con 0x7f5eac0a9ed0 2023-12-22T10:00:37.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.190+0000 7f5eabfff700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5eac0afd90 con 0x7f5eac0c5960 2023-12-22T10:00:37.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.194+0000 7f5eaa7fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5eac0bf910 0x7f5eac0af300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:37.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.194+0000 7f5eaa7fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5eac0bf910 0x7f5eac0af300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42416/0 (socket says 172.21.15.45:42416) 2023-12-22T10:00:37.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.194+0000 7f5eaa7fc700 1 -- 172.21.15.45:0/893772775 learned_addr learned my addr 172.21.15.45:0/893772775 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:37.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.194+0000 7f5eab7fe700 1 --2- 172.21.15.45:0/893772775 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f5eac0c5960 0x7f5eac0af7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:37.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.194+0000 7f5eaaffd700 1 --2- 172.21.15.45:0/893772775 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5eac0a9ed0 0x7f5eac14ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:37.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.194+0000 7f5eaa7fc700 1 -- 172.21.15.45:0/893772775 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f5eac0c5960 msgr2=0x7f5eac0af7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:37.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.194+0000 7f5eaa7fc700 1 --2- 172.21.15.45:0/893772775 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f5eac0c5960 0x7f5eac0af7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:37.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.194+0000 7f5eaa7fc700 1 -- 172.21.15.45:0/893772775 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5eac0a9ed0 msgr2=0x7f5eac14ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:37.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.194+0000 7f5eaa7fc700 1 --2- 172.21.15.45:0/893772775 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5eac0a9ed0 0x7f5eac14ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:37.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.194+0000 7f5eaa7fc700 1 -- 172.21.15.45:0/893772775 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ea00092a0 con 0x7f5eac0bf910 2023-12-22T10:00:37.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.194+0000 7f5eaa7fc700 1 --2- 172.21.15.45:0/893772775 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5eac0bf910 0x7f5eac0af300 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f5eac0c1980 tx=0x7f5ea0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:37.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.194+0000 7f5e92ffd700 1 -- 172.21.15.45:0/893772775 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea000dd30 con 0x7f5eac0bf910 2023-12-22T10:00:37.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.194+0000 7f5e92ffd700 1 -- 172.21.15.45:0/893772775 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ea000de90 con 0x7f5eac0bf910 2023-12-22T10:00:37.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.194+0000 7f5e92ffd700 1 -- 172.21.15.45:0/893772775 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea000d9c0 con 0x7f5eac0bf910 2023-12-22T10:00:37.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.194+0000 7f5eabfff700 1 -- 172.21.15.45:0/893772775 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5eac0b0070 con 0x7f5eac0bf910 2023-12-22T10:00:37.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.194+0000 7f5eabfff700 1 -- 172.21.15.45:0/893772775 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5eac14bf30 con 0x7f5eac0bf910 2023-12-22T10:00:37.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.198+0000 7f5eabfff700 1 -- 172.21.15.45:0/893772775 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5eac0a6fc0 con 0x7f5eac0bf910 2023-12-22T10:00:37.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.198+0000 7f5e92ffd700 1 -- 172.21.15.45:0/893772775 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f5ea001d640 con 0x7f5eac0bf910 2023-12-22T10:00:37.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.198+0000 7f5e92ffd700 1 --2- 172.21.15.45:0/893772775 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f5e9805a510 0x7f5e9805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:37.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.198+0000 7f5e92ffd700 1 -- 172.21.15.45:0/893772775 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f5ea0075e40 con 0x7f5eac0bf910 2023-12-22T10:00:37.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.198+0000 7f5eaaffd700 1 --2- 172.21.15.45:0/893772775 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f5e9805a510 0x7f5e9805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:37.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.202+0000 7f5eaaffd700 1 --2- 172.21.15.45:0/893772775 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f5e9805a510 0x7f5e9805c9d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f5e9c009c30 tx=0x7f5e9c009060).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:37.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.206+0000 7f5e92ffd700 1 -- 172.21.15.45:0/893772775 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f5ea0049560 con 0x7f5eac0bf910 2023-12-22T10:00:37.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.366+0000 7f5eabfff700 1 -- 172.21.15.45:0/893772775 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5eac0c0920 con 0x7f5eac0bf910 2023-12-22T10:00:37.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.366+0000 7f5e92ffd700 1 -- 172.21.15.45:0/893772775 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16928 (secure 0 0 0) 0x7f5ea004cb80 con 0x7f5eac0bf910 2023-12-22T10:00:37.363 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:00:37.363 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":21,"fsid":"98b0837e-5e68-4c8f-a1a0-e9424baaad8f","created":"2023-12-22T10:00:15.010174+0000","modified":"2023-12-22T10:00:34.529651+0000","last_up_change":"2023-12-22T10:00:24.980513+0000","last_in_change":"2023-12-22T10:00:17.887172+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-12-22T10:00:25.069641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-12-22T10:00:26.906399+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-12-22T10:00:31.621311+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-12-22T10:00:32.538053+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e19943a0-1c6b-47df-b6bb-383472077890","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":33777},{"type":"v1","addr":"172.21.15.45:6819","nonce":33777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":33777},{"type":"v1","addr":"172.21.15.45:6822","nonce":33777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":33777},{"type":"v1","addr":"172.21.15.45:6830","nonce":33777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":33777},{"type":"v1","addr":"172.21.15.45:6826","nonce":33777}]},"public_addr":"172.21.15.45:6819/33777","cluster_addr":"172.21.15.45:6822/33777","heartbeat_back_addr":"172.21.15.45:6830/33777","heartbeat_front_addr":"172.21.15.45:6826/33777","state":["exists","up"]},{"osd":1,"uuid":"69670f34-f082-45a7-8f67-e962acc136e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":33775},{"type":"v1","addr":"172.21.15.45:6809","nonce":33775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":33775},{"type":"v1","addr":"172.21.15.45:6811","nonce":33775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":33775},{"type":"v1","addr":"172.21.15.45:6815","nonce":33775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":33775},{"type":"v1","addr":"172.21.15.45:6813","nonce":33775}]},"public_addr":"172.21.15.45:6809/33775","cluster_addr":"172.21.15.45:6811/33775","heartbeat_back_addr":"172.21.15.45:6815/33775","heartbeat_front_addr":"172.21.15.45:6813/33775","state":["exists","up"]},{"osd":2,"uuid":"d909d49b-82b8-401b-9947-e49dd167bb95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":33776},{"type":"v1","addr":"172.21.15.45:6801","nonce":33776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":33776},{"type":"v1","addr":"172.21.15.45:6803","nonce":33776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":33776},{"type":"v1","addr":"172.21.15.45:6807","nonce":33776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":33776},{"type":"v1","addr":"172.21.15.45:6805","nonce":33776}]},"public_addr":"172.21.15.45:6801/33776","cluster_addr":"172.21.15.45:6803/33776","heartbeat_back_addr":"172.21.15.45:6807/33776","heartbeat_front_addr":"172.21.15.45:6805/33776","state":["exists","up"]},{"osd":3,"uuid":"db104ca9-3a94-4d39-a2be-bd06db888095","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":33782},{"type":"v1","addr":"172.21.15.45:6817","nonce":33782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":33782},{"type":"v1","addr":"172.21.15.45:6823","nonce":33782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":33782},{"type":"v1","addr":"172.21.15.45:6831","nonce":33782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":33782},{"type":"v1","addr":"172.21.15.45:6827","nonce":33782}]},"public_addr":"172.21.15.45:6817/33782","cluster_addr":"172.21.15.45:6823/33782","heartbeat_back_addr":"172.21.15.45:6831/33782","heartbeat_front_addr":"172.21.15.45:6827/33782","state":["exists","up"]},{"osd":4,"uuid":"9f4eaff4-e433-4479-a0d1-ee7a33375ca6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":34099},{"type":"v1","addr":"172.21.15.113:6811","nonce":34099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":34099},{"type":"v1","addr":"172.21.15.113:6815","nonce":34099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":34099},{"type":"v1","addr":"172.21.15.113:6823","nonce":34099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6816","nonce":34099},{"type":"v1","addr":"172.21.15.113:6818","nonce":34099}]},"public_addr":"172.21.15.113:6811/34099","cluster_addr":"172.21.15.113:6815/34099","heartbeat_back_addr":"172.21.15.113:6823/34099","heartbeat_front_addr":"172.21.15.113:6818/34099","state":["exists","up"]},{"osd":5,"uuid":"1efc5591-180b-43af-8611-0068aadc5aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":34100},{"type":"v1","addr":"172.21.15.113:6801","nonce":34100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":34100},{"type":"v1","addr":"172.21.15.113:6803","nonce":34100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":34100},{"type":"v1","addr":"172.21.15.113:6807","nonce":34100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":34100},{"type":"v1","addr":"172.21.15.113:6805","nonce":34100}]},"public_addr":"172.21.15.113:6801/34100","cluster_addr":"172.21.15.113:6803/34100","heartbeat_back_addr":"172.21.15.113:6807/34100","heartbeat_front_addr":"172.21.15.113:6805/34100","state":["exists","up"]},{"osd":6,"uuid":"6c89d9d8-c153-4a48-afa9-97e4c403f1ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":34101},{"type":"v1","addr":"172.21.15.113:6810","nonce":34101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6812","nonce":34101},{"type":"v1","addr":"172.21.15.113:6814","nonce":34101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6822","nonce":34101},{"type":"v1","addr":"172.21.15.113:6824","nonce":34101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":34101},{"type":"v1","addr":"172.21.15.113:6819","nonce":34101}]},"public_addr":"172.21.15.113:6810/34101","cluster_addr":"172.21.15.113:6814/34101","heartbeat_back_addr":"172.21.15.113:6824/34101","heartbeat_front_addr":"172.21.15.113:6819/34101","state":["exists","up"]},{"osd":7,"uuid":"1855e70c-23f6-4c08-ad7f-774c2148235b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6821","nonce":34102},{"type":"v1","addr":"172.21.15.113:6825","nonce":34102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":34102},{"type":"v1","addr":"172.21.15.113:6827","nonce":34102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":34102},{"type":"v1","addr":"172.21.15.113:6831","nonce":34102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6828","nonce":34102},{"type":"v1","addr":"172.21.15.113:6829","nonce":34102}]},"public_addr":"172.21.15.113:6825/34102","cluster_addr":"172.21.15.113:6827/34102","heartbeat_back_addr":"172.21.15.113:6831/34102","heartbeat_front_addr":"172.21.15.113:6829/34102","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.812672+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.825045+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.700105+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.856563+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.954683+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.883234+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.883994+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.821686+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T10:00:37.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.370+0000 7f5eabfff700 1 -- 172.21.15.45:0/893772775 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f5e9805a510 msgr2=0x7f5e9805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:37.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.370+0000 7f5eabfff700 1 --2- 172.21.15.45:0/893772775 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f5e9805a510 0x7f5e9805c9d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f5e9c009c30 tx=0x7f5e9c009060).stop 2023-12-22T10:00:37.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.370+0000 7f5eabfff700 1 -- 172.21.15.45:0/893772775 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5eac0bf910 msgr2=0x7f5eac0af300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:37.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.370+0000 7f5eabfff700 1 --2- 172.21.15.45:0/893772775 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5eac0bf910 0x7f5eac0af300 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f5eac0c1980 tx=0x7f5ea0016000).stop 2023-12-22T10:00:37.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.370+0000 7f5eabfff700 1 -- 172.21.15.45:0/893772775 shutdown_connections 2023-12-22T10:00:37.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.370+0000 7f5eabfff700 1 --2- 172.21.15.45:0/893772775 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f5e9805a510 0x7f5e9805c9d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:37.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.370+0000 7f5eabfff700 1 --2- 172.21.15.45:0/893772775 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f5eac0c5960 0x7f5eac0af7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:37.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.370+0000 7f5eabfff700 1 --2- 172.21.15.45:0/893772775 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5eac0bf910 0x7f5eac0af300 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:37.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.370+0000 7f5eabfff700 1 --2- 172.21.15.45:0/893772775 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5eac0a9ed0 0x7f5eac14ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:37.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.370+0000 7f5eabfff700 1 -- 172.21.15.45:0/893772775 >> 172.21.15.45:0/893772775 conn(0x7f5eac067500 msgr2=0x7f5eac0ac4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:37.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.370+0000 7f5eabfff700 1 -- 172.21.15.45:0/893772775 shutdown_connections 2023-12-22T10:00:37.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.370+0000 7f5eabfff700 1 -- 172.21.15.45:0/893772775 wait complete. 2023-12-22T10:00:37.391 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-22T10:00:37.391 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-22T10:00:37.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.558+0000 7fc631d69700 1 Processor -- start 2023-12-22T10:00:37.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.558+0000 7fc631d69700 1 -- start start 2023-12-22T10:00:37.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.558+0000 7fc631d69700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc62c0a56f0 0x7fc62c0a79a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:37.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.558+0000 7fc631d69700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc62c0a7e90 0x7fc62c15a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:37.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.558+0000 7fc631d69700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc62c150df0 con 0x7fc62c0a8da0 2023-12-22T10:00:37.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.558+0000 7fc631d69700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc62c151ed0 con 0x7fc62c0a7e90 2023-12-22T10:00:37.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.558+0000 7fc631d69700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc62c0c1d70 con 0x7fc62c0a56f0 2023-12-22T10:00:37.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.562+0000 7fc62b7fe700 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fc62c0a8da0 0x7fc62c0c1660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.45:42838/0 (socket says 172.21.15.45:42838) 2023-12-22T10:00:37.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.562+0000 7fc62b7fe700 1 -- 172.21.15.45:0/1898288450 learned_addr learned my addr 172.21.15.45:0/1898288450 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:00:37.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.562+0000 7fc62bfff700 1 --2- 172.21.15.45:0/1898288450 >> v2:172.21.15.45:3300/0 conn(0x7fc62c0a7e90 0x7fc62c15a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:37.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.562+0000 7fc62affd700 1 --2- 172.21.15.45:0/1898288450 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc62c0a56f0 0x7fc62c0a79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:37.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.562+0000 7fc62bfff700 1 -- 172.21.15.45:0/1898288450 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc62c0a56f0 msgr2=0x7fc62c0a79a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:00:37.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.562+0000 7fc62bfff700 1 --2- 172.21.15.45:0/1898288450 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc62c0a56f0 0x7fc62c0a79a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:37.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.562+0000 7fc62bfff700 1 -- 172.21.15.45:0/1898288450 >> v1:172.21.15.113:6789/0 conn(0x7fc62c0a8da0 legacy=0x7fc62c0c1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:37.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.562+0000 7fc62bfff700 1 -- 172.21.15.45:0/1898288450 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc62c151960 con 0x7fc62c0a7e90 2023-12-22T10:00:37.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.562+0000 7fc62bfff700 1 --2- 172.21.15.45:0/1898288450 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc62c0a7e90 0x7fc62c15a520 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7fc624009e60 tx=0x7fc624009780).ready entity=mon.0 client_cookie=766cfbaa804ac081 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:37.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.566+0000 7fc62a7fc700 1 -- 172.21.15.45:0/1898288450 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc62400e070 con 0x7fc62c0a7e90 2023-12-22T10:00:37.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.566+0000 7fc62a7fc700 1 -- 172.21.15.45:0/1898288450 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc62400bb60 con 0x7fc62c0a7e90 2023-12-22T10:00:37.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.566+0000 7fc62a7fc700 1 -- 172.21.15.45:0/1898288450 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc624012410 con 0x7fc62c0a7e90 2023-12-22T10:00:37.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.566+0000 7fc631d69700 1 -- 172.21.15.45:0/1898288450 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc62c0a7e90 msgr2=0x7fc62c15a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:37.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.566+0000 7fc631d69700 1 --2- 172.21.15.45:0/1898288450 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc62c0a7e90 0x7fc62c15a520 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7fc624009e60 tx=0x7fc624009780).stop 2023-12-22T10:00:37.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.566+0000 7fc631d69700 1 -- 172.21.15.45:0/1898288450 shutdown_connections 2023-12-22T10:00:37.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.566+0000 7fc631d69700 1 --2- 172.21.15.45:0/1898288450 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc62c0a7e90 0x7fc62c15a520 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:37.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.566+0000 7fc631d69700 1 --2- 172.21.15.45:0/1898288450 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc62c0a56f0 0x7fc62c0a79a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:37.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.566+0000 7fc631d69700 1 -- 172.21.15.45:0/1898288450 >> 172.21.15.45:0/1898288450 conn(0x7fc62c066a70 msgr2=0x7fc62c066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:37.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.566+0000 7fc631d69700 1 -- 172.21.15.45:0/1898288450 shutdown_connections 2023-12-22T10:00:37.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.566+0000 7fc631d69700 1 -- 172.21.15.45:0/1898288450 wait complete. 2023-12-22T10:00:37.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.570+0000 7fc631d69700 1 Processor -- start 2023-12-22T10:00:37.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.570+0000 7fc631d69700 1 -- start start 2023-12-22T10:00:37.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.570+0000 7fc631d69700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc62c0a56f0 0x7fc62c14e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:37.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.570+0000 7fc631d69700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc62c0a7e90 0x7fc62c1422d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:37.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.570+0000 7fc631d69700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc62c0a8da0 0x7fc62c165a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:37.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.570+0000 7fc631d69700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc62c1427c0 con 0x7fc62c0a8da0 2023-12-22T10:00:37.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.570+0000 7fc631d69700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc62c1655b0 con 0x7fc62c0a56f0 2023-12-22T10:00:37.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.570+0000 7fc631d69700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc62c162490 con 0x7fc62c0a7e90 2023-12-22T10:00:37.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.570+0000 7fc62affd700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc62c0a7e90 0x7fc62c1422d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:37.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.570+0000 7fc62bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc62c0a8da0 0x7fc62c165a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:37.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.570+0000 7fc62affd700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc62c0a7e90 0x7fc62c1422d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.113:3301/0 says I am v2:172.21.15.45:38996/0 (socket says 172.21.15.45:38996) 2023-12-22T10:00:37.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.570+0000 7fc62affd700 1 -- 172.21.15.45:0/698591469 learned_addr learned my addr 172.21.15.45:0/698591469 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:37.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.570+0000 7fc62b7fe700 1 --2- 172.21.15.45:0/698591469 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc62c0a56f0 0x7fc62c14e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:37.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.574+0000 7fc62affd700 1 -- 172.21.15.45:0/698591469 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc62c0a56f0 msgr2=0x7fc62c14e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:37.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.574+0000 7fc62affd700 1 --2- 172.21.15.45:0/698591469 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc62c0a56f0 0x7fc62c14e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:37.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.574+0000 7fc62affd700 1 -- 172.21.15.45:0/698591469 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc62c0a8da0 msgr2=0x7fc62c165a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:37.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.574+0000 7fc62affd700 1 --2- 172.21.15.45:0/698591469 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc62c0a8da0 0x7fc62c165a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:37.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.574+0000 7fc62affd700 1 -- 172.21.15.45:0/698591469 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc624009a20 con 0x7fc62c0a7e90 2023-12-22T10:00:37.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.574+0000 7fc62bfff700 1 --2- 172.21.15.45:0/698591469 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc62c0a8da0 0x7fc62c165a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-12-22T10:00:37.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.574+0000 7fc62affd700 1 --2- 172.21.15.45:0/698591469 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc62c0a7e90 0x7fc62c1422d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fc62000e960 tx=0x7fc620009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:37.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.574+0000 7fc6137fe700 1 -- 172.21.15.45:0/698591469 <== mon.2 v2:172.21.15.113:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc620012600 con 0x7fc62c0a7e90 2023-12-22T10:00:37.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.574+0000 7fc6137fe700 1 -- 172.21.15.45:0/698591469 <== mon.2 v2:172.21.15.113:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc620012760 con 0x7fc62c0a7e90 2023-12-22T10:00:37.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.574+0000 7fc6137fe700 1 -- 172.21.15.45:0/698591469 <== mon.2 v2:172.21.15.113:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc620012ae0 con 0x7fc62c0a7e90 2023-12-22T10:00:37.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.574+0000 7fc631d69700 1 -- 172.21.15.45:0/698591469 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc62c162770 con 0x7fc62c0a7e90 2023-12-22T10:00:37.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.574+0000 7fc631d69700 1 -- 172.21.15.45:0/698591469 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc62c165240 con 0x7fc62c0a7e90 2023-12-22T10:00:37.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.574+0000 7fc631d69700 1 -- 172.21.15.45:0/698591469 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc62c165740 con 0x7fc62c0a7e90 2023-12-22T10:00:37.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.578+0000 7fc6137fe700 1 -- 172.21.15.45:0/698591469 <== mon.2 v2:172.21.15.113:3301/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fc62001b400 con 0x7fc62c0a7e90 2023-12-22T10:00:37.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.578+0000 7fc6137fe700 1 --2- 172.21.15.45:0/698591469 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fc61805a540 0x7fc61805ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:37.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.578+0000 7fc6137fe700 1 -- 172.21.15.45:0/698591469 <== mon.2 v2:172.21.15.113:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fc620074c80 con 0x7fc62c0a7e90 2023-12-22T10:00:37.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.578+0000 7fc62b7fe700 1 --2- 172.21.15.45:0/698591469 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fc61805a540 0x7fc61805ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:37.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.578+0000 7fc62b7fe700 1 --2- 172.21.15.45:0/698591469 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fc61805a540 0x7fc61805ca00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fc61c007fd0 tx=0x7fc61c009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:37.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.586+0000 7fc6137fe700 1 -- 172.21.15.45:0/698591469 <== mon.2 v2:172.21.15.113:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc62007b080 con 0x7fc62c0a7e90 2023-12-22T10:00:37.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.750+0000 7fc631d69700 1 -- 172.21.15.45:0/698591469 --> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc62c151bf0 con 0x7fc61805a540 2023-12-22T10:00:37.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.770+0000 7fc6137fe700 1 -- 172.21.15.45:0/698591469 <== mgr.4104 v2:172.21.15.45:6832/33679 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+325090 (secure 0 0 0) 0x7fc62c151bf0 con 0x7fc61805a540 2023-12-22T10:00:37.778 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:00:37.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.778+0000 7fc631d69700 1 -- 172.21.15.45:0/698591469 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fc61805a540 msgr2=0x7fc61805ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:37.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.778+0000 7fc631d69700 1 --2- 172.21.15.45:0/698591469 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fc61805a540 0x7fc61805ca00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fc61c007fd0 tx=0x7fc61c009040).stop 2023-12-22T10:00:37.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.778+0000 7fc631d69700 1 -- 172.21.15.45:0/698591469 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc62c0a7e90 msgr2=0x7fc62c1422d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:37.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.778+0000 7fc631d69700 1 --2- 172.21.15.45:0/698591469 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc62c0a7e90 0x7fc62c1422d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fc62000e960 tx=0x7fc620009060).stop 2023-12-22T10:00:37.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.778+0000 7fc631d69700 1 -- 172.21.15.45:0/698591469 shutdown_connections 2023-12-22T10:00:37.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.778+0000 7fc631d69700 1 --2- 172.21.15.45:0/698591469 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc62c0a8da0 0x7fc62c165a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:37.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.778+0000 7fc631d69700 1 --2- 172.21.15.45:0/698591469 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fc61805a540 0x7fc61805ca00 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:37.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.778+0000 7fc631d69700 1 --2- 172.21.15.45:0/698591469 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc62c0a7e90 0x7fc62c1422d0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:37.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.778+0000 7fc631d69700 1 --2- 172.21.15.45:0/698591469 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc62c0a56f0 0x7fc62c14e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:37.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.778+0000 7fc631d69700 1 -- 172.21.15.45:0/698591469 >> 172.21.15.45:0/698591469 conn(0x7fc62c066a70 msgr2=0x7fc62c0a8270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:37.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.778+0000 7fc631d69700 1 -- 172.21.15.45:0/698591469 shutdown_connections 2023-12-22T10:00:37.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:37.778+0000 7fc631d69700 1 -- 172.21.15.45:0/698591469 wait complete. 2023-12-22T10:00:37.783 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-12-22T10:00:37.801 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2023-12-22T10:00:35.952386+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2378020,"kb_used_data":1252,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752596700,"statfs":{"total":773094113280,"available":770659020800,"internally_reserved":0,"allocated":1282048,"data_stored":398541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:33.066089+0000","last_change":"2023-12-22T10:00:33.066089+0000","last_active":"2023-12-22T10:00:33.066089+0000","last_peered":"2023-12-22T10:00:33.066089+0000","last_clean":"2023-12-22T10:00:33.066089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:33.066089+0000","last_undegraded":"2023-12-22T10:00:33.066089+0000","last_fullsized":"2023-12-22T10:00:33.066089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:32.051784+0000","last_change":"2023-12-22T10:00:32.051784+0000","last_active":"2023-12-22T10:00:32.051784+0000","last_peered":"2023-12-22T10:00:32.051784+0000","last_clean":"2023-12-22T10:00:32.051784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:32.051784+0000","last_undegraded":"2023-12-22T10:00:32.051784+0000","last_fullsized":"2023-12-22T10:00:32.051784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:33.066089+0000","last_change":"2023-12-22T10:00:33.066089+0000","last_active":"2023-12-22T10:00:33.066089+0000","last_peered":"2023-12-22T10:00:33.066089+0000","last_clean":"2023-12-22T10:00:33.066089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:33.066089+0000","last_undegraded":"2023-12-22T10:00:33.066089+0000","last_fullsized":"2023-12-22T10:00:33.066089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:32.051784+0000","last_change":"2023-12-22T10:00:32.051784+0000","last_active":"2023-12-22T10:00:32.051784+0000","last_peered":"2023-12-22T10:00:32.051784+0000","last_clean":"2023-12-22T10:00:32.051784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:32.051784+0000","last_undegraded":"2023-12-22T10:00:32.051784+0000","last_fullsized":"2023-12-22T10:00:32.051784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:32.051784+0000","last_change":"2023-12-22T10:00:32.051784+0000","last_active":"2023-12-22T10:00:32.051784+0000","last_peered":"2023-12-22T10:00:32.051784+0000","last_clean":"2023-12-22T10:00:32.051784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:32.051784+0000","last_undegraded":"2023-12-22T10:00:32.051784+0000","last_fullsized":"2023-12-22T10:00:32.051784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:33.066089+0000","last_change":"2023-12-22T10:00:33.066089+0000","last_active":"2023-12-22T10:00:33.066089+0000","last_peered":"2023-12-22T10:00:33.066089+0000","last_clean":"2023-12-22T10:00:33.066089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:33.066089+0000","last_undegraded":"2023-12-22T10:00:33.066089+0000","last_fullsized":"2023-12-22T10:00:33.066089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:32.051784+0000","last_change":"2023-12-22T10:00:32.051784+0000","last_active":"2023-12-22T10:00:32.051784+0000","last_peered":"2023-12-22T10:00:32.051784+0000","last_clean":"2023-12-22T10:00:32.051784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:32.051784+0000","last_undegraded":"2023-12-22T10:00:32.051784+0000","last_fullsized":"2023-12-22T10:00:32.051784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:33.066089+0000","last_change":"2023-12-22T10:00:33.066089+0000","last_active":"2023-12-22T10:00:33.066089+0000","last_peered":"2023-12-22T10:00:33.066089+0000","last_clean":"2023-12-22T10:00:33.066089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:33.066089+0000","last_undegraded":"2023-12-22T10:00:33.066089+0000","last_fullsized":"2023-12-22T10:00:33.066089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:32.051784+0000","last_change":"2023-12-22T10:00:32.051784+0000","last_active":"2023-12-22T10:00:32.051784+0000","last_peered":"2023-12-22T10:00:32.051784+0000","last_clean":"2023-12-22T10:00:32.051784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:32.051784+0000","last_undegraded":"2023-12-22T10:00:32.051784+0000","last_fullsized":"2023-12-22T10:00:32.051784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:33.066089+0000","last_change":"2023-12-22T10:00:33.066089+0000","last_active":"2023-12-22T10:00:33.066089+0000","last_peered":"2023-12-22T10:00:33.066089+0000","last_clean":"2023-12-22T10:00:33.066089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:33.066089+0000","last_undegraded":"2023-12-22T10:00:33.066089+0000","last_fullsized":"2023-12-22T10:00:33.066089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:32.051784+0000","last_change":"2023-12-22T10:00:32.051784+0000","last_active":"2023-12-22T10:00:32.051784+0000","last_peered":"2023-12-22T10:00:32.051784+0000","last_clean":"2023-12-22T10:00:32.051784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:32.051784+0000","last_undegraded":"2023-12-22T10:00:32.051784+0000","last_fullsized":"2023-12-22T10:00:32.051784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:33.066089+0000","last_change":"2023-12-22T10:00:33.066089+0000","last_active":"2023-12-22T10:00:33.066089+0000","last_peered":"2023-12-22T10:00:33.066089+0000","last_clean":"2023-12-22T10:00:33.066089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:33.066089+0000","last_undegraded":"2023-12-22T10:00:33.066089+0000","last_fullsized":"2023-12-22T10:00:33.066089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:32.051784+0000","last_change":"2023-12-22T10:00:32.051784+0000","last_active":"2023-12-22T10:00:32.051784+0000","last_peered":"2023-12-22T10:00:32.051784+0000","last_clean":"2023-12-22T10:00:32.051784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:32.051784+0000","last_undegraded":"2023-12-22T10:00:32.051784+0000","last_fullsized":"2023-12-22T10:00:32.051784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:33.066089+0000","last_change":"2023-12-22T10:00:33.066089+0000","last_active":"2023-12-22T10:00:33.066089+0000","last_peered":"2023-12-22T10:00:33.066089+0000","last_clean":"2023-12-22T10:00:33.066089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:33.066089+0000","last_undegraded":"2023-12-22T10:00:33.066089+0000","last_fullsized":"2023-12-22T10:00:33.066089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:32.051784+0000","last_change":"2023-12-22T10:00:32.051784+0000","last_active":"2023-12-22T10:00:32.051784+0000","last_peered":"2023-12-22T10:00:32.051784+0000","last_clean":"2023-12-22T10:00:32.051784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:32.051784+0000","last_undegraded":"2023-12-22T10:00:32.051784+0000","last_fullsized":"2023-12-22T10:00:32.051784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:33.066089+0000","last_change":"2023-12-22T10:00:33.066089+0000","last_active":"2023-12-22T10:00:33.066089+0000","last_peered":"2023-12-22T10:00:33.066089+0000","last_clean":"2023-12-22T10:00:33.066089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:33.066089+0000","last_undegraded":"2023-12-22T10:00:33.066089+0000","last_fullsized":"2023-12-22T10:00:33.066089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:32.051784+0000","last_change":"2023-12-22T10:00:32.051784+0000","last_active":"2023-12-22T10:00:32.051784+0000","last_peered":"2023-12-22T10:00:32.051784+0000","last_clean":"2023-12-22T10:00:32.051784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:32.051784+0000","last_undegraded":"2023-12-22T10:00:32.051784+0000","last_fullsized":"2023-12-22T10:00:32.051784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:33.066089+0000","last_change":"2023-12-22T10:00:33.066089+0000","last_active":"2023-12-22T10:00:33.066089+0000","last_peered":"2023-12-22T10:00:33.066089+0000","last_clean":"2023-12-22T10:00:33.066089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:33.066089+0000","last_undegraded":"2023-12-22T10:00:33.066089+0000","last_fullsized":"2023-12-22T10:00:33.066089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:32.051784+0000","last_change":"2023-12-22T10:00:32.051784+0000","last_active":"2023-12-22T10:00:32.051784+0000","last_peered":"2023-12-22T10:00:32.051784+0000","last_clean":"2023-12-22T10:00:32.051784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:32.051784+0000","last_undegraded":"2023-12-22T10:00:32.051784+0000","last_fullsized":"2023-12-22T10:00:32.051784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:33.066089+0000","last_change":"2023-12-22T10:00:33.066089+0000","last_active":"2023-12-22T10:00:33.066089+0000","last_peered":"2023-12-22T10:00:33.066089+0000","last_clean":"2023-12-22T10:00:33.066089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:33.066089+0000","last_undegraded":"2023-12-22T10:00:33.066089+0000","last_fullsized":"2023-12-22T10:00:33.066089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:32.051784+0000","last_change":"2023-12-22T10:00:32.051784+0000","last_active":"2023-12-22T10:00:32.051784+0000","last_peered":"2023-12-22T10:00:32.051784+0000","last_clean":"2023-12-22T10:00:32.051784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:32.051784+0000","last_undegraded":"2023-12-22T10:00:32.051784+0000","last_fullsized":"2023-12-22T10:00:32.051784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:33.066089+0000","last_change":"2023-12-22T10:00:33.066089+0000","last_active":"2023-12-22T10:00:33.066089+0000","last_peered":"2023-12-22T10:00:33.066089+0000","last_clean":"2023-12-22T10:00:33.066089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:33.066089+0000","last_undegraded":"2023-12-22T10:00:33.066089+0000","last_fullsized":"2023-12-22T10:00:33.066089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:32.051784+0000","last_change":"2023-12-22T10:00:32.051784+0000","last_active":"2023-12-22T10:00:32.051784+0000","last_peered":"2023-12-22T10:00:32.051784+0000","last_clean":"2023-12-22T10:00:32.051784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:32.051784+0000","last_undegraded":"2023-12-22T10:00:32.051784+0000","last_fullsized":"2023-12-22T10:00:32.051784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:33.066089+0000","last_change":"2023-12-22T10:00:33.066089+0000","last_active":"2023-12-22T10:00:33.066089+0000","last_peered":"2023-12-22T10:00:33.066089+0000","last_clean":"2023-12-22T10:00:33.066089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:33.066089+0000","last_undegraded":"2023-12-22T10:00:33.066089+0000","last_fullsized":"2023-12-22T10:00:33.066089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:32.051784+0000","last_change":"2023-12-22T10:00:32.051784+0000","last_active":"2023-12-22T10:00:32.051784+0000","last_peered":"2023-12-22T10:00:32.051784+0000","last_clean":"2023-12-22T10:00:32.051784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:32.051784+0000","last_undegraded":"2023-12-22T10:00:32.051784+0000","last_fullsized":"2023-12-22T10:00:32.051784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:33.066089+0000","last_change":"2023-12-22T10:00:33.066089+0000","last_active":"2023-12-22T10:00:33.066089+0000","last_peered":"2023-12-22T10:00:33.066089+0000","last_clean":"2023-12-22T10:00:33.066089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:33.066089+0000","last_undegraded":"2023-12-22T10:00:33.066089+0000","last_fullsized":"2023-12-22T10:00:33.066089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:32.051784+0000","last_change":"2023-12-22T10:00:32.051784+0000","last_active":"2023-12-22T10:00:32.051784+0000","last_peered":"2023-12-22T10:00:32.051784+0000","last_clean":"2023-12-22T10:00:32.051784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:32.051784+0000","last_undegraded":"2023-12-22T10:00:32.051784+0000","last_fullsized":"2023-12-22T10:00:32.051784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:33.066089+0000","last_change":"2023-12-22T10:00:33.066089+0000","last_active":"2023-12-22T10:00:33.066089+0000","last_peered":"2023-12-22T10:00:33.066089+0000","last_clean":"2023-12-22T10:00:33.066089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:33.066089+0000","last_undegraded":"2023-12-22T10:00:33.066089+0000","last_fullsized":"2023-12-22T10:00:33.066089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:32.051784+0000","last_change":"2023-12-22T10:00:32.051784+0000","last_active":"2023-12-22T10:00:32.051784+0000","last_peered":"2023-12-22T10:00:32.051784+0000","last_clean":"2023-12-22T10:00:32.051784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:32.051784+0000","last_undegraded":"2023-12-22T10:00:32.051784+0000","last_fullsized":"2023-12-22T10:00:32.051784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:33.066089+0000","last_change":"2023-12-22T10:00:33.066089+0000","last_active":"2023-12-22T10:00:33.066089+0000","last_peered":"2023-12-22T10:00:33.066089+0000","last_clean":"2023-12-22T10:00:33.066089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:33.066089+0000","last_undegraded":"2023-12-22T10:00:33.066089+0000","last_fullsized":"2023-12-22T10:00:33.066089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:32.051784+0000","last_change":"2023-12-22T10:00:32.051784+0000","last_active":"2023-12-22T10:00:32.051784+0000","last_peered":"2023-12-22T10:00:32.051784+0000","last_clean":"2023-12-22T10:00:32.051784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:32.051784+0000","last_undegraded":"2023-12-22T10:00:32.051784+0000","last_fullsized":"2023-12-22T10:00:32.051784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:33.066089+0000","last_change":"2023-12-22T10:00:33.066089+0000","last_active":"2023-12-22T10:00:33.066089+0000","last_peered":"2023-12-22T10:00:33.066089+0000","last_clean":"2023-12-22T10:00:33.066089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:33.066089+0000","last_undegraded":"2023-12-22T10:00:33.066089+0000","last_fullsized":"2023-12-22T10:00:33.066089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:32.051784+0000","last_change":"2023-12-22T10:00:32.051784+0000","last_active":"2023-12-22T10:00:32.051784+0000","last_peered":"2023-12-22T10:00:32.051784+0000","last_clean":"2023-12-22T10:00:32.051784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:32.051784+0000","last_undegraded":"2023-12-22T10:00:32.051784+0000","last_fullsized":"2023-12-22T10:00:32.051784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:33.066089+0000","last_change":"2023-12-22T10:00:33.066089+0000","last_active":"2023-12-22T10:00:33.066089+0000","last_peered":"2023-12-22T10:00:33.066089+0000","last_clean":"2023-12-22T10:00:33.066089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:33.066089+0000","last_undegraded":"2023-12-22T10:00:33.066089+0000","last_fullsized":"2023-12-22T10:00:33.066089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:32.051784+0000","last_change":"2023-12-22T10:00:32.051784+0000","last_active":"2023-12-22T10:00:32.051784+0000","last_peered":"2023-12-22T10:00:32.051784+0000","last_clean":"2023-12-22T10:00:32.051784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:32.051784+0000","last_undegraded":"2023-12-22T10:00:32.051784+0000","last_fullsized":"2023-12-22T10:00:32.051784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:33.066089+0000","last_change":"2023-12-22T10:00:33.066089+0000","last_active":"2023-12-22T10:00:33.066089+0000","last_peered":"2023-12-22T10:00:33.066089+0000","last_clean":"2023-12-22T10:00:33.066089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:33.066089+0000","last_undegraded":"2023-12-22T10:00:33.066089+0000","last_fullsized":"2023-12-22T10:00:33.066089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:32.051784+0000","last_change":"2023-12-22T10:00:32.051784+0000","last_active":"2023-12-22T10:00:32.051784+0000","last_peered":"2023-12-22T10:00:32.051784+0000","last_clean":"2023-12-22T10:00:32.051784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:32.051784+0000","last_undegraded":"2023-12-22T10:00:32.051784+0000","last_fullsized":"2023-12-22T10:00:32.051784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:33.066089+0000","last_change":"2023-12-22T10:00:33.066089+0000","last_active":"2023-12-22T10:00:33.066089+0000","last_peered":"2023-12-22T10:00:33.066089+0000","last_clean":"2023-12-22T10:00:33.066089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:33.066089+0000","last_undegraded":"2023-12-22T10:00:33.066089+0000","last_fullsized":"2023-12-22T10:00:33.066089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:32.051784+0000","last_change":"2023-12-22T10:00:32.051784+0000","last_active":"2023-12-22T10:00:32.051784+0000","last_peered":"2023-12-22T10:00:32.051784+0000","last_clean":"2023-12-22T10:00:32.051784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:32.051784+0000","last_undegraded":"2023-12-22T10:00:32.051784+0000","last_fullsized":"2023-12-22T10:00:32.051784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:33.066089+0000","last_change":"2023-12-22T10:00:33.066089+0000","last_active":"2023-12-22T10:00:33.066089+0000","last_peered":"2023-12-22T10:00:33.066089+0000","last_clean":"2023-12-22T10:00:33.066089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:33.066089+0000","last_undegraded":"2023-12-22T10:00:33.066089+0000","last_fullsized":"2023-12-22T10:00:33.066089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:32.051784+0000","last_change":"2023-12-22T10:00:32.051784+0000","last_active":"2023-12-22T10:00:32.051784+0000","last_peered":"2023-12-22T10:00:32.051784+0000","last_clean":"2023-12-22T10:00:32.051784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:32.051784+0000","last_undegraded":"2023-12-22T10:00:32.051784+0000","last_fullsized":"2023-12-22T10:00:32.051784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:33.066089+0000","last_change":"2023-12-22T10:00:33.066089+0000","last_active":"2023-12-22T10:00:33.066089+0000","last_peered":"2023-12-22T10:00:33.066089+0000","last_clean":"2023-12-22T10:00:33.066089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:33.066089+0000","last_undegraded":"2023-12-22T10:00:33.066089+0000","last_fullsized":"2023-12-22T10:00:33.066089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:32.051784+0000","last_change":"2023-12-22T10:00:32.051784+0000","last_active":"2023-12-22T10:00:32.051784+0000","last_peered":"2023-12-22T10:00:32.051784+0000","last_clean":"2023-12-22T10:00:32.051784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:32.051784+0000","last_undegraded":"2023-12-22T10:00:32.051784+0000","last_fullsized":"2023-12-22T10:00:32.051784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:33.066089+0000","last_change":"2023-12-22T10:00:33.066089+0000","last_active":"2023-12-22T10:00:33.066089+0000","last_peered":"2023-12-22T10:00:33.066089+0000","last_clean":"2023-12-22T10:00:33.066089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:33.066089+0000","last_undegraded":"2023-12-22T10:00:33.066089+0000","last_fullsized":"2023-12-22T10:00:33.066089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:32.051784+0000","last_change":"2023-12-22T10:00:32.051784+0000","last_active":"2023-12-22T10:00:32.051784+0000","last_peered":"2023-12-22T10:00:32.051784+0000","last_clean":"2023-12-22T10:00:32.051784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:32.051784+0000","last_undegraded":"2023-12-22T10:00:32.051784+0000","last_fullsized":"2023-12-22T10:00:32.051784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:33.066089+0000","last_change":"2023-12-22T10:00:33.066089+0000","last_active":"2023-12-22T10:00:33.066089+0000","last_peered":"2023-12-22T10:00:33.066089+0000","last_clean":"2023-12-22T10:00:33.066089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:33.066089+0000","last_undegraded":"2023-12-22T10:00:33.066089+0000","last_fullsized":"2023-12-22T10:00:33.066089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:32.051784+0000","last_change":"2023-12-22T10:00:32.051784+0000","last_active":"2023-12-22T10:00:32.051784+0000","last_peered":"2023-12-22T10:00:32.051784+0000","last_clean":"2023-12-22T10:00:32.051784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:32.051784+0000","last_undegraded":"2023-12-22T10:00:32.051784+0000","last_fullsized":"2023-12-22T10:00:32.051784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:33.066089+0000","last_change":"2023-12-22T10:00:33.066089+0000","last_active":"2023-12-22T10:00:33.066089+0000","last_peered":"2023-12-22T10:00:33.066089+0000","last_clean":"2023-12-22T10:00:33.066089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:33.066089+0000","last_undegraded":"2023-12-22T10:00:33.066089+0000","last_fullsized":"2023-12-22T10:00:33.066089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:32.051784+0000","last_change":"2023-12-22T10:00:32.051784+0000","last_active":"2023-12-22T10:00:32.051784+0000","last_peered":"2023-12-22T10:00:32.051784+0000","last_clean":"2023-12-22T10:00:32.051784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:32.051784+0000","last_undegraded":"2023-12-22T10:00:32.051784+0000","last_fullsized":"2023-12-22T10:00:32.051784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:33.066089+0000","last_change":"2023-12-22T10:00:33.066089+0000","last_active":"2023-12-22T10:00:33.066089+0000","last_peered":"2023-12-22T10:00:33.066089+0000","last_clean":"2023-12-22T10:00:33.066089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:33.066089+0000","last_undegraded":"2023-12-22T10:00:33.066089+0000","last_fullsized":"2023-12-22T10:00:33.066089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:32.051784+0000","last_change":"2023-12-22T10:00:32.051784+0000","last_active":"2023-12-22T10:00:32.051784+0000","last_peered":"2023-12-22T10:00:32.051784+0000","last_clean":"2023-12-22T10:00:32.051784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:32.051784+0000","last_undegraded":"2023-12-22T10:00:32.051784+0000","last_fullsized":"2023-12-22T10:00:32.051784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:33.066089+0000","last_change":"2023-12-22T10:00:33.066089+0000","last_active":"2023-12-22T10:00:33.066089+0000","last_peered":"2023-12-22T10:00:33.066089+0000","last_clean":"2023-12-22T10:00:33.066089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:33.066089+0000","last_undegraded":"2023-12-22T10:00:33.066089+0000","last_fullsized":"2023-12-22T10:00:33.066089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:32.051784+0000","last_change":"2023-12-22T10:00:32.051784+0000","last_active":"2023-12-22T10:00:32.051784+0000","last_peered":"2023-12-22T10:00:32.051784+0000","last_clean":"2023-12-22T10:00:32.051784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:32.051784+0000","last_undegraded":"2023-12-22T10:00:32.051784+0000","last_fullsized":"2023-12-22T10:00:32.051784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:33.066089+0000","last_change":"2023-12-22T10:00:33.066089+0000","last_active":"2023-12-22T10:00:33.066089+0000","last_peered":"2023-12-22T10:00:33.066089+0000","last_clean":"2023-12-22T10:00:33.066089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:33.066089+0000","last_undegraded":"2023-12-22T10:00:33.066089+0000","last_fullsized":"2023-12-22T10:00:33.066089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:32.051784+0000","last_change":"2023-12-22T10:00:32.051784+0000","last_active":"2023-12-22T10:00:32.051784+0000","last_peered":"2023-12-22T10:00:32.051784+0000","last_clean":"2023-12-22T10:00:32.051784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:32.051784+0000","last_undegraded":"2023-12-22T10:00:32.051784+0000","last_fullsized":"2023-12-22T10:00:32.051784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:33.066089+0000","last_change":"2023-12-22T10:00:33.066089+0000","last_active":"2023-12-22T10:00:33.066089+0000","last_peered":"2023-12-22T10:00:33.066089+0000","last_clean":"2023-12-22T10:00:33.066089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:33.066089+0000","last_undegraded":"2023-12-22T10:00:33.066089+0000","last_fullsized":"2023-12-22T10:00:33.066089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:32.051784+0000","last_change":"2023-12-22T10:00:32.051784+0000","last_active":"2023-12-22T10:00:32.051784+0000","last_peered":"2023-12-22T10:00:32.051784+0000","last_clean":"2023-12-22T10:00:32.051784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:32.051784+0000","last_undegraded":"2023-12-22T10:00:32.051784+0000","last_fullsized":"2023-12-22T10:00:32.051784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:33.066089+0000","last_change":"2023-12-22T10:00:33.066089+0000","last_active":"2023-12-22T10:00:33.066089+0000","last_peered":"2023-12-22T10:00:33.066089+0000","last_clean":"2023-12-22T10:00:33.066089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:33.066089+0000","last_undegraded":"2023-12-22T10:00:33.066089+0000","last_fullsized":"2023-12-22T10:00:33.066089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:32.051784+0000","last_change":"2023-12-22T10:00:32.051784+0000","last_active":"2023-12-22T10:00:32.051784+0000","last_peered":"2023-12-22T10:00:32.051784+0000","last_clean":"2023-12-22T10:00:32.051784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:32.051784+0000","last_undegraded":"2023-12-22T10:00:32.051784+0000","last_fullsized":"2023-12-22T10:00:32.051784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:33.066089+0000","last_change":"2023-12-22T10:00:33.066089+0000","last_active":"2023-12-22T10:00:33.066089+0000","last_peered":"2023-12-22T10:00:33.066089+0000","last_clean":"2023-12-22T10:00:33.066089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:33.066089+0000","last_undegraded":"2023-12-22T10:00:33.066089+0000","last_fullsized":"2023-12-22T10:00:33.066089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-12-22T10:00:28.036372+0000","last_change":"2023-12-22T10:00:28.036372+0000","last_active":"2023-12-22T10:00:28.036372+0000","last_peered":"2023-12-22T10:00:28.036372+0000","last_clean":"2023-12-22T10:00:28.036372+0000","last_became_active":"2023-12-22T10:00:28.035974+0000","last_became_peered":"2023-12-22T10:00:28.035974+0000","last_unstale":"2023-12-22T10:00:28.036372+0000","last_undegraded":"2023-12-22T10:00:28.036372+0000","last_fullsized":"2023-12-22T10:00:28.036372+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_clean_scrub_stamp":"2023-12-22T10:00:27.001906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:32.051784+0000","last_change":"2023-12-22T10:00:32.051784+0000","last_active":"2023-12-22T10:00:32.051784+0000","last_peered":"2023-12-22T10:00:32.051784+0000","last_clean":"2023-12-22T10:00:32.051784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:32.051784+0000","last_undegraded":"2023-12-22T10:00:32.051784+0000","last_fullsized":"2023-12-22T10:00:32.051784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:33.066089+0000","last_change":"2023-12-22T10:00:33.066089+0000","last_active":"2023-12-22T10:00:33.066089+0000","last_peered":"2023-12-22T10:00:33.066089+0000","last_clean":"2023-12-22T10:00:33.066089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:33.066089+0000","last_undegraded":"2023-12-22T10:00:33.066089+0000","last_fullsized":"2023-12-22T10:00:33.066089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-12-22T10:00:28.037750+0000","last_change":"2023-12-22T10:00:28.035308+0000","last_active":"2023-12-22T10:00:28.037750+0000","last_peered":"2023-12-22T10:00:28.037750+0000","last_clean":"2023-12-22T10:00:28.037750+0000","last_became_active":"2023-12-22T10:00:28.035002+0000","last_became_peered":"2023-12-22T10:00:28.035002+0000","last_unstale":"2023-12-22T10:00:28.037750+0000","last_undegraded":"2023-12-22T10:00:28.037750+0000","last_fullsized":"2023-12-22T10:00:28.037750+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_clean_scrub_stamp":"2023-12-22T10:00:27.001906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:32.051784+0000","last_change":"2023-12-22T10:00:32.051784+0000","last_active":"2023-12-22T10:00:32.051784+0000","last_peered":"2023-12-22T10:00:32.051784+0000","last_clean":"2023-12-22T10:00:32.051784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:32.051784+0000","last_undegraded":"2023-12-22T10:00:32.051784+0000","last_fullsized":"2023-12-22T10:00:32.051784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:33.066089+0000","last_change":"2023-12-22T10:00:33.066089+0000","last_active":"2023-12-22T10:00:33.066089+0000","last_peered":"2023-12-22T10:00:33.066089+0000","last_clean":"2023-12-22T10:00:33.066089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:33.066089+0000","last_undegraded":"2023-12-22T10:00:33.066089+0000","last_fullsized":"2023-12-22T10:00:33.066089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-12-22T10:00:28.029892+0000","last_change":"2023-12-22T10:00:28.029892+0000","last_active":"2023-12-22T10:00:28.029892+0000","last_peered":"2023-12-22T10:00:28.029892+0000","last_clean":"2023-12-22T10:00:28.029892+0000","last_became_active":"2023-12-22T10:00:28.029391+0000","last_became_peered":"2023-12-22T10:00:28.029391+0000","last_unstale":"2023-12-22T10:00:28.029892+0000","last_undegraded":"2023-12-22T10:00:28.029892+0000","last_fullsized":"2023-12-22T10:00:28.029892+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_clean_scrub_stamp":"2023-12-22T10:00:27.001906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:32.051784+0000","last_change":"2023-12-22T10:00:32.051784+0000","last_active":"2023-12-22T10:00:32.051784+0000","last_peered":"2023-12-22T10:00:32.051784+0000","last_clean":"2023-12-22T10:00:32.051784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:32.051784+0000","last_undegraded":"2023-12-22T10:00:32.051784+0000","last_fullsized":"2023-12-22T10:00:32.051784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:33.066089+0000","last_change":"2023-12-22T10:00:33.066089+0000","last_active":"2023-12-22T10:00:33.066089+0000","last_peered":"2023-12-22T10:00:33.066089+0000","last_clean":"2023-12-22T10:00:33.066089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:33.066089+0000","last_undegraded":"2023-12-22T10:00:33.066089+0000","last_fullsized":"2023-12-22T10:00:33.066089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-12-22T10:00:28.025395+0000","last_change":"2023-12-22T10:00:28.025395+0000","last_active":"2023-12-22T10:00:28.025395+0000","last_peered":"2023-12-22T10:00:28.025395+0000","last_clean":"2023-12-22T10:00:28.025395+0000","last_became_active":"2023-12-22T10:00:28.024588+0000","last_became_peered":"2023-12-22T10:00:28.024588+0000","last_unstale":"2023-12-22T10:00:28.025395+0000","last_undegraded":"2023-12-22T10:00:28.025395+0000","last_fullsized":"2023-12-22T10:00:28.025395+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_clean_scrub_stamp":"2023-12-22T10:00:27.001906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:32.051784+0000","last_change":"2023-12-22T10:00:32.051784+0000","last_active":"2023-12-22T10:00:32.051784+0000","last_peered":"2023-12-22T10:00:32.051784+0000","last_clean":"2023-12-22T10:00:32.051784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:32.051784+0000","last_undegraded":"2023-12-22T10:00:32.051784+0000","last_fullsized":"2023-12-22T10:00:32.051784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:33.066089+0000","last_change":"2023-12-22T10:00:33.066089+0000","last_active":"2023-12-22T10:00:33.066089+0000","last_peered":"2023-12-22T10:00:33.066089+0000","last_clean":"2023-12-22T10:00:33.066089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:33.066089+0000","last_undegraded":"2023-12-22T10:00:33.066089+0000","last_fullsized":"2023-12-22T10:00:33.066089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:32.051784+0000","last_change":"2023-12-22T10:00:32.051784+0000","last_active":"2023-12-22T10:00:32.051784+0000","last_peered":"2023-12-22T10:00:32.051784+0000","last_clean":"2023-12-22T10:00:32.051784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:32.051784+0000","last_undegraded":"2023-12-22T10:00:32.051784+0000","last_fullsized":"2023-12-22T10:00:32.051784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-12-22T10:00:28.029884+0000","last_change":"2023-12-22T10:00:28.029884+0000","last_active":"2023-12-22T10:00:28.029884+0000","last_peered":"2023-12-22T10:00:28.029884+0000","last_clean":"2023-12-22T10:00:28.029884+0000","last_became_active":"2023-12-22T10:00:28.029422+0000","last_became_peered":"2023-12-22T10:00:28.029422+0000","last_unstale":"2023-12-22T10:00:28.029884+0000","last_undegraded":"2023-12-22T10:00:28.029884+0000","last_fullsized":"2023-12-22T10:00:28.029884+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_clean_scrub_stamp":"2023-12-22T10:00:27.001906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:33.066089+0000","last_change":"2023-12-22T10:00:33.066089+0000","last_active":"2023-12-22T10:00:33.066089+0000","last_peered":"2023-12-22T10:00:33.066089+0000","last_clean":"2023-12-22T10:00:33.066089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:33.066089+0000","last_undegraded":"2023-12-22T10:00:33.066089+0000","last_fullsized":"2023-12-22T10:00:33.066089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:32.051784+0000","last_change":"2023-12-22T10:00:32.051784+0000","last_active":"2023-12-22T10:00:32.051784+0000","last_peered":"2023-12-22T10:00:32.051784+0000","last_clean":"2023-12-22T10:00:32.051784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:32.051784+0000","last_undegraded":"2023-12-22T10:00:32.051784+0000","last_fullsized":"2023-12-22T10:00:32.051784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-12-22T10:00:28.032058+0000","last_change":"2023-12-22T10:00:28.028621+0000","last_active":"2023-12-22T10:00:28.032058+0000","last_peered":"2023-12-22T10:00:28.032058+0000","last_clean":"2023-12-22T10:00:28.032058+0000","last_became_active":"2023-12-22T10:00:28.028159+0000","last_became_peered":"2023-12-22T10:00:28.028159+0000","last_unstale":"2023-12-22T10:00:28.032058+0000","last_undegraded":"2023-12-22T10:00:28.032058+0000","last_fullsized":"2023-12-22T10:00:28.032058+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_clean_scrub_stamp":"2023-12-22T10:00:27.001906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:33.066089+0000","last_change":"2023-12-22T10:00:33.066089+0000","last_active":"2023-12-22T10:00:33.066089+0000","last_peered":"2023-12-22T10:00:33.066089+0000","last_clean":"2023-12-22T10:00:33.066089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:33.066089+0000","last_undegraded":"2023-12-22T10:00:33.066089+0000","last_fullsized":"2023-12-22T10:00:33.066089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:32.051784+0000","last_change":"2023-12-22T10:00:32.051784+0000","last_active":"2023-12-22T10:00:32.051784+0000","last_peered":"2023-12-22T10:00:32.051784+0000","last_clean":"2023-12-22T10:00:32.051784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:32.051784+0000","last_undegraded":"2023-12-22T10:00:32.051784+0000","last_fullsized":"2023-12-22T10:00:32.051784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-12-22T10:00:28.030883+0000","last_change":"2023-12-22T10:00:28.030883+0000","last_active":"2023-12-22T10:00:28.030883+0000","last_peered":"2023-12-22T10:00:28.030883+0000","last_clean":"2023-12-22T10:00:28.030883+0000","last_became_active":"2023-12-22T10:00:28.030284+0000","last_became_peered":"2023-12-22T10:00:28.030284+0000","last_unstale":"2023-12-22T10:00:28.030883+0000","last_undegraded":"2023-12-22T10:00:28.030883+0000","last_fullsized":"2023-12-22T10:00:28.030883+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_clean_scrub_stamp":"2023-12-22T10:00:27.001906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:33.066089+0000","last_change":"2023-12-22T10:00:33.066089+0000","last_active":"2023-12-22T10:00:33.066089+0000","last_peered":"2023-12-22T10:00:33.066089+0000","last_clean":"2023-12-22T10:00:33.066089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:33.066089+0000","last_undegraded":"2023-12-22T10:00:33.066089+0000","last_fullsized":"2023-12-22T10:00:33.066089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:32.051784+0000","last_change":"2023-12-22T10:00:32.051784+0000","last_active":"2023-12-22T10:00:32.051784+0000","last_peered":"2023-12-22T10:00:32.051784+0000","last_clean":"2023-12-22T10:00:32.051784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:32.051784+0000","last_undegraded":"2023-12-22T10:00:32.051784+0000","last_fullsized":"2023-12-22T10:00:32.051784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":8,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-12-22T10:00:28.031790+0000","last_change":"2023-12-22T10:00:28.031790+0000","last_active":"2023-12-22T10:00:28.031790+0000","last_peered":"2023-12-22T10:00:28.031790+0000","last_clean":"2023-12-22T10:00:28.031790+0000","last_became_active":"2023-12-22T10:00:28.031190+0000","last_became_peered":"2023-12-22T10:00:28.031190+0000","last_unstale":"2023-12-22T10:00:28.031790+0000","last_undegraded":"2023-12-22T10:00:28.031790+0000","last_fullsized":"2023-12-22T10:00:28.031790+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_clean_scrub_stamp":"2023-12-22T10:00:27.001906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-12-22T10:00:27.890908+0000","last_change":"2023-12-22T10:00:27.889031+0000","last_active":"2023-12-22T10:00:27.890908+0000","last_peered":"2023-12-22T10:00:27.890908+0000","last_clean":"2023-12-22T10:00:27.890908+0000","last_became_active":"2023-12-22T10:00:27.888164+0000","last_became_peered":"2023-12-22T10:00:27.888164+0000","last_unstale":"2023-12-22T10:00:27.890908+0000","last_undegraded":"2023-12-22T10:00:27.890908+0000","last_fullsized":"2023-12-22T10:00:27.890908+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:25.998963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:25.998963+0000","last_clean_scrub_stamp":"2023-12-22T10:00:25.998963+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:33.066089+0000","last_change":"2023-12-22T10:00:33.066089+0000","last_active":"2023-12-22T10:00:33.066089+0000","last_peered":"2023-12-22T10:00:33.066089+0000","last_clean":"2023-12-22T10:00:33.066089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:33.066089+0000","last_undegraded":"2023-12-22T10:00:33.066089+0000","last_fullsized":"2023-12-22T10:00:33.066089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:32.051784+0000","last_change":"2023-12-22T10:00:32.051784+0000","last_active":"2023-12-22T10:00:32.051784+0000","last_peered":"2023-12-22T10:00:32.051784+0000","last_clean":"2023-12-22T10:00:32.051784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:32.051784+0000","last_undegraded":"2023-12-22T10:00:32.051784+0000","last_fullsized":"2023-12-22T10:00:32.051784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:33.066089+0000","last_change":"2023-12-22T10:00:33.066089+0000","last_active":"2023-12-22T10:00:33.066089+0000","last_peered":"2023-12-22T10:00:33.066089+0000","last_clean":"2023-12-22T10:00:33.066089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:33.066089+0000","last_undegraded":"2023-12-22T10:00:33.066089+0000","last_fullsized":"2023-12-22T10:00:33.066089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:32.051784+0000","last_change":"2023-12-22T10:00:32.051784+0000","last_active":"2023-12-22T10:00:32.051784+0000","last_peered":"2023-12-22T10:00:32.051784+0000","last_clean":"2023-12-22T10:00:32.051784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:32.051784+0000","last_undegraded":"2023-12-22T10:00:32.051784+0000","last_fullsized":"2023-12-22T10:00:32.051784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:33.066089+0000","last_change":"2023-12-22T10:00:33.066089+0000","last_active":"2023-12-22T10:00:33.066089+0000","last_peered":"2023-12-22T10:00:33.066089+0000","last_clean":"2023-12-22T10:00:33.066089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:33.066089+0000","last_undegraded":"2023-12-22T10:00:33.066089+0000","last_fullsized":"2023-12-22T10:00:33.066089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:32.051784+0000","last_change":"2023-12-22T10:00:32.051784+0000","last_active":"2023-12-22T10:00:32.051784+0000","last_peered":"2023-12-22T10:00:32.051784+0000","last_clean":"2023-12-22T10:00:32.051784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:32.051784+0000","last_undegraded":"2023-12-22T10:00:32.051784+0000","last_fullsized":"2023-12-22T10:00:32.051784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:33.066089+0000","last_change":"2023-12-22T10:00:33.066089+0000","last_active":"2023-12-22T10:00:33.066089+0000","last_peered":"2023-12-22T10:00:33.066089+0000","last_clean":"2023-12-22T10:00:33.066089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:33.066089+0000","last_undegraded":"2023-12-22T10:00:33.066089+0000","last_fullsized":"2023-12-22T10:00:33.066089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:32.051784+0000","last_change":"2023-12-22T10:00:32.051784+0000","last_active":"2023-12-22T10:00:32.051784+0000","last_peered":"2023-12-22T10:00:32.051784+0000","last_clean":"2023-12-22T10:00:32.051784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:32.051784+0000","last_undegraded":"2023-12-22T10:00:32.051784+0000","last_fullsized":"2023-12-22T10:00:32.051784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:33.066089+0000","last_change":"2023-12-22T10:00:33.066089+0000","last_active":"2023-12-22T10:00:33.066089+0000","last_peered":"2023-12-22T10:00:33.066089+0000","last_clean":"2023-12-22T10:00:33.066089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:33.066089+0000","last_undegraded":"2023-12-22T10:00:33.066089+0000","last_fullsized":"2023-12-22T10:00:33.066089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:32.051784+0000","last_change":"2023-12-22T10:00:32.051784+0000","last_active":"2023-12-22T10:00:32.051784+0000","last_peered":"2023-12-22T10:00:32.051784+0000","last_clean":"2023-12-22T10:00:32.051784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:32.051784+0000","last_undegraded":"2023-12-22T10:00:32.051784+0000","last_fullsized":"2023-12-22T10:00:32.051784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:33.066089+0000","last_change":"2023-12-22T10:00:33.066089+0000","last_active":"2023-12-22T10:00:33.066089+0000","last_peered":"2023-12-22T10:00:33.066089+0000","last_clean":"2023-12-22T10:00:33.066089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:33.066089+0000","last_undegraded":"2023-12-22T10:00:33.066089+0000","last_fullsized":"2023-12-22T10:00:33.066089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:32.051784+0000","last_change":"2023-12-22T10:00:32.051784+0000","last_active":"2023-12-22T10:00:32.051784+0000","last_peered":"2023-12-22T10:00:32.051784+0000","last_clean":"2023-12-22T10:00:32.051784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:32.051784+0000","last_undegraded":"2023-12-22T10:00:32.051784+0000","last_fullsized":"2023-12-22T10:00:32.051784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:33.066089+0000","last_change":"2023-12-22T10:00:33.066089+0000","last_active":"2023-12-22T10:00:33.066089+0000","last_peered":"2023-12-22T10:00:33.066089+0000","last_clean":"2023-12-22T10:00:33.066089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:33.066089+0000","last_undegraded":"2023-12-22T10:00:33.066089+0000","last_fullsized":"2023-12-22T10:00:33.066089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:32.051784+0000","last_change":"2023-12-22T10:00:32.051784+0000","last_active":"2023-12-22T10:00:32.051784+0000","last_peered":"2023-12-22T10:00:32.051784+0000","last_clean":"2023-12-22T10:00:32.051784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:32.051784+0000","last_undegraded":"2023-12-22T10:00:32.051784+0000","last_fullsized":"2023-12-22T10:00:32.051784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:33.066089+0000","last_change":"2023-12-22T10:00:33.066089+0000","last_active":"2023-12-22T10:00:33.066089+0000","last_peered":"2023-12-22T10:00:33.066089+0000","last_clean":"2023-12-22T10:00:33.066089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:33.066089+0000","last_undegraded":"2023-12-22T10:00:33.066089+0000","last_fullsized":"2023-12-22T10:00:33.066089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:32.051784+0000","last_change":"2023-12-22T10:00:32.051784+0000","last_active":"2023-12-22T10:00:32.051784+0000","last_peered":"2023-12-22T10:00:32.051784+0000","last_clean":"2023-12-22T10:00:32.051784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:32.051784+0000","last_undegraded":"2023-12-22T10:00:32.051784+0000","last_fullsized":"2023-12-22T10:00:32.051784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:33.066089+0000","last_change":"2023-12-22T10:00:33.066089+0000","last_active":"2023-12-22T10:00:33.066089+0000","last_peered":"2023-12-22T10:00:33.066089+0000","last_clean":"2023-12-22T10:00:33.066089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:33.066089+0000","last_undegraded":"2023-12-22T10:00:33.066089+0000","last_fullsized":"2023-12-22T10:00:33.066089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:32.051784+0000","last_change":"2023-12-22T10:00:32.051784+0000","last_active":"2023-12-22T10:00:32.051784+0000","last_peered":"2023-12-22T10:00:32.051784+0000","last_clean":"2023-12-22T10:00:32.051784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:32.051784+0000","last_undegraded":"2023-12-22T10:00:32.051784+0000","last_fullsized":"2023-12-22T10:00:32.051784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:33.066089+0000","last_change":"2023-12-22T10:00:33.066089+0000","last_active":"2023-12-22T10:00:33.066089+0000","last_peered":"2023-12-22T10:00:33.066089+0000","last_clean":"2023-12-22T10:00:33.066089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:33.066089+0000","last_undegraded":"2023-12-22T10:00:33.066089+0000","last_fullsized":"2023-12-22T10:00:33.066089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:32.051784+0000","last_change":"2023-12-22T10:00:32.051784+0000","last_active":"2023-12-22T10:00:32.051784+0000","last_peered":"2023-12-22T10:00:32.051784+0000","last_clean":"2023-12-22T10:00:32.051784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:32.051784+0000","last_undegraded":"2023-12-22T10:00:32.051784+0000","last_fullsized":"2023-12-22T10:00:32.051784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:33.066089+0000","last_change":"2023-12-22T10:00:33.066089+0000","last_active":"2023-12-22T10:00:33.066089+0000","last_peered":"2023-12-22T10:00:33.066089+0000","last_clean":"2023-12-22T10:00:33.066089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:33.066089+0000","last_undegraded":"2023-12-22T10:00:33.066089+0000","last_fullsized":"2023-12-22T10:00:33.066089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:32.051784+0000","last_change":"2023-12-22T10:00:32.051784+0000","last_active":"2023-12-22T10:00:32.051784+0000","last_peered":"2023-12-22T10:00:32.051784+0000","last_clean":"2023-12-22T10:00:32.051784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:32.051784+0000","last_undegraded":"2023-12-22T10:00:32.051784+0000","last_fullsized":"2023-12-22T10:00:32.051784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:33.066089+0000","last_change":"2023-12-22T10:00:33.066089+0000","last_active":"2023-12-22T10:00:33.066089+0000","last_peered":"2023-12-22T10:00:33.066089+0000","last_clean":"2023-12-22T10:00:33.066089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:33.066089+0000","last_undegraded":"2023-12-22T10:00:33.066089+0000","last_fullsized":"2023-12-22T10:00:33.066089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:32.051784+0000","last_change":"2023-12-22T10:00:32.051784+0000","last_active":"2023-12-22T10:00:32.051784+0000","last_peered":"2023-12-22T10:00:32.051784+0000","last_clean":"2023-12-22T10:00:32.051784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:32.051784+0000","last_undegraded":"2023-12-22T10:00:32.051784+0000","last_fullsized":"2023-12-22T10:00:32.051784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:33.066089+0000","last_change":"2023-12-22T10:00:33.066089+0000","last_active":"2023-12-22T10:00:33.066089+0000","last_peered":"2023-12-22T10:00:33.066089+0000","last_clean":"2023-12-22T10:00:33.066089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:33.066089+0000","last_undegraded":"2023-12-22T10:00:33.066089+0000","last_fullsized":"2023-12-22T10:00:33.066089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:32.051784+0000","last_change":"2023-12-22T10:00:32.051784+0000","last_active":"2023-12-22T10:00:32.051784+0000","last_peered":"2023-12-22T10:00:32.051784+0000","last_clean":"2023-12-22T10:00:32.051784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:32.051784+0000","last_undegraded":"2023-12-22T10:00:32.051784+0000","last_fullsized":"2023-12-22T10:00:32.051784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:33.066089+0000","last_change":"2023-12-22T10:00:33.066089+0000","last_active":"2023-12-22T10:00:33.066089+0000","last_peered":"2023-12-22T10:00:33.066089+0000","last_clean":"2023-12-22T10:00:33.066089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:33.066089+0000","last_undegraded":"2023-12-22T10:00:33.066089+0000","last_fullsized":"2023-12-22T10:00:33.066089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:32.051784+0000","last_change":"2023-12-22T10:00:32.051784+0000","last_active":"2023-12-22T10:00:32.051784+0000","last_peered":"2023-12-22T10:00:32.051784+0000","last_clean":"2023-12-22T10:00:32.051784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:32.051784+0000","last_undegraded":"2023-12-22T10:00:32.051784+0000","last_fullsized":"2023-12-22T10:00:32.051784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:33.066089+0000","last_change":"2023-12-22T10:00:33.066089+0000","last_active":"2023-12-22T10:00:33.066089+0000","last_peered":"2023-12-22T10:00:33.066089+0000","last_clean":"2023-12-22T10:00:33.066089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:33.066089+0000","last_undegraded":"2023-12-22T10:00:33.066089+0000","last_fullsized":"2023-12-22T10:00:33.066089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:32.051784+0000","last_change":"2023-12-22T10:00:32.051784+0000","last_active":"2023-12-22T10:00:32.051784+0000","last_peered":"2023-12-22T10:00:32.051784+0000","last_clean":"2023-12-22T10:00:32.051784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:32.051784+0000","last_undegraded":"2023-12-22T10:00:32.051784+0000","last_fullsized":"2023-12-22T10:00:32.051784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:33.066089+0000","last_change":"2023-12-22T10:00:33.066089+0000","last_active":"2023-12-22T10:00:33.066089+0000","last_peered":"2023-12-22T10:00:33.066089+0000","last_clean":"2023-12-22T10:00:33.066089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:33.066089+0000","last_undegraded":"2023-12-22T10:00:33.066089+0000","last_fullsized":"2023-12-22T10:00:33.066089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:32.051784+0000","last_change":"2023-12-22T10:00:32.051784+0000","last_active":"2023-12-22T10:00:32.051784+0000","last_peered":"2023-12-22T10:00:32.051784+0000","last_clean":"2023-12-22T10:00:32.051784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:32.051784+0000","last_undegraded":"2023-12-22T10:00:32.051784+0000","last_fullsized":"2023-12-22T10:00:32.051784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:33.066089+0000","last_change":"2023-12-22T10:00:33.066089+0000","last_active":"2023-12-22T10:00:33.066089+0000","last_peered":"2023-12-22T10:00:33.066089+0000","last_clean":"2023-12-22T10:00:33.066089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:33.066089+0000","last_undegraded":"2023-12-22T10:00:33.066089+0000","last_fullsized":"2023-12-22T10:00:33.066089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:32.051784+0000","last_change":"2023-12-22T10:00:32.051784+0000","last_active":"2023-12-22T10:00:32.051784+0000","last_peered":"2023-12-22T10:00:32.051784+0000","last_clean":"2023-12-22T10:00:32.051784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:32.051784+0000","last_undegraded":"2023-12-22T10:00:32.051784+0000","last_fullsized":"2023-12-22T10:00:32.051784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:33.066089+0000","last_change":"2023-12-22T10:00:33.066089+0000","last_active":"2023-12-22T10:00:33.066089+0000","last_peered":"2023-12-22T10:00:33.066089+0000","last_clean":"2023-12-22T10:00:33.066089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:33.066089+0000","last_undegraded":"2023-12-22T10:00:33.066089+0000","last_fullsized":"2023-12-22T10:00:33.066089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:32.051784+0000","last_change":"2023-12-22T10:00:32.051784+0000","last_active":"2023-12-22T10:00:32.051784+0000","last_peered":"2023-12-22T10:00:32.051784+0000","last_clean":"2023-12-22T10:00:32.051784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:32.051784+0000","last_undegraded":"2023-12-22T10:00:32.051784+0000","last_fullsized":"2023-12-22T10:00:32.051784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:33.066089+0000","last_change":"2023-12-22T10:00:33.066089+0000","last_active":"2023-12-22T10:00:33.066089+0000","last_peered":"2023-12-22T10:00:33.066089+0000","last_clean":"2023-12-22T10:00:33.066089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:33.066089+0000","last_undegraded":"2023-12-22T10:00:33.066089+0000","last_fullsized":"2023-12-22T10:00:33.066089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:33.066089+0000","last_change":"2023-12-22T10:00:33.066089+0000","last_active":"2023-12-22T10:00:33.066089+0000","last_peered":"2023-12-22T10:00:33.066089+0000","last_clean":"2023-12-22T10:00:33.066089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:33.066089+0000","last_undegraded":"2023-12-22T10:00:33.066089+0000","last_fullsized":"2023-12-22T10:00:33.066089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:32.051784+0000","last_change":"2023-12-22T10:00:32.051784+0000","last_active":"2023-12-22T10:00:32.051784+0000","last_peered":"2023-12-22T10:00:32.051784+0000","last_clean":"2023-12-22T10:00:32.051784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:32.051784+0000","last_undegraded":"2023-12-22T10:00:32.051784+0000","last_fullsized":"2023-12-22T10:00:32.051784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:33.066089+0000","last_change":"2023-12-22T10:00:33.066089+0000","last_active":"2023-12-22T10:00:33.066089+0000","last_peered":"2023-12-22T10:00:33.066089+0000","last_clean":"2023-12-22T10:00:33.066089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:33.066089+0000","last_undegraded":"2023-12-22T10:00:33.066089+0000","last_fullsized":"2023-12-22T10:00:33.066089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:32.051784+0000","last_change":"2023-12-22T10:00:32.051784+0000","last_active":"2023-12-22T10:00:32.051784+0000","last_peered":"2023-12-22T10:00:32.051784+0000","last_clean":"2023-12-22T10:00:32.051784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:32.051784+0000","last_undegraded":"2023-12-22T10:00:32.051784+0000","last_fullsized":"2023-12-22T10:00:32.051784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:33.066089+0000","last_change":"2023-12-22T10:00:33.066089+0000","last_active":"2023-12-22T10:00:33.066089+0000","last_peered":"2023-12-22T10:00:33.066089+0000","last_clean":"2023-12-22T10:00:33.066089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:33.066089+0000","last_undegraded":"2023-12-22T10:00:33.066089+0000","last_fullsized":"2023-12-22T10:00:33.066089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:32.051784+0000","last_change":"2023-12-22T10:00:32.051784+0000","last_active":"2023-12-22T10:00:32.051784+0000","last_peered":"2023-12-22T10:00:32.051784+0000","last_clean":"2023-12-22T10:00:32.051784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:32.051784+0000","last_undegraded":"2023-12-22T10:00:32.051784+0000","last_fullsized":"2023-12-22T10:00:32.051784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:33.066089+0000","last_change":"2023-12-22T10:00:33.066089+0000","last_active":"2023-12-22T10:00:33.066089+0000","last_peered":"2023-12-22T10:00:33.066089+0000","last_clean":"2023-12-22T10:00:33.066089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:33.066089+0000","last_undegraded":"2023-12-22T10:00:33.066089+0000","last_fullsized":"2023-12-22T10:00:33.066089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:32.051784+0000","last_change":"2023-12-22T10:00:32.051784+0000","last_active":"2023-12-22T10:00:32.051784+0000","last_peered":"2023-12-22T10:00:32.051784+0000","last_clean":"2023-12-22T10:00:32.051784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:32.051784+0000","last_undegraded":"2023-12-22T10:00:32.051784+0000","last_fullsized":"2023-12-22T10:00:32.051784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:33.066089+0000","last_change":"2023-12-22T10:00:33.066089+0000","last_active":"2023-12-22T10:00:33.066089+0000","last_peered":"2023-12-22T10:00:33.066089+0000","last_clean":"2023-12-22T10:00:33.066089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:33.066089+0000","last_undegraded":"2023-12-22T10:00:33.066089+0000","last_fullsized":"2023-12-22T10:00:33.066089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:32.051784+0000","last_change":"2023-12-22T10:00:32.051784+0000","last_active":"2023-12-22T10:00:32.051784+0000","last_peered":"2023-12-22T10:00:32.051784+0000","last_clean":"2023-12-22T10:00:32.051784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:32.051784+0000","last_undegraded":"2023-12-22T10:00:32.051784+0000","last_fullsized":"2023-12-22T10:00:32.051784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:33.066089+0000","last_change":"2023-12-22T10:00:33.066089+0000","last_active":"2023-12-22T10:00:33.066089+0000","last_peered":"2023-12-22T10:00:33.066089+0000","last_clean":"2023-12-22T10:00:33.066089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:33.066089+0000","last_undegraded":"2023-12-22T10:00:33.066089+0000","last_fullsized":"2023-12-22T10:00:33.066089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:32.051784+0000","last_change":"2023-12-22T10:00:32.051784+0000","last_active":"2023-12-22T10:00:32.051784+0000","last_peered":"2023-12-22T10:00:32.051784+0000","last_clean":"2023-12-22T10:00:32.051784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:32.051784+0000","last_undegraded":"2023-12-22T10:00:32.051784+0000","last_fullsized":"2023-12-22T10:00:32.051784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:33.066089+0000","last_change":"2023-12-22T10:00:33.066089+0000","last_active":"2023-12-22T10:00:33.066089+0000","last_peered":"2023-12-22T10:00:33.066089+0000","last_clean":"2023-12-22T10:00:33.066089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:33.066089+0000","last_undegraded":"2023-12-22T10:00:33.066089+0000","last_fullsized":"2023-12-22T10:00:33.066089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:32.051784+0000","last_change":"2023-12-22T10:00:32.051784+0000","last_active":"2023-12-22T10:00:32.051784+0000","last_peered":"2023-12-22T10:00:32.051784+0000","last_clean":"2023-12-22T10:00:32.051784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:32.051784+0000","last_undegraded":"2023-12-22T10:00:32.051784+0000","last_fullsized":"2023-12-22T10:00:32.051784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:33.066089+0000","last_change":"2023-12-22T10:00:33.066089+0000","last_active":"2023-12-22T10:00:33.066089+0000","last_peered":"2023-12-22T10:00:33.066089+0000","last_clean":"2023-12-22T10:00:33.066089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:33.066089+0000","last_undegraded":"2023-12-22T10:00:33.066089+0000","last_fullsized":"2023-12-22T10:00:33.066089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-22T10:00:32.051784+0000","last_change":"2023-12-22T10:00:32.051784+0000","last_active":"2023-12-22T10:00:32.051784+0000","last_peered":"2023-12-22T10:00:32.051784+0000","last_clean":"2023-12-22T10:00:32.051784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-22T10:00:32.051784+0000","last_undegraded":"2023-12-22T10:00:32.051784+0000","last_fullsized":"2023-12-22T10:00:32.051784+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574850,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297260,"kb_used_data":164,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074580,"statfs":{"total":96636764160,"available":96332369920,"internally_reserved":0,"allocated":167936,"data_stored":53442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.8490000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3690000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2250000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2969999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.7690000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574850,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297260,"kb_used_data":164,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074580,"statfs":{"total":96636764160,"available":96332369920,"internally_reserved":0,"allocated":167936,"data_stored":53442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.456}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.262}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.365}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.204}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.397}]}]},{"osd":5,"up_from":13,"seq":55834574850,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297248,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074592,"statfs":{"total":96636764160,"available":96332382208,"internally_reserved":0,"allocated":155648,"data_stored":47643,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92200000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94699999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8779999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7749999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.091}]}]},{"osd":4,"up_from":13,"seq":55834574850,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297260,"kb_used_data":164,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074580,"statfs":{"total":96636764160,"available":96332369920,"internally_reserved":0,"allocated":167936,"data_stored":53442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0580000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3120000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3320000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574850,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297248,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074592,"statfs":{"total":96636764160,"available":96332382208,"internally_reserved":0,"allocated":155648,"data_stored":47643,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.361}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4059999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6910000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5880000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6519999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8959999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297248,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074592,"statfs":{"total":96636764160,"available":96332382208,"internally_reserved":0,"allocated":155648,"data_stored":47643,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1950000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95799999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7330000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7929999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8149999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574850,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297248,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074592,"statfs":{"total":96636764160,"available":96332382208,"internally_reserved":0,"allocated":155648,"data_stored":47643,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0940000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.319}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81599999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4239999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.466}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.482}]}]},{"osd":0,"up_from":13,"seq":55834574850,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297248,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074592,"statfs":{"total":96636764160,"available":96332382208,"internally_reserved":0,"allocated":155648,"data_stored":47643,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.111}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94899999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8089999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2629999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.925}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9570000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-22T10:00:37.807 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-22T10:00:38.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.022+0000 7f305d7f9700 1 Processor -- start 2023-12-22T10:00:38.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.022+0000 7f305d7f9700 1 -- start start 2023-12-22T10:00:38.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.026+0000 7f305d7f9700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f30580a9ed0 0x7f30580c1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:38.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.026+0000 7f305d7f9700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f30580bf910 0x7f30580bfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:38.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.026+0000 7f305d7f9700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30580c0f70 con 0x7f30580c5960 2023-12-22T10:00:38.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.026+0000 7f305d7f9700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30580aa2b0 con 0x7f30580bf910 2023-12-22T10:00:38.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.026+0000 7f305d7f9700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30580c0360 con 0x7f30580a9ed0 2023-12-22T10:00:38.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.026+0000 7f304f7fe700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f30580bf910 0x7f30580bfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:38.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.026+0000 7f3057fff700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f30580a9ed0 0x7f30580c1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:38.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.026+0000 7f304f7fe700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f30580bf910 0x7f30580bfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.45:42928/0 (socket says 172.21.15.45:42928) 2023-12-22T10:00:38.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.026+0000 7f304f7fe700 1 -- 172.21.15.45:0/304387634 learned_addr learned my addr 172.21.15.45:0/304387634 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:38.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.030+0000 7f304f7fe700 1 -- 172.21.15.45:0/304387634 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f30580a9ed0 msgr2=0x7f30580c1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:00:38.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.030+0000 7f304f7fe700 1 --2- 172.21.15.45:0/304387634 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f30580a9ed0 0x7f30580c1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:38.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.030+0000 7f304f7fe700 1 -- 172.21.15.45:0/304387634 >> v1:172.21.15.45:6789/0 conn(0x7f30580c5960 legacy=0x7f30580c5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:38.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.030+0000 7f304f7fe700 1 -- 172.21.15.45:0/304387634 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30580c0640 con 0x7f30580bf910 2023-12-22T10:00:38.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.030+0000 7f304f7fe700 1 --2- 172.21.15.45:0/304387634 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f30580bf910 0x7f30580bfd70 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f3040006fd0 tx=0x7f30400090f0).ready entity=mon.1 client_cookie=5bc4c7efb933001b server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:38.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.030+0000 7f30577fe700 1 -- 172.21.15.45:0/304387634 <== mon.1 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304000b580 con 0x7f30580bf910 2023-12-22T10:00:38.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.030+0000 7f30577fe700 1 -- 172.21.15.45:0/304387634 <== mon.1 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f304000b6e0 con 0x7f30580bf910 2023-12-22T10:00:38.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.030+0000 7f30577fe700 1 -- 172.21.15.45:0/304387634 <== mon.1 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304000ba60 con 0x7f30580bf910 2023-12-22T10:00:38.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.030+0000 7f305d7f9700 1 -- 172.21.15.45:0/304387634 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f30580bf910 msgr2=0x7f30580bfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:38.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.030+0000 7f305d7f9700 1 --2- 172.21.15.45:0/304387634 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f30580bf910 0x7f30580bfd70 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f3040006fd0 tx=0x7f30400090f0).stop 2023-12-22T10:00:38.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.030+0000 7f305d7f9700 1 -- 172.21.15.45:0/304387634 shutdown_connections 2023-12-22T10:00:38.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.030+0000 7f305d7f9700 1 --2- 172.21.15.45:0/304387634 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f30580bf910 0x7f30580bfd70 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:38.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.030+0000 7f305d7f9700 1 --2- 172.21.15.45:0/304387634 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f30580a9ed0 0x7f30580c1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:38.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.030+0000 7f305d7f9700 1 -- 172.21.15.45:0/304387634 >> 172.21.15.45:0/304387634 conn(0x7f3058067500 msgr2=0x7f30580ca9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:38.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.030+0000 7f305d7f9700 1 -- 172.21.15.45:0/304387634 shutdown_connections 2023-12-22T10:00:38.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.030+0000 7f305d7f9700 1 -- 172.21.15.45:0/304387634 wait complete. 2023-12-22T10:00:38.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.034+0000 7f305d7f9700 1 Processor -- start 2023-12-22T10:00:38.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.034+0000 7f305d7f9700 1 -- start start 2023-12-22T10:00:38.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.034+0000 7f305d7f9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30580a9ed0 0x7f3058143480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:38.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.034+0000 7f305d7f9700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f30580bf910 0x7f3058068a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:38.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.034+0000 7f305d7f9700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f30580c5960 0x7f3058068f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:38.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.034+0000 7f305d7f9700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3058069470 con 0x7f30580a9ed0 2023-12-22T10:00:38.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.034+0000 7f305d7f9700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30580c1a50 con 0x7f30580c5960 2023-12-22T10:00:38.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.034+0000 7f305d7f9700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30580c22f0 con 0x7f30580bf910 2023-12-22T10:00:38.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.034+0000 7f3057fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30580a9ed0 0x7f3058143480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:38.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.034+0000 7f3057fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30580a9ed0 0x7f3058143480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48140/0 (socket says 172.21.15.45:48140) 2023-12-22T10:00:38.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.034+0000 7f3057fff700 1 -- 172.21.15.45:0/1990017306 learned_addr learned my addr 172.21.15.45:0/1990017306 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:38.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.034+0000 7f304f7fe700 1 --2- 172.21.15.45:0/1990017306 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f30580bf910 0x7f3058068a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:38.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.034+0000 7f305cff8700 1 --2- 172.21.15.45:0/1990017306 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f30580c5960 0x7f3058068f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:38.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.038+0000 7f3057fff700 1 -- 172.21.15.45:0/1990017306 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f30580bf910 msgr2=0x7f3058068a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:38.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.038+0000 7f3057fff700 1 --2- 172.21.15.45:0/1990017306 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f30580bf910 0x7f3058068a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:38.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.038+0000 7f3057fff700 1 -- 172.21.15.45:0/1990017306 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f30580c5960 msgr2=0x7f3058068f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:38.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.038+0000 7f3057fff700 1 --2- 172.21.15.45:0/1990017306 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f30580c5960 0x7f3058068f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:38.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.038+0000 7f3057fff700 1 -- 172.21.15.45:0/1990017306 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3040009370 con 0x7f30580a9ed0 2023-12-22T10:00:38.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.038+0000 7f304f7fe700 1 --2- 172.21.15.45:0/1990017306 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f30580bf910 0x7f3058068a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T10:00:38.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.038+0000 7f3057fff700 1 --2- 172.21.15.45:0/1990017306 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30580a9ed0 0x7f3058143480 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f3048009f20 tx=0x7f304800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:38.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.038+0000 7f3054ff9700 1 -- 172.21.15.45:0/1990017306 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304800cbd0 con 0x7f30580a9ed0 2023-12-22T10:00:38.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.038+0000 7f3054ff9700 1 -- 172.21.15.45:0/1990017306 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f304800f040 con 0x7f30580a9ed0 2023-12-22T10:00:38.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.038+0000 7f305d7f9700 1 -- 172.21.15.45:0/1990017306 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3058143970 con 0x7f30580a9ed0 2023-12-22T10:00:38.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.038+0000 7f3054ff9700 1 -- 172.21.15.45:0/1990017306 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3048013400 con 0x7f30580a9ed0 2023-12-22T10:00:38.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.038+0000 7f305d7f9700 1 -- 172.21.15.45:0/1990017306 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30580c1ca0 con 0x7f30580a9ed0 2023-12-22T10:00:38.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.038+0000 7f305d7f9700 1 -- 172.21.15.45:0/1990017306 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3058047060 con 0x7f30580a9ed0 2023-12-22T10:00:38.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.042+0000 7f3054ff9700 1 -- 172.21.15.45:0/1990017306 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f3048013770 con 0x7f30580a9ed0 2023-12-22T10:00:38.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.042+0000 7f3054ff9700 1 --2- 172.21.15.45:0/1990017306 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f303805a540 0x7f303805ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:38.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.042+0000 7f3054ff9700 1 -- 172.21.15.45:0/1990017306 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f30480750f0 con 0x7f30580a9ed0 2023-12-22T10:00:38.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.042+0000 7f304f7fe700 1 --2- 172.21.15.45:0/1990017306 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f303805a540 0x7f303805ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:38.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.042+0000 7f304f7fe700 1 --2- 172.21.15.45:0/1990017306 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f303805a540 0x7f303805ca00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f3040006fd0 tx=0x7f3040017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:38.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.050+0000 7f3054ff9700 1 -- 172.21.15.45:0/1990017306 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f3048048810 con 0x7f30580a9ed0 2023-12-22T10:00:38.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.218+0000 7f305d7f9700 1 -- 172.21.15.45:0/1990017306 --> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f30580c0920 con 0x7f303805a540 2023-12-22T10:00:38.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.230+0000 7f3054ff9700 1 -- 172.21.15.45:0/1990017306 <== mgr.4104 v2:172.21.15.45:6832/33679 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+336206 (secure 0 0 0) 0x7f30580c0920 con 0x7f303805a540 2023-12-22T10:00:38.234 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:00:38.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.238+0000 7f305d7f9700 1 -- 172.21.15.45:0/1990017306 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f303805a540 msgr2=0x7f303805ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:38.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.238+0000 7f305d7f9700 1 --2- 172.21.15.45:0/1990017306 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f303805a540 0x7f303805ca00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f3040006fd0 tx=0x7f3040017000).stop 2023-12-22T10:00:38.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.238+0000 7f305d7f9700 1 -- 172.21.15.45:0/1990017306 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30580a9ed0 msgr2=0x7f3058143480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:38.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.238+0000 7f305d7f9700 1 --2- 172.21.15.45:0/1990017306 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30580a9ed0 0x7f3058143480 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f3048009f20 tx=0x7f304800b040).stop 2023-12-22T10:00:38.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.238+0000 7f305d7f9700 1 -- 172.21.15.45:0/1990017306 shutdown_connections 2023-12-22T10:00:38.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.238+0000 7f305d7f9700 1 --2- 172.21.15.45:0/1990017306 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f30580c5960 0x7f3058068f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:38.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.238+0000 7f305d7f9700 1 --2- 172.21.15.45:0/1990017306 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f303805a540 0x7f303805ca00 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:38.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.238+0000 7f305d7f9700 1 --2- 172.21.15.45:0/1990017306 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f30580bf910 0x7f3058068a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:38.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.238+0000 7f305d7f9700 1 --2- 172.21.15.45:0/1990017306 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30580a9ed0 0x7f3058143480 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:38.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.238+0000 7f305d7f9700 1 -- 172.21.15.45:0/1990017306 >> 172.21.15.45:0/1990017306 conn(0x7f3058067500 msgr2=0x7f30580af970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:38.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.238+0000 7f305d7f9700 1 -- 172.21.15.45:0/1990017306 shutdown_connections 2023-12-22T10:00:38.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.238+0000 7f305d7f9700 1 -- 172.21.15.45:0/1990017306 wait complete. 2023-12-22T10:00:38.238 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-12-22T10:00:38.256 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2023-12-22T10:00:37.953046+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":189,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2378528,"kb_used_data":1760,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752596192,"statfs":{"total":773094113280,"available":770658500608,"internally_reserved":0,"allocated":1802240,"data_stored":646412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.550595+0000","last_change":"2023-12-22T10:00:33.548525+0000","last_active":"2023-12-22T10:00:33.550595+0000","last_peered":"2023-12-22T10:00:33.550595+0000","last_clean":"2023-12-22T10:00:33.550595+0000","last_became_active":"2023-12-22T10:00:33.548303+0000","last_became_peered":"2023-12-22T10:00:33.548303+0000","last_unstale":"2023-12-22T10:00:33.550595+0000","last_undegraded":"2023-12-22T10:00:33.550595+0000","last_fullsized":"2023-12-22T10:00:33.550595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.557701+0000","last_change":"2023-12-22T10:00:33.114700+0000","last_active":"2023-12-22T10:00:33.557701+0000","last_peered":"2023-12-22T10:00:33.557701+0000","last_clean":"2023-12-22T10:00:33.557701+0000","last_became_active":"2023-12-22T10:00:33.114451+0000","last_became_peered":"2023-12-22T10:00:33.114451+0000","last_unstale":"2023-12-22T10:00:33.557701+0000","last_undegraded":"2023-12-22T10:00:33.557701+0000","last_fullsized":"2023-12-22T10:00:33.557701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.566769+0000","last_change":"2023-12-22T10:00:33.565377+0000","last_active":"2023-12-22T10:00:33.566769+0000","last_peered":"2023-12-22T10:00:33.566769+0000","last_clean":"2023-12-22T10:00:33.566769+0000","last_became_active":"2023-12-22T10:00:33.565034+0000","last_became_peered":"2023-12-22T10:00:33.565034+0000","last_unstale":"2023-12-22T10:00:33.566769+0000","last_undegraded":"2023-12-22T10:00:33.566769+0000","last_fullsized":"2023-12-22T10:00:33.566769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.30","version":"20'4","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.579500+0000","last_change":"2023-12-22T10:00:33.115740+0000","last_active":"2023-12-22T10:00:33.579500+0000","last_peered":"2023-12-22T10:00:33.579500+0000","last_clean":"2023-12-22T10:00:33.579500+0000","last_became_active":"2023-12-22T10:00:33.115447+0000","last_became_peered":"2023-12-22T10:00:33.115447+0000","last_unstale":"2023-12-22T10:00:33.579500+0000","last_undegraded":"2023-12-22T10:00:33.579500+0000","last_fullsized":"2023-12-22T10:00:33.579500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.572884+0000","last_change":"2023-12-22T10:00:33.126391+0000","last_active":"2023-12-22T10:00:33.572884+0000","last_peered":"2023-12-22T10:00:33.572884+0000","last_clean":"2023-12-22T10:00:33.572884+0000","last_became_active":"2023-12-22T10:00:33.125526+0000","last_became_peered":"2023-12-22T10:00:33.125526+0000","last_unstale":"2023-12-22T10:00:33.572884+0000","last_undegraded":"2023-12-22T10:00:33.572884+0000","last_fullsized":"2023-12-22T10:00:33.572884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.564517+0000","last_change":"2023-12-22T10:00:33.562377+0000","last_active":"2023-12-22T10:00:33.564517+0000","last_peered":"2023-12-22T10:00:33.564517+0000","last_clean":"2023-12-22T10:00:33.564517+0000","last_became_active":"2023-12-22T10:00:33.562153+0000","last_became_peered":"2023-12-22T10:00:33.562153+0000","last_unstale":"2023-12-22T10:00:33.564517+0000","last_undegraded":"2023-12-22T10:00:33.564517+0000","last_fullsized":"2023-12-22T10:00:33.564517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.535033+0000","last_change":"2023-12-22T10:00:33.102597+0000","last_active":"2023-12-22T10:00:33.535033+0000","last_peered":"2023-12-22T10:00:33.535033+0000","last_clean":"2023-12-22T10:00:33.535033+0000","last_became_active":"2023-12-22T10:00:33.102275+0000","last_became_peered":"2023-12-22T10:00:33.102275+0000","last_unstale":"2023-12-22T10:00:33.535033+0000","last_undegraded":"2023-12-22T10:00:33.535033+0000","last_fullsized":"2023-12-22T10:00:33.535033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.574337+0000","last_change":"2023-12-22T10:00:33.572233+0000","last_active":"2023-12-22T10:00:33.574337+0000","last_peered":"2023-12-22T10:00:33.574337+0000","last_clean":"2023-12-22T10:00:33.574337+0000","last_became_active":"2023-12-22T10:00:33.571392+0000","last_became_peered":"2023-12-22T10:00:33.571392+0000","last_unstale":"2023-12-22T10:00:33.574337+0000","last_undegraded":"2023-12-22T10:00:33.574337+0000","last_fullsized":"2023-12-22T10:00:33.574337+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.582022+0000","last_change":"2023-12-22T10:00:33.104748+0000","last_active":"2023-12-22T10:00:33.582022+0000","last_peered":"2023-12-22T10:00:33.582022+0000","last_clean":"2023-12-22T10:00:33.582022+0000","last_became_active":"2023-12-22T10:00:33.104419+0000","last_became_peered":"2023-12-22T10:00:33.104419+0000","last_unstale":"2023-12-22T10:00:33.582022+0000","last_undegraded":"2023-12-22T10:00:33.582022+0000","last_fullsized":"2023-12-22T10:00:33.582022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.554141+0000","last_change":"2023-12-22T10:00:33.550068+0000","last_active":"2023-12-22T10:00:33.554141+0000","last_peered":"2023-12-22T10:00:33.554141+0000","last_clean":"2023-12-22T10:00:33.554141+0000","last_became_active":"2023-12-22T10:00:33.549379+0000","last_became_peered":"2023-12-22T10:00:33.549379+0000","last_unstale":"2023-12-22T10:00:33.554141+0000","last_undegraded":"2023-12-22T10:00:33.554141+0000","last_fullsized":"2023-12-22T10:00:33.554141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.552458+0000","last_change":"2023-12-22T10:00:33.125321+0000","last_active":"2023-12-22T10:00:33.552458+0000","last_peered":"2023-12-22T10:00:33.552458+0000","last_clean":"2023-12-22T10:00:33.552458+0000","last_became_active":"2023-12-22T10:00:33.124941+0000","last_became_peered":"2023-12-22T10:00:33.124941+0000","last_unstale":"2023-12-22T10:00:33.552458+0000","last_undegraded":"2023-12-22T10:00:33.552458+0000","last_fullsized":"2023-12-22T10:00:33.552458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.559455+0000","last_change":"2023-12-22T10:00:33.555687+0000","last_active":"2023-12-22T10:00:33.559455+0000","last_peered":"2023-12-22T10:00:33.559455+0000","last_clean":"2023-12-22T10:00:33.559455+0000","last_became_active":"2023-12-22T10:00:33.555390+0000","last_became_peered":"2023-12-22T10:00:33.555390+0000","last_unstale":"2023-12-22T10:00:33.559455+0000","last_undegraded":"2023-12-22T10:00:33.559455+0000","last_fullsized":"2023-12-22T10:00:33.559455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.568874+0000","last_change":"2023-12-22T10:00:33.105518+0000","last_active":"2023-12-22T10:00:33.568874+0000","last_peered":"2023-12-22T10:00:33.568874+0000","last_clean":"2023-12-22T10:00:33.568874+0000","last_became_active":"2023-12-22T10:00:33.105228+0000","last_became_peered":"2023-12-22T10:00:33.105228+0000","last_unstale":"2023-12-22T10:00:33.568874+0000","last_undegraded":"2023-12-22T10:00:33.568874+0000","last_fullsized":"2023-12-22T10:00:33.568874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.560977+0000","last_change":"2023-12-22T10:00:33.557230+0000","last_active":"2023-12-22T10:00:33.560977+0000","last_peered":"2023-12-22T10:00:33.560977+0000","last_clean":"2023-12-22T10:00:33.560977+0000","last_became_active":"2023-12-22T10:00:33.556941+0000","last_became_peered":"2023-12-22T10:00:33.556941+0000","last_unstale":"2023-12-22T10:00:33.560977+0000","last_undegraded":"2023-12-22T10:00:33.560977+0000","last_fullsized":"2023-12-22T10:00:33.560977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.537134+0000","last_change":"2023-12-22T10:00:33.116904+0000","last_active":"2023-12-22T10:00:33.537134+0000","last_peered":"2023-12-22T10:00:33.537134+0000","last_clean":"2023-12-22T10:00:33.537134+0000","last_became_active":"2023-12-22T10:00:33.116529+0000","last_became_peered":"2023-12-22T10:00:33.116529+0000","last_unstale":"2023-12-22T10:00:33.537134+0000","last_undegraded":"2023-12-22T10:00:33.537134+0000","last_fullsized":"2023-12-22T10:00:33.537134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.572395+0000","last_change":"2023-12-22T10:00:33.568568+0000","last_active":"2023-12-22T10:00:33.572395+0000","last_peered":"2023-12-22T10:00:33.572395+0000","last_clean":"2023-12-22T10:00:33.572395+0000","last_became_active":"2023-12-22T10:00:33.568292+0000","last_became_peered":"2023-12-22T10:00:33.568292+0000","last_unstale":"2023-12-22T10:00:33.572395+0000","last_undegraded":"2023-12-22T10:00:33.572395+0000","last_fullsized":"2023-12-22T10:00:33.572395+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.557798+0000","last_change":"2023-12-22T10:00:33.117091+0000","last_active":"2023-12-22T10:00:33.557798+0000","last_peered":"2023-12-22T10:00:33.557798+0000","last_clean":"2023-12-22T10:00:33.557798+0000","last_became_active":"2023-12-22T10:00:33.116766+0000","last_became_peered":"2023-12-22T10:00:33.116766+0000","last_unstale":"2023-12-22T10:00:33.557798+0000","last_undegraded":"2023-12-22T10:00:33.557798+0000","last_fullsized":"2023-12-22T10:00:33.557798+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.566935+0000","last_change":"2023-12-22T10:00:33.561834+0000","last_active":"2023-12-22T10:00:33.566935+0000","last_peered":"2023-12-22T10:00:33.566935+0000","last_clean":"2023-12-22T10:00:33.566935+0000","last_became_active":"2023-12-22T10:00:33.561545+0000","last_became_peered":"2023-12-22T10:00:33.561545+0000","last_unstale":"2023-12-22T10:00:33.566935+0000","last_undegraded":"2023-12-22T10:00:33.566935+0000","last_fullsized":"2023-12-22T10:00:33.566935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.563732+0000","last_change":"2023-12-22T10:00:33.108579+0000","last_active":"2023-12-22T10:00:33.563732+0000","last_peered":"2023-12-22T10:00:33.563732+0000","last_clean":"2023-12-22T10:00:33.563732+0000","last_became_active":"2023-12-22T10:00:33.108196+0000","last_became_peered":"2023-12-22T10:00:33.108196+0000","last_unstale":"2023-12-22T10:00:33.563732+0000","last_undegraded":"2023-12-22T10:00:33.563732+0000","last_fullsized":"2023-12-22T10:00:33.563732+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.554072+0000","last_change":"2023-12-22T10:00:33.548625+0000","last_active":"2023-12-22T10:00:33.554072+0000","last_peered":"2023-12-22T10:00:33.554072+0000","last_clean":"2023-12-22T10:00:33.554072+0000","last_became_active":"2023-12-22T10:00:33.547877+0000","last_became_peered":"2023-12-22T10:00:33.547877+0000","last_unstale":"2023-12-22T10:00:33.554072+0000","last_undegraded":"2023-12-22T10:00:33.554072+0000","last_fullsized":"2023-12-22T10:00:33.554072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.567687+0000","last_change":"2023-12-22T10:00:33.122895+0000","last_active":"2023-12-22T10:00:33.567687+0000","last_peered":"2023-12-22T10:00:33.567687+0000","last_clean":"2023-12-22T10:00:33.567687+0000","last_became_active":"2023-12-22T10:00:33.122475+0000","last_became_peered":"2023-12-22T10:00:33.122475+0000","last_unstale":"2023-12-22T10:00:33.567687+0000","last_undegraded":"2023-12-22T10:00:33.567687+0000","last_fullsized":"2023-12-22T10:00:33.567687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.546974+0000","last_change":"2023-12-22T10:00:33.545482+0000","last_active":"2023-12-22T10:00:33.546974+0000","last_peered":"2023-12-22T10:00:33.546974+0000","last_clean":"2023-12-22T10:00:33.546974+0000","last_became_active":"2023-12-22T10:00:33.545263+0000","last_became_peered":"2023-12-22T10:00:33.545263+0000","last_unstale":"2023-12-22T10:00:33.546974+0000","last_undegraded":"2023-12-22T10:00:33.546974+0000","last_fullsized":"2023-12-22T10:00:33.546974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.541587+0000","last_change":"2023-12-22T10:00:33.116864+0000","last_active":"2023-12-22T10:00:33.541587+0000","last_peered":"2023-12-22T10:00:33.541587+0000","last_clean":"2023-12-22T10:00:33.541587+0000","last_became_active":"2023-12-22T10:00:33.114073+0000","last_became_peered":"2023-12-22T10:00:33.114073+0000","last_unstale":"2023-12-22T10:00:33.541587+0000","last_undegraded":"2023-12-22T10:00:33.541587+0000","last_fullsized":"2023-12-22T10:00:33.541587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.574592+0000","last_change":"2023-12-22T10:00:33.570093+0000","last_active":"2023-12-22T10:00:33.574592+0000","last_peered":"2023-12-22T10:00:33.574592+0000","last_clean":"2023-12-22T10:00:33.574592+0000","last_became_active":"2023-12-22T10:00:33.569770+0000","last_became_peered":"2023-12-22T10:00:33.569770+0000","last_unstale":"2023-12-22T10:00:33.574592+0000","last_undegraded":"2023-12-22T10:00:33.574592+0000","last_fullsized":"2023-12-22T10:00:33.574592+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.553842+0000","last_change":"2023-12-22T10:00:33.104605+0000","last_active":"2023-12-22T10:00:33.553842+0000","last_peered":"2023-12-22T10:00:33.553842+0000","last_clean":"2023-12-22T10:00:33.553842+0000","last_became_active":"2023-12-22T10:00:33.104303+0000","last_became_peered":"2023-12-22T10:00:33.104303+0000","last_unstale":"2023-12-22T10:00:33.553842+0000","last_undegraded":"2023-12-22T10:00:33.553842+0000","last_fullsized":"2023-12-22T10:00:33.553842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.566847+0000","last_change":"2023-12-22T10:00:33.562874+0000","last_active":"2023-12-22T10:00:33.566847+0000","last_peered":"2023-12-22T10:00:33.566847+0000","last_clean":"2023-12-22T10:00:33.566847+0000","last_became_active":"2023-12-22T10:00:33.562576+0000","last_became_peered":"2023-12-22T10:00:33.562576+0000","last_unstale":"2023-12-22T10:00:33.566847+0000","last_undegraded":"2023-12-22T10:00:33.566847+0000","last_fullsized":"2023-12-22T10:00:33.566847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.553589+0000","last_change":"2023-12-22T10:00:33.119412+0000","last_active":"2023-12-22T10:00:33.553589+0000","last_peered":"2023-12-22T10:00:33.553589+0000","last_clean":"2023-12-22T10:00:33.553589+0000","last_became_active":"2023-12-22T10:00:33.119056+0000","last_became_peered":"2023-12-22T10:00:33.119056+0000","last_unstale":"2023-12-22T10:00:33.553589+0000","last_undegraded":"2023-12-22T10:00:33.553589+0000","last_fullsized":"2023-12-22T10:00:33.553589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.567918+0000","last_change":"2023-12-22T10:00:33.560630+0000","last_active":"2023-12-22T10:00:33.567918+0000","last_peered":"2023-12-22T10:00:33.567918+0000","last_clean":"2023-12-22T10:00:33.567918+0000","last_became_active":"2023-12-22T10:00:33.559732+0000","last_became_peered":"2023-12-22T10:00:33.559732+0000","last_unstale":"2023-12-22T10:00:33.567918+0000","last_undegraded":"2023-12-22T10:00:33.567918+0000","last_fullsized":"2023-12-22T10:00:33.567918+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.563517+0000","last_change":"2023-12-22T10:00:33.101844+0000","last_active":"2023-12-22T10:00:33.563517+0000","last_peered":"2023-12-22T10:00:33.563517+0000","last_clean":"2023-12-22T10:00:33.563517+0000","last_became_active":"2023-12-22T10:00:33.101555+0000","last_became_peered":"2023-12-22T10:00:33.101555+0000","last_unstale":"2023-12-22T10:00:33.563517+0000","last_undegraded":"2023-12-22T10:00:33.563517+0000","last_fullsized":"2023-12-22T10:00:33.563517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.574042+0000","last_change":"2023-12-22T10:00:33.570633+0000","last_active":"2023-12-22T10:00:33.574042+0000","last_peered":"2023-12-22T10:00:33.574042+0000","last_clean":"2023-12-22T10:00:33.574042+0000","last_became_active":"2023-12-22T10:00:33.570252+0000","last_became_peered":"2023-12-22T10:00:33.570252+0000","last_unstale":"2023-12-22T10:00:33.574042+0000","last_undegraded":"2023-12-22T10:00:33.574042+0000","last_fullsized":"2023-12-22T10:00:33.574042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.563696+0000","last_change":"2023-12-22T10:00:33.116761+0000","last_active":"2023-12-22T10:00:33.563696+0000","last_peered":"2023-12-22T10:00:33.563696+0000","last_clean":"2023-12-22T10:00:33.563696+0000","last_became_active":"2023-12-22T10:00:33.116474+0000","last_became_peered":"2023-12-22T10:00:33.116474+0000","last_unstale":"2023-12-22T10:00:33.563696+0000","last_undegraded":"2023-12-22T10:00:33.563696+0000","last_fullsized":"2023-12-22T10:00:33.563696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.580112+0000","last_change":"2023-12-22T10:00:33.571361+0000","last_active":"2023-12-22T10:00:33.580112+0000","last_peered":"2023-12-22T10:00:33.580112+0000","last_clean":"2023-12-22T10:00:33.580112+0000","last_became_active":"2023-12-22T10:00:33.571028+0000","last_became_peered":"2023-12-22T10:00:33.571028+0000","last_unstale":"2023-12-22T10:00:33.580112+0000","last_undegraded":"2023-12-22T10:00:33.580112+0000","last_fullsized":"2023-12-22T10:00:33.580112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.533714+0000","last_change":"2023-12-22T10:00:33.106541+0000","last_active":"2023-12-22T10:00:33.533714+0000","last_peered":"2023-12-22T10:00:33.533714+0000","last_clean":"2023-12-22T10:00:33.533714+0000","last_became_active":"2023-12-22T10:00:33.106335+0000","last_became_peered":"2023-12-22T10:00:33.106335+0000","last_unstale":"2023-12-22T10:00:33.533714+0000","last_undegraded":"2023-12-22T10:00:33.533714+0000","last_fullsized":"2023-12-22T10:00:33.533714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.556351+0000","last_change":"2023-12-22T10:00:33.549027+0000","last_active":"2023-12-22T10:00:33.556351+0000","last_peered":"2023-12-22T10:00:33.556351+0000","last_clean":"2023-12-22T10:00:33.556351+0000","last_became_active":"2023-12-22T10:00:33.548700+0000","last_became_peered":"2023-12-22T10:00:33.548700+0000","last_unstale":"2023-12-22T10:00:33.556351+0000","last_undegraded":"2023-12-22T10:00:33.556351+0000","last_fullsized":"2023-12-22T10:00:33.556351+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.536888+0000","last_change":"2023-12-22T10:00:33.114834+0000","last_active":"2023-12-22T10:00:33.536888+0000","last_peered":"2023-12-22T10:00:33.536888+0000","last_clean":"2023-12-22T10:00:33.536888+0000","last_became_active":"2023-12-22T10:00:33.114551+0000","last_became_peered":"2023-12-22T10:00:33.114551+0000","last_unstale":"2023-12-22T10:00:33.536888+0000","last_undegraded":"2023-12-22T10:00:33.536888+0000","last_fullsized":"2023-12-22T10:00:33.536888+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.570248+0000","last_change":"2023-12-22T10:00:33.569508+0000","last_active":"2023-12-22T10:00:33.570248+0000","last_peered":"2023-12-22T10:00:33.570248+0000","last_clean":"2023-12-22T10:00:33.570248+0000","last_became_active":"2023-12-22T10:00:33.569153+0000","last_became_peered":"2023-12-22T10:00:33.569153+0000","last_unstale":"2023-12-22T10:00:33.570248+0000","last_undegraded":"2023-12-22T10:00:33.570248+0000","last_fullsized":"2023-12-22T10:00:33.570248+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.581087+0000","last_change":"2023-12-22T10:00:33.122806+0000","last_active":"2023-12-22T10:00:33.581087+0000","last_peered":"2023-12-22T10:00:33.581087+0000","last_clean":"2023-12-22T10:00:33.581087+0000","last_became_active":"2023-12-22T10:00:33.122335+0000","last_became_peered":"2023-12-22T10:00:33.122335+0000","last_unstale":"2023-12-22T10:00:33.581087+0000","last_undegraded":"2023-12-22T10:00:33.581087+0000","last_fullsized":"2023-12-22T10:00:33.581087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.562584+0000","last_change":"2023-12-22T10:00:33.558380+0000","last_active":"2023-12-22T10:00:33.562584+0000","last_peered":"2023-12-22T10:00:33.562584+0000","last_clean":"2023-12-22T10:00:33.562584+0000","last_became_active":"2023-12-22T10:00:33.557645+0000","last_became_peered":"2023-12-22T10:00:33.557645+0000","last_unstale":"2023-12-22T10:00:33.562584+0000","last_undegraded":"2023-12-22T10:00:33.562584+0000","last_fullsized":"2023-12-22T10:00:33.562584+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.575125+0000","last_change":"2023-12-22T10:00:33.108312+0000","last_active":"2023-12-22T10:00:33.575125+0000","last_peered":"2023-12-22T10:00:33.575125+0000","last_clean":"2023-12-22T10:00:33.575125+0000","last_became_active":"2023-12-22T10:00:33.107971+0000","last_became_peered":"2023-12-22T10:00:33.107971+0000","last_unstale":"2023-12-22T10:00:33.575125+0000","last_undegraded":"2023-12-22T10:00:33.575125+0000","last_fullsized":"2023-12-22T10:00:33.575125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.553973+0000","last_change":"2023-12-22T10:00:33.545698+0000","last_active":"2023-12-22T10:00:33.553973+0000","last_peered":"2023-12-22T10:00:33.553973+0000","last_clean":"2023-12-22T10:00:33.553973+0000","last_became_active":"2023-12-22T10:00:33.545320+0000","last_became_peered":"2023-12-22T10:00:33.545320+0000","last_unstale":"2023-12-22T10:00:33.553973+0000","last_undegraded":"2023-12-22T10:00:33.553973+0000","last_fullsized":"2023-12-22T10:00:33.553973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.583316+0000","last_change":"2023-12-22T10:00:33.131076+0000","last_active":"2023-12-22T10:00:33.583316+0000","last_peered":"2023-12-22T10:00:33.583316+0000","last_clean":"2023-12-22T10:00:33.583316+0000","last_became_active":"2023-12-22T10:00:33.129467+0000","last_became_peered":"2023-12-22T10:00:33.129467+0000","last_unstale":"2023-12-22T10:00:33.583316+0000","last_undegraded":"2023-12-22T10:00:33.583316+0000","last_fullsized":"2023-12-22T10:00:33.583316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.569110+0000","last_change":"2023-12-22T10:00:33.562206+0000","last_active":"2023-12-22T10:00:33.569110+0000","last_peered":"2023-12-22T10:00:33.569110+0000","last_clean":"2023-12-22T10:00:33.569110+0000","last_became_active":"2023-12-22T10:00:33.561891+0000","last_became_peered":"2023-12-22T10:00:33.561891+0000","last_unstale":"2023-12-22T10:00:33.569110+0000","last_undegraded":"2023-12-22T10:00:33.569110+0000","last_fullsized":"2023-12-22T10:00:33.569110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.540004+0000","last_change":"2023-12-22T10:00:33.123149+0000","last_active":"2023-12-22T10:00:33.540004+0000","last_peered":"2023-12-22T10:00:33.540004+0000","last_clean":"2023-12-22T10:00:33.540004+0000","last_became_active":"2023-12-22T10:00:33.122935+0000","last_became_peered":"2023-12-22T10:00:33.122935+0000","last_unstale":"2023-12-22T10:00:33.540004+0000","last_undegraded":"2023-12-22T10:00:33.540004+0000","last_fullsized":"2023-12-22T10:00:33.540004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.568376+0000","last_change":"2023-12-22T10:00:33.567288+0000","last_active":"2023-12-22T10:00:33.568376+0000","last_peered":"2023-12-22T10:00:33.568376+0000","last_clean":"2023-12-22T10:00:33.568376+0000","last_became_active":"2023-12-22T10:00:33.566952+0000","last_became_peered":"2023-12-22T10:00:33.566952+0000","last_unstale":"2023-12-22T10:00:33.568376+0000","last_undegraded":"2023-12-22T10:00:33.568376+0000","last_fullsized":"2023-12-22T10:00:33.568376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.538624+0000","last_change":"2023-12-22T10:00:33.123825+0000","last_active":"2023-12-22T10:00:33.538624+0000","last_peered":"2023-12-22T10:00:33.538624+0000","last_clean":"2023-12-22T10:00:33.538624+0000","last_became_active":"2023-12-22T10:00:33.123481+0000","last_became_peered":"2023-12-22T10:00:33.123481+0000","last_unstale":"2023-12-22T10:00:33.538624+0000","last_undegraded":"2023-12-22T10:00:33.538624+0000","last_fullsized":"2023-12-22T10:00:33.538624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.557967+0000","last_change":"2023-12-22T10:00:33.555572+0000","last_active":"2023-12-22T10:00:33.557967+0000","last_peered":"2023-12-22T10:00:33.557967+0000","last_clean":"2023-12-22T10:00:33.557967+0000","last_became_active":"2023-12-22T10:00:33.555250+0000","last_became_peered":"2023-12-22T10:00:33.555250+0000","last_unstale":"2023-12-22T10:00:33.557967+0000","last_undegraded":"2023-12-22T10:00:33.557967+0000","last_fullsized":"2023-12-22T10:00:33.557967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.537289+0000","last_change":"2023-12-22T10:00:33.124398+0000","last_active":"2023-12-22T10:00:33.537289+0000","last_peered":"2023-12-22T10:00:33.537289+0000","last_clean":"2023-12-22T10:00:33.537289+0000","last_became_active":"2023-12-22T10:00:33.124096+0000","last_became_peered":"2023-12-22T10:00:33.124096+0000","last_unstale":"2023-12-22T10:00:33.537289+0000","last_undegraded":"2023-12-22T10:00:33.537289+0000","last_fullsized":"2023-12-22T10:00:33.537289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.574132+0000","last_change":"2023-12-22T10:00:33.571592+0000","last_active":"2023-12-22T10:00:33.574132+0000","last_peered":"2023-12-22T10:00:33.574132+0000","last_clean":"2023-12-22T10:00:33.574132+0000","last_became_active":"2023-12-22T10:00:33.570984+0000","last_became_peered":"2023-12-22T10:00:33.570984+0000","last_unstale":"2023-12-22T10:00:33.574132+0000","last_undegraded":"2023-12-22T10:00:33.574132+0000","last_fullsized":"2023-12-22T10:00:33.574132+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.535021+0000","last_change":"2023-12-22T10:00:33.112772+0000","last_active":"2023-12-22T10:00:33.535021+0000","last_peered":"2023-12-22T10:00:33.535021+0000","last_clean":"2023-12-22T10:00:33.535021+0000","last_became_active":"2023-12-22T10:00:33.111855+0000","last_became_peered":"2023-12-22T10:00:33.111855+0000","last_unstale":"2023-12-22T10:00:33.535021+0000","last_undegraded":"2023-12-22T10:00:33.535021+0000","last_fullsized":"2023-12-22T10:00:33.535021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.548367+0000","last_change":"2023-12-22T10:00:33.544852+0000","last_active":"2023-12-22T10:00:33.548367+0000","last_peered":"2023-12-22T10:00:33.548367+0000","last_clean":"2023-12-22T10:00:33.548367+0000","last_became_active":"2023-12-22T10:00:33.544552+0000","last_became_peered":"2023-12-22T10:00:33.544552+0000","last_unstale":"2023-12-22T10:00:33.548367+0000","last_undegraded":"2023-12-22T10:00:33.548367+0000","last_fullsized":"2023-12-22T10:00:33.548367+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.558216+0000","last_change":"2023-12-22T10:00:33.113222+0000","last_active":"2023-12-22T10:00:33.558216+0000","last_peered":"2023-12-22T10:00:33.558216+0000","last_clean":"2023-12-22T10:00:33.558216+0000","last_became_active":"2023-12-22T10:00:33.112562+0000","last_became_peered":"2023-12-22T10:00:33.112562+0000","last_unstale":"2023-12-22T10:00:33.558216+0000","last_undegraded":"2023-12-22T10:00:33.558216+0000","last_fullsized":"2023-12-22T10:00:33.558216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.580413+0000","last_change":"2023-12-22T10:00:33.574338+0000","last_active":"2023-12-22T10:00:33.580413+0000","last_peered":"2023-12-22T10:00:33.580413+0000","last_clean":"2023-12-22T10:00:33.580413+0000","last_became_active":"2023-12-22T10:00:33.574067+0000","last_became_peered":"2023-12-22T10:00:33.574067+0000","last_unstale":"2023-12-22T10:00:33.580413+0000","last_undegraded":"2023-12-22T10:00:33.580413+0000","last_fullsized":"2023-12-22T10:00:33.580413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.567934+0000","last_change":"2023-12-22T10:00:33.107801+0000","last_active":"2023-12-22T10:00:33.567934+0000","last_peered":"2023-12-22T10:00:33.567934+0000","last_clean":"2023-12-22T10:00:33.567934+0000","last_became_active":"2023-12-22T10:00:33.107518+0000","last_became_peered":"2023-12-22T10:00:33.107518+0000","last_unstale":"2023-12-22T10:00:33.567934+0000","last_undegraded":"2023-12-22T10:00:33.567934+0000","last_fullsized":"2023-12-22T10:00:33.567934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.562318+0000","last_change":"2023-12-22T10:00:33.560454+0000","last_active":"2023-12-22T10:00:33.562318+0000","last_peered":"2023-12-22T10:00:33.562318+0000","last_clean":"2023-12-22T10:00:33.562318+0000","last_became_active":"2023-12-22T10:00:33.560129+0000","last_became_peered":"2023-12-22T10:00:33.560129+0000","last_unstale":"2023-12-22T10:00:33.562318+0000","last_undegraded":"2023-12-22T10:00:33.562318+0000","last_fullsized":"2023-12-22T10:00:33.562318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.541686+0000","last_change":"2023-12-22T10:00:33.117097+0000","last_active":"2023-12-22T10:00:33.541686+0000","last_peered":"2023-12-22T10:00:33.541686+0000","last_clean":"2023-12-22T10:00:33.541686+0000","last_became_active":"2023-12-22T10:00:33.116827+0000","last_became_peered":"2023-12-22T10:00:33.116827+0000","last_unstale":"2023-12-22T10:00:33.541686+0000","last_undegraded":"2023-12-22T10:00:33.541686+0000","last_fullsized":"2023-12-22T10:00:33.541686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.566055+0000","last_change":"2023-12-22T10:00:33.563813+0000","last_active":"2023-12-22T10:00:33.566055+0000","last_peered":"2023-12-22T10:00:33.566055+0000","last_clean":"2023-12-22T10:00:33.566055+0000","last_became_active":"2023-12-22T10:00:33.563482+0000","last_became_peered":"2023-12-22T10:00:33.563482+0000","last_unstale":"2023-12-22T10:00:33.566055+0000","last_undegraded":"2023-12-22T10:00:33.566055+0000","last_fullsized":"2023-12-22T10:00:33.566055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.581412+0000","last_change":"2023-12-22T10:00:33.123573+0000","last_active":"2023-12-22T10:00:33.581412+0000","last_peered":"2023-12-22T10:00:33.581412+0000","last_clean":"2023-12-22T10:00:33.581412+0000","last_became_active":"2023-12-22T10:00:33.123235+0000","last_became_peered":"2023-12-22T10:00:33.123235+0000","last_unstale":"2023-12-22T10:00:33.581412+0000","last_undegraded":"2023-12-22T10:00:33.581412+0000","last_fullsized":"2023-12-22T10:00:33.581412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.565881+0000","last_change":"2023-12-22T10:00:33.562321+0000","last_active":"2023-12-22T10:00:33.565881+0000","last_peered":"2023-12-22T10:00:33.565881+0000","last_clean":"2023-12-22T10:00:33.565881+0000","last_became_active":"2023-12-22T10:00:33.561991+0000","last_became_peered":"2023-12-22T10:00:33.561991+0000","last_unstale":"2023-12-22T10:00:33.565881+0000","last_undegraded":"2023-12-22T10:00:33.565881+0000","last_fullsized":"2023-12-22T10:00:33.565881+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.582362+0000","last_change":"2023-12-22T10:00:33.114894+0000","last_active":"2023-12-22T10:00:33.582362+0000","last_peered":"2023-12-22T10:00:33.582362+0000","last_clean":"2023-12-22T10:00:33.582362+0000","last_became_active":"2023-12-22T10:00:33.114560+0000","last_became_peered":"2023-12-22T10:00:33.114560+0000","last_unstale":"2023-12-22T10:00:33.582362+0000","last_undegraded":"2023-12-22T10:00:33.582362+0000","last_fullsized":"2023-12-22T10:00:33.582362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.567149+0000","last_change":"2023-12-22T10:00:33.559792+0000","last_active":"2023-12-22T10:00:33.567149+0000","last_peered":"2023-12-22T10:00:33.567149+0000","last_clean":"2023-12-22T10:00:33.567149+0000","last_became_active":"2023-12-22T10:00:33.559507+0000","last_became_peered":"2023-12-22T10:00:33.559507+0000","last_unstale":"2023-12-22T10:00:33.567149+0000","last_undegraded":"2023-12-22T10:00:33.567149+0000","last_fullsized":"2023-12-22T10:00:33.567149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.572960+0000","last_change":"2023-12-22T10:00:28.036372+0000","last_active":"2023-12-22T10:00:33.572960+0000","last_peered":"2023-12-22T10:00:33.572960+0000","last_clean":"2023-12-22T10:00:33.572960+0000","last_became_active":"2023-12-22T10:00:28.035974+0000","last_became_peered":"2023-12-22T10:00:28.035974+0000","last_unstale":"2023-12-22T10:00:33.572960+0000","last_undegraded":"2023-12-22T10:00:33.572960+0000","last_fullsized":"2023-12-22T10:00:33.572960+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_clean_scrub_stamp":"2023-12-22T10:00:27.001906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.537223+0000","last_change":"2023-12-22T10:00:33.105448+0000","last_active":"2023-12-22T10:00:33.537223+0000","last_peered":"2023-12-22T10:00:33.537223+0000","last_clean":"2023-12-22T10:00:33.537223+0000","last_became_active":"2023-12-22T10:00:33.105043+0000","last_became_peered":"2023-12-22T10:00:33.105043+0000","last_unstale":"2023-12-22T10:00:33.537223+0000","last_undegraded":"2023-12-22T10:00:33.537223+0000","last_fullsized":"2023-12-22T10:00:33.537223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.562442+0000","last_change":"2023-12-22T10:00:33.550578+0000","last_active":"2023-12-22T10:00:33.562442+0000","last_peered":"2023-12-22T10:00:33.562442+0000","last_clean":"2023-12-22T10:00:33.562442+0000","last_became_active":"2023-12-22T10:00:33.550295+0000","last_became_peered":"2023-12-22T10:00:33.550295+0000","last_unstale":"2023-12-22T10:00:33.562442+0000","last_undegraded":"2023-12-22T10:00:33.562442+0000","last_fullsized":"2023-12-22T10:00:33.562442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.537334+0000","last_change":"2023-12-22T10:00:28.035308+0000","last_active":"2023-12-22T10:00:33.537334+0000","last_peered":"2023-12-22T10:00:33.537334+0000","last_clean":"2023-12-22T10:00:33.537334+0000","last_became_active":"2023-12-22T10:00:28.035002+0000","last_became_peered":"2023-12-22T10:00:28.035002+0000","last_unstale":"2023-12-22T10:00:33.537334+0000","last_undegraded":"2023-12-22T10:00:33.537334+0000","last_fullsized":"2023-12-22T10:00:33.537334+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_clean_scrub_stamp":"2023-12-22T10:00:27.001906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.566358+0000","last_change":"2023-12-22T10:00:33.111116+0000","last_active":"2023-12-22T10:00:33.566358+0000","last_peered":"2023-12-22T10:00:33.566358+0000","last_clean":"2023-12-22T10:00:33.566358+0000","last_became_active":"2023-12-22T10:00:33.110624+0000","last_became_peered":"2023-12-22T10:00:33.110624+0000","last_unstale":"2023-12-22T10:00:33.566358+0000","last_undegraded":"2023-12-22T10:00:33.566358+0000","last_fullsized":"2023-12-22T10:00:33.566358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.548423+0000","last_change":"2023-12-22T10:00:33.544541+0000","last_active":"2023-12-22T10:00:33.548423+0000","last_peered":"2023-12-22T10:00:33.548423+0000","last_clean":"2023-12-22T10:00:33.548423+0000","last_became_active":"2023-12-22T10:00:33.544231+0000","last_became_peered":"2023-12-22T10:00:33.544231+0000","last_unstale":"2023-12-22T10:00:33.548423+0000","last_undegraded":"2023-12-22T10:00:33.548423+0000","last_fullsized":"2023-12-22T10:00:33.548423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.576647+0000","last_change":"2023-12-22T10:00:28.029892+0000","last_active":"2023-12-22T10:00:33.576647+0000","last_peered":"2023-12-22T10:00:33.576647+0000","last_clean":"2023-12-22T10:00:33.576647+0000","last_became_active":"2023-12-22T10:00:28.029391+0000","last_became_peered":"2023-12-22T10:00:28.029391+0000","last_unstale":"2023-12-22T10:00:33.576647+0000","last_undegraded":"2023-12-22T10:00:33.576647+0000","last_fullsized":"2023-12-22T10:00:33.576647+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_clean_scrub_stamp":"2023-12-22T10:00:27.001906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.553697+0000","last_change":"2023-12-22T10:00:33.110693+0000","last_active":"2023-12-22T10:00:33.553697+0000","last_peered":"2023-12-22T10:00:33.553697+0000","last_clean":"2023-12-22T10:00:33.553697+0000","last_became_active":"2023-12-22T10:00:33.110229+0000","last_became_peered":"2023-12-22T10:00:33.110229+0000","last_unstale":"2023-12-22T10:00:33.553697+0000","last_undegraded":"2023-12-22T10:00:33.553697+0000","last_fullsized":"2023-12-22T10:00:33.553697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.563709+0000","last_change":"2023-12-22T10:00:33.561493+0000","last_active":"2023-12-22T10:00:33.563709+0000","last_peered":"2023-12-22T10:00:33.563709+0000","last_clean":"2023-12-22T10:00:33.563709+0000","last_became_active":"2023-12-22T10:00:33.561177+0000","last_became_peered":"2023-12-22T10:00:33.561177+0000","last_unstale":"2023-12-22T10:00:33.563709+0000","last_undegraded":"2023-12-22T10:00:33.563709+0000","last_fullsized":"2023-12-22T10:00:33.563709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.562802+0000","last_change":"2023-12-22T10:00:28.025395+0000","last_active":"2023-12-22T10:00:33.562802+0000","last_peered":"2023-12-22T10:00:33.562802+0000","last_clean":"2023-12-22T10:00:33.562802+0000","last_became_active":"2023-12-22T10:00:28.024588+0000","last_became_peered":"2023-12-22T10:00:28.024588+0000","last_unstale":"2023-12-22T10:00:33.562802+0000","last_undegraded":"2023-12-22T10:00:33.562802+0000","last_fullsized":"2023-12-22T10:00:33.562802+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_clean_scrub_stamp":"2023-12-22T10:00:27.001906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.537968+0000","last_change":"2023-12-22T10:00:33.116031+0000","last_active":"2023-12-22T10:00:33.537968+0000","last_peered":"2023-12-22T10:00:33.537968+0000","last_clean":"2023-12-22T10:00:33.537968+0000","last_became_active":"2023-12-22T10:00:33.115730+0000","last_became_peered":"2023-12-22T10:00:33.115730+0000","last_unstale":"2023-12-22T10:00:33.537968+0000","last_undegraded":"2023-12-22T10:00:33.537968+0000","last_fullsized":"2023-12-22T10:00:33.537968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.563609+0000","last_change":"2023-12-22T10:00:33.558628+0000","last_active":"2023-12-22T10:00:33.563609+0000","last_peered":"2023-12-22T10:00:33.563609+0000","last_clean":"2023-12-22T10:00:33.563609+0000","last_became_active":"2023-12-22T10:00:33.558312+0000","last_became_peered":"2023-12-22T10:00:33.558312+0000","last_unstale":"2023-12-22T10:00:33.563609+0000","last_undegraded":"2023-12-22T10:00:33.563609+0000","last_fullsized":"2023-12-22T10:00:33.563609+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.552943+0000","last_change":"2023-12-22T10:00:33.124426+0000","last_active":"2023-12-22T10:00:33.552943+0000","last_peered":"2023-12-22T10:00:33.552943+0000","last_clean":"2023-12-22T10:00:33.552943+0000","last_became_active":"2023-12-22T10:00:33.119964+0000","last_became_peered":"2023-12-22T10:00:33.119964+0000","last_unstale":"2023-12-22T10:00:33.552943+0000","last_undegraded":"2023-12-22T10:00:33.552943+0000","last_fullsized":"2023-12-22T10:00:33.552943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.563791+0000","last_change":"2023-12-22T10:00:28.029884+0000","last_active":"2023-12-22T10:00:33.563791+0000","last_peered":"2023-12-22T10:00:33.563791+0000","last_clean":"2023-12-22T10:00:33.563791+0000","last_became_active":"2023-12-22T10:00:28.029422+0000","last_became_peered":"2023-12-22T10:00:28.029422+0000","last_unstale":"2023-12-22T10:00:33.563791+0000","last_undegraded":"2023-12-22T10:00:33.563791+0000","last_fullsized":"2023-12-22T10:00:33.563791+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_clean_scrub_stamp":"2023-12-22T10:00:27.001906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.555956+0000","last_change":"2023-12-22T10:00:33.547520+0000","last_active":"2023-12-22T10:00:33.555956+0000","last_peered":"2023-12-22T10:00:33.555956+0000","last_clean":"2023-12-22T10:00:33.555956+0000","last_became_active":"2023-12-22T10:00:33.546923+0000","last_became_peered":"2023-12-22T10:00:33.546923+0000","last_unstale":"2023-12-22T10:00:33.555956+0000","last_undegraded":"2023-12-22T10:00:33.555956+0000","last_fullsized":"2023-12-22T10:00:33.555956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.558060+0000","last_change":"2023-12-22T10:00:33.103518+0000","last_active":"2023-12-22T10:00:33.558060+0000","last_peered":"2023-12-22T10:00:33.558060+0000","last_clean":"2023-12-22T10:00:33.558060+0000","last_became_active":"2023-12-22T10:00:33.103133+0000","last_became_peered":"2023-12-22T10:00:33.103133+0000","last_unstale":"2023-12-22T10:00:33.558060+0000","last_undegraded":"2023-12-22T10:00:33.558060+0000","last_fullsized":"2023-12-22T10:00:33.558060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.533806+0000","last_change":"2023-12-22T10:00:28.028621+0000","last_active":"2023-12-22T10:00:33.533806+0000","last_peered":"2023-12-22T10:00:33.533806+0000","last_clean":"2023-12-22T10:00:33.533806+0000","last_became_active":"2023-12-22T10:00:28.028159+0000","last_became_peered":"2023-12-22T10:00:28.028159+0000","last_unstale":"2023-12-22T10:00:33.533806+0000","last_undegraded":"2023-12-22T10:00:33.533806+0000","last_fullsized":"2023-12-22T10:00:33.533806+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_clean_scrub_stamp":"2023-12-22T10:00:27.001906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.574590+0000","last_change":"2023-12-22T10:00:33.569946+0000","last_active":"2023-12-22T10:00:33.574590+0000","last_peered":"2023-12-22T10:00:33.574590+0000","last_clean":"2023-12-22T10:00:33.574590+0000","last_became_active":"2023-12-22T10:00:33.569709+0000","last_became_peered":"2023-12-22T10:00:33.569709+0000","last_unstale":"2023-12-22T10:00:33.574590+0000","last_undegraded":"2023-12-22T10:00:33.574590+0000","last_fullsized":"2023-12-22T10:00:33.574590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.552800+0000","last_change":"2023-12-22T10:00:33.102638+0000","last_active":"2023-12-22T10:00:33.552800+0000","last_peered":"2023-12-22T10:00:33.552800+0000","last_clean":"2023-12-22T10:00:33.552800+0000","last_became_active":"2023-12-22T10:00:33.101055+0000","last_became_peered":"2023-12-22T10:00:33.101055+0000","last_unstale":"2023-12-22T10:00:33.552800+0000","last_undegraded":"2023-12-22T10:00:33.552800+0000","last_fullsized":"2023-12-22T10:00:33.552800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.568523+0000","last_change":"2023-12-22T10:00:28.030883+0000","last_active":"2023-12-22T10:00:33.568523+0000","last_peered":"2023-12-22T10:00:33.568523+0000","last_clean":"2023-12-22T10:00:33.568523+0000","last_became_active":"2023-12-22T10:00:28.030284+0000","last_became_peered":"2023-12-22T10:00:28.030284+0000","last_unstale":"2023-12-22T10:00:33.568523+0000","last_undegraded":"2023-12-22T10:00:33.568523+0000","last_fullsized":"2023-12-22T10:00:33.568523+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_clean_scrub_stamp":"2023-12-22T10:00:27.001906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.572101+0000","last_change":"2023-12-22T10:00:33.568203+0000","last_active":"2023-12-22T10:00:33.572101+0000","last_peered":"2023-12-22T10:00:33.572101+0000","last_clean":"2023-12-22T10:00:33.572101+0000","last_became_active":"2023-12-22T10:00:33.567890+0000","last_became_peered":"2023-12-22T10:00:33.567890+0000","last_unstale":"2023-12-22T10:00:33.572101+0000","last_undegraded":"2023-12-22T10:00:33.572101+0000","last_fullsized":"2023-12-22T10:00:33.572101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.535729+0000","last_change":"2023-12-22T10:00:33.105537+0000","last_active":"2023-12-22T10:00:33.535729+0000","last_peered":"2023-12-22T10:00:33.535729+0000","last_clean":"2023-12-22T10:00:33.535729+0000","last_became_active":"2023-12-22T10:00:33.105202+0000","last_became_peered":"2023-12-22T10:00:33.105202+0000","last_unstale":"2023-12-22T10:00:33.535729+0000","last_undegraded":"2023-12-22T10:00:33.535729+0000","last_fullsized":"2023-12-22T10:00:33.535729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.568566+0000","last_change":"2023-12-22T10:00:28.031790+0000","last_active":"2023-12-22T10:00:33.568566+0000","last_peered":"2023-12-22T10:00:33.568566+0000","last_clean":"2023-12-22T10:00:33.568566+0000","last_became_active":"2023-12-22T10:00:28.031190+0000","last_became_peered":"2023-12-22T10:00:28.031190+0000","last_unstale":"2023-12-22T10:00:33.568566+0000","last_undegraded":"2023-12-22T10:00:33.568566+0000","last_fullsized":"2023-12-22T10:00:33.568566+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_clean_scrub_stamp":"2023-12-22T10:00:27.001906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.535875+0000","last_change":"2023-12-22T10:00:27.889031+0000","last_active":"2023-12-22T10:00:33.535875+0000","last_peered":"2023-12-22T10:00:33.535875+0000","last_clean":"2023-12-22T10:00:33.535875+0000","last_became_active":"2023-12-22T10:00:27.888164+0000","last_became_peered":"2023-12-22T10:00:27.888164+0000","last_unstale":"2023-12-22T10:00:33.535875+0000","last_undegraded":"2023-12-22T10:00:33.535875+0000","last_fullsized":"2023-12-22T10:00:33.535875+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:25.998963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:25.998963+0000","last_clean_scrub_stamp":"2023-12-22T10:00:25.998963+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.557856+0000","last_change":"2023-12-22T10:00:33.554263+0000","last_active":"2023-12-22T10:00:33.557856+0000","last_peered":"2023-12-22T10:00:33.557856+0000","last_clean":"2023-12-22T10:00:33.557856+0000","last_became_active":"2023-12-22T10:00:33.553794+0000","last_became_peered":"2023-12-22T10:00:33.553794+0000","last_unstale":"2023-12-22T10:00:33.557856+0000","last_undegraded":"2023-12-22T10:00:33.557856+0000","last_fullsized":"2023-12-22T10:00:33.557856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.535306+0000","last_change":"2023-12-22T10:00:33.096988+0000","last_active":"2023-12-22T10:00:33.535306+0000","last_peered":"2023-12-22T10:00:33.535306+0000","last_clean":"2023-12-22T10:00:33.535306+0000","last_became_active":"2023-12-22T10:00:33.096126+0000","last_became_peered":"2023-12-22T10:00:33.096126+0000","last_unstale":"2023-12-22T10:00:33.535306+0000","last_undegraded":"2023-12-22T10:00:33.535306+0000","last_fullsized":"2023-12-22T10:00:33.535306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.559082+0000","last_change":"2023-12-22T10:00:33.548870+0000","last_active":"2023-12-22T10:00:33.559082+0000","last_peered":"2023-12-22T10:00:33.559082+0000","last_clean":"2023-12-22T10:00:33.559082+0000","last_became_active":"2023-12-22T10:00:33.548315+0000","last_became_peered":"2023-12-22T10:00:33.548315+0000","last_unstale":"2023-12-22T10:00:33.559082+0000","last_undegraded":"2023-12-22T10:00:33.559082+0000","last_fullsized":"2023-12-22T10:00:33.559082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.563733+0000","last_change":"2023-12-22T10:00:33.105596+0000","last_active":"2023-12-22T10:00:33.563733+0000","last_peered":"2023-12-22T10:00:33.563733+0000","last_clean":"2023-12-22T10:00:33.563733+0000","last_became_active":"2023-12-22T10:00:33.105278+0000","last_became_peered":"2023-12-22T10:00:33.105278+0000","last_unstale":"2023-12-22T10:00:33.563733+0000","last_undegraded":"2023-12-22T10:00:33.563733+0000","last_fullsized":"2023-12-22T10:00:33.563733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.562468+0000","last_change":"2023-12-22T10:00:33.559066+0000","last_active":"2023-12-22T10:00:33.562468+0000","last_peered":"2023-12-22T10:00:33.562468+0000","last_clean":"2023-12-22T10:00:33.562468+0000","last_became_active":"2023-12-22T10:00:33.558181+0000","last_became_peered":"2023-12-22T10:00:33.558181+0000","last_unstale":"2023-12-22T10:00:33.562468+0000","last_undegraded":"2023-12-22T10:00:33.562468+0000","last_fullsized":"2023-12-22T10:00:33.562468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.563711+0000","last_change":"2023-12-22T10:00:33.127356+0000","last_active":"2023-12-22T10:00:33.563711+0000","last_peered":"2023-12-22T10:00:33.563711+0000","last_clean":"2023-12-22T10:00:33.563711+0000","last_became_active":"2023-12-22T10:00:33.127051+0000","last_became_peered":"2023-12-22T10:00:33.127051+0000","last_unstale":"2023-12-22T10:00:33.563711+0000","last_undegraded":"2023-12-22T10:00:33.563711+0000","last_fullsized":"2023-12-22T10:00:33.563711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.557876+0000","last_change":"2023-12-22T10:00:33.554458+0000","last_active":"2023-12-22T10:00:33.557876+0000","last_peered":"2023-12-22T10:00:33.557876+0000","last_clean":"2023-12-22T10:00:33.557876+0000","last_became_active":"2023-12-22T10:00:33.554135+0000","last_became_peered":"2023-12-22T10:00:33.554135+0000","last_unstale":"2023-12-22T10:00:33.557876+0000","last_undegraded":"2023-12-22T10:00:33.557876+0000","last_fullsized":"2023-12-22T10:00:33.557876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.553982+0000","last_change":"2023-12-22T10:00:33.111426+0000","last_active":"2023-12-22T10:00:33.553982+0000","last_peered":"2023-12-22T10:00:33.553982+0000","last_clean":"2023-12-22T10:00:33.553982+0000","last_became_active":"2023-12-22T10:00:33.111127+0000","last_became_peered":"2023-12-22T10:00:33.111127+0000","last_unstale":"2023-12-22T10:00:33.553982+0000","last_undegraded":"2023-12-22T10:00:33.553982+0000","last_fullsized":"2023-12-22T10:00:33.553982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.568351+0000","last_change":"2023-12-22T10:00:33.560716+0000","last_active":"2023-12-22T10:00:33.568351+0000","last_peered":"2023-12-22T10:00:33.568351+0000","last_clean":"2023-12-22T10:00:33.568351+0000","last_became_active":"2023-12-22T10:00:33.560383+0000","last_became_peered":"2023-12-22T10:00:33.560383+0000","last_unstale":"2023-12-22T10:00:33.568351+0000","last_undegraded":"2023-12-22T10:00:33.568351+0000","last_fullsized":"2023-12-22T10:00:33.568351+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.552544+0000","last_change":"2023-12-22T10:00:33.117407+0000","last_active":"2023-12-22T10:00:33.552544+0000","last_peered":"2023-12-22T10:00:33.552544+0000","last_clean":"2023-12-22T10:00:33.552544+0000","last_became_active":"2023-12-22T10:00:33.117026+0000","last_became_peered":"2023-12-22T10:00:33.117026+0000","last_unstale":"2023-12-22T10:00:33.552544+0000","last_undegraded":"2023-12-22T10:00:33.552544+0000","last_fullsized":"2023-12-22T10:00:33.552544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.570974+0000","last_change":"2023-12-22T10:00:33.563333+0000","last_active":"2023-12-22T10:00:33.570974+0000","last_peered":"2023-12-22T10:00:33.570974+0000","last_clean":"2023-12-22T10:00:33.570974+0000","last_became_active":"2023-12-22T10:00:33.560143+0000","last_became_peered":"2023-12-22T10:00:33.560143+0000","last_unstale":"2023-12-22T10:00:33.570974+0000","last_undegraded":"2023-12-22T10:00:33.570974+0000","last_fullsized":"2023-12-22T10:00:33.570974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.576416+0000","last_change":"2023-12-22T10:00:33.127841+0000","last_active":"2023-12-22T10:00:33.576416+0000","last_peered":"2023-12-22T10:00:33.576416+0000","last_clean":"2023-12-22T10:00:33.576416+0000","last_became_active":"2023-12-22T10:00:33.127188+0000","last_became_peered":"2023-12-22T10:00:33.127188+0000","last_unstale":"2023-12-22T10:00:33.576416+0000","last_undegraded":"2023-12-22T10:00:33.576416+0000","last_fullsized":"2023-12-22T10:00:33.576416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.570549+0000","last_change":"2023-12-22T10:00:33.569232+0000","last_active":"2023-12-22T10:00:33.570549+0000","last_peered":"2023-12-22T10:00:33.570549+0000","last_clean":"2023-12-22T10:00:33.570549+0000","last_became_active":"2023-12-22T10:00:33.568907+0000","last_became_peered":"2023-12-22T10:00:33.568907+0000","last_unstale":"2023-12-22T10:00:33.570549+0000","last_undegraded":"2023-12-22T10:00:33.570549+0000","last_fullsized":"2023-12-22T10:00:33.570549+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.574106+0000","last_change":"2023-12-22T10:00:33.120992+0000","last_active":"2023-12-22T10:00:33.574106+0000","last_peered":"2023-12-22T10:00:33.574106+0000","last_clean":"2023-12-22T10:00:33.574106+0000","last_became_active":"2023-12-22T10:00:33.120706+0000","last_became_peered":"2023-12-22T10:00:33.120706+0000","last_unstale":"2023-12-22T10:00:33.574106+0000","last_undegraded":"2023-12-22T10:00:33.574106+0000","last_fullsized":"2023-12-22T10:00:33.574106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.576244+0000","last_change":"2023-12-22T10:00:33.573000+0000","last_active":"2023-12-22T10:00:33.576244+0000","last_peered":"2023-12-22T10:00:33.576244+0000","last_clean":"2023-12-22T10:00:33.576244+0000","last_became_active":"2023-12-22T10:00:33.571916+0000","last_became_peered":"2023-12-22T10:00:33.571916+0000","last_unstale":"2023-12-22T10:00:33.576244+0000","last_undegraded":"2023-12-22T10:00:33.576244+0000","last_fullsized":"2023-12-22T10:00:33.576244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.582224+0000","last_change":"2023-12-22T10:00:33.125992+0000","last_active":"2023-12-22T10:00:33.582224+0000","last_peered":"2023-12-22T10:00:33.582224+0000","last_clean":"2023-12-22T10:00:33.582224+0000","last_became_active":"2023-12-22T10:00:33.125693+0000","last_became_peered":"2023-12-22T10:00:33.125693+0000","last_unstale":"2023-12-22T10:00:33.582224+0000","last_undegraded":"2023-12-22T10:00:33.582224+0000","last_fullsized":"2023-12-22T10:00:33.582224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.554932+0000","last_change":"2023-12-22T10:00:33.553361+0000","last_active":"2023-12-22T10:00:33.554932+0000","last_peered":"2023-12-22T10:00:33.554932+0000","last_clean":"2023-12-22T10:00:33.554932+0000","last_became_active":"2023-12-22T10:00:33.551429+0000","last_became_peered":"2023-12-22T10:00:33.551429+0000","last_unstale":"2023-12-22T10:00:33.554932+0000","last_undegraded":"2023-12-22T10:00:33.554932+0000","last_fullsized":"2023-12-22T10:00:33.554932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"20'4","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.579099+0000","last_change":"2023-12-22T10:00:33.120651+0000","last_active":"2023-12-22T10:00:33.579099+0000","last_peered":"2023-12-22T10:00:33.579099+0000","last_clean":"2023-12-22T10:00:33.579099+0000","last_became_active":"2023-12-22T10:00:33.110600+0000","last_became_peered":"2023-12-22T10:00:33.110600+0000","last_unstale":"2023-12-22T10:00:33.579099+0000","last_undegraded":"2023-12-22T10:00:33.579099+0000","last_fullsized":"2023-12-22T10:00:33.579099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.567975+0000","last_change":"2023-12-22T10:00:33.559374+0000","last_active":"2023-12-22T10:00:33.567975+0000","last_peered":"2023-12-22T10:00:33.567975+0000","last_clean":"2023-12-22T10:00:33.567975+0000","last_became_active":"2023-12-22T10:00:33.559066+0000","last_became_peered":"2023-12-22T10:00:33.559066+0000","last_unstale":"2023-12-22T10:00:33.567975+0000","last_undegraded":"2023-12-22T10:00:33.567975+0000","last_fullsized":"2023-12-22T10:00:33.567975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.563571+0000","last_change":"2023-12-22T10:00:33.114896+0000","last_active":"2023-12-22T10:00:33.563571+0000","last_peered":"2023-12-22T10:00:33.563571+0000","last_clean":"2023-12-22T10:00:33.563571+0000","last_became_active":"2023-12-22T10:00:33.114585+0000","last_became_peered":"2023-12-22T10:00:33.114585+0000","last_unstale":"2023-12-22T10:00:33.563571+0000","last_undegraded":"2023-12-22T10:00:33.563571+0000","last_fullsized":"2023-12-22T10:00:33.563571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.572121+0000","last_change":"2023-12-22T10:00:33.568325+0000","last_active":"2023-12-22T10:00:33.572121+0000","last_peered":"2023-12-22T10:00:33.572121+0000","last_clean":"2023-12-22T10:00:33.572121+0000","last_became_active":"2023-12-22T10:00:33.568026+0000","last_became_peered":"2023-12-22T10:00:33.568026+0000","last_unstale":"2023-12-22T10:00:33.572121+0000","last_undegraded":"2023-12-22T10:00:33.572121+0000","last_fullsized":"2023-12-22T10:00:33.572121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.553362+0000","last_change":"2023-12-22T10:00:33.108149+0000","last_active":"2023-12-22T10:00:33.553362+0000","last_peered":"2023-12-22T10:00:33.553362+0000","last_clean":"2023-12-22T10:00:33.553362+0000","last_became_active":"2023-12-22T10:00:33.107842+0000","last_became_peered":"2023-12-22T10:00:33.107842+0000","last_unstale":"2023-12-22T10:00:33.553362+0000","last_undegraded":"2023-12-22T10:00:33.553362+0000","last_fullsized":"2023-12-22T10:00:33.553362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.580131+0000","last_change":"2023-12-22T10:00:33.571557+0000","last_active":"2023-12-22T10:00:33.580131+0000","last_peered":"2023-12-22T10:00:33.580131+0000","last_clean":"2023-12-22T10:00:33.580131+0000","last_became_active":"2023-12-22T10:00:33.571220+0000","last_became_peered":"2023-12-22T10:00:33.571220+0000","last_unstale":"2023-12-22T10:00:33.580131+0000","last_undegraded":"2023-12-22T10:00:33.580131+0000","last_fullsized":"2023-12-22T10:00:33.580131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.582666+0000","last_change":"2023-12-22T10:00:33.129657+0000","last_active":"2023-12-22T10:00:33.582666+0000","last_peered":"2023-12-22T10:00:33.582666+0000","last_clean":"2023-12-22T10:00:33.582666+0000","last_became_active":"2023-12-22T10:00:33.129343+0000","last_became_peered":"2023-12-22T10:00:33.129343+0000","last_unstale":"2023-12-22T10:00:33.582666+0000","last_undegraded":"2023-12-22T10:00:33.582666+0000","last_fullsized":"2023-12-22T10:00:33.582666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.564447+0000","last_change":"2023-12-22T10:00:33.560227+0000","last_active":"2023-12-22T10:00:33.564447+0000","last_peered":"2023-12-22T10:00:33.564447+0000","last_clean":"2023-12-22T10:00:33.564447+0000","last_became_active":"2023-12-22T10:00:33.560005+0000","last_became_peered":"2023-12-22T10:00:33.560005+0000","last_unstale":"2023-12-22T10:00:33.564447+0000","last_undegraded":"2023-12-22T10:00:33.564447+0000","last_fullsized":"2023-12-22T10:00:33.564447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.548267+0000","last_change":"2023-12-22T10:00:33.096353+0000","last_active":"2023-12-22T10:00:33.548267+0000","last_peered":"2023-12-22T10:00:33.548267+0000","last_clean":"2023-12-22T10:00:33.548267+0000","last_became_active":"2023-12-22T10:00:33.095756+0000","last_became_peered":"2023-12-22T10:00:33.095756+0000","last_unstale":"2023-12-22T10:00:33.548267+0000","last_undegraded":"2023-12-22T10:00:33.548267+0000","last_fullsized":"2023-12-22T10:00:33.548267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.568251+0000","last_change":"2023-12-22T10:00:33.565765+0000","last_active":"2023-12-22T10:00:33.568251+0000","last_peered":"2023-12-22T10:00:33.568251+0000","last_clean":"2023-12-22T10:00:33.568251+0000","last_became_active":"2023-12-22T10:00:33.565480+0000","last_became_peered":"2023-12-22T10:00:33.565480+0000","last_unstale":"2023-12-22T10:00:33.568251+0000","last_undegraded":"2023-12-22T10:00:33.568251+0000","last_fullsized":"2023-12-22T10:00:33.568251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.33","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.570467+0000","last_change":"2023-12-22T10:00:33.126475+0000","last_active":"2023-12-22T10:00:33.570467+0000","last_peered":"2023-12-22T10:00:33.570467+0000","last_clean":"2023-12-22T10:00:33.570467+0000","last_became_active":"2023-12-22T10:00:33.126160+0000","last_became_peered":"2023-12-22T10:00:33.126160+0000","last_unstale":"2023-12-22T10:00:33.570467+0000","last_undegraded":"2023-12-22T10:00:33.570467+0000","last_fullsized":"2023-12-22T10:00:33.570467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.575581+0000","last_change":"2023-12-22T10:00:33.573494+0000","last_active":"2023-12-22T10:00:33.575581+0000","last_peered":"2023-12-22T10:00:33.575581+0000","last_clean":"2023-12-22T10:00:33.575581+0000","last_became_active":"2023-12-22T10:00:33.573179+0000","last_became_peered":"2023-12-22T10:00:33.573179+0000","last_unstale":"2023-12-22T10:00:33.575581+0000","last_undegraded":"2023-12-22T10:00:33.575581+0000","last_fullsized":"2023-12-22T10:00:33.575581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.34","version":"20'4","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.584940+0000","last_change":"2023-12-22T10:00:33.125144+0000","last_active":"2023-12-22T10:00:33.584940+0000","last_peered":"2023-12-22T10:00:33.584940+0000","last_clean":"2023-12-22T10:00:33.584940+0000","last_became_active":"2023-12-22T10:00:33.124721+0000","last_became_peered":"2023-12-22T10:00:33.124721+0000","last_unstale":"2023-12-22T10:00:33.584940+0000","last_undegraded":"2023-12-22T10:00:33.584940+0000","last_fullsized":"2023-12-22T10:00:33.584940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.574522+0000","last_change":"2023-12-22T10:00:33.569457+0000","last_active":"2023-12-22T10:00:33.574522+0000","last_peered":"2023-12-22T10:00:33.574522+0000","last_clean":"2023-12-22T10:00:33.574522+0000","last_became_active":"2023-12-22T10:00:33.569137+0000","last_became_peered":"2023-12-22T10:00:33.569137+0000","last_unstale":"2023-12-22T10:00:33.574522+0000","last_undegraded":"2023-12-22T10:00:33.574522+0000","last_fullsized":"2023-12-22T10:00:33.574522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.555657+0000","last_change":"2023-12-22T10:00:33.115688+0000","last_active":"2023-12-22T10:00:33.555657+0000","last_peered":"2023-12-22T10:00:33.555657+0000","last_clean":"2023-12-22T10:00:33.555657+0000","last_became_active":"2023-12-22T10:00:33.115458+0000","last_became_peered":"2023-12-22T10:00:33.115458+0000","last_unstale":"2023-12-22T10:00:33.555657+0000","last_undegraded":"2023-12-22T10:00:33.555657+0000","last_fullsized":"2023-12-22T10:00:33.555657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.575066+0000","last_change":"2023-12-22T10:00:33.572218+0000","last_active":"2023-12-22T10:00:33.575066+0000","last_peered":"2023-12-22T10:00:33.575066+0000","last_clean":"2023-12-22T10:00:33.575066+0000","last_became_active":"2023-12-22T10:00:33.571923+0000","last_became_peered":"2023-12-22T10:00:33.571923+0000","last_unstale":"2023-12-22T10:00:33.575066+0000","last_undegraded":"2023-12-22T10:00:33.575066+0000","last_fullsized":"2023-12-22T10:00:33.575066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.552045+0000","last_change":"2023-12-22T10:00:33.122533+0000","last_active":"2023-12-22T10:00:33.552045+0000","last_peered":"2023-12-22T10:00:33.552045+0000","last_clean":"2023-12-22T10:00:33.552045+0000","last_became_active":"2023-12-22T10:00:33.122204+0000","last_became_peered":"2023-12-22T10:00:33.122204+0000","last_unstale":"2023-12-22T10:00:33.552045+0000","last_undegraded":"2023-12-22T10:00:33.552045+0000","last_fullsized":"2023-12-22T10:00:33.552045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.560067+0000","last_change":"2023-12-22T10:00:33.550771+0000","last_active":"2023-12-22T10:00:33.560067+0000","last_peered":"2023-12-22T10:00:33.560067+0000","last_clean":"2023-12-22T10:00:33.560067+0000","last_became_active":"2023-12-22T10:00:33.550449+0000","last_became_peered":"2023-12-22T10:00:33.550449+0000","last_unstale":"2023-12-22T10:00:33.560067+0000","last_undegraded":"2023-12-22T10:00:33.560067+0000","last_fullsized":"2023-12-22T10:00:33.560067+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.536396+0000","last_change":"2023-12-22T10:00:33.122914+0000","last_active":"2023-12-22T10:00:33.536396+0000","last_peered":"2023-12-22T10:00:33.536396+0000","last_clean":"2023-12-22T10:00:33.536396+0000","last_became_active":"2023-12-22T10:00:33.122636+0000","last_became_peered":"2023-12-22T10:00:33.122636+0000","last_unstale":"2023-12-22T10:00:33.536396+0000","last_undegraded":"2023-12-22T10:00:33.536396+0000","last_fullsized":"2023-12-22T10:00:33.536396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.571565+0000","last_change":"2023-12-22T10:00:33.562037+0000","last_active":"2023-12-22T10:00:33.571565+0000","last_peered":"2023-12-22T10:00:33.571565+0000","last_clean":"2023-12-22T10:00:33.571565+0000","last_became_active":"2023-12-22T10:00:33.561795+0000","last_became_peered":"2023-12-22T10:00:33.561795+0000","last_unstale":"2023-12-22T10:00:33.571565+0000","last_undegraded":"2023-12-22T10:00:33.571565+0000","last_fullsized":"2023-12-22T10:00:33.571565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.572601+0000","last_change":"2023-12-22T10:00:33.568975+0000","last_active":"2023-12-22T10:00:33.572601+0000","last_peered":"2023-12-22T10:00:33.572601+0000","last_clean":"2023-12-22T10:00:33.572601+0000","last_became_active":"2023-12-22T10:00:33.568710+0000","last_became_peered":"2023-12-22T10:00:33.568710+0000","last_unstale":"2023-12-22T10:00:33.572601+0000","last_undegraded":"2023-12-22T10:00:33.572601+0000","last_fullsized":"2023-12-22T10:00:33.572601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.557960+0000","last_change":"2023-12-22T10:00:33.106798+0000","last_active":"2023-12-22T10:00:33.557960+0000","last_peered":"2023-12-22T10:00:33.557960+0000","last_clean":"2023-12-22T10:00:33.557960+0000","last_became_active":"2023-12-22T10:00:33.106444+0000","last_became_peered":"2023-12-22T10:00:33.106444+0000","last_unstale":"2023-12-22T10:00:33.557960+0000","last_undegraded":"2023-12-22T10:00:33.557960+0000","last_fullsized":"2023-12-22T10:00:33.557960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.562492+0000","last_change":"2023-12-22T10:00:33.559266+0000","last_active":"2023-12-22T10:00:33.562492+0000","last_peered":"2023-12-22T10:00:33.562492+0000","last_clean":"2023-12-22T10:00:33.562492+0000","last_became_active":"2023-12-22T10:00:33.558860+0000","last_became_peered":"2023-12-22T10:00:33.558860+0000","last_unstale":"2023-12-22T10:00:33.562492+0000","last_undegraded":"2023-12-22T10:00:33.562492+0000","last_fullsized":"2023-12-22T10:00:33.562492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.550181+0000","last_change":"2023-12-22T10:00:33.111950+0000","last_active":"2023-12-22T10:00:33.550181+0000","last_peered":"2023-12-22T10:00:33.550181+0000","last_clean":"2023-12-22T10:00:33.550181+0000","last_became_active":"2023-12-22T10:00:33.111519+0000","last_became_peered":"2023-12-22T10:00:33.111519+0000","last_unstale":"2023-12-22T10:00:33.550181+0000","last_undegraded":"2023-12-22T10:00:33.550181+0000","last_fullsized":"2023-12-22T10:00:33.550181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.581939+0000","last_change":"2023-12-22T10:00:33.579310+0000","last_active":"2023-12-22T10:00:33.581939+0000","last_peered":"2023-12-22T10:00:33.581939+0000","last_clean":"2023-12-22T10:00:33.581939+0000","last_became_active":"2023-12-22T10:00:33.574714+0000","last_became_peered":"2023-12-22T10:00:33.574714+0000","last_unstale":"2023-12-22T10:00:33.581939+0000","last_undegraded":"2023-12-22T10:00:33.581939+0000","last_fullsized":"2023-12-22T10:00:33.581939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.562352+0000","last_change":"2023-12-22T10:00:33.104906+0000","last_active":"2023-12-22T10:00:33.562352+0000","last_peered":"2023-12-22T10:00:33.562352+0000","last_clean":"2023-12-22T10:00:33.562352+0000","last_became_active":"2023-12-22T10:00:33.104018+0000","last_became_peered":"2023-12-22T10:00:33.104018+0000","last_unstale":"2023-12-22T10:00:33.562352+0000","last_undegraded":"2023-12-22T10:00:33.562352+0000","last_fullsized":"2023-12-22T10:00:33.562352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.559924+0000","last_change":"2023-12-22T10:00:33.546434+0000","last_active":"2023-12-22T10:00:33.559924+0000","last_peered":"2023-12-22T10:00:33.559924+0000","last_clean":"2023-12-22T10:00:33.559924+0000","last_became_active":"2023-12-22T10:00:33.546119+0000","last_became_peered":"2023-12-22T10:00:33.546119+0000","last_unstale":"2023-12-22T10:00:33.559924+0000","last_undegraded":"2023-12-22T10:00:33.559924+0000","last_fullsized":"2023-12-22T10:00:33.559924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.580716+0000","last_change":"2023-12-22T10:00:33.124220+0000","last_active":"2023-12-22T10:00:33.580716+0000","last_peered":"2023-12-22T10:00:33.580716+0000","last_clean":"2023-12-22T10:00:33.580716+0000","last_became_active":"2023-12-22T10:00:33.119951+0000","last_became_peered":"2023-12-22T10:00:33.119951+0000","last_unstale":"2023-12-22T10:00:33.580716+0000","last_undegraded":"2023-12-22T10:00:33.580716+0000","last_fullsized":"2023-12-22T10:00:33.580716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.560601+0000","last_change":"2023-12-22T10:00:33.556065+0000","last_active":"2023-12-22T10:00:33.560601+0000","last_peered":"2023-12-22T10:00:33.560601+0000","last_clean":"2023-12-22T10:00:33.560601+0000","last_became_active":"2023-12-22T10:00:33.555696+0000","last_became_peered":"2023-12-22T10:00:33.555696+0000","last_unstale":"2023-12-22T10:00:33.560601+0000","last_undegraded":"2023-12-22T10:00:33.560601+0000","last_fullsized":"2023-12-22T10:00:33.560601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.562529+0000","last_change":"2023-12-22T10:00:33.103404+0000","last_active":"2023-12-22T10:00:33.562529+0000","last_peered":"2023-12-22T10:00:33.562529+0000","last_clean":"2023-12-22T10:00:33.562529+0000","last_became_active":"2023-12-22T10:00:33.103130+0000","last_became_peered":"2023-12-22T10:00:33.103130+0000","last_unstale":"2023-12-22T10:00:33.562529+0000","last_undegraded":"2023-12-22T10:00:33.562529+0000","last_fullsized":"2023-12-22T10:00:33.562529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.579183+0000","last_change":"2023-12-22T10:00:33.569585+0000","last_active":"2023-12-22T10:00:33.579183+0000","last_peered":"2023-12-22T10:00:33.579183+0000","last_clean":"2023-12-22T10:00:33.579183+0000","last_became_active":"2023-12-22T10:00:33.569304+0000","last_became_peered":"2023-12-22T10:00:33.569304+0000","last_unstale":"2023-12-22T10:00:33.579183+0000","last_undegraded":"2023-12-22T10:00:33.579183+0000","last_fullsized":"2023-12-22T10:00:33.579183+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.562974+0000","last_change":"2023-12-22T10:00:33.113160+0000","last_active":"2023-12-22T10:00:33.562974+0000","last_peered":"2023-12-22T10:00:33.562974+0000","last_clean":"2023-12-22T10:00:33.562974+0000","last_became_active":"2023-12-22T10:00:33.112458+0000","last_became_peered":"2023-12-22T10:00:33.112458+0000","last_unstale":"2023-12-22T10:00:33.562974+0000","last_undegraded":"2023-12-22T10:00:33.562974+0000","last_fullsized":"2023-12-22T10:00:33.562974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.580304+0000","last_change":"2023-12-22T10:00:33.574165+0000","last_active":"2023-12-22T10:00:33.580304+0000","last_peered":"2023-12-22T10:00:33.580304+0000","last_clean":"2023-12-22T10:00:33.580304+0000","last_became_active":"2023-12-22T10:00:33.570912+0000","last_became_peered":"2023-12-22T10:00:33.570912+0000","last_unstale":"2023-12-22T10:00:33.580304+0000","last_undegraded":"2023-12-22T10:00:33.580304+0000","last_fullsized":"2023-12-22T10:00:33.580304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.567643+0000","last_change":"2023-12-22T10:00:33.114540+0000","last_active":"2023-12-22T10:00:33.567643+0000","last_peered":"2023-12-22T10:00:33.567643+0000","last_clean":"2023-12-22T10:00:33.567643+0000","last_became_active":"2023-12-22T10:00:33.113955+0000","last_became_peered":"2023-12-22T10:00:33.113955+0000","last_unstale":"2023-12-22T10:00:33.567643+0000","last_undegraded":"2023-12-22T10:00:33.567643+0000","last_fullsized":"2023-12-22T10:00:33.567643+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.544500+0000","last_change":"2023-12-22T10:00:33.540584+0000","last_active":"2023-12-22T10:00:33.544500+0000","last_peered":"2023-12-22T10:00:33.544500+0000","last_clean":"2023-12-22T10:00:33.544500+0000","last_became_active":"2023-12-22T10:00:33.540281+0000","last_became_peered":"2023-12-22T10:00:33.540281+0000","last_unstale":"2023-12-22T10:00:33.544500+0000","last_undegraded":"2023-12-22T10:00:33.544500+0000","last_fullsized":"2023-12-22T10:00:33.544500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"20'3","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.581658+0000","last_change":"2023-12-22T10:00:33.113110+0000","last_active":"2023-12-22T10:00:33.581658+0000","last_peered":"2023-12-22T10:00:33.581658+0000","last_clean":"2023-12-22T10:00:33.581658+0000","last_became_active":"2023-12-22T10:00:33.112754+0000","last_became_peered":"2023-12-22T10:00:33.112754+0000","last_unstale":"2023-12-22T10:00:33.581658+0000","last_undegraded":"2023-12-22T10:00:33.581658+0000","last_fullsized":"2023-12-22T10:00:33.581658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297308,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074532,"statfs":{"total":96636764160,"available":96332320768,"internally_reserved":0,"allocated":217088,"data_stored":80225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.087}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.141}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.51}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.252}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2869999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.452}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8839999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297312,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074528,"statfs":{"total":96636764160,"available":96332316672,"internally_reserved":0,"allocated":221184,"data_stored":80315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92700000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297308,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074532,"statfs":{"total":96636764160,"available":96332320768,"internally_reserved":0,"allocated":217088,"data_stored":80225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.038}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.256}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3540000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.381}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4890000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297312,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074528,"statfs":{"total":96636764160,"available":96332316672,"internally_reserved":0,"allocated":221184,"data_stored":80295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5309999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.256}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0660000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.111}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6259999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.351}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5760000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297328,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074512,"statfs":{"total":96636764160,"available":96332300288,"internally_reserved":0,"allocated":237568,"data_stored":81527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1080000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.405}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.054}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2989999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5720000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6160000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1389999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297316,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074524,"statfs":{"total":96636764160,"available":96332312576,"internally_reserved":0,"allocated":225280,"data_stored":80869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82999999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.246}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.381}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.446}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.472}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297316,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074524,"statfs":{"total":96636764160,"available":96332312576,"internally_reserved":0,"allocated":225280,"data_stored":81139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3320000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5840000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4059999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297328,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074512,"statfs":{"total":96636764160,"available":96332300288,"internally_reserved":0,"allocated":237568,"data_stored":81817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0189999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.264}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95299999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.079}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.502}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3640000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.391}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-22T10:00:38.262 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-22T10:00:38.263 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-12-22T10:00:38.263 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-12-22T10:00:38.263 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-12-22T10:00:38.264 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-12-22T10:00:38.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.474+0000 7f22889a9700 1 Processor -- start 2023-12-22T10:00:38.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.474+0000 7f22889a9700 1 -- start start 2023-12-22T10:00:38.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.478+0000 7f22889a9700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f22840c5900 0x7f22841580d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:38.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.478+0000 7f22889a9700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22840c9720 con 0x7f22840ac5c0 2023-12-22T10:00:38.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.478+0000 7f22889a9700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2284153ec0 con 0x7f22840c7430 2023-12-22T10:00:38.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.478+0000 7f22889a9700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22841585c0 con 0x7f22840c5900 2023-12-22T10:00:38.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.478+0000 7f228259c700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f22840ac5c0 0x7f22840aa660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59102/0 (socket says 172.21.15.45:59102) 2023-12-22T10:00:38.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.478+0000 7f228259c700 1 -- 172.21.15.45:0/2933061835 learned_addr learned my addr 172.21.15.45:0/2933061835 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:00:38.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.478+0000 7f2281d9b700 1 --2- 172.21.15.45:0/2933061835 >> v2:172.21.15.45:3300/0 conn(0x7f22840c5900 0x7f22841580d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:38.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.478+0000 7f2281d9b700 1 -- 172.21.15.45:0/2933061835 >> v1:172.21.15.113:6789/0 conn(0x7f22840c7430 legacy=0x7f22840c9bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:38.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.478+0000 7f2281d9b700 1 -- 172.21.15.45:0/2933061835 >> v1:172.21.15.45:6789/0 conn(0x7f22840ac5c0 legacy=0x7f22840aa660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:38.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.478+0000 7f2281d9b700 1 -- 172.21.15.45:0/2933061835 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22840c5d60 con 0x7f22840c5900 2023-12-22T10:00:38.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.478+0000 7f2281d9b700 1 --2- 172.21.15.45:0/2933061835 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22840c5900 0x7f22841580d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f2278009760 tx=0x7f2278009060).ready entity=mon.0 client_cookie=e33a3f2dfd2e8883 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:38.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.478+0000 7f228159a700 1 -- 172.21.15.45:0/2933061835 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f227800b610 con 0x7f22840c5900 2023-12-22T10:00:38.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.478+0000 7f228159a700 1 -- 172.21.15.45:0/2933061835 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f227800b770 con 0x7f22840c5900 2023-12-22T10:00:38.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.478+0000 7f228159a700 1 -- 172.21.15.45:0/2933061835 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f227800baf0 con 0x7f22840c5900 2023-12-22T10:00:38.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.478+0000 7f22889a9700 1 -- 172.21.15.45:0/2933061835 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22840c5900 msgr2=0x7f22841580d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:38.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.478+0000 7f22889a9700 1 --2- 172.21.15.45:0/2933061835 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22840c5900 0x7f22841580d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f2278009760 tx=0x7f2278009060).stop 2023-12-22T10:00:38.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.482+0000 7f22889a9700 1 -- 172.21.15.45:0/2933061835 shutdown_connections 2023-12-22T10:00:38.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.482+0000 7f22889a9700 1 --2- 172.21.15.45:0/2933061835 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22840c5900 0x7f22841580d0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:38.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.482+0000 7f22889a9700 1 -- 172.21.15.45:0/2933061835 >> 172.21.15.45:0/2933061835 conn(0x7f2284082a30 msgr2=0x7f2284066a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:38.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.482+0000 7f22889a9700 1 -- 172.21.15.45:0/2933061835 shutdown_connections 2023-12-22T10:00:38.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.482+0000 7f22889a9700 1 -- 172.21.15.45:0/2933061835 wait complete. 2023-12-22T10:00:38.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.482+0000 7f22889a9700 1 Processor -- start 2023-12-22T10:00:38.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.482+0000 7f22889a9700 1 -- start start 2023-12-22T10:00:38.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.482+0000 7f22889a9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22840ac5c0 0x7f22840c1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:38.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.482+0000 7f22889a9700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f22840c5900 0x7f22841672d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:38.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.482+0000 7f22889a9700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f22840c7430 0x7f2284165590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:38.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.482+0000 7f22889a9700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22841677c0 con 0x7f22840ac5c0 2023-12-22T10:00:38.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.482+0000 7f22889a9700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2284165a80 con 0x7f22840c7430 2023-12-22T10:00:38.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.482+0000 7f22889a9700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22840c3820 con 0x7f22840c5900 2023-12-22T10:00:38.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.482+0000 7f228259c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22840ac5c0 0x7f22840c1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:38.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.482+0000 7f228259c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22840ac5c0 0x7f22840c1ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48152/0 (socket says 172.21.15.45:48152) 2023-12-22T10:00:38.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.482+0000 7f228259c700 1 -- 172.21.15.45:0/3433420184 learned_addr learned my addr 172.21.15.45:0/3433420184 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:38.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.482+0000 7f2281d9b700 1 --2- 172.21.15.45:0/3433420184 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f22840c5900 0x7f22841672d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:38.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.482+0000 7f2282d9d700 1 --2- 172.21.15.45:0/3433420184 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f22840c7430 0x7f2284165590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:38.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.486+0000 7f228259c700 1 -- 172.21.15.45:0/3433420184 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f22840c5900 msgr2=0x7f22841672d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:38.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.486+0000 7f228259c700 1 --2- 172.21.15.45:0/3433420184 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f22840c5900 0x7f22841672d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:38.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.486+0000 7f228259c700 1 -- 172.21.15.45:0/3433420184 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f22840c7430 msgr2=0x7f2284165590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:38.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.486+0000 7f228259c700 1 --2- 172.21.15.45:0/3433420184 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f22840c7430 0x7f2284165590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:38.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.486+0000 7f228259c700 1 -- 172.21.15.45:0/3433420184 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22780092a0 con 0x7f22840ac5c0 2023-12-22T10:00:38.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.486+0000 7f2282d9d700 1 --2- 172.21.15.45:0/3433420184 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f22840c7430 0x7f2284165590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T10:00:38.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.486+0000 7f2281d9b700 1 --2- 172.21.15.45:0/3433420184 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f22840c5900 0x7f22841672d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T10:00:38.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.486+0000 7f228259c700 1 --2- 172.21.15.45:0/3433420184 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22840ac5c0 0x7f22840c1ae0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f2274007fd0 tx=0x7f2274007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:38.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.486+0000 7f22727fc700 1 -- 172.21.15.45:0/3433420184 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22740072e0 con 0x7f22840ac5c0 2023-12-22T10:00:38.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.486+0000 7f22727fc700 1 -- 172.21.15.45:0/3433420184 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2274007440 con 0x7f22840ac5c0 2023-12-22T10:00:38.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.486+0000 7f22889a9700 1 -- 172.21.15.45:0/3433420184 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22840c2080 con 0x7f22840ac5c0 2023-12-22T10:00:38.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.486+0000 7f22727fc700 1 -- 172.21.15.45:0/3433420184 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22740057a0 con 0x7f22840ac5c0 2023-12-22T10:00:38.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.486+0000 7f22889a9700 1 -- 172.21.15.45:0/3433420184 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22840c2640 con 0x7f22840ac5c0 2023-12-22T10:00:38.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.486+0000 7f22889a9700 1 -- 172.21.15.45:0/3433420184 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f228406c070 con 0x7f22840ac5c0 2023-12-22T10:00:38.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.490+0000 7f22727fc700 1 -- 172.21.15.45:0/3433420184 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f2274005b90 con 0x7f22840ac5c0 2023-12-22T10:00:38.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.490+0000 7f22727fc700 1 --2- 172.21.15.45:0/3433420184 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f226405a560 0x7f226405ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:38.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.490+0000 7f22727fc700 1 -- 172.21.15.45:0/3433420184 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f22740740f0 con 0x7f22840ac5c0 2023-12-22T10:00:38.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.490+0000 7f2281d9b700 1 --2- 172.21.15.45:0/3433420184 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f226405a560 0x7f226405ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:38.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.490+0000 7f2281d9b700 1 --2- 172.21.15.45:0/3433420184 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f226405a560 0x7f226405ca20 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f22840c0b80 tx=0x7f2278017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:38.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.498+0000 7f22727fc700 1 -- 172.21.15.45:0/3433420184 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f2274047890 con 0x7f22840ac5c0 2023-12-22T10:00:38.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.706+0000 7f22889a9700 1 -- 172.21.15.45:0/3433420184 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f22840c5fc0 con 0x7f22840ac5c0 2023-12-22T10:00:38.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.714+0000 7f22727fc700 1 -- 172.21.15.45:0/3433420184 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v4) v1 ==== 74+0+142146 (secure 0 0 0) 0x7f227404aeb0 con 0x7f22840ac5c0 2023-12-22T10:00:38.712 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:00:38.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.718+0000 7f22889a9700 1 -- 172.21.15.45:0/3433420184 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f226405a560 msgr2=0x7f226405ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:38.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.718+0000 7f22889a9700 1 --2- 172.21.15.45:0/3433420184 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f226405a560 0x7f226405ca20 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f22840c0b80 tx=0x7f2278017000).stop 2023-12-22T10:00:38.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.718+0000 7f22889a9700 1 -- 172.21.15.45:0/3433420184 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22840ac5c0 msgr2=0x7f22840c1ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:38.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.718+0000 7f22889a9700 1 --2- 172.21.15.45:0/3433420184 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22840ac5c0 0x7f22840c1ae0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f2274007fd0 tx=0x7f2274007df0).stop 2023-12-22T10:00:38.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.718+0000 7f22889a9700 1 -- 172.21.15.45:0/3433420184 shutdown_connections 2023-12-22T10:00:38.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.718+0000 7f22889a9700 1 --2- 172.21.15.45:0/3433420184 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f22840c7430 0x7f2284165590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:38.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.718+0000 7f22889a9700 1 --2- 172.21.15.45:0/3433420184 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f226405a560 0x7f226405ca20 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:38.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.718+0000 7f22889a9700 1 --2- 172.21.15.45:0/3433420184 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f22840c5900 0x7f22841672d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:38.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.718+0000 7f22889a9700 1 --2- 172.21.15.45:0/3433420184 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22840ac5c0 0x7f22840c1ae0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:38.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.718+0000 7f22889a9700 1 -- 172.21.15.45:0/3433420184 >> 172.21.15.45:0/3433420184 conn(0x7f2284082a30 msgr2=0x7f2284066a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:38.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.718+0000 7f22889a9700 1 -- 172.21.15.45:0/3433420184 shutdown_connections 2023-12-22T10:00:38.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.718+0000 7f22889a9700 1 -- 172.21.15.45:0/3433420184 wait complete. 2023-12-22T10:00:38.738 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":4,"active_gid":4104,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":33679},{"type":"v1","addr":"172.21.15.45:6833","nonce":33679}]},"active_addr":"172.21.15.45:6833/33679","active_change":"2023-12-22T10:00:19.930749+0000","active_mgr_features":4540138314316775423,"available":true,"standbys":[{"gid":4100,"name":"x","mgr_features":4540138314316775423,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.45:0","nonce":3389215739}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.45:0","nonce":1276407369}]}]} 2023-12-22T10:00:38.743 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-12-22T10:00:38.743 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-12-22T10:00:38.743 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T10:00:38.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.902+0000 7f1a58ee4700 1 Processor -- start 2023-12-22T10:00:38.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.906+0000 7f1a58ee4700 1 -- start start 2023-12-22T10:00:38.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.906+0000 7f1a58ee4700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1a54151a20 0x7f1a54155750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:38.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.906+0000 7f1a58ee4700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1a54151e00 0x7f1a54155c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:38.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.910+0000 7f1a58ee4700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a54069270 con 0x7f1a540bbe10 2023-12-22T10:00:38.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.910+0000 7f1a58ee4700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a540bc660 con 0x7f1a54151e00 2023-12-22T10:00:38.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.910+0000 7f1a58ee4700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a54156130 con 0x7f1a54151a20 2023-12-22T10:00:38.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.910+0000 7f1a537fe700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1a54151a20 0x7f1a54155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:38.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.910+0000 7f1a537fe700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1a54151a20 0x7f1a54155750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.113:3301/0 says I am v2:172.21.15.45:35954/0 (socket says 172.21.15.45:35954) 2023-12-22T10:00:38.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.910+0000 7f1a537fe700 1 -- 172.21.15.45:0/1285720476 learned_addr learned my addr 172.21.15.45:0/1285720476 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:38.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.910+0000 7f1a52ffd700 1 --2- 172.21.15.45:0/1285720476 >> v2:172.21.15.113:3300/0 conn(0x7f1a54151e00 0x7f1a54155c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:38.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.910+0000 7f1a537fe700 1 -- 172.21.15.45:0/1285720476 >> v2:172.21.15.113:3300/0 conn(0x7f1a54151e00 msgr2=0x7f1a54155c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:00:38.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.910+0000 7f1a537fe700 1 --2- 172.21.15.45:0/1285720476 >> v2:172.21.15.113:3300/0 conn(0x7f1a54151e00 0x7f1a54155c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:38.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.910+0000 7f1a537fe700 1 -- 172.21.15.45:0/1285720476 >> v1:172.21.15.113:6789/0 conn(0x7f1a540bbe10 legacy=0x7f1a54069700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:00:38.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.910+0000 7f1a537fe700 1 -- 172.21.15.45:0/1285720476 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a540bc380 con 0x7f1a54151a20 2023-12-22T10:00:38.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.910+0000 7f1a537fe700 1 --2- 172.21.15.45:0/1285720476 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1a54151a20 0x7f1a54155750 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f1a44006fd0 tx=0x7f1a440090f0).ready entity=mon.2 client_cookie=5e6735b31a51c7d2 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:38.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.910+0000 7f1a527fc700 1 -- 172.21.15.45:0/1285720476 <== mon.2 v2:172.21.15.113:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a4400b690 con 0x7f1a54151a20 2023-12-22T10:00:38.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.910+0000 7f1a527fc700 1 -- 172.21.15.45:0/1285720476 <== mon.2 v2:172.21.15.113:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a4400b7f0 con 0x7f1a54151a20 2023-12-22T10:00:38.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.910+0000 7f1a527fc700 1 -- 172.21.15.45:0/1285720476 <== mon.2 v2:172.21.15.113:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a4400bb70 con 0x7f1a54151a20 2023-12-22T10:00:38.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.910+0000 7f1a58ee4700 1 -- 172.21.15.45:0/1285720476 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1a54151a20 msgr2=0x7f1a54155750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:38.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.910+0000 7f1a58ee4700 1 --2- 172.21.15.45:0/1285720476 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1a54151a20 0x7f1a54155750 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f1a44006fd0 tx=0x7f1a440090f0).stop 2023-12-22T10:00:38.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.914+0000 7f1a58ee4700 1 -- 172.21.15.45:0/1285720476 shutdown_connections 2023-12-22T10:00:38.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.914+0000 7f1a58ee4700 1 --2- 172.21.15.45:0/1285720476 >> v2:172.21.15.113:3300/0 conn(0x7f1a54151e00 0x7f1a54155c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:38.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.914+0000 7f1a58ee4700 1 --2- 172.21.15.45:0/1285720476 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1a54151a20 0x7f1a54155750 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:38.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.914+0000 7f1a58ee4700 1 -- 172.21.15.45:0/1285720476 >> 172.21.15.45:0/1285720476 conn(0x7f1a54067540 msgr2=0x7f1a540c6460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:38.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.914+0000 7f1a58ee4700 1 -- 172.21.15.45:0/1285720476 shutdown_connections 2023-12-22T10:00:38.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.914+0000 7f1a58ee4700 1 -- 172.21.15.45:0/1285720476 wait complete. 2023-12-22T10:00:38.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.914+0000 7f1a58ee4700 1 Processor -- start 2023-12-22T10:00:38.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.914+0000 7f1a58ee4700 1 -- start start 2023-12-22T10:00:38.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.918+0000 7f1a58ee4700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1a540bbe10 0x7f1a5414c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:38.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.918+0000 7f1a58ee4700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1a54151a20 0x7f1a54154c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:38.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.918+0000 7f1a58ee4700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a54151e00 0x7f1a540bfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:38.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.918+0000 7f1a58ee4700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a541547c0 con 0x7f1a54151e00 2023-12-22T10:00:38.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.918+0000 7f1a58ee4700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5414c9d0 con 0x7f1a540bbe10 2023-12-22T10:00:38.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.918+0000 7f1a58ee4700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a54155140 con 0x7f1a54151a20 2023-12-22T10:00:38.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.918+0000 7f1a53fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a54151e00 0x7f1a540bfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:38.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.918+0000 7f1a53fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a54151e00 0x7f1a540bfcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48154/0 (socket says 172.21.15.45:48154) 2023-12-22T10:00:38.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.918+0000 7f1a53fff700 1 -- 172.21.15.45:0/2167929508 learned_addr learned my addr 172.21.15.45:0/2167929508 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:38.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.918+0000 7f1a537fe700 1 --2- 172.21.15.45:0/2167929508 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1a540bbe10 0x7f1a5414c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:38.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.918+0000 7f1a52ffd700 1 --2- 172.21.15.45:0/2167929508 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1a54151a20 0x7f1a54154c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:38.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.918+0000 7f1a53fff700 1 -- 172.21.15.45:0/2167929508 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1a54151a20 msgr2=0x7f1a54154c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:38.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.918+0000 7f1a53fff700 1 --2- 172.21.15.45:0/2167929508 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1a54151a20 0x7f1a54154c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:38.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.918+0000 7f1a53fff700 1 -- 172.21.15.45:0/2167929508 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1a540bbe10 msgr2=0x7f1a5414c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:38.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.918+0000 7f1a53fff700 1 --2- 172.21.15.45:0/2167929508 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1a540bbe10 0x7f1a5414c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:38.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.918+0000 7f1a53fff700 1 -- 172.21.15.45:0/2167929508 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a44009370 con 0x7f1a54151e00 2023-12-22T10:00:38.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.918+0000 7f1a53fff700 1 --2- 172.21.15.45:0/2167929508 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a54151e00 0x7f1a540bfcd0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f1a4c00c7c0 tx=0x7f1a4c001510).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:38.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.922+0000 7f1a3b7fe700 1 -- 172.21.15.45:0/2167929508 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a4c00e4a0 con 0x7f1a54151e00 2023-12-22T10:00:38.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.922+0000 7f1a3b7fe700 1 -- 172.21.15.45:0/2167929508 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a4c00e600 con 0x7f1a54151e00 2023-12-22T10:00:38.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.922+0000 7f1a58ee4700 1 -- 172.21.15.45:0/2167929508 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a54153bb0 con 0x7f1a54151e00 2023-12-22T10:00:38.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.922+0000 7f1a3b7fe700 1 -- 172.21.15.45:0/2167929508 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a4c00e980 con 0x7f1a54151e00 2023-12-22T10:00:38.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.922+0000 7f1a58ee4700 1 -- 172.21.15.45:0/2167929508 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a54154170 con 0x7f1a54151e00 2023-12-22T10:00:38.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.922+0000 7f1a58ee4700 1 -- 172.21.15.45:0/2167929508 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a54047060 con 0x7f1a54151e00 2023-12-22T10:00:38.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.922+0000 7f1a3b7fe700 1 -- 172.21.15.45:0/2167929508 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f1a4c0123f0 con 0x7f1a54151e00 2023-12-22T10:00:38.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.926+0000 7f1a3b7fe700 1 --2- 172.21.15.45:0/2167929508 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f1a4005a510 0x7f1a4005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:38.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.926+0000 7f1a3b7fe700 1 -- 172.21.15.45:0/2167929508 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f1a4c073fd0 con 0x7f1a54151e00 2023-12-22T10:00:38.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.926+0000 7f1a537fe700 1 --2- 172.21.15.45:0/2167929508 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f1a4005a510 0x7f1a4005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:38.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.926+0000 7f1a537fe700 1 --2- 172.21.15.45:0/2167929508 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f1a4005a510 0x7f1a4005c9d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f1a44009130 tx=0x7f1a44017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:38.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:38.930+0000 7f1a3b7fe700 1 -- 172.21.15.45:0/2167929508 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f1a4c047750 con 0x7f1a54151e00 2023-12-22T10:00:39.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.102+0000 7f1a58ee4700 1 -- 172.21.15.45:0/2167929508 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1a54068c20 con 0x7f1a54151e00 2023-12-22T10:00:39.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.102+0000 7f1a3b7fe700 1 -- 172.21.15.45:0/2167929508 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16928 (secure 0 0 0) 0x7f1a4c04ad70 con 0x7f1a54151e00 2023-12-22T10:00:39.102 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:00:39.102 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":21,"fsid":"98b0837e-5e68-4c8f-a1a0-e9424baaad8f","created":"2023-12-22T10:00:15.010174+0000","modified":"2023-12-22T10:00:34.529651+0000","last_up_change":"2023-12-22T10:00:24.980513+0000","last_in_change":"2023-12-22T10:00:17.887172+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-12-22T10:00:25.069641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-12-22T10:00:26.906399+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-12-22T10:00:31.621311+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-12-22T10:00:32.538053+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e19943a0-1c6b-47df-b6bb-383472077890","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":33777},{"type":"v1","addr":"172.21.15.45:6819","nonce":33777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":33777},{"type":"v1","addr":"172.21.15.45:6822","nonce":33777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":33777},{"type":"v1","addr":"172.21.15.45:6830","nonce":33777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":33777},{"type":"v1","addr":"172.21.15.45:6826","nonce":33777}]},"public_addr":"172.21.15.45:6819/33777","cluster_addr":"172.21.15.45:6822/33777","heartbeat_back_addr":"172.21.15.45:6830/33777","heartbeat_front_addr":"172.21.15.45:6826/33777","state":["exists","up"]},{"osd":1,"uuid":"69670f34-f082-45a7-8f67-e962acc136e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":33775},{"type":"v1","addr":"172.21.15.45:6809","nonce":33775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":33775},{"type":"v1","addr":"172.21.15.45:6811","nonce":33775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":33775},{"type":"v1","addr":"172.21.15.45:6815","nonce":33775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":33775},{"type":"v1","addr":"172.21.15.45:6813","nonce":33775}]},"public_addr":"172.21.15.45:6809/33775","cluster_addr":"172.21.15.45:6811/33775","heartbeat_back_addr":"172.21.15.45:6815/33775","heartbeat_front_addr":"172.21.15.45:6813/33775","state":["exists","up"]},{"osd":2,"uuid":"d909d49b-82b8-401b-9947-e49dd167bb95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":33776},{"type":"v1","addr":"172.21.15.45:6801","nonce":33776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":33776},{"type":"v1","addr":"172.21.15.45:6803","nonce":33776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":33776},{"type":"v1","addr":"172.21.15.45:6807","nonce":33776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":33776},{"type":"v1","addr":"172.21.15.45:6805","nonce":33776}]},"public_addr":"172.21.15.45:6801/33776","cluster_addr":"172.21.15.45:6803/33776","heartbeat_back_addr":"172.21.15.45:6807/33776","heartbeat_front_addr":"172.21.15.45:6805/33776","state":["exists","up"]},{"osd":3,"uuid":"db104ca9-3a94-4d39-a2be-bd06db888095","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":33782},{"type":"v1","addr":"172.21.15.45:6817","nonce":33782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":33782},{"type":"v1","addr":"172.21.15.45:6823","nonce":33782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":33782},{"type":"v1","addr":"172.21.15.45:6831","nonce":33782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":33782},{"type":"v1","addr":"172.21.15.45:6827","nonce":33782}]},"public_addr":"172.21.15.45:6817/33782","cluster_addr":"172.21.15.45:6823/33782","heartbeat_back_addr":"172.21.15.45:6831/33782","heartbeat_front_addr":"172.21.15.45:6827/33782","state":["exists","up"]},{"osd":4,"uuid":"9f4eaff4-e433-4479-a0d1-ee7a33375ca6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":34099},{"type":"v1","addr":"172.21.15.113:6811","nonce":34099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":34099},{"type":"v1","addr":"172.21.15.113:6815","nonce":34099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":34099},{"type":"v1","addr":"172.21.15.113:6823","nonce":34099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6816","nonce":34099},{"type":"v1","addr":"172.21.15.113:6818","nonce":34099}]},"public_addr":"172.21.15.113:6811/34099","cluster_addr":"172.21.15.113:6815/34099","heartbeat_back_addr":"172.21.15.113:6823/34099","heartbeat_front_addr":"172.21.15.113:6818/34099","state":["exists","up"]},{"osd":5,"uuid":"1efc5591-180b-43af-8611-0068aadc5aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":34100},{"type":"v1","addr":"172.21.15.113:6801","nonce":34100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":34100},{"type":"v1","addr":"172.21.15.113:6803","nonce":34100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":34100},{"type":"v1","addr":"172.21.15.113:6807","nonce":34100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":34100},{"type":"v1","addr":"172.21.15.113:6805","nonce":34100}]},"public_addr":"172.21.15.113:6801/34100","cluster_addr":"172.21.15.113:6803/34100","heartbeat_back_addr":"172.21.15.113:6807/34100","heartbeat_front_addr":"172.21.15.113:6805/34100","state":["exists","up"]},{"osd":6,"uuid":"6c89d9d8-c153-4a48-afa9-97e4c403f1ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":34101},{"type":"v1","addr":"172.21.15.113:6810","nonce":34101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6812","nonce":34101},{"type":"v1","addr":"172.21.15.113:6814","nonce":34101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6822","nonce":34101},{"type":"v1","addr":"172.21.15.113:6824","nonce":34101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":34101},{"type":"v1","addr":"172.21.15.113:6819","nonce":34101}]},"public_addr":"172.21.15.113:6810/34101","cluster_addr":"172.21.15.113:6814/34101","heartbeat_back_addr":"172.21.15.113:6824/34101","heartbeat_front_addr":"172.21.15.113:6819/34101","state":["exists","up"]},{"osd":7,"uuid":"1855e70c-23f6-4c08-ad7f-774c2148235b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6821","nonce":34102},{"type":"v1","addr":"172.21.15.113:6825","nonce":34102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":34102},{"type":"v1","addr":"172.21.15.113:6827","nonce":34102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":34102},{"type":"v1","addr":"172.21.15.113:6831","nonce":34102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6828","nonce":34102},{"type":"v1","addr":"172.21.15.113:6829","nonce":34102}]},"public_addr":"172.21.15.113:6825/34102","cluster_addr":"172.21.15.113:6827/34102","heartbeat_back_addr":"172.21.15.113:6831/34102","heartbeat_front_addr":"172.21.15.113:6829/34102","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.812672+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.825045+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.700105+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.856563+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.954683+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.883234+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.883994+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.821686+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T10:00:39.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.106+0000 7f1a58ee4700 1 -- 172.21.15.45:0/2167929508 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f1a4005a510 msgr2=0x7f1a4005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:39.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.106+0000 7f1a58ee4700 1 --2- 172.21.15.45:0/2167929508 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f1a4005a510 0x7f1a4005c9d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f1a44009130 tx=0x7f1a44017000).stop 2023-12-22T10:00:39.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.106+0000 7f1a58ee4700 1 -- 172.21.15.45:0/2167929508 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a54151e00 msgr2=0x7f1a540bfcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:39.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.106+0000 7f1a58ee4700 1 --2- 172.21.15.45:0/2167929508 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a54151e00 0x7f1a540bfcd0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f1a4c00c7c0 tx=0x7f1a4c001510).stop 2023-12-22T10:00:39.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.106+0000 7f1a58ee4700 1 -- 172.21.15.45:0/2167929508 shutdown_connections 2023-12-22T10:00:39.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.106+0000 7f1a58ee4700 1 --2- 172.21.15.45:0/2167929508 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a54151e00 0x7f1a540bfcd0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:39.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.106+0000 7f1a58ee4700 1 --2- 172.21.15.45:0/2167929508 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f1a4005a510 0x7f1a4005c9d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:39.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.106+0000 7f1a58ee4700 1 --2- 172.21.15.45:0/2167929508 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1a54151a20 0x7f1a54154c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:39.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.106+0000 7f1a58ee4700 1 --2- 172.21.15.45:0/2167929508 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1a540bbe10 0x7f1a5414c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:39.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.106+0000 7f1a58ee4700 1 -- 172.21.15.45:0/2167929508 >> 172.21.15.45:0/2167929508 conn(0x7f1a54067540 msgr2=0x7f1a540c0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:39.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.106+0000 7f1a58ee4700 1 -- 172.21.15.45:0/2167929508 shutdown_connections 2023-12-22T10:00:39.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.106+0000 7f1a58ee4700 1 -- 172.21.15.45:0/2167929508 wait complete. 2023-12-22T10:00:39.124 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-12-22T10:00:39.124 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T10:00:39.191 INFO:tasks.ceph.mds.a.smithi045.stderr:2023-12-22T10:00:39.194+0000 7f373d49e700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-22T10:00:39.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.290+0000 7fdc9389b700 1 Processor -- start 2023-12-22T10:00:39.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.294+0000 7fdc9389b700 1 -- start start 2023-12-22T10:00:39.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.294+0000 7fdc9389b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fdc8c153c80 0x7fdc8c066130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:39.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.294+0000 7fdc9389b700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fdc8c0c1cb0 0x7fdc8c0befb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:39.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.294+0000 7fdc9389b700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc8c0beb20 con 0x7fdc8c05de60 2023-12-22T10:00:39.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.294+0000 7fdc9389b700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc8c0c2410 con 0x7fdc8c153c80 2023-12-22T10:00:39.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.294+0000 7fdc9389b700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc8c0c26f0 con 0x7fdc8c0c1cb0 2023-12-22T10:00:39.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.294+0000 7fdc91637700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fdc8c153c80 0x7fdc8c066130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:39.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.294+0000 7fdc91637700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fdc8c153c80 0x7fdc8c066130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48166/0 (socket says 172.21.15.45:48166) 2023-12-22T10:00:39.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.294+0000 7fdc91637700 1 -- 172.21.15.45:0/62731434 learned_addr learned my addr 172.21.15.45:0/62731434 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:39.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.294+0000 7fdc91e38700 1 --2- 172.21.15.45:0/62731434 >> v2:172.21.15.113:3300/0 conn(0x7fdc8c0c1cb0 0x7fdc8c0befb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:39.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.294+0000 7fdc91637700 1 -- 172.21.15.45:0/62731434 >> v2:172.21.15.113:3300/0 conn(0x7fdc8c0c1cb0 msgr2=0x7fdc8c0befb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:00:39.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.294+0000 7fdc91637700 1 --2- 172.21.15.45:0/62731434 >> v2:172.21.15.113:3300/0 conn(0x7fdc8c0c1cb0 0x7fdc8c0befb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:39.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.294+0000 7fdc91637700 1 -- 172.21.15.45:0/62731434 >> v1:172.21.15.113:6789/0 conn(0x7fdc8c05de60 legacy=0x7fdc8c0c15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:39.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.294+0000 7fdc91637700 1 -- 172.21.15.45:0/62731434 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc8c0c29d0 con 0x7fdc8c153c80 2023-12-22T10:00:39.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.298+0000 7fdc91637700 1 --2- 172.21.15.45:0/62731434 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc8c153c80 0x7fdc8c066130 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7fdc8c0be030 tx=0x7fdc880090f0).ready entity=mon.0 client_cookie=eeeca59fa92c45d1 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:39.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.298+0000 7fdc83fff700 1 -- 172.21.15.45:0/62731434 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc8800b600 con 0x7fdc8c153c80 2023-12-22T10:00:39.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.298+0000 7fdc83fff700 1 -- 172.21.15.45:0/62731434 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc8800b760 con 0x7fdc8c153c80 2023-12-22T10:00:39.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.298+0000 7fdc83fff700 1 -- 172.21.15.45:0/62731434 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc8800bae0 con 0x7fdc8c153c80 2023-12-22T10:00:39.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.298+0000 7fdc9389b700 1 -- 172.21.15.45:0/62731434 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc8c153c80 msgr2=0x7fdc8c066130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:39.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.298+0000 7fdc9389b700 1 --2- 172.21.15.45:0/62731434 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc8c153c80 0x7fdc8c066130 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7fdc8c0be030 tx=0x7fdc880090f0).stop 2023-12-22T10:00:39.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.298+0000 7fdc9389b700 1 -- 172.21.15.45:0/62731434 shutdown_connections 2023-12-22T10:00:39.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.298+0000 7fdc9389b700 1 --2- 172.21.15.45:0/62731434 >> v2:172.21.15.113:3300/0 conn(0x7fdc8c0c1cb0 0x7fdc8c0befb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:39.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.298+0000 7fdc9389b700 1 --2- 172.21.15.45:0/62731434 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc8c153c80 0x7fdc8c066130 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:39.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.298+0000 7fdc9389b700 1 -- 172.21.15.45:0/62731434 >> 172.21.15.45:0/62731434 conn(0x7fdc8c0c7a30 msgr2=0x7fdc8c0c3a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:39.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.298+0000 7fdc9389b700 1 -- 172.21.15.45:0/62731434 shutdown_connections 2023-12-22T10:00:39.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.298+0000 7fdc9389b700 1 -- 172.21.15.45:0/62731434 wait complete. 2023-12-22T10:00:39.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.302+0000 7fdc9389b700 1 Processor -- start 2023-12-22T10:00:39.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.302+0000 7fdc9389b700 1 -- start start 2023-12-22T10:00:39.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.302+0000 7fdc9389b700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdc8c05de60 0x7fdc8c141210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:39.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.302+0000 7fdc9389b700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fdc8c0c1cb0 0x7fdc8c066be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:39.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.302+0000 7fdc9389b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc8c153c80 0x7fdc8c0670d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:39.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.302+0000 7fdc9389b700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc8c0675c0 con 0x7fdc8c153c80 2023-12-22T10:00:39.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.302+0000 7fdc9389b700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc8c163e40 con 0x7fdc8c05de60 2023-12-22T10:00:39.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.302+0000 7fdc9389b700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc8c157c10 con 0x7fdc8c0c1cb0 2023-12-22T10:00:39.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.302+0000 7fdc91e38700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc8c153c80 0x7fdc8c0670d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:39.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.302+0000 7fdc91e38700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc8c153c80 0x7fdc8c0670d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48180/0 (socket says 172.21.15.45:48180) 2023-12-22T10:00:39.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.302+0000 7fdc91e38700 1 -- 172.21.15.45:0/3424120599 learned_addr learned my addr 172.21.15.45:0/3424120599 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:39.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.302+0000 7fdc91637700 1 --2- 172.21.15.45:0/3424120599 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdc8c05de60 0x7fdc8c141210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:39.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.302+0000 7fdc90e36700 1 --2- 172.21.15.45:0/3424120599 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fdc8c0c1cb0 0x7fdc8c066be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:39.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.302+0000 7fdc91e38700 1 -- 172.21.15.45:0/3424120599 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fdc8c0c1cb0 msgr2=0x7fdc8c066be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:39.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.302+0000 7fdc91e38700 1 --2- 172.21.15.45:0/3424120599 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fdc8c0c1cb0 0x7fdc8c066be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:39.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.302+0000 7fdc91e38700 1 -- 172.21.15.45:0/3424120599 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdc8c05de60 msgr2=0x7fdc8c141210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:39.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.302+0000 7fdc91e38700 1 --2- 172.21.15.45:0/3424120599 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdc8c05de60 0x7fdc8c141210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:39.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.302+0000 7fdc91e38700 1 -- 172.21.15.45:0/3424120599 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc88009370 con 0x7fdc8c153c80 2023-12-22T10:00:39.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.302+0000 7fdc91e38700 1 --2- 172.21.15.45:0/3424120599 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc8c153c80 0x7fdc8c0670d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fdc84009fd0 tx=0x7fdc84009900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:39.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.302+0000 7fdc817fa700 1 -- 172.21.15.45:0/3424120599 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc8400eca0 con 0x7fdc8c153c80 2023-12-22T10:00:39.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.302+0000 7fdc817fa700 1 -- 172.21.15.45:0/3424120599 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc8400ee00 con 0x7fdc8c153c80 2023-12-22T10:00:39.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.302+0000 7fdc9389b700 1 -- 172.21.15.45:0/3424120599 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc8c154e40 con 0x7fdc8c153c80 2023-12-22T10:00:39.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.302+0000 7fdc817fa700 1 -- 172.21.15.45:0/3424120599 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc84014610 con 0x7fdc8c153c80 2023-12-22T10:00:39.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.306+0000 7fdc9389b700 1 -- 172.21.15.45:0/3424120599 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc8c155400 con 0x7fdc8c153c80 2023-12-22T10:00:39.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.306+0000 7fdc9389b700 1 -- 172.21.15.45:0/3424120599 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc8c06c070 con 0x7fdc8c153c80 2023-12-22T10:00:39.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.306+0000 7fdc817fa700 1 -- 172.21.15.45:0/3424120599 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fdc8401d3b0 con 0x7fdc8c153c80 2023-12-22T10:00:39.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.306+0000 7fdc817fa700 1 --2- 172.21.15.45:0/3424120599 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fdc7005a510 0x7fdc7005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:39.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.306+0000 7fdc817fa700 1 -- 172.21.15.45:0/3424120599 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fdc84074d50 con 0x7fdc8c153c80 2023-12-22T10:00:39.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.306+0000 7fdc91637700 1 --2- 172.21.15.45:0/3424120599 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fdc7005a510 0x7fdc7005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:39.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.310+0000 7fdc91637700 1 --2- 172.21.15.45:0/3424120599 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fdc7005a510 0x7fdc7005c9d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fdc88009130 tx=0x7fdc88017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:39.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.314+0000 7fdc817fa700 1 -- 172.21.15.45:0/3424120599 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fdc84078030 con 0x7fdc8c153c80 2023-12-22T10:00:39.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.478+0000 7fdc9389b700 1 -- 172.21.15.45:0/3424120599 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdc8c0c1620 con 0x7fdc8c153c80 2023-12-22T10:00:39.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.482+0000 7fdc817fa700 1 -- 172.21.15.45:0/3424120599 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16928 (secure 0 0 0) 0x7fdc840484d0 con 0x7fdc8c153c80 2023-12-22T10:00:39.479 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:00:39.479 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":21,"fsid":"98b0837e-5e68-4c8f-a1a0-e9424baaad8f","created":"2023-12-22T10:00:15.010174+0000","modified":"2023-12-22T10:00:34.529651+0000","last_up_change":"2023-12-22T10:00:24.980513+0000","last_in_change":"2023-12-22T10:00:17.887172+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-12-22T10:00:25.069641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-12-22T10:00:26.906399+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-12-22T10:00:31.621311+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-12-22T10:00:32.538053+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e19943a0-1c6b-47df-b6bb-383472077890","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":33777},{"type":"v1","addr":"172.21.15.45:6819","nonce":33777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":33777},{"type":"v1","addr":"172.21.15.45:6822","nonce":33777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":33777},{"type":"v1","addr":"172.21.15.45:6830","nonce":33777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":33777},{"type":"v1","addr":"172.21.15.45:6826","nonce":33777}]},"public_addr":"172.21.15.45:6819/33777","cluster_addr":"172.21.15.45:6822/33777","heartbeat_back_addr":"172.21.15.45:6830/33777","heartbeat_front_addr":"172.21.15.45:6826/33777","state":["exists","up"]},{"osd":1,"uuid":"69670f34-f082-45a7-8f67-e962acc136e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":33775},{"type":"v1","addr":"172.21.15.45:6809","nonce":33775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":33775},{"type":"v1","addr":"172.21.15.45:6811","nonce":33775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":33775},{"type":"v1","addr":"172.21.15.45:6815","nonce":33775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":33775},{"type":"v1","addr":"172.21.15.45:6813","nonce":33775}]},"public_addr":"172.21.15.45:6809/33775","cluster_addr":"172.21.15.45:6811/33775","heartbeat_back_addr":"172.21.15.45:6815/33775","heartbeat_front_addr":"172.21.15.45:6813/33775","state":["exists","up"]},{"osd":2,"uuid":"d909d49b-82b8-401b-9947-e49dd167bb95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":33776},{"type":"v1","addr":"172.21.15.45:6801","nonce":33776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":33776},{"type":"v1","addr":"172.21.15.45:6803","nonce":33776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":33776},{"type":"v1","addr":"172.21.15.45:6807","nonce":33776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":33776},{"type":"v1","addr":"172.21.15.45:6805","nonce":33776}]},"public_addr":"172.21.15.45:6801/33776","cluster_addr":"172.21.15.45:6803/33776","heartbeat_back_addr":"172.21.15.45:6807/33776","heartbeat_front_addr":"172.21.15.45:6805/33776","state":["exists","up"]},{"osd":3,"uuid":"db104ca9-3a94-4d39-a2be-bd06db888095","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":33782},{"type":"v1","addr":"172.21.15.45:6817","nonce":33782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":33782},{"type":"v1","addr":"172.21.15.45:6823","nonce":33782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":33782},{"type":"v1","addr":"172.21.15.45:6831","nonce":33782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":33782},{"type":"v1","addr":"172.21.15.45:6827","nonce":33782}]},"public_addr":"172.21.15.45:6817/33782","cluster_addr":"172.21.15.45:6823/33782","heartbeat_back_addr":"172.21.15.45:6831/33782","heartbeat_front_addr":"172.21.15.45:6827/33782","state":["exists","up"]},{"osd":4,"uuid":"9f4eaff4-e433-4479-a0d1-ee7a33375ca6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":34099},{"type":"v1","addr":"172.21.15.113:6811","nonce":34099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":34099},{"type":"v1","addr":"172.21.15.113:6815","nonce":34099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":34099},{"type":"v1","addr":"172.21.15.113:6823","nonce":34099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6816","nonce":34099},{"type":"v1","addr":"172.21.15.113:6818","nonce":34099}]},"public_addr":"172.21.15.113:6811/34099","cluster_addr":"172.21.15.113:6815/34099","heartbeat_back_addr":"172.21.15.113:6823/34099","heartbeat_front_addr":"172.21.15.113:6818/34099","state":["exists","up"]},{"osd":5,"uuid":"1efc5591-180b-43af-8611-0068aadc5aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":34100},{"type":"v1","addr":"172.21.15.113:6801","nonce":34100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":34100},{"type":"v1","addr":"172.21.15.113:6803","nonce":34100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":34100},{"type":"v1","addr":"172.21.15.113:6807","nonce":34100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":34100},{"type":"v1","addr":"172.21.15.113:6805","nonce":34100}]},"public_addr":"172.21.15.113:6801/34100","cluster_addr":"172.21.15.113:6803/34100","heartbeat_back_addr":"172.21.15.113:6807/34100","heartbeat_front_addr":"172.21.15.113:6805/34100","state":["exists","up"]},{"osd":6,"uuid":"6c89d9d8-c153-4a48-afa9-97e4c403f1ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":34101},{"type":"v1","addr":"172.21.15.113:6810","nonce":34101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6812","nonce":34101},{"type":"v1","addr":"172.21.15.113:6814","nonce":34101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6822","nonce":34101},{"type":"v1","addr":"172.21.15.113:6824","nonce":34101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":34101},{"type":"v1","addr":"172.21.15.113:6819","nonce":34101}]},"public_addr":"172.21.15.113:6810/34101","cluster_addr":"172.21.15.113:6814/34101","heartbeat_back_addr":"172.21.15.113:6824/34101","heartbeat_front_addr":"172.21.15.113:6819/34101","state":["exists","up"]},{"osd":7,"uuid":"1855e70c-23f6-4c08-ad7f-774c2148235b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6821","nonce":34102},{"type":"v1","addr":"172.21.15.113:6825","nonce":34102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":34102},{"type":"v1","addr":"172.21.15.113:6827","nonce":34102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":34102},{"type":"v1","addr":"172.21.15.113:6831","nonce":34102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6828","nonce":34102},{"type":"v1","addr":"172.21.15.113:6829","nonce":34102}]},"public_addr":"172.21.15.113:6825/34102","cluster_addr":"172.21.15.113:6827/34102","heartbeat_back_addr":"172.21.15.113:6831/34102","heartbeat_front_addr":"172.21.15.113:6829/34102","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.812672+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.825045+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.700105+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.856563+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.954683+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.883234+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.883994+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.821686+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T10:00:39.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.482+0000 7fdc9389b700 1 -- 172.21.15.45:0/3424120599 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fdc7005a510 msgr2=0x7fdc7005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:39.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.482+0000 7fdc9389b700 1 --2- 172.21.15.45:0/3424120599 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fdc7005a510 0x7fdc7005c9d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fdc88009130 tx=0x7fdc88017000).stop 2023-12-22T10:00:39.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.482+0000 7fdc9389b700 1 -- 172.21.15.45:0/3424120599 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc8c153c80 msgr2=0x7fdc8c0670d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:39.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.482+0000 7fdc9389b700 1 --2- 172.21.15.45:0/3424120599 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc8c153c80 0x7fdc8c0670d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fdc84009fd0 tx=0x7fdc84009900).stop 2023-12-22T10:00:39.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.486+0000 7fdc9389b700 1 -- 172.21.15.45:0/3424120599 shutdown_connections 2023-12-22T10:00:39.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.486+0000 7fdc9389b700 1 --2- 172.21.15.45:0/3424120599 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc8c153c80 0x7fdc8c0670d0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:39.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.486+0000 7fdc9389b700 1 --2- 172.21.15.45:0/3424120599 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fdc7005a510 0x7fdc7005c9d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:39.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.486+0000 7fdc9389b700 1 --2- 172.21.15.45:0/3424120599 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fdc8c0c1cb0 0x7fdc8c066be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:39.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.486+0000 7fdc9389b700 1 --2- 172.21.15.45:0/3424120599 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdc8c05de60 0x7fdc8c141210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:39.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.486+0000 7fdc9389b700 1 -- 172.21.15.45:0/3424120599 >> 172.21.15.45:0/3424120599 conn(0x7fdc8c0c7a30 msgr2=0x7fdc8c14f550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:39.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.486+0000 7fdc9389b700 1 -- 172.21.15.45:0/3424120599 shutdown_connections 2023-12-22T10:00:39.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.486+0000 7fdc9389b700 1 -- 172.21.15.45:0/3424120599 wait complete. 2023-12-22T10:00:39.503 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-12-22T10:00:39.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.670+0000 7f33e8f69700 1 Processor -- start 2023-12-22T10:00:39.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.670+0000 7f33e8f69700 1 -- start start 2023-12-22T10:00:39.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.674+0000 7f33e8f69700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f33e4153ba0 0x7f33e40ca1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:39.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.674+0000 7f33e8f69700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f33e40c7460 0x7f33e40c78d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:39.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.674+0000 7f33e8f69700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33e40c7dc0 con 0x7f33e41537c0 2023-12-22T10:00:39.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.674+0000 7f33e8f69700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33e40c9120 con 0x7f33e40c7460 2023-12-22T10:00:39.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.674+0000 7f33e8f69700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33e40c9400 con 0x7f33e4153ba0 2023-12-22T10:00:39.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.674+0000 7f33e259c700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f33e41537c0 0x7f33e4158060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59118/0 (socket says 172.21.15.45:59118) 2023-12-22T10:00:39.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.678+0000 7f33e259c700 1 -- 172.21.15.45:0/299428795 learned_addr learned my addr 172.21.15.45:0/299428795 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:00:39.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.678+0000 7f33e1d9b700 1 --2- 172.21.15.45:0/299428795 >> v2:172.21.15.113:3300/0 conn(0x7f33e4153ba0 0x7f33e40ca1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:39.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.678+0000 7f33e2d9d700 1 --2- 172.21.15.45:0/299428795 >> v2:172.21.15.45:3300/0 conn(0x7f33e40c7460 0x7f33e40c78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:39.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.678+0000 7f33e159a700 1 -- 172.21.15.45:0/299428795 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3789985683 0 0) 0x7f33e40c7dc0 con 0x7f33e41537c0 2023-12-22T10:00:39.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.678+0000 7f33e159a700 1 -- 172.21.15.45:0/299428795 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33cc0033f0 con 0x7f33e41537c0 2023-12-22T10:00:39.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.678+0000 7f33e1d9b700 1 -- 172.21.15.45:0/299428795 >> v2:172.21.15.45:3300/0 conn(0x7f33e40c7460 msgr2=0x7f33e40c78d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:00:39.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.678+0000 7f33e1d9b700 1 --2- 172.21.15.45:0/299428795 >> v2:172.21.15.45:3300/0 conn(0x7f33e40c7460 0x7f33e40c78d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:39.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.678+0000 7f33e1d9b700 1 -- 172.21.15.45:0/299428795 >> v1:172.21.15.45:6789/0 conn(0x7f33e41537c0 legacy=0x7f33e4158060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:39.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.678+0000 7f33e1d9b700 1 -- 172.21.15.45:0/299428795 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33e40c96e0 con 0x7f33e4153ba0 2023-12-22T10:00:39.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.678+0000 7f33e1d9b700 1 --2- 172.21.15.45:0/299428795 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f33e4153ba0 0x7f33e40ca1c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f33e40c8540 tx=0x7f33d8006f40).ready entity=mon.1 client_cookie=28112a445d97b00d server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:39.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.678+0000 7f33e159a700 1 -- 172.21.15.45:0/299428795 <== mon.1 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d8005880 con 0x7f33e4153ba0 2023-12-22T10:00:39.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.678+0000 7f33e159a700 1 -- 172.21.15.45:0/299428795 <== mon.1 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33d80059e0 con 0x7f33e4153ba0 2023-12-22T10:00:39.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.678+0000 7f33e159a700 1 -- 172.21.15.45:0/299428795 <== mon.1 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d8005d60 con 0x7f33e4153ba0 2023-12-22T10:00:39.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.678+0000 7f33e8f69700 1 -- 172.21.15.45:0/299428795 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f33e4153ba0 msgr2=0x7f33e40ca1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:39.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.678+0000 7f33e8f69700 1 --2- 172.21.15.45:0/299428795 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f33e4153ba0 0x7f33e40ca1c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f33e40c8540 tx=0x7f33d8006f40).stop 2023-12-22T10:00:39.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.678+0000 7f33e8f69700 1 -- 172.21.15.45:0/299428795 shutdown_connections 2023-12-22T10:00:39.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.678+0000 7f33e8f69700 1 --2- 172.21.15.45:0/299428795 >> v2:172.21.15.45:3300/0 conn(0x7f33e40c7460 0x7f33e40c78d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:39.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.678+0000 7f33e8f69700 1 --2- 172.21.15.45:0/299428795 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f33e4153ba0 0x7f33e40ca1c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:39.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.678+0000 7f33e8f69700 1 -- 172.21.15.45:0/299428795 >> 172.21.15.45:0/299428795 conn(0x7f33e4066a70 msgr2=0x7f33e4066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:39.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.678+0000 7f33e8f69700 1 -- 172.21.15.45:0/299428795 shutdown_connections 2023-12-22T10:00:39.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.682+0000 7f33e8f69700 1 -- 172.21.15.45:0/299428795 wait complete. 2023-12-22T10:00:39.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.682+0000 7f33e8f69700 1 Processor -- start 2023-12-22T10:00:39.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.682+0000 7f33e8f69700 1 -- start start 2023-12-22T10:00:39.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.686+0000 7f33e8f69700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f33e40c7460 0x7f33e414d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:39.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.686+0000 7f33e8f69700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f33e41537c0 0x7f33e4155680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:39.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.686+0000 7f33e8f69700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33e4153ba0 0x7f33e4155b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:39.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.686+0000 7f33e8f69700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33e4156060 con 0x7f33e4153ba0 2023-12-22T10:00:39.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.686+0000 7f33e8f69700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33e40c3470 con 0x7f33e40c7460 2023-12-22T10:00:39.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.686+0000 7f33e8f69700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33e40aed60 con 0x7f33e41537c0 2023-12-22T10:00:39.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.686+0000 7f33e2d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33e4153ba0 0x7f33e4155b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:39.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.686+0000 7f33e2d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33e4153ba0 0x7f33e4155b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48206/0 (socket says 172.21.15.45:48206) 2023-12-22T10:00:39.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.686+0000 7f33e2d9d700 1 -- 172.21.15.45:0/2882822735 learned_addr learned my addr 172.21.15.45:0/2882822735 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:39.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.686+0000 7f33e259c700 1 --2- 172.21.15.45:0/2882822735 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f33e40c7460 0x7f33e414d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:39.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.686+0000 7f33e1d9b700 1 --2- 172.21.15.45:0/2882822735 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f33e41537c0 0x7f33e4155680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:39.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.686+0000 7f33e2d9d700 1 -- 172.21.15.45:0/2882822735 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f33e41537c0 msgr2=0x7f33e4155680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:39.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.686+0000 7f33e2d9d700 1 --2- 172.21.15.45:0/2882822735 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f33e41537c0 0x7f33e4155680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:39.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.686+0000 7f33e2d9d700 1 -- 172.21.15.45:0/2882822735 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f33e40c7460 msgr2=0x7f33e414d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:39.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.686+0000 7f33e2d9d700 1 --2- 172.21.15.45:0/2882822735 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f33e40c7460 0x7f33e414d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:39.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.686+0000 7f33e2d9d700 1 -- 172.21.15.45:0/2882822735 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33d8009250 con 0x7f33e4153ba0 2023-12-22T10:00:39.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.686+0000 7f33e2d9d700 1 --2- 172.21.15.45:0/2882822735 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33e4153ba0 0x7f33e4155b70 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f33dc009e90 tx=0x7f33dc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:39.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.686+0000 7f33d27fc700 1 -- 172.21.15.45:0/2882822735 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33dc00caa0 con 0x7f33e4153ba0 2023-12-22T10:00:39.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.686+0000 7f33d27fc700 1 -- 172.21.15.45:0/2882822735 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33dc00f040 con 0x7f33e4153ba0 2023-12-22T10:00:39.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.686+0000 7f33e8f69700 1 -- 172.21.15.45:0/2882822735 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33e40af040 con 0x7f33e4153ba0 2023-12-22T10:00:39.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.686+0000 7f33d27fc700 1 -- 172.21.15.45:0/2882822735 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33dc00ce10 con 0x7f33e4153ba0 2023-12-22T10:00:39.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.686+0000 7f33e8f69700 1 -- 172.21.15.45:0/2882822735 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33e4168740 con 0x7f33e4153ba0 2023-12-22T10:00:39.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.690+0000 7f33e8f69700 1 -- 172.21.15.45:0/2882822735 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f33e40c2f80 con 0x7f33e4153ba0 2023-12-22T10:00:39.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.690+0000 7f33d27fc700 1 -- 172.21.15.45:0/2882822735 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f33dc013610 con 0x7f33e4153ba0 2023-12-22T10:00:39.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.690+0000 7f33d27fc700 1 --2- 172.21.15.45:0/2882822735 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f33c405a510 0x7f33c405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:39.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.690+0000 7f33d27fc700 1 -- 172.21.15.45:0/2882822735 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f33dc075140 con 0x7f33e4153ba0 2023-12-22T10:00:39.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.690+0000 7f33d27fc700 1 --2- 172.21.15.45:0/2882822735 >> [v2:172.21.15.45:6818/33777,v1:172.21.15.45:6819/33777] conn(0x7f33c40638b0 0x7f33c4065d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:39.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.690+0000 7f33d27fc700 1 -- 172.21.15.45:0/2882822735 --> [v2:172.21.15.45:6818/33777,v1:172.21.15.45:6819/33777] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f33c4066390 con 0x7f33c40638b0 2023-12-22T10:00:39.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.690+0000 7f33d27fc700 1 -- 172.21.15.45:0/2882822735 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f33dc0776a0 con 0x7f33e4153ba0 2023-12-22T10:00:39.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.690+0000 7f33e259c700 1 --2- 172.21.15.45:0/2882822735 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f33c405a510 0x7f33c405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:39.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.690+0000 7f33e1d9b700 1 --2- 172.21.15.45:0/2882822735 >> [v2:172.21.15.45:6818/33777,v1:172.21.15.45:6819/33777] conn(0x7f33c40638b0 0x7f33c4065d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:39.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.694+0000 7f33e259c700 1 --2- 172.21.15.45:0/2882822735 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f33c405a510 0x7f33c405c9d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f33d4005750 tx=0x7f33d4009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:39.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.694+0000 7f33e1d9b700 1 --2- 172.21.15.45:0/2882822735 >> [v2:172.21.15.45:6818/33777,v1:172.21.15.45:6819/33777] conn(0x7f33c40638b0 0x7f33c4065d10 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:39.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.694+0000 7f33d27fc700 1 -- 172.21.15.45:0/2882822735 <== osd.0 v2:172.21.15.45:6818/33777 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7f33c4066390 con 0x7f33c40638b0 2023-12-22T10:00:39.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.714+0000 7f33e8f69700 1 -- 172.21.15.45:0/2882822735 --> [v2:172.21.15.45:6818/33777,v1:172.21.15.45:6819/33777] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f33e4168930 con 0x7f33c40638b0 2023-12-22T10:00:39.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.718+0000 7f33d27fc700 1 -- 172.21.15.45:0/2882822735 <== osd.0 v2:172.21.15.45:6818/33777 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f33e4168930 con 0x7f33c40638b0 2023-12-22T10:00:39.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.718+0000 7f33e8f69700 1 -- 172.21.15.45:0/2882822735 >> [v2:172.21.15.45:6818/33777,v1:172.21.15.45:6819/33777] conn(0x7f33c40638b0 msgr2=0x7f33c4065d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:39.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.718+0000 7f33e8f69700 1 --2- 172.21.15.45:0/2882822735 >> [v2:172.21.15.45:6818/33777,v1:172.21.15.45:6819/33777] conn(0x7f33c40638b0 0x7f33c4065d10 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:39.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.718+0000 7f33e8f69700 1 -- 172.21.15.45:0/2882822735 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f33c405a510 msgr2=0x7f33c405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:39.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.718+0000 7f33e8f69700 1 --2- 172.21.15.45:0/2882822735 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f33c405a510 0x7f33c405c9d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f33d4005750 tx=0x7f33d4009040).stop 2023-12-22T10:00:39.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.718+0000 7f33e8f69700 1 -- 172.21.15.45:0/2882822735 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33e4153ba0 msgr2=0x7f33e4155b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:39.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.718+0000 7f33e8f69700 1 --2- 172.21.15.45:0/2882822735 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33e4153ba0 0x7f33e4155b70 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f33dc009e90 tx=0x7f33dc00b040).stop 2023-12-22T10:00:39.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.718+0000 7f33e2d9d700 1 -- 172.21.15.45:0/2882822735 reap_dead start 2023-12-22T10:00:39.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.718+0000 7f33e8f69700 1 -- 172.21.15.45:0/2882822735 shutdown_connections 2023-12-22T10:00:39.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.718+0000 7f33e8f69700 1 -- 172.21.15.45:0/2882822735 >> 172.21.15.45:0/2882822735 conn(0x7f33e4066a70 msgr2=0x7f33e4066e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:39.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.718+0000 7f33e8f69700 1 -- 172.21.15.45:0/2882822735 shutdown_connections 2023-12-22T10:00:39.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.718+0000 7f33e8f69700 1 -- 172.21.15.45:0/2882822735 wait complete. 2023-12-22T10:00:39.738 INFO:teuthology.orchestra.run.smithi045.stdout:55834574852 2023-12-22T10:00:39.738 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-12-22T10:00:39.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.922+0000 7f2dd9279700 1 Processor -- start 2023-12-22T10:00:39.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.922+0000 7f2dd9279700 1 -- start start 2023-12-22T10:00:39.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.922+0000 7f2dd9279700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2dd4151830 0x7f2dd40bc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:39.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.922+0000 7f2dd9279700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f2dd4064f10 0x7f2dd40653a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:39.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.922+0000 7f2dd9279700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dd40c4710 con 0x7f2dd40bbef0 2023-12-22T10:00:39.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.922+0000 7f2dd9279700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dd40c42c0 con 0x7f2dd4151830 2023-12-22T10:00:39.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.922+0000 7f2dd9279700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dd4068510 con 0x7f2dd4064f10 2023-12-22T10:00:39.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.922+0000 7f2dd3fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2dd4151830 0x7f2dd40bc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:39.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.922+0000 7f2dd3fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2dd4151830 0x7f2dd40bc6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48222/0 (socket says 172.21.15.45:48222) 2023-12-22T10:00:39.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.922+0000 7f2dd3fff700 1 -- 172.21.15.45:0/3872021876 learned_addr learned my addr 172.21.15.45:0/3872021876 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:39.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.922+0000 7f2dd8a78700 1 --2- 172.21.15.45:0/3872021876 >> v2:172.21.15.113:3300/0 conn(0x7f2dd4064f10 0x7f2dd40653a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:39.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.922+0000 7f2dd3fff700 1 -- 172.21.15.45:0/3872021876 >> v2:172.21.15.113:3300/0 conn(0x7f2dd4064f10 msgr2=0x7f2dd40653a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:00:39.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.922+0000 7f2dd3fff700 1 --2- 172.21.15.45:0/3872021876 >> v2:172.21.15.113:3300/0 conn(0x7f2dd4064f10 0x7f2dd40653a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:39.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.922+0000 7f2dd3fff700 1 -- 172.21.15.45:0/3872021876 >> v1:172.21.15.45:6789/0 conn(0x7f2dd40bbef0 legacy=0x7f2dd4067440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:00:39.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.922+0000 7f2dd3fff700 1 -- 172.21.15.45:0/3872021876 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dd40bcbe0 con 0x7f2dd4151830 2023-12-22T10:00:39.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.922+0000 7f2dd8a78700 1 --2- 172.21.15.45:0/3872021876 >> v2:172.21.15.113:3300/0 conn(0x7f2dd4064f10 0x7f2dd40653a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-12-22T10:00:39.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.922+0000 7f2dd3fff700 1 --2- 172.21.15.45:0/3872021876 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2dd4151830 0x7f2dd40bc6f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f2dd4064470 tx=0x7f2dc40090f0).ready entity=mon.0 client_cookie=3893aebbed1cfda server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:39.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.922+0000 7f2dd37fe700 1 -- 172.21.15.45:0/3872021876 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dc400b600 con 0x7f2dd4151830 2023-12-22T10:00:39.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.926+0000 7f2dd37fe700 1 -- 172.21.15.45:0/3872021876 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dc400b760 con 0x7f2dd4151830 2023-12-22T10:00:39.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.926+0000 7f2dd37fe700 1 -- 172.21.15.45:0/3872021876 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dc400bae0 con 0x7f2dd4151830 2023-12-22T10:00:39.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.926+0000 7f2dd9279700 1 -- 172.21.15.45:0/3872021876 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2dd4151830 msgr2=0x7f2dd40bc6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:39.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.926+0000 7f2dd9279700 1 --2- 172.21.15.45:0/3872021876 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2dd4151830 0x7f2dd40bc6f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f2dd4064470 tx=0x7f2dc40090f0).stop 2023-12-22T10:00:39.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.926+0000 7f2dd9279700 1 -- 172.21.15.45:0/3872021876 shutdown_connections 2023-12-22T10:00:39.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.926+0000 7f2dd9279700 1 --2- 172.21.15.45:0/3872021876 >> v2:172.21.15.113:3300/0 conn(0x7f2dd4064f10 0x7f2dd40653a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:39.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.926+0000 7f2dd9279700 1 --2- 172.21.15.45:0/3872021876 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2dd4151830 0x7f2dd40bc6f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:39.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.926+0000 7f2dd9279700 1 -- 172.21.15.45:0/3872021876 >> 172.21.15.45:0/3872021876 conn(0x7f2dd40c77a0 msgr2=0x7f2dd40c3770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:39.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.926+0000 7f2dd9279700 1 -- 172.21.15.45:0/3872021876 shutdown_connections 2023-12-22T10:00:39.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.926+0000 7f2dd9279700 1 -- 172.21.15.45:0/3872021876 wait complete. 2023-12-22T10:00:39.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.930+0000 7f2dd9279700 1 Processor -- start 2023-12-22T10:00:39.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.930+0000 7f2dd9279700 1 -- start start 2023-12-22T10:00:39.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.930+0000 7f2dd9279700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2dd4064f10 0x7f2dd4142460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:39.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.930+0000 7f2dd9279700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f2dd40bbef0 0x7f2dd40c1d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:39.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.930+0000 7f2dd9279700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2dd4151830 0x7f2dd40c2230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:39.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.930+0000 7f2dd9279700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd40ab510 con 0x7f2dd4151830 2023-12-22T10:00:39.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.930+0000 7f2dd9279700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd4142950 con 0x7f2dd4064f10 2023-12-22T10:00:39.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.930+0000 7f2dd9279700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd4150210 con 0x7f2dd40bbef0 2023-12-22T10:00:39.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.930+0000 7f2dd8a78700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2dd4151830 0x7f2dd40c2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:39.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.930+0000 7f2dd8a78700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2dd4151830 0x7f2dd40c2230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48236/0 (socket says 172.21.15.45:48236) 2023-12-22T10:00:39.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.930+0000 7f2dd8a78700 1 -- 172.21.15.45:0/2891874902 learned_addr learned my addr 172.21.15.45:0/2891874902 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:39.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.930+0000 7f2dd3fff700 1 --2- 172.21.15.45:0/2891874902 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2dd4064f10 0x7f2dd4142460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:39.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.930+0000 7f2dcb7fe700 1 --2- 172.21.15.45:0/2891874902 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f2dd40bbef0 0x7f2dd40c1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:39.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.930+0000 7f2dd8a78700 1 -- 172.21.15.45:0/2891874902 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f2dd40bbef0 msgr2=0x7f2dd40c1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:39.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.930+0000 7f2dd8a78700 1 --2- 172.21.15.45:0/2891874902 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f2dd40bbef0 0x7f2dd40c1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:39.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.930+0000 7f2dd8a78700 1 -- 172.21.15.45:0/2891874902 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2dd4064f10 msgr2=0x7f2dd4142460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:39.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.930+0000 7f2dd8a78700 1 --2- 172.21.15.45:0/2891874902 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2dd4064f10 0x7f2dd4142460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:39.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.930+0000 7f2dd8a78700 1 -- 172.21.15.45:0/2891874902 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dc4009370 con 0x7f2dd4151830 2023-12-22T10:00:39.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.930+0000 7f2dcb7fe700 1 --2- 172.21.15.45:0/2891874902 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f2dd40bbef0 0x7f2dd40c1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T10:00:39.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.934+0000 7f2dd8a78700 1 --2- 172.21.15.45:0/2891874902 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2dd4151830 0x7f2dd40c2230 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f2dcc00a380 tx=0x7f2dcc007900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:39.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.934+0000 7f2dd0ff9700 1 -- 172.21.15.45:0/2891874902 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dcc016470 con 0x7f2dd4151830 2023-12-22T10:00:39.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.934+0000 7f2dd0ff9700 1 -- 172.21.15.45:0/2891874902 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dcc0165d0 con 0x7f2dd4151830 2023-12-22T10:00:39.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.934+0000 7f2dd9279700 1 -- 172.21.15.45:0/2891874902 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dd40c28f0 con 0x7f2dd4151830 2023-12-22T10:00:39.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.934+0000 7f2dd0ff9700 1 -- 172.21.15.45:0/2891874902 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dcc016950 con 0x7f2dd4151830 2023-12-22T10:00:39.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.934+0000 7f2dd9279700 1 -- 172.21.15.45:0/2891874902 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dd40aaec0 con 0x7f2dd4151830 2023-12-22T10:00:39.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.934+0000 7f2dd9279700 1 -- 172.21.15.45:0/2891874902 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2dd4047060 con 0x7f2dd4151830 2023-12-22T10:00:39.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.938+0000 7f2dd0ff9700 1 -- 172.21.15.45:0/2891874902 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f2dcc013070 con 0x7f2dd4151830 2023-12-22T10:00:39.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.938+0000 7f2dd0ff9700 1 --2- 172.21.15.45:0/2891874902 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f2db405a540 0x7f2db405ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:39.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.938+0000 7f2dd0ff9700 1 -- 172.21.15.45:0/2891874902 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f2dcc075530 con 0x7f2dd4151830 2023-12-22T10:00:39.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.938+0000 7f2dd3fff700 1 --2- 172.21.15.45:0/2891874902 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f2db405a540 0x7f2db405ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:39.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.938+0000 7f2dd0ff9700 1 --2- 172.21.15.45:0/2891874902 >> [v2:172.21.15.45:6808/33775,v1:172.21.15.45:6809/33775] conn(0x7f2db40638e0 0x7f2db4065d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:39.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.938+0000 7f2dd0ff9700 1 -- 172.21.15.45:0/2891874902 --> [v2:172.21.15.45:6808/33775,v1:172.21.15.45:6809/33775] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2db40663c0 con 0x7f2db40638e0 2023-12-22T10:00:39.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.938+0000 7f2dd0ff9700 1 -- 172.21.15.45:0/2891874902 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2dcc077a90 con 0x7f2dd4151830 2023-12-22T10:00:39.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.938+0000 7f2dcb7fe700 1 --2- 172.21.15.45:0/2891874902 >> [v2:172.21.15.45:6808/33775,v1:172.21.15.45:6809/33775] conn(0x7f2db40638e0 0x7f2db4065d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:39.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.938+0000 7f2dd3fff700 1 --2- 172.21.15.45:0/2891874902 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f2db405a540 0x7f2db405ca00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f2dc4009fd0 tx=0x7f2dc4017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:39.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.942+0000 7f2dcb7fe700 1 --2- 172.21.15.45:0/2891874902 >> [v2:172.21.15.45:6808/33775,v1:172.21.15.45:6809/33775] conn(0x7f2db40638e0 0x7f2db4065d40 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:39.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.942+0000 7f2dd0ff9700 1 -- 172.21.15.45:0/2891874902 <== osd.1 v2:172.21.15.45:6808/33775 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7f2db40663c0 con 0x7f2db40638e0 2023-12-22T10:00:39.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.958+0000 7f2dd9279700 1 -- 172.21.15.45:0/2891874902 --> [v2:172.21.15.45:6808/33775,v1:172.21.15.45:6809/33775] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2dd40638d0 con 0x7f2db40638e0 2023-12-22T10:00:39.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.962+0000 7f2dd0ff9700 1 -- 172.21.15.45:0/2891874902 <== osd.1 v2:172.21.15.45:6808/33775 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2dd40638d0 con 0x7f2db40638e0 2023-12-22T10:00:39.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.962+0000 7f2dd9279700 1 -- 172.21.15.45:0/2891874902 >> [v2:172.21.15.45:6808/33775,v1:172.21.15.45:6809/33775] conn(0x7f2db40638e0 msgr2=0x7f2db4065d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:39.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.962+0000 7f2dd9279700 1 --2- 172.21.15.45:0/2891874902 >> [v2:172.21.15.45:6808/33775,v1:172.21.15.45:6809/33775] conn(0x7f2db40638e0 0x7f2db4065d40 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:39.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.962+0000 7f2dd9279700 1 -- 172.21.15.45:0/2891874902 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f2db405a540 msgr2=0x7f2db405ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:39.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.962+0000 7f2dd9279700 1 --2- 172.21.15.45:0/2891874902 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f2db405a540 0x7f2db405ca00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f2dc4009fd0 tx=0x7f2dc4017000).stop 2023-12-22T10:00:39.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.962+0000 7f2dd9279700 1 -- 172.21.15.45:0/2891874902 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2dd4151830 msgr2=0x7f2dd40c2230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:39.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.962+0000 7f2dd9279700 1 --2- 172.21.15.45:0/2891874902 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2dd4151830 0x7f2dd40c2230 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f2dcc00a380 tx=0x7f2dcc007900).stop 2023-12-22T10:00:39.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.962+0000 7f2dd8a78700 1 -- 172.21.15.45:0/2891874902 reap_dead start 2023-12-22T10:00:39.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.962+0000 7f2dd9279700 1 -- 172.21.15.45:0/2891874902 shutdown_connections 2023-12-22T10:00:39.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.962+0000 7f2dd9279700 1 -- 172.21.15.45:0/2891874902 >> 172.21.15.45:0/2891874902 conn(0x7f2dd40c77a0 msgr2=0x7f2dd40675d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:39.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.962+0000 7f2dd9279700 1 -- 172.21.15.45:0/2891874902 shutdown_connections 2023-12-22T10:00:39.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:39.962+0000 7f2dd9279700 1 -- 172.21.15.45:0/2891874902 wait complete. 2023-12-22T10:00:39.982 INFO:teuthology.orchestra.run.smithi045.stdout:55834574852 2023-12-22T10:00:39.982 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-12-22T10:00:40.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.158+0000 7f6c1928f700 1 Processor -- start 2023-12-22T10:00:40.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.158+0000 7f6c1928f700 1 -- start start 2023-12-22T10:00:40.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.162+0000 7f6c1928f700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f6c14157b50 0x7f6c14064f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:40.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.162+0000 7f6c1928f700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c14157f70 con 0x7f6c14157770 2023-12-22T10:00:40.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.162+0000 7f6c1928f700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c140658a0 con 0x7f6c14065410 2023-12-22T10:00:40.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.162+0000 7f6c1928f700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c140c1a70 con 0x7f6c14157b50 2023-12-22T10:00:40.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.162+0000 7f6c13fff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f6c14157770 0x7f6c14068a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59140/0 (socket says 172.21.15.45:59140) 2023-12-22T10:00:40.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.162+0000 7f6c13fff700 1 -- 172.21.15.45:0/3975366541 learned_addr learned my addr 172.21.15.45:0/3975366541 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:00:40.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.162+0000 7f6c137fe700 1 --2- 172.21.15.45:0/3975366541 >> v2:172.21.15.113:3300/0 conn(0x7f6c14157b50 0x7f6c14064f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:40.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.162+0000 7f6c137fe700 1 -- 172.21.15.45:0/3975366541 >> v1:172.21.15.113:6789/0 conn(0x7f6c14065410 legacy=0x7f6c140c1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:40.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.162+0000 7f6c12ffd700 1 -- 172.21.15.45:0/3975366541 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 496723115 0 0) 0x7f6c04001110 con 0x7f6c14157770 2023-12-22T10:00:40.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.162+0000 7f6c137fe700 1 -- 172.21.15.45:0/3975366541 >> v1:172.21.15.45:6789/0 conn(0x7f6c14157770 legacy=0x7f6c14068a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:40.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.162+0000 7f6c137fe700 1 -- 172.21.15.45:0/3975366541 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c14158430 con 0x7f6c14157b50 2023-12-22T10:00:40.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.162+0000 7f6c137fe700 1 --2- 172.21.15.45:0/3975366541 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6c14157b50 0x7f6c14064f20 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f6c08009760 tx=0x7f6c08009060).ready entity=mon.1 client_cookie=45fcae1708216609 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:40.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.162+0000 7f6c12ffd700 1 -- 172.21.15.45:0/3975366541 <== mon.1 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c0800b580 con 0x7f6c14157b50 2023-12-22T10:00:40.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.162+0000 7f6c12ffd700 1 -- 172.21.15.45:0/3975366541 <== mon.1 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c0800b6e0 con 0x7f6c14157b50 2023-12-22T10:00:40.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.162+0000 7f6c12ffd700 1 -- 172.21.15.45:0/3975366541 <== mon.1 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c0800ba60 con 0x7f6c14157b50 2023-12-22T10:00:40.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.166+0000 7f6c1928f700 1 -- 172.21.15.45:0/3975366541 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6c14157b50 msgr2=0x7f6c14064f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:40.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.166+0000 7f6c1928f700 1 --2- 172.21.15.45:0/3975366541 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6c14157b50 0x7f6c14064f20 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f6c08009760 tx=0x7f6c08009060).stop 2023-12-22T10:00:40.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.166+0000 7f6c1928f700 1 -- 172.21.15.45:0/3975366541 shutdown_connections 2023-12-22T10:00:40.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.166+0000 7f6c1928f700 1 --2- 172.21.15.45:0/3975366541 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6c14157b50 0x7f6c14064f20 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:40.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.166+0000 7f6c1928f700 1 -- 172.21.15.45:0/3975366541 >> 172.21.15.45:0/3975366541 conn(0x7f6c14067500 msgr2=0x7f6c140c6400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:40.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.166+0000 7f6c1928f700 1 -- 172.21.15.45:0/3975366541 shutdown_connections 2023-12-22T10:00:40.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.166+0000 7f6c1928f700 1 -- 172.21.15.45:0/3975366541 wait complete. 2023-12-22T10:00:40.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.166+0000 7f6c1928f700 1 Processor -- start 2023-12-22T10:00:40.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.170+0000 7f6c1928f700 1 -- start start 2023-12-22T10:00:40.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.170+0000 7f6c1928f700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f6c14065410 0x7f6c14144180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:40.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.170+0000 7f6c1928f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c14157770 0x7f6c140be9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:40.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.170+0000 7f6c1928f700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6c14157b50 0x7f6c140aa7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:40.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.170+0000 7f6c1928f700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c140bff90 con 0x7f6c14157770 2023-12-22T10:00:40.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.170+0000 7f6c1928f700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c140bf380 con 0x7f6c14157b50 2023-12-22T10:00:40.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.170+0000 7f6c1928f700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c140bf660 con 0x7f6c14065410 2023-12-22T10:00:40.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.170+0000 7f6c137fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c14157770 0x7f6c140be9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:40.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.170+0000 7f6c137fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c14157770 0x7f6c140be9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48252/0 (socket says 172.21.15.45:48252) 2023-12-22T10:00:40.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.170+0000 7f6c137fe700 1 -- 172.21.15.45:0/1549581113 learned_addr learned my addr 172.21.15.45:0/1549581113 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:40.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.170+0000 7f6c13fff700 1 --2- 172.21.15.45:0/1549581113 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f6c14065410 0x7f6c14144180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:40.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.170+0000 7f6c18a8e700 1 --2- 172.21.15.45:0/1549581113 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6c14157b50 0x7f6c140aa7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:40.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.170+0000 7f6c137fe700 1 -- 172.21.15.45:0/1549581113 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f6c14065410 msgr2=0x7f6c14144180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:40.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.170+0000 7f6c137fe700 1 --2- 172.21.15.45:0/1549581113 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f6c14065410 0x7f6c14144180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:40.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.170+0000 7f6c137fe700 1 -- 172.21.15.45:0/1549581113 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6c14157b50 msgr2=0x7f6c140aa7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:40.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.170+0000 7f6c137fe700 1 --2- 172.21.15.45:0/1549581113 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6c14157b50 0x7f6c140aa7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:40.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.170+0000 7f6c137fe700 1 -- 172.21.15.45:0/1549581113 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c080092a0 con 0x7f6c14157770 2023-12-22T10:00:40.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.170+0000 7f6c18a8e700 1 --2- 172.21.15.45:0/1549581113 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6c14157b50 0x7f6c140aa7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T10:00:40.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.170+0000 7f6c137fe700 1 --2- 172.21.15.45:0/1549581113 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c14157770 0x7f6c140be9f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f6c08009eb0 tx=0x7f6c08017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:40.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.170+0000 7f6bfbfff700 1 -- 172.21.15.45:0/1549581113 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c0800b850 con 0x7f6c14157770 2023-12-22T10:00:40.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.170+0000 7f6bfbfff700 1 -- 172.21.15.45:0/1549581113 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c0800b9b0 con 0x7f6c14157770 2023-12-22T10:00:40.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.170+0000 7f6c1928f700 1 -- 172.21.15.45:0/1549581113 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c140bf940 con 0x7f6c14157770 2023-12-22T10:00:40.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.170+0000 7f6bfbfff700 1 -- 172.21.15.45:0/1549581113 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c0801b640 con 0x7f6c14157770 2023-12-22T10:00:40.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.170+0000 7f6c1928f700 1 -- 172.21.15.45:0/1549581113 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c14144670 con 0x7f6c14157770 2023-12-22T10:00:40.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.174+0000 7f6c1928f700 1 -- 172.21.15.45:0/1549581113 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6c140c0420 con 0x7f6c14157770 2023-12-22T10:00:40.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.174+0000 7f6bfbfff700 1 -- 172.21.15.45:0/1549581113 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f6c0801b9f0 con 0x7f6c14157770 2023-12-22T10:00:40.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.174+0000 7f6bfbfff700 1 --2- 172.21.15.45:0/1549581113 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f6c0005a510 0x7f6c0005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:40.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.178+0000 7f6bfbfff700 1 -- 172.21.15.45:0/1549581113 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f6c08076170 con 0x7f6c14157770 2023-12-22T10:00:40.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.178+0000 7f6bfbfff700 1 --2- 172.21.15.45:0/1549581113 >> [v2:172.21.15.45:6800/33776,v1:172.21.15.45:6801/33776] conn(0x7f6c000638b0 0x7f6c00065d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:40.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.178+0000 7f6bfbfff700 1 -- 172.21.15.45:0/1549581113 --> [v2:172.21.15.45:6800/33776,v1:172.21.15.45:6801/33776] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6c00066390 con 0x7f6c000638b0 2023-12-22T10:00:40.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.178+0000 7f6bfbfff700 1 -- 172.21.15.45:0/1549581113 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6c08078790 con 0x7f6c14157770 2023-12-22T10:00:40.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.178+0000 7f6c13fff700 1 --2- 172.21.15.45:0/1549581113 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f6c0005a510 0x7f6c0005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:40.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.178+0000 7f6c18a8e700 1 --2- 172.21.15.45:0/1549581113 >> [v2:172.21.15.45:6800/33776,v1:172.21.15.45:6801/33776] conn(0x7f6c000638b0 0x7f6c00065d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:40.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.178+0000 7f6c13fff700 1 --2- 172.21.15.45:0/1549581113 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f6c0005a510 0x7f6c0005c9d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f6c04007fd0 tx=0x7f6c040079f0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:40.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.178+0000 7f6c18a8e700 1 --2- 172.21.15.45:0/1549581113 >> [v2:172.21.15.45:6800/33776,v1:172.21.15.45:6801/33776] conn(0x7f6c000638b0 0x7f6c00065d10 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:40.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.178+0000 7f6bfbfff700 1 -- 172.21.15.45:0/1549581113 <== osd.2 v2:172.21.15.45:6800/33776 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7f6c00066390 con 0x7f6c000638b0 2023-12-22T10:00:40.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.198+0000 7f6c1928f700 1 -- 172.21.15.45:0/1549581113 --> [v2:172.21.15.45:6800/33776,v1:172.21.15.45:6801/33776] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6c14047060 con 0x7f6c000638b0 2023-12-22T10:00:40.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.198+0000 7f6bfbfff700 1 -- 172.21.15.45:0/1549581113 <== osd.2 v2:172.21.15.45:6800/33776 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6c14047060 con 0x7f6c000638b0 2023-12-22T10:00:40.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.202+0000 7f6c1928f700 1 -- 172.21.15.45:0/1549581113 >> [v2:172.21.15.45:6800/33776,v1:172.21.15.45:6801/33776] conn(0x7f6c000638b0 msgr2=0x7f6c00065d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:40.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.202+0000 7f6c1928f700 1 --2- 172.21.15.45:0/1549581113 >> [v2:172.21.15.45:6800/33776,v1:172.21.15.45:6801/33776] conn(0x7f6c000638b0 0x7f6c00065d10 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:40.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.202+0000 7f6c1928f700 1 -- 172.21.15.45:0/1549581113 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f6c0005a510 msgr2=0x7f6c0005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:40.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.202+0000 7f6c1928f700 1 --2- 172.21.15.45:0/1549581113 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f6c0005a510 0x7f6c0005c9d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f6c04007fd0 tx=0x7f6c040079f0).stop 2023-12-22T10:00:40.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.202+0000 7f6c1928f700 1 -- 172.21.15.45:0/1549581113 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c14157770 msgr2=0x7f6c140be9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:40.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.202+0000 7f6c1928f700 1 --2- 172.21.15.45:0/1549581113 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c14157770 0x7f6c140be9f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f6c08009eb0 tx=0x7f6c08017000).stop 2023-12-22T10:00:40.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.202+0000 7f6c18a8e700 1 -- 172.21.15.45:0/1549581113 reap_dead start 2023-12-22T10:00:40.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.202+0000 7f6c1928f700 1 -- 172.21.15.45:0/1549581113 shutdown_connections 2023-12-22T10:00:40.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.202+0000 7f6c1928f700 1 -- 172.21.15.45:0/1549581113 >> 172.21.15.45:0/1549581113 conn(0x7f6c14067500 msgr2=0x7f6c140c5780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:40.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.202+0000 7f6c1928f700 1 -- 172.21.15.45:0/1549581113 shutdown_connections 2023-12-22T10:00:40.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.202+0000 7f6c1928f700 1 -- 172.21.15.45:0/1549581113 wait complete. 2023-12-22T10:00:40.221 INFO:teuthology.orchestra.run.smithi045.stdout:55834574853 2023-12-22T10:00:40.221 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-12-22T10:00:40.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.390+0000 7fa1bae5b700 1 Processor -- start 2023-12-22T10:00:40.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.390+0000 7fa1bae5b700 1 -- start start 2023-12-22T10:00:40.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.394+0000 7fa1bae5b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa1b41537c0 0x7fa1b4153ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:40.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.394+0000 7fa1bae5b700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fa1b4158060 0x7fa1b40ca1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:40.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.394+0000 7fa1bae5b700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fa1b40c7460 0x7fa1b40c78f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:40.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.394+0000 7fa1bae5b700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1b40c7de0 con 0x7fa1b41537c0 2023-12-22T10:00:40.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.394+0000 7fa1bae5b700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1b40c9120 con 0x7fa1b40c7460 2023-12-22T10:00:40.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.394+0000 7fa1bae5b700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b40c9400 con 0x7fa1b4158060 2023-12-22T10:00:40.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.394+0000 7fa1b8bf7700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa1b41537c0 0x7fa1b4153ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:40.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.394+0000 7fa1b8bf7700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa1b41537c0 0x7fa1b4153ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48264/0 (socket says 172.21.15.45:48264) 2023-12-22T10:00:40.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.394+0000 7fa1b8bf7700 1 -- 172.21.15.45:0/1226583833 learned_addr learned my addr 172.21.15.45:0/1226583833 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:40.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.394+0000 7fa1b3fff700 1 --2- 172.21.15.45:0/1226583833 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fa1b4158060 0x7fa1b40ca1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:40.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.394+0000 7fa1b93f8700 1 --2- 172.21.15.45:0/1226583833 >> v2:172.21.15.113:3300/0 conn(0x7fa1b40c7460 0x7fa1b40c78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:40.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.394+0000 7fa1b8bf7700 1 -- 172.21.15.45:0/1226583833 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fa1b4158060 msgr2=0x7fa1b40ca1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:00:40.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.394+0000 7fa1b8bf7700 1 --2- 172.21.15.45:0/1226583833 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fa1b4158060 0x7fa1b40ca1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:40.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.394+0000 7fa1b8bf7700 1 -- 172.21.15.45:0/1226583833 >> v2:172.21.15.113:3300/0 conn(0x7fa1b40c7460 msgr2=0x7fa1b40c78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:00:40.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.394+0000 7fa1b8bf7700 1 --2- 172.21.15.45:0/1226583833 >> v2:172.21.15.113:3300/0 conn(0x7fa1b40c7460 0x7fa1b40c78f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:40.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.394+0000 7fa1b8bf7700 1 -- 172.21.15.45:0/1226583833 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1b40c96e0 con 0x7fa1b41537c0 2023-12-22T10:00:40.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.394+0000 7fa1b8bf7700 1 --2- 172.21.15.45:0/1226583833 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa1b41537c0 0x7fa1b4153ba0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7fa1b40c4fe0 tx=0x7fa1a80090f0).ready entity=mon.0 client_cookie=1d6462235d3ce890 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:40.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.394+0000 7fa1b37fe700 1 -- 172.21.15.45:0/1226583833 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a800b600 con 0x7fa1b41537c0 2023-12-22T10:00:40.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.394+0000 7fa1b37fe700 1 -- 172.21.15.45:0/1226583833 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1a800b760 con 0x7fa1b41537c0 2023-12-22T10:00:40.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.394+0000 7fa1b37fe700 1 -- 172.21.15.45:0/1226583833 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a800bae0 con 0x7fa1b41537c0 2023-12-22T10:00:40.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.398+0000 7fa1bae5b700 1 -- 172.21.15.45:0/1226583833 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa1b41537c0 msgr2=0x7fa1b4153ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:40.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.398+0000 7fa1bae5b700 1 --2- 172.21.15.45:0/1226583833 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa1b41537c0 0x7fa1b4153ba0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7fa1b40c4fe0 tx=0x7fa1a80090f0).stop 2023-12-22T10:00:40.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.398+0000 7fa1bae5b700 1 -- 172.21.15.45:0/1226583833 shutdown_connections 2023-12-22T10:00:40.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.398+0000 7fa1bae5b700 1 --2- 172.21.15.45:0/1226583833 >> v2:172.21.15.113:3300/0 conn(0x7fa1b40c7460 0x7fa1b40c78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:40.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.398+0000 7fa1bae5b700 1 --2- 172.21.15.45:0/1226583833 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fa1b4158060 0x7fa1b40ca1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:40.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.398+0000 7fa1bae5b700 1 --2- 172.21.15.45:0/1226583833 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa1b41537c0 0x7fa1b4153ba0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:40.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.398+0000 7fa1bae5b700 1 -- 172.21.15.45:0/1226583833 >> 172.21.15.45:0/1226583833 conn(0x7fa1b4066a70 msgr2=0x7fa1b4066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:40.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.398+0000 7fa1bae5b700 1 -- 172.21.15.45:0/1226583833 shutdown_connections 2023-12-22T10:00:40.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.398+0000 7fa1bae5b700 1 -- 172.21.15.45:0/1226583833 wait complete. 2023-12-22T10:00:40.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.398+0000 7fa1bae5b700 1 Processor -- start 2023-12-22T10:00:40.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.402+0000 7fa1bae5b700 1 -- start start 2023-12-22T10:00:40.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.402+0000 7fa1bae5b700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa1b40c7460 0x7fa1b40c43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:40.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.402+0000 7fa1bae5b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa1b41537c0 0x7fa1b4156780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:40.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.402+0000 7fa1bae5b700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fa1b4158060 0x7fa1b40ae350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:40.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.402+0000 7fa1bae5b700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b40c3f40 con 0x7fa1b41537c0 2023-12-22T10:00:40.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.402+0000 7fa1bae5b700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b40c3330 con 0x7fa1b40c7460 2023-12-22T10:00:40.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.402+0000 7fa1bae5b700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b40c3610 con 0x7fa1b4158060 2023-12-22T10:00:40.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.402+0000 7fa1b3fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa1b41537c0 0x7fa1b4156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:40.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.402+0000 7fa1b3fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa1b41537c0 0x7fa1b4156780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48276/0 (socket says 172.21.15.45:48276) 2023-12-22T10:00:40.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.402+0000 7fa1b3fff700 1 -- 172.21.15.45:0/1756025963 learned_addr learned my addr 172.21.15.45:0/1756025963 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:40.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.402+0000 7fa1b8bf7700 1 --2- 172.21.15.45:0/1756025963 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa1b40c7460 0x7fa1b40c43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:40.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.402+0000 7fa1b93f8700 1 --2- 172.21.15.45:0/1756025963 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fa1b4158060 0x7fa1b40ae350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:40.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.402+0000 7fa1b3fff700 1 -- 172.21.15.45:0/1756025963 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fa1b4158060 msgr2=0x7fa1b40ae350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:40.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.402+0000 7fa1b3fff700 1 --2- 172.21.15.45:0/1756025963 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fa1b4158060 0x7fa1b40ae350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:40.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.402+0000 7fa1b3fff700 1 -- 172.21.15.45:0/1756025963 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa1b40c7460 msgr2=0x7fa1b40c43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:40.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.402+0000 7fa1b3fff700 1 --2- 172.21.15.45:0/1756025963 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa1b40c7460 0x7fa1b40c43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:40.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.402+0000 7fa1b3fff700 1 -- 172.21.15.45:0/1756025963 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1a8009370 con 0x7fa1b41537c0 2023-12-22T10:00:40.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.402+0000 7fa1b8bf7700 1 --2- 172.21.15.45:0/1756025963 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa1b40c7460 0x7fa1b40c43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T10:00:40.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.402+0000 7fa1b3fff700 1 --2- 172.21.15.45:0/1756025963 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa1b41537c0 0x7fa1b4156780 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fa1a0006920 tx=0x7fa1a0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:40.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.402+0000 7fa1b0ff9700 1 -- 172.21.15.45:0/1756025963 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a00125f0 con 0x7fa1b41537c0 2023-12-22T10:00:40.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.406+0000 7fa1b0ff9700 1 -- 172.21.15.45:0/1756025963 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1a0012750 con 0x7fa1b41537c0 2023-12-22T10:00:40.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.406+0000 7fa1bae5b700 1 -- 172.21.15.45:0/1756025963 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1b40c38f0 con 0x7fa1b41537c0 2023-12-22T10:00:40.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.406+0000 7fa1b0ff9700 1 -- 172.21.15.45:0/1756025963 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a0012ad0 con 0x7fa1b41537c0 2023-12-22T10:00:40.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.406+0000 7fa1bae5b700 1 -- 172.21.15.45:0/1756025963 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1b4156c70 con 0x7fa1b41537c0 2023-12-22T10:00:40.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.406+0000 7fa1bae5b700 1 -- 172.21.15.45:0/1756025963 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa1b406c070 con 0x7fa1b41537c0 2023-12-22T10:00:40.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.406+0000 7fa1b0ff9700 1 -- 172.21.15.45:0/1756025963 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fa1a0013480 con 0x7fa1b41537c0 2023-12-22T10:00:40.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.410+0000 7fa1b0ff9700 1 --2- 172.21.15.45:0/1756025963 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fa19805a540 0x7fa19805ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:40.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.410+0000 7fa1b0ff9700 1 -- 172.21.15.45:0/1756025963 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fa1a0074bb0 con 0x7fa1b41537c0 2023-12-22T10:00:40.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.410+0000 7fa1b8bf7700 1 --2- 172.21.15.45:0/1756025963 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fa19805a540 0x7fa19805ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:40.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.410+0000 7fa1b0ff9700 1 --2- 172.21.15.45:0/1756025963 >> [v2:172.21.15.45:6816/33782,v1:172.21.15.45:6817/33782] conn(0x7fa1980638e0 0x7fa198065d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:40.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.410+0000 7fa1b0ff9700 1 -- 172.21.15.45:0/1756025963 --> [v2:172.21.15.45:6816/33782,v1:172.21.15.45:6817/33782] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa1980663c0 con 0x7fa1980638e0 2023-12-22T10:00:40.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.410+0000 7fa1b0ff9700 1 -- 172.21.15.45:0/1756025963 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa1a00791e0 con 0x7fa1b41537c0 2023-12-22T10:00:40.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.410+0000 7fa1b93f8700 1 --2- 172.21.15.45:0/1756025963 >> [v2:172.21.15.45:6816/33782,v1:172.21.15.45:6817/33782] conn(0x7fa1980638e0 0x7fa198065d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:40.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.410+0000 7fa1b8bf7700 1 --2- 172.21.15.45:0/1756025963 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fa19805a540 0x7fa19805ca00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fa1a8009130 tx=0x7fa1a8017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:40.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.410+0000 7fa1b93f8700 1 --2- 172.21.15.45:0/1756025963 >> [v2:172.21.15.45:6816/33782,v1:172.21.15.45:6817/33782] conn(0x7fa1980638e0 0x7fa198065d40 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:40.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.414+0000 7fa1b0ff9700 1 -- 172.21.15.45:0/1756025963 <== osd.3 v2:172.21.15.45:6816/33782 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7fa1980663c0 con 0x7fa1980638e0 2023-12-22T10:00:40.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.430+0000 7fa1bae5b700 1 -- 172.21.15.45:0/1756025963 --> [v2:172.21.15.45:6816/33782,v1:172.21.15.45:6817/33782] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa1b40c4080 con 0x7fa1980638e0 2023-12-22T10:00:40.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.430+0000 7fa1b0ff9700 1 -- 172.21.15.45:0/1756025963 <== osd.3 v2:172.21.15.45:6816/33782 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa1b40c4080 con 0x7fa1980638e0 2023-12-22T10:00:40.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.430+0000 7fa1bae5b700 1 -- 172.21.15.45:0/1756025963 >> [v2:172.21.15.45:6816/33782,v1:172.21.15.45:6817/33782] conn(0x7fa1980638e0 msgr2=0x7fa198065d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:40.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.430+0000 7fa1bae5b700 1 --2- 172.21.15.45:0/1756025963 >> [v2:172.21.15.45:6816/33782,v1:172.21.15.45:6817/33782] conn(0x7fa1980638e0 0x7fa198065d40 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:40.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.430+0000 7fa1bae5b700 1 -- 172.21.15.45:0/1756025963 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fa19805a540 msgr2=0x7fa19805ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:40.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.430+0000 7fa1bae5b700 1 --2- 172.21.15.45:0/1756025963 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fa19805a540 0x7fa19805ca00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fa1a8009130 tx=0x7fa1a8017000).stop 2023-12-22T10:00:40.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.430+0000 7fa1bae5b700 1 -- 172.21.15.45:0/1756025963 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa1b41537c0 msgr2=0x7fa1b4156780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:40.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.434+0000 7fa1bae5b700 1 --2- 172.21.15.45:0/1756025963 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa1b41537c0 0x7fa1b4156780 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fa1a0006920 tx=0x7fa1a0008040).stop 2023-12-22T10:00:40.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.434+0000 7fa1b93f8700 1 -- 172.21.15.45:0/1756025963 reap_dead start 2023-12-22T10:00:40.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.434+0000 7fa1bae5b700 1 -- 172.21.15.45:0/1756025963 shutdown_connections 2023-12-22T10:00:40.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.434+0000 7fa1bae5b700 1 -- 172.21.15.45:0/1756025963 >> 172.21.15.45:0/1756025963 conn(0x7fa1b4066a70 msgr2=0x7fa1b40ca0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:40.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.434+0000 7fa1bae5b700 1 -- 172.21.15.45:0/1756025963 shutdown_connections 2023-12-22T10:00:40.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.434+0000 7fa1bae5b700 1 -- 172.21.15.45:0/1756025963 wait complete. 2023-12-22T10:00:40.448 INFO:teuthology.orchestra.run.smithi045.stdout:55834574852 2023-12-22T10:00:40.449 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-12-22T10:00:40.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.626+0000 7f11e489a700 1 Processor -- start 2023-12-22T10:00:40.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.626+0000 7f11e489a700 1 -- start start 2023-12-22T10:00:40.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.630+0000 7f11e489a700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f11e00c0110 0x7f11e00c04f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:40.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.630+0000 7f11e489a700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f11e00cb130 0x7f11e00c5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:40.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.630+0000 7f11e489a700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f11e00c6180 0x7f11e0068b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:40.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.630+0000 7f11e489a700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11e00c6c20 con 0x7f11e00c0110 2023-12-22T10:00:40.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.630+0000 7f11e489a700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11e00aa9b0 con 0x7f11e00c6180 2023-12-22T10:00:40.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.630+0000 7f11e489a700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11e00c6660 con 0x7f11e00cb130 2023-12-22T10:00:40.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.630+0000 7f11ded9d700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f11e00c0110 0x7f11e00c04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:40.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.630+0000 7f11ded9d700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f11e00c0110 0x7f11e00c04f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48292/0 (socket says 172.21.15.45:48292) 2023-12-22T10:00:40.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.630+0000 7f11de59c700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f11e00cb130 0x7f11e00c5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:40.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.630+0000 7f11ded9d700 1 -- 172.21.15.45:0/4011579318 learned_addr learned my addr 172.21.15.45:0/4011579318 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:40.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.630+0000 7f11df59e700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f11e00c6180 0x7f11e0068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:40.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.634+0000 7f11ded9d700 1 -- 172.21.15.45:0/4011579318 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f11e00cb130 msgr2=0x7f11e00c5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:00:40.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.634+0000 7f11ded9d700 1 --2- 172.21.15.45:0/4011579318 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f11e00cb130 0x7f11e00c5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:40.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.634+0000 7f11ded9d700 1 -- 172.21.15.45:0/4011579318 >> v2:172.21.15.113:3300/0 conn(0x7f11e00c6180 msgr2=0x7f11e0068b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:00:40.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.634+0000 7f11ded9d700 1 --2- 172.21.15.45:0/4011579318 >> v2:172.21.15.113:3300/0 conn(0x7f11e00c6180 0x7f11e0068b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:40.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.634+0000 7f11ded9d700 1 -- 172.21.15.45:0/4011579318 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11e00c6940 con 0x7f11e00c0110 2023-12-22T10:00:40.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.634+0000 7f11ded9d700 1 --2- 172.21.15.45:0/4011579318 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11e00c0110 0x7f11e00c04f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f11e00c83f0 tx=0x7f11d00090f0).ready entity=mon.0 client_cookie=bf32d53e47d370e1 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:40.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.634+0000 7f11ddd9b700 1 -- 172.21.15.45:0/4011579318 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d000f510 con 0x7f11e00c0110 2023-12-22T10:00:40.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.634+0000 7f11ddd9b700 1 -- 172.21.15.45:0/4011579318 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11d000f670 con 0x7f11e00c0110 2023-12-22T10:00:40.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.634+0000 7f11ddd9b700 1 -- 172.21.15.45:0/4011579318 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d000f9f0 con 0x7f11e00c0110 2023-12-22T10:00:40.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.634+0000 7f11e489a700 1 -- 172.21.15.45:0/4011579318 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11e00c0110 msgr2=0x7f11e00c04f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:40.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.634+0000 7f11e489a700 1 --2- 172.21.15.45:0/4011579318 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11e00c0110 0x7f11e00c04f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f11e00c83f0 tx=0x7f11d00090f0).stop 2023-12-22T10:00:40.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.634+0000 7f11e489a700 1 -- 172.21.15.45:0/4011579318 shutdown_connections 2023-12-22T10:00:40.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.634+0000 7f11e489a700 1 --2- 172.21.15.45:0/4011579318 >> v2:172.21.15.113:3300/0 conn(0x7f11e00c6180 0x7f11e0068b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:40.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.634+0000 7f11e489a700 1 --2- 172.21.15.45:0/4011579318 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f11e00cb130 0x7f11e00c5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:40.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.634+0000 7f11e489a700 1 --2- 172.21.15.45:0/4011579318 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11e00c0110 0x7f11e00c04f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:40.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.634+0000 7f11e489a700 1 -- 172.21.15.45:0/4011579318 >> 172.21.15.45:0/4011579318 conn(0x7f11e0067540 msgr2=0x7f11e00ca940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:40.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.634+0000 7f11e489a700 1 -- 172.21.15.45:0/4011579318 shutdown_connections 2023-12-22T10:00:40.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.634+0000 7f11e489a700 1 -- 172.21.15.45:0/4011579318 wait complete. 2023-12-22T10:00:40.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.638+0000 7f11e489a700 1 Processor -- start 2023-12-22T10:00:40.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.638+0000 7f11e489a700 1 -- start start 2023-12-22T10:00:40.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.638+0000 7f11e489a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11e00c0110 0x7f11e00c4530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:40.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.638+0000 7f11e489a700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f11e00c6180 0x7f11e0168820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:40.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.638+0000 7f11e489a700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f11e00cb130 0x7f11e0168d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:40.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.638+0000 7f11e489a700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11e0169870 con 0x7f11e00c0110 2023-12-22T10:00:40.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.638+0000 7f11e489a700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11e00af130 con 0x7f11e00cb130 2023-12-22T10:00:40.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.638+0000 7f11e489a700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11e01692b0 con 0x7f11e00c6180 2023-12-22T10:00:40.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.642+0000 7f11ded9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11e00c0110 0x7f11e00c4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:40.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.642+0000 7f11ded9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11e00c0110 0x7f11e00c4530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48308/0 (socket says 172.21.15.45:48308) 2023-12-22T10:00:40.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.642+0000 7f11ded9d700 1 -- 172.21.15.45:0/2144555558 learned_addr learned my addr 172.21.15.45:0/2144555558 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:40.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.642+0000 7f11de59c700 1 --2- 172.21.15.45:0/2144555558 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f11e00c6180 0x7f11e0168820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:40.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.642+0000 7f11df59e700 1 --2- 172.21.15.45:0/2144555558 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f11e00cb130 0x7f11e0168d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:40.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.642+0000 7f11ded9d700 1 -- 172.21.15.45:0/2144555558 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f11e00c6180 msgr2=0x7f11e0168820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:40.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.642+0000 7f11ded9d700 1 --2- 172.21.15.45:0/2144555558 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f11e00c6180 0x7f11e0168820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:40.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.642+0000 7f11ded9d700 1 -- 172.21.15.45:0/2144555558 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f11e00cb130 msgr2=0x7f11e0168d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:40.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.642+0000 7f11ded9d700 1 --2- 172.21.15.45:0/2144555558 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f11e00cb130 0x7f11e0168d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:40.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.642+0000 7f11ded9d700 1 -- 172.21.15.45:0/2144555558 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11d0009370 con 0x7f11e00c0110 2023-12-22T10:00:40.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.642+0000 7f11ded9d700 1 --2- 172.21.15.45:0/2144555558 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11e00c0110 0x7f11e00c4530 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f11e0066760 tx=0x7f11d0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:40.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.642+0000 7f11c6ffd700 1 -- 172.21.15.45:0/2144555558 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d000f7e0 con 0x7f11e00c0110 2023-12-22T10:00:40.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.642+0000 7f11c6ffd700 1 -- 172.21.15.45:0/2144555558 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11d000f940 con 0x7f11e00c0110 2023-12-22T10:00:40.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.642+0000 7f11c6ffd700 1 -- 172.21.15.45:0/2144555558 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d001c670 con 0x7f11e00c0110 2023-12-22T10:00:40.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.642+0000 7f11e489a700 1 -- 172.21.15.45:0/2144555558 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11e0169590 con 0x7f11e00c0110 2023-12-22T10:00:40.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.642+0000 7f11e489a700 1 -- 172.21.15.45:0/2144555558 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11e00c28d0 con 0x7f11e00c0110 2023-12-22T10:00:40.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.642+0000 7f11e489a700 1 -- 172.21.15.45:0/2144555558 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f11e00aec20 con 0x7f11e00c0110 2023-12-22T10:00:40.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.646+0000 7f11c6ffd700 1 -- 172.21.15.45:0/2144555558 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f11d001ca60 con 0x7f11e00c0110 2023-12-22T10:00:40.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.646+0000 7f11c6ffd700 1 --2- 172.21.15.45:0/2144555558 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f11cc05a510 0x7f11cc05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:40.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.646+0000 7f11c6ffd700 1 -- 172.21.15.45:0/2144555558 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f11d0076380 con 0x7f11e00c0110 2023-12-22T10:00:40.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.646+0000 7f11c6ffd700 1 --2- 172.21.15.45:0/2144555558 >> [v2:172.21.15.113:6809/34099,v1:172.21.15.113:6811/34099] conn(0x7f11cc0638b0 0x7f11cc065d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:40.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.646+0000 7f11c6ffd700 1 -- 172.21.15.45:0/2144555558 --> [v2:172.21.15.113:6809/34099,v1:172.21.15.113:6811/34099] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f11cc066390 con 0x7f11cc0638b0 2023-12-22T10:00:40.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.646+0000 7f11c6ffd700 1 -- 172.21.15.45:0/2144555558 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f11d00788e0 con 0x7f11e00c0110 2023-12-22T10:00:40.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.646+0000 7f11de59c700 1 --2- 172.21.15.45:0/2144555558 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f11cc05a510 0x7f11cc05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:40.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.646+0000 7f11df59e700 1 --2- 172.21.15.45:0/2144555558 >> [v2:172.21.15.113:6809/34099,v1:172.21.15.113:6811/34099] conn(0x7f11cc0638b0 0x7f11cc065d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:40.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.646+0000 7f11de59c700 1 --2- 172.21.15.45:0/2144555558 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f11cc05a510 0x7f11cc05c9d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f11e0065ac0 tx=0x7f11d4009060).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:40.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.646+0000 7f11df59e700 1 --2- 172.21.15.45:0/2144555558 >> [v2:172.21.15.113:6809/34099,v1:172.21.15.113:6811/34099] conn(0x7f11cc0638b0 0x7f11cc065d10 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:40.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.650+0000 7f11c6ffd700 1 -- 172.21.15.45:0/2144555558 <== osd.4 v2:172.21.15.113:6809/34099 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7f11cc066390 con 0x7f11cc0638b0 2023-12-22T10:00:40.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.670+0000 7f11e489a700 1 -- 172.21.15.45:0/2144555558 --> [v2:172.21.15.113:6809/34099,v1:172.21.15.113:6811/34099] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f11e00af270 con 0x7f11cc0638b0 2023-12-22T10:00:40.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.670+0000 7f11c6ffd700 1 -- 172.21.15.45:0/2144555558 <== osd.4 v2:172.21.15.113:6809/34099 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f11d800f040 con 0x7f11cc0638b0 2023-12-22T10:00:40.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.670+0000 7f11e489a700 1 -- 172.21.15.45:0/2144555558 >> [v2:172.21.15.113:6809/34099,v1:172.21.15.113:6811/34099] conn(0x7f11cc0638b0 msgr2=0x7f11cc065d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:40.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.670+0000 7f11e489a700 1 --2- 172.21.15.45:0/2144555558 >> [v2:172.21.15.113:6809/34099,v1:172.21.15.113:6811/34099] conn(0x7f11cc0638b0 0x7f11cc065d10 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:40.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.670+0000 7f11e489a700 1 -- 172.21.15.45:0/2144555558 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f11cc05a510 msgr2=0x7f11cc05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:40.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.670+0000 7f11e489a700 1 --2- 172.21.15.45:0/2144555558 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f11cc05a510 0x7f11cc05c9d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f11e0065ac0 tx=0x7f11d4009060).stop 2023-12-22T10:00:40.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.670+0000 7f11e489a700 1 -- 172.21.15.45:0/2144555558 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11e00c0110 msgr2=0x7f11e00c4530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:40.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.670+0000 7f11e489a700 1 --2- 172.21.15.45:0/2144555558 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11e00c0110 0x7f11e00c4530 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f11e0066760 tx=0x7f11d0017000).stop 2023-12-22T10:00:40.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.670+0000 7f11df59e700 1 -- 172.21.15.45:0/2144555558 reap_dead start 2023-12-22T10:00:40.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.670+0000 7f11e489a700 1 -- 172.21.15.45:0/2144555558 shutdown_connections 2023-12-22T10:00:40.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.670+0000 7f11e489a700 1 -- 172.21.15.45:0/2144555558 >> 172.21.15.45:0/2144555558 conn(0x7f11e0067540 msgr2=0x7f11e00c90a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:40.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.670+0000 7f11e489a700 1 -- 172.21.15.45:0/2144555558 shutdown_connections 2023-12-22T10:00:40.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.670+0000 7f11e489a700 1 -- 172.21.15.45:0/2144555558 wait complete. 2023-12-22T10:00:40.690 INFO:teuthology.orchestra.run.smithi045.stdout:55834574852 2023-12-22T10:00:40.690 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-12-22T10:00:40.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.858+0000 7fb82961b700 1 Processor -- start 2023-12-22T10:00:40.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.862+0000 7fb82961b700 1 -- start start 2023-12-22T10:00:40.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.862+0000 7fb82961b700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb8241518f0 0x7fb824064890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:40.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.862+0000 7fb82961b700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb824155740 con 0x7fb824151cd0 2023-12-22T10:00:40.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.862+0000 7fb82961b700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8240a61b0 con 0x7fb8240a7420 2023-12-22T10:00:40.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.862+0000 7fb82961b700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8240c40f0 con 0x7fb8241518f0 2023-12-22T10:00:40.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.862+0000 7fb81a7fc700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fb824151cd0 0x7fb8240a6d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59156/0 (socket says 172.21.15.45:59156) 2023-12-22T10:00:40.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.862+0000 7fb81a7fc700 1 -- 172.21.15.45:0/1854442974 learned_addr learned my addr 172.21.15.45:0/1854442974 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:00:40.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.862+0000 7fb822ffd700 1 --2- 172.21.15.45:0/1854442974 >> v2:172.21.15.113:3300/0 conn(0x7fb8241518f0 0x7fb824064890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:40.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.862+0000 7fb822ffd700 1 -- 172.21.15.45:0/1854442974 >> v1:172.21.15.113:6789/0 conn(0x7fb8240a7420 legacy=0x7fb8240c3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:40.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.862+0000 7fb822ffd700 1 -- 172.21.15.45:0/1854442974 >> v1:172.21.15.45:6789/0 conn(0x7fb824151cd0 legacy=0x7fb8240a6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:40.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.862+0000 7fb8227fc700 1 -- 172.21.15.45:0/1854442974 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1563248015 0 0) 0x7fb824155740 con 0x7fb824151cd0 2023-12-22T10:00:40.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.862+0000 7fb822ffd700 1 -- 172.21.15.45:0/1854442974 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8240a5910 con 0x7fb8241518f0 2023-12-22T10:00:40.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.866+0000 7fb822ffd700 1 --2- 172.21.15.45:0/1854442974 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb8241518f0 0x7fb824064890 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fb814009760 tx=0x7fb814009060).ready entity=mon.1 client_cookie=82ce364fd568b332 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:40.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.866+0000 7fb8227fc700 1 -- 172.21.15.45:0/1854442974 <== mon.1 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb81400b580 con 0x7fb8241518f0 2023-12-22T10:00:40.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.866+0000 7fb8227fc700 1 -- 172.21.15.45:0/1854442974 <== mon.1 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb81400b6e0 con 0x7fb8241518f0 2023-12-22T10:00:40.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.866+0000 7fb8227fc700 1 -- 172.21.15.45:0/1854442974 <== mon.1 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb81400ba60 con 0x7fb8241518f0 2023-12-22T10:00:40.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.866+0000 7fb82961b700 1 -- 172.21.15.45:0/1854442974 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb8241518f0 msgr2=0x7fb824064890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:40.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.866+0000 7fb82961b700 1 --2- 172.21.15.45:0/1854442974 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb8241518f0 0x7fb824064890 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fb814009760 tx=0x7fb814009060).stop 2023-12-22T10:00:40.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.866+0000 7fb82961b700 1 -- 172.21.15.45:0/1854442974 shutdown_connections 2023-12-22T10:00:40.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.866+0000 7fb82961b700 1 --2- 172.21.15.45:0/1854442974 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb8241518f0 0x7fb824064890 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:40.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.866+0000 7fb82961b700 1 -- 172.21.15.45:0/1854442974 >> 172.21.15.45:0/1854442974 conn(0x7fb824066a70 msgr2=0x7fb824066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:40.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.866+0000 7fb82961b700 1 -- 172.21.15.45:0/1854442974 shutdown_connections 2023-12-22T10:00:40.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.866+0000 7fb82961b700 1 -- 172.21.15.45:0/1854442974 wait complete. 2023-12-22T10:00:40.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.870+0000 7fb82961b700 1 Processor -- start 2023-12-22T10:00:40.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.870+0000 7fb82961b700 1 -- start start 2023-12-22T10:00:40.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.870+0000 7fb82961b700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb8240a7420 0x7fb824154700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:40.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.870+0000 7fb82961b700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb8241518f0 0x7fb8240abca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:40.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.870+0000 7fb82961b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb824151cd0 0x7fb8240ac190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:40.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.870+0000 7fb82961b700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb82413c870 con 0x7fb824151cd0 2023-12-22T10:00:40.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.870+0000 7fb82961b700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb82413b980 con 0x7fb8241518f0 2023-12-22T10:00:40.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.870+0000 7fb82961b700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb82413bc60 con 0x7fb8240a7420 2023-12-22T10:00:40.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.870+0000 7fb8237fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb824151cd0 0x7fb8240ac190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:40.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.870+0000 7fb8237fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb824151cd0 0x7fb8240ac190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48324/0 (socket says 172.21.15.45:48324) 2023-12-22T10:00:40.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.870+0000 7fb8237fe700 1 -- 172.21.15.45:0/3280293726 learned_addr learned my addr 172.21.15.45:0/3280293726 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:40.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.870+0000 7fb81a7fc700 1 --2- 172.21.15.45:0/3280293726 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb8241518f0 0x7fb8240abca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:40.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.870+0000 7fb822ffd700 1 --2- 172.21.15.45:0/3280293726 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb8240a7420 0x7fb824154700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:40.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.874+0000 7fb8237fe700 1 -- 172.21.15.45:0/3280293726 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb8240a7420 msgr2=0x7fb824154700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:40.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.874+0000 7fb8237fe700 1 --2- 172.21.15.45:0/3280293726 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb8240a7420 0x7fb824154700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:40.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.874+0000 7fb8237fe700 1 -- 172.21.15.45:0/3280293726 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb8241518f0 msgr2=0x7fb8240abca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:40.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.874+0000 7fb8237fe700 1 --2- 172.21.15.45:0/3280293726 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb8241518f0 0x7fb8240abca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:40.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.874+0000 7fb8237fe700 1 -- 172.21.15.45:0/3280293726 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8140092a0 con 0x7fb824151cd0 2023-12-22T10:00:40.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.874+0000 7fb822ffd700 1 --2- 172.21.15.45:0/3280293726 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb8240a7420 0x7fb824154700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T10:00:40.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.874+0000 7fb8237fe700 1 --2- 172.21.15.45:0/3280293726 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb824151cd0 0x7fb8240ac190 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7fb81c00c7c0 tx=0x7fb81c001530).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:40.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.874+0000 7fb81b7fe700 1 -- 172.21.15.45:0/3280293726 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb81c010510 con 0x7fb824151cd0 2023-12-22T10:00:40.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.874+0000 7fb81b7fe700 1 -- 172.21.15.45:0/3280293726 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb81c010670 con 0x7fb824151cd0 2023-12-22T10:00:40.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.874+0000 7fb82961b700 1 -- 172.21.15.45:0/3280293726 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb82413bf40 con 0x7fb824151cd0 2023-12-22T10:00:40.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.874+0000 7fb81b7fe700 1 -- 172.21.15.45:0/3280293726 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb81c0109f0 con 0x7fb824151cd0 2023-12-22T10:00:40.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.874+0000 7fb82961b700 1 -- 172.21.15.45:0/3280293726 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb82413c500 con 0x7fb824151cd0 2023-12-22T10:00:40.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.874+0000 7fb82961b700 1 -- 172.21.15.45:0/3280293726 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb8240bbcf0 con 0x7fb824151cd0 2023-12-22T10:00:40.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.878+0000 7fb81b7fe700 1 -- 172.21.15.45:0/3280293726 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fb81c012440 con 0x7fb824151cd0 2023-12-22T10:00:40.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.878+0000 7fb81b7fe700 1 --2- 172.21.15.45:0/3280293726 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fb80405a510 0x7fb80405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:40.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.878+0000 7fb81b7fe700 1 -- 172.21.15.45:0/3280293726 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb81c0740e0 con 0x7fb824151cd0 2023-12-22T10:00:40.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.878+0000 7fb822ffd700 1 --2- 172.21.15.45:0/3280293726 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fb80405a510 0x7fb80405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:40.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.878+0000 7fb81b7fe700 1 --2- 172.21.15.45:0/3280293726 >> [v2:172.21.15.113:6800/34100,v1:172.21.15.113:6801/34100] conn(0x7fb8040638b0 0x7fb804065d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:40.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.878+0000 7fb81b7fe700 1 -- 172.21.15.45:0/3280293726 --> [v2:172.21.15.113:6800/34100,v1:172.21.15.113:6801/34100] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb804066390 con 0x7fb8040638b0 2023-12-22T10:00:40.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.878+0000 7fb81b7fe700 1 -- 172.21.15.45:0/3280293726 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb81c076640 con 0x7fb824151cd0 2023-12-22T10:00:40.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.878+0000 7fb81a7fc700 1 --2- 172.21.15.45:0/3280293726 >> [v2:172.21.15.113:6800/34100,v1:172.21.15.113:6801/34100] conn(0x7fb8040638b0 0x7fb804065d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:40.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.878+0000 7fb822ffd700 1 --2- 172.21.15.45:0/3280293726 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fb80405a510 0x7fb80405c9d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fb814006e00 tx=0x7fb814017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:40.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.882+0000 7fb81a7fc700 1 --2- 172.21.15.45:0/3280293726 >> [v2:172.21.15.113:6800/34100,v1:172.21.15.113:6801/34100] conn(0x7fb8040638b0 0x7fb804065d10 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:40.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.882+0000 7fb81b7fe700 1 -- 172.21.15.45:0/3280293726 <== osd.5 v2:172.21.15.113:6800/34100 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7fb804066390 con 0x7fb8040638b0 2023-12-22T10:00:40.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.902+0000 7fb82961b700 1 -- 172.21.15.45:0/3280293726 --> [v2:172.21.15.113:6800/34100,v1:172.21.15.113:6801/34100] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb82406c070 con 0x7fb8040638b0 2023-12-22T10:00:40.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.906+0000 7fb81b7fe700 1 -- 172.21.15.45:0/3280293726 <== osd.5 v2:172.21.15.113:6800/34100 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb82406c070 con 0x7fb8040638b0 2023-12-22T10:00:40.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.906+0000 7fb82961b700 1 -- 172.21.15.45:0/3280293726 >> [v2:172.21.15.113:6800/34100,v1:172.21.15.113:6801/34100] conn(0x7fb8040638b0 msgr2=0x7fb804065d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:40.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.906+0000 7fb82961b700 1 --2- 172.21.15.45:0/3280293726 >> [v2:172.21.15.113:6800/34100,v1:172.21.15.113:6801/34100] conn(0x7fb8040638b0 0x7fb804065d10 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:40.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.906+0000 7fb82961b700 1 -- 172.21.15.45:0/3280293726 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fb80405a510 msgr2=0x7fb80405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:40.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.906+0000 7fb82961b700 1 --2- 172.21.15.45:0/3280293726 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fb80405a510 0x7fb80405c9d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fb814006e00 tx=0x7fb814017000).stop 2023-12-22T10:00:40.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.906+0000 7fb82961b700 1 -- 172.21.15.45:0/3280293726 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb824151cd0 msgr2=0x7fb8240ac190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:40.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.906+0000 7fb82961b700 1 --2- 172.21.15.45:0/3280293726 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb824151cd0 0x7fb8240ac190 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7fb81c00c7c0 tx=0x7fb81c001530).stop 2023-12-22T10:00:40.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.906+0000 7fb8237fe700 1 -- 172.21.15.45:0/3280293726 reap_dead start 2023-12-22T10:00:40.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.906+0000 7fb82961b700 1 -- 172.21.15.45:0/3280293726 shutdown_connections 2023-12-22T10:00:40.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.906+0000 7fb82961b700 1 -- 172.21.15.45:0/3280293726 >> 172.21.15.45:0/3280293726 conn(0x7fb824066a70 msgr2=0x7fb8240659b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:40.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.906+0000 7fb82961b700 1 -- 172.21.15.45:0/3280293726 shutdown_connections 2023-12-22T10:00:40.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:40.906+0000 7fb82961b700 1 -- 172.21.15.45:0/3280293726 wait complete. 2023-12-22T10:00:40.924 INFO:teuthology.orchestra.run.smithi045.stdout:55834574852 2023-12-22T10:00:40.924 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-12-22T10:00:41.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.098+0000 7f93ef49b700 1 Processor -- start 2023-12-22T10:00:41.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.098+0000 7f93ef49b700 1 -- start start 2023-12-22T10:00:41.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.098+0000 7f93ef49b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f93e8151cd0 0x7f93e80a6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:41.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.098+0000 7f93ef49b700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93e8155740 con 0x7f93e81518f0 2023-12-22T10:00:41.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.098+0000 7f93ef49b700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93e80a7690 con 0x7f93e80a7200 2023-12-22T10:00:41.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.098+0000 7f93ef49b700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93e80c40f0 con 0x7f93e8151cd0 2023-12-22T10:00:41.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.098+0000 7f93eca36700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f93e8151cd0 0x7f93e80a6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:41.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.102+0000 7f93eca36700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f93e8151cd0 0x7f93e80a6d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48336/0 (socket says 172.21.15.45:48336) 2023-12-22T10:00:41.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.102+0000 7f93eca36700 1 -- 172.21.15.45:0/2367909292 learned_addr learned my addr 172.21.15.45:0/2367909292 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:41.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.102+0000 7f93eca36700 1 -- 172.21.15.45:0/2367909292 >> v1:172.21.15.113:6789/0 conn(0x7f93e80a7200 legacy=0x7f93e80c3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:41.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.102+0000 7f93eca36700 1 -- 172.21.15.45:0/2367909292 >> v1:172.21.15.45:6789/0 conn(0x7f93e81518f0 legacy=0x7f93e8064890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:41.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.102+0000 7f93eca36700 1 -- 172.21.15.45:0/2367909292 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93e80a61b0 con 0x7f93e8151cd0 2023-12-22T10:00:41.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.102+0000 7f93eca36700 1 --2- 172.21.15.45:0/2367909292 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93e8151cd0 0x7f93e80a6d10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f93d8006fd0 tx=0x7f93d80090f0).ready entity=mon.0 client_cookie=4fcfff3281b7f490 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:41.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.102+0000 7f93dffff700 1 -- 172.21.15.45:0/2367909292 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d800b600 con 0x7f93e8151cd0 2023-12-22T10:00:41.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.102+0000 7f93dffff700 1 -- 172.21.15.45:0/2367909292 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93d800b760 con 0x7f93e8151cd0 2023-12-22T10:00:41.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.102+0000 7f93dffff700 1 -- 172.21.15.45:0/2367909292 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d800bae0 con 0x7f93e8151cd0 2023-12-22T10:00:41.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.102+0000 7f93ef49b700 1 -- 172.21.15.45:0/2367909292 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93e8151cd0 msgr2=0x7f93e80a6d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:41.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.102+0000 7f93ef49b700 1 --2- 172.21.15.45:0/2367909292 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93e8151cd0 0x7f93e80a6d10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f93d8006fd0 tx=0x7f93d80090f0).stop 2023-12-22T10:00:41.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.102+0000 7f93ef49b700 1 -- 172.21.15.45:0/2367909292 shutdown_connections 2023-12-22T10:00:41.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.102+0000 7f93ef49b700 1 --2- 172.21.15.45:0/2367909292 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93e8151cd0 0x7f93e80a6d10 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:41.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.102+0000 7f93ef49b700 1 -- 172.21.15.45:0/2367909292 >> 172.21.15.45:0/2367909292 conn(0x7f93e8066a70 msgr2=0x7f93e8066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:41.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.106+0000 7f93ef49b700 1 -- 172.21.15.45:0/2367909292 shutdown_connections 2023-12-22T10:00:41.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.106+0000 7f93ef49b700 1 -- 172.21.15.45:0/2367909292 wait complete. 2023-12-22T10:00:41.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.106+0000 7f93ef49b700 1 Processor -- start 2023-12-22T10:00:41.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.106+0000 7f93ef49b700 1 -- start start 2023-12-22T10:00:41.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.110+0000 7f93ef49b700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f93e80a7200 0x7f93e81422d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:41.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.110+0000 7f93ef49b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93e81518f0 0x7f93e80aa390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:41.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.110+0000 7f93ef49b700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f93e8151cd0 0x7f93e80aa880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:41.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.110+0000 7f93ef49b700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e80c1660 con 0x7f93e81518f0 2023-12-22T10:00:41.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.110+0000 7f93ef49b700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e81427c0 con 0x7f93e8151cd0 2023-12-22T10:00:41.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.110+0000 7f93ef49b700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93e80aae80 con 0x7f93e80a7200 2023-12-22T10:00:41.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.110+0000 7f93eca36700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93e81518f0 0x7f93e80aa390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:41.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.110+0000 7f93eca36700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93e81518f0 0x7f93e80aa390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48338/0 (socket says 172.21.15.45:48338) 2023-12-22T10:00:41.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.110+0000 7f93eca36700 1 -- 172.21.15.45:0/4028488332 learned_addr learned my addr 172.21.15.45:0/4028488332 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:41.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.110+0000 7f93eda38700 1 --2- 172.21.15.45:0/4028488332 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f93e8151cd0 0x7f93e80aa880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:41.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.110+0000 7f93ed237700 1 --2- 172.21.15.45:0/4028488332 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f93e80a7200 0x7f93e81422d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:41.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.110+0000 7f93eca36700 1 -- 172.21.15.45:0/4028488332 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f93e80a7200 msgr2=0x7f93e81422d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:41.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.110+0000 7f93eca36700 1 --2- 172.21.15.45:0/4028488332 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f93e80a7200 0x7f93e81422d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:41.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.110+0000 7f93eca36700 1 -- 172.21.15.45:0/4028488332 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f93e8151cd0 msgr2=0x7f93e80aa880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:41.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.110+0000 7f93eca36700 1 --2- 172.21.15.45:0/4028488332 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f93e8151cd0 0x7f93e80aa880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:41.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.110+0000 7f93eca36700 1 -- 172.21.15.45:0/4028488332 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93d8009370 con 0x7f93e81518f0 2023-12-22T10:00:41.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.110+0000 7f93eca36700 1 --2- 172.21.15.45:0/4028488332 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93e81518f0 0x7f93e80aa390 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f93e8063b00 tx=0x7f93d8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:41.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.110+0000 7f93dd7fa700 1 -- 172.21.15.45:0/4028488332 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d800b8d0 con 0x7f93e81518f0 2023-12-22T10:00:41.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.110+0000 7f93dd7fa700 1 -- 172.21.15.45:0/4028488332 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93d800ba30 con 0x7f93e81518f0 2023-12-22T10:00:41.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.110+0000 7f93dd7fa700 1 -- 172.21.15.45:0/4028488332 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d801c670 con 0x7f93e81518f0 2023-12-22T10:00:41.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.110+0000 7f93ef49b700 1 -- 172.21.15.45:0/4028488332 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93e80c0d30 con 0x7f93e81518f0 2023-12-22T10:00:41.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.110+0000 7f93ef49b700 1 -- 172.21.15.45:0/4028488332 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93e80c12f0 con 0x7f93e81518f0 2023-12-22T10:00:41.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.114+0000 7f93ef49b700 1 -- 172.21.15.45:0/4028488332 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f93e806c070 con 0x7f93e81518f0 2023-12-22T10:00:41.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.114+0000 7f93dd7fa700 1 -- 172.21.15.45:0/4028488332 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f93d801c9e0 con 0x7f93e81518f0 2023-12-22T10:00:41.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.114+0000 7f93dd7fa700 1 --2- 172.21.15.45:0/4028488332 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f93cc05a510 0x7f93cc05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:41.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.114+0000 7f93dd7fa700 1 -- 172.21.15.45:0/4028488332 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f93d8076dd0 con 0x7f93e81518f0 2023-12-22T10:00:41.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.114+0000 7f93ed237700 1 --2- 172.21.15.45:0/4028488332 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f93cc05a510 0x7f93cc05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:41.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.114+0000 7f93dd7fa700 1 --2- 172.21.15.45:0/4028488332 >> [v2:172.21.15.113:6808/34101,v1:172.21.15.113:6810/34101] conn(0x7f93cc0638b0 0x7f93cc065d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:41.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.114+0000 7f93dd7fa700 1 -- 172.21.15.45:0/4028488332 --> [v2:172.21.15.113:6808/34101,v1:172.21.15.113:6810/34101] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f93cc066390 con 0x7f93cc0638b0 2023-12-22T10:00:41.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.118+0000 7f93dd7fa700 1 -- 172.21.15.45:0/4028488332 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f93d8077180 con 0x7f93e81518f0 2023-12-22T10:00:41.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.118+0000 7f93eda38700 1 --2- 172.21.15.45:0/4028488332 >> [v2:172.21.15.113:6808/34101,v1:172.21.15.113:6810/34101] conn(0x7f93cc0638b0 0x7f93cc065d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:41.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.118+0000 7f93ed237700 1 --2- 172.21.15.45:0/4028488332 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f93cc05a510 0x7f93cc05c9d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f93e4003900 tx=0x7f93e4007d40).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:41.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.118+0000 7f93eda38700 1 --2- 172.21.15.45:0/4028488332 >> [v2:172.21.15.113:6808/34101,v1:172.21.15.113:6810/34101] conn(0x7f93cc0638b0 0x7f93cc065d10 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:41.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.118+0000 7f93dd7fa700 1 -- 172.21.15.45:0/4028488332 <== osd.6 v2:172.21.15.113:6808/34101 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7f93cc066390 con 0x7f93cc0638b0 2023-12-22T10:00:41.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.138+0000 7f93ef49b700 1 -- 172.21.15.45:0/4028488332 --> [v2:172.21.15.113:6808/34101,v1:172.21.15.113:6810/34101] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f93e80c17a0 con 0x7f93cc0638b0 2023-12-22T10:00:41.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.138+0000 7f93dd7fa700 1 -- 172.21.15.45:0/4028488332 <== osd.6 v2:172.21.15.113:6808/34101 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f93e80c17a0 con 0x7f93cc0638b0 2023-12-22T10:00:41.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.138+0000 7f93ef49b700 1 -- 172.21.15.45:0/4028488332 >> [v2:172.21.15.113:6808/34101,v1:172.21.15.113:6810/34101] conn(0x7f93cc0638b0 msgr2=0x7f93cc065d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:41.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.138+0000 7f93ef49b700 1 --2- 172.21.15.45:0/4028488332 >> [v2:172.21.15.113:6808/34101,v1:172.21.15.113:6810/34101] conn(0x7f93cc0638b0 0x7f93cc065d10 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:41.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.138+0000 7f93ef49b700 1 -- 172.21.15.45:0/4028488332 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f93cc05a510 msgr2=0x7f93cc05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:41.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.138+0000 7f93ef49b700 1 --2- 172.21.15.45:0/4028488332 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f93cc05a510 0x7f93cc05c9d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f93e4003900 tx=0x7f93e4007d40).stop 2023-12-22T10:00:41.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.138+0000 7f93ef49b700 1 -- 172.21.15.45:0/4028488332 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93e81518f0 msgr2=0x7f93e80aa390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:41.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.138+0000 7f93ef49b700 1 --2- 172.21.15.45:0/4028488332 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93e81518f0 0x7f93e80aa390 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f93e8063b00 tx=0x7f93d8017000).stop 2023-12-22T10:00:41.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.138+0000 7f93eda38700 1 -- 172.21.15.45:0/4028488332 reap_dead start 2023-12-22T10:00:41.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.138+0000 7f93ef49b700 1 -- 172.21.15.45:0/4028488332 shutdown_connections 2023-12-22T10:00:41.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.138+0000 7f93ef49b700 1 -- 172.21.15.45:0/4028488332 >> 172.21.15.45:0/4028488332 conn(0x7f93e8066a70 msgr2=0x7f93e80c5840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:41.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.142+0000 7f93ef49b700 1 -- 172.21.15.45:0/4028488332 shutdown_connections 2023-12-22T10:00:41.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.142+0000 7f93ef49b700 1 -- 172.21.15.45:0/4028488332 wait complete. 2023-12-22T10:00:41.155 INFO:teuthology.orchestra.run.smithi045.stdout:55834574853 2023-12-22T10:00:41.156 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-12-22T10:00:41.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.330+0000 7f30df59e700 1 Processor -- start 2023-12-22T10:00:41.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.330+0000 7f30df59e700 1 -- start start 2023-12-22T10:00:41.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.334+0000 7f30df59e700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f30e00c7460 0x7f30e00c3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:41.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.334+0000 7f30df59e700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f30e00c4090 0x7f30e00c7840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:41.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.334+0000 7f30df59e700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f30e0062a40 0x7f30e00c7d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:41.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.334+0000 7f30df59e700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30e00bc5b0 con 0x7f30e0062a40 2023-12-22T10:00:41.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.334+0000 7f30df59e700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30e00c4db0 con 0x7f30e00c7460 2023-12-22T10:00:41.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.334+0000 7f30df59e700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30e00c4510 con 0x7f30e00c4090 2023-12-22T10:00:41.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.334+0000 7f30ddd9b700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f30e00c4090 0x7f30e00c7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:41.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.334+0000 7f30ddd9b700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f30e00c4090 0x7f30e00c7840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.113:3301/0 says I am v2:172.21.15.45:36050/0 (socket says 172.21.15.45:36050) 2023-12-22T10:00:41.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.334+0000 7f30ddd9b700 1 -- 172.21.15.45:0/4261043785 learned_addr learned my addr 172.21.15.45:0/4261043785 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:41.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.334+0000 7f30de59c700 1 --2- 172.21.15.45:0/4261043785 >> v2:172.21.15.113:3300/0 conn(0x7f30e00c7460 0x7f30e00c3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:41.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.334+0000 7f30ded9d700 1 --2- 172.21.15.45:0/4261043785 >> v2:172.21.15.45:3300/0 conn(0x7f30e0062a40 0x7f30e00c7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:41.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.334+0000 7f30ddd9b700 1 -- 172.21.15.45:0/4261043785 >> v2:172.21.15.113:3300/0 conn(0x7f30e00c7460 msgr2=0x7f30e00c3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:00:41.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.334+0000 7f30ddd9b700 1 --2- 172.21.15.45:0/4261043785 >> v2:172.21.15.113:3300/0 conn(0x7f30e00c7460 0x7f30e00c3ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:41.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.334+0000 7f30ddd9b700 1 -- 172.21.15.45:0/4261043785 >> v2:172.21.15.45:3300/0 conn(0x7f30e0062a40 msgr2=0x7f30e00c7d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:00:41.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.334+0000 7f30ddd9b700 1 --2- 172.21.15.45:0/4261043785 >> v2:172.21.15.45:3300/0 conn(0x7f30e0062a40 0x7f30e00c7d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:41.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.334+0000 7f30ddd9b700 1 -- 172.21.15.45:0/4261043785 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30e00c47f0 con 0x7f30e00c4090 2023-12-22T10:00:41.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.338+0000 7f30ddd9b700 1 --2- 172.21.15.45:0/4261043785 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f30e00c4090 0x7f30e00c7840 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f30e00c7430 tx=0x7f30d40090f0).ready entity=mon.2 client_cookie=816472054d63d4b6 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:41.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.338+0000 7f30dd59a700 1 -- 172.21.15.45:0/4261043785 <== mon.2 v2:172.21.15.113:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30d400f510 con 0x7f30e00c4090 2023-12-22T10:00:41.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.338+0000 7f30dd59a700 1 -- 172.21.15.45:0/4261043785 <== mon.2 v2:172.21.15.113:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30d400f670 con 0x7f30e00c4090 2023-12-22T10:00:41.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.338+0000 7f30dd59a700 1 -- 172.21.15.45:0/4261043785 <== mon.2 v2:172.21.15.113:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30d400fa10 con 0x7f30e00c4090 2023-12-22T10:00:41.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.338+0000 7f30df59e700 1 -- 172.21.15.45:0/4261043785 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f30e00c4090 msgr2=0x7f30e00c7840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:41.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.338+0000 7f30df59e700 1 --2- 172.21.15.45:0/4261043785 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f30e00c4090 0x7f30e00c7840 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f30e00c7430 tx=0x7f30d40090f0).stop 2023-12-22T10:00:41.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.338+0000 7f30df59e700 1 -- 172.21.15.45:0/4261043785 shutdown_connections 2023-12-22T10:00:41.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.338+0000 7f30df59e700 1 --2- 172.21.15.45:0/4261043785 >> v2:172.21.15.45:3300/0 conn(0x7f30e0062a40 0x7f30e00c7d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:41.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.338+0000 7f30df59e700 1 --2- 172.21.15.45:0/4261043785 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f30e00c4090 0x7f30e00c7840 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:41.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.338+0000 7f30df59e700 1 --2- 172.21.15.45:0/4261043785 >> v2:172.21.15.113:3300/0 conn(0x7f30e00c7460 0x7f30e00c3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:41.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.338+0000 7f30df59e700 1 -- 172.21.15.45:0/4261043785 >> 172.21.15.45:0/4261043785 conn(0x7f30e0068610 msgr2=0x7f30e0062230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:41.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.338+0000 7f30df59e700 1 -- 172.21.15.45:0/4261043785 shutdown_connections 2023-12-22T10:00:41.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.338+0000 7f30df59e700 1 -- 172.21.15.45:0/4261043785 wait complete. 2023-12-22T10:00:41.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.342+0000 7f30df59e700 1 Processor -- start 2023-12-22T10:00:41.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.342+0000 7f30df59e700 1 -- start start 2023-12-22T10:00:41.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.342+0000 7f30df59e700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f30e0062a40 0x7f30e014c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:41.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.342+0000 7f30df59e700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f30e00c4090 0x7f30e0154110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:41.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.342+0000 7f30df59e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30e00c7460 0x7f30e014d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:41.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.342+0000 7f30df59e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30e0155750 con 0x7f30e00c7460 2023-12-22T10:00:41.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.342+0000 7f30df59e700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30e0154b40 con 0x7f30e0062a40 2023-12-22T10:00:41.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.342+0000 7f30df59e700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30e0154e20 con 0x7f30e00c4090 2023-12-22T10:00:41.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.342+0000 7f30ded9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30e00c7460 0x7f30e014d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:41.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.342+0000 7f30ded9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30e00c7460 0x7f30e014d140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48350/0 (socket says 172.21.15.45:48350) 2023-12-22T10:00:41.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.342+0000 7f30ded9d700 1 -- 172.21.15.45:0/1686317828 learned_addr learned my addr 172.21.15.45:0/1686317828 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:41.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.342+0000 7f30de59c700 1 --2- 172.21.15.45:0/1686317828 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f30e0062a40 0x7f30e014c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:41.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.342+0000 7f30ddd9b700 1 --2- 172.21.15.45:0/1686317828 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f30e00c4090 0x7f30e0154110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:41.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.342+0000 7f30ded9d700 1 -- 172.21.15.45:0/1686317828 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f30e00c4090 msgr2=0x7f30e0154110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:41.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.342+0000 7f30ded9d700 1 --2- 172.21.15.45:0/1686317828 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f30e00c4090 0x7f30e0154110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:41.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.342+0000 7f30ded9d700 1 -- 172.21.15.45:0/1686317828 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f30e0062a40 msgr2=0x7f30e014c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:41.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.342+0000 7f30ded9d700 1 --2- 172.21.15.45:0/1686317828 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f30e0062a40 0x7f30e014c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:41.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.342+0000 7f30ded9d700 1 -- 172.21.15.45:0/1686317828 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30d4009370 con 0x7f30e00c7460 2023-12-22T10:00:41.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.342+0000 7f30ded9d700 1 --2- 172.21.15.45:0/1686317828 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30e00c7460 0x7f30e014d140 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f30d8009d70 tx=0x7f30d800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:41.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.346+0000 7f30ce7fc700 1 -- 172.21.15.45:0/1686317828 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30d800caa0 con 0x7f30e00c7460 2023-12-22T10:00:41.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.346+0000 7f30ce7fc700 1 -- 172.21.15.45:0/1686317828 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30d800f040 con 0x7f30e00c7460 2023-12-22T10:00:41.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.346+0000 7f30df59e700 1 -- 172.21.15.45:0/1686317828 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30e0155100 con 0x7f30e00c7460 2023-12-22T10:00:41.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.346+0000 7f30ce7fc700 1 -- 172.21.15.45:0/1686317828 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30d800ce10 con 0x7f30e00c7460 2023-12-22T10:00:41.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.346+0000 7f30df59e700 1 -- 172.21.15.45:0/1686317828 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30e00a5520 con 0x7f30e00c7460 2023-12-22T10:00:41.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.346+0000 7f30df59e700 1 -- 172.21.15.45:0/1686317828 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f30e0047060 con 0x7f30e00c7460 2023-12-22T10:00:41.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.346+0000 7f30ce7fc700 1 -- 172.21.15.45:0/1686317828 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f30d8013610 con 0x7f30e00c7460 2023-12-22T10:00:41.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.350+0000 7f30ce7fc700 1 --2- 172.21.15.45:0/1686317828 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f30c005a540 0x7f30c005ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:41.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.350+0000 7f30ce7fc700 1 -- 172.21.15.45:0/1686317828 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f30d8074ee0 con 0x7f30e00c7460 2023-12-22T10:00:41.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.350+0000 7f30de59c700 1 --2- 172.21.15.45:0/1686317828 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f30c005a540 0x7f30c005ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:41.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.350+0000 7f30ce7fc700 1 --2- 172.21.15.45:0/1686317828 >> [v2:172.21.15.113:6821/34102,v1:172.21.15.113:6825/34102] conn(0x7f30c00638e0 0x7f30c0065d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:41.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.350+0000 7f30ce7fc700 1 -- 172.21.15.45:0/1686317828 --> [v2:172.21.15.113:6821/34102,v1:172.21.15.113:6825/34102] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f30c00663c0 con 0x7f30c00638e0 2023-12-22T10:00:41.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.350+0000 7f30ce7fc700 1 -- 172.21.15.45:0/1686317828 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f30d8077440 con 0x7f30e00c7460 2023-12-22T10:00:41.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.350+0000 7f30ddd9b700 1 --2- 172.21.15.45:0/1686317828 >> [v2:172.21.15.113:6821/34102,v1:172.21.15.113:6825/34102] conn(0x7f30c00638e0 0x7f30c0065d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:41.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.350+0000 7f30de59c700 1 --2- 172.21.15.45:0/1686317828 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f30c005a540 0x7f30c005ca00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f30d0009c30 tx=0x7f30d0009060).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:41.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.350+0000 7f30ddd9b700 1 --2- 172.21.15.45:0/1686317828 >> [v2:172.21.15.113:6821/34102,v1:172.21.15.113:6825/34102] conn(0x7f30c00638e0 0x7f30c0065d40 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:41.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.354+0000 7f30ce7fc700 1 -- 172.21.15.45:0/1686317828 <== osd.7 v2:172.21.15.113:6821/34102 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7f30c00663c0 con 0x7f30c00638e0 2023-12-22T10:00:41.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.370+0000 7f30df59e700 1 -- 172.21.15.45:0/1686317828 --> [v2:172.21.15.113:6821/34102,v1:172.21.15.113:6825/34102] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f30e0155890 con 0x7f30c00638e0 2023-12-22T10:00:41.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.374+0000 7f30ce7fc700 1 -- 172.21.15.45:0/1686317828 <== osd.7 v2:172.21.15.113:6821/34102 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f30e0155890 con 0x7f30c00638e0 2023-12-22T10:00:41.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.374+0000 7f30df59e700 1 -- 172.21.15.45:0/1686317828 >> [v2:172.21.15.113:6821/34102,v1:172.21.15.113:6825/34102] conn(0x7f30c00638e0 msgr2=0x7f30c0065d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:41.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.374+0000 7f30df59e700 1 --2- 172.21.15.45:0/1686317828 >> [v2:172.21.15.113:6821/34102,v1:172.21.15.113:6825/34102] conn(0x7f30c00638e0 0x7f30c0065d40 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:41.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.374+0000 7f30df59e700 1 -- 172.21.15.45:0/1686317828 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f30c005a540 msgr2=0x7f30c005ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:41.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.374+0000 7f30df59e700 1 --2- 172.21.15.45:0/1686317828 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f30c005a540 0x7f30c005ca00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f30d0009c30 tx=0x7f30d0009060).stop 2023-12-22T10:00:41.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.374+0000 7f30df59e700 1 -- 172.21.15.45:0/1686317828 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30e00c7460 msgr2=0x7f30e014d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:41.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.374+0000 7f30df59e700 1 --2- 172.21.15.45:0/1686317828 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30e00c7460 0x7f30e014d140 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f30d8009d70 tx=0x7f30d800b040).stop 2023-12-22T10:00:41.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.374+0000 7f30ded9d700 1 -- 172.21.15.45:0/1686317828 reap_dead start 2023-12-22T10:00:41.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.374+0000 7f30df59e700 1 -- 172.21.15.45:0/1686317828 shutdown_connections 2023-12-22T10:00:41.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.374+0000 7f30df59e700 1 -- 172.21.15.45:0/1686317828 >> 172.21.15.45:0/1686317828 conn(0x7f30e0068610 msgr2=0x7f30e00c6a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:41.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.374+0000 7f30df59e700 1 -- 172.21.15.45:0/1686317828 shutdown_connections 2023-12-22T10:00:41.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.374+0000 7f30df59e700 1 -- 172.21.15.45:0/1686317828 wait complete. 2023-12-22T10:00:41.389 INFO:teuthology.orchestra.run.smithi045.stdout:55834574853 2023-12-22T10:00:41.390 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-12-22T10:00:41.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.562+0000 7fddc3fff700 1 Processor -- start 2023-12-22T10:00:41.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.562+0000 7fddc3fff700 1 -- start start 2023-12-22T10:00:41.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.566+0000 7fddc3fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fddc4067180 0x7fddc40c4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:41.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.566+0000 7fddc3fff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddc40a74d0 con 0x7fddc4155050 2023-12-22T10:00:41.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.566+0000 7fddc3fff700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddc40c4e10 con 0x7fddc4154c70 2023-12-22T10:00:41.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.566+0000 7fddc3fff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddc4062cd0 con 0x7fddc4067180 2023-12-22T10:00:41.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.566+0000 7fddc27fc700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fddc4067180 0x7fddc40c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:41.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.566+0000 7fddc2ffd700 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fddc4154c70 0x7fddc4066a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.45:37764/0 (socket says 172.21.15.45:37764) 2023-12-22T10:00:41.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.566+0000 7fddc37fe700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fddc4155050 0x7fddc40a7940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59172/0 (socket says 172.21.15.45:59172) 2023-12-22T10:00:41.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.566+0000 7fddc2ffd700 1 -- 172.21.15.45:0/1349870576 learned_addr learned my addr 172.21.15.45:0/1349870576 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:00:41.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.566+0000 7fddc27fc700 1 -- 172.21.15.45:0/1349870576 >> v1:172.21.15.113:6789/0 conn(0x7fddc4154c70 legacy=0x7fddc4066a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:41.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.566+0000 7fddc27fc700 1 -- 172.21.15.45:0/1349870576 >> v1:172.21.15.45:6789/0 conn(0x7fddc4155050 legacy=0x7fddc40a7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:41.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.566+0000 7fddc27fc700 1 -- 172.21.15.45:0/1349870576 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddc40bc990 con 0x7fddc4067180 2023-12-22T10:00:41.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.566+0000 7fddc27fc700 1 --2- 172.21.15.45:0/1349870576 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fddc4067180 0x7fddc40c4920 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fddb80096e0 tx=0x7fddb8009060).ready entity=mon.0 client_cookie=24cb48efa9164cc5 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:41.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.566+0000 7fddc1ffb700 1 -- 172.21.15.45:0/1349870576 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb80090d0 con 0x7fddc4067180 2023-12-22T10:00:41.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.566+0000 7fddc1ffb700 1 -- 172.21.15.45:0/1349870576 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddb800f510 con 0x7fddc4067180 2023-12-22T10:00:41.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.566+0000 7fddc1ffb700 1 -- 172.21.15.45:0/1349870576 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb800f890 con 0x7fddc4067180 2023-12-22T10:00:41.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.570+0000 7fddc3fff700 1 -- 172.21.15.45:0/1349870576 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fddc4067180 msgr2=0x7fddc40c4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:41.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.570+0000 7fddc3fff700 1 --2- 172.21.15.45:0/1349870576 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fddc4067180 0x7fddc40c4920 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fddb80096e0 tx=0x7fddb8009060).stop 2023-12-22T10:00:41.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.570+0000 7fddc3fff700 1 -- 172.21.15.45:0/1349870576 shutdown_connections 2023-12-22T10:00:41.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.570+0000 7fddc3fff700 1 --2- 172.21.15.45:0/1349870576 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fddc4067180 0x7fddc40c4920 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:41.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.570+0000 7fddc3fff700 1 -- 172.21.15.45:0/1349870576 >> 172.21.15.45:0/1349870576 conn(0x7fddc4068610 msgr2=0x7fddc4062230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:41.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.570+0000 7fddc3fff700 1 -- 172.21.15.45:0/1349870576 shutdown_connections 2023-12-22T10:00:41.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.570+0000 7fddc3fff700 1 -- 172.21.15.45:0/1349870576 wait complete. 2023-12-22T10:00:41.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.570+0000 7fddc3fff700 1 Processor -- start 2023-12-22T10:00:41.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.570+0000 7fddc3fff700 1 -- start start 2023-12-22T10:00:41.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.574+0000 7fddc3fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fddc4067180 0x7fddc4145410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:41.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.574+0000 7fddc3fff700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fddc4154c70 0x7fddc40c0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:41.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.574+0000 7fddc3fff700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fddc4155050 0x7fddc40c0e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:41.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.574+0000 7fddc3fff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddc40c12f0 con 0x7fddc4067180 2023-12-22T10:00:41.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.574+0000 7fddc3fff700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddc4142ac0 con 0x7fddc4154c70 2023-12-22T10:00:41.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.574+0000 7fddc3fff700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddc40bf080 con 0x7fddc4155050 2023-12-22T10:00:41.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.574+0000 7fddc2ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fddc4067180 0x7fddc4145410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:41.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.574+0000 7fddc2ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fddc4067180 0x7fddc4145410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48372/0 (socket says 172.21.15.45:48372) 2023-12-22T10:00:41.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.574+0000 7fddc2ffd700 1 -- 172.21.15.45:0/1502437953 learned_addr learned my addr 172.21.15.45:0/1502437953 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:41.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.574+0000 7fddc27fc700 1 --2- 172.21.15.45:0/1502437953 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fddc4154c70 0x7fddc40c0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:41.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.574+0000 7fddc37fe700 1 --2- 172.21.15.45:0/1502437953 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fddc4155050 0x7fddc40c0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:41.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.574+0000 7fddc2ffd700 1 -- 172.21.15.45:0/1502437953 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fddc4155050 msgr2=0x7fddc40c0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:41.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.574+0000 7fddc2ffd700 1 --2- 172.21.15.45:0/1502437953 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fddc4155050 0x7fddc40c0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:41.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.574+0000 7fddc2ffd700 1 -- 172.21.15.45:0/1502437953 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fddc4154c70 msgr2=0x7fddc40c0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:41.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.574+0000 7fddc2ffd700 1 --2- 172.21.15.45:0/1502437953 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fddc4154c70 0x7fddc40c0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:41.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.574+0000 7fddc2ffd700 1 -- 172.21.15.45:0/1502437953 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddb80092a0 con 0x7fddc4067180 2023-12-22T10:00:41.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.574+0000 7fddc2ffd700 1 --2- 172.21.15.45:0/1502437953 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fddc4067180 0x7fddc4145410 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7fddb400c610 tx=0x7fddb4007db0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:41.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.574+0000 7fddaaffd700 1 -- 172.21.15.45:0/1502437953 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb40072e0 con 0x7fddc4067180 2023-12-22T10:00:41.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.574+0000 7fddaaffd700 1 -- 172.21.15.45:0/1502437953 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddb4007440 con 0x7fddc4067180 2023-12-22T10:00:41.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.574+0000 7fddaaffd700 1 -- 172.21.15.45:0/1502437953 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb40057a0 con 0x7fddc4067180 2023-12-22T10:00:41.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.574+0000 7fddc3fff700 1 -- 172.21.15.45:0/1502437953 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddc40c6d10 con 0x7fddc4067180 2023-12-22T10:00:41.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.574+0000 7fddc3fff700 1 -- 172.21.15.45:0/1502437953 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddc40bea30 con 0x7fddc4067180 2023-12-22T10:00:41.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.578+0000 7fddc3fff700 1 -- 172.21.15.45:0/1502437953 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddc4047060 con 0x7fddc4067180 2023-12-22T10:00:41.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.578+0000 7fddaaffd700 1 -- 172.21.15.45:0/1502437953 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fddb4005b90 con 0x7fddc4067180 2023-12-22T10:00:41.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.578+0000 7fddaaffd700 1 --2- 172.21.15.45:0/1502437953 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fddb005a510 0x7fddb005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:41.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.578+0000 7fddaaffd700 1 -- 172.21.15.45:0/1502437953 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fddb4073fe0 con 0x7fddc4067180 2023-12-22T10:00:41.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.578+0000 7fddc27fc700 1 --2- 172.21.15.45:0/1502437953 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fddb005a510 0x7fddb005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:41.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.578+0000 7fddc27fc700 1 --2- 172.21.15.45:0/1502437953 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fddb005a510 0x7fddb005c9d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7fddc4067580 tx=0x7fddb8017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:41.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.586+0000 7fddaaffd700 1 -- 172.21.15.45:0/1502437953 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fddb4047700 con 0x7fddc4067180 2023-12-22T10:00:41.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.750+0000 7fddc3fff700 1 -- 172.21.15.45:0/1502437953 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fddc4154730 con 0x7fddc4067180 2023-12-22T10:00:41.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.750+0000 7fddaaffd700 1 -- 172.21.15.45:0/1502437953 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fddb404ad20 con 0x7fddc4067180 2023-12-22T10:00:41.747 INFO:teuthology.orchestra.run.smithi045.stdout:55834574852 2023-12-22T10:00:41.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.754+0000 7fddc3fff700 1 -- 172.21.15.45:0/1502437953 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fddb005a510 msgr2=0x7fddb005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:41.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.754+0000 7fddc3fff700 1 --2- 172.21.15.45:0/1502437953 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fddb005a510 0x7fddb005c9d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7fddc4067580 tx=0x7fddb8017000).stop 2023-12-22T10:00:41.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.754+0000 7fddc3fff700 1 -- 172.21.15.45:0/1502437953 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fddc4067180 msgr2=0x7fddc4145410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:41.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.754+0000 7fddc3fff700 1 --2- 172.21.15.45:0/1502437953 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fddc4067180 0x7fddc4145410 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7fddb400c610 tx=0x7fddb4007db0).stop 2023-12-22T10:00:41.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.754+0000 7fddc3fff700 1 -- 172.21.15.45:0/1502437953 shutdown_connections 2023-12-22T10:00:41.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.754+0000 7fddc3fff700 1 --2- 172.21.15.45:0/1502437953 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fddb005a510 0x7fddb005c9d0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:41.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.754+0000 7fddc3fff700 1 --2- 172.21.15.45:0/1502437953 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fddc4155050 0x7fddc40c0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:41.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.754+0000 7fddc3fff700 1 --2- 172.21.15.45:0/1502437953 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fddc4154c70 0x7fddc40c0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:41.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.754+0000 7fddc3fff700 1 --2- 172.21.15.45:0/1502437953 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fddc4067180 0x7fddc4145410 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:41.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.754+0000 7fddc3fff700 1 -- 172.21.15.45:0/1502437953 >> 172.21.15.45:0/1502437953 conn(0x7fddc4068610 msgr2=0x7fddc41538a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:41.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.754+0000 7fddc3fff700 1 -- 172.21.15.45:0/1502437953 shutdown_connections 2023-12-22T10:00:41.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.754+0000 7fddc3fff700 1 -- 172.21.15.45:0/1502437953 wait complete. 2023-12-22T10:00:41.768 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.0 2023-12-22T10:00:41.769 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-12-22T10:00:41.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.938+0000 7f16652b9700 1 Processor -- start 2023-12-22T10:00:41.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.938+0000 7f16652b9700 1 -- start start 2023-12-22T10:00:41.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.942+0000 7f16652b9700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f16600acdb0 0x7f16600c9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:41.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.942+0000 7f16652b9700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f16600caf30 0x7f16600c57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:41.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.942+0000 7f16652b9700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16600c9840 con 0x7f1660068a90 2023-12-22T10:00:41.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.942+0000 7f16652b9700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16600c6060 con 0x7f16600acdb0 2023-12-22T10:00:41.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.942+0000 7f16652b9700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16600c8f10 con 0x7f16600caf30 2023-12-22T10:00:41.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.942+0000 7f1664ab8700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f1660068a90 0x7f16600aa620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59184/0 (socket says 172.21.15.45:59184) 2023-12-22T10:00:41.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.942+0000 7f1664ab8700 1 -- 172.21.15.45:0/1254087930 learned_addr learned my addr 172.21.15.45:0/1254087930 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:00:41.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.942+0000 7f16577fe700 1 --2- 172.21.15.45:0/1254087930 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f16600caf30 0x7f16600c57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:41.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.942+0000 7f165ffff700 1 --2- 172.21.15.45:0/1254087930 >> v2:172.21.15.113:3300/0 conn(0x7f16600acdb0 0x7f16600c9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:41.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.942+0000 7f165f7fe700 1 -- 172.21.15.45:0/1254087930 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3662830680 0 0) 0x7f16600c9840 con 0x7f1660068a90 2023-12-22T10:00:41.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.942+0000 7f165f7fe700 1 -- 172.21.15.45:0/1254087930 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f164c0033f0 con 0x7f1660068a90 2023-12-22T10:00:41.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.942+0000 7f165f7fe700 1 -- 172.21.15.45:0/1254087930 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1906317151 0 0) 0x7f164c0033f0 con 0x7f1660068a90 2023-12-22T10:00:41.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.942+0000 7f165f7fe700 1 -- 172.21.15.45:0/1254087930 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f16600caf30 msgr2=0x7f16600c57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:00:41.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.942+0000 7f165f7fe700 1 --2- 172.21.15.45:0/1254087930 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f16600caf30 0x7f16600c57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:41.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.942+0000 7f165f7fe700 1 -- 172.21.15.45:0/1254087930 >> v2:172.21.15.113:3300/0 conn(0x7f16600acdb0 msgr2=0x7f16600c9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:00:41.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.942+0000 7f165f7fe700 1 --2- 172.21.15.45:0/1254087930 >> v2:172.21.15.113:3300/0 conn(0x7f16600acdb0 0x7f16600c9cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:41.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.942+0000 7f165f7fe700 1 -- 172.21.15.45:0/1254087930 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16600c91f0 con 0x7f1660068a90 2023-12-22T10:00:41.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.942+0000 7f165f7fe700 1 -- 172.21.15.45:0/1254087930 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2619163070 0 0) 0x7f16580017f0 con 0x7f1660068a90 2023-12-22T10:00:41.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.942+0000 7f165f7fe700 1 -- 172.21.15.45:0/1254087930 >> v1:172.21.15.45:6789/0 conn(0x7f1660068a90 legacy=0x7f16600aa620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:41.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.942+0000 7f165f7fe700 1 --2- 172.21.15.45:0/1254087930 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f164c0038e0 0x7f164c003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:41.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.942+0000 7f165f7fe700 1 --2- 172.21.15.45:0/1254087930 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f164c004690 0x7f164c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:41.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.942+0000 7f165f7fe700 1 --2- 172.21.15.45:0/1254087930 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f16600caf30 0x7f164c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:41.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.942+0000 7f165f7fe700 1 -- 172.21.15.45:0/1254087930 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16600c6060 con 0x7f164c0038e0 2023-12-22T10:00:41.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.942+0000 7f165f7fe700 1 -- 172.21.15.45:0/1254087930 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16600c8f10 con 0x7f164c004690 2023-12-22T10:00:41.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.942+0000 7f165f7fe700 1 -- 172.21.15.45:0/1254087930 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f164c00b8e0 con 0x7f16600caf30 2023-12-22T10:00:41.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.942+0000 7f165ffff700 1 --2- 172.21.15.45:0/1254087930 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f164c0038e0 0x7f164c003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:41.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.942+0000 7f16577fe700 1 --2- 172.21.15.45:0/1254087930 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f164c004690 0x7f164c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:41.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.942+0000 7f1664ab8700 1 --2- 172.21.15.45:0/1254087930 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f16600caf30 0x7f164c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:41.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.942+0000 7f165ffff700 1 -- 172.21.15.45:0/1254087930 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f16600caf30 msgr2=0x7f164c005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:00:41.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.942+0000 7f165ffff700 1 --2- 172.21.15.45:0/1254087930 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f16600caf30 0x7f164c005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:41.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.942+0000 7f165ffff700 1 -- 172.21.15.45:0/1254087930 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f164c004690 msgr2=0x7f164c004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:00:41.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.942+0000 7f165ffff700 1 --2- 172.21.15.45:0/1254087930 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f164c004690 0x7f164c004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:41.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.942+0000 7f165ffff700 1 -- 172.21.15.45:0/1254087930 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f164c0033f0 con 0x7f164c0038e0 2023-12-22T10:00:41.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.946+0000 7f165ffff700 1 --2- 172.21.15.45:0/1254087930 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f164c0038e0 0x7f164c003d00 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f1650009a80 tx=0x7f1650009060).ready entity=mon.0 client_cookie=934d29fd90cd3e6a server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:41.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.946+0000 7f165f7fe700 1 -- 172.21.15.45:0/1254087930 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1650009430 con 0x7f164c0038e0 2023-12-22T10:00:41.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.946+0000 7f165f7fe700 1 -- 172.21.15.45:0/1254087930 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f165000e640 con 0x7f164c0038e0 2023-12-22T10:00:41.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.946+0000 7f165f7fe700 1 -- 172.21.15.45:0/1254087930 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f165000e9c0 con 0x7f164c0038e0 2023-12-22T10:00:41.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.946+0000 7f16652b9700 1 -- 172.21.15.45:0/1254087930 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f164c0038e0 msgr2=0x7f164c003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:41.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.946+0000 7f16652b9700 1 --2- 172.21.15.45:0/1254087930 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f164c0038e0 0x7f164c003d00 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f1650009a80 tx=0x7f1650009060).stop 2023-12-22T10:00:41.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.946+0000 7f1664ab8700 1 -- 172.21.15.45:0/1254087930 reap_dead start 2023-12-22T10:00:41.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.946+0000 7f16652b9700 1 -- 172.21.15.45:0/1254087930 shutdown_connections 2023-12-22T10:00:41.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.946+0000 7f16652b9700 1 -- 172.21.15.45:0/1254087930 >> 172.21.15.45:0/1254087930 conn(0x7f1660067500 msgr2=0x7f16600ca820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:41.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.946+0000 7f16652b9700 1 -- 172.21.15.45:0/1254087930 shutdown_connections 2023-12-22T10:00:41.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.946+0000 7f16652b9700 1 -- 172.21.15.45:0/1254087930 wait complete. 2023-12-22T10:00:41.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.950+0000 7f16652b9700 1 Processor -- start 2023-12-22T10:00:41.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.950+0000 7f16652b9700 1 -- start start 2023-12-22T10:00:41.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.950+0000 7f16652b9700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f164c0038e0 0x7f1660144c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:41.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.950+0000 7f16652b9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1660163de0 0x7f16600c27a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:41.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.950+0000 7f16652b9700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1660164260 0x7f16600c2c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:41.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.950+0000 7f16652b9700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16600c3230 con 0x7f1660163de0 2023-12-22T10:00:41.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.950+0000 7f16652b9700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16600ae230 con 0x7f1660164260 2023-12-22T10:00:41.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.950+0000 7f16652b9700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16600ad900 con 0x7f164c0038e0 2023-12-22T10:00:41.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.950+0000 7f16577fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1660163de0 0x7f16600c27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:41.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.950+0000 7f16577fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1660163de0 0x7f16600c27a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48386/0 (socket says 172.21.15.45:48386) 2023-12-22T10:00:41.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.950+0000 7f16577fe700 1 -- 172.21.15.45:0/2355561367 learned_addr learned my addr 172.21.15.45:0/2355561367 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:41.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.950+0000 7f165ffff700 1 --2- 172.21.15.45:0/2355561367 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f164c0038e0 0x7f1660144c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:41.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.950+0000 7f1664ab8700 1 --2- 172.21.15.45:0/2355561367 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1660164260 0x7f16600c2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:41.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.950+0000 7f16577fe700 1 -- 172.21.15.45:0/2355561367 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f164c0038e0 msgr2=0x7f1660144c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:41.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.950+0000 7f16577fe700 1 --2- 172.21.15.45:0/2355561367 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f164c0038e0 0x7f1660144c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:41.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.950+0000 7f16577fe700 1 -- 172.21.15.45:0/2355561367 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1660164260 msgr2=0x7f16600c2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:41.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.950+0000 7f16577fe700 1 --2- 172.21.15.45:0/2355561367 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1660164260 0x7f16600c2c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:41.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.950+0000 7f16577fe700 1 -- 172.21.15.45:0/2355561367 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16600adbe0 con 0x7f1660163de0 2023-12-22T10:00:41.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.954+0000 7f16577fe700 1 --2- 172.21.15.45:0/2355561367 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1660163de0 0x7f16600c27a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f1648011710 tx=0x7f1648008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:41.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.954+0000 7f165cff9700 1 -- 172.21.15.45:0/2355561367 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16480094c0 con 0x7f1660163de0 2023-12-22T10:00:41.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.954+0000 7f165cff9700 1 -- 172.21.15.45:0/2355561367 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1648013620 con 0x7f1660163de0 2023-12-22T10:00:41.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.954+0000 7f16652b9700 1 -- 172.21.15.45:0/2355561367 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16600adec0 con 0x7f1660163de0 2023-12-22T10:00:41.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.954+0000 7f165cff9700 1 -- 172.21.15.45:0/2355561367 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16480139a0 con 0x7f1660163de0 2023-12-22T10:00:41.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.954+0000 7f16652b9700 1 -- 172.21.15.45:0/2355561367 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16600af960 con 0x7f1660163de0 2023-12-22T10:00:41.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.954+0000 7f16652b9700 1 -- 172.21.15.45:0/2355561367 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16600c1c10 con 0x7f1660163de0 2023-12-22T10:00:41.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.954+0000 7f165cff9700 1 -- 172.21.15.45:0/2355561367 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f1648015480 con 0x7f1660163de0 2023-12-22T10:00:41.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.958+0000 7f165cff9700 1 --2- 172.21.15.45:0/2355561367 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f164005a510 0x7f164005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:41.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.958+0000 7f165cff9700 1 -- 172.21.15.45:0/2355561367 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f1648074ea0 con 0x7f1660163de0 2023-12-22T10:00:41.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.958+0000 7f165ffff700 1 --2- 172.21.15.45:0/2355561367 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f164005a510 0x7f164005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:41.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.958+0000 7f165ffff700 1 --2- 172.21.15.45:0/2355561367 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f164005a510 0x7f164005c9d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f1650009a80 tx=0x7f165001a000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:41.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:41.962+0000 7f165cff9700 1 -- 172.21.15.45:0/2355561367 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f1648048560 con 0x7f1660163de0 2023-12-22T10:00:42.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:42.130+0000 7f16652b9700 1 -- 172.21.15.45:0/2355561367 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1660047060 con 0x7f1660163de0 2023-12-22T10:00:42.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:42.130+0000 7f165cff9700 1 -- 172.21.15.45:0/2355561367 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f164804bb80 con 0x7f1660163de0 2023-12-22T10:00:42.126 INFO:teuthology.orchestra.run.smithi045.stdout:55834574851 2023-12-22T10:00:42.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:42.134+0000 7f16652b9700 1 -- 172.21.15.45:0/2355561367 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f164005a510 msgr2=0x7f164005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:42.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:42.134+0000 7f16652b9700 1 --2- 172.21.15.45:0/2355561367 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f164005a510 0x7f164005c9d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f1650009a80 tx=0x7f165001a000).stop 2023-12-22T10:00:42.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:42.134+0000 7f16652b9700 1 -- 172.21.15.45:0/2355561367 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1660163de0 msgr2=0x7f16600c27a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:42.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:42.134+0000 7f16652b9700 1 --2- 172.21.15.45:0/2355561367 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1660163de0 0x7f16600c27a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f1648011710 tx=0x7f1648008040).stop 2023-12-22T10:00:42.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:42.134+0000 7f16652b9700 1 -- 172.21.15.45:0/2355561367 shutdown_connections 2023-12-22T10:00:42.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:42.134+0000 7f16652b9700 1 --2- 172.21.15.45:0/2355561367 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1660164260 0x7f16600c2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:42.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:42.134+0000 7f16652b9700 1 --2- 172.21.15.45:0/2355561367 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1660163de0 0x7f16600c27a0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:42.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:42.134+0000 7f16652b9700 1 --2- 172.21.15.45:0/2355561367 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f164005a510 0x7f164005c9d0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:42.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:42.134+0000 7f16652b9700 1 --2- 172.21.15.45:0/2355561367 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f164c0038e0 0x7f1660144c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:42.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:42.134+0000 7f16652b9700 1 -- 172.21.15.45:0/2355561367 >> 172.21.15.45:0/2355561367 conn(0x7f1660067500 msgr2=0x7f16600c0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:42.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:42.134+0000 7f16652b9700 1 -- 172.21.15.45:0/2355561367 shutdown_connections 2023-12-22T10:00:42.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:42.134+0000 7f16652b9700 1 -- 172.21.15.45:0/2355561367 wait complete. 2023-12-22T10:00:42.156 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.1 2023-12-22T10:00:43.157 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-12-22T10:00:43.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.322+0000 7fe8a4e5b700 1 Processor -- start 2023-12-22T10:00:43.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.322+0000 7fe8a4e5b700 1 -- start start 2023-12-22T10:00:43.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.322+0000 7fe8a4e5b700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fe8a0151cd0 0x7fe8a00a6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:43.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.322+0000 7fe8a4e5b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe8a00a7200 0x7fe8a00c3160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:43.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.322+0000 7fe8a4e5b700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8a0155740 con 0x7fe8a01518f0 2023-12-22T10:00:43.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.322+0000 7fe8a4e5b700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8a00c40f0 con 0x7fe8a00a7200 2023-12-22T10:00:43.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.322+0000 7fe8a4e5b700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8a00a7690 con 0x7fe8a0151cd0 2023-12-22T10:00:43.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.322+0000 7fe89ed9d700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe8a00a7200 0x7fe8a00c3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:43.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.322+0000 7fe89ed9d700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe8a00a7200 0x7fe8a00c3160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48390/0 (socket says 172.21.15.45:48390) 2023-12-22T10:00:43.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.322+0000 7fe89ed9d700 1 -- 172.21.15.45:0/2028351040 learned_addr learned my addr 172.21.15.45:0/2028351040 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:43.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.322+0000 7fe89dd9b700 1 --2- 172.21.15.45:0/2028351040 >> v2:172.21.15.113:3300/0 conn(0x7fe8a0151cd0 0x7fe8a00a6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:43.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.322+0000 7fe89ed9d700 1 -- 172.21.15.45:0/2028351040 >> v2:172.21.15.113:3300/0 conn(0x7fe8a0151cd0 msgr2=0x7fe8a00a6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:00:43.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.322+0000 7fe89ed9d700 1 --2- 172.21.15.45:0/2028351040 >> v2:172.21.15.113:3300/0 conn(0x7fe8a0151cd0 0x7fe8a00a6d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:43.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.326+0000 7fe89ed9d700 1 -- 172.21.15.45:0/2028351040 >> v1:172.21.15.113:6789/0 conn(0x7fe8a01518f0 legacy=0x7fe8a0064890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:43.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.326+0000 7fe89ed9d700 1 -- 172.21.15.45:0/2028351040 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8a00a61b0 con 0x7fe8a00a7200 2023-12-22T10:00:43.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.326+0000 7fe89ed9d700 1 --2- 172.21.15.45:0/2028351040 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8a00a7200 0x7fe8a00c3160 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7fe8a00680f0 tx=0x7fe898009840).ready entity=mon.0 client_cookie=8b1958f52ddb700b server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:43.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.326+0000 7fe89d59a700 1 -- 172.21.15.45:0/2028351040 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe89800e070 con 0x7fe8a00a7200 2023-12-22T10:00:43.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.326+0000 7fe89d59a700 1 -- 172.21.15.45:0/2028351040 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe89800ba50 con 0x7fe8a00a7200 2023-12-22T10:00:43.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.326+0000 7fe89d59a700 1 -- 172.21.15.45:0/2028351040 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe89800bdd0 con 0x7fe8a00a7200 2023-12-22T10:00:43.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.326+0000 7fe8a4e5b700 1 -- 172.21.15.45:0/2028351040 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8a00a7200 msgr2=0x7fe8a00c3160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:43.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.326+0000 7fe8a4e5b700 1 --2- 172.21.15.45:0/2028351040 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8a00a7200 0x7fe8a00c3160 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7fe8a00680f0 tx=0x7fe898009840).stop 2023-12-22T10:00:43.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.326+0000 7fe8a4e5b700 1 -- 172.21.15.45:0/2028351040 shutdown_connections 2023-12-22T10:00:43.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.326+0000 7fe8a4e5b700 1 --2- 172.21.15.45:0/2028351040 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8a00a7200 0x7fe8a00c3160 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:43.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.326+0000 7fe8a4e5b700 1 --2- 172.21.15.45:0/2028351040 >> v2:172.21.15.113:3300/0 conn(0x7fe8a0151cd0 0x7fe8a00a6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:43.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.326+0000 7fe8a4e5b700 1 -- 172.21.15.45:0/2028351040 >> 172.21.15.45:0/2028351040 conn(0x7fe8a0066a70 msgr2=0x7fe8a0066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:43.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.326+0000 7fe8a4e5b700 1 -- 172.21.15.45:0/2028351040 shutdown_connections 2023-12-22T10:00:43.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.326+0000 7fe8a4e5b700 1 -- 172.21.15.45:0/2028351040 wait complete. 2023-12-22T10:00:43.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.330+0000 7fe8a4e5b700 1 Processor -- start 2023-12-22T10:00:43.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.330+0000 7fe8a4e5b700 1 -- start start 2023-12-22T10:00:43.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.330+0000 7fe8a4e5b700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fe8a00a7200 0x7fe8a0146200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:43.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.330+0000 7fe8a4e5b700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe8a01518f0 0x7fe8a01564e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:43.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.330+0000 7fe8a4e5b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8a0151cd0 0x7fe8a01569d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:43.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.330+0000 7fe8a4e5b700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a0156f60 con 0x7fe8a0151cd0 2023-12-22T10:00:43.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.330+0000 7fe8a4e5b700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a0157240 con 0x7fe8a01518f0 2023-12-22T10:00:43.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.330+0000 7fe8a4e5b700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a0157520 con 0x7fe8a00a7200 2023-12-22T10:00:43.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.330+0000 7fe89ed9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8a0151cd0 0x7fe8a01569d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:43.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.330+0000 7fe89ed9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8a0151cd0 0x7fe8a01569d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48400/0 (socket says 172.21.15.45:48400) 2023-12-22T10:00:43.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.330+0000 7fe89ed9d700 1 -- 172.21.15.45:0/3800511120 learned_addr learned my addr 172.21.15.45:0/3800511120 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:43.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.330+0000 7fe89dd9b700 1 --2- 172.21.15.45:0/3800511120 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe8a01518f0 0x7fe8a01564e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:43.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.330+0000 7fe89e59c700 1 --2- 172.21.15.45:0/3800511120 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fe8a00a7200 0x7fe8a0146200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:43.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.330+0000 7fe89ed9d700 1 -- 172.21.15.45:0/3800511120 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fe8a00a7200 msgr2=0x7fe8a0146200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:43.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.330+0000 7fe89ed9d700 1 --2- 172.21.15.45:0/3800511120 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fe8a00a7200 0x7fe8a0146200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:43.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.330+0000 7fe89ed9d700 1 -- 172.21.15.45:0/3800511120 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe8a01518f0 msgr2=0x7fe8a01564e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:43.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.330+0000 7fe89ed9d700 1 --2- 172.21.15.45:0/3800511120 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe8a01518f0 0x7fe8a01564e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:43.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.330+0000 7fe89ed9d700 1 -- 172.21.15.45:0/3800511120 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe898009ae0 con 0x7fe8a0151cd0 2023-12-22T10:00:43.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.330+0000 7fe89ed9d700 1 --2- 172.21.15.45:0/3800511120 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8a0151cd0 0x7fe8a01569d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7fe898009fd0 tx=0x7fe898009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:43.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.330+0000 7fe88e7fc700 1 -- 172.21.15.45:0/3800511120 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8980092e0 con 0x7fe8a0151cd0 2023-12-22T10:00:43.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.330+0000 7fe88e7fc700 1 -- 172.21.15.45:0/3800511120 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe89801d410 con 0x7fe8a0151cd0 2023-12-22T10:00:43.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.330+0000 7fe8a4e5b700 1 -- 172.21.15.45:0/3800511120 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8a0157800 con 0x7fe8a0151cd0 2023-12-22T10:00:43.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.330+0000 7fe88e7fc700 1 -- 172.21.15.45:0/3800511120 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe89801d790 con 0x7fe8a0151cd0 2023-12-22T10:00:43.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.334+0000 7fe8a4e5b700 1 -- 172.21.15.45:0/3800511120 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8a00ab750 con 0x7fe8a0151cd0 2023-12-22T10:00:43.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.334+0000 7fe8a4e5b700 1 -- 172.21.15.45:0/3800511120 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8a0157a40 con 0x7fe8a0151cd0 2023-12-22T10:00:43.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.334+0000 7fe88e7fc700 1 -- 172.21.15.45:0/3800511120 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fe89801db80 con 0x7fe8a0151cd0 2023-12-22T10:00:43.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.334+0000 7fe88e7fc700 1 --2- 172.21.15.45:0/3800511120 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fe88005a510 0x7fe88005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:43.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.338+0000 7fe88e7fc700 1 -- 172.21.15.45:0/3800511120 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fe898076540 con 0x7fe8a0151cd0 2023-12-22T10:00:43.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.338+0000 7fe89e59c700 1 --2- 172.21.15.45:0/3800511120 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fe88005a510 0x7fe88005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:43.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.338+0000 7fe89e59c700 1 --2- 172.21.15.45:0/3800511120 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fe88005a510 0x7fe88005c9d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fe8900036d0 tx=0x7fe890009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:43.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.342+0000 7fe88e7fc700 1 -- 172.21.15.45:0/3800511120 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fe8a0157a40 con 0x7fe8a0151cd0 2023-12-22T10:00:43.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.502+0000 7fe8a4e5b700 1 -- 172.21.15.45:0/3800511120 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe8a0157a40 con 0x7fe8a0151cd0 2023-12-22T10:00:43.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.506+0000 7fe88e7fc700 1 -- 172.21.15.45:0/3800511120 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe8a0157a40 con 0x7fe8a0151cd0 2023-12-22T10:00:43.501 INFO:teuthology.orchestra.run.smithi045.stdout:55834574853 2023-12-22T10:00:43.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.510+0000 7fe8a4e5b700 1 -- 172.21.15.45:0/3800511120 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fe88005a510 msgr2=0x7fe88005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:43.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.510+0000 7fe8a4e5b700 1 --2- 172.21.15.45:0/3800511120 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fe88005a510 0x7fe88005c9d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fe8900036d0 tx=0x7fe890009040).stop 2023-12-22T10:00:43.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.510+0000 7fe8a4e5b700 1 -- 172.21.15.45:0/3800511120 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8a0151cd0 msgr2=0x7fe8a01569d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:43.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.510+0000 7fe8a4e5b700 1 --2- 172.21.15.45:0/3800511120 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8a0151cd0 0x7fe8a01569d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7fe898009fd0 tx=0x7fe898009840).stop 2023-12-22T10:00:43.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.510+0000 7fe8a4e5b700 1 -- 172.21.15.45:0/3800511120 shutdown_connections 2023-12-22T10:00:43.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.510+0000 7fe8a4e5b700 1 --2- 172.21.15.45:0/3800511120 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8a0151cd0 0x7fe8a01569d0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:43.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.510+0000 7fe8a4e5b700 1 --2- 172.21.15.45:0/3800511120 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe8a01518f0 0x7fe8a01564e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:43.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.510+0000 7fe8a4e5b700 1 --2- 172.21.15.45:0/3800511120 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fe88005a510 0x7fe88005c9d0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:43.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.510+0000 7fe8a4e5b700 1 --2- 172.21.15.45:0/3800511120 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fe8a00a7200 0x7fe8a0146200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:43.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.510+0000 7fe8a4e5b700 1 -- 172.21.15.45:0/3800511120 >> 172.21.15.45:0/3800511120 conn(0x7fe8a0066a70 msgr2=0x7fe8a00c4de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:43.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.510+0000 7fe8a4e5b700 1 -- 172.21.15.45:0/3800511120 shutdown_connections 2023-12-22T10:00:43.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.510+0000 7fe8a4e5b700 1 -- 172.21.15.45:0/3800511120 wait complete. 2023-12-22T10:00:43.527 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574853 for osd.1 2023-12-22T10:00:43.527 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-12-22T10:00:43.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.690+0000 7fd2f5d69700 1 Processor -- start 2023-12-22T10:00:43.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.690+0000 7fd2f5d69700 1 -- start start 2023-12-22T10:00:43.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.690+0000 7fd2f5d69700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd2f01518f0 0x7fd2f0064890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:43.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.694+0000 7fd2f5d69700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2f0155740 con 0x7fd2f0151cd0 2023-12-22T10:00:43.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.694+0000 7fd2f5d69700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2f00a61b0 con 0x7fd2f00a7420 2023-12-22T10:00:43.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.694+0000 7fd2f5d69700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f00c40f0 con 0x7fd2f01518f0 2023-12-22T10:00:43.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.694+0000 7fd2eeffd700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fd2f0151cd0 0x7fd2f00a6d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59196/0 (socket says 172.21.15.45:59196) 2023-12-22T10:00:43.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.694+0000 7fd2eeffd700 1 -- 172.21.15.45:0/3590526860 learned_addr learned my addr 172.21.15.45:0/3590526860 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:00:43.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.694+0000 7fd2ef7fe700 1 --2- 172.21.15.45:0/3590526860 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd2f01518f0 0x7fd2f0064890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:43.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.694+0000 7fd2ef7fe700 1 -- 172.21.15.45:0/3590526860 >> v1:172.21.15.113:6789/0 conn(0x7fd2f00a7420 legacy=0x7fd2f00c3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:43.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.694+0000 7fd2ee7fc700 1 -- 172.21.15.45:0/3590526860 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3552223337 0 0) 0x7fd2f0155740 con 0x7fd2f0151cd0 2023-12-22T10:00:43.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.694+0000 7fd2ef7fe700 1 -- 172.21.15.45:0/3590526860 >> v1:172.21.15.45:6789/0 conn(0x7fd2f0151cd0 legacy=0x7fd2f00a6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:43.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.694+0000 7fd2ef7fe700 1 -- 172.21.15.45:0/3590526860 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2f00a5910 con 0x7fd2f01518f0 2023-12-22T10:00:43.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.694+0000 7fd2ef7fe700 1 --2- 172.21.15.45:0/3590526860 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd2f01518f0 0x7fd2f0064890 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fd2e0009790 tx=0x7fd2e0009060).ready entity=mon.2 client_cookie=f2ca4d52340f1ae1 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:43.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.694+0000 7fd2ee7fc700 1 -- 172.21.15.45:0/3590526860 <== mon.2 v2:172.21.15.113:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e000b5a0 con 0x7fd2f01518f0 2023-12-22T10:00:43.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.694+0000 7fd2ee7fc700 1 -- 172.21.15.45:0/3590526860 <== mon.2 v2:172.21.15.113:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2e000b700 con 0x7fd2f01518f0 2023-12-22T10:00:43.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.694+0000 7fd2ee7fc700 1 -- 172.21.15.45:0/3590526860 <== mon.2 v2:172.21.15.113:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e000ba80 con 0x7fd2f01518f0 2023-12-22T10:00:43.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.694+0000 7fd2f5d69700 1 -- 172.21.15.45:0/3590526860 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd2f01518f0 msgr2=0x7fd2f0064890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:43.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.694+0000 7fd2f5d69700 1 --2- 172.21.15.45:0/3590526860 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd2f01518f0 0x7fd2f0064890 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fd2e0009790 tx=0x7fd2e0009060).stop 2023-12-22T10:00:43.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.694+0000 7fd2f5d69700 1 -- 172.21.15.45:0/3590526860 shutdown_connections 2023-12-22T10:00:43.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.694+0000 7fd2f5d69700 1 --2- 172.21.15.45:0/3590526860 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd2f01518f0 0x7fd2f0064890 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:43.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.694+0000 7fd2f5d69700 1 -- 172.21.15.45:0/3590526860 >> 172.21.15.45:0/3590526860 conn(0x7fd2f0066a70 msgr2=0x7fd2f0066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:43.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.694+0000 7fd2f5d69700 1 -- 172.21.15.45:0/3590526860 shutdown_connections 2023-12-22T10:00:43.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.694+0000 7fd2f5d69700 1 -- 172.21.15.45:0/3590526860 wait complete. 2023-12-22T10:00:43.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.698+0000 7fd2f5d69700 1 Processor -- start 2023-12-22T10:00:43.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.698+0000 7fd2f5d69700 1 -- start start 2023-12-22T10:00:43.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.698+0000 7fd2f5d69700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd2f00a7420 0x7fd2f013a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:43.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.698+0000 7fd2f5d69700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd2f01518f0 0x7fd2f0152ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:43.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.698+0000 7fd2f5d69700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2f0151cd0 0x7fd2f0152fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:43.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.698+0000 7fd2f5d69700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f0154c20 con 0x7fd2f0151cd0 2023-12-22T10:00:43.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.698+0000 7fd2f5d69700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f014ed50 con 0x7fd2f01518f0 2023-12-22T10:00:43.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.698+0000 7fd2f5d69700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f0153630 con 0x7fd2f00a7420 2023-12-22T10:00:43.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.698+0000 7fd2effff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2f0151cd0 0x7fd2f0152fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:43.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.702+0000 7fd2effff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2f0151cd0 0x7fd2f0152fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48410/0 (socket says 172.21.15.45:48410) 2023-12-22T10:00:43.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.702+0000 7fd2ef7fe700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd2f00a7420 0x7fd2f013a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:43.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.702+0000 7fd2effff700 1 -- 172.21.15.45:0/1836911092 learned_addr learned my addr 172.21.15.45:0/1836911092 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:43.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.702+0000 7fd2eeffd700 1 --2- 172.21.15.45:0/1836911092 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd2f01518f0 0x7fd2f0152ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:43.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.702+0000 7fd2effff700 1 -- 172.21.15.45:0/1836911092 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd2f00a7420 msgr2=0x7fd2f013a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:43.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.702+0000 7fd2effff700 1 --2- 172.21.15.45:0/1836911092 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd2f00a7420 0x7fd2f013a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:43.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.702+0000 7fd2effff700 1 -- 172.21.15.45:0/1836911092 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd2f01518f0 msgr2=0x7fd2f0152ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:43.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.702+0000 7fd2effff700 1 --2- 172.21.15.45:0/1836911092 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd2f01518f0 0x7fd2f0152ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:43.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.702+0000 7fd2effff700 1 -- 172.21.15.45:0/1836911092 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2e00092a0 con 0x7fd2f0151cd0 2023-12-22T10:00:43.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.702+0000 7fd2effff700 1 --2- 172.21.15.45:0/1836911092 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2f0151cd0 0x7fd2f0152fb0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7fd2e800c7c0 tx=0x7fd2e8001530).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:43.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.702+0000 7fd2d77fe700 1 -- 172.21.15.45:0/1836911092 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e8010510 con 0x7fd2f0151cd0 2023-12-22T10:00:43.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.702+0000 7fd2d77fe700 1 -- 172.21.15.45:0/1836911092 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2e8010670 con 0x7fd2f0151cd0 2023-12-22T10:00:43.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.702+0000 7fd2d77fe700 1 -- 172.21.15.45:0/1836911092 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e80109f0 con 0x7fd2f0151cd0 2023-12-22T10:00:43.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.702+0000 7fd2f5d69700 1 -- 172.21.15.45:0/1836911092 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2f0153910 con 0x7fd2f0151cd0 2023-12-22T10:00:43.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.702+0000 7fd2f5d69700 1 -- 172.21.15.45:0/1836911092 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2f00a9be0 con 0x7fd2f0151cd0 2023-12-22T10:00:43.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.702+0000 7fd2f5d69700 1 -- 172.21.15.45:0/1836911092 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2f00a55b0 con 0x7fd2f0151cd0 2023-12-22T10:00:43.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.706+0000 7fd2d77fe700 1 -- 172.21.15.45:0/1836911092 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fd2e8012440 con 0x7fd2f0151cd0 2023-12-22T10:00:43.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.706+0000 7fd2d77fe700 1 --2- 172.21.15.45:0/1836911092 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fd2dc05a540 0x7fd2dc05ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:43.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.706+0000 7fd2d77fe700 1 -- 172.21.15.45:0/1836911092 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fd2e8074010 con 0x7fd2f0151cd0 2023-12-22T10:00:43.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.706+0000 7fd2ef7fe700 1 --2- 172.21.15.45:0/1836911092 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fd2dc05a540 0x7fd2dc05ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:43.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.710+0000 7fd2ef7fe700 1 --2- 172.21.15.45:0/1836911092 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fd2dc05a540 0x7fd2dc05ca00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7fd2f014e860 tx=0x7fd2e0015000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:43.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.714+0000 7fd2d77fe700 1 -- 172.21.15.45:0/1836911092 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd2f00a55b0 con 0x7fd2f0151cd0 2023-12-22T10:00:43.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.882+0000 7fd2f5d69700 1 -- 172.21.15.45:0/1836911092 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd2f006c070 con 0x7fd2f0151cd0 2023-12-22T10:00:43.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.882+0000 7fd2d77fe700 1 -- 172.21.15.45:0/1836911092 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd2e8017030 con 0x7fd2f0151cd0 2023-12-22T10:00:43.879 INFO:teuthology.orchestra.run.smithi045.stdout:55834574854 2023-12-22T10:00:43.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.886+0000 7fd2f5d69700 1 -- 172.21.15.45:0/1836911092 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fd2dc05a540 msgr2=0x7fd2dc05ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:43.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.886+0000 7fd2f5d69700 1 --2- 172.21.15.45:0/1836911092 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fd2dc05a540 0x7fd2dc05ca00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7fd2f014e860 tx=0x7fd2e0015000).stop 2023-12-22T10:00:43.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.886+0000 7fd2f5d69700 1 -- 172.21.15.45:0/1836911092 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2f0151cd0 msgr2=0x7fd2f0152fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:43.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.886+0000 7fd2f5d69700 1 --2- 172.21.15.45:0/1836911092 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2f0151cd0 0x7fd2f0152fb0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7fd2e800c7c0 tx=0x7fd2e8001530).stop 2023-12-22T10:00:43.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.886+0000 7fd2f5d69700 1 -- 172.21.15.45:0/1836911092 shutdown_connections 2023-12-22T10:00:43.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.886+0000 7fd2f5d69700 1 --2- 172.21.15.45:0/1836911092 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2f0151cd0 0x7fd2f0152fb0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:43.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.886+0000 7fd2f5d69700 1 --2- 172.21.15.45:0/1836911092 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd2f01518f0 0x7fd2f0152ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:43.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.886+0000 7fd2f5d69700 1 --2- 172.21.15.45:0/1836911092 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fd2dc05a540 0x7fd2dc05ca00 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:43.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.886+0000 7fd2f5d69700 1 --2- 172.21.15.45:0/1836911092 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd2f00a7420 0x7fd2f013a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:43.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.886+0000 7fd2f5d69700 1 -- 172.21.15.45:0/1836911092 >> 172.21.15.45:0/1836911092 conn(0x7fd2f0066a70 msgr2=0x7fd2f014d460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:43.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.886+0000 7fd2f5d69700 1 -- 172.21.15.45:0/1836911092 shutdown_connections 2023-12-22T10:00:43.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:43.886+0000 7fd2f5d69700 1 -- 172.21.15.45:0/1836911092 wait complete. 2023-12-22T10:00:43.905 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.2 2023-12-22T10:00:43.905 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-12-22T10:00:44.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.078+0000 7fac9581b700 1 Processor -- start 2023-12-22T10:00:44.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.078+0000 7fac9581b700 1 -- start start 2023-12-22T10:00:44.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.078+0000 7fac9581b700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fac900a56f0 0x7fac900a79a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:44.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.078+0000 7fac9581b700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fac900a7e90 0x7fac9015a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:44.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.082+0000 7fac9581b700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac90150df0 con 0x7fac900a8da0 2023-12-22T10:00:44.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.082+0000 7fac9581b700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac90151ed0 con 0x7fac900a56f0 2023-12-22T10:00:44.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.082+0000 7fac9581b700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac900c1d70 con 0x7fac900a7e90 2023-12-22T10:00:44.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.082+0000 7fac8f7fe700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fac900a7e90 0x7fac9015a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:44.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.082+0000 7fac87fff700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fac900a56f0 0x7fac900a79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:44.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.082+0000 7fac8f7fe700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fac900a7e90 0x7fac9015a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.113:3301/0 says I am v2:172.21.15.45:36102/0 (socket says 172.21.15.45:36102) 2023-12-22T10:00:44.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.082+0000 7fac8f7fe700 1 -- 172.21.15.45:0/2951802709 learned_addr learned my addr 172.21.15.45:0/2951802709 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:44.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.082+0000 7fac8f7fe700 1 -- 172.21.15.45:0/2951802709 >> v2:172.21.15.113:3300/0 conn(0x7fac900a56f0 msgr2=0x7fac900a79a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:00:44.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.082+0000 7fac8f7fe700 1 --2- 172.21.15.45:0/2951802709 >> v2:172.21.15.113:3300/0 conn(0x7fac900a56f0 0x7fac900a79a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:44.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.082+0000 7fac8f7fe700 1 -- 172.21.15.45:0/2951802709 >> v1:172.21.15.113:6789/0 conn(0x7fac900a8da0 legacy=0x7fac900c1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:44.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.082+0000 7fac8f7fe700 1 -- 172.21.15.45:0/2951802709 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac90151960 con 0x7fac900a7e90 2023-12-22T10:00:44.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.082+0000 7fac8f7fe700 1 --2- 172.21.15.45:0/2951802709 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fac900a7e90 0x7fac9015a520 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fac8800bfc0 tx=0x7fac8800d040).ready entity=mon.2 client_cookie=32482c00f761f22a server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:44.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.082+0000 7fac8e7fc700 1 -- 172.21.15.45:0/2951802709 <== mon.2 v2:172.21.15.113:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac8800b2e0 con 0x7fac900a7e90 2023-12-22T10:00:44.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.082+0000 7fac8e7fc700 1 -- 172.21.15.45:0/2951802709 <== mon.2 v2:172.21.15.113:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac8800b440 con 0x7fac900a7e90 2023-12-22T10:00:44.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.082+0000 7fac8e7fc700 1 -- 172.21.15.45:0/2951802709 <== mon.2 v2:172.21.15.113:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac8800cc80 con 0x7fac900a7e90 2023-12-22T10:00:44.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.086+0000 7fac9581b700 1 -- 172.21.15.45:0/2951802709 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fac900a7e90 msgr2=0x7fac9015a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:44.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.086+0000 7fac9581b700 1 --2- 172.21.15.45:0/2951802709 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fac900a7e90 0x7fac9015a520 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fac8800bfc0 tx=0x7fac8800d040).stop 2023-12-22T10:00:44.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.086+0000 7fac9581b700 1 -- 172.21.15.45:0/2951802709 shutdown_connections 2023-12-22T10:00:44.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.086+0000 7fac9581b700 1 --2- 172.21.15.45:0/2951802709 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fac900a7e90 0x7fac9015a520 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:44.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.086+0000 7fac9581b700 1 --2- 172.21.15.45:0/2951802709 >> v2:172.21.15.113:3300/0 conn(0x7fac900a56f0 0x7fac900a79a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:44.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.086+0000 7fac9581b700 1 -- 172.21.15.45:0/2951802709 >> 172.21.15.45:0/2951802709 conn(0x7fac90066a70 msgr2=0x7fac90066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:44.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.086+0000 7fac9581b700 1 -- 172.21.15.45:0/2951802709 shutdown_connections 2023-12-22T10:00:44.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.086+0000 7fac9581b700 1 -- 172.21.15.45:0/2951802709 wait complete. 2023-12-22T10:00:44.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.086+0000 7fac9581b700 1 Processor -- start 2023-12-22T10:00:44.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.086+0000 7fac9581b700 1 -- start start 2023-12-22T10:00:44.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.090+0000 7fac9581b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac900a56f0 0x7fac90143770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:44.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.090+0000 7fac9581b700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fac900a7e90 0x7fac900c5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:44.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.090+0000 7fac9581b700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fac900a8da0 0x7fac900c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:44.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.090+0000 7fac9581b700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac900c6400 con 0x7fac900a56f0 2023-12-22T10:00:44.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.090+0000 7fac9581b700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac900aa240 con 0x7fac900a7e90 2023-12-22T10:00:44.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.090+0000 7fac9581b700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac90148360 con 0x7fac900a8da0 2023-12-22T10:00:44.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.090+0000 7fac8effd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac900a56f0 0x7fac90143770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:44.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.090+0000 7fac8f7fe700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fac900a8da0 0x7fac900c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:44.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.090+0000 7fac8effd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac900a56f0 0x7fac90143770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48424/0 (socket says 172.21.15.45:48424) 2023-12-22T10:00:44.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.090+0000 7fac8effd700 1 -- 172.21.15.45:0/4177444813 learned_addr learned my addr 172.21.15.45:0/4177444813 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:44.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.090+0000 7fac87fff700 1 --2- 172.21.15.45:0/4177444813 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fac900a7e90 0x7fac900c5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:44.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.090+0000 7fac8f7fe700 1 -- 172.21.15.45:0/4177444813 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fac900a7e90 msgr2=0x7fac900c5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:44.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.090+0000 7fac8f7fe700 1 --2- 172.21.15.45:0/4177444813 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fac900a7e90 0x7fac900c5a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:44.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.090+0000 7fac8f7fe700 1 -- 172.21.15.45:0/4177444813 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac900a56f0 msgr2=0x7fac90143770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:44.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.090+0000 7fac8f7fe700 1 --2- 172.21.15.45:0/4177444813 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac900a56f0 0x7fac90143770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:44.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.090+0000 7fac8f7fe700 1 -- 172.21.15.45:0/4177444813 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac8800bb00 con 0x7fac900a8da0 2023-12-22T10:00:44.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.090+0000 7fac87fff700 1 --2- 172.21.15.45:0/4177444813 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fac900a7e90 0x7fac900c5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-12-22T10:00:44.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.090+0000 7fac8effd700 1 --2- 172.21.15.45:0/4177444813 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac900a56f0 0x7fac90143770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-12-22T10:00:44.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.090+0000 7fac8f7fe700 1 --2- 172.21.15.45:0/4177444813 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fac900a8da0 0x7fac900c5f10 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fac90063820 tx=0x7fac88016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:44.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.090+0000 7fac86ffd700 1 -- 172.21.15.45:0/4177444813 <== mon.2 v2:172.21.15.113:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac8800b2e0 con 0x7fac900a8da0 2023-12-22T10:00:44.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.090+0000 7fac86ffd700 1 -- 172.21.15.45:0/4177444813 <== mon.2 v2:172.21.15.113:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac88007080 con 0x7fac900a8da0 2023-12-22T10:00:44.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.090+0000 7fac9581b700 1 -- 172.21.15.45:0/4177444813 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac90144670 con 0x7fac900a8da0 2023-12-22T10:00:44.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.090+0000 7fac86ffd700 1 -- 172.21.15.45:0/4177444813 <== mon.2 v2:172.21.15.113:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac88014850 con 0x7fac900a8da0 2023-12-22T10:00:44.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.090+0000 7fac9581b700 1 -- 172.21.15.45:0/4177444813 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac900a9910 con 0x7fac900a8da0 2023-12-22T10:00:44.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.094+0000 7fac9581b700 1 -- 172.21.15.45:0/4177444813 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac900aa3d0 con 0x7fac900a8da0 2023-12-22T10:00:44.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.094+0000 7fac86ffd700 1 -- 172.21.15.45:0/4177444813 <== mon.2 v2:172.21.15.113:3301/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fac88003030 con 0x7fac900a8da0 2023-12-22T10:00:44.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.098+0000 7fac86ffd700 1 --2- 172.21.15.45:0/4177444813 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fac7005a590 0x7fac7005ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:44.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.098+0000 7fac86ffd700 1 -- 172.21.15.45:0/4177444813 <== mon.2 v2:172.21.15.113:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fac88075d20 con 0x7fac900a8da0 2023-12-22T10:00:44.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.098+0000 7fac8effd700 1 --2- 172.21.15.45:0/4177444813 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fac7005a590 0x7fac7005ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:44.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.098+0000 7fac8effd700 1 --2- 172.21.15.45:0/4177444813 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fac7005a590 0x7fac7005ca50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fac80001c60 tx=0x7fac80009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:44.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.106+0000 7fac86ffd700 1 -- 172.21.15.45:0/4177444813 <== mon.2 v2:172.21.15.113:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fac880494c0 con 0x7fac900a8da0 2023-12-22T10:00:44.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.274+0000 7fac9581b700 1 -- 172.21.15.45:0/4177444813 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fac90151bf0 con 0x7fac900a8da0 2023-12-22T10:00:44.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.274+0000 7fac86ffd700 1 -- 172.21.15.45:0/4177444813 <== mon.2 v2:172.21.15.113:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fac8804cae0 con 0x7fac900a8da0 2023-12-22T10:00:44.272 INFO:teuthology.orchestra.run.smithi045.stdout:55834574853 2023-12-22T10:00:44.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.278+0000 7fac9581b700 1 -- 172.21.15.45:0/4177444813 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fac7005a590 msgr2=0x7fac7005ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:44.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.278+0000 7fac9581b700 1 --2- 172.21.15.45:0/4177444813 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fac7005a590 0x7fac7005ca50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fac80001c60 tx=0x7fac80009040).stop 2023-12-22T10:00:44.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.278+0000 7fac9581b700 1 -- 172.21.15.45:0/4177444813 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fac900a8da0 msgr2=0x7fac900c5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:44.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.278+0000 7fac9581b700 1 --2- 172.21.15.45:0/4177444813 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fac900a8da0 0x7fac900c5f10 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fac90063820 tx=0x7fac88016000).stop 2023-12-22T10:00:44.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.278+0000 7fac9581b700 1 -- 172.21.15.45:0/4177444813 shutdown_connections 2023-12-22T10:00:44.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.278+0000 7fac9581b700 1 --2- 172.21.15.45:0/4177444813 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fac7005a590 0x7fac7005ca50 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:44.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.278+0000 7fac9581b700 1 --2- 172.21.15.45:0/4177444813 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fac900a8da0 0x7fac900c5f10 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:44.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.278+0000 7fac9581b700 1 --2- 172.21.15.45:0/4177444813 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fac900a7e90 0x7fac900c5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:44.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.278+0000 7fac9581b700 1 --2- 172.21.15.45:0/4177444813 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac900a56f0 0x7fac90143770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:44.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.278+0000 7fac9581b700 1 -- 172.21.15.45:0/4177444813 >> 172.21.15.45:0/4177444813 conn(0x7fac90066a70 msgr2=0x7fac9014fc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:44.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.278+0000 7fac9581b700 1 -- 172.21.15.45:0/4177444813 shutdown_connections 2023-12-22T10:00:44.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.278+0000 7fac9581b700 1 -- 172.21.15.45:0/4177444813 wait complete. 2023-12-22T10:00:44.299 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574853 for osd.3 2023-12-22T10:00:44.300 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-12-22T10:00:44.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.470+0000 7f778a69b700 1 Processor -- start 2023-12-22T10:00:44.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.474+0000 7f778a69b700 1 -- start start 2023-12-22T10:00:44.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.474+0000 7f778a69b700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f77840a8da0 0x7f77840c1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:44.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.474+0000 7f778a69b700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7784150df0 con 0x7f77840a56f0 2023-12-22T10:00:44.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.474+0000 7f778a69b700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7784151ed0 con 0x7f77840a80b0 2023-12-22T10:00:44.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.474+0000 7f778a69b700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77840a8560 con 0x7f77840a8da0 2023-12-22T10:00:44.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.478+0000 7f7783fff700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f77840a8da0 0x7f77840c1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:44.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.478+0000 7f7783fff700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f77840a8da0 0x7f77840c1660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.113:3301/0 says I am v2:172.21.15.45:36126/0 (socket says 172.21.15.45:36126) 2023-12-22T10:00:44.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.478+0000 7f7783fff700 1 -- 172.21.15.45:0/4386760 learned_addr learned my addr 172.21.15.45:0/4386760 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:44.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.478+0000 7f777b7fe700 1 --1- 172.21.15.45:0/4386760 >> v1:172.21.15.45:6789/0 conn(0x7f77840a56f0 0x7f77840a79a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59210/0 (socket says 172.21.15.45:59210) 2023-12-22T10:00:44.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.478+0000 7f7783fff700 1 -- 172.21.15.45:0/4386760 >> v1:172.21.15.113:6789/0 conn(0x7f77840a80b0 legacy=0x7f778415a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:44.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.478+0000 7f7783fff700 1 -- 172.21.15.45:0/4386760 >> v1:172.21.15.45:6789/0 conn(0x7f77840a56f0 legacy=0x7f77840a79a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:44.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.478+0000 7f7783fff700 1 -- 172.21.15.45:0/4386760 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7784151960 con 0x7f77840a8da0 2023-12-22T10:00:44.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.478+0000 7f7783fff700 1 --2- 172.21.15.45:0/4386760 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f77840a8da0 0x7f77840c1660 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f777400d1d0 tx=0x7f777400ba50).ready entity=mon.2 client_cookie=8d0405cfd2257a51 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:44.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.478+0000 7f77837fe700 1 -- 172.21.15.45:0/4386760 <== mon.2 v2:172.21.15.113:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7774010070 con 0x7f77840a8da0 2023-12-22T10:00:44.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.478+0000 7f77837fe700 1 -- 172.21.15.45:0/4386760 <== mon.2 v2:172.21.15.113:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f777400b0d0 con 0x7f77840a8da0 2023-12-22T10:00:44.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.478+0000 7f77837fe700 1 -- 172.21.15.45:0/4386760 <== mon.2 v2:172.21.15.113:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f777400b450 con 0x7f77840a8da0 2023-12-22T10:00:44.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.478+0000 7f778a69b700 1 -- 172.21.15.45:0/4386760 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f77840a8da0 msgr2=0x7f77840c1660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:44.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.478+0000 7f778a69b700 1 --2- 172.21.15.45:0/4386760 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f77840a8da0 0x7f77840c1660 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f777400d1d0 tx=0x7f777400ba50).stop 2023-12-22T10:00:44.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.478+0000 7f778a69b700 1 -- 172.21.15.45:0/4386760 shutdown_connections 2023-12-22T10:00:44.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.478+0000 7f778a69b700 1 --2- 172.21.15.45:0/4386760 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f77840a8da0 0x7f77840c1660 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:44.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.478+0000 7f778a69b700 1 -- 172.21.15.45:0/4386760 >> 172.21.15.45:0/4386760 conn(0x7f7784066a70 msgr2=0x7f7784066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:44.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.478+0000 7f778a69b700 1 -- 172.21.15.45:0/4386760 shutdown_connections 2023-12-22T10:00:44.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.478+0000 7f778a69b700 1 -- 172.21.15.45:0/4386760 wait complete. 2023-12-22T10:00:44.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.482+0000 7f778a69b700 1 Processor -- start 2023-12-22T10:00:44.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.482+0000 7f778a69b700 1 -- start start 2023-12-22T10:00:44.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.482+0000 7f778a69b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77840a56f0 0x7f77840be690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:44.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.482+0000 7f778a69b700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f77840a80b0 0x7f778413d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:44.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.482+0000 7f778a69b700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f77840a8da0 0x7f778413dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:44.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.482+0000 7f778a69b700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f778413e2d0 con 0x7f77840a56f0 2023-12-22T10:00:44.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.482+0000 7f778a69b700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77840bc850 con 0x7f77840a8da0 2023-12-22T10:00:44.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.482+0000 7f778a69b700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77840bbc40 con 0x7f77840a80b0 2023-12-22T10:00:44.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.482+0000 7f7783fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77840a56f0 0x7f77840be690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:44.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.482+0000 7f7783fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77840a56f0 0x7f77840be690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48440/0 (socket says 172.21.15.45:48440) 2023-12-22T10:00:44.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.482+0000 7f7783fff700 1 -- 172.21.15.45:0/3927844335 learned_addr learned my addr 172.21.15.45:0/3927844335 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:44.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.482+0000 7f777b7fe700 1 --2- 172.21.15.45:0/3927844335 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f77840a80b0 0x7f778413d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:44.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.482+0000 7f7788c38700 1 --2- 172.21.15.45:0/3927844335 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f77840a8da0 0x7f778413dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:44.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.482+0000 7f7783fff700 1 -- 172.21.15.45:0/3927844335 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f77840a80b0 msgr2=0x7f778413d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:44.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.482+0000 7f7783fff700 1 --2- 172.21.15.45:0/3927844335 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f77840a80b0 0x7f778413d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:44.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.486+0000 7f7783fff700 1 -- 172.21.15.45:0/3927844335 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f77840a8da0 msgr2=0x7f778413dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:44.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.486+0000 7f7783fff700 1 --2- 172.21.15.45:0/3927844335 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f77840a8da0 0x7f778413dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:44.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.486+0000 7f7783fff700 1 -- 172.21.15.45:0/3927844335 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f777400bcf0 con 0x7f77840a56f0 2023-12-22T10:00:44.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.486+0000 7f7783fff700 1 --2- 172.21.15.45:0/3927844335 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77840a56f0 0x7f77840be690 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f7774012000 tx=0x7f777400ba50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:44.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.486+0000 7f7780ff9700 1 -- 172.21.15.45:0/3927844335 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7774015630 con 0x7f77840a56f0 2023-12-22T10:00:44.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.486+0000 7f7780ff9700 1 -- 172.21.15.45:0/3927844335 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7774015790 con 0x7f77840a56f0 2023-12-22T10:00:44.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.486+0000 7f778a69b700 1 -- 172.21.15.45:0/3927844335 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77840bbf20 con 0x7f77840a56f0 2023-12-22T10:00:44.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.486+0000 7f7780ff9700 1 -- 172.21.15.45:0/3927844335 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7774015b50 con 0x7f77840a56f0 2023-12-22T10:00:44.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.486+0000 7f778a69b700 1 -- 172.21.15.45:0/3927844335 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77840bc4e0 con 0x7f77840a56f0 2023-12-22T10:00:44.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.486+0000 7f778a69b700 1 -- 172.21.15.45:0/3927844335 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f778406c070 con 0x7f77840a56f0 2023-12-22T10:00:44.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.486+0000 7f7780ff9700 1 -- 172.21.15.45:0/3927844335 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f7774003040 con 0x7f77840a56f0 2023-12-22T10:00:44.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.490+0000 7f7780ff9700 1 --2- 172.21.15.45:0/3927844335 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f776405a510 0x7f776405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:44.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.490+0000 7f7780ff9700 1 -- 172.21.15.45:0/3927844335 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f7774078460 con 0x7f77840a56f0 2023-12-22T10:00:44.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.490+0000 7f777b7fe700 1 --2- 172.21.15.45:0/3927844335 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f776405a510 0x7f776405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:44.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.490+0000 7f777b7fe700 1 --2- 172.21.15.45:0/3927844335 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f776405a510 0x7f776405c9d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f77840be4c0 tx=0x7f776c007bf0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:44.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.494+0000 7f7780ff9700 1 -- 172.21.15.45:0/3927844335 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f777404bb80 con 0x7f77840a56f0 2023-12-22T10:00:44.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.658+0000 7f778a69b700 1 -- 172.21.15.45:0/3927844335 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f7784151bf0 con 0x7f77840a56f0 2023-12-22T10:00:44.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.658+0000 7f7780ff9700 1 -- 172.21.15.45:0/3927844335 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7774025070 con 0x7f77840a56f0 2023-12-22T10:00:44.656 INFO:teuthology.orchestra.run.smithi045.stdout:55834574853 2023-12-22T10:00:44.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.662+0000 7f778a69b700 1 -- 172.21.15.45:0/3927844335 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f776405a510 msgr2=0x7f776405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:44.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.662+0000 7f778a69b700 1 --2- 172.21.15.45:0/3927844335 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f776405a510 0x7f776405c9d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f77840be4c0 tx=0x7f776c007bf0).stop 2023-12-22T10:00:44.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.662+0000 7f778a69b700 1 -- 172.21.15.45:0/3927844335 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77840a56f0 msgr2=0x7f77840be690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:44.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.662+0000 7f778a69b700 1 --2- 172.21.15.45:0/3927844335 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77840a56f0 0x7f77840be690 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f7774012000 tx=0x7f777400ba50).stop 2023-12-22T10:00:44.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.662+0000 7f778a69b700 1 -- 172.21.15.45:0/3927844335 shutdown_connections 2023-12-22T10:00:44.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.662+0000 7f778a69b700 1 --2- 172.21.15.45:0/3927844335 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f77840a8da0 0x7f778413dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:44.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.662+0000 7f778a69b700 1 --2- 172.21.15.45:0/3927844335 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f776405a510 0x7f776405c9d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:44.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.662+0000 7f778a69b700 1 --2- 172.21.15.45:0/3927844335 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f77840a80b0 0x7f778413d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:44.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.662+0000 7f778a69b700 1 --2- 172.21.15.45:0/3927844335 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77840a56f0 0x7f77840be690 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:44.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.662+0000 7f778a69b700 1 -- 172.21.15.45:0/3927844335 >> 172.21.15.45:0/3927844335 conn(0x7f7784066a70 msgr2=0x7f77840c31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:44.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.662+0000 7f778a69b700 1 -- 172.21.15.45:0/3927844335 shutdown_connections 2023-12-22T10:00:44.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.662+0000 7f778a69b700 1 -- 172.21.15.45:0/3927844335 wait complete. 2023-12-22T10:00:44.680 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574853 for osd.4 2023-12-22T10:00:44.680 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-12-22T10:00:44.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.854+0000 7f1212fa9700 1 Processor -- start 2023-12-22T10:00:44.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.854+0000 7f1212fa9700 1 -- start start 2023-12-22T10:00:44.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.858+0000 7f1212fa9700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f120c0a8da0 0x7f120c0c1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:44.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.858+0000 7f1212fa9700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f120c0a56f0 0x7f120c0a79a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:44.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.858+0000 7f1212fa9700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f120c150df0 con 0x7f120c0a7e90 2023-12-22T10:00:44.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.858+0000 7f1212fa9700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f120c151ed0 con 0x7f120c0a56f0 2023-12-22T10:00:44.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.858+0000 7f1212fa9700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f120c151960 con 0x7f120c0a8da0 2023-12-22T10:00:44.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.858+0000 7f120bfff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f120c0a56f0 0x7f120c0a79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:44.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.858+0000 7f120bfff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f120c0a56f0 0x7f120c0a79a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48452/0 (socket says 172.21.15.45:48452) 2023-12-22T10:00:44.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.858+0000 7f120bfff700 1 -- 172.21.15.45:0/2829163695 learned_addr learned my addr 172.21.15.45:0/2829163695 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:44.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.858+0000 7f1210d45700 1 --2- 172.21.15.45:0/2829163695 >> v2:172.21.15.113:3300/0 conn(0x7f120c0a8da0 0x7f120c0c1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:44.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.858+0000 7f120bfff700 1 -- 172.21.15.45:0/2829163695 >> v2:172.21.15.113:3300/0 conn(0x7f120c0a8da0 msgr2=0x7f120c0c1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:00:44.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.858+0000 7f120bfff700 1 --2- 172.21.15.45:0/2829163695 >> v2:172.21.15.113:3300/0 conn(0x7f120c0a8da0 0x7f120c0c1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:44.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.858+0000 7f120bfff700 1 -- 172.21.15.45:0/2829163695 >> v1:172.21.15.113:6789/0 conn(0x7f120c0a7e90 legacy=0x7f120c064890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:44.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.858+0000 7f120bfff700 1 -- 172.21.15.45:0/2829163695 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f120c151bf0 con 0x7f120c0a56f0 2023-12-22T10:00:44.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.862+0000 7f120bfff700 1 --2- 172.21.15.45:0/2829163695 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f120c0a56f0 0x7f120c0a79a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f120c063820 tx=0x7f11f80090f0).ready entity=mon.0 client_cookie=275f0ad30403c5ad server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:44.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.862+0000 7f120b7fe700 1 -- 172.21.15.45:0/2829163695 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f800b520 con 0x7f120c0a56f0 2023-12-22T10:00:44.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.862+0000 7f120b7fe700 1 -- 172.21.15.45:0/2829163695 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11f800b680 con 0x7f120c0a56f0 2023-12-22T10:00:44.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.862+0000 7f120b7fe700 1 -- 172.21.15.45:0/2829163695 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f800ba20 con 0x7f120c0a56f0 2023-12-22T10:00:44.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.862+0000 7f1212fa9700 1 -- 172.21.15.45:0/2829163695 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f120c0a56f0 msgr2=0x7f120c0a79a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:44.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.862+0000 7f1212fa9700 1 --2- 172.21.15.45:0/2829163695 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f120c0a56f0 0x7f120c0a79a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f120c063820 tx=0x7f11f80090f0).stop 2023-12-22T10:00:44.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.862+0000 7f1212fa9700 1 -- 172.21.15.45:0/2829163695 shutdown_connections 2023-12-22T10:00:44.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.862+0000 7f1212fa9700 1 --2- 172.21.15.45:0/2829163695 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f120c0a56f0 0x7f120c0a79a0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:44.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.862+0000 7f1212fa9700 1 --2- 172.21.15.45:0/2829163695 >> v2:172.21.15.113:3300/0 conn(0x7f120c0a8da0 0x7f120c0c1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:44.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.862+0000 7f1212fa9700 1 -- 172.21.15.45:0/2829163695 >> 172.21.15.45:0/2829163695 conn(0x7f120c066a70 msgr2=0x7f120c066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:44.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.862+0000 7f1212fa9700 1 -- 172.21.15.45:0/2829163695 shutdown_connections 2023-12-22T10:00:44.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.862+0000 7f1212fa9700 1 -- 172.21.15.45:0/2829163695 wait complete. 2023-12-22T10:00:44.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.862+0000 7f1212fa9700 1 Processor -- start 2023-12-22T10:00:44.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.866+0000 7f1212fa9700 1 -- start start 2023-12-22T10:00:44.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.866+0000 7f1212fa9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f120c0a56f0 0x7f120c13f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:44.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.866+0000 7f1212fa9700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f120c0a7e90 0x7f120c1534f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:44.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.866+0000 7f1212fa9700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f120c0a8da0 0x7f120c1539e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:44.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.866+0000 7f1212fa9700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f120c153ed0 con 0x7f120c0a56f0 2023-12-22T10:00:44.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.866+0000 7f1212fa9700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f120c0ab540 con 0x7f120c0a8da0 2023-12-22T10:00:44.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.866+0000 7f1212fa9700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f120c0aa6f0 con 0x7f120c0a7e90 2023-12-22T10:00:44.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.866+0000 7f1210d45700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f120c0a56f0 0x7f120c13f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:44.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.866+0000 7f1210d45700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f120c0a56f0 0x7f120c13f130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48454/0 (socket says 172.21.15.45:48454) 2023-12-22T10:00:44.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.866+0000 7f1210d45700 1 -- 172.21.15.45:0/506165873 learned_addr learned my addr 172.21.15.45:0/506165873 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:44.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.866+0000 7f1211546700 1 --2- 172.21.15.45:0/506165873 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f120c0a8da0 0x7f120c1539e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:44.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.866+0000 7f120bfff700 1 --2- 172.21.15.45:0/506165873 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f120c0a7e90 0x7f120c1534f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:44.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.866+0000 7f1210d45700 1 -- 172.21.15.45:0/506165873 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f120c0a7e90 msgr2=0x7f120c1534f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:44.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.866+0000 7f1210d45700 1 --2- 172.21.15.45:0/506165873 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f120c0a7e90 0x7f120c1534f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:44.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.866+0000 7f1210d45700 1 -- 172.21.15.45:0/506165873 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f120c0a8da0 msgr2=0x7f120c1539e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:44.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.866+0000 7f1210d45700 1 --2- 172.21.15.45:0/506165873 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f120c0a8da0 0x7f120c1539e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:44.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.866+0000 7f1210d45700 1 -- 172.21.15.45:0/506165873 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11f8009370 con 0x7f120c0a56f0 2023-12-22T10:00:44.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.866+0000 7f1211546700 1 --2- 172.21.15.45:0/506165873 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f120c0a8da0 0x7f120c1539e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-12-22T10:00:44.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.866+0000 7f1210d45700 1 --2- 172.21.15.45:0/506165873 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f120c0a56f0 0x7f120c13f130 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f120000e900 tx=0x7f1200009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:44.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.866+0000 7f1208ff9700 1 -- 172.21.15.45:0/506165873 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1200012600 con 0x7f120c0a56f0 2023-12-22T10:00:44.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.866+0000 7f1208ff9700 1 -- 172.21.15.45:0/506165873 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1200012760 con 0x7f120c0a56f0 2023-12-22T10:00:44.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.866+0000 7f1212fa9700 1 -- 172.21.15.45:0/506165873 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f120c0aa9d0 con 0x7f120c0a56f0 2023-12-22T10:00:44.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.866+0000 7f1208ff9700 1 -- 172.21.15.45:0/506165873 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1200012ae0 con 0x7f120c0a56f0 2023-12-22T10:00:44.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.866+0000 7f1212fa9700 1 -- 172.21.15.45:0/506165873 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f120c0ab1d0 con 0x7f120c0a56f0 2023-12-22T10:00:44.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.870+0000 7f1212fa9700 1 -- 172.21.15.45:0/506165873 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f120c064330 con 0x7f120c0a56f0 2023-12-22T10:00:44.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.870+0000 7f1208ff9700 1 -- 172.21.15.45:0/506165873 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f120001b400 con 0x7f120c0a56f0 2023-12-22T10:00:44.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.870+0000 7f1208ff9700 1 --2- 172.21.15.45:0/506165873 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f11f005a540 0x7f11f005ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:44.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.874+0000 7f1208ff9700 1 -- 172.21.15.45:0/506165873 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f1200074b40 con 0x7f120c0a56f0 2023-12-22T10:00:44.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.874+0000 7f120bfff700 1 --2- 172.21.15.45:0/506165873 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f11f005a540 0x7f11f005ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:44.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.874+0000 7f120bfff700 1 --2- 172.21.15.45:0/506165873 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f11f005a540 0x7f11f005ca00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f11f800b2e0 tx=0x7f11f8017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:44.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:44.878+0000 7f1208ff9700 1 -- 172.21.15.45:0/506165873 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f120c064330 con 0x7f120c0a56f0 2023-12-22T10:00:45.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.046+0000 7f1212fa9700 1 -- 172.21.15.45:0/506165873 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f120c064330 con 0x7f120c0a56f0 2023-12-22T10:00:45.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.046+0000 7f1208ff9700 1 -- 172.21.15.45:0/506165873 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f120c064330 con 0x7f120c0a56f0 2023-12-22T10:00:45.043 INFO:teuthology.orchestra.run.smithi045.stdout:55834574853 2023-12-22T10:00:45.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.050+0000 7f1212fa9700 1 -- 172.21.15.45:0/506165873 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f11f005a540 msgr2=0x7f11f005ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:45.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.050+0000 7f1212fa9700 1 --2- 172.21.15.45:0/506165873 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f11f005a540 0x7f11f005ca00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f11f800b2e0 tx=0x7f11f8017000).stop 2023-12-22T10:00:45.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.050+0000 7f1212fa9700 1 -- 172.21.15.45:0/506165873 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f120c0a56f0 msgr2=0x7f120c13f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:45.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.050+0000 7f1212fa9700 1 --2- 172.21.15.45:0/506165873 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f120c0a56f0 0x7f120c13f130 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f120000e900 tx=0x7f1200009060).stop 2023-12-22T10:00:45.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.050+0000 7f1212fa9700 1 -- 172.21.15.45:0/506165873 shutdown_connections 2023-12-22T10:00:45.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.050+0000 7f1212fa9700 1 --2- 172.21.15.45:0/506165873 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f120c0a8da0 0x7f120c1539e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:45.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.050+0000 7f1212fa9700 1 --2- 172.21.15.45:0/506165873 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f11f005a540 0x7f11f005ca00 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:45.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.050+0000 7f1212fa9700 1 --2- 172.21.15.45:0/506165873 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f120c0a7e90 0x7f120c1534f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:45.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.050+0000 7f1212fa9700 1 --2- 172.21.15.45:0/506165873 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f120c0a56f0 0x7f120c13f130 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:45.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.050+0000 7f1212fa9700 1 -- 172.21.15.45:0/506165873 >> 172.21.15.45:0/506165873 conn(0x7f120c066a70 msgr2=0x7f120c0c2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:45.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.050+0000 7f1212fa9700 1 -- 172.21.15.45:0/506165873 shutdown_connections 2023-12-22T10:00:45.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.050+0000 7f1212fa9700 1 -- 172.21.15.45:0/506165873 wait complete. 2023-12-22T10:00:45.068 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574853 for osd.5 2023-12-22T10:00:45.068 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-12-22T10:00:45.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.238+0000 7f6809d07700 1 Processor -- start 2023-12-22T10:00:45.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.238+0000 7f6809d07700 1 -- start start 2023-12-22T10:00:45.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.242+0000 7f6809d07700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f68040cb130 0x7f68040c04f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:45.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.242+0000 7f6809d07700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6804157c60 0x7f68041580c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:45.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.242+0000 7f6809d07700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68040aa9b0 con 0x7f68040c0110 2023-12-22T10:00:45.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.242+0000 7f6809d07700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68040c6c20 con 0x7f6804157c60 2023-12-22T10:00:45.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.242+0000 7f6809d07700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68040c63a0 con 0x7f68040cb130 2023-12-22T10:00:45.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.242+0000 7f6809506700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6804157c60 0x7f68041580c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:45.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.242+0000 7f6809506700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6804157c60 0x7f68041580c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48466/0 (socket says 172.21.15.45:48466) 2023-12-22T10:00:45.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.242+0000 7f6809506700 1 -- 172.21.15.45:0/1859330199 learned_addr learned my addr 172.21.15.45:0/1859330199 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:45.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.242+0000 7f6803fff700 1 --2- 172.21.15.45:0/1859330199 >> v2:172.21.15.113:3300/0 conn(0x7f68040cb130 0x7f68040c04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:45.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.242+0000 7f6809506700 1 -- 172.21.15.45:0/1859330199 >> v2:172.21.15.113:3300/0 conn(0x7f68040cb130 msgr2=0x7f68040c04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:00:45.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.242+0000 7f6809506700 1 --2- 172.21.15.45:0/1859330199 >> v2:172.21.15.113:3300/0 conn(0x7f68040cb130 0x7f68040c04f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:45.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.242+0000 7f6809506700 1 -- 172.21.15.45:0/1859330199 >> v1:172.21.15.113:6789/0 conn(0x7f68040c0110 legacy=0x7f68040c5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:45.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.242+0000 7f6809506700 1 -- 172.21.15.45:0/1859330199 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68040c6660 con 0x7f6804157c60 2023-12-22T10:00:45.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.242+0000 7f6809506700 1 --2- 172.21.15.45:0/1859330199 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6804157c60 0x7f68041580c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f68040b0af0 tx=0x7f67fc009840).ready entity=mon.0 client_cookie=1c03d2a88de77c98 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:45.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.242+0000 7f68037fe700 1 -- 172.21.15.45:0/1859330199 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67fc00e070 con 0x7f6804157c60 2023-12-22T10:00:45.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.246+0000 7f68037fe700 1 -- 172.21.15.45:0/1859330199 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67fc00ba20 con 0x7f6804157c60 2023-12-22T10:00:45.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.246+0000 7f68037fe700 1 -- 172.21.15.45:0/1859330199 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67fc00bda0 con 0x7f6804157c60 2023-12-22T10:00:45.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.246+0000 7f6809d07700 1 -- 172.21.15.45:0/1859330199 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6804157c60 msgr2=0x7f68041580c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:45.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.246+0000 7f6809d07700 1 --2- 172.21.15.45:0/1859330199 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6804157c60 0x7f68041580c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f68040b0af0 tx=0x7f67fc009840).stop 2023-12-22T10:00:45.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.246+0000 7f6809d07700 1 -- 172.21.15.45:0/1859330199 shutdown_connections 2023-12-22T10:00:45.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.246+0000 7f6809d07700 1 --2- 172.21.15.45:0/1859330199 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6804157c60 0x7f68041580c0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:45.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.246+0000 7f6809d07700 1 --2- 172.21.15.45:0/1859330199 >> v2:172.21.15.113:3300/0 conn(0x7f68040cb130 0x7f68040c04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:45.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.246+0000 7f6809d07700 1 -- 172.21.15.45:0/1859330199 >> 172.21.15.45:0/1859330199 conn(0x7f6804067540 msgr2=0x7f68040ca940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:45.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.246+0000 7f6809d07700 1 -- 172.21.15.45:0/1859330199 shutdown_connections 2023-12-22T10:00:45.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.246+0000 7f6809d07700 1 -- 172.21.15.45:0/1859330199 wait complete. 2023-12-22T10:00:45.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.246+0000 7f6809d07700 1 Processor -- start 2023-12-22T10:00:45.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.246+0000 7f6809d07700 1 -- start start 2023-12-22T10:00:45.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.250+0000 7f6809d07700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68040c0110 0x7f6804168130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:45.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.250+0000 7f6809d07700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f68040cb130 0x7f6804169300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:45.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.250+0000 7f6809d07700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6804157c60 0x7f68040afa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:45.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.250+0000 7f6809d07700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68041697f0 con 0x7f68040c0110 2023-12-22T10:00:45.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.250+0000 7f6809d07700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68040af510 con 0x7f6804157c60 2023-12-22T10:00:45.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.250+0000 7f6809d07700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68040aff50 con 0x7f68040cb130 2023-12-22T10:00:45.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.250+0000 7f6808d05700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68040c0110 0x7f6804168130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:45.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.250+0000 7f6808d05700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68040c0110 0x7f6804168130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48472/0 (socket says 172.21.15.45:48472) 2023-12-22T10:00:45.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.250+0000 7f6803fff700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f68040cb130 0x7f6804169300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:45.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.250+0000 7f6808d05700 1 -- 172.21.15.45:0/4208954422 learned_addr learned my addr 172.21.15.45:0/4208954422 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:45.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.250+0000 7f6809506700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6804157c60 0x7f68040afa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:45.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.250+0000 7f6808d05700 1 -- 172.21.15.45:0/4208954422 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f68040cb130 msgr2=0x7f6804169300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:45.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.250+0000 7f6808d05700 1 --2- 172.21.15.45:0/4208954422 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f68040cb130 0x7f6804169300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:45.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.250+0000 7f6808d05700 1 -- 172.21.15.45:0/4208954422 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6804157c60 msgr2=0x7f68040afa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:45.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.250+0000 7f6808d05700 1 --2- 172.21.15.45:0/4208954422 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6804157c60 0x7f68040afa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:45.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.250+0000 7f6808d05700 1 -- 172.21.15.45:0/4208954422 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67fc009ae0 con 0x7f68040c0110 2023-12-22T10:00:45.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.250+0000 7f6809506700 1 --2- 172.21.15.45:0/4208954422 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6804157c60 0x7f68040afa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-12-22T10:00:45.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.250+0000 7f6803fff700 1 --2- 172.21.15.45:0/4208954422 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f68040cb130 0x7f6804169300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-12-22T10:00:45.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.250+0000 7f6808d05700 1 --2- 172.21.15.45:0/4208954422 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68040c0110 0x7f6804168130 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f67f800c4f0 tx=0x7f67f8007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:45.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.250+0000 7f6800ff9700 1 -- 172.21.15.45:0/4208954422 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f800ce60 con 0x7f68040c0110 2023-12-22T10:00:45.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.250+0000 7f6800ff9700 1 -- 172.21.15.45:0/4208954422 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67f8001e90 con 0x7f68040c0110 2023-12-22T10:00:45.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.250+0000 7f6800ff9700 1 -- 172.21.15.45:0/4208954422 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f8007250 con 0x7f68040c0110 2023-12-22T10:00:45.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.250+0000 7f6809d07700 1 -- 172.21.15.45:0/4208954422 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68040ad8f0 con 0x7f68040c0110 2023-12-22T10:00:45.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.254+0000 7f6809d07700 1 -- 172.21.15.45:0/4208954422 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6804168d00 con 0x7f68040c0110 2023-12-22T10:00:45.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.254+0000 7f6809d07700 1 -- 172.21.15.45:0/4208954422 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6804047060 con 0x7f68040c0110 2023-12-22T10:00:45.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.254+0000 7f6800ff9700 1 -- 172.21.15.45:0/4208954422 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f67f80066a0 con 0x7f68040c0110 2023-12-22T10:00:45.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.258+0000 7f6800ff9700 1 --2- 172.21.15.45:0/4208954422 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f67e805a510 0x7f67e805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:45.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.258+0000 7f6800ff9700 1 -- 172.21.15.45:0/4208954422 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f67f80740e0 con 0x7f68040c0110 2023-12-22T10:00:45.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.258+0000 7f6803fff700 1 --2- 172.21.15.45:0/4208954422 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f67e805a510 0x7f67e805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:45.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.258+0000 7f6803fff700 1 --2- 172.21.15.45:0/4208954422 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f67e805a510 0x7f67e805c9d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f6804165d50 tx=0x7f67f0009060).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:45.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.262+0000 7f6800ff9700 1 -- 172.21.15.45:0/4208954422 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f67f8047800 con 0x7f68040c0110 2023-12-22T10:00:45.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.430+0000 7f6809d07700 1 -- 172.21.15.45:0/4208954422 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f68040c6940 con 0x7f68040c0110 2023-12-22T10:00:45.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.430+0000 7f6800ff9700 1 -- 172.21.15.45:0/4208954422 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f67f804ae20 con 0x7f68040c0110 2023-12-22T10:00:45.427 INFO:teuthology.orchestra.run.smithi045.stdout:55834574853 2023-12-22T10:00:45.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.434+0000 7f6809d07700 1 -- 172.21.15.45:0/4208954422 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f67e805a510 msgr2=0x7f67e805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:45.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.434+0000 7f6809d07700 1 --2- 172.21.15.45:0/4208954422 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f67e805a510 0x7f67e805c9d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f6804165d50 tx=0x7f67f0009060).stop 2023-12-22T10:00:45.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.434+0000 7f6809d07700 1 -- 172.21.15.45:0/4208954422 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68040c0110 msgr2=0x7f6804168130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:45.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.434+0000 7f6809d07700 1 --2- 172.21.15.45:0/4208954422 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68040c0110 0x7f6804168130 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f67f800c4f0 tx=0x7f67f8007e00).stop 2023-12-22T10:00:45.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.434+0000 7f6809d07700 1 -- 172.21.15.45:0/4208954422 shutdown_connections 2023-12-22T10:00:45.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.434+0000 7f6809d07700 1 --2- 172.21.15.45:0/4208954422 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6804157c60 0x7f68040afa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:45.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.434+0000 7f6809d07700 1 --2- 172.21.15.45:0/4208954422 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f67e805a510 0x7f67e805c9d0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:45.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.434+0000 7f6809d07700 1 --2- 172.21.15.45:0/4208954422 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f68040cb130 0x7f6804169300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:45.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.434+0000 7f6809d07700 1 --2- 172.21.15.45:0/4208954422 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68040c0110 0x7f6804168130 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:45.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.434+0000 7f6809d07700 1 -- 172.21.15.45:0/4208954422 >> 172.21.15.45:0/4208954422 conn(0x7f6804067540 msgr2=0x7f6804155f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:45.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.434+0000 7f6809d07700 1 -- 172.21.15.45:0/4208954422 shutdown_connections 2023-12-22T10:00:45.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.434+0000 7f6809d07700 1 -- 172.21.15.45:0/4208954422 wait complete. 2023-12-22T10:00:45.449 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.6 2023-12-22T10:00:45.450 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-12-22T10:00:45.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.618+0000 7fc6f3c5b700 1 Processor -- start 2023-12-22T10:00:45.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.618+0000 7fc6f3c5b700 1 -- start start 2023-12-22T10:00:45.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.618+0000 7fc6f3c5b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc6ec0ac5c0 0x7fc6ec0c5900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:45.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.622+0000 7fc6f3c5b700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fc6ec1580d0 0x7fc6ec0aa660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:45.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.622+0000 7fc6f3c5b700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6ec0c9720 con 0x7fc6ec0c7430 2023-12-22T10:00:45.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.622+0000 7fc6f3c5b700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6ec153ec0 con 0x7fc6ec0ac5c0 2023-12-22T10:00:45.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.622+0000 7fc6f3c5b700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6ec158530 con 0x7fc6ec1580d0 2023-12-22T10:00:45.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.622+0000 7fc6f19f7700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc6ec0ac5c0 0x7fc6ec0c5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:45.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.622+0000 7fc6f21f8700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fc6ec0c7430 0x7fc6ec0c9bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59222/0 (socket says 172.21.15.45:59222) 2023-12-22T10:00:45.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.622+0000 7fc6f21f8700 1 -- 172.21.15.45:0/3761944631 learned_addr learned my addr 172.21.15.45:0/3761944631 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:00:45.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.622+0000 7fc6f11f6700 1 --2- 172.21.15.45:0/3761944631 >> v2:172.21.15.113:3300/0 conn(0x7fc6ec1580d0 0x7fc6ec0aa660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:45.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.622+0000 7fc6f19f7700 1 -- 172.21.15.45:0/3761944631 >> v2:172.21.15.113:3300/0 conn(0x7fc6ec1580d0 msgr2=0x7fc6ec0aa660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:00:45.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.622+0000 7fc6f19f7700 1 --2- 172.21.15.45:0/3761944631 >> v2:172.21.15.113:3300/0 conn(0x7fc6ec1580d0 0x7fc6ec0aa660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:45.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.622+0000 7fc6f19f7700 1 -- 172.21.15.45:0/3761944631 >> v1:172.21.15.45:6789/0 conn(0x7fc6ec0c7430 legacy=0x7fc6ec0c9bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:45.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.622+0000 7fc6f09f5700 1 -- 172.21.15.45:0/3761944631 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 409096059 0 0) 0x7fc6ec0c9720 con 0x7fc6ec0c7430 2023-12-22T10:00:45.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.622+0000 7fc6f19f7700 1 -- 172.21.15.45:0/3761944631 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6ec0c5fc0 con 0x7fc6ec0ac5c0 2023-12-22T10:00:45.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.622+0000 7fc6f19f7700 1 --2- 172.21.15.45:0/3761944631 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6ec0ac5c0 0x7fc6ec0c5900 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7fc6ec0c8d00 tx=0x7fc6e8009060).ready entity=mon.0 client_cookie=9934b8ef43e26c6d server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:45.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.622+0000 7fc6f09f5700 1 -- 172.21.15.45:0/3761944631 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e800f510 con 0x7fc6ec0ac5c0 2023-12-22T10:00:45.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.622+0000 7fc6f09f5700 1 -- 172.21.15.45:0/3761944631 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6e800f670 con 0x7fc6ec0ac5c0 2023-12-22T10:00:45.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.622+0000 7fc6f09f5700 1 -- 172.21.15.45:0/3761944631 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e800f9f0 con 0x7fc6ec0ac5c0 2023-12-22T10:00:45.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.626+0000 7fc6f3c5b700 1 -- 172.21.15.45:0/3761944631 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6ec0ac5c0 msgr2=0x7fc6ec0c5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:45.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.626+0000 7fc6f3c5b700 1 --2- 172.21.15.45:0/3761944631 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6ec0ac5c0 0x7fc6ec0c5900 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7fc6ec0c8d00 tx=0x7fc6e8009060).stop 2023-12-22T10:00:45.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.626+0000 7fc6f3c5b700 1 -- 172.21.15.45:0/3761944631 shutdown_connections 2023-12-22T10:00:45.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.626+0000 7fc6f3c5b700 1 --2- 172.21.15.45:0/3761944631 >> v2:172.21.15.113:3300/0 conn(0x7fc6ec1580d0 0x7fc6ec0aa660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:45.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.626+0000 7fc6f3c5b700 1 --2- 172.21.15.45:0/3761944631 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6ec0ac5c0 0x7fc6ec0c5900 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:45.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.626+0000 7fc6f3c5b700 1 -- 172.21.15.45:0/3761944631 >> 172.21.15.45:0/3761944631 conn(0x7fc6ec082a30 msgr2=0x7fc6ec066a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:45.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.626+0000 7fc6f3c5b700 1 -- 172.21.15.45:0/3761944631 shutdown_connections 2023-12-22T10:00:45.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.626+0000 7fc6f3c5b700 1 -- 172.21.15.45:0/3761944631 wait complete. 2023-12-22T10:00:45.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.626+0000 7fc6f3c5b700 1 Processor -- start 2023-12-22T10:00:45.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.626+0000 7fc6f3c5b700 1 -- start start 2023-12-22T10:00:45.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.630+0000 7fc6f3c5b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6ec0ac5c0 0x7fc6ec0c2a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:45.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.630+0000 7fc6f3c5b700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc6ec0c7430 0x7fc6ec1436b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:45.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.630+0000 7fc6f3c5b700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc6ec1580d0 0x7fc6ec151970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:45.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.630+0000 7fc6f3c5b700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6ec0c35a0 con 0x7fc6ec0ac5c0 2023-12-22T10:00:45.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.630+0000 7fc6f3c5b700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6ec0af670 con 0x7fc6ec1580d0 2023-12-22T10:00:45.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.630+0000 7fc6f3c5b700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6ec0c2fe0 con 0x7fc6ec0c7430 2023-12-22T10:00:45.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.630+0000 7fc6f19f7700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6ec0ac5c0 0x7fc6ec0c2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:45.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.630+0000 7fc6f19f7700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6ec0ac5c0 0x7fc6ec0c2a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48492/0 (socket says 172.21.15.45:48492) 2023-12-22T10:00:45.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.630+0000 7fc6f19f7700 1 -- 172.21.15.45:0/3596974643 learned_addr learned my addr 172.21.15.45:0/3596974643 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:45.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.630+0000 7fc6f11f6700 1 --2- 172.21.15.45:0/3596974643 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc6ec0c7430 0x7fc6ec1436b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:45.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.630+0000 7fc6f21f8700 1 --2- 172.21.15.45:0/3596974643 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc6ec1580d0 0x7fc6ec151970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:45.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.630+0000 7fc6f19f7700 1 -- 172.21.15.45:0/3596974643 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc6ec0c7430 msgr2=0x7fc6ec1436b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:45.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.630+0000 7fc6f19f7700 1 --2- 172.21.15.45:0/3596974643 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc6ec0c7430 0x7fc6ec1436b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:45.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.630+0000 7fc6f19f7700 1 -- 172.21.15.45:0/3596974643 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc6ec1580d0 msgr2=0x7fc6ec151970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:45.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.630+0000 7fc6f19f7700 1 --2- 172.21.15.45:0/3596974643 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc6ec1580d0 0x7fc6ec151970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:45.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.630+0000 7fc6f19f7700 1 -- 172.21.15.45:0/3596974643 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6e80092a0 con 0x7fc6ec0ac5c0 2023-12-22T10:00:45.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.630+0000 7fc6f19f7700 1 --2- 172.21.15.45:0/3596974643 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6ec0ac5c0 0x7fc6ec0c2a20 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7fc6e8009dd0 tx=0x7fc6e8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:45.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.630+0000 7fc6e1ffb700 1 -- 172.21.15.45:0/3596974643 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e800f7e0 con 0x7fc6ec0ac5c0 2023-12-22T10:00:45.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.630+0000 7fc6e1ffb700 1 -- 172.21.15.45:0/3596974643 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6e800f940 con 0x7fc6ec0ac5c0 2023-12-22T10:00:45.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.630+0000 7fc6f3c5b700 1 -- 172.21.15.45:0/3596974643 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6ec0c32c0 con 0x7fc6ec0ac5c0 2023-12-22T10:00:45.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.630+0000 7fc6e1ffb700 1 -- 172.21.15.45:0/3596974643 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e801b690 con 0x7fc6ec0ac5c0 2023-12-22T10:00:45.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.630+0000 7fc6f3c5b700 1 -- 172.21.15.45:0/3596974643 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6ec151e60 con 0x7fc6ec0ac5c0 2023-12-22T10:00:45.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.634+0000 7fc6f3c5b700 1 -- 172.21.15.45:0/3596974643 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6ec06c070 con 0x7fc6ec0ac5c0 2023-12-22T10:00:45.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.634+0000 7fc6e1ffb700 1 -- 172.21.15.45:0/3596974643 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fc6e801ba40 con 0x7fc6ec0ac5c0 2023-12-22T10:00:45.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.634+0000 7fc6e1ffb700 1 --2- 172.21.15.45:0/3596974643 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fc6d005a540 0x7fc6d005ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:45.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.634+0000 7fc6e1ffb700 1 -- 172.21.15.45:0/3596974643 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fc6e8075e70 con 0x7fc6ec0ac5c0 2023-12-22T10:00:45.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.634+0000 7fc6f11f6700 1 --2- 172.21.15.45:0/3596974643 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fc6d005a540 0x7fc6d005ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:45.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.638+0000 7fc6f11f6700 1 --2- 172.21.15.45:0/3596974643 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fc6d005a540 0x7fc6d005ca00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7fc6ec0c2f10 tx=0x7fc6dc009060).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:45.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.642+0000 7fc6e1ffb700 1 -- 172.21.15.45:0/3596974643 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc6e8049590 con 0x7fc6ec0ac5c0 2023-12-22T10:00:45.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.814+0000 7fc6f3c5b700 1 -- 172.21.15.45:0/3596974643 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fc6ec0c8750 con 0x7fc6ec0ac5c0 2023-12-22T10:00:45.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.814+0000 7fc6e1ffb700 1 -- 172.21.15.45:0/3596974643 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc6e8019330 con 0x7fc6ec0ac5c0 2023-12-22T10:00:45.812 INFO:teuthology.orchestra.run.smithi045.stdout:55834574853 2023-12-22T10:00:45.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.818+0000 7fc6f3c5b700 1 -- 172.21.15.45:0/3596974643 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fc6d005a540 msgr2=0x7fc6d005ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:45.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.818+0000 7fc6f3c5b700 1 --2- 172.21.15.45:0/3596974643 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fc6d005a540 0x7fc6d005ca00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7fc6ec0c2f10 tx=0x7fc6dc009060).stop 2023-12-22T10:00:45.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.818+0000 7fc6f3c5b700 1 -- 172.21.15.45:0/3596974643 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6ec0ac5c0 msgr2=0x7fc6ec0c2a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:45.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.818+0000 7fc6f3c5b700 1 --2- 172.21.15.45:0/3596974643 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6ec0ac5c0 0x7fc6ec0c2a20 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7fc6e8009dd0 tx=0x7fc6e8017000).stop 2023-12-22T10:00:45.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.818+0000 7fc6f3c5b700 1 -- 172.21.15.45:0/3596974643 shutdown_connections 2023-12-22T10:00:45.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.818+0000 7fc6f3c5b700 1 --2- 172.21.15.45:0/3596974643 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc6ec1580d0 0x7fc6ec151970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:45.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.818+0000 7fc6f3c5b700 1 --2- 172.21.15.45:0/3596974643 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fc6d005a540 0x7fc6d005ca00 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:45.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.818+0000 7fc6f3c5b700 1 --2- 172.21.15.45:0/3596974643 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc6ec0c7430 0x7fc6ec1436b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:45.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.818+0000 7fc6f3c5b700 1 --2- 172.21.15.45:0/3596974643 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6ec0ac5c0 0x7fc6ec0c2a20 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:45.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.818+0000 7fc6f3c5b700 1 -- 172.21.15.45:0/3596974643 >> 172.21.15.45:0/3596974643 conn(0x7fc6ec082a30 msgr2=0x7fc6ec1532e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:45.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.818+0000 7fc6f3c5b700 1 -- 172.21.15.45:0/3596974643 shutdown_connections 2023-12-22T10:00:45.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.818+0000 7fc6f3c5b700 1 -- 172.21.15.45:0/3596974643 wait complete. 2023-12-22T10:00:45.836 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.7 2023-12-22T10:00:45.836 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-12-22T10:00:45.836 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-22T10:00:45.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:45.998+0000 7fc457507700 1 Processor -- start 2023-12-22T10:00:45.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.002+0000 7fc457507700 1 -- start start 2023-12-22T10:00:45.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.002+0000 7fc457507700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc4500a8ad0 0x7fc450065860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:45.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.002+0000 7fc457507700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fc4500a8eb0 0x7fc4500c10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:45.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.002+0000 7fc457507700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc45015bb60 0x7fc45015c010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:45.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.002+0000 7fc457507700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc45015c500 con 0x7fc4500a8ad0 2023-12-22T10:00:45.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.002+0000 7fc457507700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4500c2630 con 0x7fc4500a8eb0 2023-12-22T10:00:45.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.002+0000 7fc457507700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4501584c0 con 0x7fc45015bb60 2023-12-22T10:00:46.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.002+0000 7fc456505700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc4500a8ad0 0x7fc450065860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:46.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.002+0000 7fc456505700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc4500a8ad0 0x7fc450065860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48498/0 (socket says 172.21.15.45:48498) 2023-12-22T10:00:46.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.002+0000 7fc456505700 1 -- 172.21.15.45:0/2540734793 learned_addr learned my addr 172.21.15.45:0/2540734793 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:46.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.002+0000 7fc456d06700 1 --2- 172.21.15.45:0/2540734793 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc45015bb60 0x7fc45015c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:46.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.002+0000 7fc455d04700 1 --2- 172.21.15.45:0/2540734793 >> v2:172.21.15.113:3300/0 conn(0x7fc4500a8eb0 0x7fc4500c10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:46.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.002+0000 7fc456505700 1 -- 172.21.15.45:0/2540734793 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc45015bb60 msgr2=0x7fc45015c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:00:46.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.002+0000 7fc456505700 1 --2- 172.21.15.45:0/2540734793 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc45015bb60 0x7fc45015c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:46.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.002+0000 7fc456505700 1 -- 172.21.15.45:0/2540734793 >> v2:172.21.15.113:3300/0 conn(0x7fc4500a8eb0 msgr2=0x7fc4500c10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:00:46.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.002+0000 7fc456505700 1 --2- 172.21.15.45:0/2540734793 >> v2:172.21.15.113:3300/0 conn(0x7fc4500a8eb0 0x7fc4500c10d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:46.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.002+0000 7fc456505700 1 -- 172.21.15.45:0/2540734793 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4500c1a20 con 0x7fc4500a8ad0 2023-12-22T10:00:46.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.002+0000 7fc456d06700 1 --2- 172.21.15.45:0/2540734793 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc45015bb60 0x7fc45015c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T10:00:46.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.002+0000 7fc456505700 1 --2- 172.21.15.45:0/2540734793 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc4500a8ad0 0x7fc450065860 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7fc4500bb9e0 tx=0x7fc44c009840).ready entity=mon.0 client_cookie=d063410b86fd1611 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:46.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.006+0000 7fc455503700 1 -- 172.21.15.45:0/2540734793 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc44c00e070 con 0x7fc4500a8ad0 2023-12-22T10:00:46.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.006+0000 7fc455503700 1 -- 172.21.15.45:0/2540734793 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc44c00ba50 con 0x7fc4500a8ad0 2023-12-22T10:00:46.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.006+0000 7fc455503700 1 -- 172.21.15.45:0/2540734793 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc44c00bdd0 con 0x7fc4500a8ad0 2023-12-22T10:00:46.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.006+0000 7fc457507700 1 -- 172.21.15.45:0/2540734793 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc4500a8ad0 msgr2=0x7fc450065860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:46.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.006+0000 7fc457507700 1 --2- 172.21.15.45:0/2540734793 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc4500a8ad0 0x7fc450065860 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7fc4500bb9e0 tx=0x7fc44c009840).stop 2023-12-22T10:00:46.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.006+0000 7fc457507700 1 -- 172.21.15.45:0/2540734793 shutdown_connections 2023-12-22T10:00:46.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.006+0000 7fc457507700 1 --2- 172.21.15.45:0/2540734793 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc45015bb60 0x7fc45015c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:46.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.006+0000 7fc457507700 1 --2- 172.21.15.45:0/2540734793 >> v2:172.21.15.113:3300/0 conn(0x7fc4500a8eb0 0x7fc4500c10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:46.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.006+0000 7fc457507700 1 --2- 172.21.15.45:0/2540734793 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc4500a8ad0 0x7fc450065860 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:46.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.006+0000 7fc457507700 1 -- 172.21.15.45:0/2540734793 >> 172.21.15.45:0/2540734793 conn(0x7fc450067540 msgr2=0x7fc4500c6460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:46.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.006+0000 7fc457507700 1 -- 172.21.15.45:0/2540734793 shutdown_connections 2023-12-22T10:00:46.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.006+0000 7fc457507700 1 -- 172.21.15.45:0/2540734793 wait complete. 2023-12-22T10:00:46.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.010+0000 7fc457507700 1 Processor -- start 2023-12-22T10:00:46.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.010+0000 7fc457507700 1 -- start start 2023-12-22T10:00:46.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.010+0000 7fc457507700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc4500a8ad0 0x7fc45013c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:46.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.010+0000 7fc457507700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc45015bb60 0x7fc450159820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:46.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.010+0000 7fc457507700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc45013cd20 0x7fc450159d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:46.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.010+0000 7fc457507700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc45015a200 con 0x7fc45015bb60 2023-12-22T10:00:46.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.010+0000 7fc457507700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4500bd910 con 0x7fc4500a8ad0 2023-12-22T10:00:46.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.010+0000 7fc457507700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4500bfd30 con 0x7fc45013cd20 2023-12-22T10:00:46.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.010+0000 7fc455d04700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc45015bb60 0x7fc450159820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:46.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.010+0000 7fc455d04700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc45015bb60 0x7fc450159820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48508/0 (socket says 172.21.15.45:48508) 2023-12-22T10:00:46.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.010+0000 7fc455d04700 1 -- 172.21.15.45:0/2932787082 learned_addr learned my addr 172.21.15.45:0/2932787082 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:46.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.010+0000 7fc456505700 1 --2- 172.21.15.45:0/2932787082 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc4500a8ad0 0x7fc45013c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:46.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.010+0000 7fc456d06700 1 --2- 172.21.15.45:0/2932787082 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc45013cd20 0x7fc450159d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:46.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.010+0000 7fc455d04700 1 -- 172.21.15.45:0/2932787082 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc45013cd20 msgr2=0x7fc450159d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:46.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.014+0000 7fc455d04700 1 --2- 172.21.15.45:0/2932787082 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc45013cd20 0x7fc450159d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:46.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.014+0000 7fc455d04700 1 -- 172.21.15.45:0/2932787082 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc4500a8ad0 msgr2=0x7fc45013c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:46.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.014+0000 7fc455d04700 1 --2- 172.21.15.45:0/2932787082 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc4500a8ad0 0x7fc45013c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:46.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.014+0000 7fc455d04700 1 -- 172.21.15.45:0/2932787082 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc44c009ae0 con 0x7fc45015bb60 2023-12-22T10:00:46.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.014+0000 7fc456505700 1 --2- 172.21.15.45:0/2932787082 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc4500a8ad0 0x7fc45013c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T10:00:46.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.014+0000 7fc455d04700 1 --2- 172.21.15.45:0/2932787082 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc45015bb60 0x7fc450159820 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7fc44000d890 tx=0x7fc440008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:46.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.014+0000 7fc4467fc700 1 -- 172.21.15.45:0/2932787082 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4400125f0 con 0x7fc45015bb60 2023-12-22T10:00:46.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.014+0000 7fc4467fc700 1 -- 172.21.15.45:0/2932787082 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc440012750 con 0x7fc45015bb60 2023-12-22T10:00:46.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.014+0000 7fc457507700 1 -- 172.21.15.45:0/2932787082 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4500c0010 con 0x7fc45015bb60 2023-12-22T10:00:46.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.014+0000 7fc4467fc700 1 -- 172.21.15.45:0/2932787082 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc440012ad0 con 0x7fc45015bb60 2023-12-22T10:00:46.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.014+0000 7fc457507700 1 -- 172.21.15.45:0/2932787082 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4500bd5a0 con 0x7fc45015bb60 2023-12-22T10:00:46.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.014+0000 7fc457507700 1 -- 172.21.15.45:0/2932787082 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4500bdaa0 con 0x7fc45015bb60 2023-12-22T10:00:46.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.014+0000 7fc4467fc700 1 -- 172.21.15.45:0/2932787082 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fc440013480 con 0x7fc45015bb60 2023-12-22T10:00:46.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.018+0000 7fc4467fc700 1 --2- 172.21.15.45:0/2932787082 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fc43405a510 0x7fc43405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:46.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.018+0000 7fc4467fc700 1 -- 172.21.15.45:0/2932787082 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fc440074630 con 0x7fc45015bb60 2023-12-22T10:00:46.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.018+0000 7fc456505700 1 --2- 172.21.15.45:0/2932787082 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fc43405a510 0x7fc43405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:46.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.018+0000 7fc456505700 1 --2- 172.21.15.45:0/2932787082 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fc43405a510 0x7fc43405c9d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7fc44c00ba20 tx=0x7fc44c009840).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:46.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.022+0000 7fc4467fc700 1 -- 172.21.15.45:0/2932787082 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc440047cf0 con 0x7fc45015bb60 2023-12-22T10:00:46.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.182+0000 7fc457507700 1 -- 172.21.15.45:0/2932787082 --> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc450047060 con 0x7fc43405a510 2023-12-22T10:00:46.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.198+0000 7fc4467fc700 1 -- 172.21.15.45:0/2932787082 <== mgr.4104 v2:172.21.15.45:6832/33679 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+335970 (secure 0 0 0) 0x7fc450047060 con 0x7fc43405a510 2023-12-22T10:00:46.202 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:00:46.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.210+0000 7fc457507700 1 -- 172.21.15.45:0/2932787082 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fc43405a510 msgr2=0x7fc43405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:46.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.210+0000 7fc457507700 1 --2- 172.21.15.45:0/2932787082 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fc43405a510 0x7fc43405c9d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7fc44c00ba20 tx=0x7fc44c009840).stop 2023-12-22T10:00:46.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.210+0000 7fc457507700 1 -- 172.21.15.45:0/2932787082 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc45015bb60 msgr2=0x7fc450159820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:46.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.210+0000 7fc457507700 1 --2- 172.21.15.45:0/2932787082 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc45015bb60 0x7fc450159820 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7fc44000d890 tx=0x7fc440008040).stop 2023-12-22T10:00:46.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.210+0000 7fc457507700 1 -- 172.21.15.45:0/2932787082 shutdown_connections 2023-12-22T10:00:46.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.210+0000 7fc457507700 1 --2- 172.21.15.45:0/2932787082 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fc43405a510 0x7fc43405c9d0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:46.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.210+0000 7fc457507700 1 --2- 172.21.15.45:0/2932787082 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc45013cd20 0x7fc450159d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:46.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.210+0000 7fc457507700 1 --2- 172.21.15.45:0/2932787082 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc45015bb60 0x7fc450159820 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:46.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.210+0000 7fc457507700 1 --2- 172.21.15.45:0/2932787082 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc4500a8ad0 0x7fc45013c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:46.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.210+0000 7fc457507700 1 -- 172.21.15.45:0/2932787082 >> 172.21.15.45:0/2932787082 conn(0x7fc450067540 msgr2=0x7fc450150c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:46.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.210+0000 7fc457507700 1 -- 172.21.15.45:0/2932787082 shutdown_connections 2023-12-22T10:00:46.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.210+0000 7fc457507700 1 -- 172.21.15.45:0/2932787082 wait complete. 2023-12-22T10:00:46.207 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-12-22T10:00:46.224 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-12-22T10:00:45.955969+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2378528,"kb_used_data":1760,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752596192,"statfs":{"total":773094113280,"available":770658500608,"internally_reserved":0,"allocated":1802240,"data_stored":646412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002922"},"pg_stats":[{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.550595+0000","last_change":"2023-12-22T10:00:33.548525+0000","last_active":"2023-12-22T10:00:33.550595+0000","last_peered":"2023-12-22T10:00:33.550595+0000","last_clean":"2023-12-22T10:00:33.550595+0000","last_became_active":"2023-12-22T10:00:33.548303+0000","last_became_peered":"2023-12-22T10:00:33.548303+0000","last_unstale":"2023-12-22T10:00:33.550595+0000","last_undegraded":"2023-12-22T10:00:33.550595+0000","last_fullsized":"2023-12-22T10:00:33.550595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.557701+0000","last_change":"2023-12-22T10:00:33.114700+0000","last_active":"2023-12-22T10:00:33.557701+0000","last_peered":"2023-12-22T10:00:33.557701+0000","last_clean":"2023-12-22T10:00:33.557701+0000","last_became_active":"2023-12-22T10:00:33.114451+0000","last_became_peered":"2023-12-22T10:00:33.114451+0000","last_unstale":"2023-12-22T10:00:33.557701+0000","last_undegraded":"2023-12-22T10:00:33.557701+0000","last_fullsized":"2023-12-22T10:00:33.557701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.566769+0000","last_change":"2023-12-22T10:00:33.565377+0000","last_active":"2023-12-22T10:00:33.566769+0000","last_peered":"2023-12-22T10:00:33.566769+0000","last_clean":"2023-12-22T10:00:33.566769+0000","last_became_active":"2023-12-22T10:00:33.565034+0000","last_became_peered":"2023-12-22T10:00:33.565034+0000","last_unstale":"2023-12-22T10:00:33.566769+0000","last_undegraded":"2023-12-22T10:00:33.566769+0000","last_fullsized":"2023-12-22T10:00:33.566769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.30","version":"20'4","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.579500+0000","last_change":"2023-12-22T10:00:33.115740+0000","last_active":"2023-12-22T10:00:33.579500+0000","last_peered":"2023-12-22T10:00:33.579500+0000","last_clean":"2023-12-22T10:00:33.579500+0000","last_became_active":"2023-12-22T10:00:33.115447+0000","last_became_peered":"2023-12-22T10:00:33.115447+0000","last_unstale":"2023-12-22T10:00:33.579500+0000","last_undegraded":"2023-12-22T10:00:33.579500+0000","last_fullsized":"2023-12-22T10:00:33.579500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.572884+0000","last_change":"2023-12-22T10:00:33.126391+0000","last_active":"2023-12-22T10:00:33.572884+0000","last_peered":"2023-12-22T10:00:33.572884+0000","last_clean":"2023-12-22T10:00:33.572884+0000","last_became_active":"2023-12-22T10:00:33.125526+0000","last_became_peered":"2023-12-22T10:00:33.125526+0000","last_unstale":"2023-12-22T10:00:33.572884+0000","last_undegraded":"2023-12-22T10:00:33.572884+0000","last_fullsized":"2023-12-22T10:00:33.572884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.564517+0000","last_change":"2023-12-22T10:00:33.562377+0000","last_active":"2023-12-22T10:00:33.564517+0000","last_peered":"2023-12-22T10:00:33.564517+0000","last_clean":"2023-12-22T10:00:33.564517+0000","last_became_active":"2023-12-22T10:00:33.562153+0000","last_became_peered":"2023-12-22T10:00:33.562153+0000","last_unstale":"2023-12-22T10:00:33.564517+0000","last_undegraded":"2023-12-22T10:00:33.564517+0000","last_fullsized":"2023-12-22T10:00:33.564517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.535033+0000","last_change":"2023-12-22T10:00:33.102597+0000","last_active":"2023-12-22T10:00:33.535033+0000","last_peered":"2023-12-22T10:00:33.535033+0000","last_clean":"2023-12-22T10:00:33.535033+0000","last_became_active":"2023-12-22T10:00:33.102275+0000","last_became_peered":"2023-12-22T10:00:33.102275+0000","last_unstale":"2023-12-22T10:00:33.535033+0000","last_undegraded":"2023-12-22T10:00:33.535033+0000","last_fullsized":"2023-12-22T10:00:33.535033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.574337+0000","last_change":"2023-12-22T10:00:33.572233+0000","last_active":"2023-12-22T10:00:33.574337+0000","last_peered":"2023-12-22T10:00:33.574337+0000","last_clean":"2023-12-22T10:00:33.574337+0000","last_became_active":"2023-12-22T10:00:33.571392+0000","last_became_peered":"2023-12-22T10:00:33.571392+0000","last_unstale":"2023-12-22T10:00:33.574337+0000","last_undegraded":"2023-12-22T10:00:33.574337+0000","last_fullsized":"2023-12-22T10:00:33.574337+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.582022+0000","last_change":"2023-12-22T10:00:33.104748+0000","last_active":"2023-12-22T10:00:33.582022+0000","last_peered":"2023-12-22T10:00:33.582022+0000","last_clean":"2023-12-22T10:00:33.582022+0000","last_became_active":"2023-12-22T10:00:33.104419+0000","last_became_peered":"2023-12-22T10:00:33.104419+0000","last_unstale":"2023-12-22T10:00:33.582022+0000","last_undegraded":"2023-12-22T10:00:33.582022+0000","last_fullsized":"2023-12-22T10:00:33.582022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.554141+0000","last_change":"2023-12-22T10:00:33.550068+0000","last_active":"2023-12-22T10:00:33.554141+0000","last_peered":"2023-12-22T10:00:33.554141+0000","last_clean":"2023-12-22T10:00:33.554141+0000","last_became_active":"2023-12-22T10:00:33.549379+0000","last_became_peered":"2023-12-22T10:00:33.549379+0000","last_unstale":"2023-12-22T10:00:33.554141+0000","last_undegraded":"2023-12-22T10:00:33.554141+0000","last_fullsized":"2023-12-22T10:00:33.554141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.552458+0000","last_change":"2023-12-22T10:00:33.125321+0000","last_active":"2023-12-22T10:00:33.552458+0000","last_peered":"2023-12-22T10:00:33.552458+0000","last_clean":"2023-12-22T10:00:33.552458+0000","last_became_active":"2023-12-22T10:00:33.124941+0000","last_became_peered":"2023-12-22T10:00:33.124941+0000","last_unstale":"2023-12-22T10:00:33.552458+0000","last_undegraded":"2023-12-22T10:00:33.552458+0000","last_fullsized":"2023-12-22T10:00:33.552458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.559455+0000","last_change":"2023-12-22T10:00:33.555687+0000","last_active":"2023-12-22T10:00:33.559455+0000","last_peered":"2023-12-22T10:00:33.559455+0000","last_clean":"2023-12-22T10:00:33.559455+0000","last_became_active":"2023-12-22T10:00:33.555390+0000","last_became_peered":"2023-12-22T10:00:33.555390+0000","last_unstale":"2023-12-22T10:00:33.559455+0000","last_undegraded":"2023-12-22T10:00:33.559455+0000","last_fullsized":"2023-12-22T10:00:33.559455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.568874+0000","last_change":"2023-12-22T10:00:33.105518+0000","last_active":"2023-12-22T10:00:33.568874+0000","last_peered":"2023-12-22T10:00:33.568874+0000","last_clean":"2023-12-22T10:00:33.568874+0000","last_became_active":"2023-12-22T10:00:33.105228+0000","last_became_peered":"2023-12-22T10:00:33.105228+0000","last_unstale":"2023-12-22T10:00:33.568874+0000","last_undegraded":"2023-12-22T10:00:33.568874+0000","last_fullsized":"2023-12-22T10:00:33.568874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.560977+0000","last_change":"2023-12-22T10:00:33.557230+0000","last_active":"2023-12-22T10:00:33.560977+0000","last_peered":"2023-12-22T10:00:33.560977+0000","last_clean":"2023-12-22T10:00:33.560977+0000","last_became_active":"2023-12-22T10:00:33.556941+0000","last_became_peered":"2023-12-22T10:00:33.556941+0000","last_unstale":"2023-12-22T10:00:33.560977+0000","last_undegraded":"2023-12-22T10:00:33.560977+0000","last_fullsized":"2023-12-22T10:00:33.560977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.537134+0000","last_change":"2023-12-22T10:00:33.116904+0000","last_active":"2023-12-22T10:00:33.537134+0000","last_peered":"2023-12-22T10:00:33.537134+0000","last_clean":"2023-12-22T10:00:33.537134+0000","last_became_active":"2023-12-22T10:00:33.116529+0000","last_became_peered":"2023-12-22T10:00:33.116529+0000","last_unstale":"2023-12-22T10:00:33.537134+0000","last_undegraded":"2023-12-22T10:00:33.537134+0000","last_fullsized":"2023-12-22T10:00:33.537134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.572395+0000","last_change":"2023-12-22T10:00:33.568568+0000","last_active":"2023-12-22T10:00:33.572395+0000","last_peered":"2023-12-22T10:00:33.572395+0000","last_clean":"2023-12-22T10:00:33.572395+0000","last_became_active":"2023-12-22T10:00:33.568292+0000","last_became_peered":"2023-12-22T10:00:33.568292+0000","last_unstale":"2023-12-22T10:00:33.572395+0000","last_undegraded":"2023-12-22T10:00:33.572395+0000","last_fullsized":"2023-12-22T10:00:33.572395+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.557798+0000","last_change":"2023-12-22T10:00:33.117091+0000","last_active":"2023-12-22T10:00:33.557798+0000","last_peered":"2023-12-22T10:00:33.557798+0000","last_clean":"2023-12-22T10:00:33.557798+0000","last_became_active":"2023-12-22T10:00:33.116766+0000","last_became_peered":"2023-12-22T10:00:33.116766+0000","last_unstale":"2023-12-22T10:00:33.557798+0000","last_undegraded":"2023-12-22T10:00:33.557798+0000","last_fullsized":"2023-12-22T10:00:33.557798+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.566935+0000","last_change":"2023-12-22T10:00:33.561834+0000","last_active":"2023-12-22T10:00:33.566935+0000","last_peered":"2023-12-22T10:00:33.566935+0000","last_clean":"2023-12-22T10:00:33.566935+0000","last_became_active":"2023-12-22T10:00:33.561545+0000","last_became_peered":"2023-12-22T10:00:33.561545+0000","last_unstale":"2023-12-22T10:00:33.566935+0000","last_undegraded":"2023-12-22T10:00:33.566935+0000","last_fullsized":"2023-12-22T10:00:33.566935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.563732+0000","last_change":"2023-12-22T10:00:33.108579+0000","last_active":"2023-12-22T10:00:33.563732+0000","last_peered":"2023-12-22T10:00:33.563732+0000","last_clean":"2023-12-22T10:00:33.563732+0000","last_became_active":"2023-12-22T10:00:33.108196+0000","last_became_peered":"2023-12-22T10:00:33.108196+0000","last_unstale":"2023-12-22T10:00:33.563732+0000","last_undegraded":"2023-12-22T10:00:33.563732+0000","last_fullsized":"2023-12-22T10:00:33.563732+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.554072+0000","last_change":"2023-12-22T10:00:33.548625+0000","last_active":"2023-12-22T10:00:33.554072+0000","last_peered":"2023-12-22T10:00:33.554072+0000","last_clean":"2023-12-22T10:00:33.554072+0000","last_became_active":"2023-12-22T10:00:33.547877+0000","last_became_peered":"2023-12-22T10:00:33.547877+0000","last_unstale":"2023-12-22T10:00:33.554072+0000","last_undegraded":"2023-12-22T10:00:33.554072+0000","last_fullsized":"2023-12-22T10:00:33.554072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.567687+0000","last_change":"2023-12-22T10:00:33.122895+0000","last_active":"2023-12-22T10:00:33.567687+0000","last_peered":"2023-12-22T10:00:33.567687+0000","last_clean":"2023-12-22T10:00:33.567687+0000","last_became_active":"2023-12-22T10:00:33.122475+0000","last_became_peered":"2023-12-22T10:00:33.122475+0000","last_unstale":"2023-12-22T10:00:33.567687+0000","last_undegraded":"2023-12-22T10:00:33.567687+0000","last_fullsized":"2023-12-22T10:00:33.567687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.546974+0000","last_change":"2023-12-22T10:00:33.545482+0000","last_active":"2023-12-22T10:00:33.546974+0000","last_peered":"2023-12-22T10:00:33.546974+0000","last_clean":"2023-12-22T10:00:33.546974+0000","last_became_active":"2023-12-22T10:00:33.545263+0000","last_became_peered":"2023-12-22T10:00:33.545263+0000","last_unstale":"2023-12-22T10:00:33.546974+0000","last_undegraded":"2023-12-22T10:00:33.546974+0000","last_fullsized":"2023-12-22T10:00:33.546974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-22T10:00:35.632723+0000","last_change":"2023-12-22T10:00:33.116864+0000","last_active":"2023-12-22T10:00:35.632723+0000","last_peered":"2023-12-22T10:00:35.632723+0000","last_clean":"2023-12-22T10:00:35.632723+0000","last_became_active":"2023-12-22T10:00:33.114073+0000","last_became_peered":"2023-12-22T10:00:33.114073+0000","last_unstale":"2023-12-22T10:00:35.632723+0000","last_undegraded":"2023-12-22T10:00:35.632723+0000","last_fullsized":"2023-12-22T10:00:35.632723+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.574592+0000","last_change":"2023-12-22T10:00:33.570093+0000","last_active":"2023-12-22T10:00:33.574592+0000","last_peered":"2023-12-22T10:00:33.574592+0000","last_clean":"2023-12-22T10:00:33.574592+0000","last_became_active":"2023-12-22T10:00:33.569770+0000","last_became_peered":"2023-12-22T10:00:33.569770+0000","last_unstale":"2023-12-22T10:00:33.574592+0000","last_undegraded":"2023-12-22T10:00:33.574592+0000","last_fullsized":"2023-12-22T10:00:33.574592+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.553842+0000","last_change":"2023-12-22T10:00:33.104605+0000","last_active":"2023-12-22T10:00:33.553842+0000","last_peered":"2023-12-22T10:00:33.553842+0000","last_clean":"2023-12-22T10:00:33.553842+0000","last_became_active":"2023-12-22T10:00:33.104303+0000","last_became_peered":"2023-12-22T10:00:33.104303+0000","last_unstale":"2023-12-22T10:00:33.553842+0000","last_undegraded":"2023-12-22T10:00:33.553842+0000","last_fullsized":"2023-12-22T10:00:33.553842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.566847+0000","last_change":"2023-12-22T10:00:33.562874+0000","last_active":"2023-12-22T10:00:33.566847+0000","last_peered":"2023-12-22T10:00:33.566847+0000","last_clean":"2023-12-22T10:00:33.566847+0000","last_became_active":"2023-12-22T10:00:33.562576+0000","last_became_peered":"2023-12-22T10:00:33.562576+0000","last_unstale":"2023-12-22T10:00:33.566847+0000","last_undegraded":"2023-12-22T10:00:33.566847+0000","last_fullsized":"2023-12-22T10:00:33.566847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.553589+0000","last_change":"2023-12-22T10:00:33.119412+0000","last_active":"2023-12-22T10:00:33.553589+0000","last_peered":"2023-12-22T10:00:33.553589+0000","last_clean":"2023-12-22T10:00:33.553589+0000","last_became_active":"2023-12-22T10:00:33.119056+0000","last_became_peered":"2023-12-22T10:00:33.119056+0000","last_unstale":"2023-12-22T10:00:33.553589+0000","last_undegraded":"2023-12-22T10:00:33.553589+0000","last_fullsized":"2023-12-22T10:00:33.553589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.567918+0000","last_change":"2023-12-22T10:00:33.560630+0000","last_active":"2023-12-22T10:00:33.567918+0000","last_peered":"2023-12-22T10:00:33.567918+0000","last_clean":"2023-12-22T10:00:33.567918+0000","last_became_active":"2023-12-22T10:00:33.559732+0000","last_became_peered":"2023-12-22T10:00:33.559732+0000","last_unstale":"2023-12-22T10:00:33.567918+0000","last_undegraded":"2023-12-22T10:00:33.567918+0000","last_fullsized":"2023-12-22T10:00:33.567918+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.563517+0000","last_change":"2023-12-22T10:00:33.101844+0000","last_active":"2023-12-22T10:00:33.563517+0000","last_peered":"2023-12-22T10:00:33.563517+0000","last_clean":"2023-12-22T10:00:33.563517+0000","last_became_active":"2023-12-22T10:00:33.101555+0000","last_became_peered":"2023-12-22T10:00:33.101555+0000","last_unstale":"2023-12-22T10:00:33.563517+0000","last_undegraded":"2023-12-22T10:00:33.563517+0000","last_fullsized":"2023-12-22T10:00:33.563517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.574042+0000","last_change":"2023-12-22T10:00:33.570633+0000","last_active":"2023-12-22T10:00:33.574042+0000","last_peered":"2023-12-22T10:00:33.574042+0000","last_clean":"2023-12-22T10:00:33.574042+0000","last_became_active":"2023-12-22T10:00:33.570252+0000","last_became_peered":"2023-12-22T10:00:33.570252+0000","last_unstale":"2023-12-22T10:00:33.574042+0000","last_undegraded":"2023-12-22T10:00:33.574042+0000","last_fullsized":"2023-12-22T10:00:33.574042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.563696+0000","last_change":"2023-12-22T10:00:33.116761+0000","last_active":"2023-12-22T10:00:33.563696+0000","last_peered":"2023-12-22T10:00:33.563696+0000","last_clean":"2023-12-22T10:00:33.563696+0000","last_became_active":"2023-12-22T10:00:33.116474+0000","last_became_peered":"2023-12-22T10:00:33.116474+0000","last_unstale":"2023-12-22T10:00:33.563696+0000","last_undegraded":"2023-12-22T10:00:33.563696+0000","last_fullsized":"2023-12-22T10:00:33.563696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.580112+0000","last_change":"2023-12-22T10:00:33.571361+0000","last_active":"2023-12-22T10:00:33.580112+0000","last_peered":"2023-12-22T10:00:33.580112+0000","last_clean":"2023-12-22T10:00:33.580112+0000","last_became_active":"2023-12-22T10:00:33.571028+0000","last_became_peered":"2023-12-22T10:00:33.571028+0000","last_unstale":"2023-12-22T10:00:33.580112+0000","last_undegraded":"2023-12-22T10:00:33.580112+0000","last_fullsized":"2023-12-22T10:00:33.580112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.533714+0000","last_change":"2023-12-22T10:00:33.106541+0000","last_active":"2023-12-22T10:00:33.533714+0000","last_peered":"2023-12-22T10:00:33.533714+0000","last_clean":"2023-12-22T10:00:33.533714+0000","last_became_active":"2023-12-22T10:00:33.106335+0000","last_became_peered":"2023-12-22T10:00:33.106335+0000","last_unstale":"2023-12-22T10:00:33.533714+0000","last_undegraded":"2023-12-22T10:00:33.533714+0000","last_fullsized":"2023-12-22T10:00:33.533714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.556351+0000","last_change":"2023-12-22T10:00:33.549027+0000","last_active":"2023-12-22T10:00:33.556351+0000","last_peered":"2023-12-22T10:00:33.556351+0000","last_clean":"2023-12-22T10:00:33.556351+0000","last_became_active":"2023-12-22T10:00:33.548700+0000","last_became_peered":"2023-12-22T10:00:33.548700+0000","last_unstale":"2023-12-22T10:00:33.556351+0000","last_undegraded":"2023-12-22T10:00:33.556351+0000","last_fullsized":"2023-12-22T10:00:33.556351+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.536888+0000","last_change":"2023-12-22T10:00:33.114834+0000","last_active":"2023-12-22T10:00:33.536888+0000","last_peered":"2023-12-22T10:00:33.536888+0000","last_clean":"2023-12-22T10:00:33.536888+0000","last_became_active":"2023-12-22T10:00:33.114551+0000","last_became_peered":"2023-12-22T10:00:33.114551+0000","last_unstale":"2023-12-22T10:00:33.536888+0000","last_undegraded":"2023-12-22T10:00:33.536888+0000","last_fullsized":"2023-12-22T10:00:33.536888+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.570248+0000","last_change":"2023-12-22T10:00:33.569508+0000","last_active":"2023-12-22T10:00:33.570248+0000","last_peered":"2023-12-22T10:00:33.570248+0000","last_clean":"2023-12-22T10:00:33.570248+0000","last_became_active":"2023-12-22T10:00:33.569153+0000","last_became_peered":"2023-12-22T10:00:33.569153+0000","last_unstale":"2023-12-22T10:00:33.570248+0000","last_undegraded":"2023-12-22T10:00:33.570248+0000","last_fullsized":"2023-12-22T10:00:33.570248+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.581087+0000","last_change":"2023-12-22T10:00:33.122806+0000","last_active":"2023-12-22T10:00:33.581087+0000","last_peered":"2023-12-22T10:00:33.581087+0000","last_clean":"2023-12-22T10:00:33.581087+0000","last_became_active":"2023-12-22T10:00:33.122335+0000","last_became_peered":"2023-12-22T10:00:33.122335+0000","last_unstale":"2023-12-22T10:00:33.581087+0000","last_undegraded":"2023-12-22T10:00:33.581087+0000","last_fullsized":"2023-12-22T10:00:33.581087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.562584+0000","last_change":"2023-12-22T10:00:33.558380+0000","last_active":"2023-12-22T10:00:33.562584+0000","last_peered":"2023-12-22T10:00:33.562584+0000","last_clean":"2023-12-22T10:00:33.562584+0000","last_became_active":"2023-12-22T10:00:33.557645+0000","last_became_peered":"2023-12-22T10:00:33.557645+0000","last_unstale":"2023-12-22T10:00:33.562584+0000","last_undegraded":"2023-12-22T10:00:33.562584+0000","last_fullsized":"2023-12-22T10:00:33.562584+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.575125+0000","last_change":"2023-12-22T10:00:33.108312+0000","last_active":"2023-12-22T10:00:33.575125+0000","last_peered":"2023-12-22T10:00:33.575125+0000","last_clean":"2023-12-22T10:00:33.575125+0000","last_became_active":"2023-12-22T10:00:33.107971+0000","last_became_peered":"2023-12-22T10:00:33.107971+0000","last_unstale":"2023-12-22T10:00:33.575125+0000","last_undegraded":"2023-12-22T10:00:33.575125+0000","last_fullsized":"2023-12-22T10:00:33.575125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.553973+0000","last_change":"2023-12-22T10:00:33.545698+0000","last_active":"2023-12-22T10:00:33.553973+0000","last_peered":"2023-12-22T10:00:33.553973+0000","last_clean":"2023-12-22T10:00:33.553973+0000","last_became_active":"2023-12-22T10:00:33.545320+0000","last_became_peered":"2023-12-22T10:00:33.545320+0000","last_unstale":"2023-12-22T10:00:33.553973+0000","last_undegraded":"2023-12-22T10:00:33.553973+0000","last_fullsized":"2023-12-22T10:00:33.553973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.583316+0000","last_change":"2023-12-22T10:00:33.131076+0000","last_active":"2023-12-22T10:00:33.583316+0000","last_peered":"2023-12-22T10:00:33.583316+0000","last_clean":"2023-12-22T10:00:33.583316+0000","last_became_active":"2023-12-22T10:00:33.129467+0000","last_became_peered":"2023-12-22T10:00:33.129467+0000","last_unstale":"2023-12-22T10:00:33.583316+0000","last_undegraded":"2023-12-22T10:00:33.583316+0000","last_fullsized":"2023-12-22T10:00:33.583316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.569110+0000","last_change":"2023-12-22T10:00:33.562206+0000","last_active":"2023-12-22T10:00:33.569110+0000","last_peered":"2023-12-22T10:00:33.569110+0000","last_clean":"2023-12-22T10:00:33.569110+0000","last_became_active":"2023-12-22T10:00:33.561891+0000","last_became_peered":"2023-12-22T10:00:33.561891+0000","last_unstale":"2023-12-22T10:00:33.569110+0000","last_undegraded":"2023-12-22T10:00:33.569110+0000","last_fullsized":"2023-12-22T10:00:33.569110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.540004+0000","last_change":"2023-12-22T10:00:33.123149+0000","last_active":"2023-12-22T10:00:33.540004+0000","last_peered":"2023-12-22T10:00:33.540004+0000","last_clean":"2023-12-22T10:00:33.540004+0000","last_became_active":"2023-12-22T10:00:33.122935+0000","last_became_peered":"2023-12-22T10:00:33.122935+0000","last_unstale":"2023-12-22T10:00:33.540004+0000","last_undegraded":"2023-12-22T10:00:33.540004+0000","last_fullsized":"2023-12-22T10:00:33.540004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.568376+0000","last_change":"2023-12-22T10:00:33.567288+0000","last_active":"2023-12-22T10:00:33.568376+0000","last_peered":"2023-12-22T10:00:33.568376+0000","last_clean":"2023-12-22T10:00:33.568376+0000","last_became_active":"2023-12-22T10:00:33.566952+0000","last_became_peered":"2023-12-22T10:00:33.566952+0000","last_unstale":"2023-12-22T10:00:33.568376+0000","last_undegraded":"2023-12-22T10:00:33.568376+0000","last_fullsized":"2023-12-22T10:00:33.568376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.538624+0000","last_change":"2023-12-22T10:00:33.123825+0000","last_active":"2023-12-22T10:00:33.538624+0000","last_peered":"2023-12-22T10:00:33.538624+0000","last_clean":"2023-12-22T10:00:33.538624+0000","last_became_active":"2023-12-22T10:00:33.123481+0000","last_became_peered":"2023-12-22T10:00:33.123481+0000","last_unstale":"2023-12-22T10:00:33.538624+0000","last_undegraded":"2023-12-22T10:00:33.538624+0000","last_fullsized":"2023-12-22T10:00:33.538624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.557967+0000","last_change":"2023-12-22T10:00:33.555572+0000","last_active":"2023-12-22T10:00:33.557967+0000","last_peered":"2023-12-22T10:00:33.557967+0000","last_clean":"2023-12-22T10:00:33.557967+0000","last_became_active":"2023-12-22T10:00:33.555250+0000","last_became_peered":"2023-12-22T10:00:33.555250+0000","last_unstale":"2023-12-22T10:00:33.557967+0000","last_undegraded":"2023-12-22T10:00:33.557967+0000","last_fullsized":"2023-12-22T10:00:33.557967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.537289+0000","last_change":"2023-12-22T10:00:33.124398+0000","last_active":"2023-12-22T10:00:33.537289+0000","last_peered":"2023-12-22T10:00:33.537289+0000","last_clean":"2023-12-22T10:00:33.537289+0000","last_became_active":"2023-12-22T10:00:33.124096+0000","last_became_peered":"2023-12-22T10:00:33.124096+0000","last_unstale":"2023-12-22T10:00:33.537289+0000","last_undegraded":"2023-12-22T10:00:33.537289+0000","last_fullsized":"2023-12-22T10:00:33.537289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.574132+0000","last_change":"2023-12-22T10:00:33.571592+0000","last_active":"2023-12-22T10:00:33.574132+0000","last_peered":"2023-12-22T10:00:33.574132+0000","last_clean":"2023-12-22T10:00:33.574132+0000","last_became_active":"2023-12-22T10:00:33.570984+0000","last_became_peered":"2023-12-22T10:00:33.570984+0000","last_unstale":"2023-12-22T10:00:33.574132+0000","last_undegraded":"2023-12-22T10:00:33.574132+0000","last_fullsized":"2023-12-22T10:00:33.574132+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.535021+0000","last_change":"2023-12-22T10:00:33.112772+0000","last_active":"2023-12-22T10:00:33.535021+0000","last_peered":"2023-12-22T10:00:33.535021+0000","last_clean":"2023-12-22T10:00:33.535021+0000","last_became_active":"2023-12-22T10:00:33.111855+0000","last_became_peered":"2023-12-22T10:00:33.111855+0000","last_unstale":"2023-12-22T10:00:33.535021+0000","last_undegraded":"2023-12-22T10:00:33.535021+0000","last_fullsized":"2023-12-22T10:00:33.535021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.548367+0000","last_change":"2023-12-22T10:00:33.544852+0000","last_active":"2023-12-22T10:00:33.548367+0000","last_peered":"2023-12-22T10:00:33.548367+0000","last_clean":"2023-12-22T10:00:33.548367+0000","last_became_active":"2023-12-22T10:00:33.544552+0000","last_became_peered":"2023-12-22T10:00:33.544552+0000","last_unstale":"2023-12-22T10:00:33.548367+0000","last_undegraded":"2023-12-22T10:00:33.548367+0000","last_fullsized":"2023-12-22T10:00:33.548367+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.558216+0000","last_change":"2023-12-22T10:00:33.113222+0000","last_active":"2023-12-22T10:00:33.558216+0000","last_peered":"2023-12-22T10:00:33.558216+0000","last_clean":"2023-12-22T10:00:33.558216+0000","last_became_active":"2023-12-22T10:00:33.112562+0000","last_became_peered":"2023-12-22T10:00:33.112562+0000","last_unstale":"2023-12-22T10:00:33.558216+0000","last_undegraded":"2023-12-22T10:00:33.558216+0000","last_fullsized":"2023-12-22T10:00:33.558216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.580413+0000","last_change":"2023-12-22T10:00:33.574338+0000","last_active":"2023-12-22T10:00:33.580413+0000","last_peered":"2023-12-22T10:00:33.580413+0000","last_clean":"2023-12-22T10:00:33.580413+0000","last_became_active":"2023-12-22T10:00:33.574067+0000","last_became_peered":"2023-12-22T10:00:33.574067+0000","last_unstale":"2023-12-22T10:00:33.580413+0000","last_undegraded":"2023-12-22T10:00:33.580413+0000","last_fullsized":"2023-12-22T10:00:33.580413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.567934+0000","last_change":"2023-12-22T10:00:33.107801+0000","last_active":"2023-12-22T10:00:33.567934+0000","last_peered":"2023-12-22T10:00:33.567934+0000","last_clean":"2023-12-22T10:00:33.567934+0000","last_became_active":"2023-12-22T10:00:33.107518+0000","last_became_peered":"2023-12-22T10:00:33.107518+0000","last_unstale":"2023-12-22T10:00:33.567934+0000","last_undegraded":"2023-12-22T10:00:33.567934+0000","last_fullsized":"2023-12-22T10:00:33.567934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.562318+0000","last_change":"2023-12-22T10:00:33.560454+0000","last_active":"2023-12-22T10:00:33.562318+0000","last_peered":"2023-12-22T10:00:33.562318+0000","last_clean":"2023-12-22T10:00:33.562318+0000","last_became_active":"2023-12-22T10:00:33.560129+0000","last_became_peered":"2023-12-22T10:00:33.560129+0000","last_unstale":"2023-12-22T10:00:33.562318+0000","last_undegraded":"2023-12-22T10:00:33.562318+0000","last_fullsized":"2023-12-22T10:00:33.562318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.541686+0000","last_change":"2023-12-22T10:00:33.117097+0000","last_active":"2023-12-22T10:00:33.541686+0000","last_peered":"2023-12-22T10:00:33.541686+0000","last_clean":"2023-12-22T10:00:33.541686+0000","last_became_active":"2023-12-22T10:00:33.116827+0000","last_became_peered":"2023-12-22T10:00:33.116827+0000","last_unstale":"2023-12-22T10:00:33.541686+0000","last_undegraded":"2023-12-22T10:00:33.541686+0000","last_fullsized":"2023-12-22T10:00:33.541686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.566055+0000","last_change":"2023-12-22T10:00:33.563813+0000","last_active":"2023-12-22T10:00:33.566055+0000","last_peered":"2023-12-22T10:00:33.566055+0000","last_clean":"2023-12-22T10:00:33.566055+0000","last_became_active":"2023-12-22T10:00:33.563482+0000","last_became_peered":"2023-12-22T10:00:33.563482+0000","last_unstale":"2023-12-22T10:00:33.566055+0000","last_undegraded":"2023-12-22T10:00:33.566055+0000","last_fullsized":"2023-12-22T10:00:33.566055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.581412+0000","last_change":"2023-12-22T10:00:33.123573+0000","last_active":"2023-12-22T10:00:33.581412+0000","last_peered":"2023-12-22T10:00:33.581412+0000","last_clean":"2023-12-22T10:00:33.581412+0000","last_became_active":"2023-12-22T10:00:33.123235+0000","last_became_peered":"2023-12-22T10:00:33.123235+0000","last_unstale":"2023-12-22T10:00:33.581412+0000","last_undegraded":"2023-12-22T10:00:33.581412+0000","last_fullsized":"2023-12-22T10:00:33.581412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.565881+0000","last_change":"2023-12-22T10:00:33.562321+0000","last_active":"2023-12-22T10:00:33.565881+0000","last_peered":"2023-12-22T10:00:33.565881+0000","last_clean":"2023-12-22T10:00:33.565881+0000","last_became_active":"2023-12-22T10:00:33.561991+0000","last_became_peered":"2023-12-22T10:00:33.561991+0000","last_unstale":"2023-12-22T10:00:33.565881+0000","last_undegraded":"2023-12-22T10:00:33.565881+0000","last_fullsized":"2023-12-22T10:00:33.565881+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.582362+0000","last_change":"2023-12-22T10:00:33.114894+0000","last_active":"2023-12-22T10:00:33.582362+0000","last_peered":"2023-12-22T10:00:33.582362+0000","last_clean":"2023-12-22T10:00:33.582362+0000","last_became_active":"2023-12-22T10:00:33.114560+0000","last_became_peered":"2023-12-22T10:00:33.114560+0000","last_unstale":"2023-12-22T10:00:33.582362+0000","last_undegraded":"2023-12-22T10:00:33.582362+0000","last_fullsized":"2023-12-22T10:00:33.582362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.567149+0000","last_change":"2023-12-22T10:00:33.559792+0000","last_active":"2023-12-22T10:00:33.567149+0000","last_peered":"2023-12-22T10:00:33.567149+0000","last_clean":"2023-12-22T10:00:33.567149+0000","last_became_active":"2023-12-22T10:00:33.559507+0000","last_became_peered":"2023-12-22T10:00:33.559507+0000","last_unstale":"2023-12-22T10:00:33.567149+0000","last_undegraded":"2023-12-22T10:00:33.567149+0000","last_fullsized":"2023-12-22T10:00:33.567149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.572960+0000","last_change":"2023-12-22T10:00:28.036372+0000","last_active":"2023-12-22T10:00:33.572960+0000","last_peered":"2023-12-22T10:00:33.572960+0000","last_clean":"2023-12-22T10:00:33.572960+0000","last_became_active":"2023-12-22T10:00:28.035974+0000","last_became_peered":"2023-12-22T10:00:28.035974+0000","last_unstale":"2023-12-22T10:00:33.572960+0000","last_undegraded":"2023-12-22T10:00:33.572960+0000","last_fullsized":"2023-12-22T10:00:33.572960+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_clean_scrub_stamp":"2023-12-22T10:00:27.001906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.537223+0000","last_change":"2023-12-22T10:00:33.105448+0000","last_active":"2023-12-22T10:00:33.537223+0000","last_peered":"2023-12-22T10:00:33.537223+0000","last_clean":"2023-12-22T10:00:33.537223+0000","last_became_active":"2023-12-22T10:00:33.105043+0000","last_became_peered":"2023-12-22T10:00:33.105043+0000","last_unstale":"2023-12-22T10:00:33.537223+0000","last_undegraded":"2023-12-22T10:00:33.537223+0000","last_fullsized":"2023-12-22T10:00:33.537223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.562442+0000","last_change":"2023-12-22T10:00:33.550578+0000","last_active":"2023-12-22T10:00:33.562442+0000","last_peered":"2023-12-22T10:00:33.562442+0000","last_clean":"2023-12-22T10:00:33.562442+0000","last_became_active":"2023-12-22T10:00:33.550295+0000","last_became_peered":"2023-12-22T10:00:33.550295+0000","last_unstale":"2023-12-22T10:00:33.562442+0000","last_undegraded":"2023-12-22T10:00:33.562442+0000","last_fullsized":"2023-12-22T10:00:33.562442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.537334+0000","last_change":"2023-12-22T10:00:28.035308+0000","last_active":"2023-12-22T10:00:33.537334+0000","last_peered":"2023-12-22T10:00:33.537334+0000","last_clean":"2023-12-22T10:00:33.537334+0000","last_became_active":"2023-12-22T10:00:28.035002+0000","last_became_peered":"2023-12-22T10:00:28.035002+0000","last_unstale":"2023-12-22T10:00:33.537334+0000","last_undegraded":"2023-12-22T10:00:33.537334+0000","last_fullsized":"2023-12-22T10:00:33.537334+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_clean_scrub_stamp":"2023-12-22T10:00:27.001906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.566358+0000","last_change":"2023-12-22T10:00:33.111116+0000","last_active":"2023-12-22T10:00:33.566358+0000","last_peered":"2023-12-22T10:00:33.566358+0000","last_clean":"2023-12-22T10:00:33.566358+0000","last_became_active":"2023-12-22T10:00:33.110624+0000","last_became_peered":"2023-12-22T10:00:33.110624+0000","last_unstale":"2023-12-22T10:00:33.566358+0000","last_undegraded":"2023-12-22T10:00:33.566358+0000","last_fullsized":"2023-12-22T10:00:33.566358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.548423+0000","last_change":"2023-12-22T10:00:33.544541+0000","last_active":"2023-12-22T10:00:33.548423+0000","last_peered":"2023-12-22T10:00:33.548423+0000","last_clean":"2023-12-22T10:00:33.548423+0000","last_became_active":"2023-12-22T10:00:33.544231+0000","last_became_peered":"2023-12-22T10:00:33.544231+0000","last_unstale":"2023-12-22T10:00:33.548423+0000","last_undegraded":"2023-12-22T10:00:33.548423+0000","last_fullsized":"2023-12-22T10:00:33.548423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.576647+0000","last_change":"2023-12-22T10:00:28.029892+0000","last_active":"2023-12-22T10:00:33.576647+0000","last_peered":"2023-12-22T10:00:33.576647+0000","last_clean":"2023-12-22T10:00:33.576647+0000","last_became_active":"2023-12-22T10:00:28.029391+0000","last_became_peered":"2023-12-22T10:00:28.029391+0000","last_unstale":"2023-12-22T10:00:33.576647+0000","last_undegraded":"2023-12-22T10:00:33.576647+0000","last_fullsized":"2023-12-22T10:00:33.576647+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_clean_scrub_stamp":"2023-12-22T10:00:27.001906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.553697+0000","last_change":"2023-12-22T10:00:33.110693+0000","last_active":"2023-12-22T10:00:33.553697+0000","last_peered":"2023-12-22T10:00:33.553697+0000","last_clean":"2023-12-22T10:00:33.553697+0000","last_became_active":"2023-12-22T10:00:33.110229+0000","last_became_peered":"2023-12-22T10:00:33.110229+0000","last_unstale":"2023-12-22T10:00:33.553697+0000","last_undegraded":"2023-12-22T10:00:33.553697+0000","last_fullsized":"2023-12-22T10:00:33.553697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.563709+0000","last_change":"2023-12-22T10:00:33.561493+0000","last_active":"2023-12-22T10:00:33.563709+0000","last_peered":"2023-12-22T10:00:33.563709+0000","last_clean":"2023-12-22T10:00:33.563709+0000","last_became_active":"2023-12-22T10:00:33.561177+0000","last_became_peered":"2023-12-22T10:00:33.561177+0000","last_unstale":"2023-12-22T10:00:33.563709+0000","last_undegraded":"2023-12-22T10:00:33.563709+0000","last_fullsized":"2023-12-22T10:00:33.563709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.562802+0000","last_change":"2023-12-22T10:00:28.025395+0000","last_active":"2023-12-22T10:00:33.562802+0000","last_peered":"2023-12-22T10:00:33.562802+0000","last_clean":"2023-12-22T10:00:33.562802+0000","last_became_active":"2023-12-22T10:00:28.024588+0000","last_became_peered":"2023-12-22T10:00:28.024588+0000","last_unstale":"2023-12-22T10:00:33.562802+0000","last_undegraded":"2023-12-22T10:00:33.562802+0000","last_fullsized":"2023-12-22T10:00:33.562802+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_clean_scrub_stamp":"2023-12-22T10:00:27.001906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.537968+0000","last_change":"2023-12-22T10:00:33.116031+0000","last_active":"2023-12-22T10:00:33.537968+0000","last_peered":"2023-12-22T10:00:33.537968+0000","last_clean":"2023-12-22T10:00:33.537968+0000","last_became_active":"2023-12-22T10:00:33.115730+0000","last_became_peered":"2023-12-22T10:00:33.115730+0000","last_unstale":"2023-12-22T10:00:33.537968+0000","last_undegraded":"2023-12-22T10:00:33.537968+0000","last_fullsized":"2023-12-22T10:00:33.537968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.563609+0000","last_change":"2023-12-22T10:00:33.558628+0000","last_active":"2023-12-22T10:00:33.563609+0000","last_peered":"2023-12-22T10:00:33.563609+0000","last_clean":"2023-12-22T10:00:33.563609+0000","last_became_active":"2023-12-22T10:00:33.558312+0000","last_became_peered":"2023-12-22T10:00:33.558312+0000","last_unstale":"2023-12-22T10:00:33.563609+0000","last_undegraded":"2023-12-22T10:00:33.563609+0000","last_fullsized":"2023-12-22T10:00:33.563609+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.552943+0000","last_change":"2023-12-22T10:00:33.124426+0000","last_active":"2023-12-22T10:00:33.552943+0000","last_peered":"2023-12-22T10:00:33.552943+0000","last_clean":"2023-12-22T10:00:33.552943+0000","last_became_active":"2023-12-22T10:00:33.119964+0000","last_became_peered":"2023-12-22T10:00:33.119964+0000","last_unstale":"2023-12-22T10:00:33.552943+0000","last_undegraded":"2023-12-22T10:00:33.552943+0000","last_fullsized":"2023-12-22T10:00:33.552943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.563791+0000","last_change":"2023-12-22T10:00:28.029884+0000","last_active":"2023-12-22T10:00:33.563791+0000","last_peered":"2023-12-22T10:00:33.563791+0000","last_clean":"2023-12-22T10:00:33.563791+0000","last_became_active":"2023-12-22T10:00:28.029422+0000","last_became_peered":"2023-12-22T10:00:28.029422+0000","last_unstale":"2023-12-22T10:00:33.563791+0000","last_undegraded":"2023-12-22T10:00:33.563791+0000","last_fullsized":"2023-12-22T10:00:33.563791+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_clean_scrub_stamp":"2023-12-22T10:00:27.001906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.555956+0000","last_change":"2023-12-22T10:00:33.547520+0000","last_active":"2023-12-22T10:00:33.555956+0000","last_peered":"2023-12-22T10:00:33.555956+0000","last_clean":"2023-12-22T10:00:33.555956+0000","last_became_active":"2023-12-22T10:00:33.546923+0000","last_became_peered":"2023-12-22T10:00:33.546923+0000","last_unstale":"2023-12-22T10:00:33.555956+0000","last_undegraded":"2023-12-22T10:00:33.555956+0000","last_fullsized":"2023-12-22T10:00:33.555956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.558060+0000","last_change":"2023-12-22T10:00:33.103518+0000","last_active":"2023-12-22T10:00:33.558060+0000","last_peered":"2023-12-22T10:00:33.558060+0000","last_clean":"2023-12-22T10:00:33.558060+0000","last_became_active":"2023-12-22T10:00:33.103133+0000","last_became_peered":"2023-12-22T10:00:33.103133+0000","last_unstale":"2023-12-22T10:00:33.558060+0000","last_undegraded":"2023-12-22T10:00:33.558060+0000","last_fullsized":"2023-12-22T10:00:33.558060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.533806+0000","last_change":"2023-12-22T10:00:28.028621+0000","last_active":"2023-12-22T10:00:33.533806+0000","last_peered":"2023-12-22T10:00:33.533806+0000","last_clean":"2023-12-22T10:00:33.533806+0000","last_became_active":"2023-12-22T10:00:28.028159+0000","last_became_peered":"2023-12-22T10:00:28.028159+0000","last_unstale":"2023-12-22T10:00:33.533806+0000","last_undegraded":"2023-12-22T10:00:33.533806+0000","last_fullsized":"2023-12-22T10:00:33.533806+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_clean_scrub_stamp":"2023-12-22T10:00:27.001906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.574590+0000","last_change":"2023-12-22T10:00:33.569946+0000","last_active":"2023-12-22T10:00:33.574590+0000","last_peered":"2023-12-22T10:00:33.574590+0000","last_clean":"2023-12-22T10:00:33.574590+0000","last_became_active":"2023-12-22T10:00:33.569709+0000","last_became_peered":"2023-12-22T10:00:33.569709+0000","last_unstale":"2023-12-22T10:00:33.574590+0000","last_undegraded":"2023-12-22T10:00:33.574590+0000","last_fullsized":"2023-12-22T10:00:33.574590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.552800+0000","last_change":"2023-12-22T10:00:33.102638+0000","last_active":"2023-12-22T10:00:33.552800+0000","last_peered":"2023-12-22T10:00:33.552800+0000","last_clean":"2023-12-22T10:00:33.552800+0000","last_became_active":"2023-12-22T10:00:33.101055+0000","last_became_peered":"2023-12-22T10:00:33.101055+0000","last_unstale":"2023-12-22T10:00:33.552800+0000","last_undegraded":"2023-12-22T10:00:33.552800+0000","last_fullsized":"2023-12-22T10:00:33.552800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.568523+0000","last_change":"2023-12-22T10:00:28.030883+0000","last_active":"2023-12-22T10:00:33.568523+0000","last_peered":"2023-12-22T10:00:33.568523+0000","last_clean":"2023-12-22T10:00:33.568523+0000","last_became_active":"2023-12-22T10:00:28.030284+0000","last_became_peered":"2023-12-22T10:00:28.030284+0000","last_unstale":"2023-12-22T10:00:33.568523+0000","last_undegraded":"2023-12-22T10:00:33.568523+0000","last_fullsized":"2023-12-22T10:00:33.568523+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_clean_scrub_stamp":"2023-12-22T10:00:27.001906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.572101+0000","last_change":"2023-12-22T10:00:33.568203+0000","last_active":"2023-12-22T10:00:33.572101+0000","last_peered":"2023-12-22T10:00:33.572101+0000","last_clean":"2023-12-22T10:00:33.572101+0000","last_became_active":"2023-12-22T10:00:33.567890+0000","last_became_peered":"2023-12-22T10:00:33.567890+0000","last_unstale":"2023-12-22T10:00:33.572101+0000","last_undegraded":"2023-12-22T10:00:33.572101+0000","last_fullsized":"2023-12-22T10:00:33.572101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.535729+0000","last_change":"2023-12-22T10:00:33.105537+0000","last_active":"2023-12-22T10:00:33.535729+0000","last_peered":"2023-12-22T10:00:33.535729+0000","last_clean":"2023-12-22T10:00:33.535729+0000","last_became_active":"2023-12-22T10:00:33.105202+0000","last_became_peered":"2023-12-22T10:00:33.105202+0000","last_unstale":"2023-12-22T10:00:33.535729+0000","last_undegraded":"2023-12-22T10:00:33.535729+0000","last_fullsized":"2023-12-22T10:00:33.535729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.568566+0000","last_change":"2023-12-22T10:00:28.031790+0000","last_active":"2023-12-22T10:00:33.568566+0000","last_peered":"2023-12-22T10:00:33.568566+0000","last_clean":"2023-12-22T10:00:33.568566+0000","last_became_active":"2023-12-22T10:00:28.031190+0000","last_became_peered":"2023-12-22T10:00:28.031190+0000","last_unstale":"2023-12-22T10:00:33.568566+0000","last_undegraded":"2023-12-22T10:00:33.568566+0000","last_fullsized":"2023-12-22T10:00:33.568566+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_clean_scrub_stamp":"2023-12-22T10:00:27.001906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.535875+0000","last_change":"2023-12-22T10:00:27.889031+0000","last_active":"2023-12-22T10:00:33.535875+0000","last_peered":"2023-12-22T10:00:33.535875+0000","last_clean":"2023-12-22T10:00:33.535875+0000","last_became_active":"2023-12-22T10:00:27.888164+0000","last_became_peered":"2023-12-22T10:00:27.888164+0000","last_unstale":"2023-12-22T10:00:33.535875+0000","last_undegraded":"2023-12-22T10:00:33.535875+0000","last_fullsized":"2023-12-22T10:00:33.535875+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:25.998963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:25.998963+0000","last_clean_scrub_stamp":"2023-12-22T10:00:25.998963+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.557856+0000","last_change":"2023-12-22T10:00:33.554263+0000","last_active":"2023-12-22T10:00:33.557856+0000","last_peered":"2023-12-22T10:00:33.557856+0000","last_clean":"2023-12-22T10:00:33.557856+0000","last_became_active":"2023-12-22T10:00:33.553794+0000","last_became_peered":"2023-12-22T10:00:33.553794+0000","last_unstale":"2023-12-22T10:00:33.557856+0000","last_undegraded":"2023-12-22T10:00:33.557856+0000","last_fullsized":"2023-12-22T10:00:33.557856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.535306+0000","last_change":"2023-12-22T10:00:33.096988+0000","last_active":"2023-12-22T10:00:33.535306+0000","last_peered":"2023-12-22T10:00:33.535306+0000","last_clean":"2023-12-22T10:00:33.535306+0000","last_became_active":"2023-12-22T10:00:33.096126+0000","last_became_peered":"2023-12-22T10:00:33.096126+0000","last_unstale":"2023-12-22T10:00:33.535306+0000","last_undegraded":"2023-12-22T10:00:33.535306+0000","last_fullsized":"2023-12-22T10:00:33.535306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.559082+0000","last_change":"2023-12-22T10:00:33.548870+0000","last_active":"2023-12-22T10:00:33.559082+0000","last_peered":"2023-12-22T10:00:33.559082+0000","last_clean":"2023-12-22T10:00:33.559082+0000","last_became_active":"2023-12-22T10:00:33.548315+0000","last_became_peered":"2023-12-22T10:00:33.548315+0000","last_unstale":"2023-12-22T10:00:33.559082+0000","last_undegraded":"2023-12-22T10:00:33.559082+0000","last_fullsized":"2023-12-22T10:00:33.559082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.563733+0000","last_change":"2023-12-22T10:00:33.105596+0000","last_active":"2023-12-22T10:00:33.563733+0000","last_peered":"2023-12-22T10:00:33.563733+0000","last_clean":"2023-12-22T10:00:33.563733+0000","last_became_active":"2023-12-22T10:00:33.105278+0000","last_became_peered":"2023-12-22T10:00:33.105278+0000","last_unstale":"2023-12-22T10:00:33.563733+0000","last_undegraded":"2023-12-22T10:00:33.563733+0000","last_fullsized":"2023-12-22T10:00:33.563733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.562468+0000","last_change":"2023-12-22T10:00:33.559066+0000","last_active":"2023-12-22T10:00:33.562468+0000","last_peered":"2023-12-22T10:00:33.562468+0000","last_clean":"2023-12-22T10:00:33.562468+0000","last_became_active":"2023-12-22T10:00:33.558181+0000","last_became_peered":"2023-12-22T10:00:33.558181+0000","last_unstale":"2023-12-22T10:00:33.562468+0000","last_undegraded":"2023-12-22T10:00:33.562468+0000","last_fullsized":"2023-12-22T10:00:33.562468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.563711+0000","last_change":"2023-12-22T10:00:33.127356+0000","last_active":"2023-12-22T10:00:33.563711+0000","last_peered":"2023-12-22T10:00:33.563711+0000","last_clean":"2023-12-22T10:00:33.563711+0000","last_became_active":"2023-12-22T10:00:33.127051+0000","last_became_peered":"2023-12-22T10:00:33.127051+0000","last_unstale":"2023-12-22T10:00:33.563711+0000","last_undegraded":"2023-12-22T10:00:33.563711+0000","last_fullsized":"2023-12-22T10:00:33.563711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.557876+0000","last_change":"2023-12-22T10:00:33.554458+0000","last_active":"2023-12-22T10:00:33.557876+0000","last_peered":"2023-12-22T10:00:33.557876+0000","last_clean":"2023-12-22T10:00:33.557876+0000","last_became_active":"2023-12-22T10:00:33.554135+0000","last_became_peered":"2023-12-22T10:00:33.554135+0000","last_unstale":"2023-12-22T10:00:33.557876+0000","last_undegraded":"2023-12-22T10:00:33.557876+0000","last_fullsized":"2023-12-22T10:00:33.557876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.553982+0000","last_change":"2023-12-22T10:00:33.111426+0000","last_active":"2023-12-22T10:00:33.553982+0000","last_peered":"2023-12-22T10:00:33.553982+0000","last_clean":"2023-12-22T10:00:33.553982+0000","last_became_active":"2023-12-22T10:00:33.111127+0000","last_became_peered":"2023-12-22T10:00:33.111127+0000","last_unstale":"2023-12-22T10:00:33.553982+0000","last_undegraded":"2023-12-22T10:00:33.553982+0000","last_fullsized":"2023-12-22T10:00:33.553982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.568351+0000","last_change":"2023-12-22T10:00:33.560716+0000","last_active":"2023-12-22T10:00:33.568351+0000","last_peered":"2023-12-22T10:00:33.568351+0000","last_clean":"2023-12-22T10:00:33.568351+0000","last_became_active":"2023-12-22T10:00:33.560383+0000","last_became_peered":"2023-12-22T10:00:33.560383+0000","last_unstale":"2023-12-22T10:00:33.568351+0000","last_undegraded":"2023-12-22T10:00:33.568351+0000","last_fullsized":"2023-12-22T10:00:33.568351+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.552544+0000","last_change":"2023-12-22T10:00:33.117407+0000","last_active":"2023-12-22T10:00:33.552544+0000","last_peered":"2023-12-22T10:00:33.552544+0000","last_clean":"2023-12-22T10:00:33.552544+0000","last_became_active":"2023-12-22T10:00:33.117026+0000","last_became_peered":"2023-12-22T10:00:33.117026+0000","last_unstale":"2023-12-22T10:00:33.552544+0000","last_undegraded":"2023-12-22T10:00:33.552544+0000","last_fullsized":"2023-12-22T10:00:33.552544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.570974+0000","last_change":"2023-12-22T10:00:33.563333+0000","last_active":"2023-12-22T10:00:33.570974+0000","last_peered":"2023-12-22T10:00:33.570974+0000","last_clean":"2023-12-22T10:00:33.570974+0000","last_became_active":"2023-12-22T10:00:33.560143+0000","last_became_peered":"2023-12-22T10:00:33.560143+0000","last_unstale":"2023-12-22T10:00:33.570974+0000","last_undegraded":"2023-12-22T10:00:33.570974+0000","last_fullsized":"2023-12-22T10:00:33.570974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.576416+0000","last_change":"2023-12-22T10:00:33.127841+0000","last_active":"2023-12-22T10:00:33.576416+0000","last_peered":"2023-12-22T10:00:33.576416+0000","last_clean":"2023-12-22T10:00:33.576416+0000","last_became_active":"2023-12-22T10:00:33.127188+0000","last_became_peered":"2023-12-22T10:00:33.127188+0000","last_unstale":"2023-12-22T10:00:33.576416+0000","last_undegraded":"2023-12-22T10:00:33.576416+0000","last_fullsized":"2023-12-22T10:00:33.576416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.570549+0000","last_change":"2023-12-22T10:00:33.569232+0000","last_active":"2023-12-22T10:00:33.570549+0000","last_peered":"2023-12-22T10:00:33.570549+0000","last_clean":"2023-12-22T10:00:33.570549+0000","last_became_active":"2023-12-22T10:00:33.568907+0000","last_became_peered":"2023-12-22T10:00:33.568907+0000","last_unstale":"2023-12-22T10:00:33.570549+0000","last_undegraded":"2023-12-22T10:00:33.570549+0000","last_fullsized":"2023-12-22T10:00:33.570549+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.574106+0000","last_change":"2023-12-22T10:00:33.120992+0000","last_active":"2023-12-22T10:00:33.574106+0000","last_peered":"2023-12-22T10:00:33.574106+0000","last_clean":"2023-12-22T10:00:33.574106+0000","last_became_active":"2023-12-22T10:00:33.120706+0000","last_became_peered":"2023-12-22T10:00:33.120706+0000","last_unstale":"2023-12-22T10:00:33.574106+0000","last_undegraded":"2023-12-22T10:00:33.574106+0000","last_fullsized":"2023-12-22T10:00:33.574106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.576244+0000","last_change":"2023-12-22T10:00:33.573000+0000","last_active":"2023-12-22T10:00:33.576244+0000","last_peered":"2023-12-22T10:00:33.576244+0000","last_clean":"2023-12-22T10:00:33.576244+0000","last_became_active":"2023-12-22T10:00:33.571916+0000","last_became_peered":"2023-12-22T10:00:33.571916+0000","last_unstale":"2023-12-22T10:00:33.576244+0000","last_undegraded":"2023-12-22T10:00:33.576244+0000","last_fullsized":"2023-12-22T10:00:33.576244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.582224+0000","last_change":"2023-12-22T10:00:33.125992+0000","last_active":"2023-12-22T10:00:33.582224+0000","last_peered":"2023-12-22T10:00:33.582224+0000","last_clean":"2023-12-22T10:00:33.582224+0000","last_became_active":"2023-12-22T10:00:33.125693+0000","last_became_peered":"2023-12-22T10:00:33.125693+0000","last_unstale":"2023-12-22T10:00:33.582224+0000","last_undegraded":"2023-12-22T10:00:33.582224+0000","last_fullsized":"2023-12-22T10:00:33.582224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.554932+0000","last_change":"2023-12-22T10:00:33.553361+0000","last_active":"2023-12-22T10:00:33.554932+0000","last_peered":"2023-12-22T10:00:33.554932+0000","last_clean":"2023-12-22T10:00:33.554932+0000","last_became_active":"2023-12-22T10:00:33.551429+0000","last_became_peered":"2023-12-22T10:00:33.551429+0000","last_unstale":"2023-12-22T10:00:33.554932+0000","last_undegraded":"2023-12-22T10:00:33.554932+0000","last_fullsized":"2023-12-22T10:00:33.554932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"20'4","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.579099+0000","last_change":"2023-12-22T10:00:33.120651+0000","last_active":"2023-12-22T10:00:33.579099+0000","last_peered":"2023-12-22T10:00:33.579099+0000","last_clean":"2023-12-22T10:00:33.579099+0000","last_became_active":"2023-12-22T10:00:33.110600+0000","last_became_peered":"2023-12-22T10:00:33.110600+0000","last_unstale":"2023-12-22T10:00:33.579099+0000","last_undegraded":"2023-12-22T10:00:33.579099+0000","last_fullsized":"2023-12-22T10:00:33.579099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.567975+0000","last_change":"2023-12-22T10:00:33.559374+0000","last_active":"2023-12-22T10:00:33.567975+0000","last_peered":"2023-12-22T10:00:33.567975+0000","last_clean":"2023-12-22T10:00:33.567975+0000","last_became_active":"2023-12-22T10:00:33.559066+0000","last_became_peered":"2023-12-22T10:00:33.559066+0000","last_unstale":"2023-12-22T10:00:33.567975+0000","last_undegraded":"2023-12-22T10:00:33.567975+0000","last_fullsized":"2023-12-22T10:00:33.567975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.563571+0000","last_change":"2023-12-22T10:00:33.114896+0000","last_active":"2023-12-22T10:00:33.563571+0000","last_peered":"2023-12-22T10:00:33.563571+0000","last_clean":"2023-12-22T10:00:33.563571+0000","last_became_active":"2023-12-22T10:00:33.114585+0000","last_became_peered":"2023-12-22T10:00:33.114585+0000","last_unstale":"2023-12-22T10:00:33.563571+0000","last_undegraded":"2023-12-22T10:00:33.563571+0000","last_fullsized":"2023-12-22T10:00:33.563571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.572121+0000","last_change":"2023-12-22T10:00:33.568325+0000","last_active":"2023-12-22T10:00:33.572121+0000","last_peered":"2023-12-22T10:00:33.572121+0000","last_clean":"2023-12-22T10:00:33.572121+0000","last_became_active":"2023-12-22T10:00:33.568026+0000","last_became_peered":"2023-12-22T10:00:33.568026+0000","last_unstale":"2023-12-22T10:00:33.572121+0000","last_undegraded":"2023-12-22T10:00:33.572121+0000","last_fullsized":"2023-12-22T10:00:33.572121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.553362+0000","last_change":"2023-12-22T10:00:33.108149+0000","last_active":"2023-12-22T10:00:33.553362+0000","last_peered":"2023-12-22T10:00:33.553362+0000","last_clean":"2023-12-22T10:00:33.553362+0000","last_became_active":"2023-12-22T10:00:33.107842+0000","last_became_peered":"2023-12-22T10:00:33.107842+0000","last_unstale":"2023-12-22T10:00:33.553362+0000","last_undegraded":"2023-12-22T10:00:33.553362+0000","last_fullsized":"2023-12-22T10:00:33.553362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.580131+0000","last_change":"2023-12-22T10:00:33.571557+0000","last_active":"2023-12-22T10:00:33.580131+0000","last_peered":"2023-12-22T10:00:33.580131+0000","last_clean":"2023-12-22T10:00:33.580131+0000","last_became_active":"2023-12-22T10:00:33.571220+0000","last_became_peered":"2023-12-22T10:00:33.571220+0000","last_unstale":"2023-12-22T10:00:33.580131+0000","last_undegraded":"2023-12-22T10:00:33.580131+0000","last_fullsized":"2023-12-22T10:00:33.580131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.582666+0000","last_change":"2023-12-22T10:00:33.129657+0000","last_active":"2023-12-22T10:00:33.582666+0000","last_peered":"2023-12-22T10:00:33.582666+0000","last_clean":"2023-12-22T10:00:33.582666+0000","last_became_active":"2023-12-22T10:00:33.129343+0000","last_became_peered":"2023-12-22T10:00:33.129343+0000","last_unstale":"2023-12-22T10:00:33.582666+0000","last_undegraded":"2023-12-22T10:00:33.582666+0000","last_fullsized":"2023-12-22T10:00:33.582666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.564447+0000","last_change":"2023-12-22T10:00:33.560227+0000","last_active":"2023-12-22T10:00:33.564447+0000","last_peered":"2023-12-22T10:00:33.564447+0000","last_clean":"2023-12-22T10:00:33.564447+0000","last_became_active":"2023-12-22T10:00:33.560005+0000","last_became_peered":"2023-12-22T10:00:33.560005+0000","last_unstale":"2023-12-22T10:00:33.564447+0000","last_undegraded":"2023-12-22T10:00:33.564447+0000","last_fullsized":"2023-12-22T10:00:33.564447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.548267+0000","last_change":"2023-12-22T10:00:33.096353+0000","last_active":"2023-12-22T10:00:33.548267+0000","last_peered":"2023-12-22T10:00:33.548267+0000","last_clean":"2023-12-22T10:00:33.548267+0000","last_became_active":"2023-12-22T10:00:33.095756+0000","last_became_peered":"2023-12-22T10:00:33.095756+0000","last_unstale":"2023-12-22T10:00:33.548267+0000","last_undegraded":"2023-12-22T10:00:33.548267+0000","last_fullsized":"2023-12-22T10:00:33.548267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.568251+0000","last_change":"2023-12-22T10:00:33.565765+0000","last_active":"2023-12-22T10:00:33.568251+0000","last_peered":"2023-12-22T10:00:33.568251+0000","last_clean":"2023-12-22T10:00:33.568251+0000","last_became_active":"2023-12-22T10:00:33.565480+0000","last_became_peered":"2023-12-22T10:00:33.565480+0000","last_unstale":"2023-12-22T10:00:33.568251+0000","last_undegraded":"2023-12-22T10:00:33.568251+0000","last_fullsized":"2023-12-22T10:00:33.568251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.33","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.570467+0000","last_change":"2023-12-22T10:00:33.126475+0000","last_active":"2023-12-22T10:00:33.570467+0000","last_peered":"2023-12-22T10:00:33.570467+0000","last_clean":"2023-12-22T10:00:33.570467+0000","last_became_active":"2023-12-22T10:00:33.126160+0000","last_became_peered":"2023-12-22T10:00:33.126160+0000","last_unstale":"2023-12-22T10:00:33.570467+0000","last_undegraded":"2023-12-22T10:00:33.570467+0000","last_fullsized":"2023-12-22T10:00:33.570467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.575581+0000","last_change":"2023-12-22T10:00:33.573494+0000","last_active":"2023-12-22T10:00:33.575581+0000","last_peered":"2023-12-22T10:00:33.575581+0000","last_clean":"2023-12-22T10:00:33.575581+0000","last_became_active":"2023-12-22T10:00:33.573179+0000","last_became_peered":"2023-12-22T10:00:33.573179+0000","last_unstale":"2023-12-22T10:00:33.575581+0000","last_undegraded":"2023-12-22T10:00:33.575581+0000","last_fullsized":"2023-12-22T10:00:33.575581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.34","version":"20'4","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.584940+0000","last_change":"2023-12-22T10:00:33.125144+0000","last_active":"2023-12-22T10:00:33.584940+0000","last_peered":"2023-12-22T10:00:33.584940+0000","last_clean":"2023-12-22T10:00:33.584940+0000","last_became_active":"2023-12-22T10:00:33.124721+0000","last_became_peered":"2023-12-22T10:00:33.124721+0000","last_unstale":"2023-12-22T10:00:33.584940+0000","last_undegraded":"2023-12-22T10:00:33.584940+0000","last_fullsized":"2023-12-22T10:00:33.584940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.574522+0000","last_change":"2023-12-22T10:00:33.569457+0000","last_active":"2023-12-22T10:00:33.574522+0000","last_peered":"2023-12-22T10:00:33.574522+0000","last_clean":"2023-12-22T10:00:33.574522+0000","last_became_active":"2023-12-22T10:00:33.569137+0000","last_became_peered":"2023-12-22T10:00:33.569137+0000","last_unstale":"2023-12-22T10:00:33.574522+0000","last_undegraded":"2023-12-22T10:00:33.574522+0000","last_fullsized":"2023-12-22T10:00:33.574522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.555657+0000","last_change":"2023-12-22T10:00:33.115688+0000","last_active":"2023-12-22T10:00:33.555657+0000","last_peered":"2023-12-22T10:00:33.555657+0000","last_clean":"2023-12-22T10:00:33.555657+0000","last_became_active":"2023-12-22T10:00:33.115458+0000","last_became_peered":"2023-12-22T10:00:33.115458+0000","last_unstale":"2023-12-22T10:00:33.555657+0000","last_undegraded":"2023-12-22T10:00:33.555657+0000","last_fullsized":"2023-12-22T10:00:33.555657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.575066+0000","last_change":"2023-12-22T10:00:33.572218+0000","last_active":"2023-12-22T10:00:33.575066+0000","last_peered":"2023-12-22T10:00:33.575066+0000","last_clean":"2023-12-22T10:00:33.575066+0000","last_became_active":"2023-12-22T10:00:33.571923+0000","last_became_peered":"2023-12-22T10:00:33.571923+0000","last_unstale":"2023-12-22T10:00:33.575066+0000","last_undegraded":"2023-12-22T10:00:33.575066+0000","last_fullsized":"2023-12-22T10:00:33.575066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.552045+0000","last_change":"2023-12-22T10:00:33.122533+0000","last_active":"2023-12-22T10:00:33.552045+0000","last_peered":"2023-12-22T10:00:33.552045+0000","last_clean":"2023-12-22T10:00:33.552045+0000","last_became_active":"2023-12-22T10:00:33.122204+0000","last_became_peered":"2023-12-22T10:00:33.122204+0000","last_unstale":"2023-12-22T10:00:33.552045+0000","last_undegraded":"2023-12-22T10:00:33.552045+0000","last_fullsized":"2023-12-22T10:00:33.552045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.560067+0000","last_change":"2023-12-22T10:00:33.550771+0000","last_active":"2023-12-22T10:00:33.560067+0000","last_peered":"2023-12-22T10:00:33.560067+0000","last_clean":"2023-12-22T10:00:33.560067+0000","last_became_active":"2023-12-22T10:00:33.550449+0000","last_became_peered":"2023-12-22T10:00:33.550449+0000","last_unstale":"2023-12-22T10:00:33.560067+0000","last_undegraded":"2023-12-22T10:00:33.560067+0000","last_fullsized":"2023-12-22T10:00:33.560067+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.536396+0000","last_change":"2023-12-22T10:00:33.122914+0000","last_active":"2023-12-22T10:00:33.536396+0000","last_peered":"2023-12-22T10:00:33.536396+0000","last_clean":"2023-12-22T10:00:33.536396+0000","last_became_active":"2023-12-22T10:00:33.122636+0000","last_became_peered":"2023-12-22T10:00:33.122636+0000","last_unstale":"2023-12-22T10:00:33.536396+0000","last_undegraded":"2023-12-22T10:00:33.536396+0000","last_fullsized":"2023-12-22T10:00:33.536396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.571565+0000","last_change":"2023-12-22T10:00:33.562037+0000","last_active":"2023-12-22T10:00:33.571565+0000","last_peered":"2023-12-22T10:00:33.571565+0000","last_clean":"2023-12-22T10:00:33.571565+0000","last_became_active":"2023-12-22T10:00:33.561795+0000","last_became_peered":"2023-12-22T10:00:33.561795+0000","last_unstale":"2023-12-22T10:00:33.571565+0000","last_undegraded":"2023-12-22T10:00:33.571565+0000","last_fullsized":"2023-12-22T10:00:33.571565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.572601+0000","last_change":"2023-12-22T10:00:33.568975+0000","last_active":"2023-12-22T10:00:33.572601+0000","last_peered":"2023-12-22T10:00:33.572601+0000","last_clean":"2023-12-22T10:00:33.572601+0000","last_became_active":"2023-12-22T10:00:33.568710+0000","last_became_peered":"2023-12-22T10:00:33.568710+0000","last_unstale":"2023-12-22T10:00:33.572601+0000","last_undegraded":"2023-12-22T10:00:33.572601+0000","last_fullsized":"2023-12-22T10:00:33.572601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.557960+0000","last_change":"2023-12-22T10:00:33.106798+0000","last_active":"2023-12-22T10:00:33.557960+0000","last_peered":"2023-12-22T10:00:33.557960+0000","last_clean":"2023-12-22T10:00:33.557960+0000","last_became_active":"2023-12-22T10:00:33.106444+0000","last_became_peered":"2023-12-22T10:00:33.106444+0000","last_unstale":"2023-12-22T10:00:33.557960+0000","last_undegraded":"2023-12-22T10:00:33.557960+0000","last_fullsized":"2023-12-22T10:00:33.557960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.562492+0000","last_change":"2023-12-22T10:00:33.559266+0000","last_active":"2023-12-22T10:00:33.562492+0000","last_peered":"2023-12-22T10:00:33.562492+0000","last_clean":"2023-12-22T10:00:33.562492+0000","last_became_active":"2023-12-22T10:00:33.558860+0000","last_became_peered":"2023-12-22T10:00:33.558860+0000","last_unstale":"2023-12-22T10:00:33.562492+0000","last_undegraded":"2023-12-22T10:00:33.562492+0000","last_fullsized":"2023-12-22T10:00:33.562492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.550181+0000","last_change":"2023-12-22T10:00:33.111950+0000","last_active":"2023-12-22T10:00:33.550181+0000","last_peered":"2023-12-22T10:00:33.550181+0000","last_clean":"2023-12-22T10:00:33.550181+0000","last_became_active":"2023-12-22T10:00:33.111519+0000","last_became_peered":"2023-12-22T10:00:33.111519+0000","last_unstale":"2023-12-22T10:00:33.550181+0000","last_undegraded":"2023-12-22T10:00:33.550181+0000","last_fullsized":"2023-12-22T10:00:33.550181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.581939+0000","last_change":"2023-12-22T10:00:33.579310+0000","last_active":"2023-12-22T10:00:33.581939+0000","last_peered":"2023-12-22T10:00:33.581939+0000","last_clean":"2023-12-22T10:00:33.581939+0000","last_became_active":"2023-12-22T10:00:33.574714+0000","last_became_peered":"2023-12-22T10:00:33.574714+0000","last_unstale":"2023-12-22T10:00:33.581939+0000","last_undegraded":"2023-12-22T10:00:33.581939+0000","last_fullsized":"2023-12-22T10:00:33.581939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.562352+0000","last_change":"2023-12-22T10:00:33.104906+0000","last_active":"2023-12-22T10:00:33.562352+0000","last_peered":"2023-12-22T10:00:33.562352+0000","last_clean":"2023-12-22T10:00:33.562352+0000","last_became_active":"2023-12-22T10:00:33.104018+0000","last_became_peered":"2023-12-22T10:00:33.104018+0000","last_unstale":"2023-12-22T10:00:33.562352+0000","last_undegraded":"2023-12-22T10:00:33.562352+0000","last_fullsized":"2023-12-22T10:00:33.562352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.559924+0000","last_change":"2023-12-22T10:00:33.546434+0000","last_active":"2023-12-22T10:00:33.559924+0000","last_peered":"2023-12-22T10:00:33.559924+0000","last_clean":"2023-12-22T10:00:33.559924+0000","last_became_active":"2023-12-22T10:00:33.546119+0000","last_became_peered":"2023-12-22T10:00:33.546119+0000","last_unstale":"2023-12-22T10:00:33.559924+0000","last_undegraded":"2023-12-22T10:00:33.559924+0000","last_fullsized":"2023-12-22T10:00:33.559924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.580716+0000","last_change":"2023-12-22T10:00:33.124220+0000","last_active":"2023-12-22T10:00:33.580716+0000","last_peered":"2023-12-22T10:00:33.580716+0000","last_clean":"2023-12-22T10:00:33.580716+0000","last_became_active":"2023-12-22T10:00:33.119951+0000","last_became_peered":"2023-12-22T10:00:33.119951+0000","last_unstale":"2023-12-22T10:00:33.580716+0000","last_undegraded":"2023-12-22T10:00:33.580716+0000","last_fullsized":"2023-12-22T10:00:33.580716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.560601+0000","last_change":"2023-12-22T10:00:33.556065+0000","last_active":"2023-12-22T10:00:33.560601+0000","last_peered":"2023-12-22T10:00:33.560601+0000","last_clean":"2023-12-22T10:00:33.560601+0000","last_became_active":"2023-12-22T10:00:33.555696+0000","last_became_peered":"2023-12-22T10:00:33.555696+0000","last_unstale":"2023-12-22T10:00:33.560601+0000","last_undegraded":"2023-12-22T10:00:33.560601+0000","last_fullsized":"2023-12-22T10:00:33.560601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.562529+0000","last_change":"2023-12-22T10:00:33.103404+0000","last_active":"2023-12-22T10:00:33.562529+0000","last_peered":"2023-12-22T10:00:33.562529+0000","last_clean":"2023-12-22T10:00:33.562529+0000","last_became_active":"2023-12-22T10:00:33.103130+0000","last_became_peered":"2023-12-22T10:00:33.103130+0000","last_unstale":"2023-12-22T10:00:33.562529+0000","last_undegraded":"2023-12-22T10:00:33.562529+0000","last_fullsized":"2023-12-22T10:00:33.562529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.579183+0000","last_change":"2023-12-22T10:00:33.569585+0000","last_active":"2023-12-22T10:00:33.579183+0000","last_peered":"2023-12-22T10:00:33.579183+0000","last_clean":"2023-12-22T10:00:33.579183+0000","last_became_active":"2023-12-22T10:00:33.569304+0000","last_became_peered":"2023-12-22T10:00:33.569304+0000","last_unstale":"2023-12-22T10:00:33.579183+0000","last_undegraded":"2023-12-22T10:00:33.579183+0000","last_fullsized":"2023-12-22T10:00:33.579183+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.562974+0000","last_change":"2023-12-22T10:00:33.113160+0000","last_active":"2023-12-22T10:00:33.562974+0000","last_peered":"2023-12-22T10:00:33.562974+0000","last_clean":"2023-12-22T10:00:33.562974+0000","last_became_active":"2023-12-22T10:00:33.112458+0000","last_became_peered":"2023-12-22T10:00:33.112458+0000","last_unstale":"2023-12-22T10:00:33.562974+0000","last_undegraded":"2023-12-22T10:00:33.562974+0000","last_fullsized":"2023-12-22T10:00:33.562974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.580304+0000","last_change":"2023-12-22T10:00:33.574165+0000","last_active":"2023-12-22T10:00:33.580304+0000","last_peered":"2023-12-22T10:00:33.580304+0000","last_clean":"2023-12-22T10:00:33.580304+0000","last_became_active":"2023-12-22T10:00:33.570912+0000","last_became_peered":"2023-12-22T10:00:33.570912+0000","last_unstale":"2023-12-22T10:00:33.580304+0000","last_undegraded":"2023-12-22T10:00:33.580304+0000","last_fullsized":"2023-12-22T10:00:33.580304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.567643+0000","last_change":"2023-12-22T10:00:33.114540+0000","last_active":"2023-12-22T10:00:33.567643+0000","last_peered":"2023-12-22T10:00:33.567643+0000","last_clean":"2023-12-22T10:00:33.567643+0000","last_became_active":"2023-12-22T10:00:33.113955+0000","last_became_peered":"2023-12-22T10:00:33.113955+0000","last_unstale":"2023-12-22T10:00:33.567643+0000","last_undegraded":"2023-12-22T10:00:33.567643+0000","last_fullsized":"2023-12-22T10:00:33.567643+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.544500+0000","last_change":"2023-12-22T10:00:33.540584+0000","last_active":"2023-12-22T10:00:33.544500+0000","last_peered":"2023-12-22T10:00:33.544500+0000","last_clean":"2023-12-22T10:00:33.544500+0000","last_became_active":"2023-12-22T10:00:33.540281+0000","last_became_peered":"2023-12-22T10:00:33.540281+0000","last_unstale":"2023-12-22T10:00:33.544500+0000","last_undegraded":"2023-12-22T10:00:33.544500+0000","last_fullsized":"2023-12-22T10:00:33.544500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"20'3","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.581658+0000","last_change":"2023-12-22T10:00:33.113110+0000","last_active":"2023-12-22T10:00:33.581658+0000","last_peered":"2023-12-22T10:00:33.581658+0000","last_clean":"2023-12-22T10:00:33.581658+0000","last_became_active":"2023-12-22T10:00:33.112754+0000","last_became_peered":"2023-12-22T10:00:33.112754+0000","last_unstale":"2023-12-22T10:00:33.581658+0000","last_undegraded":"2023-12-22T10:00:33.581658+0000","last_fullsized":"2023-12-22T10:00:33.581658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297308,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074532,"statfs":{"total":96636764160,"available":96332320768,"internally_reserved":0,"allocated":217088,"data_stored":80225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1279999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5089999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0309999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.262}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.595}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5780000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.75}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297312,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074528,"statfs":{"total":96636764160,"available":96332316672,"internally_reserved":0,"allocated":221184,"data_stored":80315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.016}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.042}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0880000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1850000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.157}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.196}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297308,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074532,"statfs":{"total":96636764160,"available":96332320768,"internally_reserved":0,"allocated":217088,"data_stored":80225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.288}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.171}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.194}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.25}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4139999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4490000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.516}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297312,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074528,"statfs":{"total":96636764160,"available":96332316672,"internally_reserved":0,"allocated":221184,"data_stored":80295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.01}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.202}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.641}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.593}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.869}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9590000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297328,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074512,"statfs":{"total":96636764160,"available":96332300288,"internally_reserved":0,"allocated":237568,"data_stored":81527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.872}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94199999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.141}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.54}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2370000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.359}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297316,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074524,"statfs":{"total":96636764160,"available":96332312576,"internally_reserved":0,"allocated":225280,"data_stored":80869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.873}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0740000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.333}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.27}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.53}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.278}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297316,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074524,"statfs":{"total":96636764160,"available":96332312576,"internally_reserved":0,"allocated":225280,"data_stored":81139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2629999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.151}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8129999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8779999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.337}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297328,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074512,"statfs":{"total":96636764160,"available":96332300288,"internally_reserved":0,"allocated":237568,"data_stored":81817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.173}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.131}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0009999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4550000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.492}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3620000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-22T10:00:46.231 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-22T10:00:46.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.438+0000 7f3826279700 1 Processor -- start 2023-12-22T10:00:46.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.442+0000 7f3826279700 1 -- start start 2023-12-22T10:00:46.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.442+0000 7f3826279700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f38200a9ed0 0x7f38200c1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:46.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.442+0000 7f3826279700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f38200bf910 0x7f38200bfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:46.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.442+0000 7f3826279700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38200c0f70 con 0x7f38200c5960 2023-12-22T10:00:46.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.442+0000 7f3826279700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38200aa2b0 con 0x7f38200a9ed0 2023-12-22T10:00:46.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.442+0000 7f3826279700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38200c0360 con 0x7f38200bf910 2023-12-22T10:00:46.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.442+0000 7f3825277700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f38200a9ed0 0x7f38200c1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:46.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.442+0000 7f3825a78700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f38200c5960 0x7f38200c5dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59238/0 (socket says 172.21.15.45:59238) 2023-12-22T10:00:46.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.442+0000 7f3825a78700 1 -- 172.21.15.45:0/3179718401 learned_addr learned my addr 172.21.15.45:0/3179718401 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:00:46.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.442+0000 7f3825277700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f38200a9ed0 0x7f38200c1400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48520/0 (socket says 172.21.15.45:48520) 2023-12-22T10:00:46.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.442+0000 7f3824a76700 1 --2- 172.21.15.45:0/3179718401 >> v2:172.21.15.113:3300/0 conn(0x7f38200bf910 0x7f38200bfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:46.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.446+0000 7f3825277700 1 -- 172.21.15.45:0/3179718401 >> v2:172.21.15.113:3300/0 conn(0x7f38200bf910 msgr2=0x7f38200bfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:00:46.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.446+0000 7f3825277700 1 --2- 172.21.15.45:0/3179718401 >> v2:172.21.15.113:3300/0 conn(0x7f38200bf910 0x7f38200bfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:46.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.446+0000 7f3825277700 1 -- 172.21.15.45:0/3179718401 >> v1:172.21.15.45:6789/0 conn(0x7f38200c5960 legacy=0x7f38200c5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:46.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.446+0000 7f3825277700 1 -- 172.21.15.45:0/3179718401 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38200c0640 con 0x7f38200a9ed0 2023-12-22T10:00:46.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.446+0000 7f3817fff700 1 -- 172.21.15.45:0/3179718401 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1328061047 0 0) 0x7f38200c0f70 con 0x7f38200c5960 2023-12-22T10:00:46.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.446+0000 7f3825277700 1 --2- 172.21.15.45:0/3179718401 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f38200a9ed0 0x7f38200c1400 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f38200aa730 tx=0x7f381c009060).ready entity=mon.0 client_cookie=3c11c48074b14f8f server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:46.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.446+0000 7f3817fff700 1 -- 172.21.15.45:0/3179718401 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f381c00f510 con 0x7f38200a9ed0 2023-12-22T10:00:46.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.446+0000 7f3817fff700 1 -- 172.21.15.45:0/3179718401 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f381c00f670 con 0x7f38200a9ed0 2023-12-22T10:00:46.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.446+0000 7f3817fff700 1 -- 172.21.15.45:0/3179718401 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f381c00f9f0 con 0x7f38200a9ed0 2023-12-22T10:00:46.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.446+0000 7f3826279700 1 -- 172.21.15.45:0/3179718401 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f38200a9ed0 msgr2=0x7f38200c1400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:46.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.446+0000 7f3826279700 1 --2- 172.21.15.45:0/3179718401 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f38200a9ed0 0x7f38200c1400 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f38200aa730 tx=0x7f381c009060).stop 2023-12-22T10:00:46.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.446+0000 7f3826279700 1 -- 172.21.15.45:0/3179718401 shutdown_connections 2023-12-22T10:00:46.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.446+0000 7f3826279700 1 --2- 172.21.15.45:0/3179718401 >> v2:172.21.15.113:3300/0 conn(0x7f38200bf910 0x7f38200bfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:46.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.446+0000 7f3826279700 1 --2- 172.21.15.45:0/3179718401 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f38200a9ed0 0x7f38200c1400 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:46.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.446+0000 7f3826279700 1 -- 172.21.15.45:0/3179718401 >> 172.21.15.45:0/3179718401 conn(0x7f3820067500 msgr2=0x7f38200ca9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:46.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.446+0000 7f3826279700 1 -- 172.21.15.45:0/3179718401 shutdown_connections 2023-12-22T10:00:46.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.450+0000 7f3826279700 1 -- 172.21.15.45:0/3179718401 wait complete. 2023-12-22T10:00:46.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.450+0000 7f3826279700 1 Processor -- start 2023-12-22T10:00:46.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.450+0000 7f3826279700 1 -- start start 2023-12-22T10:00:46.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.454+0000 7f3826279700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f38200a9ed0 0x7f3820138ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:46.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.454+0000 7f3826279700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f38200bf910 0x7f3820163e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:46.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.454+0000 7f3826279700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f38200c5960 0x7f38200afab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:46.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.454+0000 7f3826279700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f382014d980 con 0x7f38200c5960 2023-12-22T10:00:46.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.454+0000 7f3826279700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3820164750 con 0x7f38200bf910 2023-12-22T10:00:46.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.454+0000 7f3826279700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3820164a30 con 0x7f38200a9ed0 2023-12-22T10:00:46.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.454+0000 7f3825a78700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f38200c5960 0x7f38200afab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:46.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.454+0000 7f3825a78700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f38200c5960 0x7f38200afab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48536/0 (socket says 172.21.15.45:48536) 2023-12-22T10:00:46.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.454+0000 7f3825a78700 1 -- 172.21.15.45:0/3458017536 learned_addr learned my addr 172.21.15.45:0/3458017536 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:46.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.454+0000 7f3825277700 1 --2- 172.21.15.45:0/3458017536 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f38200a9ed0 0x7f3820138ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:46.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.454+0000 7f3824a76700 1 --2- 172.21.15.45:0/3458017536 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f38200bf910 0x7f3820163e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:46.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.454+0000 7f3825a78700 1 -- 172.21.15.45:0/3458017536 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f38200a9ed0 msgr2=0x7f3820138ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:46.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.454+0000 7f3825a78700 1 --2- 172.21.15.45:0/3458017536 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f38200a9ed0 0x7f3820138ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:46.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.454+0000 7f3825a78700 1 -- 172.21.15.45:0/3458017536 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f38200bf910 msgr2=0x7f3820163e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:46.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.454+0000 7f3825a78700 1 --2- 172.21.15.45:0/3458017536 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f38200bf910 0x7f3820163e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:46.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.454+0000 7f3825a78700 1 -- 172.21.15.45:0/3458017536 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f381c0092a0 con 0x7f38200c5960 2023-12-22T10:00:46.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.454+0000 7f3824a76700 1 --2- 172.21.15.45:0/3458017536 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f38200bf910 0x7f3820163e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T10:00:46.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.454+0000 7f3825a78700 1 --2- 172.21.15.45:0/3458017536 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f38200c5960 0x7f38200afab0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f381800c730 tx=0x7f3818001520).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:46.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.454+0000 7f38157fa700 1 -- 172.21.15.45:0/3458017536 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3818005d30 con 0x7f38200c5960 2023-12-22T10:00:46.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.454+0000 7f38157fa700 1 -- 172.21.15.45:0/3458017536 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3818005e90 con 0x7f38200c5960 2023-12-22T10:00:46.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.454+0000 7f38157fa700 1 -- 172.21.15.45:0/3458017536 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3818007340 con 0x7f38200c5960 2023-12-22T10:00:46.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.454+0000 7f3826279700 1 -- 172.21.15.45:0/3458017536 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3820164d10 con 0x7f38200c5960 2023-12-22T10:00:46.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.454+0000 7f3826279700 1 -- 172.21.15.45:0/3458017536 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3820138fd0 con 0x7f38200c5960 2023-12-22T10:00:46.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.458+0000 7f3826279700 1 -- 172.21.15.45:0/3458017536 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f382014db30 con 0x7f38200c5960 2023-12-22T10:00:46.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.458+0000 7f38157fa700 1 -- 172.21.15.45:0/3458017536 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f38180076f0 con 0x7f38200c5960 2023-12-22T10:00:46.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.462+0000 7f38157fa700 1 --2- 172.21.15.45:0/3458017536 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f380405a510 0x7f380405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:46.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.462+0000 7f38157fa700 1 -- 172.21.15.45:0/3458017536 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f3818074810 con 0x7f38200c5960 2023-12-22T10:00:46.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.462+0000 7f3825277700 1 --2- 172.21.15.45:0/3458017536 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f380405a510 0x7f380405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:46.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.462+0000 7f3825277700 1 --2- 172.21.15.45:0/3458017536 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f380405a510 0x7f380405c9d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f381c00f640 tx=0x7f381c017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:46.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.470+0000 7f38157fa700 1 -- 172.21.15.45:0/3458017536 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f382014db30 con 0x7f38200c5960 2023-12-22T10:00:46.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.630+0000 7f3826279700 1 -- 172.21.15.45:0/3458017536 --> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f382014dac0 con 0x7f380405a510 2023-12-22T10:00:46.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.646+0000 7f38157fa700 1 -- 172.21.15.45:0/3458017536 <== mgr.4104 v2:172.21.15.45:6832/33679 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+335970 (secure 0 0 0) 0x7f382014dac0 con 0x7f380405a510 2023-12-22T10:00:46.649 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:00:46.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.654+0000 7f3826279700 1 -- 172.21.15.45:0/3458017536 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f380405a510 msgr2=0x7f380405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:46.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.654+0000 7f3826279700 1 --2- 172.21.15.45:0/3458017536 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f380405a510 0x7f380405c9d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f381c00f640 tx=0x7f381c017000).stop 2023-12-22T10:00:46.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.658+0000 7f3826279700 1 -- 172.21.15.45:0/3458017536 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f38200c5960 msgr2=0x7f38200afab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:46.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.658+0000 7f3826279700 1 --2- 172.21.15.45:0/3458017536 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f38200c5960 0x7f38200afab0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f381800c730 tx=0x7f3818001520).stop 2023-12-22T10:00:46.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.658+0000 7f3826279700 1 -- 172.21.15.45:0/3458017536 shutdown_connections 2023-12-22T10:00:46.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.658+0000 7f3826279700 1 --2- 172.21.15.45:0/3458017536 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f38200c5960 0x7f38200afab0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:46.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.658+0000 7f3826279700 1 --2- 172.21.15.45:0/3458017536 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f38200bf910 0x7f3820163e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:46.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.658+0000 7f3826279700 1 --2- 172.21.15.45:0/3458017536 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f380405a510 0x7f380405c9d0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:46.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.658+0000 7f3826279700 1 --2- 172.21.15.45:0/3458017536 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f38200a9ed0 0x7f3820138ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:46.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.658+0000 7f3826279700 1 -- 172.21.15.45:0/3458017536 >> 172.21.15.45:0/3458017536 conn(0x7f3820067500 msgr2=0x7f38200ab8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:46.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.658+0000 7f3826279700 1 -- 172.21.15.45:0/3458017536 shutdown_connections 2023-12-22T10:00:46.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.658+0000 7f3826279700 1 -- 172.21.15.45:0/3458017536 wait complete. 2023-12-22T10:00:46.656 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-12-22T10:00:46.676 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-12-22T10:00:45.955969+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2378528,"kb_used_data":1760,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752596192,"statfs":{"total":773094113280,"available":770658500608,"internally_reserved":0,"allocated":1802240,"data_stored":646412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002922"},"pg_stats":[{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.550595+0000","last_change":"2023-12-22T10:00:33.548525+0000","last_active":"2023-12-22T10:00:33.550595+0000","last_peered":"2023-12-22T10:00:33.550595+0000","last_clean":"2023-12-22T10:00:33.550595+0000","last_became_active":"2023-12-22T10:00:33.548303+0000","last_became_peered":"2023-12-22T10:00:33.548303+0000","last_unstale":"2023-12-22T10:00:33.550595+0000","last_undegraded":"2023-12-22T10:00:33.550595+0000","last_fullsized":"2023-12-22T10:00:33.550595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.557701+0000","last_change":"2023-12-22T10:00:33.114700+0000","last_active":"2023-12-22T10:00:33.557701+0000","last_peered":"2023-12-22T10:00:33.557701+0000","last_clean":"2023-12-22T10:00:33.557701+0000","last_became_active":"2023-12-22T10:00:33.114451+0000","last_became_peered":"2023-12-22T10:00:33.114451+0000","last_unstale":"2023-12-22T10:00:33.557701+0000","last_undegraded":"2023-12-22T10:00:33.557701+0000","last_fullsized":"2023-12-22T10:00:33.557701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.566769+0000","last_change":"2023-12-22T10:00:33.565377+0000","last_active":"2023-12-22T10:00:33.566769+0000","last_peered":"2023-12-22T10:00:33.566769+0000","last_clean":"2023-12-22T10:00:33.566769+0000","last_became_active":"2023-12-22T10:00:33.565034+0000","last_became_peered":"2023-12-22T10:00:33.565034+0000","last_unstale":"2023-12-22T10:00:33.566769+0000","last_undegraded":"2023-12-22T10:00:33.566769+0000","last_fullsized":"2023-12-22T10:00:33.566769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.30","version":"20'4","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.579500+0000","last_change":"2023-12-22T10:00:33.115740+0000","last_active":"2023-12-22T10:00:33.579500+0000","last_peered":"2023-12-22T10:00:33.579500+0000","last_clean":"2023-12-22T10:00:33.579500+0000","last_became_active":"2023-12-22T10:00:33.115447+0000","last_became_peered":"2023-12-22T10:00:33.115447+0000","last_unstale":"2023-12-22T10:00:33.579500+0000","last_undegraded":"2023-12-22T10:00:33.579500+0000","last_fullsized":"2023-12-22T10:00:33.579500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.572884+0000","last_change":"2023-12-22T10:00:33.126391+0000","last_active":"2023-12-22T10:00:33.572884+0000","last_peered":"2023-12-22T10:00:33.572884+0000","last_clean":"2023-12-22T10:00:33.572884+0000","last_became_active":"2023-12-22T10:00:33.125526+0000","last_became_peered":"2023-12-22T10:00:33.125526+0000","last_unstale":"2023-12-22T10:00:33.572884+0000","last_undegraded":"2023-12-22T10:00:33.572884+0000","last_fullsized":"2023-12-22T10:00:33.572884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.564517+0000","last_change":"2023-12-22T10:00:33.562377+0000","last_active":"2023-12-22T10:00:33.564517+0000","last_peered":"2023-12-22T10:00:33.564517+0000","last_clean":"2023-12-22T10:00:33.564517+0000","last_became_active":"2023-12-22T10:00:33.562153+0000","last_became_peered":"2023-12-22T10:00:33.562153+0000","last_unstale":"2023-12-22T10:00:33.564517+0000","last_undegraded":"2023-12-22T10:00:33.564517+0000","last_fullsized":"2023-12-22T10:00:33.564517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.535033+0000","last_change":"2023-12-22T10:00:33.102597+0000","last_active":"2023-12-22T10:00:33.535033+0000","last_peered":"2023-12-22T10:00:33.535033+0000","last_clean":"2023-12-22T10:00:33.535033+0000","last_became_active":"2023-12-22T10:00:33.102275+0000","last_became_peered":"2023-12-22T10:00:33.102275+0000","last_unstale":"2023-12-22T10:00:33.535033+0000","last_undegraded":"2023-12-22T10:00:33.535033+0000","last_fullsized":"2023-12-22T10:00:33.535033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.574337+0000","last_change":"2023-12-22T10:00:33.572233+0000","last_active":"2023-12-22T10:00:33.574337+0000","last_peered":"2023-12-22T10:00:33.574337+0000","last_clean":"2023-12-22T10:00:33.574337+0000","last_became_active":"2023-12-22T10:00:33.571392+0000","last_became_peered":"2023-12-22T10:00:33.571392+0000","last_unstale":"2023-12-22T10:00:33.574337+0000","last_undegraded":"2023-12-22T10:00:33.574337+0000","last_fullsized":"2023-12-22T10:00:33.574337+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.582022+0000","last_change":"2023-12-22T10:00:33.104748+0000","last_active":"2023-12-22T10:00:33.582022+0000","last_peered":"2023-12-22T10:00:33.582022+0000","last_clean":"2023-12-22T10:00:33.582022+0000","last_became_active":"2023-12-22T10:00:33.104419+0000","last_became_peered":"2023-12-22T10:00:33.104419+0000","last_unstale":"2023-12-22T10:00:33.582022+0000","last_undegraded":"2023-12-22T10:00:33.582022+0000","last_fullsized":"2023-12-22T10:00:33.582022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.554141+0000","last_change":"2023-12-22T10:00:33.550068+0000","last_active":"2023-12-22T10:00:33.554141+0000","last_peered":"2023-12-22T10:00:33.554141+0000","last_clean":"2023-12-22T10:00:33.554141+0000","last_became_active":"2023-12-22T10:00:33.549379+0000","last_became_peered":"2023-12-22T10:00:33.549379+0000","last_unstale":"2023-12-22T10:00:33.554141+0000","last_undegraded":"2023-12-22T10:00:33.554141+0000","last_fullsized":"2023-12-22T10:00:33.554141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.552458+0000","last_change":"2023-12-22T10:00:33.125321+0000","last_active":"2023-12-22T10:00:33.552458+0000","last_peered":"2023-12-22T10:00:33.552458+0000","last_clean":"2023-12-22T10:00:33.552458+0000","last_became_active":"2023-12-22T10:00:33.124941+0000","last_became_peered":"2023-12-22T10:00:33.124941+0000","last_unstale":"2023-12-22T10:00:33.552458+0000","last_undegraded":"2023-12-22T10:00:33.552458+0000","last_fullsized":"2023-12-22T10:00:33.552458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.559455+0000","last_change":"2023-12-22T10:00:33.555687+0000","last_active":"2023-12-22T10:00:33.559455+0000","last_peered":"2023-12-22T10:00:33.559455+0000","last_clean":"2023-12-22T10:00:33.559455+0000","last_became_active":"2023-12-22T10:00:33.555390+0000","last_became_peered":"2023-12-22T10:00:33.555390+0000","last_unstale":"2023-12-22T10:00:33.559455+0000","last_undegraded":"2023-12-22T10:00:33.559455+0000","last_fullsized":"2023-12-22T10:00:33.559455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.568874+0000","last_change":"2023-12-22T10:00:33.105518+0000","last_active":"2023-12-22T10:00:33.568874+0000","last_peered":"2023-12-22T10:00:33.568874+0000","last_clean":"2023-12-22T10:00:33.568874+0000","last_became_active":"2023-12-22T10:00:33.105228+0000","last_became_peered":"2023-12-22T10:00:33.105228+0000","last_unstale":"2023-12-22T10:00:33.568874+0000","last_undegraded":"2023-12-22T10:00:33.568874+0000","last_fullsized":"2023-12-22T10:00:33.568874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.560977+0000","last_change":"2023-12-22T10:00:33.557230+0000","last_active":"2023-12-22T10:00:33.560977+0000","last_peered":"2023-12-22T10:00:33.560977+0000","last_clean":"2023-12-22T10:00:33.560977+0000","last_became_active":"2023-12-22T10:00:33.556941+0000","last_became_peered":"2023-12-22T10:00:33.556941+0000","last_unstale":"2023-12-22T10:00:33.560977+0000","last_undegraded":"2023-12-22T10:00:33.560977+0000","last_fullsized":"2023-12-22T10:00:33.560977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.537134+0000","last_change":"2023-12-22T10:00:33.116904+0000","last_active":"2023-12-22T10:00:33.537134+0000","last_peered":"2023-12-22T10:00:33.537134+0000","last_clean":"2023-12-22T10:00:33.537134+0000","last_became_active":"2023-12-22T10:00:33.116529+0000","last_became_peered":"2023-12-22T10:00:33.116529+0000","last_unstale":"2023-12-22T10:00:33.537134+0000","last_undegraded":"2023-12-22T10:00:33.537134+0000","last_fullsized":"2023-12-22T10:00:33.537134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.572395+0000","last_change":"2023-12-22T10:00:33.568568+0000","last_active":"2023-12-22T10:00:33.572395+0000","last_peered":"2023-12-22T10:00:33.572395+0000","last_clean":"2023-12-22T10:00:33.572395+0000","last_became_active":"2023-12-22T10:00:33.568292+0000","last_became_peered":"2023-12-22T10:00:33.568292+0000","last_unstale":"2023-12-22T10:00:33.572395+0000","last_undegraded":"2023-12-22T10:00:33.572395+0000","last_fullsized":"2023-12-22T10:00:33.572395+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.557798+0000","last_change":"2023-12-22T10:00:33.117091+0000","last_active":"2023-12-22T10:00:33.557798+0000","last_peered":"2023-12-22T10:00:33.557798+0000","last_clean":"2023-12-22T10:00:33.557798+0000","last_became_active":"2023-12-22T10:00:33.116766+0000","last_became_peered":"2023-12-22T10:00:33.116766+0000","last_unstale":"2023-12-22T10:00:33.557798+0000","last_undegraded":"2023-12-22T10:00:33.557798+0000","last_fullsized":"2023-12-22T10:00:33.557798+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.566935+0000","last_change":"2023-12-22T10:00:33.561834+0000","last_active":"2023-12-22T10:00:33.566935+0000","last_peered":"2023-12-22T10:00:33.566935+0000","last_clean":"2023-12-22T10:00:33.566935+0000","last_became_active":"2023-12-22T10:00:33.561545+0000","last_became_peered":"2023-12-22T10:00:33.561545+0000","last_unstale":"2023-12-22T10:00:33.566935+0000","last_undegraded":"2023-12-22T10:00:33.566935+0000","last_fullsized":"2023-12-22T10:00:33.566935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.563732+0000","last_change":"2023-12-22T10:00:33.108579+0000","last_active":"2023-12-22T10:00:33.563732+0000","last_peered":"2023-12-22T10:00:33.563732+0000","last_clean":"2023-12-22T10:00:33.563732+0000","last_became_active":"2023-12-22T10:00:33.108196+0000","last_became_peered":"2023-12-22T10:00:33.108196+0000","last_unstale":"2023-12-22T10:00:33.563732+0000","last_undegraded":"2023-12-22T10:00:33.563732+0000","last_fullsized":"2023-12-22T10:00:33.563732+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.554072+0000","last_change":"2023-12-22T10:00:33.548625+0000","last_active":"2023-12-22T10:00:33.554072+0000","last_peered":"2023-12-22T10:00:33.554072+0000","last_clean":"2023-12-22T10:00:33.554072+0000","last_became_active":"2023-12-22T10:00:33.547877+0000","last_became_peered":"2023-12-22T10:00:33.547877+0000","last_unstale":"2023-12-22T10:00:33.554072+0000","last_undegraded":"2023-12-22T10:00:33.554072+0000","last_fullsized":"2023-12-22T10:00:33.554072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.567687+0000","last_change":"2023-12-22T10:00:33.122895+0000","last_active":"2023-12-22T10:00:33.567687+0000","last_peered":"2023-12-22T10:00:33.567687+0000","last_clean":"2023-12-22T10:00:33.567687+0000","last_became_active":"2023-12-22T10:00:33.122475+0000","last_became_peered":"2023-12-22T10:00:33.122475+0000","last_unstale":"2023-12-22T10:00:33.567687+0000","last_undegraded":"2023-12-22T10:00:33.567687+0000","last_fullsized":"2023-12-22T10:00:33.567687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.546974+0000","last_change":"2023-12-22T10:00:33.545482+0000","last_active":"2023-12-22T10:00:33.546974+0000","last_peered":"2023-12-22T10:00:33.546974+0000","last_clean":"2023-12-22T10:00:33.546974+0000","last_became_active":"2023-12-22T10:00:33.545263+0000","last_became_peered":"2023-12-22T10:00:33.545263+0000","last_unstale":"2023-12-22T10:00:33.546974+0000","last_undegraded":"2023-12-22T10:00:33.546974+0000","last_fullsized":"2023-12-22T10:00:33.546974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-12-22T10:00:35.632723+0000","last_change":"2023-12-22T10:00:33.116864+0000","last_active":"2023-12-22T10:00:35.632723+0000","last_peered":"2023-12-22T10:00:35.632723+0000","last_clean":"2023-12-22T10:00:35.632723+0000","last_became_active":"2023-12-22T10:00:33.114073+0000","last_became_peered":"2023-12-22T10:00:33.114073+0000","last_unstale":"2023-12-22T10:00:35.632723+0000","last_undegraded":"2023-12-22T10:00:35.632723+0000","last_fullsized":"2023-12-22T10:00:35.632723+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.574592+0000","last_change":"2023-12-22T10:00:33.570093+0000","last_active":"2023-12-22T10:00:33.574592+0000","last_peered":"2023-12-22T10:00:33.574592+0000","last_clean":"2023-12-22T10:00:33.574592+0000","last_became_active":"2023-12-22T10:00:33.569770+0000","last_became_peered":"2023-12-22T10:00:33.569770+0000","last_unstale":"2023-12-22T10:00:33.574592+0000","last_undegraded":"2023-12-22T10:00:33.574592+0000","last_fullsized":"2023-12-22T10:00:33.574592+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.553842+0000","last_change":"2023-12-22T10:00:33.104605+0000","last_active":"2023-12-22T10:00:33.553842+0000","last_peered":"2023-12-22T10:00:33.553842+0000","last_clean":"2023-12-22T10:00:33.553842+0000","last_became_active":"2023-12-22T10:00:33.104303+0000","last_became_peered":"2023-12-22T10:00:33.104303+0000","last_unstale":"2023-12-22T10:00:33.553842+0000","last_undegraded":"2023-12-22T10:00:33.553842+0000","last_fullsized":"2023-12-22T10:00:33.553842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.566847+0000","last_change":"2023-12-22T10:00:33.562874+0000","last_active":"2023-12-22T10:00:33.566847+0000","last_peered":"2023-12-22T10:00:33.566847+0000","last_clean":"2023-12-22T10:00:33.566847+0000","last_became_active":"2023-12-22T10:00:33.562576+0000","last_became_peered":"2023-12-22T10:00:33.562576+0000","last_unstale":"2023-12-22T10:00:33.566847+0000","last_undegraded":"2023-12-22T10:00:33.566847+0000","last_fullsized":"2023-12-22T10:00:33.566847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.553589+0000","last_change":"2023-12-22T10:00:33.119412+0000","last_active":"2023-12-22T10:00:33.553589+0000","last_peered":"2023-12-22T10:00:33.553589+0000","last_clean":"2023-12-22T10:00:33.553589+0000","last_became_active":"2023-12-22T10:00:33.119056+0000","last_became_peered":"2023-12-22T10:00:33.119056+0000","last_unstale":"2023-12-22T10:00:33.553589+0000","last_undegraded":"2023-12-22T10:00:33.553589+0000","last_fullsized":"2023-12-22T10:00:33.553589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.567918+0000","last_change":"2023-12-22T10:00:33.560630+0000","last_active":"2023-12-22T10:00:33.567918+0000","last_peered":"2023-12-22T10:00:33.567918+0000","last_clean":"2023-12-22T10:00:33.567918+0000","last_became_active":"2023-12-22T10:00:33.559732+0000","last_became_peered":"2023-12-22T10:00:33.559732+0000","last_unstale":"2023-12-22T10:00:33.567918+0000","last_undegraded":"2023-12-22T10:00:33.567918+0000","last_fullsized":"2023-12-22T10:00:33.567918+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.563517+0000","last_change":"2023-12-22T10:00:33.101844+0000","last_active":"2023-12-22T10:00:33.563517+0000","last_peered":"2023-12-22T10:00:33.563517+0000","last_clean":"2023-12-22T10:00:33.563517+0000","last_became_active":"2023-12-22T10:00:33.101555+0000","last_became_peered":"2023-12-22T10:00:33.101555+0000","last_unstale":"2023-12-22T10:00:33.563517+0000","last_undegraded":"2023-12-22T10:00:33.563517+0000","last_fullsized":"2023-12-22T10:00:33.563517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.574042+0000","last_change":"2023-12-22T10:00:33.570633+0000","last_active":"2023-12-22T10:00:33.574042+0000","last_peered":"2023-12-22T10:00:33.574042+0000","last_clean":"2023-12-22T10:00:33.574042+0000","last_became_active":"2023-12-22T10:00:33.570252+0000","last_became_peered":"2023-12-22T10:00:33.570252+0000","last_unstale":"2023-12-22T10:00:33.574042+0000","last_undegraded":"2023-12-22T10:00:33.574042+0000","last_fullsized":"2023-12-22T10:00:33.574042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.563696+0000","last_change":"2023-12-22T10:00:33.116761+0000","last_active":"2023-12-22T10:00:33.563696+0000","last_peered":"2023-12-22T10:00:33.563696+0000","last_clean":"2023-12-22T10:00:33.563696+0000","last_became_active":"2023-12-22T10:00:33.116474+0000","last_became_peered":"2023-12-22T10:00:33.116474+0000","last_unstale":"2023-12-22T10:00:33.563696+0000","last_undegraded":"2023-12-22T10:00:33.563696+0000","last_fullsized":"2023-12-22T10:00:33.563696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.580112+0000","last_change":"2023-12-22T10:00:33.571361+0000","last_active":"2023-12-22T10:00:33.580112+0000","last_peered":"2023-12-22T10:00:33.580112+0000","last_clean":"2023-12-22T10:00:33.580112+0000","last_became_active":"2023-12-22T10:00:33.571028+0000","last_became_peered":"2023-12-22T10:00:33.571028+0000","last_unstale":"2023-12-22T10:00:33.580112+0000","last_undegraded":"2023-12-22T10:00:33.580112+0000","last_fullsized":"2023-12-22T10:00:33.580112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.533714+0000","last_change":"2023-12-22T10:00:33.106541+0000","last_active":"2023-12-22T10:00:33.533714+0000","last_peered":"2023-12-22T10:00:33.533714+0000","last_clean":"2023-12-22T10:00:33.533714+0000","last_became_active":"2023-12-22T10:00:33.106335+0000","last_became_peered":"2023-12-22T10:00:33.106335+0000","last_unstale":"2023-12-22T10:00:33.533714+0000","last_undegraded":"2023-12-22T10:00:33.533714+0000","last_fullsized":"2023-12-22T10:00:33.533714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.556351+0000","last_change":"2023-12-22T10:00:33.549027+0000","last_active":"2023-12-22T10:00:33.556351+0000","last_peered":"2023-12-22T10:00:33.556351+0000","last_clean":"2023-12-22T10:00:33.556351+0000","last_became_active":"2023-12-22T10:00:33.548700+0000","last_became_peered":"2023-12-22T10:00:33.548700+0000","last_unstale":"2023-12-22T10:00:33.556351+0000","last_undegraded":"2023-12-22T10:00:33.556351+0000","last_fullsized":"2023-12-22T10:00:33.556351+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.536888+0000","last_change":"2023-12-22T10:00:33.114834+0000","last_active":"2023-12-22T10:00:33.536888+0000","last_peered":"2023-12-22T10:00:33.536888+0000","last_clean":"2023-12-22T10:00:33.536888+0000","last_became_active":"2023-12-22T10:00:33.114551+0000","last_became_peered":"2023-12-22T10:00:33.114551+0000","last_unstale":"2023-12-22T10:00:33.536888+0000","last_undegraded":"2023-12-22T10:00:33.536888+0000","last_fullsized":"2023-12-22T10:00:33.536888+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.570248+0000","last_change":"2023-12-22T10:00:33.569508+0000","last_active":"2023-12-22T10:00:33.570248+0000","last_peered":"2023-12-22T10:00:33.570248+0000","last_clean":"2023-12-22T10:00:33.570248+0000","last_became_active":"2023-12-22T10:00:33.569153+0000","last_became_peered":"2023-12-22T10:00:33.569153+0000","last_unstale":"2023-12-22T10:00:33.570248+0000","last_undegraded":"2023-12-22T10:00:33.570248+0000","last_fullsized":"2023-12-22T10:00:33.570248+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.581087+0000","last_change":"2023-12-22T10:00:33.122806+0000","last_active":"2023-12-22T10:00:33.581087+0000","last_peered":"2023-12-22T10:00:33.581087+0000","last_clean":"2023-12-22T10:00:33.581087+0000","last_became_active":"2023-12-22T10:00:33.122335+0000","last_became_peered":"2023-12-22T10:00:33.122335+0000","last_unstale":"2023-12-22T10:00:33.581087+0000","last_undegraded":"2023-12-22T10:00:33.581087+0000","last_fullsized":"2023-12-22T10:00:33.581087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.562584+0000","last_change":"2023-12-22T10:00:33.558380+0000","last_active":"2023-12-22T10:00:33.562584+0000","last_peered":"2023-12-22T10:00:33.562584+0000","last_clean":"2023-12-22T10:00:33.562584+0000","last_became_active":"2023-12-22T10:00:33.557645+0000","last_became_peered":"2023-12-22T10:00:33.557645+0000","last_unstale":"2023-12-22T10:00:33.562584+0000","last_undegraded":"2023-12-22T10:00:33.562584+0000","last_fullsized":"2023-12-22T10:00:33.562584+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.575125+0000","last_change":"2023-12-22T10:00:33.108312+0000","last_active":"2023-12-22T10:00:33.575125+0000","last_peered":"2023-12-22T10:00:33.575125+0000","last_clean":"2023-12-22T10:00:33.575125+0000","last_became_active":"2023-12-22T10:00:33.107971+0000","last_became_peered":"2023-12-22T10:00:33.107971+0000","last_unstale":"2023-12-22T10:00:33.575125+0000","last_undegraded":"2023-12-22T10:00:33.575125+0000","last_fullsized":"2023-12-22T10:00:33.575125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.553973+0000","last_change":"2023-12-22T10:00:33.545698+0000","last_active":"2023-12-22T10:00:33.553973+0000","last_peered":"2023-12-22T10:00:33.553973+0000","last_clean":"2023-12-22T10:00:33.553973+0000","last_became_active":"2023-12-22T10:00:33.545320+0000","last_became_peered":"2023-12-22T10:00:33.545320+0000","last_unstale":"2023-12-22T10:00:33.553973+0000","last_undegraded":"2023-12-22T10:00:33.553973+0000","last_fullsized":"2023-12-22T10:00:33.553973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.583316+0000","last_change":"2023-12-22T10:00:33.131076+0000","last_active":"2023-12-22T10:00:33.583316+0000","last_peered":"2023-12-22T10:00:33.583316+0000","last_clean":"2023-12-22T10:00:33.583316+0000","last_became_active":"2023-12-22T10:00:33.129467+0000","last_became_peered":"2023-12-22T10:00:33.129467+0000","last_unstale":"2023-12-22T10:00:33.583316+0000","last_undegraded":"2023-12-22T10:00:33.583316+0000","last_fullsized":"2023-12-22T10:00:33.583316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.569110+0000","last_change":"2023-12-22T10:00:33.562206+0000","last_active":"2023-12-22T10:00:33.569110+0000","last_peered":"2023-12-22T10:00:33.569110+0000","last_clean":"2023-12-22T10:00:33.569110+0000","last_became_active":"2023-12-22T10:00:33.561891+0000","last_became_peered":"2023-12-22T10:00:33.561891+0000","last_unstale":"2023-12-22T10:00:33.569110+0000","last_undegraded":"2023-12-22T10:00:33.569110+0000","last_fullsized":"2023-12-22T10:00:33.569110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.540004+0000","last_change":"2023-12-22T10:00:33.123149+0000","last_active":"2023-12-22T10:00:33.540004+0000","last_peered":"2023-12-22T10:00:33.540004+0000","last_clean":"2023-12-22T10:00:33.540004+0000","last_became_active":"2023-12-22T10:00:33.122935+0000","last_became_peered":"2023-12-22T10:00:33.122935+0000","last_unstale":"2023-12-22T10:00:33.540004+0000","last_undegraded":"2023-12-22T10:00:33.540004+0000","last_fullsized":"2023-12-22T10:00:33.540004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.568376+0000","last_change":"2023-12-22T10:00:33.567288+0000","last_active":"2023-12-22T10:00:33.568376+0000","last_peered":"2023-12-22T10:00:33.568376+0000","last_clean":"2023-12-22T10:00:33.568376+0000","last_became_active":"2023-12-22T10:00:33.566952+0000","last_became_peered":"2023-12-22T10:00:33.566952+0000","last_unstale":"2023-12-22T10:00:33.568376+0000","last_undegraded":"2023-12-22T10:00:33.568376+0000","last_fullsized":"2023-12-22T10:00:33.568376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.538624+0000","last_change":"2023-12-22T10:00:33.123825+0000","last_active":"2023-12-22T10:00:33.538624+0000","last_peered":"2023-12-22T10:00:33.538624+0000","last_clean":"2023-12-22T10:00:33.538624+0000","last_became_active":"2023-12-22T10:00:33.123481+0000","last_became_peered":"2023-12-22T10:00:33.123481+0000","last_unstale":"2023-12-22T10:00:33.538624+0000","last_undegraded":"2023-12-22T10:00:33.538624+0000","last_fullsized":"2023-12-22T10:00:33.538624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.557967+0000","last_change":"2023-12-22T10:00:33.555572+0000","last_active":"2023-12-22T10:00:33.557967+0000","last_peered":"2023-12-22T10:00:33.557967+0000","last_clean":"2023-12-22T10:00:33.557967+0000","last_became_active":"2023-12-22T10:00:33.555250+0000","last_became_peered":"2023-12-22T10:00:33.555250+0000","last_unstale":"2023-12-22T10:00:33.557967+0000","last_undegraded":"2023-12-22T10:00:33.557967+0000","last_fullsized":"2023-12-22T10:00:33.557967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.537289+0000","last_change":"2023-12-22T10:00:33.124398+0000","last_active":"2023-12-22T10:00:33.537289+0000","last_peered":"2023-12-22T10:00:33.537289+0000","last_clean":"2023-12-22T10:00:33.537289+0000","last_became_active":"2023-12-22T10:00:33.124096+0000","last_became_peered":"2023-12-22T10:00:33.124096+0000","last_unstale":"2023-12-22T10:00:33.537289+0000","last_undegraded":"2023-12-22T10:00:33.537289+0000","last_fullsized":"2023-12-22T10:00:33.537289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.574132+0000","last_change":"2023-12-22T10:00:33.571592+0000","last_active":"2023-12-22T10:00:33.574132+0000","last_peered":"2023-12-22T10:00:33.574132+0000","last_clean":"2023-12-22T10:00:33.574132+0000","last_became_active":"2023-12-22T10:00:33.570984+0000","last_became_peered":"2023-12-22T10:00:33.570984+0000","last_unstale":"2023-12-22T10:00:33.574132+0000","last_undegraded":"2023-12-22T10:00:33.574132+0000","last_fullsized":"2023-12-22T10:00:33.574132+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.535021+0000","last_change":"2023-12-22T10:00:33.112772+0000","last_active":"2023-12-22T10:00:33.535021+0000","last_peered":"2023-12-22T10:00:33.535021+0000","last_clean":"2023-12-22T10:00:33.535021+0000","last_became_active":"2023-12-22T10:00:33.111855+0000","last_became_peered":"2023-12-22T10:00:33.111855+0000","last_unstale":"2023-12-22T10:00:33.535021+0000","last_undegraded":"2023-12-22T10:00:33.535021+0000","last_fullsized":"2023-12-22T10:00:33.535021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.548367+0000","last_change":"2023-12-22T10:00:33.544852+0000","last_active":"2023-12-22T10:00:33.548367+0000","last_peered":"2023-12-22T10:00:33.548367+0000","last_clean":"2023-12-22T10:00:33.548367+0000","last_became_active":"2023-12-22T10:00:33.544552+0000","last_became_peered":"2023-12-22T10:00:33.544552+0000","last_unstale":"2023-12-22T10:00:33.548367+0000","last_undegraded":"2023-12-22T10:00:33.548367+0000","last_fullsized":"2023-12-22T10:00:33.548367+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.558216+0000","last_change":"2023-12-22T10:00:33.113222+0000","last_active":"2023-12-22T10:00:33.558216+0000","last_peered":"2023-12-22T10:00:33.558216+0000","last_clean":"2023-12-22T10:00:33.558216+0000","last_became_active":"2023-12-22T10:00:33.112562+0000","last_became_peered":"2023-12-22T10:00:33.112562+0000","last_unstale":"2023-12-22T10:00:33.558216+0000","last_undegraded":"2023-12-22T10:00:33.558216+0000","last_fullsized":"2023-12-22T10:00:33.558216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.580413+0000","last_change":"2023-12-22T10:00:33.574338+0000","last_active":"2023-12-22T10:00:33.580413+0000","last_peered":"2023-12-22T10:00:33.580413+0000","last_clean":"2023-12-22T10:00:33.580413+0000","last_became_active":"2023-12-22T10:00:33.574067+0000","last_became_peered":"2023-12-22T10:00:33.574067+0000","last_unstale":"2023-12-22T10:00:33.580413+0000","last_undegraded":"2023-12-22T10:00:33.580413+0000","last_fullsized":"2023-12-22T10:00:33.580413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.567934+0000","last_change":"2023-12-22T10:00:33.107801+0000","last_active":"2023-12-22T10:00:33.567934+0000","last_peered":"2023-12-22T10:00:33.567934+0000","last_clean":"2023-12-22T10:00:33.567934+0000","last_became_active":"2023-12-22T10:00:33.107518+0000","last_became_peered":"2023-12-22T10:00:33.107518+0000","last_unstale":"2023-12-22T10:00:33.567934+0000","last_undegraded":"2023-12-22T10:00:33.567934+0000","last_fullsized":"2023-12-22T10:00:33.567934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.562318+0000","last_change":"2023-12-22T10:00:33.560454+0000","last_active":"2023-12-22T10:00:33.562318+0000","last_peered":"2023-12-22T10:00:33.562318+0000","last_clean":"2023-12-22T10:00:33.562318+0000","last_became_active":"2023-12-22T10:00:33.560129+0000","last_became_peered":"2023-12-22T10:00:33.560129+0000","last_unstale":"2023-12-22T10:00:33.562318+0000","last_undegraded":"2023-12-22T10:00:33.562318+0000","last_fullsized":"2023-12-22T10:00:33.562318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.541686+0000","last_change":"2023-12-22T10:00:33.117097+0000","last_active":"2023-12-22T10:00:33.541686+0000","last_peered":"2023-12-22T10:00:33.541686+0000","last_clean":"2023-12-22T10:00:33.541686+0000","last_became_active":"2023-12-22T10:00:33.116827+0000","last_became_peered":"2023-12-22T10:00:33.116827+0000","last_unstale":"2023-12-22T10:00:33.541686+0000","last_undegraded":"2023-12-22T10:00:33.541686+0000","last_fullsized":"2023-12-22T10:00:33.541686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.566055+0000","last_change":"2023-12-22T10:00:33.563813+0000","last_active":"2023-12-22T10:00:33.566055+0000","last_peered":"2023-12-22T10:00:33.566055+0000","last_clean":"2023-12-22T10:00:33.566055+0000","last_became_active":"2023-12-22T10:00:33.563482+0000","last_became_peered":"2023-12-22T10:00:33.563482+0000","last_unstale":"2023-12-22T10:00:33.566055+0000","last_undegraded":"2023-12-22T10:00:33.566055+0000","last_fullsized":"2023-12-22T10:00:33.566055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.581412+0000","last_change":"2023-12-22T10:00:33.123573+0000","last_active":"2023-12-22T10:00:33.581412+0000","last_peered":"2023-12-22T10:00:33.581412+0000","last_clean":"2023-12-22T10:00:33.581412+0000","last_became_active":"2023-12-22T10:00:33.123235+0000","last_became_peered":"2023-12-22T10:00:33.123235+0000","last_unstale":"2023-12-22T10:00:33.581412+0000","last_undegraded":"2023-12-22T10:00:33.581412+0000","last_fullsized":"2023-12-22T10:00:33.581412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.565881+0000","last_change":"2023-12-22T10:00:33.562321+0000","last_active":"2023-12-22T10:00:33.565881+0000","last_peered":"2023-12-22T10:00:33.565881+0000","last_clean":"2023-12-22T10:00:33.565881+0000","last_became_active":"2023-12-22T10:00:33.561991+0000","last_became_peered":"2023-12-22T10:00:33.561991+0000","last_unstale":"2023-12-22T10:00:33.565881+0000","last_undegraded":"2023-12-22T10:00:33.565881+0000","last_fullsized":"2023-12-22T10:00:33.565881+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.582362+0000","last_change":"2023-12-22T10:00:33.114894+0000","last_active":"2023-12-22T10:00:33.582362+0000","last_peered":"2023-12-22T10:00:33.582362+0000","last_clean":"2023-12-22T10:00:33.582362+0000","last_became_active":"2023-12-22T10:00:33.114560+0000","last_became_peered":"2023-12-22T10:00:33.114560+0000","last_unstale":"2023-12-22T10:00:33.582362+0000","last_undegraded":"2023-12-22T10:00:33.582362+0000","last_fullsized":"2023-12-22T10:00:33.582362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.567149+0000","last_change":"2023-12-22T10:00:33.559792+0000","last_active":"2023-12-22T10:00:33.567149+0000","last_peered":"2023-12-22T10:00:33.567149+0000","last_clean":"2023-12-22T10:00:33.567149+0000","last_became_active":"2023-12-22T10:00:33.559507+0000","last_became_peered":"2023-12-22T10:00:33.559507+0000","last_unstale":"2023-12-22T10:00:33.567149+0000","last_undegraded":"2023-12-22T10:00:33.567149+0000","last_fullsized":"2023-12-22T10:00:33.567149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.572960+0000","last_change":"2023-12-22T10:00:28.036372+0000","last_active":"2023-12-22T10:00:33.572960+0000","last_peered":"2023-12-22T10:00:33.572960+0000","last_clean":"2023-12-22T10:00:33.572960+0000","last_became_active":"2023-12-22T10:00:28.035974+0000","last_became_peered":"2023-12-22T10:00:28.035974+0000","last_unstale":"2023-12-22T10:00:33.572960+0000","last_undegraded":"2023-12-22T10:00:33.572960+0000","last_fullsized":"2023-12-22T10:00:33.572960+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_clean_scrub_stamp":"2023-12-22T10:00:27.001906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.537223+0000","last_change":"2023-12-22T10:00:33.105448+0000","last_active":"2023-12-22T10:00:33.537223+0000","last_peered":"2023-12-22T10:00:33.537223+0000","last_clean":"2023-12-22T10:00:33.537223+0000","last_became_active":"2023-12-22T10:00:33.105043+0000","last_became_peered":"2023-12-22T10:00:33.105043+0000","last_unstale":"2023-12-22T10:00:33.537223+0000","last_undegraded":"2023-12-22T10:00:33.537223+0000","last_fullsized":"2023-12-22T10:00:33.537223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.562442+0000","last_change":"2023-12-22T10:00:33.550578+0000","last_active":"2023-12-22T10:00:33.562442+0000","last_peered":"2023-12-22T10:00:33.562442+0000","last_clean":"2023-12-22T10:00:33.562442+0000","last_became_active":"2023-12-22T10:00:33.550295+0000","last_became_peered":"2023-12-22T10:00:33.550295+0000","last_unstale":"2023-12-22T10:00:33.562442+0000","last_undegraded":"2023-12-22T10:00:33.562442+0000","last_fullsized":"2023-12-22T10:00:33.562442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.537334+0000","last_change":"2023-12-22T10:00:28.035308+0000","last_active":"2023-12-22T10:00:33.537334+0000","last_peered":"2023-12-22T10:00:33.537334+0000","last_clean":"2023-12-22T10:00:33.537334+0000","last_became_active":"2023-12-22T10:00:28.035002+0000","last_became_peered":"2023-12-22T10:00:28.035002+0000","last_unstale":"2023-12-22T10:00:33.537334+0000","last_undegraded":"2023-12-22T10:00:33.537334+0000","last_fullsized":"2023-12-22T10:00:33.537334+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_clean_scrub_stamp":"2023-12-22T10:00:27.001906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.566358+0000","last_change":"2023-12-22T10:00:33.111116+0000","last_active":"2023-12-22T10:00:33.566358+0000","last_peered":"2023-12-22T10:00:33.566358+0000","last_clean":"2023-12-22T10:00:33.566358+0000","last_became_active":"2023-12-22T10:00:33.110624+0000","last_became_peered":"2023-12-22T10:00:33.110624+0000","last_unstale":"2023-12-22T10:00:33.566358+0000","last_undegraded":"2023-12-22T10:00:33.566358+0000","last_fullsized":"2023-12-22T10:00:33.566358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.548423+0000","last_change":"2023-12-22T10:00:33.544541+0000","last_active":"2023-12-22T10:00:33.548423+0000","last_peered":"2023-12-22T10:00:33.548423+0000","last_clean":"2023-12-22T10:00:33.548423+0000","last_became_active":"2023-12-22T10:00:33.544231+0000","last_became_peered":"2023-12-22T10:00:33.544231+0000","last_unstale":"2023-12-22T10:00:33.548423+0000","last_undegraded":"2023-12-22T10:00:33.548423+0000","last_fullsized":"2023-12-22T10:00:33.548423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.576647+0000","last_change":"2023-12-22T10:00:28.029892+0000","last_active":"2023-12-22T10:00:33.576647+0000","last_peered":"2023-12-22T10:00:33.576647+0000","last_clean":"2023-12-22T10:00:33.576647+0000","last_became_active":"2023-12-22T10:00:28.029391+0000","last_became_peered":"2023-12-22T10:00:28.029391+0000","last_unstale":"2023-12-22T10:00:33.576647+0000","last_undegraded":"2023-12-22T10:00:33.576647+0000","last_fullsized":"2023-12-22T10:00:33.576647+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_clean_scrub_stamp":"2023-12-22T10:00:27.001906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.553697+0000","last_change":"2023-12-22T10:00:33.110693+0000","last_active":"2023-12-22T10:00:33.553697+0000","last_peered":"2023-12-22T10:00:33.553697+0000","last_clean":"2023-12-22T10:00:33.553697+0000","last_became_active":"2023-12-22T10:00:33.110229+0000","last_became_peered":"2023-12-22T10:00:33.110229+0000","last_unstale":"2023-12-22T10:00:33.553697+0000","last_undegraded":"2023-12-22T10:00:33.553697+0000","last_fullsized":"2023-12-22T10:00:33.553697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.563709+0000","last_change":"2023-12-22T10:00:33.561493+0000","last_active":"2023-12-22T10:00:33.563709+0000","last_peered":"2023-12-22T10:00:33.563709+0000","last_clean":"2023-12-22T10:00:33.563709+0000","last_became_active":"2023-12-22T10:00:33.561177+0000","last_became_peered":"2023-12-22T10:00:33.561177+0000","last_unstale":"2023-12-22T10:00:33.563709+0000","last_undegraded":"2023-12-22T10:00:33.563709+0000","last_fullsized":"2023-12-22T10:00:33.563709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.562802+0000","last_change":"2023-12-22T10:00:28.025395+0000","last_active":"2023-12-22T10:00:33.562802+0000","last_peered":"2023-12-22T10:00:33.562802+0000","last_clean":"2023-12-22T10:00:33.562802+0000","last_became_active":"2023-12-22T10:00:28.024588+0000","last_became_peered":"2023-12-22T10:00:28.024588+0000","last_unstale":"2023-12-22T10:00:33.562802+0000","last_undegraded":"2023-12-22T10:00:33.562802+0000","last_fullsized":"2023-12-22T10:00:33.562802+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_clean_scrub_stamp":"2023-12-22T10:00:27.001906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.537968+0000","last_change":"2023-12-22T10:00:33.116031+0000","last_active":"2023-12-22T10:00:33.537968+0000","last_peered":"2023-12-22T10:00:33.537968+0000","last_clean":"2023-12-22T10:00:33.537968+0000","last_became_active":"2023-12-22T10:00:33.115730+0000","last_became_peered":"2023-12-22T10:00:33.115730+0000","last_unstale":"2023-12-22T10:00:33.537968+0000","last_undegraded":"2023-12-22T10:00:33.537968+0000","last_fullsized":"2023-12-22T10:00:33.537968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.563609+0000","last_change":"2023-12-22T10:00:33.558628+0000","last_active":"2023-12-22T10:00:33.563609+0000","last_peered":"2023-12-22T10:00:33.563609+0000","last_clean":"2023-12-22T10:00:33.563609+0000","last_became_active":"2023-12-22T10:00:33.558312+0000","last_became_peered":"2023-12-22T10:00:33.558312+0000","last_unstale":"2023-12-22T10:00:33.563609+0000","last_undegraded":"2023-12-22T10:00:33.563609+0000","last_fullsized":"2023-12-22T10:00:33.563609+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.552943+0000","last_change":"2023-12-22T10:00:33.124426+0000","last_active":"2023-12-22T10:00:33.552943+0000","last_peered":"2023-12-22T10:00:33.552943+0000","last_clean":"2023-12-22T10:00:33.552943+0000","last_became_active":"2023-12-22T10:00:33.119964+0000","last_became_peered":"2023-12-22T10:00:33.119964+0000","last_unstale":"2023-12-22T10:00:33.552943+0000","last_undegraded":"2023-12-22T10:00:33.552943+0000","last_fullsized":"2023-12-22T10:00:33.552943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.563791+0000","last_change":"2023-12-22T10:00:28.029884+0000","last_active":"2023-12-22T10:00:33.563791+0000","last_peered":"2023-12-22T10:00:33.563791+0000","last_clean":"2023-12-22T10:00:33.563791+0000","last_became_active":"2023-12-22T10:00:28.029422+0000","last_became_peered":"2023-12-22T10:00:28.029422+0000","last_unstale":"2023-12-22T10:00:33.563791+0000","last_undegraded":"2023-12-22T10:00:33.563791+0000","last_fullsized":"2023-12-22T10:00:33.563791+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_clean_scrub_stamp":"2023-12-22T10:00:27.001906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.555956+0000","last_change":"2023-12-22T10:00:33.547520+0000","last_active":"2023-12-22T10:00:33.555956+0000","last_peered":"2023-12-22T10:00:33.555956+0000","last_clean":"2023-12-22T10:00:33.555956+0000","last_became_active":"2023-12-22T10:00:33.546923+0000","last_became_peered":"2023-12-22T10:00:33.546923+0000","last_unstale":"2023-12-22T10:00:33.555956+0000","last_undegraded":"2023-12-22T10:00:33.555956+0000","last_fullsized":"2023-12-22T10:00:33.555956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.558060+0000","last_change":"2023-12-22T10:00:33.103518+0000","last_active":"2023-12-22T10:00:33.558060+0000","last_peered":"2023-12-22T10:00:33.558060+0000","last_clean":"2023-12-22T10:00:33.558060+0000","last_became_active":"2023-12-22T10:00:33.103133+0000","last_became_peered":"2023-12-22T10:00:33.103133+0000","last_unstale":"2023-12-22T10:00:33.558060+0000","last_undegraded":"2023-12-22T10:00:33.558060+0000","last_fullsized":"2023-12-22T10:00:33.558060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.533806+0000","last_change":"2023-12-22T10:00:28.028621+0000","last_active":"2023-12-22T10:00:33.533806+0000","last_peered":"2023-12-22T10:00:33.533806+0000","last_clean":"2023-12-22T10:00:33.533806+0000","last_became_active":"2023-12-22T10:00:28.028159+0000","last_became_peered":"2023-12-22T10:00:28.028159+0000","last_unstale":"2023-12-22T10:00:33.533806+0000","last_undegraded":"2023-12-22T10:00:33.533806+0000","last_fullsized":"2023-12-22T10:00:33.533806+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_clean_scrub_stamp":"2023-12-22T10:00:27.001906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.574590+0000","last_change":"2023-12-22T10:00:33.569946+0000","last_active":"2023-12-22T10:00:33.574590+0000","last_peered":"2023-12-22T10:00:33.574590+0000","last_clean":"2023-12-22T10:00:33.574590+0000","last_became_active":"2023-12-22T10:00:33.569709+0000","last_became_peered":"2023-12-22T10:00:33.569709+0000","last_unstale":"2023-12-22T10:00:33.574590+0000","last_undegraded":"2023-12-22T10:00:33.574590+0000","last_fullsized":"2023-12-22T10:00:33.574590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.552800+0000","last_change":"2023-12-22T10:00:33.102638+0000","last_active":"2023-12-22T10:00:33.552800+0000","last_peered":"2023-12-22T10:00:33.552800+0000","last_clean":"2023-12-22T10:00:33.552800+0000","last_became_active":"2023-12-22T10:00:33.101055+0000","last_became_peered":"2023-12-22T10:00:33.101055+0000","last_unstale":"2023-12-22T10:00:33.552800+0000","last_undegraded":"2023-12-22T10:00:33.552800+0000","last_fullsized":"2023-12-22T10:00:33.552800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.568523+0000","last_change":"2023-12-22T10:00:28.030883+0000","last_active":"2023-12-22T10:00:33.568523+0000","last_peered":"2023-12-22T10:00:33.568523+0000","last_clean":"2023-12-22T10:00:33.568523+0000","last_became_active":"2023-12-22T10:00:28.030284+0000","last_became_peered":"2023-12-22T10:00:28.030284+0000","last_unstale":"2023-12-22T10:00:33.568523+0000","last_undegraded":"2023-12-22T10:00:33.568523+0000","last_fullsized":"2023-12-22T10:00:33.568523+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_clean_scrub_stamp":"2023-12-22T10:00:27.001906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.572101+0000","last_change":"2023-12-22T10:00:33.568203+0000","last_active":"2023-12-22T10:00:33.572101+0000","last_peered":"2023-12-22T10:00:33.572101+0000","last_clean":"2023-12-22T10:00:33.572101+0000","last_became_active":"2023-12-22T10:00:33.567890+0000","last_became_peered":"2023-12-22T10:00:33.567890+0000","last_unstale":"2023-12-22T10:00:33.572101+0000","last_undegraded":"2023-12-22T10:00:33.572101+0000","last_fullsized":"2023-12-22T10:00:33.572101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.535729+0000","last_change":"2023-12-22T10:00:33.105537+0000","last_active":"2023-12-22T10:00:33.535729+0000","last_peered":"2023-12-22T10:00:33.535729+0000","last_clean":"2023-12-22T10:00:33.535729+0000","last_became_active":"2023-12-22T10:00:33.105202+0000","last_became_peered":"2023-12-22T10:00:33.105202+0000","last_unstale":"2023-12-22T10:00:33.535729+0000","last_undegraded":"2023-12-22T10:00:33.535729+0000","last_fullsized":"2023-12-22T10:00:33.535729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.568566+0000","last_change":"2023-12-22T10:00:28.031790+0000","last_active":"2023-12-22T10:00:33.568566+0000","last_peered":"2023-12-22T10:00:33.568566+0000","last_clean":"2023-12-22T10:00:33.568566+0000","last_became_active":"2023-12-22T10:00:28.031190+0000","last_became_peered":"2023-12-22T10:00:28.031190+0000","last_unstale":"2023-12-22T10:00:33.568566+0000","last_undegraded":"2023-12-22T10:00:33.568566+0000","last_fullsized":"2023-12-22T10:00:33.568566+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_clean_scrub_stamp":"2023-12-22T10:00:27.001906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.535875+0000","last_change":"2023-12-22T10:00:27.889031+0000","last_active":"2023-12-22T10:00:33.535875+0000","last_peered":"2023-12-22T10:00:33.535875+0000","last_clean":"2023-12-22T10:00:33.535875+0000","last_became_active":"2023-12-22T10:00:27.888164+0000","last_became_peered":"2023-12-22T10:00:27.888164+0000","last_unstale":"2023-12-22T10:00:33.535875+0000","last_undegraded":"2023-12-22T10:00:33.535875+0000","last_fullsized":"2023-12-22T10:00:33.535875+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:25.998963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:25.998963+0000","last_clean_scrub_stamp":"2023-12-22T10:00:25.998963+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.557856+0000","last_change":"2023-12-22T10:00:33.554263+0000","last_active":"2023-12-22T10:00:33.557856+0000","last_peered":"2023-12-22T10:00:33.557856+0000","last_clean":"2023-12-22T10:00:33.557856+0000","last_became_active":"2023-12-22T10:00:33.553794+0000","last_became_peered":"2023-12-22T10:00:33.553794+0000","last_unstale":"2023-12-22T10:00:33.557856+0000","last_undegraded":"2023-12-22T10:00:33.557856+0000","last_fullsized":"2023-12-22T10:00:33.557856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.535306+0000","last_change":"2023-12-22T10:00:33.096988+0000","last_active":"2023-12-22T10:00:33.535306+0000","last_peered":"2023-12-22T10:00:33.535306+0000","last_clean":"2023-12-22T10:00:33.535306+0000","last_became_active":"2023-12-22T10:00:33.096126+0000","last_became_peered":"2023-12-22T10:00:33.096126+0000","last_unstale":"2023-12-22T10:00:33.535306+0000","last_undegraded":"2023-12-22T10:00:33.535306+0000","last_fullsized":"2023-12-22T10:00:33.535306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.559082+0000","last_change":"2023-12-22T10:00:33.548870+0000","last_active":"2023-12-22T10:00:33.559082+0000","last_peered":"2023-12-22T10:00:33.559082+0000","last_clean":"2023-12-22T10:00:33.559082+0000","last_became_active":"2023-12-22T10:00:33.548315+0000","last_became_peered":"2023-12-22T10:00:33.548315+0000","last_unstale":"2023-12-22T10:00:33.559082+0000","last_undegraded":"2023-12-22T10:00:33.559082+0000","last_fullsized":"2023-12-22T10:00:33.559082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.563733+0000","last_change":"2023-12-22T10:00:33.105596+0000","last_active":"2023-12-22T10:00:33.563733+0000","last_peered":"2023-12-22T10:00:33.563733+0000","last_clean":"2023-12-22T10:00:33.563733+0000","last_became_active":"2023-12-22T10:00:33.105278+0000","last_became_peered":"2023-12-22T10:00:33.105278+0000","last_unstale":"2023-12-22T10:00:33.563733+0000","last_undegraded":"2023-12-22T10:00:33.563733+0000","last_fullsized":"2023-12-22T10:00:33.563733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.562468+0000","last_change":"2023-12-22T10:00:33.559066+0000","last_active":"2023-12-22T10:00:33.562468+0000","last_peered":"2023-12-22T10:00:33.562468+0000","last_clean":"2023-12-22T10:00:33.562468+0000","last_became_active":"2023-12-22T10:00:33.558181+0000","last_became_peered":"2023-12-22T10:00:33.558181+0000","last_unstale":"2023-12-22T10:00:33.562468+0000","last_undegraded":"2023-12-22T10:00:33.562468+0000","last_fullsized":"2023-12-22T10:00:33.562468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.563711+0000","last_change":"2023-12-22T10:00:33.127356+0000","last_active":"2023-12-22T10:00:33.563711+0000","last_peered":"2023-12-22T10:00:33.563711+0000","last_clean":"2023-12-22T10:00:33.563711+0000","last_became_active":"2023-12-22T10:00:33.127051+0000","last_became_peered":"2023-12-22T10:00:33.127051+0000","last_unstale":"2023-12-22T10:00:33.563711+0000","last_undegraded":"2023-12-22T10:00:33.563711+0000","last_fullsized":"2023-12-22T10:00:33.563711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.557876+0000","last_change":"2023-12-22T10:00:33.554458+0000","last_active":"2023-12-22T10:00:33.557876+0000","last_peered":"2023-12-22T10:00:33.557876+0000","last_clean":"2023-12-22T10:00:33.557876+0000","last_became_active":"2023-12-22T10:00:33.554135+0000","last_became_peered":"2023-12-22T10:00:33.554135+0000","last_unstale":"2023-12-22T10:00:33.557876+0000","last_undegraded":"2023-12-22T10:00:33.557876+0000","last_fullsized":"2023-12-22T10:00:33.557876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.553982+0000","last_change":"2023-12-22T10:00:33.111426+0000","last_active":"2023-12-22T10:00:33.553982+0000","last_peered":"2023-12-22T10:00:33.553982+0000","last_clean":"2023-12-22T10:00:33.553982+0000","last_became_active":"2023-12-22T10:00:33.111127+0000","last_became_peered":"2023-12-22T10:00:33.111127+0000","last_unstale":"2023-12-22T10:00:33.553982+0000","last_undegraded":"2023-12-22T10:00:33.553982+0000","last_fullsized":"2023-12-22T10:00:33.553982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.568351+0000","last_change":"2023-12-22T10:00:33.560716+0000","last_active":"2023-12-22T10:00:33.568351+0000","last_peered":"2023-12-22T10:00:33.568351+0000","last_clean":"2023-12-22T10:00:33.568351+0000","last_became_active":"2023-12-22T10:00:33.560383+0000","last_became_peered":"2023-12-22T10:00:33.560383+0000","last_unstale":"2023-12-22T10:00:33.568351+0000","last_undegraded":"2023-12-22T10:00:33.568351+0000","last_fullsized":"2023-12-22T10:00:33.568351+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.552544+0000","last_change":"2023-12-22T10:00:33.117407+0000","last_active":"2023-12-22T10:00:33.552544+0000","last_peered":"2023-12-22T10:00:33.552544+0000","last_clean":"2023-12-22T10:00:33.552544+0000","last_became_active":"2023-12-22T10:00:33.117026+0000","last_became_peered":"2023-12-22T10:00:33.117026+0000","last_unstale":"2023-12-22T10:00:33.552544+0000","last_undegraded":"2023-12-22T10:00:33.552544+0000","last_fullsized":"2023-12-22T10:00:33.552544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.570974+0000","last_change":"2023-12-22T10:00:33.563333+0000","last_active":"2023-12-22T10:00:33.570974+0000","last_peered":"2023-12-22T10:00:33.570974+0000","last_clean":"2023-12-22T10:00:33.570974+0000","last_became_active":"2023-12-22T10:00:33.560143+0000","last_became_peered":"2023-12-22T10:00:33.560143+0000","last_unstale":"2023-12-22T10:00:33.570974+0000","last_undegraded":"2023-12-22T10:00:33.570974+0000","last_fullsized":"2023-12-22T10:00:33.570974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.576416+0000","last_change":"2023-12-22T10:00:33.127841+0000","last_active":"2023-12-22T10:00:33.576416+0000","last_peered":"2023-12-22T10:00:33.576416+0000","last_clean":"2023-12-22T10:00:33.576416+0000","last_became_active":"2023-12-22T10:00:33.127188+0000","last_became_peered":"2023-12-22T10:00:33.127188+0000","last_unstale":"2023-12-22T10:00:33.576416+0000","last_undegraded":"2023-12-22T10:00:33.576416+0000","last_fullsized":"2023-12-22T10:00:33.576416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.570549+0000","last_change":"2023-12-22T10:00:33.569232+0000","last_active":"2023-12-22T10:00:33.570549+0000","last_peered":"2023-12-22T10:00:33.570549+0000","last_clean":"2023-12-22T10:00:33.570549+0000","last_became_active":"2023-12-22T10:00:33.568907+0000","last_became_peered":"2023-12-22T10:00:33.568907+0000","last_unstale":"2023-12-22T10:00:33.570549+0000","last_undegraded":"2023-12-22T10:00:33.570549+0000","last_fullsized":"2023-12-22T10:00:33.570549+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.574106+0000","last_change":"2023-12-22T10:00:33.120992+0000","last_active":"2023-12-22T10:00:33.574106+0000","last_peered":"2023-12-22T10:00:33.574106+0000","last_clean":"2023-12-22T10:00:33.574106+0000","last_became_active":"2023-12-22T10:00:33.120706+0000","last_became_peered":"2023-12-22T10:00:33.120706+0000","last_unstale":"2023-12-22T10:00:33.574106+0000","last_undegraded":"2023-12-22T10:00:33.574106+0000","last_fullsized":"2023-12-22T10:00:33.574106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.576244+0000","last_change":"2023-12-22T10:00:33.573000+0000","last_active":"2023-12-22T10:00:33.576244+0000","last_peered":"2023-12-22T10:00:33.576244+0000","last_clean":"2023-12-22T10:00:33.576244+0000","last_became_active":"2023-12-22T10:00:33.571916+0000","last_became_peered":"2023-12-22T10:00:33.571916+0000","last_unstale":"2023-12-22T10:00:33.576244+0000","last_undegraded":"2023-12-22T10:00:33.576244+0000","last_fullsized":"2023-12-22T10:00:33.576244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.582224+0000","last_change":"2023-12-22T10:00:33.125992+0000","last_active":"2023-12-22T10:00:33.582224+0000","last_peered":"2023-12-22T10:00:33.582224+0000","last_clean":"2023-12-22T10:00:33.582224+0000","last_became_active":"2023-12-22T10:00:33.125693+0000","last_became_peered":"2023-12-22T10:00:33.125693+0000","last_unstale":"2023-12-22T10:00:33.582224+0000","last_undegraded":"2023-12-22T10:00:33.582224+0000","last_fullsized":"2023-12-22T10:00:33.582224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.554932+0000","last_change":"2023-12-22T10:00:33.553361+0000","last_active":"2023-12-22T10:00:33.554932+0000","last_peered":"2023-12-22T10:00:33.554932+0000","last_clean":"2023-12-22T10:00:33.554932+0000","last_became_active":"2023-12-22T10:00:33.551429+0000","last_became_peered":"2023-12-22T10:00:33.551429+0000","last_unstale":"2023-12-22T10:00:33.554932+0000","last_undegraded":"2023-12-22T10:00:33.554932+0000","last_fullsized":"2023-12-22T10:00:33.554932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"20'4","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.579099+0000","last_change":"2023-12-22T10:00:33.120651+0000","last_active":"2023-12-22T10:00:33.579099+0000","last_peered":"2023-12-22T10:00:33.579099+0000","last_clean":"2023-12-22T10:00:33.579099+0000","last_became_active":"2023-12-22T10:00:33.110600+0000","last_became_peered":"2023-12-22T10:00:33.110600+0000","last_unstale":"2023-12-22T10:00:33.579099+0000","last_undegraded":"2023-12-22T10:00:33.579099+0000","last_fullsized":"2023-12-22T10:00:33.579099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.567975+0000","last_change":"2023-12-22T10:00:33.559374+0000","last_active":"2023-12-22T10:00:33.567975+0000","last_peered":"2023-12-22T10:00:33.567975+0000","last_clean":"2023-12-22T10:00:33.567975+0000","last_became_active":"2023-12-22T10:00:33.559066+0000","last_became_peered":"2023-12-22T10:00:33.559066+0000","last_unstale":"2023-12-22T10:00:33.567975+0000","last_undegraded":"2023-12-22T10:00:33.567975+0000","last_fullsized":"2023-12-22T10:00:33.567975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.563571+0000","last_change":"2023-12-22T10:00:33.114896+0000","last_active":"2023-12-22T10:00:33.563571+0000","last_peered":"2023-12-22T10:00:33.563571+0000","last_clean":"2023-12-22T10:00:33.563571+0000","last_became_active":"2023-12-22T10:00:33.114585+0000","last_became_peered":"2023-12-22T10:00:33.114585+0000","last_unstale":"2023-12-22T10:00:33.563571+0000","last_undegraded":"2023-12-22T10:00:33.563571+0000","last_fullsized":"2023-12-22T10:00:33.563571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.572121+0000","last_change":"2023-12-22T10:00:33.568325+0000","last_active":"2023-12-22T10:00:33.572121+0000","last_peered":"2023-12-22T10:00:33.572121+0000","last_clean":"2023-12-22T10:00:33.572121+0000","last_became_active":"2023-12-22T10:00:33.568026+0000","last_became_peered":"2023-12-22T10:00:33.568026+0000","last_unstale":"2023-12-22T10:00:33.572121+0000","last_undegraded":"2023-12-22T10:00:33.572121+0000","last_fullsized":"2023-12-22T10:00:33.572121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.553362+0000","last_change":"2023-12-22T10:00:33.108149+0000","last_active":"2023-12-22T10:00:33.553362+0000","last_peered":"2023-12-22T10:00:33.553362+0000","last_clean":"2023-12-22T10:00:33.553362+0000","last_became_active":"2023-12-22T10:00:33.107842+0000","last_became_peered":"2023-12-22T10:00:33.107842+0000","last_unstale":"2023-12-22T10:00:33.553362+0000","last_undegraded":"2023-12-22T10:00:33.553362+0000","last_fullsized":"2023-12-22T10:00:33.553362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.580131+0000","last_change":"2023-12-22T10:00:33.571557+0000","last_active":"2023-12-22T10:00:33.580131+0000","last_peered":"2023-12-22T10:00:33.580131+0000","last_clean":"2023-12-22T10:00:33.580131+0000","last_became_active":"2023-12-22T10:00:33.571220+0000","last_became_peered":"2023-12-22T10:00:33.571220+0000","last_unstale":"2023-12-22T10:00:33.580131+0000","last_undegraded":"2023-12-22T10:00:33.580131+0000","last_fullsized":"2023-12-22T10:00:33.580131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.582666+0000","last_change":"2023-12-22T10:00:33.129657+0000","last_active":"2023-12-22T10:00:33.582666+0000","last_peered":"2023-12-22T10:00:33.582666+0000","last_clean":"2023-12-22T10:00:33.582666+0000","last_became_active":"2023-12-22T10:00:33.129343+0000","last_became_peered":"2023-12-22T10:00:33.129343+0000","last_unstale":"2023-12-22T10:00:33.582666+0000","last_undegraded":"2023-12-22T10:00:33.582666+0000","last_fullsized":"2023-12-22T10:00:33.582666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.564447+0000","last_change":"2023-12-22T10:00:33.560227+0000","last_active":"2023-12-22T10:00:33.564447+0000","last_peered":"2023-12-22T10:00:33.564447+0000","last_clean":"2023-12-22T10:00:33.564447+0000","last_became_active":"2023-12-22T10:00:33.560005+0000","last_became_peered":"2023-12-22T10:00:33.560005+0000","last_unstale":"2023-12-22T10:00:33.564447+0000","last_undegraded":"2023-12-22T10:00:33.564447+0000","last_fullsized":"2023-12-22T10:00:33.564447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.548267+0000","last_change":"2023-12-22T10:00:33.096353+0000","last_active":"2023-12-22T10:00:33.548267+0000","last_peered":"2023-12-22T10:00:33.548267+0000","last_clean":"2023-12-22T10:00:33.548267+0000","last_became_active":"2023-12-22T10:00:33.095756+0000","last_became_peered":"2023-12-22T10:00:33.095756+0000","last_unstale":"2023-12-22T10:00:33.548267+0000","last_undegraded":"2023-12-22T10:00:33.548267+0000","last_fullsized":"2023-12-22T10:00:33.548267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.568251+0000","last_change":"2023-12-22T10:00:33.565765+0000","last_active":"2023-12-22T10:00:33.568251+0000","last_peered":"2023-12-22T10:00:33.568251+0000","last_clean":"2023-12-22T10:00:33.568251+0000","last_became_active":"2023-12-22T10:00:33.565480+0000","last_became_peered":"2023-12-22T10:00:33.565480+0000","last_unstale":"2023-12-22T10:00:33.568251+0000","last_undegraded":"2023-12-22T10:00:33.568251+0000","last_fullsized":"2023-12-22T10:00:33.568251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.33","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.570467+0000","last_change":"2023-12-22T10:00:33.126475+0000","last_active":"2023-12-22T10:00:33.570467+0000","last_peered":"2023-12-22T10:00:33.570467+0000","last_clean":"2023-12-22T10:00:33.570467+0000","last_became_active":"2023-12-22T10:00:33.126160+0000","last_became_peered":"2023-12-22T10:00:33.126160+0000","last_unstale":"2023-12-22T10:00:33.570467+0000","last_undegraded":"2023-12-22T10:00:33.570467+0000","last_fullsized":"2023-12-22T10:00:33.570467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.575581+0000","last_change":"2023-12-22T10:00:33.573494+0000","last_active":"2023-12-22T10:00:33.575581+0000","last_peered":"2023-12-22T10:00:33.575581+0000","last_clean":"2023-12-22T10:00:33.575581+0000","last_became_active":"2023-12-22T10:00:33.573179+0000","last_became_peered":"2023-12-22T10:00:33.573179+0000","last_unstale":"2023-12-22T10:00:33.575581+0000","last_undegraded":"2023-12-22T10:00:33.575581+0000","last_fullsized":"2023-12-22T10:00:33.575581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.34","version":"20'4","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.584940+0000","last_change":"2023-12-22T10:00:33.125144+0000","last_active":"2023-12-22T10:00:33.584940+0000","last_peered":"2023-12-22T10:00:33.584940+0000","last_clean":"2023-12-22T10:00:33.584940+0000","last_became_active":"2023-12-22T10:00:33.124721+0000","last_became_peered":"2023-12-22T10:00:33.124721+0000","last_unstale":"2023-12-22T10:00:33.584940+0000","last_undegraded":"2023-12-22T10:00:33.584940+0000","last_fullsized":"2023-12-22T10:00:33.584940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.574522+0000","last_change":"2023-12-22T10:00:33.569457+0000","last_active":"2023-12-22T10:00:33.574522+0000","last_peered":"2023-12-22T10:00:33.574522+0000","last_clean":"2023-12-22T10:00:33.574522+0000","last_became_active":"2023-12-22T10:00:33.569137+0000","last_became_peered":"2023-12-22T10:00:33.569137+0000","last_unstale":"2023-12-22T10:00:33.574522+0000","last_undegraded":"2023-12-22T10:00:33.574522+0000","last_fullsized":"2023-12-22T10:00:33.574522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.555657+0000","last_change":"2023-12-22T10:00:33.115688+0000","last_active":"2023-12-22T10:00:33.555657+0000","last_peered":"2023-12-22T10:00:33.555657+0000","last_clean":"2023-12-22T10:00:33.555657+0000","last_became_active":"2023-12-22T10:00:33.115458+0000","last_became_peered":"2023-12-22T10:00:33.115458+0000","last_unstale":"2023-12-22T10:00:33.555657+0000","last_undegraded":"2023-12-22T10:00:33.555657+0000","last_fullsized":"2023-12-22T10:00:33.555657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.575066+0000","last_change":"2023-12-22T10:00:33.572218+0000","last_active":"2023-12-22T10:00:33.575066+0000","last_peered":"2023-12-22T10:00:33.575066+0000","last_clean":"2023-12-22T10:00:33.575066+0000","last_became_active":"2023-12-22T10:00:33.571923+0000","last_became_peered":"2023-12-22T10:00:33.571923+0000","last_unstale":"2023-12-22T10:00:33.575066+0000","last_undegraded":"2023-12-22T10:00:33.575066+0000","last_fullsized":"2023-12-22T10:00:33.575066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.552045+0000","last_change":"2023-12-22T10:00:33.122533+0000","last_active":"2023-12-22T10:00:33.552045+0000","last_peered":"2023-12-22T10:00:33.552045+0000","last_clean":"2023-12-22T10:00:33.552045+0000","last_became_active":"2023-12-22T10:00:33.122204+0000","last_became_peered":"2023-12-22T10:00:33.122204+0000","last_unstale":"2023-12-22T10:00:33.552045+0000","last_undegraded":"2023-12-22T10:00:33.552045+0000","last_fullsized":"2023-12-22T10:00:33.552045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.560067+0000","last_change":"2023-12-22T10:00:33.550771+0000","last_active":"2023-12-22T10:00:33.560067+0000","last_peered":"2023-12-22T10:00:33.560067+0000","last_clean":"2023-12-22T10:00:33.560067+0000","last_became_active":"2023-12-22T10:00:33.550449+0000","last_became_peered":"2023-12-22T10:00:33.550449+0000","last_unstale":"2023-12-22T10:00:33.560067+0000","last_undegraded":"2023-12-22T10:00:33.560067+0000","last_fullsized":"2023-12-22T10:00:33.560067+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.536396+0000","last_change":"2023-12-22T10:00:33.122914+0000","last_active":"2023-12-22T10:00:33.536396+0000","last_peered":"2023-12-22T10:00:33.536396+0000","last_clean":"2023-12-22T10:00:33.536396+0000","last_became_active":"2023-12-22T10:00:33.122636+0000","last_became_peered":"2023-12-22T10:00:33.122636+0000","last_unstale":"2023-12-22T10:00:33.536396+0000","last_undegraded":"2023-12-22T10:00:33.536396+0000","last_fullsized":"2023-12-22T10:00:33.536396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.571565+0000","last_change":"2023-12-22T10:00:33.562037+0000","last_active":"2023-12-22T10:00:33.571565+0000","last_peered":"2023-12-22T10:00:33.571565+0000","last_clean":"2023-12-22T10:00:33.571565+0000","last_became_active":"2023-12-22T10:00:33.561795+0000","last_became_peered":"2023-12-22T10:00:33.561795+0000","last_unstale":"2023-12-22T10:00:33.571565+0000","last_undegraded":"2023-12-22T10:00:33.571565+0000","last_fullsized":"2023-12-22T10:00:33.571565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.572601+0000","last_change":"2023-12-22T10:00:33.568975+0000","last_active":"2023-12-22T10:00:33.572601+0000","last_peered":"2023-12-22T10:00:33.572601+0000","last_clean":"2023-12-22T10:00:33.572601+0000","last_became_active":"2023-12-22T10:00:33.568710+0000","last_became_peered":"2023-12-22T10:00:33.568710+0000","last_unstale":"2023-12-22T10:00:33.572601+0000","last_undegraded":"2023-12-22T10:00:33.572601+0000","last_fullsized":"2023-12-22T10:00:33.572601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.557960+0000","last_change":"2023-12-22T10:00:33.106798+0000","last_active":"2023-12-22T10:00:33.557960+0000","last_peered":"2023-12-22T10:00:33.557960+0000","last_clean":"2023-12-22T10:00:33.557960+0000","last_became_active":"2023-12-22T10:00:33.106444+0000","last_became_peered":"2023-12-22T10:00:33.106444+0000","last_unstale":"2023-12-22T10:00:33.557960+0000","last_undegraded":"2023-12-22T10:00:33.557960+0000","last_fullsized":"2023-12-22T10:00:33.557960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.562492+0000","last_change":"2023-12-22T10:00:33.559266+0000","last_active":"2023-12-22T10:00:33.562492+0000","last_peered":"2023-12-22T10:00:33.562492+0000","last_clean":"2023-12-22T10:00:33.562492+0000","last_became_active":"2023-12-22T10:00:33.558860+0000","last_became_peered":"2023-12-22T10:00:33.558860+0000","last_unstale":"2023-12-22T10:00:33.562492+0000","last_undegraded":"2023-12-22T10:00:33.562492+0000","last_fullsized":"2023-12-22T10:00:33.562492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.550181+0000","last_change":"2023-12-22T10:00:33.111950+0000","last_active":"2023-12-22T10:00:33.550181+0000","last_peered":"2023-12-22T10:00:33.550181+0000","last_clean":"2023-12-22T10:00:33.550181+0000","last_became_active":"2023-12-22T10:00:33.111519+0000","last_became_peered":"2023-12-22T10:00:33.111519+0000","last_unstale":"2023-12-22T10:00:33.550181+0000","last_undegraded":"2023-12-22T10:00:33.550181+0000","last_fullsized":"2023-12-22T10:00:33.550181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.581939+0000","last_change":"2023-12-22T10:00:33.579310+0000","last_active":"2023-12-22T10:00:33.581939+0000","last_peered":"2023-12-22T10:00:33.581939+0000","last_clean":"2023-12-22T10:00:33.581939+0000","last_became_active":"2023-12-22T10:00:33.574714+0000","last_became_peered":"2023-12-22T10:00:33.574714+0000","last_unstale":"2023-12-22T10:00:33.581939+0000","last_undegraded":"2023-12-22T10:00:33.581939+0000","last_fullsized":"2023-12-22T10:00:33.581939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.562352+0000","last_change":"2023-12-22T10:00:33.104906+0000","last_active":"2023-12-22T10:00:33.562352+0000","last_peered":"2023-12-22T10:00:33.562352+0000","last_clean":"2023-12-22T10:00:33.562352+0000","last_became_active":"2023-12-22T10:00:33.104018+0000","last_became_peered":"2023-12-22T10:00:33.104018+0000","last_unstale":"2023-12-22T10:00:33.562352+0000","last_undegraded":"2023-12-22T10:00:33.562352+0000","last_fullsized":"2023-12-22T10:00:33.562352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.559924+0000","last_change":"2023-12-22T10:00:33.546434+0000","last_active":"2023-12-22T10:00:33.559924+0000","last_peered":"2023-12-22T10:00:33.559924+0000","last_clean":"2023-12-22T10:00:33.559924+0000","last_became_active":"2023-12-22T10:00:33.546119+0000","last_became_peered":"2023-12-22T10:00:33.546119+0000","last_unstale":"2023-12-22T10:00:33.559924+0000","last_undegraded":"2023-12-22T10:00:33.559924+0000","last_fullsized":"2023-12-22T10:00:33.559924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.580716+0000","last_change":"2023-12-22T10:00:33.124220+0000","last_active":"2023-12-22T10:00:33.580716+0000","last_peered":"2023-12-22T10:00:33.580716+0000","last_clean":"2023-12-22T10:00:33.580716+0000","last_became_active":"2023-12-22T10:00:33.119951+0000","last_became_peered":"2023-12-22T10:00:33.119951+0000","last_unstale":"2023-12-22T10:00:33.580716+0000","last_undegraded":"2023-12-22T10:00:33.580716+0000","last_fullsized":"2023-12-22T10:00:33.580716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.560601+0000","last_change":"2023-12-22T10:00:33.556065+0000","last_active":"2023-12-22T10:00:33.560601+0000","last_peered":"2023-12-22T10:00:33.560601+0000","last_clean":"2023-12-22T10:00:33.560601+0000","last_became_active":"2023-12-22T10:00:33.555696+0000","last_became_peered":"2023-12-22T10:00:33.555696+0000","last_unstale":"2023-12-22T10:00:33.560601+0000","last_undegraded":"2023-12-22T10:00:33.560601+0000","last_fullsized":"2023-12-22T10:00:33.560601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.562529+0000","last_change":"2023-12-22T10:00:33.103404+0000","last_active":"2023-12-22T10:00:33.562529+0000","last_peered":"2023-12-22T10:00:33.562529+0000","last_clean":"2023-12-22T10:00:33.562529+0000","last_became_active":"2023-12-22T10:00:33.103130+0000","last_became_peered":"2023-12-22T10:00:33.103130+0000","last_unstale":"2023-12-22T10:00:33.562529+0000","last_undegraded":"2023-12-22T10:00:33.562529+0000","last_fullsized":"2023-12-22T10:00:33.562529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.579183+0000","last_change":"2023-12-22T10:00:33.569585+0000","last_active":"2023-12-22T10:00:33.579183+0000","last_peered":"2023-12-22T10:00:33.579183+0000","last_clean":"2023-12-22T10:00:33.579183+0000","last_became_active":"2023-12-22T10:00:33.569304+0000","last_became_peered":"2023-12-22T10:00:33.569304+0000","last_unstale":"2023-12-22T10:00:33.579183+0000","last_undegraded":"2023-12-22T10:00:33.579183+0000","last_fullsized":"2023-12-22T10:00:33.579183+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.562974+0000","last_change":"2023-12-22T10:00:33.113160+0000","last_active":"2023-12-22T10:00:33.562974+0000","last_peered":"2023-12-22T10:00:33.562974+0000","last_clean":"2023-12-22T10:00:33.562974+0000","last_became_active":"2023-12-22T10:00:33.112458+0000","last_became_peered":"2023-12-22T10:00:33.112458+0000","last_unstale":"2023-12-22T10:00:33.562974+0000","last_undegraded":"2023-12-22T10:00:33.562974+0000","last_fullsized":"2023-12-22T10:00:33.562974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.580304+0000","last_change":"2023-12-22T10:00:33.574165+0000","last_active":"2023-12-22T10:00:33.580304+0000","last_peered":"2023-12-22T10:00:33.580304+0000","last_clean":"2023-12-22T10:00:33.580304+0000","last_became_active":"2023-12-22T10:00:33.570912+0000","last_became_peered":"2023-12-22T10:00:33.570912+0000","last_unstale":"2023-12-22T10:00:33.580304+0000","last_undegraded":"2023-12-22T10:00:33.580304+0000","last_fullsized":"2023-12-22T10:00:33.580304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.567643+0000","last_change":"2023-12-22T10:00:33.114540+0000","last_active":"2023-12-22T10:00:33.567643+0000","last_peered":"2023-12-22T10:00:33.567643+0000","last_clean":"2023-12-22T10:00:33.567643+0000","last_became_active":"2023-12-22T10:00:33.113955+0000","last_became_peered":"2023-12-22T10:00:33.113955+0000","last_unstale":"2023-12-22T10:00:33.567643+0000","last_undegraded":"2023-12-22T10:00:33.567643+0000","last_fullsized":"2023-12-22T10:00:33.567643+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.544500+0000","last_change":"2023-12-22T10:00:33.540584+0000","last_active":"2023-12-22T10:00:33.544500+0000","last_peered":"2023-12-22T10:00:33.544500+0000","last_clean":"2023-12-22T10:00:33.544500+0000","last_became_active":"2023-12-22T10:00:33.540281+0000","last_became_peered":"2023-12-22T10:00:33.540281+0000","last_unstale":"2023-12-22T10:00:33.544500+0000","last_undegraded":"2023-12-22T10:00:33.544500+0000","last_fullsized":"2023-12-22T10:00:33.544500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:33.066089+0000","last_clean_scrub_stamp":"2023-12-22T10:00:33.066089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"20'3","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-22T10:00:33.581658+0000","last_change":"2023-12-22T10:00:33.113110+0000","last_active":"2023-12-22T10:00:33.581658+0000","last_peered":"2023-12-22T10:00:33.581658+0000","last_clean":"2023-12-22T10:00:33.581658+0000","last_became_active":"2023-12-22T10:00:33.112754+0000","last_became_peered":"2023-12-22T10:00:33.112754+0000","last_unstale":"2023-12-22T10:00:33.581658+0000","last_undegraded":"2023-12-22T10:00:33.581658+0000","last_fullsized":"2023-12-22T10:00:33.581658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:32.051784+0000","last_clean_scrub_stamp":"2023-12-22T10:00:32.051784+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297308,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074532,"statfs":{"total":96636764160,"available":96332320768,"internally_reserved":0,"allocated":217088,"data_stored":80225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1279999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5089999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0309999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.262}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.595}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5780000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.75}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297312,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074528,"statfs":{"total":96636764160,"available":96332316672,"internally_reserved":0,"allocated":221184,"data_stored":80315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.016}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.042}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0880000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1850000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.157}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.196}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297308,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074532,"statfs":{"total":96636764160,"available":96332320768,"internally_reserved":0,"allocated":217088,"data_stored":80225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.288}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.171}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.194}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.25}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4139999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4490000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.516}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297312,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074528,"statfs":{"total":96636764160,"available":96332316672,"internally_reserved":0,"allocated":221184,"data_stored":80295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.01}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.202}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.641}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.593}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.869}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9590000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297328,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074512,"statfs":{"total":96636764160,"available":96332300288,"internally_reserved":0,"allocated":237568,"data_stored":81527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.872}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94199999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.141}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.54}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2370000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.359}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297316,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074524,"statfs":{"total":96636764160,"available":96332312576,"internally_reserved":0,"allocated":225280,"data_stored":80869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.873}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0740000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.333}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.27}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.53}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.278}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297316,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074524,"statfs":{"total":96636764160,"available":96332312576,"internally_reserved":0,"allocated":225280,"data_stored":81139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2629999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.151}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8129999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8779999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.337}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297328,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074512,"statfs":{"total":96636764160,"available":96332300288,"internally_reserved":0,"allocated":237568,"data_stored":81817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.173}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.131}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0009999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4550000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.492}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3620000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-22T10:00:46.681 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-12-22T10:00:46.681 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-12-22T10:00:46.682 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-12-22T10:00:46.682 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-12-22T10:00:46.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.878+0000 7f217d107700 1 Processor -- start 2023-12-22T10:00:46.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.878+0000 7f217d107700 1 -- start start 2023-12-22T10:00:46.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.882+0000 7f217d107700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f21780c6070 0x7f21780aa940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:46.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.882+0000 7f217d107700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21780c0f70 con 0x7f21780c1400 2023-12-22T10:00:46.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.882+0000 7f217d107700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21780aa2b0 con 0x7f21780a9ed0 2023-12-22T10:00:46.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.882+0000 7f217d107700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21780c1860 con 0x7f21780c6070 2023-12-22T10:00:46.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.882+0000 7f216f7fe700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f21780c1400 0x7f21780c5960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59242/0 (socket says 172.21.15.45:59242) 2023-12-22T10:00:46.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.882+0000 7f216f7fe700 1 -- 172.21.15.45:0/2904046750 learned_addr learned my addr 172.21.15.45:0/2904046750 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:00:46.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.882+0000 7f217c906700 1 --2- 172.21.15.45:0/2904046750 >> v2:172.21.15.113:3300/0 conn(0x7f21780c6070 0x7f21780aa940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:46.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.886+0000 7f21777fe700 1 -- 172.21.15.45:0/2904046750 <== mon.1 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2053050886 0 0) 0x7f21780aa2b0 con 0x7f21780a9ed0 2023-12-22T10:00:46.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.886+0000 7f21777fe700 1 -- 172.21.15.45:0/2904046750 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21640033f0 con 0x7f21780a9ed0 2023-12-22T10:00:46.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.886+0000 7f21777fe700 1 -- 172.21.15.45:0/2904046750 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 655326012 0 0) 0x7f21780c0f70 con 0x7f21780c1400 2023-12-22T10:00:46.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.886+0000 7f217c906700 1 -- 172.21.15.45:0/2904046750 >> v1:172.21.15.113:6789/0 conn(0x7f21780a9ed0 legacy=0x7f21780bf910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:46.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.886+0000 7f217c906700 1 -- 172.21.15.45:0/2904046750 >> v1:172.21.15.45:6789/0 conn(0x7f21780c1400 legacy=0x7f21780c5960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:46.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.886+0000 7f217c906700 1 -- 172.21.15.45:0/2904046750 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21780c0360 con 0x7f21780c6070 2023-12-22T10:00:46.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.886+0000 7f217c906700 1 --2- 172.21.15.45:0/2904046750 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f21780c6070 0x7f21780aa940 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f2170009760 tx=0x7f2170009060).ready entity=mon.1 client_cookie=1559e90fae40e62e server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:46.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.886+0000 7f21777fe700 1 -- 172.21.15.45:0/2904046750 <== mon.1 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f217000f510 con 0x7f21780c6070 2023-12-22T10:00:46.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.886+0000 7f21777fe700 1 -- 172.21.15.45:0/2904046750 <== mon.1 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f217000f670 con 0x7f21780c6070 2023-12-22T10:00:46.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.886+0000 7f21777fe700 1 -- 172.21.15.45:0/2904046750 <== mon.1 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f217000f9f0 con 0x7f21780c6070 2023-12-22T10:00:46.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.886+0000 7f217d107700 1 -- 172.21.15.45:0/2904046750 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f21780c6070 msgr2=0x7f21780aa940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:46.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.886+0000 7f217d107700 1 --2- 172.21.15.45:0/2904046750 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f21780c6070 0x7f21780aa940 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f2170009760 tx=0x7f2170009060).stop 2023-12-22T10:00:46.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.886+0000 7f217d107700 1 -- 172.21.15.45:0/2904046750 shutdown_connections 2023-12-22T10:00:46.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.886+0000 7f217d107700 1 --2- 172.21.15.45:0/2904046750 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f21780c6070 0x7f21780aa940 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:46.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.886+0000 7f217d107700 1 -- 172.21.15.45:0/2904046750 >> 172.21.15.45:0/2904046750 conn(0x7f2178067500 msgr2=0x7f21780ca9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:46.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.886+0000 7f217d107700 1 -- 172.21.15.45:0/2904046750 shutdown_connections 2023-12-22T10:00:46.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.886+0000 7f217d107700 1 -- 172.21.15.45:0/2904046750 wait complete. 2023-12-22T10:00:46.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.890+0000 7f217d107700 1 Processor -- start 2023-12-22T10:00:46.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.890+0000 7f217d107700 1 -- start start 2023-12-22T10:00:46.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.890+0000 7f217d107700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f21780a9ed0 0x7f217814c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:46.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.890+0000 7f217d107700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f21780c1400 0x7f2178156550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:46.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.890+0000 7f217d107700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21780c6070 0x7f2178156a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:46.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.890+0000 7f217d107700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2178156f30 con 0x7f21780c6070 2023-12-22T10:00:46.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.890+0000 7f217d107700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2178157130 con 0x7f21780a9ed0 2023-12-22T10:00:46.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.890+0000 7f217d107700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2178157410 con 0x7f21780c1400 2023-12-22T10:00:46.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.890+0000 7f217c906700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21780c6070 0x7f2178156a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:46.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.890+0000 7f217c906700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21780c6070 0x7f2178156a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48540/0 (socket says 172.21.15.45:48540) 2023-12-22T10:00:46.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.890+0000 7f217c906700 1 -- 172.21.15.45:0/291897242 learned_addr learned my addr 172.21.15.45:0/291897242 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:46.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.890+0000 7f216f7fe700 1 --2- 172.21.15.45:0/291897242 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f21780c1400 0x7f2178156550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:46.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.890+0000 7f2177fff700 1 --2- 172.21.15.45:0/291897242 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f21780a9ed0 0x7f217814c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:46.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.894+0000 7f217c906700 1 -- 172.21.15.45:0/291897242 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f21780c1400 msgr2=0x7f2178156550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:46.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.894+0000 7f217c906700 1 --2- 172.21.15.45:0/291897242 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f21780c1400 0x7f2178156550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:46.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.894+0000 7f217c906700 1 -- 172.21.15.45:0/291897242 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f21780a9ed0 msgr2=0x7f217814c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:46.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.894+0000 7f217c906700 1 --2- 172.21.15.45:0/291897242 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f21780a9ed0 0x7f217814c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:46.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.894+0000 7f217c906700 1 -- 172.21.15.45:0/291897242 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21700092a0 con 0x7f21780c6070 2023-12-22T10:00:46.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.894+0000 7f2177fff700 1 --2- 172.21.15.45:0/291897242 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f21780a9ed0 0x7f217814c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-12-22T10:00:46.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.894+0000 7f217c906700 1 --2- 172.21.15.45:0/291897242 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21780c6070 0x7f2178156a40 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f2170009e00 tx=0x7f2170017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:46.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.894+0000 7f2174ff9700 1 -- 172.21.15.45:0/291897242 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f217000f9f0 con 0x7f21780c6070 2023-12-22T10:00:46.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.894+0000 7f2174ff9700 1 -- 172.21.15.45:0/291897242 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f217001b440 con 0x7f21780c6070 2023-12-22T10:00:46.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.894+0000 7f2174ff9700 1 -- 172.21.15.45:0/291897242 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f217001b800 con 0x7f21780c6070 2023-12-22T10:00:46.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.894+0000 7f217d107700 1 -- 172.21.15.45:0/291897242 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21781576f0 con 0x7f21780c6070 2023-12-22T10:00:46.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.894+0000 7f217d107700 1 -- 172.21.15.45:0/291897242 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f217814c8f0 con 0x7f21780c6070 2023-12-22T10:00:46.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.894+0000 7f217d107700 1 -- 172.21.15.45:0/291897242 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21780c2fe0 con 0x7f21780c6070 2023-12-22T10:00:46.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.898+0000 7f2174ff9700 1 -- 172.21.15.45:0/291897242 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f217001bb70 con 0x7f21780c6070 2023-12-22T10:00:46.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.898+0000 7f2174ff9700 1 --2- 172.21.15.45:0/291897242 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f215805a510 0x7f215805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:46.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.898+0000 7f2174ff9700 1 -- 172.21.15.45:0/291897242 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f2170076120 con 0x7f21780c6070 2023-12-22T10:00:46.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.898+0000 7f2177fff700 1 --2- 172.21.15.45:0/291897242 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f215805a510 0x7f215805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:46.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.898+0000 7f2177fff700 1 --2- 172.21.15.45:0/291897242 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f215805a510 0x7f215805c9d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f2168002e40 tx=0x7f2168009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:46.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:46.902+0000 7f2174ff9700 1 -- 172.21.15.45:0/291897242 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f21780c2fe0 con 0x7f21780c6070 2023-12-22T10:00:47.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.106+0000 7f217d107700 1 -- 172.21.15.45:0/291897242 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f21780c2fe0 con 0x7f21780c6070 2023-12-22T10:00:47.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.106+0000 7f2174ff9700 1 -- 172.21.15.45:0/291897242 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+45 (secure 0 0 0) 0x7f21780c2fe0 con 0x7f21780c6070 2023-12-22T10:00:47.104 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:00:47.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.110+0000 7f217d107700 1 -- 172.21.15.45:0/291897242 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f215805a510 msgr2=0x7f215805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:47.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.110+0000 7f217d107700 1 --2- 172.21.15.45:0/291897242 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f215805a510 0x7f215805c9d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f2168002e40 tx=0x7f2168009040).stop 2023-12-22T10:00:47.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.110+0000 7f217d107700 1 -- 172.21.15.45:0/291897242 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21780c6070 msgr2=0x7f2178156a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:47.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.110+0000 7f217d107700 1 --2- 172.21.15.45:0/291897242 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21780c6070 0x7f2178156a40 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f2170009e00 tx=0x7f2170017000).stop 2023-12-22T10:00:47.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.110+0000 7f217d107700 1 -- 172.21.15.45:0/291897242 shutdown_connections 2023-12-22T10:00:47.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.110+0000 7f217d107700 1 --2- 172.21.15.45:0/291897242 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21780c6070 0x7f2178156a40 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:47.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.110+0000 7f217d107700 1 --2- 172.21.15.45:0/291897242 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f215805a510 0x7f215805c9d0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:47.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.110+0000 7f217d107700 1 --2- 172.21.15.45:0/291897242 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f21780c1400 0x7f2178156550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:47.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.110+0000 7f217d107700 1 --2- 172.21.15.45:0/291897242 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f21780a9ed0 0x7f217814c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:47.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.110+0000 7f217d107700 1 -- 172.21.15.45:0/291897242 >> 172.21.15.45:0/291897242 conn(0x7f2178067500 msgr2=0x7f21780ca1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:47.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.110+0000 7f217d107700 1 -- 172.21.15.45:0/291897242 shutdown_connections 2023-12-22T10:00:47.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.110+0000 7f217d107700 1 -- 172.21.15.45:0/291897242 wait complete. 2023-12-22T10:00:47.127 INFO:teuthology.orchestra.run.smithi045.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-12-22T10:00:47.127 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-12-22T10:00:47.127 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T10:00:47.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.298+0000 7f74eba1b700 1 Processor -- start 2023-12-22T10:00:47.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.298+0000 7f74eba1b700 1 -- start start 2023-12-22T10:00:47.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.302+0000 7f74eba1b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f74e4157e10 0x7f74e40c1820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:47.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.302+0000 7f74eba1b700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f74e40c3790 0x7f74e40c1d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:47.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.302+0000 7f74e97b7700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f74e4157e10 0x7f74e40c1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:47.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.302+0000 7f74eba1b700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74e40a68b0 con 0x7f74e41581f0 2023-12-22T10:00:47.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.302+0000 7f74eba1b700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74e4065610 con 0x7f74e4157e10 2023-12-22T10:00:47.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.302+0000 7f74eba1b700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74e40658f0 con 0x7f74e40c3790 2023-12-22T10:00:47.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.302+0000 7f74e97b7700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f74e4157e10 0x7f74e40c1820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48556/0 (socket says 172.21.15.45:48556) 2023-12-22T10:00:47.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.302+0000 7f74e97b7700 1 -- 172.21.15.45:0/2161114672 learned_addr learned my addr 172.21.15.45:0/2161114672 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:47.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.302+0000 7f74e97b7700 1 -- 172.21.15.45:0/2161114672 >> v2:172.21.15.113:3300/0 conn(0x7f74e40c3790 msgr2=0x7f74e40c1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:00:47.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.302+0000 7f74e97b7700 1 --2- 172.21.15.45:0/2161114672 >> v2:172.21.15.113:3300/0 conn(0x7f74e40c3790 0x7f74e40c1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-12-22T10:00:47.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.302+0000 7f74e97b7700 1 -- 172.21.15.45:0/2161114672 >> v1:172.21.15.113:6789/0 conn(0x7f74e41581f0 legacy=0x7f74e40c3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:00:47.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.302+0000 7f74e97b7700 1 -- 172.21.15.45:0/2161114672 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74e4065bd0 con 0x7f74e4157e10 2023-12-22T10:00:47.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.302+0000 7f74e97b7700 1 --2- 172.21.15.45:0/2161114672 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74e4157e10 0x7f74e40c1820 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f74e4047170 tx=0x7f74e00090f0).ready entity=mon.0 client_cookie=b2f409401b493140 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:47.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.302+0000 7f74dbfff700 1 -- 172.21.15.45:0/2161114672 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e000b5a0 con 0x7f74e4157e10 2023-12-22T10:00:47.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.302+0000 7f74dbfff700 1 -- 172.21.15.45:0/2161114672 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74e000b700 con 0x7f74e4157e10 2023-12-22T10:00:47.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.302+0000 7f74dbfff700 1 -- 172.21.15.45:0/2161114672 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e000ba80 con 0x7f74e4157e10 2023-12-22T10:00:47.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.306+0000 7f74eba1b700 1 -- 172.21.15.45:0/2161114672 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74e4157e10 msgr2=0x7f74e40c1820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:47.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.306+0000 7f74eba1b700 1 --2- 172.21.15.45:0/2161114672 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74e4157e10 0x7f74e40c1820 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f74e4047170 tx=0x7f74e00090f0).stop 2023-12-22T10:00:47.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.306+0000 7f74eba1b700 1 -- 172.21.15.45:0/2161114672 shutdown_connections 2023-12-22T10:00:47.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.306+0000 7f74eba1b700 1 --2- 172.21.15.45:0/2161114672 >> v2:172.21.15.113:3300/0 conn(0x7f74e40c3790 0x7f74e40c1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-12-22T10:00:47.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.306+0000 7f74eba1b700 1 --2- 172.21.15.45:0/2161114672 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74e4157e10 0x7f74e40c1820 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:47.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.306+0000 7f74eba1b700 1 -- 172.21.15.45:0/2161114672 >> 172.21.15.45:0/2161114672 conn(0x7f74e4066a70 msgr2=0x7f74e4066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:47.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.306+0000 7f74eba1b700 1 -- 172.21.15.45:0/2161114672 shutdown_connections 2023-12-22T10:00:47.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.306+0000 7f74eba1b700 1 -- 172.21.15.45:0/2161114672 wait complete. 2023-12-22T10:00:47.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.306+0000 7f74eba1b700 1 Processor -- start 2023-12-22T10:00:47.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.306+0000 7f74eba1b700 1 -- start start 2023-12-22T10:00:47.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.310+0000 7f74eba1b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74e40c3790 0x7f74e40bfba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:47.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.310+0000 7f74eba1b700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f74e4157e10 0x7f74e40c50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:47.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.310+0000 7f74eba1b700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f74e41581f0 0x7f74e40c55d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:47.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.310+0000 7f74eba1b700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74e40c5ac0 con 0x7f74e40c3790 2023-12-22T10:00:47.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.310+0000 7f74eba1b700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74e40aade0 con 0x7f74e41581f0 2023-12-22T10:00:47.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.310+0000 7f74eba1b700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74e40a9170 con 0x7f74e4157e10 2023-12-22T10:00:47.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.310+0000 7f74e97b7700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74e40c3790 0x7f74e40bfba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:47.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.310+0000 7f74e97b7700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74e40c3790 0x7f74e40bfba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48562/0 (socket says 172.21.15.45:48562) 2023-12-22T10:00:47.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.310+0000 7f74e97b7700 1 -- 172.21.15.45:0/3656936423 learned_addr learned my addr 172.21.15.45:0/3656936423 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:47.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.310+0000 7f74e8fb6700 1 --2- 172.21.15.45:0/3656936423 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f74e4157e10 0x7f74e40c50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:47.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.310+0000 7f74e9fb8700 1 --2- 172.21.15.45:0/3656936423 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f74e41581f0 0x7f74e40c55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:47.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.310+0000 7f74e97b7700 1 -- 172.21.15.45:0/3656936423 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f74e4157e10 msgr2=0x7f74e40c50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:47.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.310+0000 7f74e97b7700 1 --2- 172.21.15.45:0/3656936423 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f74e4157e10 0x7f74e40c50e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:47.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.310+0000 7f74e97b7700 1 -- 172.21.15.45:0/3656936423 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f74e41581f0 msgr2=0x7f74e40c55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:47.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.310+0000 7f74e97b7700 1 --2- 172.21.15.45:0/3656936423 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f74e41581f0 0x7f74e40c55d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:47.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.310+0000 7f74e97b7700 1 -- 172.21.15.45:0/3656936423 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74e0009370 con 0x7f74e40c3790 2023-12-22T10:00:47.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.310+0000 7f74e97b7700 1 --2- 172.21.15.45:0/3656936423 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74e40c3790 0x7f74e40bfba0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f74e0009130 tx=0x7f74e0015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:47.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.310+0000 7f74d97fa700 1 -- 172.21.15.45:0/3656936423 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e000b870 con 0x7f74e40c3790 2023-12-22T10:00:47.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.310+0000 7f74d97fa700 1 -- 172.21.15.45:0/3656936423 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74e000b9d0 con 0x7f74e40c3790 2023-12-22T10:00:47.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.310+0000 7f74eba1b700 1 -- 172.21.15.45:0/3656936423 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74e40aa7d0 con 0x7f74e40c3790 2023-12-22T10:00:47.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.310+0000 7f74d97fa700 1 -- 172.21.15.45:0/3656936423 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e001a430 con 0x7f74e40c3790 2023-12-22T10:00:47.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.310+0000 7f74eba1b700 1 -- 172.21.15.45:0/3656936423 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74e40aaa70 con 0x7f74e40c3790 2023-12-22T10:00:47.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.314+0000 7f74eba1b700 1 -- 172.21.15.45:0/3656936423 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74e406c070 con 0x7f74e40c3790 2023-12-22T10:00:47.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.314+0000 7f74d97fa700 1 -- 172.21.15.45:0/3656936423 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f74e0021020 con 0x7f74e40c3790 2023-12-22T10:00:47.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.314+0000 7f74d97fa700 1 --2- 172.21.15.45:0/3656936423 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f74c805a510 0x7f74c805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:47.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.314+0000 7f74d97fa700 1 -- 172.21.15.45:0/3656936423 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f74e0075dd0 con 0x7f74e40c3790 2023-12-22T10:00:47.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.314+0000 7f74e8fb6700 1 --2- 172.21.15.45:0/3656936423 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f74c805a510 0x7f74c805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:47.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.314+0000 7f74e8fb6700 1 --2- 172.21.15.45:0/3656936423 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f74c805a510 0x7f74c805c9d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f74e40c5040 tx=0x7f74d4008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:47.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.322+0000 7f74d97fa700 1 -- 172.21.15.45:0/3656936423 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f74e0049650 con 0x7f74e40c3790 2023-12-22T10:00:47.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.486+0000 7f74eba1b700 1 -- 172.21.15.45:0/3656936423 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f74e40c7140 con 0x7f74e40c3790 2023-12-22T10:00:47.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.490+0000 7f74d97fa700 1 -- 172.21.15.45:0/3656936423 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16928 (secure 0 0 0) 0x7f74e0029070 con 0x7f74e40c3790 2023-12-22T10:00:47.487 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:00:47.487 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":21,"fsid":"98b0837e-5e68-4c8f-a1a0-e9424baaad8f","created":"2023-12-22T10:00:15.010174+0000","modified":"2023-12-22T10:00:34.529651+0000","last_up_change":"2023-12-22T10:00:24.980513+0000","last_in_change":"2023-12-22T10:00:17.887172+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-12-22T10:00:25.069641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-12-22T10:00:26.906399+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-12-22T10:00:31.621311+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-12-22T10:00:32.538053+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e19943a0-1c6b-47df-b6bb-383472077890","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":33777},{"type":"v1","addr":"172.21.15.45:6819","nonce":33777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":33777},{"type":"v1","addr":"172.21.15.45:6822","nonce":33777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":33777},{"type":"v1","addr":"172.21.15.45:6830","nonce":33777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":33777},{"type":"v1","addr":"172.21.15.45:6826","nonce":33777}]},"public_addr":"172.21.15.45:6819/33777","cluster_addr":"172.21.15.45:6822/33777","heartbeat_back_addr":"172.21.15.45:6830/33777","heartbeat_front_addr":"172.21.15.45:6826/33777","state":["exists","up"]},{"osd":1,"uuid":"69670f34-f082-45a7-8f67-e962acc136e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":33775},{"type":"v1","addr":"172.21.15.45:6809","nonce":33775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":33775},{"type":"v1","addr":"172.21.15.45:6811","nonce":33775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":33775},{"type":"v1","addr":"172.21.15.45:6815","nonce":33775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":33775},{"type":"v1","addr":"172.21.15.45:6813","nonce":33775}]},"public_addr":"172.21.15.45:6809/33775","cluster_addr":"172.21.15.45:6811/33775","heartbeat_back_addr":"172.21.15.45:6815/33775","heartbeat_front_addr":"172.21.15.45:6813/33775","state":["exists","up"]},{"osd":2,"uuid":"d909d49b-82b8-401b-9947-e49dd167bb95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":33776},{"type":"v1","addr":"172.21.15.45:6801","nonce":33776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":33776},{"type":"v1","addr":"172.21.15.45:6803","nonce":33776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":33776},{"type":"v1","addr":"172.21.15.45:6807","nonce":33776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":33776},{"type":"v1","addr":"172.21.15.45:6805","nonce":33776}]},"public_addr":"172.21.15.45:6801/33776","cluster_addr":"172.21.15.45:6803/33776","heartbeat_back_addr":"172.21.15.45:6807/33776","heartbeat_front_addr":"172.21.15.45:6805/33776","state":["exists","up"]},{"osd":3,"uuid":"db104ca9-3a94-4d39-a2be-bd06db888095","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":33782},{"type":"v1","addr":"172.21.15.45:6817","nonce":33782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":33782},{"type":"v1","addr":"172.21.15.45:6823","nonce":33782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":33782},{"type":"v1","addr":"172.21.15.45:6831","nonce":33782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":33782},{"type":"v1","addr":"172.21.15.45:6827","nonce":33782}]},"public_addr":"172.21.15.45:6817/33782","cluster_addr":"172.21.15.45:6823/33782","heartbeat_back_addr":"172.21.15.45:6831/33782","heartbeat_front_addr":"172.21.15.45:6827/33782","state":["exists","up"]},{"osd":4,"uuid":"9f4eaff4-e433-4479-a0d1-ee7a33375ca6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":34099},{"type":"v1","addr":"172.21.15.113:6811","nonce":34099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":34099},{"type":"v1","addr":"172.21.15.113:6815","nonce":34099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":34099},{"type":"v1","addr":"172.21.15.113:6823","nonce":34099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6816","nonce":34099},{"type":"v1","addr":"172.21.15.113:6818","nonce":34099}]},"public_addr":"172.21.15.113:6811/34099","cluster_addr":"172.21.15.113:6815/34099","heartbeat_back_addr":"172.21.15.113:6823/34099","heartbeat_front_addr":"172.21.15.113:6818/34099","state":["exists","up"]},{"osd":5,"uuid":"1efc5591-180b-43af-8611-0068aadc5aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":34100},{"type":"v1","addr":"172.21.15.113:6801","nonce":34100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":34100},{"type":"v1","addr":"172.21.15.113:6803","nonce":34100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":34100},{"type":"v1","addr":"172.21.15.113:6807","nonce":34100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":34100},{"type":"v1","addr":"172.21.15.113:6805","nonce":34100}]},"public_addr":"172.21.15.113:6801/34100","cluster_addr":"172.21.15.113:6803/34100","heartbeat_back_addr":"172.21.15.113:6807/34100","heartbeat_front_addr":"172.21.15.113:6805/34100","state":["exists","up"]},{"osd":6,"uuid":"6c89d9d8-c153-4a48-afa9-97e4c403f1ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":34101},{"type":"v1","addr":"172.21.15.113:6810","nonce":34101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6812","nonce":34101},{"type":"v1","addr":"172.21.15.113:6814","nonce":34101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6822","nonce":34101},{"type":"v1","addr":"172.21.15.113:6824","nonce":34101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":34101},{"type":"v1","addr":"172.21.15.113:6819","nonce":34101}]},"public_addr":"172.21.15.113:6810/34101","cluster_addr":"172.21.15.113:6814/34101","heartbeat_back_addr":"172.21.15.113:6824/34101","heartbeat_front_addr":"172.21.15.113:6819/34101","state":["exists","up"]},{"osd":7,"uuid":"1855e70c-23f6-4c08-ad7f-774c2148235b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6821","nonce":34102},{"type":"v1","addr":"172.21.15.113:6825","nonce":34102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":34102},{"type":"v1","addr":"172.21.15.113:6827","nonce":34102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":34102},{"type":"v1","addr":"172.21.15.113:6831","nonce":34102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6828","nonce":34102},{"type":"v1","addr":"172.21.15.113:6829","nonce":34102}]},"public_addr":"172.21.15.113:6825/34102","cluster_addr":"172.21.15.113:6827/34102","heartbeat_back_addr":"172.21.15.113:6831/34102","heartbeat_front_addr":"172.21.15.113:6829/34102","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.812672+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.825045+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.700105+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.856563+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.954683+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.883234+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.883994+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.821686+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T10:00:47.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.490+0000 7f74eba1b700 1 -- 172.21.15.45:0/3656936423 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f74c805a510 msgr2=0x7f74c805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:47.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.490+0000 7f74eba1b700 1 --2- 172.21.15.45:0/3656936423 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f74c805a510 0x7f74c805c9d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f74e40c5040 tx=0x7f74d4008040).stop 2023-12-22T10:00:47.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.494+0000 7f74eba1b700 1 -- 172.21.15.45:0/3656936423 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74e40c3790 msgr2=0x7f74e40bfba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:47.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.494+0000 7f74eba1b700 1 --2- 172.21.15.45:0/3656936423 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74e40c3790 0x7f74e40bfba0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f74e0009130 tx=0x7f74e0015000).stop 2023-12-22T10:00:47.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.494+0000 7f74eba1b700 1 -- 172.21.15.45:0/3656936423 shutdown_connections 2023-12-22T10:00:47.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.494+0000 7f74eba1b700 1 --2- 172.21.15.45:0/3656936423 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f74e41581f0 0x7f74e40c55d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:47.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.494+0000 7f74eba1b700 1 --2- 172.21.15.45:0/3656936423 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f74c805a510 0x7f74c805c9d0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:47.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.494+0000 7f74eba1b700 1 --2- 172.21.15.45:0/3656936423 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f74e4157e10 0x7f74e40c50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:47.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.494+0000 7f74eba1b700 1 --2- 172.21.15.45:0/3656936423 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74e40c3790 0x7f74e40bfba0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:47.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.494+0000 7f74eba1b700 1 -- 172.21.15.45:0/3656936423 >> 172.21.15.45:0/3656936423 conn(0x7f74e4066a70 msgr2=0x7f74e40c5cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:47.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.494+0000 7f74eba1b700 1 -- 172.21.15.45:0/3656936423 shutdown_connections 2023-12-22T10:00:47.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.494+0000 7f74eba1b700 1 -- 172.21.15.45:0/3656936423 wait complete. 2023-12-22T10:00:47.510 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-12-22T10:00:25.069641+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-12-22T10:00:26.906399+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-22T10:00:31.621311+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-12-22T10:00:32.538053+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-22T10:00:47.510 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-12-22T10:00:47.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.682+0000 7f0c28c9b700 1 Processor -- start 2023-12-22T10:00:47.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.682+0000 7f0c28c9b700 1 -- start start 2023-12-22T10:00:47.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.686+0000 7f0c28c9b700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f0c240ac0e0 0x7f0c240a7050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:47.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.686+0000 7f0c28c9b700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f0c240ac4c0 0x7f0c24155660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:47.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.686+0000 7f0c28c9b700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c241521b0 con 0x7f0c24155b50 2023-12-22T10:00:47.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.686+0000 7f0c28c9b700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c24151fa0 con 0x7f0c240ac4c0 2023-12-22T10:00:47.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.686+0000 7f0c28c9b700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c240c36e0 con 0x7f0c240ac0e0 2023-12-22T10:00:47.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.686+0000 7f0c22d9d700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f0c24155b50 0x7f0c240a5890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59256/0 (socket says 172.21.15.45:59256) 2023-12-22T10:00:47.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.686+0000 7f0c22d9d700 1 -- 172.21.15.45:0/1717409670 learned_addr learned my addr 172.21.15.45:0/1717409670 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:00:47.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.686+0000 7f0c1bfff700 1 --2- 172.21.15.45:0/1717409670 >> v2:172.21.15.113:3300/0 conn(0x7f0c240ac4c0 0x7f0c24155660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:47.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.686+0000 7f0c2259c700 1 --2- 172.21.15.45:0/1717409670 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f0c240ac0e0 0x7f0c240a7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:47.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.686+0000 7f0c2259c700 1 -- 172.21.15.45:0/1717409670 >> v2:172.21.15.113:3300/0 conn(0x7f0c240ac4c0 msgr2=0x7f0c24155660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:00:47.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.686+0000 7f0c2259c700 1 --2- 172.21.15.45:0/1717409670 >> v2:172.21.15.113:3300/0 conn(0x7f0c240ac4c0 0x7f0c24155660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:47.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.686+0000 7f0c2259c700 1 -- 172.21.15.45:0/1717409670 >> v1:172.21.15.45:6789/0 conn(0x7f0c24155b50 legacy=0x7f0c240a5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:47.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.686+0000 7f0c2259c700 1 -- 172.21.15.45:0/1717409670 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c240c39c0 con 0x7f0c240ac0e0 2023-12-22T10:00:47.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.686+0000 7f0c21d9b700 1 -- 172.21.15.45:0/1717409670 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2130207699 0 0) 0x7f0c241521b0 con 0x7f0c24155b50 2023-12-22T10:00:47.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.686+0000 7f0c2259c700 1 --2- 172.21.15.45:0/1717409670 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f0c240ac0e0 0x7f0c240a7050 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f0c14009760 tx=0x7f0c14009060).ready entity=mon.2 client_cookie=62f55e3caa27e0bd server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:47.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.686+0000 7f0c21d9b700 1 -- 172.21.15.45:0/1717409670 <== mon.2 v2:172.21.15.113:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c1400f510 con 0x7f0c240ac0e0 2023-12-22T10:00:47.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.686+0000 7f0c21d9b700 1 -- 172.21.15.45:0/1717409670 <== mon.2 v2:172.21.15.113:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c1400f670 con 0x7f0c240ac0e0 2023-12-22T10:00:47.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.686+0000 7f0c21d9b700 1 -- 172.21.15.45:0/1717409670 <== mon.2 v2:172.21.15.113:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c1400f9f0 con 0x7f0c240ac0e0 2023-12-22T10:00:47.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.690+0000 7f0c28c9b700 1 -- 172.21.15.45:0/1717409670 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f0c240ac0e0 msgr2=0x7f0c240a7050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:47.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.690+0000 7f0c28c9b700 1 --2- 172.21.15.45:0/1717409670 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f0c240ac0e0 0x7f0c240a7050 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f0c14009760 tx=0x7f0c14009060).stop 2023-12-22T10:00:47.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.690+0000 7f0c28c9b700 1 -- 172.21.15.45:0/1717409670 shutdown_connections 2023-12-22T10:00:47.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.690+0000 7f0c28c9b700 1 --2- 172.21.15.45:0/1717409670 >> v2:172.21.15.113:3300/0 conn(0x7f0c240ac4c0 0x7f0c24155660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:47.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.690+0000 7f0c28c9b700 1 --2- 172.21.15.45:0/1717409670 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f0c240ac0e0 0x7f0c240a7050 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:47.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.690+0000 7f0c28c9b700 1 -- 172.21.15.45:0/1717409670 >> 172.21.15.45:0/1717409670 conn(0x7f0c24066a70 msgr2=0x7f0c24066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:47.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.690+0000 7f0c28c9b700 1 -- 172.21.15.45:0/1717409670 shutdown_connections 2023-12-22T10:00:47.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.690+0000 7f0c28c9b700 1 -- 172.21.15.45:0/1717409670 wait complete. 2023-12-22T10:00:47.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.690+0000 7f0c28c9b700 1 Processor -- start 2023-12-22T10:00:47.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.690+0000 7f0c28c9b700 1 -- start start 2023-12-22T10:00:47.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.694+0000 7f0c28c9b700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f0c240ac0e0 0x7f0c241421a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:47.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.694+0000 7f0c28c9b700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0c24155b50 0x7f0c240c49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:47.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.694+0000 7f0c28c9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c240c4ed0 0x7f0c240a9db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:47.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.694+0000 7f0c28c9b700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c240c53c0 con 0x7f0c240c4ed0 2023-12-22T10:00:47.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.694+0000 7f0c28c9b700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c240c56a0 con 0x7f0c24155b50 2023-12-22T10:00:47.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.694+0000 7f0c28c9b700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c240c5980 con 0x7f0c240ac0e0 2023-12-22T10:00:47.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.694+0000 7f0c22d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c240c4ed0 0x7f0c240a9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:47.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.694+0000 7f0c22d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c240c4ed0 0x7f0c240a9db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48578/0 (socket says 172.21.15.45:48578) 2023-12-22T10:00:47.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.694+0000 7f0c22d9d700 1 -- 172.21.15.45:0/517044907 learned_addr learned my addr 172.21.15.45:0/517044907 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:47.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.694+0000 7f0c2259c700 1 --2- 172.21.15.45:0/517044907 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f0c240ac0e0 0x7f0c241421a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:47.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.694+0000 7f0c1bfff700 1 --2- 172.21.15.45:0/517044907 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0c24155b50 0x7f0c240c49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:47.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.694+0000 7f0c22d9d700 1 -- 172.21.15.45:0/517044907 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f0c240ac0e0 msgr2=0x7f0c241421a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:47.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.694+0000 7f0c22d9d700 1 --2- 172.21.15.45:0/517044907 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f0c240ac0e0 0x7f0c241421a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:47.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.694+0000 7f0c22d9d700 1 -- 172.21.15.45:0/517044907 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0c24155b50 msgr2=0x7f0c240c49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:47.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.694+0000 7f0c22d9d700 1 --2- 172.21.15.45:0/517044907 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0c24155b50 0x7f0c240c49e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:47.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.694+0000 7f0c22d9d700 1 -- 172.21.15.45:0/517044907 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c140092a0 con 0x7f0c240c4ed0 2023-12-22T10:00:47.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.694+0000 7f0c22d9d700 1 --2- 172.21.15.45:0/517044907 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c240c4ed0 0x7f0c240a9db0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f0c1c00c810 tx=0x7f0c1c0014d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:47.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.694+0000 7f0c1a7fc700 1 -- 172.21.15.45:0/517044907 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c1c005d30 con 0x7f0c240c4ed0 2023-12-22T10:00:47.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.694+0000 7f0c1a7fc700 1 -- 172.21.15.45:0/517044907 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c1c005e90 con 0x7f0c240c4ed0 2023-12-22T10:00:47.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.694+0000 7f0c1a7fc700 1 -- 172.21.15.45:0/517044907 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c1c007300 con 0x7f0c240c4ed0 2023-12-22T10:00:47.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.694+0000 7f0c28c9b700 1 -- 172.21.15.45:0/517044907 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c240c5c60 con 0x7f0c240c4ed0 2023-12-22T10:00:47.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.694+0000 7f0c28c9b700 1 -- 172.21.15.45:0/517044907 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c24142de0 con 0x7f0c240c4ed0 2023-12-22T10:00:47.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.698+0000 7f0c28c9b700 1 -- 172.21.15.45:0/517044907 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c2406c070 con 0x7f0c240c4ed0 2023-12-22T10:00:47.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.698+0000 7f0c1a7fc700 1 -- 172.21.15.45:0/517044907 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f0c1c0076b0 con 0x7f0c240c4ed0 2023-12-22T10:00:47.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.698+0000 7f0c1a7fc700 1 --2- 172.21.15.45:0/517044907 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f0c0405a510 0x7f0c0405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:47.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.698+0000 7f0c1a7fc700 1 -- 172.21.15.45:0/517044907 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f0c1c074240 con 0x7f0c240c4ed0 2023-12-22T10:00:47.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.698+0000 7f0c2259c700 1 --2- 172.21.15.45:0/517044907 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f0c0405a510 0x7f0c0405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:47.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.702+0000 7f0c2259c700 1 --2- 172.21.15.45:0/517044907 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f0c0405a510 0x7f0c0405c9d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f0c14009fd0 tx=0x7f0c14017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:47.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.706+0000 7f0c1a7fc700 1 -- 172.21.15.45:0/517044907 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f0c1c047960 con 0x7f0c240c4ed0 2023-12-22T10:00:47.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.874+0000 7f0c28c9b700 1 -- 172.21.15.45:0/517044907 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f0c24067660 con 0x7f0c240c4ed0 2023-12-22T10:00:47.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.874+0000 7f0c1a7fc700 1 -- 172.21.15.45:0/517044907 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v21) v1 ==== 110+0+10 (secure 0 0 0) 0x7f0c1c04af80 con 0x7f0c240c4ed0 2023-12-22T10:00:47.872 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-12-22T10:00:47.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.878+0000 7f0c28c9b700 1 -- 172.21.15.45:0/517044907 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f0c0405a510 msgr2=0x7f0c0405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:47.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.878+0000 7f0c28c9b700 1 --2- 172.21.15.45:0/517044907 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f0c0405a510 0x7f0c0405c9d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f0c14009fd0 tx=0x7f0c14017000).stop 2023-12-22T10:00:47.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.878+0000 7f0c28c9b700 1 -- 172.21.15.45:0/517044907 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c240c4ed0 msgr2=0x7f0c240a9db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:47.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.878+0000 7f0c28c9b700 1 --2- 172.21.15.45:0/517044907 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c240c4ed0 0x7f0c240a9db0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f0c1c00c810 tx=0x7f0c1c0014d0).stop 2023-12-22T10:00:47.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.878+0000 7f0c28c9b700 1 -- 172.21.15.45:0/517044907 shutdown_connections 2023-12-22T10:00:47.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.878+0000 7f0c28c9b700 1 --2- 172.21.15.45:0/517044907 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c240c4ed0 0x7f0c240a9db0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:47.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.878+0000 7f0c28c9b700 1 --2- 172.21.15.45:0/517044907 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0c24155b50 0x7f0c240c49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:47.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.878+0000 7f0c28c9b700 1 --2- 172.21.15.45:0/517044907 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f0c0405a510 0x7f0c0405c9d0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:47.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.878+0000 7f0c28c9b700 1 --2- 172.21.15.45:0/517044907 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f0c240ac0e0 0x7f0c241421a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:47.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.878+0000 7f0c28c9b700 1 -- 172.21.15.45:0/517044907 >> 172.21.15.45:0/517044907 conn(0x7f0c24066a70 msgr2=0x7f0c240a8b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:47.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.878+0000 7f0c28c9b700 1 -- 172.21.15.45:0/517044907 shutdown_connections 2023-12-22T10:00:47.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:47.878+0000 7f0c28c9b700 1 -- 172.21.15.45:0/517044907 wait complete. 2023-12-22T10:00:47.895 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-12-22T10:00:48.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.074+0000 7f245f7db700 1 Processor -- start 2023-12-22T10:00:48.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.074+0000 7f245f7db700 1 -- start start 2023-12-22T10:00:48.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.078+0000 7f245f7db700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f24580ac2d0 0x7f24580c5900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:48.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.078+0000 7f245f7db700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f24580ac6b0 0x7f24580aa660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:48.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.078+0000 7f245f7db700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24580c8d50 con 0x7f2458158050 2023-12-22T10:00:48.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.078+0000 7f245f7db700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24580c95f0 con 0x7f24580ac2d0 2023-12-22T10:00:48.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.078+0000 7f245f7db700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24580aab50 con 0x7f24580ac6b0 2023-12-22T10:00:48.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.078+0000 7f245dd78700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f2458158050 0x7f24580c7430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:37102/0 (socket says 172.21.15.45:37102) 2023-12-22T10:00:48.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.078+0000 7f245dd78700 1 -- 172.21.15.45:0/3725282481 learned_addr learned my addr 172.21.15.45:0/3725282481 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:00:48.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.078+0000 7f245d577700 1 --2- 172.21.15.45:0/3725282481 >> v2:172.21.15.113:3300/0 conn(0x7f24580ac2d0 0x7f24580c5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:48.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.078+0000 7f245cd76700 1 --2- 172.21.15.45:0/3725282481 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f24580ac6b0 0x7f24580aa660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:48.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.078+0000 7f244ffff700 1 -- 172.21.15.45:0/3725282481 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 573662353 0 0) 0x7f24580c8d50 con 0x7f2458158050 2023-12-22T10:00:48.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.078+0000 7f244ffff700 1 -- 172.21.15.45:0/3725282481 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24440033f0 con 0x7f2458158050 2023-12-22T10:00:48.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.078+0000 7f245d577700 1 -- 172.21.15.45:0/3725282481 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f24580ac6b0 msgr2=0x7f24580aa660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:00:48.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.078+0000 7f245d577700 1 --2- 172.21.15.45:0/3725282481 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f24580ac6b0 0x7f24580aa660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:48.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.078+0000 7f245d577700 1 -- 172.21.15.45:0/3725282481 >> v1:172.21.15.45:6789/0 conn(0x7f2458158050 legacy=0x7f24580c7430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:48.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.078+0000 7f245d577700 1 -- 172.21.15.45:0/3725282481 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24580acb10 con 0x7f24580ac2d0 2023-12-22T10:00:48.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.078+0000 7f245d577700 1 --2- 172.21.15.45:0/3725282481 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f24580ac2d0 0x7f24580c5900 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f2454009760 tx=0x7f2454009060).ready entity=mon.1 client_cookie=4628b02c99eb00ed server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:48.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.082+0000 7f244ffff700 1 -- 172.21.15.45:0/3725282481 <== mon.1 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f245400d4a0 con 0x7f24580ac2d0 2023-12-22T10:00:48.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.082+0000 7f244ffff700 1 -- 172.21.15.45:0/3725282481 <== mon.1 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f245400d600 con 0x7f24580ac2d0 2023-12-22T10:00:48.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.082+0000 7f244ffff700 1 -- 172.21.15.45:0/3725282481 <== mon.1 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f245400d980 con 0x7f24580ac2d0 2023-12-22T10:00:48.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.082+0000 7f245f7db700 1 -- 172.21.15.45:0/3725282481 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f24580ac2d0 msgr2=0x7f24580c5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:48.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.082+0000 7f245f7db700 1 --2- 172.21.15.45:0/3725282481 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f24580ac2d0 0x7f24580c5900 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f2454009760 tx=0x7f2454009060).stop 2023-12-22T10:00:48.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.082+0000 7f245f7db700 1 -- 172.21.15.45:0/3725282481 shutdown_connections 2023-12-22T10:00:48.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.082+0000 7f245f7db700 1 --2- 172.21.15.45:0/3725282481 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f24580ac6b0 0x7f24580aa660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:48.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.082+0000 7f245f7db700 1 --2- 172.21.15.45:0/3725282481 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f24580ac2d0 0x7f24580c5900 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:48.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.082+0000 7f245f7db700 1 -- 172.21.15.45:0/3725282481 >> 172.21.15.45:0/3725282481 conn(0x7f2458082a50 msgr2=0x7f2458066a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:48.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.082+0000 7f245f7db700 1 -- 172.21.15.45:0/3725282481 shutdown_connections 2023-12-22T10:00:48.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.082+0000 7f245f7db700 1 -- 172.21.15.45:0/3725282481 wait complete. 2023-12-22T10:00:48.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.086+0000 7f245f7db700 1 Processor -- start 2023-12-22T10:00:48.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.086+0000 7f245f7db700 1 -- start start 2023-12-22T10:00:48.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.086+0000 7f245f7db700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f24580ac2d0 0x7f2458155180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:48.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.086+0000 7f245f7db700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f24580ac6b0 0x7f24580c24b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:48.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.086+0000 7f245f7db700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2458158050 0x7f2458145360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:48.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.086+0000 7f245f7db700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24580c52b0 con 0x7f2458158050 2023-12-22T10:00:48.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.086+0000 7f245f7db700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2458155a50 con 0x7f24580ac6b0 2023-12-22T10:00:48.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.086+0000 7f245f7db700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2458163c50 con 0x7f24580ac2d0 2023-12-22T10:00:48.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.086+0000 7f245dd78700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2458158050 0x7f2458145360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:48.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.086+0000 7f245dd78700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2458158050 0x7f2458145360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34492/0 (socket says 172.21.15.45:34492) 2023-12-22T10:00:48.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.086+0000 7f245dd78700 1 -- 172.21.15.45:0/1546583099 learned_addr learned my addr 172.21.15.45:0/1546583099 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:48.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.086+0000 7f245cd76700 1 --2- 172.21.15.45:0/1546583099 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f24580ac6b0 0x7f24580c24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:48.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.086+0000 7f245d577700 1 --2- 172.21.15.45:0/1546583099 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f24580ac2d0 0x7f2458155180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:48.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.086+0000 7f245dd78700 1 -- 172.21.15.45:0/1546583099 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f24580ac2d0 msgr2=0x7f2458155180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:48.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.086+0000 7f245dd78700 1 --2- 172.21.15.45:0/1546583099 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f24580ac2d0 0x7f2458155180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:48.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.086+0000 7f245dd78700 1 -- 172.21.15.45:0/1546583099 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f24580ac6b0 msgr2=0x7f24580c24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:48.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.086+0000 7f245dd78700 1 --2- 172.21.15.45:0/1546583099 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f24580ac6b0 0x7f24580c24b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:48.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.086+0000 7f245dd78700 1 -- 172.21.15.45:0/1546583099 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24540092a0 con 0x7f2458158050 2023-12-22T10:00:48.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.086+0000 7f245d577700 1 --2- 172.21.15.45:0/1546583099 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f24580ac2d0 0x7f2458155180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T10:00:48.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.086+0000 7f245dd78700 1 --2- 172.21.15.45:0/1546583099 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2458158050 0x7f2458145360 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f2450001460 tx=0x7f2450001650).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:48.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.090+0000 7f244d7fa700 1 -- 172.21.15.45:0/1546583099 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2450005d30 con 0x7f2458158050 2023-12-22T10:00:48.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.090+0000 7f244d7fa700 1 -- 172.21.15.45:0/1546583099 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2450005e90 con 0x7f2458158050 2023-12-22T10:00:48.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.090+0000 7f244d7fa700 1 -- 172.21.15.45:0/1546583099 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2450007320 con 0x7f2458158050 2023-12-22T10:00:48.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.090+0000 7f245f7db700 1 -- 172.21.15.45:0/1546583099 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24580c2c40 con 0x7f2458158050 2023-12-22T10:00:48.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.090+0000 7f245f7db700 1 -- 172.21.15.45:0/1546583099 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24580c4cf0 con 0x7f2458158050 2023-12-22T10:00:48.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.090+0000 7f245f7db700 1 -- 172.21.15.45:0/1546583099 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24581557b0 con 0x7f2458158050 2023-12-22T10:00:48.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.090+0000 7f244d7fa700 1 -- 172.21.15.45:0/1546583099 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f2450007710 con 0x7f2458158050 2023-12-22T10:00:48.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.094+0000 7f244d7fa700 1 --2- 172.21.15.45:0/1546583099 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f243c05a510 0x7f243c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:48.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.094+0000 7f244d7fa700 1 -- 172.21.15.45:0/1546583099 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f2450074870 con 0x7f2458158050 2023-12-22T10:00:48.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.094+0000 7f245d577700 1 --2- 172.21.15.45:0/1546583099 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f243c05a510 0x7f243c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:48.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.094+0000 7f245d577700 1 --2- 172.21.15.45:0/1546583099 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f243c05a510 0x7f243c05c9d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f245400d260 tx=0x7f2454016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:48.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.102+0000 7f244d7fa700 1 -- 172.21.15.45:0/1546583099 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f24581557b0 con 0x7f2458158050 2023-12-22T10:00:48.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.266+0000 7f245f7db700 1 -- 172.21.15.45:0/1546583099 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2458155b90 con 0x7f2458158050 2023-12-22T10:00:48.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.266+0000 7f244d7fa700 1 -- 172.21.15.45:0/1546583099 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2458155b90 con 0x7f2458158050 2023-12-22T10:00:48.263 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-12-22T10:00:48.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.270+0000 7f245f7db700 1 -- 172.21.15.45:0/1546583099 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f243c05a510 msgr2=0x7f243c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:48.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.270+0000 7f245f7db700 1 --2- 172.21.15.45:0/1546583099 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f243c05a510 0x7f243c05c9d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f245400d260 tx=0x7f2454016000).stop 2023-12-22T10:00:48.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.270+0000 7f245f7db700 1 -- 172.21.15.45:0/1546583099 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2458158050 msgr2=0x7f2458145360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:48.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.270+0000 7f245f7db700 1 --2- 172.21.15.45:0/1546583099 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2458158050 0x7f2458145360 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f2450001460 tx=0x7f2450001650).stop 2023-12-22T10:00:48.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.270+0000 7f245f7db700 1 -- 172.21.15.45:0/1546583099 shutdown_connections 2023-12-22T10:00:48.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.270+0000 7f245f7db700 1 --2- 172.21.15.45:0/1546583099 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2458158050 0x7f2458145360 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:48.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.270+0000 7f245f7db700 1 --2- 172.21.15.45:0/1546583099 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f24580ac6b0 0x7f24580c24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:48.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.270+0000 7f245f7db700 1 --2- 172.21.15.45:0/1546583099 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f243c05a510 0x7f243c05c9d0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:48.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.270+0000 7f245f7db700 1 --2- 172.21.15.45:0/1546583099 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f24580ac2d0 0x7f2458155180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:48.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.270+0000 7f245f7db700 1 -- 172.21.15.45:0/1546583099 >> 172.21.15.45:0/1546583099 conn(0x7f2458082a50 msgr2=0x7f2458153610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:48.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.270+0000 7f245f7db700 1 -- 172.21.15.45:0/1546583099 shutdown_connections 2023-12-22T10:00:48.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.270+0000 7f245f7db700 1 -- 172.21.15.45:0/1546583099 wait complete. 2023-12-22T10:00:48.288 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-22T10:00:48.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.462+0000 7f7a6759e700 1 Processor -- start 2023-12-22T10:00:48.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.462+0000 7f7a6759e700 1 -- start start 2023-12-22T10:00:48.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.462+0000 7f7a6759e700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7a680691c0 0x7f7a680ad080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:48.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.462+0000 7f7a6759e700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7a680c9d20 0x7f7a680c97e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:48.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.462+0000 7f7a6759e700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a680c5810 con 0x7f7a680acca0 2023-12-22T10:00:48.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.462+0000 7f7a6759e700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a680c8d90 con 0x7f7a680c9d20 2023-12-22T10:00:48.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.462+0000 7f7a6759e700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a680c9350 con 0x7f7a680691c0 2023-12-22T10:00:48.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.462+0000 7f7a6659c700 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f7a680acca0 0x7f7a68068ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.45:53410/0 (socket says 172.21.15.45:53410) 2023-12-22T10:00:48.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.462+0000 7f7a6659c700 1 -- 172.21.15.45:0/389414178 learned_addr learned my addr 172.21.15.45:0/389414178 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:00:48.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.462+0000 7f7a65d9b700 1 --2- 172.21.15.45:0/389414178 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7a680691c0 0x7f7a680ad080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:48.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.462+0000 7f7a66d9d700 1 --2- 172.21.15.45:0/389414178 >> v2:172.21.15.45:3300/0 conn(0x7f7a680c9d20 0x7f7a680c97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:48.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.466+0000 7f7a6559a700 1 -- 172.21.15.45:0/389414178 <== mon.1 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 289989296 0 0) 0x7f7a680c5810 con 0x7f7a680acca0 2023-12-22T10:00:48.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.466+0000 7f7a6559a700 1 -- 172.21.15.45:0/389414178 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a500033f0 con 0x7f7a680acca0 2023-12-22T10:00:48.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.466+0000 7f7a65d9b700 1 -- 172.21.15.45:0/389414178 >> v2:172.21.15.45:3300/0 conn(0x7f7a680c9d20 msgr2=0x7f7a680c97e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:00:48.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.466+0000 7f7a65d9b700 1 --2- 172.21.15.45:0/389414178 >> v2:172.21.15.45:3300/0 conn(0x7f7a680c9d20 0x7f7a680c97e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:48.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.466+0000 7f7a65d9b700 1 -- 172.21.15.45:0/389414178 >> v1:172.21.15.113:6789/0 conn(0x7f7a680acca0 legacy=0x7f7a68068ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:48.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.466+0000 7f7a65d9b700 1 -- 172.21.15.45:0/389414178 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a68154070 con 0x7f7a680691c0 2023-12-22T10:00:48.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.466+0000 7f7a66d9d700 1 --2- 172.21.15.45:0/389414178 >> v2:172.21.15.45:3300/0 conn(0x7f7a680c9d20 0x7f7a680c97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T10:00:48.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.466+0000 7f7a65d9b700 1 --2- 172.21.15.45:0/389414178 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7a680691c0 0x7f7a680ad080 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f7a5c009760 tx=0x7f7a5c009060).ready entity=mon.2 client_cookie=86bb159a2e246242 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:48.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.466+0000 7f7a6559a700 1 -- 172.21.15.45:0/389414178 <== mon.2 v2:172.21.15.113:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a5c00f510 con 0x7f7a680691c0 2023-12-22T10:00:48.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.466+0000 7f7a6559a700 1 -- 172.21.15.45:0/389414178 <== mon.2 v2:172.21.15.113:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a5c00f670 con 0x7f7a680691c0 2023-12-22T10:00:48.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.466+0000 7f7a6559a700 1 -- 172.21.15.45:0/389414178 <== mon.2 v2:172.21.15.113:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a5c00f9f0 con 0x7f7a680691c0 2023-12-22T10:00:48.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.466+0000 7f7a6759e700 1 -- 172.21.15.45:0/389414178 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7a680691c0 msgr2=0x7f7a680ad080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:48.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.466+0000 7f7a6759e700 1 --2- 172.21.15.45:0/389414178 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7a680691c0 0x7f7a680ad080 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f7a5c009760 tx=0x7f7a5c009060).stop 2023-12-22T10:00:48.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.466+0000 7f7a6759e700 1 -- 172.21.15.45:0/389414178 shutdown_connections 2023-12-22T10:00:48.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.466+0000 7f7a6759e700 1 --2- 172.21.15.45:0/389414178 >> v2:172.21.15.45:3300/0 conn(0x7f7a680c9d20 0x7f7a680c97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:48.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.466+0000 7f7a6759e700 1 --2- 172.21.15.45:0/389414178 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7a680691c0 0x7f7a680ad080 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:48.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.466+0000 7f7a6759e700 1 -- 172.21.15.45:0/389414178 >> 172.21.15.45:0/389414178 conn(0x7f7a680674f0 msgr2=0x7f7a680ca820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:48.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.466+0000 7f7a6759e700 1 -- 172.21.15.45:0/389414178 shutdown_connections 2023-12-22T10:00:48.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.466+0000 7f7a6759e700 1 -- 172.21.15.45:0/389414178 wait complete. 2023-12-22T10:00:48.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.470+0000 7f7a6759e700 1 Processor -- start 2023-12-22T10:00:48.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.470+0000 7f7a6759e700 1 -- start start 2023-12-22T10:00:48.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.474+0000 7f7a6759e700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7a680691c0 0x7f7a680ae510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:48.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.474+0000 7f7a6759e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7a680acca0 0x7f7a68142000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:48.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.474+0000 7f7a6759e700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7a680c9d20 0x7f7a68167800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:48.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.474+0000 7f7a6759e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a680af970 con 0x7f7a680acca0 2023-12-22T10:00:48.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.474+0000 7f7a6759e700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a680aed60 con 0x7f7a680c9d20 2023-12-22T10:00:48.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.474+0000 7f7a6759e700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a680af040 con 0x7f7a680691c0 2023-12-22T10:00:48.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.474+0000 7f7a65d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7a680acca0 0x7f7a68142000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:48.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.474+0000 7f7a65d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7a680acca0 0x7f7a68142000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34504/0 (socket says 172.21.15.45:34504) 2023-12-22T10:00:48.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.474+0000 7f7a65d9b700 1 -- 172.21.15.45:0/1924610589 learned_addr learned my addr 172.21.15.45:0/1924610589 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:48.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.474+0000 7f7a6659c700 1 --2- 172.21.15.45:0/1924610589 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7a680691c0 0x7f7a680ae510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:48.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.474+0000 7f7a66d9d700 1 --2- 172.21.15.45:0/1924610589 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7a680c9d20 0x7f7a68167800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:48.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.474+0000 7f7a65d9b700 1 -- 172.21.15.45:0/1924610589 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7a680691c0 msgr2=0x7f7a680ae510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:48.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.474+0000 7f7a65d9b700 1 --2- 172.21.15.45:0/1924610589 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7a680691c0 0x7f7a680ae510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:48.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.474+0000 7f7a65d9b700 1 -- 172.21.15.45:0/1924610589 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7a680c9d20 msgr2=0x7f7a68167800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:48.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.474+0000 7f7a65d9b700 1 --2- 172.21.15.45:0/1924610589 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7a680c9d20 0x7f7a68167800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:48.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.474+0000 7f7a65d9b700 1 -- 172.21.15.45:0/1924610589 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a5c0092a0 con 0x7f7a680acca0 2023-12-22T10:00:48.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.474+0000 7f7a65d9b700 1 --2- 172.21.15.45:0/1924610589 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7a680acca0 0x7f7a68142000 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f7a5c011000 tx=0x7f7a5c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:48.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.474+0000 7f7a567fc700 1 -- 172.21.15.45:0/1924610589 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a5c00f7e0 con 0x7f7a680acca0 2023-12-22T10:00:48.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.474+0000 7f7a567fc700 1 -- 172.21.15.45:0/1924610589 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a5c00f940 con 0x7f7a680acca0 2023-12-22T10:00:48.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.474+0000 7f7a567fc700 1 -- 172.21.15.45:0/1924610589 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a5c01a680 con 0x7f7a680acca0 2023-12-22T10:00:48.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.474+0000 7f7a6759e700 1 -- 172.21.15.45:0/1924610589 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a680af320 con 0x7f7a680acca0 2023-12-22T10:00:48.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.474+0000 7f7a6759e700 1 -- 172.21.15.45:0/1924610589 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a680aea00 con 0x7f7a680acca0 2023-12-22T10:00:48.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.478+0000 7f7a6759e700 1 -- 172.21.15.45:0/1924610589 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a680afae0 con 0x7f7a680acca0 2023-12-22T10:00:48.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.478+0000 7f7a567fc700 1 -- 172.21.15.45:0/1924610589 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f7a5c01aa70 con 0x7f7a680acca0 2023-12-22T10:00:48.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.478+0000 7f7a567fc700 1 --2- 172.21.15.45:0/1924610589 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f7a4805a540 0x7f7a4805ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:48.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.478+0000 7f7a567fc700 1 -- 172.21.15.45:0/1924610589 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f7a5c075ab0 con 0x7f7a680acca0 2023-12-22T10:00:48.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.478+0000 7f7a6659c700 1 --2- 172.21.15.45:0/1924610589 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f7a4805a540 0x7f7a4805ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:48.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.482+0000 7f7a6659c700 1 --2- 172.21.15.45:0/1924610589 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f7a4805a540 0x7f7a4805ca00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f7a58005750 tx=0x7f7a58009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:48.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.490+0000 7f7a567fc700 1 -- 172.21.15.45:0/1924610589 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f7a5c049290 con 0x7f7a680acca0 2023-12-22T10:00:48.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.650+0000 7f7a6759e700 1 -- 172.21.15.45:0/1924610589 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7a68047060 con 0x7f7a680acca0 2023-12-22T10:00:48.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.650+0000 7f7a567fc700 1 -- 172.21.15.45:0/1924610589 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7a5c0270a0 con 0x7f7a680acca0 2023-12-22T10:00:48.646 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-22T10:00:48.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.650+0000 7f7a6759e700 1 -- 172.21.15.45:0/1924610589 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f7a4805a540 msgr2=0x7f7a4805ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:48.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.650+0000 7f7a6759e700 1 --2- 172.21.15.45:0/1924610589 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f7a4805a540 0x7f7a4805ca00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f7a58005750 tx=0x7f7a58009040).stop 2023-12-22T10:00:48.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.650+0000 7f7a6759e700 1 -- 172.21.15.45:0/1924610589 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7a680acca0 msgr2=0x7f7a68142000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:48.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.650+0000 7f7a6759e700 1 --2- 172.21.15.45:0/1924610589 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7a680acca0 0x7f7a68142000 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f7a5c011000 tx=0x7f7a5c017000).stop 2023-12-22T10:00:48.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.654+0000 7f7a6759e700 1 -- 172.21.15.45:0/1924610589 shutdown_connections 2023-12-22T10:00:48.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.654+0000 7f7a6759e700 1 --2- 172.21.15.45:0/1924610589 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7a680c9d20 0x7f7a68167800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:48.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.654+0000 7f7a6759e700 1 --2- 172.21.15.45:0/1924610589 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7a680acca0 0x7f7a68142000 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:48.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.654+0000 7f7a6759e700 1 --2- 172.21.15.45:0/1924610589 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f7a4805a540 0x7f7a4805ca00 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:48.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.654+0000 7f7a6759e700 1 --2- 172.21.15.45:0/1924610589 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7a680691c0 0x7f7a680ae510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:48.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.654+0000 7f7a6759e700 1 -- 172.21.15.45:0/1924610589 >> 172.21.15.45:0/1924610589 conn(0x7f7a680674f0 msgr2=0x7f7a680c1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:48.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.654+0000 7f7a6759e700 1 -- 172.21.15.45:0/1924610589 shutdown_connections 2023-12-22T10:00:48.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.654+0000 7f7a6759e700 1 -- 172.21.15.45:0/1924610589 wait complete. 2023-12-22T10:00:48.671 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-22T10:00:48.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.862+0000 7fb71af69700 1 Processor -- start 2023-12-22T10:00:48.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.862+0000 7fb71af69700 1 -- start start 2023-12-22T10:00:48.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.862+0000 7fb71af69700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb7140ac4c0 0x7fb714155660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:48.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.862+0000 7fb71af69700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb714155b50 0x7fb7140a5890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:48.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.862+0000 7fb71af69700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7141521b0 con 0x7fb7140ac0e0 2023-12-22T10:00:48.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.862+0000 7fb71af69700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb714151fa0 con 0x7fb7140ac4c0 2023-12-22T10:00:48.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.862+0000 7fb71af69700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7140c36e0 con 0x7fb714155b50 2023-12-22T10:00:48.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.862+0000 7fb713fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb7140ac4c0 0x7fb714155660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:48.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.862+0000 7fb713fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb7140ac4c0 0x7fb714155660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34508/0 (socket says 172.21.15.45:34508) 2023-12-22T10:00:48.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.862+0000 7fb718d05700 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fb7140ac0e0 0x7fb7140a7050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.45:53424/0 (socket says 172.21.15.45:53424) 2023-12-22T10:00:48.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.862+0000 7fb713fff700 1 -- 172.21.15.45:0/2697487655 learned_addr learned my addr 172.21.15.45:0/2697487655 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:48.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.862+0000 7fb719506700 1 --2- 172.21.15.45:0/2697487655 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb714155b50 0x7fb7140a5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:48.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.862+0000 7fb713fff700 1 -- 172.21.15.45:0/2697487655 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb714155b50 msgr2=0x7fb7140a5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:00:48.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.862+0000 7fb713fff700 1 --2- 172.21.15.45:0/2697487655 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb714155b50 0x7fb7140a5890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:48.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.862+0000 7fb713fff700 1 -- 172.21.15.45:0/2697487655 >> v1:172.21.15.113:6789/0 conn(0x7fb7140ac0e0 legacy=0x7fb7140a7050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:48.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.862+0000 7fb713fff700 1 -- 172.21.15.45:0/2697487655 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7140c39c0 con 0x7fb7140ac4c0 2023-12-22T10:00:48.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.862+0000 7fb7137fe700 1 -- 172.21.15.45:0/2697487655 <== mon.1 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3126254498 0 0) 0x7fb7141521b0 con 0x7fb7140ac0e0 2023-12-22T10:00:48.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.866+0000 7fb713fff700 1 --2- 172.21.15.45:0/2697487655 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb7140ac4c0 0x7fb714155660 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7fb700006fd0 tx=0x7fb7000090f0).ready entity=mon.0 client_cookie=a9b1af81fa2efcd5 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:48.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.866+0000 7fb7137fe700 1 -- 172.21.15.45:0/2697487655 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb70000b580 con 0x7fb7140ac4c0 2023-12-22T10:00:48.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.866+0000 7fb7137fe700 1 -- 172.21.15.45:0/2697487655 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb70000b6e0 con 0x7fb7140ac4c0 2023-12-22T10:00:48.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.866+0000 7fb7137fe700 1 -- 172.21.15.45:0/2697487655 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb70000ba60 con 0x7fb7140ac4c0 2023-12-22T10:00:48.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.866+0000 7fb71af69700 1 -- 172.21.15.45:0/2697487655 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb7140ac4c0 msgr2=0x7fb714155660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:48.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.866+0000 7fb71af69700 1 --2- 172.21.15.45:0/2697487655 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb7140ac4c0 0x7fb714155660 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7fb700006fd0 tx=0x7fb7000090f0).stop 2023-12-22T10:00:48.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.866+0000 7fb71af69700 1 -- 172.21.15.45:0/2697487655 shutdown_connections 2023-12-22T10:00:48.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.866+0000 7fb71af69700 1 --2- 172.21.15.45:0/2697487655 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb714155b50 0x7fb7140a5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:48.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.866+0000 7fb71af69700 1 --2- 172.21.15.45:0/2697487655 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb7140ac4c0 0x7fb714155660 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:48.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.866+0000 7fb71af69700 1 -- 172.21.15.45:0/2697487655 >> 172.21.15.45:0/2697487655 conn(0x7fb714066a70 msgr2=0x7fb714066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:48.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.866+0000 7fb71af69700 1 -- 172.21.15.45:0/2697487655 shutdown_connections 2023-12-22T10:00:48.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.866+0000 7fb71af69700 1 -- 172.21.15.45:0/2697487655 wait complete. 2023-12-22T10:00:48.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.870+0000 7fb71af69700 1 Processor -- start 2023-12-22T10:00:48.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.870+0000 7fb71af69700 1 -- start start 2023-12-22T10:00:48.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.870+0000 7fb71af69700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb7140ac0e0 0x7fb7141431d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:48.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.870+0000 7fb71af69700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb714155b50 0x7fb7140c6750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:48.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.870+0000 7fb71af69700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb7140c6c40 0x7fb714161dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:48.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.870+0000 7fb71af69700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7140c62c0 con 0x7fb714155b50 2023-12-22T10:00:48.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.870+0000 7fb71af69700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7140c5fc0 con 0x7fb7140ac0e0 2023-12-22T10:00:48.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.870+0000 7fb71af69700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7140bfcc0 con 0x7fb7140c6c40 2023-12-22T10:00:48.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.870+0000 7fb713fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb714155b50 0x7fb7140c6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:48.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.870+0000 7fb713fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb714155b50 0x7fb7140c6750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34512/0 (socket says 172.21.15.45:34512) 2023-12-22T10:00:48.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.870+0000 7fb713fff700 1 -- 172.21.15.45:0/2972466074 learned_addr learned my addr 172.21.15.45:0/2972466074 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:48.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.870+0000 7fb718d05700 1 --2- 172.21.15.45:0/2972466074 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb7140ac0e0 0x7fb7141431d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:48.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.870+0000 7fb719506700 1 --2- 172.21.15.45:0/2972466074 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb7140c6c40 0x7fb714161dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:48.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.874+0000 7fb713fff700 1 -- 172.21.15.45:0/2972466074 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb7140c6c40 msgr2=0x7fb714161dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:48.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.874+0000 7fb713fff700 1 --2- 172.21.15.45:0/2972466074 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb7140c6c40 0x7fb714161dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:48.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.874+0000 7fb713fff700 1 -- 172.21.15.45:0/2972466074 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb7140ac0e0 msgr2=0x7fb7141431d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:48.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.874+0000 7fb713fff700 1 --2- 172.21.15.45:0/2972466074 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb7140ac0e0 0x7fb7141431d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:48.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.874+0000 7fb713fff700 1 -- 172.21.15.45:0/2972466074 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb700009370 con 0x7fb714155b50 2023-12-22T10:00:48.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.874+0000 7fb718d05700 1 --2- 172.21.15.45:0/2972466074 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb7140ac0e0 0x7fb7141431d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-12-22T10:00:48.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.874+0000 7fb713fff700 1 --2- 172.21.15.45:0/2972466074 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb714155b50 0x7fb7140c6750 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7fb700009fd0 tx=0x7fb700017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:48.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.874+0000 7fb710ff9700 1 -- 172.21.15.45:0/2972466074 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb700000bc0 con 0x7fb714155b50 2023-12-22T10:00:48.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.874+0000 7fb710ff9700 1 -- 172.21.15.45:0/2972466074 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb70000b850 con 0x7fb714155b50 2023-12-22T10:00:48.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.874+0000 7fb710ff9700 1 -- 172.21.15.45:0/2972466074 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb700000d20 con 0x7fb714155b50 2023-12-22T10:00:48.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.874+0000 7fb71af69700 1 -- 172.21.15.45:0/2972466074 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7140bff60 con 0x7fb714155b50 2023-12-22T10:00:48.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.874+0000 7fb71af69700 1 -- 172.21.15.45:0/2972466074 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb71414e890 con 0x7fb714155b50 2023-12-22T10:00:48.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.874+0000 7fb71af69700 1 -- 172.21.15.45:0/2972466074 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7140c7020 con 0x7fb714155b50 2023-12-22T10:00:48.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.878+0000 7fb710ff9700 1 -- 172.21.15.45:0/2972466074 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fb70001c8c0 con 0x7fb714155b50 2023-12-22T10:00:48.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.878+0000 7fb710ff9700 1 --2- 172.21.15.45:0/2972466074 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fb6f805a510 0x7fb6f805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:48.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.878+0000 7fb710ff9700 1 -- 172.21.15.45:0/2972466074 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb700076510 con 0x7fb714155b50 2023-12-22T10:00:48.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.878+0000 7fb718d05700 1 --2- 172.21.15.45:0/2972466074 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fb6f805a510 0x7fb6f805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:48.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.878+0000 7fb718d05700 1 --2- 172.21.15.45:0/2972466074 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fb6f805a510 0x7fb6f805c9d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fb714065e30 tx=0x7fb708007bd0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:48.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:48.886+0000 7fb710ff9700 1 -- 172.21.15.45:0/2972466074 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb700049c10 con 0x7fb714155b50 2023-12-22T10:00:49.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.054+0000 7fb71af69700 1 -- 172.21.15.45:0/2972466074 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb7140c6470 con 0x7fb714155b50 2023-12-22T10:00:49.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.054+0000 7fb710ff9700 1 -- 172.21.15.45:0/2972466074 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb7140c6470 con 0x7fb714155b50 2023-12-22T10:00:49.051 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-22T10:00:49.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.058+0000 7fb71af69700 1 -- 172.21.15.45:0/2972466074 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fb6f805a510 msgr2=0x7fb6f805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:49.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.058+0000 7fb71af69700 1 --2- 172.21.15.45:0/2972466074 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fb6f805a510 0x7fb6f805c9d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fb714065e30 tx=0x7fb708007bd0).stop 2023-12-22T10:00:49.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.058+0000 7fb71af69700 1 -- 172.21.15.45:0/2972466074 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb714155b50 msgr2=0x7fb7140c6750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:49.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.058+0000 7fb71af69700 1 --2- 172.21.15.45:0/2972466074 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb714155b50 0x7fb7140c6750 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7fb700009fd0 tx=0x7fb700017000).stop 2023-12-22T10:00:49.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.058+0000 7fb71af69700 1 -- 172.21.15.45:0/2972466074 shutdown_connections 2023-12-22T10:00:49.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.058+0000 7fb71af69700 1 --2- 172.21.15.45:0/2972466074 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fb6f805a510 0x7fb6f805c9d0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:49.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.058+0000 7fb71af69700 1 --2- 172.21.15.45:0/2972466074 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb7140c6c40 0x7fb714161dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:49.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.058+0000 7fb71af69700 1 --2- 172.21.15.45:0/2972466074 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb714155b50 0x7fb7140c6750 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:49.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.058+0000 7fb71af69700 1 --2- 172.21.15.45:0/2972466074 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb7140ac0e0 0x7fb7141431d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:49.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.058+0000 7fb71af69700 1 -- 172.21.15.45:0/2972466074 >> 172.21.15.45:0/2972466074 conn(0x7fb714066a70 msgr2=0x7fb71414fed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:49.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.058+0000 7fb71af69700 1 -- 172.21.15.45:0/2972466074 shutdown_connections 2023-12-22T10:00:49.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.058+0000 7fb71af69700 1 -- 172.21.15.45:0/2972466074 wait complete. 2023-12-22T10:00:49.082 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T10:00:49.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.246+0000 7f72c8bb9700 1 Processor -- start 2023-12-22T10:00:49.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.246+0000 7f72c8bb9700 1 -- start start 2023-12-22T10:00:49.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.246+0000 7f72c8bb9700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f72c4151e00 0x7f72c415ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:49.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.246+0000 7f72c8bb9700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72c4069270 con 0x7f72c4151a20 2023-12-22T10:00:49.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.246+0000 7f72c8bb9700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72c40bc380 con 0x7f72c4155e60 2023-12-22T10:00:49.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.246+0000 7f72c8bb9700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72c40bc660 con 0x7f72c4151e00 2023-12-22T10:00:49.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.250+0000 7f72c3fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f72c4151e00 0x7f72c415ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:49.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.250+0000 7f72c3fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f72c4151e00 0x7f72c415ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34516/0 (socket says 172.21.15.45:34516) 2023-12-22T10:00:49.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.250+0000 7f72c3fff700 1 -- 172.21.15.45:0/3402323178 learned_addr learned my addr 172.21.15.45:0/3402323178 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:49.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.250+0000 7f72c37fe700 1 --1- 172.21.15.45:0/3402323178 >> v1:172.21.15.45:6789/0 conn(0x7f72c4151a20 0x7f72c4155750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:37110/0 (socket says 172.21.15.45:37110) 2023-12-22T10:00:49.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.250+0000 7f72c3fff700 1 -- 172.21.15.45:0/3402323178 >> v1:172.21.15.113:6789/0 conn(0x7f72c4155e60 legacy=0x7f72c40645b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:49.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.250+0000 7f72c3fff700 1 -- 172.21.15.45:0/3402323178 >> v1:172.21.15.45:6789/0 conn(0x7f72c4151a20 legacy=0x7f72c4155750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:49.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.250+0000 7f72c3fff700 1 -- 172.21.15.45:0/3402323178 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72c4068c20 con 0x7f72c4151e00 2023-12-22T10:00:49.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.250+0000 7f72c3fff700 1 --2- 172.21.15.45:0/3402323178 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72c4151e00 0x7f72c415ca90 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f72bc009f20 tx=0x7f72bc009840).ready entity=mon.0 client_cookie=e65b1875b3dcf0e3 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:49.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.250+0000 7f72c27fc700 1 -- 172.21.15.45:0/3402323178 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72bc00e070 con 0x7f72c4151e00 2023-12-22T10:00:49.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.250+0000 7f72c27fc700 1 -- 172.21.15.45:0/3402323178 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72bc00bb10 con 0x7f72c4151e00 2023-12-22T10:00:49.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.250+0000 7f72c27fc700 1 -- 172.21.15.45:0/3402323178 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72bc00be90 con 0x7f72c4151e00 2023-12-22T10:00:49.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.250+0000 7f72c8bb9700 1 -- 172.21.15.45:0/3402323178 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72c4151e00 msgr2=0x7f72c415ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:49.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.250+0000 7f72c8bb9700 1 --2- 172.21.15.45:0/3402323178 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72c4151e00 0x7f72c415ca90 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f72bc009f20 tx=0x7f72bc009840).stop 2023-12-22T10:00:49.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.250+0000 7f72c8bb9700 1 -- 172.21.15.45:0/3402323178 shutdown_connections 2023-12-22T10:00:49.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.250+0000 7f72c8bb9700 1 --2- 172.21.15.45:0/3402323178 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72c4151e00 0x7f72c415ca90 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:49.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.250+0000 7f72c8bb9700 1 -- 172.21.15.45:0/3402323178 >> 172.21.15.45:0/3402323178 conn(0x7f72c4067540 msgr2=0x7f72c40c6460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:49.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.250+0000 7f72c8bb9700 1 -- 172.21.15.45:0/3402323178 shutdown_connections 2023-12-22T10:00:49.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.250+0000 7f72c8bb9700 1 -- 172.21.15.45:0/3402323178 wait complete. 2023-12-22T10:00:49.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.254+0000 7f72c8bb9700 1 Processor -- start 2023-12-22T10:00:49.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.254+0000 7f72c8bb9700 1 -- start start 2023-12-22T10:00:49.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.254+0000 7f72c8bb9700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f72c4151a20 0x7f72c4154d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:49.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.254+0000 7f72c8bb9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72c4151e00 0x7f72c4152bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:49.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.254+0000 7f72c8bb9700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f72c4155e60 0x7f72c4164350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:49.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.254+0000 7f72c8bb9700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c40bd500 con 0x7f72c4151e00 2023-12-22T10:00:49.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.254+0000 7f72c8bb9700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c40bd7a0 con 0x7f72c4151a20 2023-12-22T10:00:49.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.254+0000 7f72c8bb9700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72c41533d0 con 0x7f72c4155e60 2023-12-22T10:00:49.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.254+0000 7f72c2ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72c4151e00 0x7f72c4152bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:49.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.254+0000 7f72c2ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72c4151e00 0x7f72c4152bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34524/0 (socket says 172.21.15.45:34524) 2023-12-22T10:00:49.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.254+0000 7f72c2ffd700 1 -- 172.21.15.45:0/3429706241 learned_addr learned my addr 172.21.15.45:0/3429706241 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:49.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.254+0000 7f72c37fe700 1 --2- 172.21.15.45:0/3429706241 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f72c4151a20 0x7f72c4154d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:49.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.254+0000 7f72c3fff700 1 --2- 172.21.15.45:0/3429706241 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f72c4155e60 0x7f72c4164350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:49.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.258+0000 7f72c2ffd700 1 -- 172.21.15.45:0/3429706241 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f72c4155e60 msgr2=0x7f72c4164350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:49.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.258+0000 7f72c2ffd700 1 --2- 172.21.15.45:0/3429706241 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f72c4155e60 0x7f72c4164350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:49.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.258+0000 7f72c2ffd700 1 -- 172.21.15.45:0/3429706241 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f72c4151a20 msgr2=0x7f72c4154d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:49.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.258+0000 7f72c2ffd700 1 --2- 172.21.15.45:0/3429706241 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f72c4151a20 0x7f72c4154d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:49.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.258+0000 7f72c2ffd700 1 -- 172.21.15.45:0/3429706241 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72bc009ae0 con 0x7f72c4151e00 2023-12-22T10:00:49.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.258+0000 7f72c2ffd700 1 --2- 172.21.15.45:0/3429706241 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72c4151e00 0x7f72c4152bb0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f72b800c4c0 tx=0x7f72b8007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:49.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.258+0000 7f72ab7fe700 1 -- 172.21.15.45:0/3429706241 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b800ce10 con 0x7f72c4151e00 2023-12-22T10:00:49.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.258+0000 7f72ab7fe700 1 -- 172.21.15.45:0/3429706241 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72b8007020 con 0x7f72c4151e00 2023-12-22T10:00:49.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.258+0000 7f72ab7fe700 1 -- 172.21.15.45:0/3429706241 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b80073c0 con 0x7f72c4151e00 2023-12-22T10:00:49.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.258+0000 7f72c8bb9700 1 -- 172.21.15.45:0/3429706241 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72c41536b0 con 0x7f72c4151e00 2023-12-22T10:00:49.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.258+0000 7f72c8bb9700 1 -- 172.21.15.45:0/3429706241 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72c41530a0 con 0x7f72c4151e00 2023-12-22T10:00:49.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.258+0000 7f72c8bb9700 1 -- 172.21.15.45:0/3429706241 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72c4047060 con 0x7f72c4151e00 2023-12-22T10:00:49.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.262+0000 7f72ab7fe700 1 -- 172.21.15.45:0/3429706241 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f72b80068b0 con 0x7f72c4151e00 2023-12-22T10:00:49.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.262+0000 7f72ab7fe700 1 --2- 172.21.15.45:0/3429706241 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f72b005a510 0x7f72b005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:49.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.262+0000 7f72ab7fe700 1 -- 172.21.15.45:0/3429706241 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f72b8073b50 con 0x7f72c4151e00 2023-12-22T10:00:49.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.262+0000 7f72c37fe700 1 --2- 172.21.15.45:0/3429706241 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f72b005a510 0x7f72b005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:49.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.262+0000 7f72c37fe700 1 --2- 172.21.15.45:0/3429706241 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f72b005a510 0x7f72b005c9d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f72b4007fd0 tx=0x7f72b4007d30).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:49.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.270+0000 7f72ab7fe700 1 -- 172.21.15.45:0/3429706241 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f72b8047270 con 0x7f72c4151e00 2023-12-22T10:00:49.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.466+0000 7f72c8bb9700 1 -- 172.21.15.45:0/3429706241 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f72c4154770 con 0x7f72c4151e00 2023-12-22T10:00:49.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.466+0000 7f72ab7fe700 1 -- 172.21.15.45:0/3429706241 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4489 (secure 0 0 0) 0x7f72b804a890 con 0x7f72c4151e00 2023-12-22T10:00:49.464 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:00:49.464 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6833/3021221178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6832","nonce":3021221178},{"type":"v1","addr":"172.21.15.113:6833","nonce":3021221178}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6835/1307046651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":1307046651},{"type":"v1","addr":"172.21.15.113:6835","nonce":1307046651}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/3043486757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":3043486757},{"type":"v1","addr":"172.21.15.45:6835","nonce":3043486757}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T10:00:33.522493+0000","modified":"2023-12-22T10:00:36.550815+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6837/1007404834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":1007404834},{"type":"v1","addr":"172.21.15.45:6837","nonce":1007404834}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-12-22T10:00:49.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.470+0000 7f72c8bb9700 1 -- 172.21.15.45:0/3429706241 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f72b005a510 msgr2=0x7f72b005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:49.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.470+0000 7f72c8bb9700 1 --2- 172.21.15.45:0/3429706241 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f72b005a510 0x7f72b005c9d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f72b4007fd0 tx=0x7f72b4007d30).stop 2023-12-22T10:00:49.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.470+0000 7f72c8bb9700 1 -- 172.21.15.45:0/3429706241 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72c4151e00 msgr2=0x7f72c4152bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:49.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.470+0000 7f72c8bb9700 1 --2- 172.21.15.45:0/3429706241 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72c4151e00 0x7f72c4152bb0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f72b800c4c0 tx=0x7f72b8007dd0).stop 2023-12-22T10:00:49.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.470+0000 7f72c8bb9700 1 -- 172.21.15.45:0/3429706241 shutdown_connections 2023-12-22T10:00:49.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.470+0000 7f72c8bb9700 1 --2- 172.21.15.45:0/3429706241 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f72b005a510 0x7f72b005c9d0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:49.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.470+0000 7f72c8bb9700 1 --2- 172.21.15.45:0/3429706241 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f72c4155e60 0x7f72c4164350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:49.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.470+0000 7f72c8bb9700 1 --2- 172.21.15.45:0/3429706241 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72c4151e00 0x7f72c4152bb0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:49.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.470+0000 7f72c8bb9700 1 --2- 172.21.15.45:0/3429706241 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f72c4151a20 0x7f72c4154d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:49.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.470+0000 7f72c8bb9700 1 -- 172.21.15.45:0/3429706241 >> 172.21.15.45:0/3429706241 conn(0x7f72c4067540 msgr2=0x7f72c40a9c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:49.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.470+0000 7f72c8bb9700 1 -- 172.21.15.45:0/3429706241 shutdown_connections 2023-12-22T10:00:49.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.470+0000 7f72c8bb9700 1 -- 172.21.15.45:0/3429706241 wait complete. 2023-12-22T10:00:49.470 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 8 2023-12-22T10:00:49.488 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T10:00:49.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.654+0000 7f7137169700 1 Processor -- start 2023-12-22T10:00:49.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.654+0000 7f7137169700 1 -- start start 2023-12-22T10:00:49.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.654+0000 7f7137169700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7130153870 0x7f7130158070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:49.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.654+0000 7f7137169700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f71300ca680 0x7f71300c5120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:49.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.654+0000 7f7137169700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71300aa690 con 0x7f7130153c50 2023-12-22T10:00:49.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.654+0000 7f7137169700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71300c59d0 con 0x7f7130153870 2023-12-22T10:00:49.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.654+0000 7f7137169700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7130157620 con 0x7f71300ca680 2023-12-22T10:00:49.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.658+0000 7f7134f05700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7130153870 0x7f7130158070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:49.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.658+0000 7f7134f05700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7130153870 0x7f7130158070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34526/0 (socket says 172.21.15.45:34526) 2023-12-22T10:00:49.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.658+0000 7f7134f05700 1 -- 172.21.15.45:0/2889896073 learned_addr learned my addr 172.21.15.45:0/2889896073 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:49.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.658+0000 7f712ffff700 1 --2- 172.21.15.45:0/2889896073 >> v2:172.21.15.113:3300/0 conn(0x7f71300ca680 0x7f71300c5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:49.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.658+0000 7f712f7fe700 1 -- 172.21.15.45:0/2889896073 <== mon.1 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2899178969 0 0) 0x7f71300aa690 con 0x7f7130153c50 2023-12-22T10:00:49.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.658+0000 7f712f7fe700 1 -- 172.21.15.45:0/2889896073 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71200033f0 con 0x7f7130153c50 2023-12-22T10:00:49.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.658+0000 7f7134f05700 1 -- 172.21.15.45:0/2889896073 >> v2:172.21.15.113:3300/0 conn(0x7f71300ca680 msgr2=0x7f71300c5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:00:49.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.658+0000 7f7134f05700 1 --2- 172.21.15.45:0/2889896073 >> v2:172.21.15.113:3300/0 conn(0x7f71300ca680 0x7f71300c5120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:49.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.658+0000 7f7134f05700 1 -- 172.21.15.45:0/2889896073 >> v1:172.21.15.113:6789/0 conn(0x7f7130153c50 legacy=0x7f71300c7460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:49.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.658+0000 7f7134f05700 1 -- 172.21.15.45:0/2889896073 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7130157be0 con 0x7f7130153870 2023-12-22T10:00:49.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.658+0000 7f7134f05700 1 --2- 172.21.15.45:0/2889896073 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7130153870 0x7f7130158070 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f7130158750 tx=0x7f71240090f0).ready entity=mon.0 client_cookie=df7cf9598dbc97c0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:49.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.658+0000 7f712f7fe700 1 -- 172.21.15.45:0/2889896073 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f712400f510 con 0x7f7130153870 2023-12-22T10:00:49.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.658+0000 7f712f7fe700 1 -- 172.21.15.45:0/2889896073 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f712400f670 con 0x7f7130153870 2023-12-22T10:00:49.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.658+0000 7f712f7fe700 1 -- 172.21.15.45:0/2889896073 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f712400f9f0 con 0x7f7130153870 2023-12-22T10:00:49.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.658+0000 7f7137169700 1 -- 172.21.15.45:0/2889896073 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7130153870 msgr2=0x7f7130158070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:49.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.658+0000 7f7137169700 1 --2- 172.21.15.45:0/2889896073 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7130153870 0x7f7130158070 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f7130158750 tx=0x7f71240090f0).stop 2023-12-22T10:00:49.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.658+0000 7f7137169700 1 -- 172.21.15.45:0/2889896073 shutdown_connections 2023-12-22T10:00:49.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.658+0000 7f7137169700 1 --2- 172.21.15.45:0/2889896073 >> v2:172.21.15.113:3300/0 conn(0x7f71300ca680 0x7f71300c5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:49.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.658+0000 7f7137169700 1 --2- 172.21.15.45:0/2889896073 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7130153870 0x7f7130158070 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:49.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.658+0000 7f7137169700 1 -- 172.21.15.45:0/2889896073 >> 172.21.15.45:0/2889896073 conn(0x7f7130082a80 msgr2=0x7f7130066a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:49.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.658+0000 7f7137169700 1 -- 172.21.15.45:0/2889896073 shutdown_connections 2023-12-22T10:00:49.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.658+0000 7f7137169700 1 -- 172.21.15.45:0/2889896073 wait complete. 2023-12-22T10:00:49.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.662+0000 7f7137169700 1 Processor -- start 2023-12-22T10:00:49.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.662+0000 7f7137169700 1 -- start start 2023-12-22T10:00:49.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.662+0000 7f7137169700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7130153c50 0x7f71300c1b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:49.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.662+0000 7f7137169700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f71300c2000 0x7f7130164520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:49.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.662+0000 7f7137169700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7130164a10 0x7f7130164e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:49.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.662+0000 7f7137169700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71300c2480 con 0x7f7130164a10 2023-12-22T10:00:49.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.662+0000 7f7137169700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71300c3dd0 con 0x7f7130153c50 2023-12-22T10:00:49.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.662+0000 7f7137169700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71300c2680 con 0x7f71300c2000 2023-12-22T10:00:49.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.666+0000 7f7135706700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7130164a10 0x7f7130164e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:49.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.666+0000 7f7134f05700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7130153c50 0x7f71300c1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:49.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.666+0000 7f7134f05700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7130153c50 0x7f71300c1b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.45:51390/0 (socket says 172.21.15.45:51390) 2023-12-22T10:00:49.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.666+0000 7f7135706700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7130164a10 0x7f7130164e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34536/0 (socket says 172.21.15.45:34536) 2023-12-22T10:00:49.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.666+0000 7f7134f05700 1 -- 172.21.15.45:0/2324673167 learned_addr learned my addr 172.21.15.45:0/2324673167 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:49.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.666+0000 7f712ffff700 1 --2- 172.21.15.45:0/2324673167 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f71300c2000 0x7f7130164520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:49.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.666+0000 7f712ffff700 1 -- 172.21.15.45:0/2324673167 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7130153c50 msgr2=0x7f71300c1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:49.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.666+0000 7f712ffff700 1 --2- 172.21.15.45:0/2324673167 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7130153c50 0x7f71300c1b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:49.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.666+0000 7f712ffff700 1 -- 172.21.15.45:0/2324673167 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7130164a10 msgr2=0x7f7130164e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:49.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.666+0000 7f712ffff700 1 --2- 172.21.15.45:0/2324673167 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7130164a10 0x7f7130164e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:49.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.666+0000 7f712ffff700 1 -- 172.21.15.45:0/2324673167 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7124009370 con 0x7f71300c2000 2023-12-22T10:00:49.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.666+0000 7f7135706700 1 --2- 172.21.15.45:0/2324673167 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7130164a10 0x7f7130164e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-12-22T10:00:49.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.666+0000 7f712ffff700 1 --2- 172.21.15.45:0/2324673167 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f71300c2000 0x7f7130164520 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f711c00e930 tx=0x7f711c009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:49.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.666+0000 7f712cff9700 1 -- 172.21.15.45:0/2324673167 <== mon.2 v2:172.21.15.113:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711c012600 con 0x7f71300c2000 2023-12-22T10:00:49.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.666+0000 7f712cff9700 1 -- 172.21.15.45:0/2324673167 <== mon.2 v2:172.21.15.113:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f711c012760 con 0x7f71300c2000 2023-12-22T10:00:49.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.666+0000 7f7137169700 1 -- 172.21.15.45:0/2324673167 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71300c2960 con 0x7f71300c2000 2023-12-22T10:00:49.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.666+0000 7f712cff9700 1 -- 172.21.15.45:0/2324673167 <== mon.2 v2:172.21.15.113:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711c012ae0 con 0x7f71300c2000 2023-12-22T10:00:49.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.666+0000 7f7137169700 1 -- 172.21.15.45:0/2324673167 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71300c2f20 con 0x7f71300c2000 2023-12-22T10:00:49.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.666+0000 7f7137169700 1 -- 172.21.15.45:0/2324673167 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f713006c070 con 0x7f71300c2000 2023-12-22T10:00:49.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.670+0000 7f712cff9700 1 -- 172.21.15.45:0/2324673167 <== mon.2 v2:172.21.15.113:3301/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f711c01b400 con 0x7f71300c2000 2023-12-22T10:00:49.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.670+0000 7f712cff9700 1 --2- 172.21.15.45:0/2324673167 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f711405a510 0x7f711405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:49.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.670+0000 7f712cff9700 1 -- 172.21.15.45:0/2324673167 <== mon.2 v2:172.21.15.113:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f711c074d00 con 0x7f71300c2000 2023-12-22T10:00:49.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.670+0000 7f7134f05700 1 --2- 172.21.15.45:0/2324673167 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f711405a510 0x7f711405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:49.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.674+0000 7f7134f05700 1 --2- 172.21.15.45:0/2324673167 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f711405a510 0x7f711405c9d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f712400ffd0 tx=0x7f7124017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:49.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.682+0000 7f712cff9700 1 -- 172.21.15.45:0/2324673167 <== mon.2 v2:172.21.15.113:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f711c0483c0 con 0x7f71300c2000 2023-12-22T10:00:49.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.850+0000 7f7137169700 1 -- 172.21.15.45:0/2324673167 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f713005f2c0 con 0x7f71300c2000 2023-12-22T10:00:49.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.850+0000 7f712cff9700 1 -- 172.21.15.45:0/2324673167 <== mon.2 v2:172.21.15.113:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16928 (secure 0 0 0) 0x7f711c04b9e0 con 0x7f71300c2000 2023-12-22T10:00:49.849 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:00:49.849 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":21,"fsid":"98b0837e-5e68-4c8f-a1a0-e9424baaad8f","created":"2023-12-22T10:00:15.010174+0000","modified":"2023-12-22T10:00:34.529651+0000","last_up_change":"2023-12-22T10:00:24.980513+0000","last_in_change":"2023-12-22T10:00:17.887172+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-12-22T10:00:25.069641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-12-22T10:00:26.906399+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-12-22T10:00:31.621311+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-12-22T10:00:32.538053+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e19943a0-1c6b-47df-b6bb-383472077890","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":33777},{"type":"v1","addr":"172.21.15.45:6819","nonce":33777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":33777},{"type":"v1","addr":"172.21.15.45:6822","nonce":33777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":33777},{"type":"v1","addr":"172.21.15.45:6830","nonce":33777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":33777},{"type":"v1","addr":"172.21.15.45:6826","nonce":33777}]},"public_addr":"172.21.15.45:6819/33777","cluster_addr":"172.21.15.45:6822/33777","heartbeat_back_addr":"172.21.15.45:6830/33777","heartbeat_front_addr":"172.21.15.45:6826/33777","state":["exists","up"]},{"osd":1,"uuid":"69670f34-f082-45a7-8f67-e962acc136e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":33775},{"type":"v1","addr":"172.21.15.45:6809","nonce":33775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":33775},{"type":"v1","addr":"172.21.15.45:6811","nonce":33775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":33775},{"type":"v1","addr":"172.21.15.45:6815","nonce":33775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":33775},{"type":"v1","addr":"172.21.15.45:6813","nonce":33775}]},"public_addr":"172.21.15.45:6809/33775","cluster_addr":"172.21.15.45:6811/33775","heartbeat_back_addr":"172.21.15.45:6815/33775","heartbeat_front_addr":"172.21.15.45:6813/33775","state":["exists","up"]},{"osd":2,"uuid":"d909d49b-82b8-401b-9947-e49dd167bb95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":33776},{"type":"v1","addr":"172.21.15.45:6801","nonce":33776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":33776},{"type":"v1","addr":"172.21.15.45:6803","nonce":33776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":33776},{"type":"v1","addr":"172.21.15.45:6807","nonce":33776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":33776},{"type":"v1","addr":"172.21.15.45:6805","nonce":33776}]},"public_addr":"172.21.15.45:6801/33776","cluster_addr":"172.21.15.45:6803/33776","heartbeat_back_addr":"172.21.15.45:6807/33776","heartbeat_front_addr":"172.21.15.45:6805/33776","state":["exists","up"]},{"osd":3,"uuid":"db104ca9-3a94-4d39-a2be-bd06db888095","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":33782},{"type":"v1","addr":"172.21.15.45:6817","nonce":33782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":33782},{"type":"v1","addr":"172.21.15.45:6823","nonce":33782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":33782},{"type":"v1","addr":"172.21.15.45:6831","nonce":33782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":33782},{"type":"v1","addr":"172.21.15.45:6827","nonce":33782}]},"public_addr":"172.21.15.45:6817/33782","cluster_addr":"172.21.15.45:6823/33782","heartbeat_back_addr":"172.21.15.45:6831/33782","heartbeat_front_addr":"172.21.15.45:6827/33782","state":["exists","up"]},{"osd":4,"uuid":"9f4eaff4-e433-4479-a0d1-ee7a33375ca6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":34099},{"type":"v1","addr":"172.21.15.113:6811","nonce":34099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":34099},{"type":"v1","addr":"172.21.15.113:6815","nonce":34099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":34099},{"type":"v1","addr":"172.21.15.113:6823","nonce":34099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6816","nonce":34099},{"type":"v1","addr":"172.21.15.113:6818","nonce":34099}]},"public_addr":"172.21.15.113:6811/34099","cluster_addr":"172.21.15.113:6815/34099","heartbeat_back_addr":"172.21.15.113:6823/34099","heartbeat_front_addr":"172.21.15.113:6818/34099","state":["exists","up"]},{"osd":5,"uuid":"1efc5591-180b-43af-8611-0068aadc5aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":34100},{"type":"v1","addr":"172.21.15.113:6801","nonce":34100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":34100},{"type":"v1","addr":"172.21.15.113:6803","nonce":34100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":34100},{"type":"v1","addr":"172.21.15.113:6807","nonce":34100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":34100},{"type":"v1","addr":"172.21.15.113:6805","nonce":34100}]},"public_addr":"172.21.15.113:6801/34100","cluster_addr":"172.21.15.113:6803/34100","heartbeat_back_addr":"172.21.15.113:6807/34100","heartbeat_front_addr":"172.21.15.113:6805/34100","state":["exists","up"]},{"osd":6,"uuid":"6c89d9d8-c153-4a48-afa9-97e4c403f1ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":34101},{"type":"v1","addr":"172.21.15.113:6810","nonce":34101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6812","nonce":34101},{"type":"v1","addr":"172.21.15.113:6814","nonce":34101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6822","nonce":34101},{"type":"v1","addr":"172.21.15.113:6824","nonce":34101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":34101},{"type":"v1","addr":"172.21.15.113:6819","nonce":34101}]},"public_addr":"172.21.15.113:6810/34101","cluster_addr":"172.21.15.113:6814/34101","heartbeat_back_addr":"172.21.15.113:6824/34101","heartbeat_front_addr":"172.21.15.113:6819/34101","state":["exists","up"]},{"osd":7,"uuid":"1855e70c-23f6-4c08-ad7f-774c2148235b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6821","nonce":34102},{"type":"v1","addr":"172.21.15.113:6825","nonce":34102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":34102},{"type":"v1","addr":"172.21.15.113:6827","nonce":34102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":34102},{"type":"v1","addr":"172.21.15.113:6831","nonce":34102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6828","nonce":34102},{"type":"v1","addr":"172.21.15.113:6829","nonce":34102}]},"public_addr":"172.21.15.113:6825/34102","cluster_addr":"172.21.15.113:6827/34102","heartbeat_back_addr":"172.21.15.113:6831/34102","heartbeat_front_addr":"172.21.15.113:6829/34102","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.812672+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.825045+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.700105+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.856563+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.954683+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.883234+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.883994+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.821686+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T10:00:49.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.858+0000 7f7137169700 1 -- 172.21.15.45:0/2324673167 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f711405a510 msgr2=0x7f711405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:49.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.858+0000 7f7137169700 1 --2- 172.21.15.45:0/2324673167 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f711405a510 0x7f711405c9d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f712400ffd0 tx=0x7f7124017000).stop 2023-12-22T10:00:49.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.858+0000 7f7137169700 1 -- 172.21.15.45:0/2324673167 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f71300c2000 msgr2=0x7f7130164520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:49.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.858+0000 7f7137169700 1 --2- 172.21.15.45:0/2324673167 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f71300c2000 0x7f7130164520 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f711c00e930 tx=0x7f711c009060).stop 2023-12-22T10:00:49.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.858+0000 7f7137169700 1 -- 172.21.15.45:0/2324673167 shutdown_connections 2023-12-22T10:00:49.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.858+0000 7f7137169700 1 --2- 172.21.15.45:0/2324673167 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7130164a10 0x7f7130164e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:49.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.858+0000 7f7137169700 1 --2- 172.21.15.45:0/2324673167 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f711405a510 0x7f711405c9d0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:49.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.858+0000 7f7137169700 1 --2- 172.21.15.45:0/2324673167 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f71300c2000 0x7f7130164520 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:49.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.858+0000 7f7137169700 1 --2- 172.21.15.45:0/2324673167 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7130153c50 0x7f71300c1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:49.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.858+0000 7f7137169700 1 -- 172.21.15.45:0/2324673167 >> 172.21.15.45:0/2324673167 conn(0x7f7130082a80 msgr2=0x7f71300c8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:49.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.858+0000 7f7137169700 1 -- 172.21.15.45:0/2324673167 shutdown_connections 2023-12-22T10:00:49.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:49.858+0000 7f7137169700 1 -- 172.21.15.45:0/2324673167 wait complete. 2023-12-22T10:00:49.879 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-12-22T10:00:25.069641+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-12-22T10:00:26.906399+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-22T10:00:31.621311+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-12-22T10:00:32.538053+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-22T10:00:49.880 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-12-22T10:00:50.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.054+0000 7f7003fff700 1 Processor -- start 2023-12-22T10:00:50.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.054+0000 7f7003fff700 1 -- start start 2023-12-22T10:00:50.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.058+0000 7f7003fff700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f70040acca0 0x7f70040ad080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:50.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.058+0000 7f7003fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f70040c9d20 0x7f70040c97e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:50.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.058+0000 7f7003fff700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70040c5810 con 0x7f70040ca230 2023-12-22T10:00:50.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.058+0000 7f7003fff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70040c8d90 con 0x7f70040c9d20 2023-12-22T10:00:50.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.058+0000 7f7003fff700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70040c9350 con 0x7f70040acca0 2023-12-22T10:00:50.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.058+0000 7f7002ffd700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f70040c9d20 0x7f70040c97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:50.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.058+0000 7f6ffaffd700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f70040acca0 0x7f70040ad080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:50.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.058+0000 7f70037fe700 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f70040ca230 0x7f7004068ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.45:53454/0 (socket says 172.21.15.45:53454) 2023-12-22T10:00:50.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.058+0000 7f70037fe700 1 -- 172.21.15.45:0/2348346940 learned_addr learned my addr 172.21.15.45:0/2348346940 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:00:50.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.058+0000 7f70027fc700 1 -- 172.21.15.45:0/2348346940 <== mon.1 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1726658903 0 0) 0x7f70040c5810 con 0x7f70040ca230 2023-12-22T10:00:50.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.058+0000 7f70027fc700 1 -- 172.21.15.45:0/2348346940 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ff00033f0 con 0x7f70040ca230 2023-12-22T10:00:50.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.058+0000 7f7002ffd700 1 -- 172.21.15.45:0/2348346940 >> v2:172.21.15.113:3300/0 conn(0x7f70040acca0 msgr2=0x7f70040ad080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:00:50.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.058+0000 7f7002ffd700 1 --2- 172.21.15.45:0/2348346940 >> v2:172.21.15.113:3300/0 conn(0x7f70040acca0 0x7f70040ad080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:50.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.058+0000 7f7002ffd700 1 -- 172.21.15.45:0/2348346940 >> v1:172.21.15.113:6789/0 conn(0x7f70040ca230 legacy=0x7f7004068ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:50.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.058+0000 7f7002ffd700 1 -- 172.21.15.45:0/2348346940 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7004154070 con 0x7f70040c9d20 2023-12-22T10:00:50.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.058+0000 7f7002ffd700 1 --2- 172.21.15.45:0/2348346940 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70040c9d20 0x7f70040c97e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f7004069db0 tx=0x7f6fec009060).ready entity=mon.0 client_cookie=94265f24f5c9d334 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:50.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.058+0000 7f70027fc700 1 -- 172.21.15.45:0/2348346940 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fec00d4a0 con 0x7f70040c9d20 2023-12-22T10:00:50.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.058+0000 7f70027fc700 1 -- 172.21.15.45:0/2348346940 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fec00d600 con 0x7f70040c9d20 2023-12-22T10:00:50.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.058+0000 7f70027fc700 1 -- 172.21.15.45:0/2348346940 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fec00d980 con 0x7f70040c9d20 2023-12-22T10:00:50.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.058+0000 7f7003fff700 1 -- 172.21.15.45:0/2348346940 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70040c9d20 msgr2=0x7f70040c97e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:50.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.062+0000 7f7003fff700 1 --2- 172.21.15.45:0/2348346940 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70040c9d20 0x7f70040c97e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f7004069db0 tx=0x7f6fec009060).stop 2023-12-22T10:00:50.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.062+0000 7f7003fff700 1 -- 172.21.15.45:0/2348346940 shutdown_connections 2023-12-22T10:00:50.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.062+0000 7f7003fff700 1 --2- 172.21.15.45:0/2348346940 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70040c9d20 0x7f70040c97e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:50.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.062+0000 7f7003fff700 1 --2- 172.21.15.45:0/2348346940 >> v2:172.21.15.113:3300/0 conn(0x7f70040acca0 0x7f70040ad080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:50.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.062+0000 7f7003fff700 1 -- 172.21.15.45:0/2348346940 >> 172.21.15.45:0/2348346940 conn(0x7f70040674f0 msgr2=0x7f70040ca820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:50.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.062+0000 7f7003fff700 1 -- 172.21.15.45:0/2348346940 shutdown_connections 2023-12-22T10:00:50.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.062+0000 7f7003fff700 1 -- 172.21.15.45:0/2348346940 wait complete. 2023-12-22T10:00:50.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.062+0000 7f7003fff700 1 Processor -- start 2023-12-22T10:00:50.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.062+0000 7f7003fff700 1 -- start start 2023-12-22T10:00:50.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.066+0000 7f7003fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70040acca0 0x7f7004151450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:50.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.066+0000 7f7003fff700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f70040c9d20 0x7f7004150ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:50.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.066+0000 7f7003fff700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f70040ca230 0x7f70041551d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:50.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.066+0000 7f7003fff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70040ae030 con 0x7f70040acca0 2023-12-22T10:00:50.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.066+0000 7f7003fff700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70040c2290 con 0x7f70040c9d20 2023-12-22T10:00:50.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.066+0000 7f7003fff700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70040ad7d0 con 0x7f70040ca230 2023-12-22T10:00:50.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.066+0000 7f6ffaffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70040acca0 0x7f7004151450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:50.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.066+0000 7f6ffaffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70040acca0 0x7f7004151450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34554/0 (socket says 172.21.15.45:34554) 2023-12-22T10:00:50.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.066+0000 7f6ffaffd700 1 -- 172.21.15.45:0/3582791155 learned_addr learned my addr 172.21.15.45:0/3582791155 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:50.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.066+0000 7f7002ffd700 1 --2- 172.21.15.45:0/3582791155 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f70040c9d20 0x7f7004150ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:50.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.066+0000 7f70037fe700 1 --2- 172.21.15.45:0/3582791155 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f70040ca230 0x7f70041551d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:50.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.066+0000 7f6ffaffd700 1 -- 172.21.15.45:0/3582791155 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f70040ca230 msgr2=0x7f70041551d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:50.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.066+0000 7f6ffaffd700 1 --2- 172.21.15.45:0/3582791155 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f70040ca230 0x7f70041551d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:50.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.066+0000 7f6ffaffd700 1 -- 172.21.15.45:0/3582791155 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f70040c9d20 msgr2=0x7f7004150ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:50.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.066+0000 7f6ffaffd700 1 --2- 172.21.15.45:0/3582791155 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f70040c9d20 0x7f7004150ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:50.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.066+0000 7f6ffaffd700 1 -- 172.21.15.45:0/3582791155 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fec0092a0 con 0x7f70040acca0 2023-12-22T10:00:50.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.066+0000 7f6ffaffd700 1 --2- 172.21.15.45:0/3582791155 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70040acca0 0x7f7004151450 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f6ff400e900 tx=0x7f6ff4009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:50.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.066+0000 7f6ffb7fe700 1 -- 172.21.15.45:0/3582791155 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff4012600 con 0x7f70040acca0 2023-12-22T10:00:50.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.066+0000 7f6ffb7fe700 1 -- 172.21.15.45:0/3582791155 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ff4012760 con 0x7f70040acca0 2023-12-22T10:00:50.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.066+0000 7f7003fff700 1 -- 172.21.15.45:0/3582791155 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70040ada70 con 0x7f70040acca0 2023-12-22T10:00:50.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.066+0000 7f6ffb7fe700 1 -- 172.21.15.45:0/3582791155 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff4012ae0 con 0x7f70040acca0 2023-12-22T10:00:50.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.066+0000 7f7003fff700 1 -- 172.21.15.45:0/3582791155 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70040ade00 con 0x7f70040acca0 2023-12-22T10:00:50.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.070+0000 7f7003fff700 1 -- 172.21.15.45:0/3582791155 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7004151a00 con 0x7f70040acca0 2023-12-22T10:00:50.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.070+0000 7f6ffb7fe700 1 -- 172.21.15.45:0/3582791155 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f6ff401b400 con 0x7f70040acca0 2023-12-22T10:00:50.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.070+0000 7f6ffb7fe700 1 --2- 172.21.15.45:0/3582791155 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f6fe405a510 0x7f6fe405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:50.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.074+0000 7f6ffb7fe700 1 -- 172.21.15.45:0/3582791155 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f6ff4074bf0 con 0x7f70040acca0 2023-12-22T10:00:50.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.074+0000 7f7002ffd700 1 --2- 172.21.15.45:0/3582791155 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f6fe405a510 0x7f6fe405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:50.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.074+0000 7f7002ffd700 1 --2- 172.21.15.45:0/3582791155 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f6fe405a510 0x7f6fe405c9d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f7004069db0 tx=0x7f6fec016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:50.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.078+0000 7f6ffb7fe700 1 -- 172.21.15.45:0/3582791155 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f6ff40482b0 con 0x7f70040acca0 2023-12-22T10:00:50.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.238+0000 7f7003fff700 1 -- 172.21.15.45:0/3582791155 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f7004047060 con 0x7f70040acca0 2023-12-22T10:00:50.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.238+0000 7f6ffb7fe700 1 -- 172.21.15.45:0/3582791155 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v21) v1 ==== 110+0+10 (secure 0 0 0) 0x7f6ff404b8d0 con 0x7f70040acca0 2023-12-22T10:00:50.234 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-12-22T10:00:50.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.242+0000 7f7003fff700 1 -- 172.21.15.45:0/3582791155 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f6fe405a510 msgr2=0x7f6fe405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:50.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.242+0000 7f7003fff700 1 --2- 172.21.15.45:0/3582791155 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f6fe405a510 0x7f6fe405c9d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f7004069db0 tx=0x7f6fec016000).stop 2023-12-22T10:00:50.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.242+0000 7f7003fff700 1 -- 172.21.15.45:0/3582791155 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70040acca0 msgr2=0x7f7004151450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:50.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.242+0000 7f7003fff700 1 --2- 172.21.15.45:0/3582791155 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70040acca0 0x7f7004151450 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f6ff400e900 tx=0x7f6ff4009060).stop 2023-12-22T10:00:50.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.242+0000 7f7003fff700 1 -- 172.21.15.45:0/3582791155 shutdown_connections 2023-12-22T10:00:50.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.242+0000 7f7003fff700 1 --2- 172.21.15.45:0/3582791155 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f6fe405a510 0x7f6fe405c9d0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:50.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.242+0000 7f7003fff700 1 --2- 172.21.15.45:0/3582791155 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f70040ca230 0x7f70041551d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:50.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.242+0000 7f7003fff700 1 --2- 172.21.15.45:0/3582791155 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f70040c9d20 0x7f7004150ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:50.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.242+0000 7f7003fff700 1 --2- 172.21.15.45:0/3582791155 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70040acca0 0x7f7004151450 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:50.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.242+0000 7f7003fff700 1 -- 172.21.15.45:0/3582791155 >> 172.21.15.45:0/3582791155 conn(0x7f70040674f0 msgr2=0x7f70041533f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:50.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.242+0000 7f7003fff700 1 -- 172.21.15.45:0/3582791155 shutdown_connections 2023-12-22T10:00:50.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.242+0000 7f7003fff700 1 -- 172.21.15.45:0/3582791155 wait complete. 2023-12-22T10:00:50.262 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-12-22T10:00:50.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.438+0000 7f1bef59e700 1 Processor -- start 2023-12-22T10:00:50.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.438+0000 7f1bef59e700 1 -- start start 2023-12-22T10:00:50.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.442+0000 7f1bef59e700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1bf00acc10 0x7f1bf00bfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:50.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.442+0000 7f1bef59e700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1bf00acff0 0x7f1bf00c6c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:50.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.442+0000 7f1bef59e700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bf00ad450 con 0x7f1bf0066a70 2023-12-22T10:00:50.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.442+0000 7f1bef59e700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bf00c7110 con 0x7f1bf00acff0 2023-12-22T10:00:50.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.442+0000 7f1bef59e700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bf00aa870 con 0x7f1bf00acc10 2023-12-22T10:00:50.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.442+0000 7f1bee59c700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1bf00acc10 0x7f1bf00bfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:50.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.442+0000 7f1bee59c700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1bf00acc10 0x7f1bf00bfcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.45:51406/0 (socket says 172.21.15.45:51406) 2023-12-22T10:00:50.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.442+0000 7f1bedd9b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1bf00acff0 0x7f1bf00c6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:50.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.442+0000 7f1bee59c700 1 -- 172.21.15.45:0/2940130837 learned_addr learned my addr 172.21.15.45:0/2940130837 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:50.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.442+0000 7f1bee59c700 1 -- 172.21.15.45:0/2940130837 >> v2:172.21.15.45:3300/0 conn(0x7f1bf00acff0 msgr2=0x7f1bf00c6c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:00:50.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.442+0000 7f1bee59c700 1 --2- 172.21.15.45:0/2940130837 >> v2:172.21.15.45:3300/0 conn(0x7f1bf00acff0 0x7f1bf00c6c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:50.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.442+0000 7f1bee59c700 1 -- 172.21.15.45:0/2940130837 >> v1:172.21.15.113:6789/0 conn(0x7f1bf0066a70 legacy=0x7f1bf00c5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:50.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.442+0000 7f1bee59c700 1 -- 172.21.15.45:0/2940130837 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bf00c0320 con 0x7f1bf00acc10 2023-12-22T10:00:50.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.442+0000 7f1bee59c700 1 --2- 172.21.15.45:0/2940130837 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1bf00acc10 0x7f1bf00bfcd0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f1bf0083310 tx=0x7f1be00090f0).ready entity=mon.1 client_cookie=fe39b82005eb7028 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:50.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.446+0000 7f1bed59a700 1 -- 172.21.15.45:0/2940130837 <== mon.1 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1be000b520 con 0x7f1bf00acc10 2023-12-22T10:00:50.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.446+0000 7f1bed59a700 1 -- 172.21.15.45:0/2940130837 <== mon.1 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1be000b680 con 0x7f1bf00acc10 2023-12-22T10:00:50.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.446+0000 7f1bed59a700 1 -- 172.21.15.45:0/2940130837 <== mon.1 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1be000ba00 con 0x7f1bf00acc10 2023-12-22T10:00:50.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.446+0000 7f1bef59e700 1 -- 172.21.15.45:0/2940130837 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1bf00acc10 msgr2=0x7f1bf00bfcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:50.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.446+0000 7f1bef59e700 1 --2- 172.21.15.45:0/2940130837 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1bf00acc10 0x7f1bf00bfcd0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f1bf0083310 tx=0x7f1be00090f0).stop 2023-12-22T10:00:50.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.446+0000 7f1bef59e700 1 -- 172.21.15.45:0/2940130837 shutdown_connections 2023-12-22T10:00:50.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.446+0000 7f1bef59e700 1 --2- 172.21.15.45:0/2940130837 >> v2:172.21.15.45:3300/0 conn(0x7f1bf00acff0 0x7f1bf00c6c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:50.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.446+0000 7f1bef59e700 1 --2- 172.21.15.45:0/2940130837 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1bf00acc10 0x7f1bf00bfcd0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:50.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.446+0000 7f1bef59e700 1 -- 172.21.15.45:0/2940130837 >> 172.21.15.45:0/2940130837 conn(0x7f1bf00cb330 msgr2=0x7f1bf00c7300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:50.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.446+0000 7f1bef59e700 1 -- 172.21.15.45:0/2940130837 shutdown_connections 2023-12-22T10:00:50.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.446+0000 7f1bef59e700 1 -- 172.21.15.45:0/2940130837 wait complete. 2023-12-22T10:00:50.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.450+0000 7f1bef59e700 1 Processor -- start 2023-12-22T10:00:50.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.450+0000 7f1bef59e700 1 -- start start 2023-12-22T10:00:50.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.450+0000 7f1bef59e700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1bf0066a70 0x7f1bf013a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:50.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.450+0000 7f1bef59e700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1bf00acc10 0x7f1bf0156bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:50.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.450+0000 7f1bef59e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1bf00acff0 0x7f1bf0158d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:50.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.450+0000 7f1bef59e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf0156150 con 0x7f1bf00acff0 2023-12-22T10:00:50.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.450+0000 7f1bef59e700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf0149ac0 con 0x7f1bf00acc10 2023-12-22T10:00:50.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.450+0000 7f1bef59e700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf0164e50 con 0x7f1bf0066a70 2023-12-22T10:00:50.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.450+0000 7f1beed9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1bf00acff0 0x7f1bf0158d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:50.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.450+0000 7f1beed9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1bf00acff0 0x7f1bf0158d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34576/0 (socket says 172.21.15.45:34576) 2023-12-22T10:00:50.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.450+0000 7f1beed9d700 1 -- 172.21.15.45:0/1995974698 learned_addr learned my addr 172.21.15.45:0/1995974698 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:50.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.450+0000 7f1bee59c700 1 --2- 172.21.15.45:0/1995974698 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1bf0066a70 0x7f1bf013a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:50.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.450+0000 7f1bedd9b700 1 --2- 172.21.15.45:0/1995974698 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1bf00acc10 0x7f1bf0156bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:50.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.450+0000 7f1beed9d700 1 -- 172.21.15.45:0/1995974698 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1bf0066a70 msgr2=0x7f1bf013a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:50.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.450+0000 7f1beed9d700 1 --2- 172.21.15.45:0/1995974698 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1bf0066a70 0x7f1bf013a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:50.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.450+0000 7f1beed9d700 1 -- 172.21.15.45:0/1995974698 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1bf00acc10 msgr2=0x7f1bf0156bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:50.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.450+0000 7f1beed9d700 1 --2- 172.21.15.45:0/1995974698 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1bf00acc10 0x7f1bf0156bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:50.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.450+0000 7f1beed9d700 1 -- 172.21.15.45:0/1995974698 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1be0009370 con 0x7f1bf00acff0 2023-12-22T10:00:50.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.450+0000 7f1beed9d700 1 --2- 172.21.15.45:0/1995974698 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1bf00acff0 0x7f1bf0158d00 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f1be8002230 tx=0x7f1be80015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:50.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.454+0000 7f1bde7fc700 1 -- 172.21.15.45:0/1995974698 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1be800e4a0 con 0x7f1bf00acff0 2023-12-22T10:00:50.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.454+0000 7f1bde7fc700 1 -- 172.21.15.45:0/1995974698 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1be800e600 con 0x7f1bf00acff0 2023-12-22T10:00:50.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.454+0000 7f1bde7fc700 1 -- 172.21.15.45:0/1995974698 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1be800e980 con 0x7f1bf00acff0 2023-12-22T10:00:50.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.454+0000 7f1bef59e700 1 -- 172.21.15.45:0/1995974698 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bf01563f0 con 0x7f1bf00acff0 2023-12-22T10:00:50.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.454+0000 7f1bef59e700 1 -- 172.21.15.45:0/1995974698 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bf0165130 con 0x7f1bf00acff0 2023-12-22T10:00:50.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.454+0000 7f1bef59e700 1 -- 172.21.15.45:0/1995974698 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bf01568f0 con 0x7f1bf00acff0 2023-12-22T10:00:50.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.458+0000 7f1bde7fc700 1 -- 172.21.15.45:0/1995974698 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f1be801b3b0 con 0x7f1bf00acff0 2023-12-22T10:00:50.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.458+0000 7f1bde7fc700 1 --2- 172.21.15.45:0/1995974698 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f1bd005a510 0x7f1bd005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:50.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.458+0000 7f1bde7fc700 1 -- 172.21.15.45:0/1995974698 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f1be8073f20 con 0x7f1bf00acff0 2023-12-22T10:00:50.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.458+0000 7f1bee59c700 1 --2- 172.21.15.45:0/1995974698 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f1bd005a510 0x7f1bd005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:50.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.458+0000 7f1bee59c700 1 --2- 172.21.15.45:0/1995974698 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f1bd005a510 0x7f1bd005c9d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f1be0009130 tx=0x7f1be0017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:50.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.466+0000 7f1bde7fc700 1 -- 172.21.15.45:0/1995974698 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f1be8047690 con 0x7f1bf00acff0 2023-12-22T10:00:50.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.634+0000 7f1bef59e700 1 -- 172.21.15.45:0/1995974698 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1bf00aab10 con 0x7f1bf00acff0 2023-12-22T10:00:50.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.634+0000 7f1bde7fc700 1 -- 172.21.15.45:0/1995974698 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1be804acb0 con 0x7f1bf00acff0 2023-12-22T10:00:50.630 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-12-22T10:00:50.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.638+0000 7f1bef59e700 1 -- 172.21.15.45:0/1995974698 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f1bd005a510 msgr2=0x7f1bd005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:50.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.638+0000 7f1bef59e700 1 --2- 172.21.15.45:0/1995974698 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f1bd005a510 0x7f1bd005c9d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f1be0009130 tx=0x7f1be0017000).stop 2023-12-22T10:00:50.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.638+0000 7f1bef59e700 1 -- 172.21.15.45:0/1995974698 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1bf00acff0 msgr2=0x7f1bf0158d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:50.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.638+0000 7f1bef59e700 1 --2- 172.21.15.45:0/1995974698 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1bf00acff0 0x7f1bf0158d00 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f1be8002230 tx=0x7f1be80015e0).stop 2023-12-22T10:00:50.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.638+0000 7f1bef59e700 1 -- 172.21.15.45:0/1995974698 shutdown_connections 2023-12-22T10:00:50.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.638+0000 7f1bef59e700 1 --2- 172.21.15.45:0/1995974698 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1bf00acff0 0x7f1bf0158d00 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:50.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.638+0000 7f1bef59e700 1 --2- 172.21.15.45:0/1995974698 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1bf00acc10 0x7f1bf0156bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:50.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.638+0000 7f1bef59e700 1 --2- 172.21.15.45:0/1995974698 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f1bd005a510 0x7f1bd005c9d0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:50.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.638+0000 7f1bef59e700 1 --2- 172.21.15.45:0/1995974698 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1bf0066a70 0x7f1bf013a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:50.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.638+0000 7f1bef59e700 1 -- 172.21.15.45:0/1995974698 >> 172.21.15.45:0/1995974698 conn(0x7f1bf00cb330 msgr2=0x7f1bf0153100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:50.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.638+0000 7f1bef59e700 1 -- 172.21.15.45:0/1995974698 shutdown_connections 2023-12-22T10:00:50.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.638+0000 7f1bef59e700 1 -- 172.21.15.45:0/1995974698 wait complete. 2023-12-22T10:00:50.655 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-22T10:00:50.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.834+0000 7f3bf6c79700 1 Processor -- start 2023-12-22T10:00:50.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.834+0000 7f3bf6c79700 1 -- start start 2023-12-22T10:00:50.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.838+0000 7f3bf6c79700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3bf00acc10 0x7f3bf00bfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:50.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.838+0000 7f3bf6c79700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f3bf0067180 0x7f3bf00c6c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:50.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.838+0000 7f3bf6c79700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bf00ad450 con 0x7f3bf00acff0 2023-12-22T10:00:50.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.838+0000 7f3bf6c79700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bf00c7110 con 0x7f3bf00acc10 2023-12-22T10:00:50.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.838+0000 7f3bf6c79700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bf00aa870 con 0x7f3bf0067180 2023-12-22T10:00:50.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.838+0000 7f3bf5c77700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3bf00acc10 0x7f3bf00bfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:50.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.838+0000 7f3bf5476700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f3bf00acff0 0x7f3bf0066a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:37122/0 (socket says 172.21.15.45:37122) 2023-12-22T10:00:50.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.838+0000 7f3bf5476700 1 -- 172.21.15.45:0/858902758 learned_addr learned my addr 172.21.15.45:0/858902758 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:00:50.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.838+0000 7f3bf6478700 1 --2- 172.21.15.45:0/858902758 >> v2:172.21.15.113:3300/0 conn(0x7f3bf0067180 0x7f3bf00c6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:50.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.838+0000 7f3bf5c77700 1 -- 172.21.15.45:0/858902758 >> v2:172.21.15.113:3300/0 conn(0x7f3bf0067180 msgr2=0x7f3bf00c6c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:00:50.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.838+0000 7f3bf5c77700 1 --2- 172.21.15.45:0/858902758 >> v2:172.21.15.113:3300/0 conn(0x7f3bf0067180 0x7f3bf00c6c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:50.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.838+0000 7f3bf5c77700 1 -- 172.21.15.45:0/858902758 >> v1:172.21.15.45:6789/0 conn(0x7f3bf00acff0 legacy=0x7f3bf0066a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:50.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.838+0000 7f3bf5c77700 1 -- 172.21.15.45:0/858902758 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bf00c0320 con 0x7f3bf00acc10 2023-12-22T10:00:50.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.838+0000 7f3bf4c75700 1 -- 172.21.15.45:0/858902758 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2408711354 0 0) 0x7f3bf00ad450 con 0x7f3bf00acff0 2023-12-22T10:00:50.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.838+0000 7f3bf5c77700 1 --2- 172.21.15.45:0/858902758 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3bf00acc10 0x7f3bf00bfcd0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f3bf00c0250 tx=0x7f3bec009060).ready entity=mon.0 client_cookie=d4a44d510b123705 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:50.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.838+0000 7f3bf4c75700 1 -- 172.21.15.45:0/858902758 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bec00f510 con 0x7f3bf00acc10 2023-12-22T10:00:50.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.838+0000 7f3bf4c75700 1 -- 172.21.15.45:0/858902758 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bec00f670 con 0x7f3bf00acc10 2023-12-22T10:00:50.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.838+0000 7f3bf4c75700 1 -- 172.21.15.45:0/858902758 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bec00f9f0 con 0x7f3bf00acc10 2023-12-22T10:00:50.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.842+0000 7f3bf6c79700 1 -- 172.21.15.45:0/858902758 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3bf00acc10 msgr2=0x7f3bf00bfcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:50.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.842+0000 7f3bf6c79700 1 --2- 172.21.15.45:0/858902758 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3bf00acc10 0x7f3bf00bfcd0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f3bf00c0250 tx=0x7f3bec009060).stop 2023-12-22T10:00:50.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.842+0000 7f3bf6c79700 1 -- 172.21.15.45:0/858902758 shutdown_connections 2023-12-22T10:00:50.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.842+0000 7f3bf6c79700 1 --2- 172.21.15.45:0/858902758 >> v2:172.21.15.113:3300/0 conn(0x7f3bf0067180 0x7f3bf00c6c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:50.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.842+0000 7f3bf6c79700 1 --2- 172.21.15.45:0/858902758 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3bf00acc10 0x7f3bf00bfcd0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:50.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.842+0000 7f3bf6c79700 1 -- 172.21.15.45:0/858902758 >> 172.21.15.45:0/858902758 conn(0x7f3bf00cb330 msgr2=0x7f3bf00c7300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:50.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.842+0000 7f3bf6c79700 1 -- 172.21.15.45:0/858902758 shutdown_connections 2023-12-22T10:00:50.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.842+0000 7f3bf6c79700 1 -- 172.21.15.45:0/858902758 wait complete. 2023-12-22T10:00:50.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.842+0000 7f3bf6c79700 1 Processor -- start 2023-12-22T10:00:50.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.846+0000 7f3bf6c79700 1 -- start start 2023-12-22T10:00:50.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.846+0000 7f3bf6c79700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3bf0067180 0x7f3bf0145650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:50.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.846+0000 7f3bf6c79700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f3bf00acc10 0x7f3bf0156cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:50.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.846+0000 7f3bf6c79700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3bf00acff0 0x7f3bf00c3380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:50.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.846+0000 7f3bf6c79700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf00c5370 con 0x7f3bf0067180 2023-12-22T10:00:50.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.846+0000 7f3bf6c79700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf00c61b0 con 0x7f3bf00acff0 2023-12-22T10:00:50.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.846+0000 7f3bf6c79700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf00c55a0 con 0x7f3bf00acc10 2023-12-22T10:00:50.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.846+0000 7f3bf5c77700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3bf0067180 0x7f3bf0145650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:50.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.846+0000 7f3bf5c77700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3bf0067180 0x7f3bf0145650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34604/0 (socket says 172.21.15.45:34604) 2023-12-22T10:00:50.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.846+0000 7f3bf5c77700 1 -- 172.21.15.45:0/3086336302 learned_addr learned my addr 172.21.15.45:0/3086336302 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:50.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.846+0000 7f3bf5476700 1 --2- 172.21.15.45:0/3086336302 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f3bf00acc10 0x7f3bf0156cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:50.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.846+0000 7f3bf6478700 1 --2- 172.21.15.45:0/3086336302 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3bf00acff0 0x7f3bf00c3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:50.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.846+0000 7f3bf5c77700 1 -- 172.21.15.45:0/3086336302 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f3bf00acc10 msgr2=0x7f3bf0156cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:50.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.846+0000 7f3bf5c77700 1 --2- 172.21.15.45:0/3086336302 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f3bf00acc10 0x7f3bf0156cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:50.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.846+0000 7f3bf5c77700 1 -- 172.21.15.45:0/3086336302 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3bf00acff0 msgr2=0x7f3bf00c3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:50.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.846+0000 7f3bf5c77700 1 --2- 172.21.15.45:0/3086336302 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3bf00acff0 0x7f3bf00c3380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:50.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.846+0000 7f3bf5c77700 1 -- 172.21.15.45:0/3086336302 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bec0092a0 con 0x7f3bf0067180 2023-12-22T10:00:50.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.846+0000 7f3bf5c77700 1 --2- 172.21.15.45:0/3086336302 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3bf0067180 0x7f3bf0145650 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f3bec009dd0 tx=0x7f3bec017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:50.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.846+0000 7f3be5ffb700 1 -- 172.21.15.45:0/3086336302 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bec00f9f0 con 0x7f3bf0067180 2023-12-22T10:00:50.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.846+0000 7f3be5ffb700 1 -- 172.21.15.45:0/3086336302 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bec000c90 con 0x7f3bf0067180 2023-12-22T10:00:50.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.850+0000 7f3bf6c79700 1 -- 172.21.15.45:0/3086336302 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bf00c5880 con 0x7f3bf0067180 2023-12-22T10:00:50.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.850+0000 7f3be5ffb700 1 -- 172.21.15.45:0/3086336302 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bec01b640 con 0x7f3bf0067180 2023-12-22T10:00:50.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.850+0000 7f3bf6c79700 1 -- 172.21.15.45:0/3086336302 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bf00c5e40 con 0x7f3bf0067180 2023-12-22T10:00:50.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.850+0000 7f3bf6c79700 1 -- 172.21.15.45:0/3086336302 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bf0047060 con 0x7f3bf0067180 2023-12-22T10:00:50.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.850+0000 7f3be5ffb700 1 -- 172.21.15.45:0/3086336302 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f3bec01b9b0 con 0x7f3bf0067180 2023-12-22T10:00:50.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.854+0000 7f3be5ffb700 1 --2- 172.21.15.45:0/3086336302 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f3bd405a510 0x7f3bd405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:50.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.854+0000 7f3be5ffb700 1 -- 172.21.15.45:0/3086336302 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f3bec0763e0 con 0x7f3bf0067180 2023-12-22T10:00:50.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.854+0000 7f3bf5476700 1 --2- 172.21.15.45:0/3086336302 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f3bd405a510 0x7f3bd405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:50.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.854+0000 7f3bf5476700 1 --2- 172.21.15.45:0/3086336302 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f3bd405a510 0x7f3bd405c9d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f3bf01674d0 tx=0x7f3be0009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:50.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:50.858+0000 7f3be5ffb700 1 -- 172.21.15.45:0/3086336302 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f3bec049b00 con 0x7f3bf0067180 2023-12-22T10:00:51.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.026+0000 7f3bf6c79700 1 -- 172.21.15.45:0/3086336302 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3bf00aab10 con 0x7f3bf0067180 2023-12-22T10:00:51.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.026+0000 7f3be5ffb700 1 -- 172.21.15.45:0/3086336302 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3bec0280a0 con 0x7f3bf0067180 2023-12-22T10:00:51.022 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-22T10:00:51.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.026+0000 7f3bf6c79700 1 -- 172.21.15.45:0/3086336302 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f3bd405a510 msgr2=0x7f3bd405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:51.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.026+0000 7f3bf6c79700 1 --2- 172.21.15.45:0/3086336302 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f3bd405a510 0x7f3bd405c9d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f3bf01674d0 tx=0x7f3be0009040).stop 2023-12-22T10:00:51.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.026+0000 7f3bf6c79700 1 -- 172.21.15.45:0/3086336302 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3bf0067180 msgr2=0x7f3bf0145650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:51.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.026+0000 7f3bf6c79700 1 --2- 172.21.15.45:0/3086336302 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3bf0067180 0x7f3bf0145650 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f3bec009dd0 tx=0x7f3bec017000).stop 2023-12-22T10:00:51.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.026+0000 7f3bf6c79700 1 -- 172.21.15.45:0/3086336302 shutdown_connections 2023-12-22T10:00:51.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.026+0000 7f3bf6c79700 1 --2- 172.21.15.45:0/3086336302 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3bf00acff0 0x7f3bf00c3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:51.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.026+0000 7f3bf6c79700 1 --2- 172.21.15.45:0/3086336302 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f3bd405a510 0x7f3bd405c9d0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:51.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.026+0000 7f3bf6c79700 1 --2- 172.21.15.45:0/3086336302 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f3bf00acc10 0x7f3bf0156cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:51.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.026+0000 7f3bf6c79700 1 --2- 172.21.15.45:0/3086336302 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3bf0067180 0x7f3bf0145650 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:51.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.026+0000 7f3bf6c79700 1 -- 172.21.15.45:0/3086336302 >> 172.21.15.45:0/3086336302 conn(0x7f3bf00cb330 msgr2=0x7f3bf00ae7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:51.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.030+0000 7f3bf6c79700 1 -- 172.21.15.45:0/3086336302 shutdown_connections 2023-12-22T10:00:51.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.030+0000 7f3bf6c79700 1 -- 172.21.15.45:0/3086336302 wait complete. 2023-12-22T10:00:51.045 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-22T10:00:51.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.218+0000 7fa58dbb9700 1 Processor -- start 2023-12-22T10:00:51.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.218+0000 7fa58dbb9700 1 -- start start 2023-12-22T10:00:51.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.222+0000 7fa58dbb9700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fa5880acca0 0x7fa5880ad080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:51.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.222+0000 7fa58dbb9700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa5880691c0 0x7fa5880c97e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:51.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.222+0000 7fa58dbb9700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5880c5810 con 0x7fa5880c9d20 2023-12-22T10:00:51.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.222+0000 7fa58dbb9700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5880c8d90 con 0x7fa5880691c0 2023-12-22T10:00:51.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.222+0000 7fa58dbb9700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5880c9350 con 0x7fa5880acca0 2023-12-22T10:00:51.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.222+0000 7fa58d3b8700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa5880691c0 0x7fa5880c97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:51.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.222+0000 7fa58d3b8700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa5880691c0 0x7fa5880c97e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34614/0 (socket says 172.21.15.45:34614) 2023-12-22T10:00:51.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.222+0000 7fa58d3b8700 1 -- 172.21.15.45:0/261822674 learned_addr learned my addr 172.21.15.45:0/261822674 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:51.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.222+0000 7fa58cbb7700 1 --2- 172.21.15.45:0/261822674 >> v2:172.21.15.113:3300/0 conn(0x7fa5880acca0 0x7fa5880ad080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:51.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.222+0000 7fa58d3b8700 1 -- 172.21.15.45:0/261822674 >> v2:172.21.15.113:3300/0 conn(0x7fa5880acca0 msgr2=0x7fa5880ad080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:00:51.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.222+0000 7fa58d3b8700 1 --2- 172.21.15.45:0/261822674 >> v2:172.21.15.113:3300/0 conn(0x7fa5880acca0 0x7fa5880ad080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:51.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.222+0000 7fa58d3b8700 1 -- 172.21.15.45:0/261822674 >> v1:172.21.15.113:6789/0 conn(0x7fa5880c9d20 legacy=0x7fa588068ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:51.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.222+0000 7fa58d3b8700 1 -- 172.21.15.45:0/261822674 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa588154070 con 0x7fa5880691c0 2023-12-22T10:00:51.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.222+0000 7fa58d3b8700 1 --2- 172.21.15.45:0/261822674 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa5880691c0 0x7fa5880c97e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7fa588069db0 tx=0x7fa580009840).ready entity=mon.0 client_cookie=2c116453235e297e server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:51.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.226+0000 7fa5877fe700 1 -- 172.21.15.45:0/261822674 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa58000e070 con 0x7fa5880691c0 2023-12-22T10:00:51.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.226+0000 7fa5877fe700 1 -- 172.21.15.45:0/261822674 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa58000ba20 con 0x7fa5880691c0 2023-12-22T10:00:51.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.226+0000 7fa5877fe700 1 -- 172.21.15.45:0/261822674 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa58000bda0 con 0x7fa5880691c0 2023-12-22T10:00:51.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.226+0000 7fa58dbb9700 1 -- 172.21.15.45:0/261822674 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa5880691c0 msgr2=0x7fa5880c97e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:51.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.226+0000 7fa58dbb9700 1 --2- 172.21.15.45:0/261822674 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa5880691c0 0x7fa5880c97e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7fa588069db0 tx=0x7fa580009840).stop 2023-12-22T10:00:51.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.226+0000 7fa58dbb9700 1 -- 172.21.15.45:0/261822674 shutdown_connections 2023-12-22T10:00:51.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.226+0000 7fa58dbb9700 1 --2- 172.21.15.45:0/261822674 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa5880691c0 0x7fa5880c97e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:51.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.226+0000 7fa58dbb9700 1 --2- 172.21.15.45:0/261822674 >> v2:172.21.15.113:3300/0 conn(0x7fa5880acca0 0x7fa5880ad080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:51.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.226+0000 7fa58dbb9700 1 -- 172.21.15.45:0/261822674 >> 172.21.15.45:0/261822674 conn(0x7fa5880674f0 msgr2=0x7fa5880ca820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:51.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.226+0000 7fa58dbb9700 1 -- 172.21.15.45:0/261822674 shutdown_connections 2023-12-22T10:00:51.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.226+0000 7fa58dbb9700 1 -- 172.21.15.45:0/261822674 wait complete. 2023-12-22T10:00:51.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.230+0000 7fa58dbb9700 1 Processor -- start 2023-12-22T10:00:51.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.230+0000 7fa58dbb9700 1 -- start start 2023-12-22T10:00:51.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.230+0000 7fa58dbb9700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fa5880691c0 0x7fa588156590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:51.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.230+0000 7fa58dbb9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa5880acca0 0x7fa5880ad7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:51.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.230+0000 7fa58dbb9700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa5880c9d20 0x7fa5880abc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:51.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.230+0000 7fa58dbb9700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5881674d0 con 0x7fa5880acca0 2023-12-22T10:00:51.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.230+0000 7fa58dbb9700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa588164450 con 0x7fa5880c9d20 2023-12-22T10:00:51.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.230+0000 7fa58dbb9700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa588164730 con 0x7fa5880691c0 2023-12-22T10:00:51.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.230+0000 7fa587fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa5880acca0 0x7fa5880ad7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:51.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.230+0000 7fa587fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa5880acca0 0x7fa5880ad7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34618/0 (socket says 172.21.15.45:34618) 2023-12-22T10:00:51.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.230+0000 7fa587fff700 1 -- 172.21.15.45:0/2265618443 learned_addr learned my addr 172.21.15.45:0/2265618443 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:51.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.230+0000 7fa58cbb7700 1 --2- 172.21.15.45:0/2265618443 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fa5880691c0 0x7fa588156590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:51.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.230+0000 7fa58d3b8700 1 --2- 172.21.15.45:0/2265618443 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa5880c9d20 0x7fa5880abc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:51.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.234+0000 7fa587fff700 1 -- 172.21.15.45:0/2265618443 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fa5880691c0 msgr2=0x7fa588156590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:51.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.234+0000 7fa587fff700 1 --2- 172.21.15.45:0/2265618443 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fa5880691c0 0x7fa588156590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:51.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.234+0000 7fa587fff700 1 -- 172.21.15.45:0/2265618443 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa5880c9d20 msgr2=0x7fa5880abc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:51.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.234+0000 7fa587fff700 1 --2- 172.21.15.45:0/2265618443 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa5880c9d20 0x7fa5880abc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:51.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.234+0000 7fa587fff700 1 -- 172.21.15.45:0/2265618443 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa580009ae0 con 0x7fa5880acca0 2023-12-22T10:00:51.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.234+0000 7fa587fff700 1 --2- 172.21.15.45:0/2265618443 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa5880acca0 0x7fa5880ad7d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7fa57400c440 tx=0x7fa574007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:51.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.234+0000 7fa584ff9700 1 -- 172.21.15.45:0/2265618443 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa574007020 con 0x7fa5880acca0 2023-12-22T10:00:51.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.234+0000 7fa584ff9700 1 -- 172.21.15.45:0/2265618443 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa574007180 con 0x7fa5880acca0 2023-12-22T10:00:51.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.234+0000 7fa584ff9700 1 -- 172.21.15.45:0/2265618443 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa574007520 con 0x7fa5880acca0 2023-12-22T10:00:51.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.234+0000 7fa58dbb9700 1 -- 172.21.15.45:0/2265618443 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa588164a10 con 0x7fa5880acca0 2023-12-22T10:00:51.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.234+0000 7fa58dbb9700 1 -- 172.21.15.45:0/2265618443 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa588156a80 con 0x7fa5880acca0 2023-12-22T10:00:51.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.234+0000 7fa58dbb9700 1 -- 172.21.15.45:0/2265618443 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa588047060 con 0x7fa5880acca0 2023-12-22T10:00:51.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.238+0000 7fa584ff9700 1 -- 172.21.15.45:0/2265618443 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fa5740068b0 con 0x7fa5880acca0 2023-12-22T10:00:51.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.238+0000 7fa584ff9700 1 --2- 172.21.15.45:0/2265618443 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fa56c05a510 0x7fa56c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:51.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.238+0000 7fa584ff9700 1 -- 172.21.15.45:0/2265618443 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fa574073a80 con 0x7fa5880acca0 2023-12-22T10:00:51.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.238+0000 7fa58cbb7700 1 --2- 172.21.15.45:0/2265618443 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fa56c05a510 0x7fa56c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:51.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.238+0000 7fa58cbb7700 1 --2- 172.21.15.45:0/2265618443 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fa56c05a510 0x7fa56c05c9d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7fa57c009c30 tx=0x7fa57c009060).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:51.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.242+0000 7fa584ff9700 1 -- 172.21.15.45:0/2265618443 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fa5740471a0 con 0x7fa5880acca0 2023-12-22T10:00:51.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.406+0000 7fa58dbb9700 1 -- 172.21.15.45:0/2265618443 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa5880c5a60 con 0x7fa5880acca0 2023-12-22T10:00:51.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.406+0000 7fa584ff9700 1 -- 172.21.15.45:0/2265618443 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa57404a7c0 con 0x7fa5880acca0 2023-12-22T10:00:51.403 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-22T10:00:51.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.410+0000 7fa58dbb9700 1 -- 172.21.15.45:0/2265618443 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fa56c05a510 msgr2=0x7fa56c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:51.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.410+0000 7fa58dbb9700 1 --2- 172.21.15.45:0/2265618443 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fa56c05a510 0x7fa56c05c9d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7fa57c009c30 tx=0x7fa57c009060).stop 2023-12-22T10:00:51.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.410+0000 7fa58dbb9700 1 -- 172.21.15.45:0/2265618443 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa5880acca0 msgr2=0x7fa5880ad7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:51.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.410+0000 7fa58dbb9700 1 --2- 172.21.15.45:0/2265618443 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa5880acca0 0x7fa5880ad7d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7fa57400c440 tx=0x7fa574007e00).stop 2023-12-22T10:00:51.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.410+0000 7fa58dbb9700 1 -- 172.21.15.45:0/2265618443 shutdown_connections 2023-12-22T10:00:51.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.410+0000 7fa58dbb9700 1 --2- 172.21.15.45:0/2265618443 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa5880c9d20 0x7fa5880abc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:51.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.410+0000 7fa58dbb9700 1 --2- 172.21.15.45:0/2265618443 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa5880acca0 0x7fa5880ad7d0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:51.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.410+0000 7fa58dbb9700 1 --2- 172.21.15.45:0/2265618443 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fa56c05a510 0x7fa56c05c9d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:51.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.410+0000 7fa58dbb9700 1 --2- 172.21.15.45:0/2265618443 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fa5880691c0 0x7fa588156590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:51.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.410+0000 7fa58dbb9700 1 -- 172.21.15.45:0/2265618443 >> 172.21.15.45:0/2265618443 conn(0x7fa5880674f0 msgr2=0x7fa5880ca820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:51.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.410+0000 7fa58dbb9700 1 -- 172.21.15.45:0/2265618443 shutdown_connections 2023-12-22T10:00:51.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.410+0000 7fa58dbb9700 1 -- 172.21.15.45:0/2265618443 wait complete. 2023-12-22T10:00:51.429 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T10:00:51.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.602+0000 7f9529347700 1 Processor -- start 2023-12-22T10:00:51.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.602+0000 7f9529347700 1 -- start start 2023-12-22T10:00:51.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.606+0000 7f9529347700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f9524151490 0x7f9524151870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:51.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.606+0000 7f9529347700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9524065190 0x7f95240655f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:51.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.606+0000 7f9529347700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9524065ba0 con 0x7f95240ab590 2023-12-22T10:00:51.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.606+0000 7f9529347700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95240697d0 con 0x7f9524065190 2023-12-22T10:00:51.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.606+0000 7f9529347700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9524068a10 con 0x7f9524151490 2023-12-22T10:00:51.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.606+0000 7f951b7fe700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9524065190 0x7f95240655f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:51.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.606+0000 7f951b7fe700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9524065190 0x7f95240655f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34634/0 (socket says 172.21.15.45:34634) 2023-12-22T10:00:51.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.606+0000 7f951b7fe700 1 -- 172.21.15.45:0/3791856575 learned_addr learned my addr 172.21.15.45:0/3791856575 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:51.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.606+0000 7f9523fff700 1 --2- 172.21.15.45:0/3791856575 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f9524151490 0x7f9524151870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:51.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.606+0000 7f951b7fe700 1 -- 172.21.15.45:0/3791856575 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f9524151490 msgr2=0x7f9524151870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:00:51.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.606+0000 7f951b7fe700 1 --2- 172.21.15.45:0/3791856575 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f9524151490 0x7f9524151870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:51.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.606+0000 7f951b7fe700 1 -- 172.21.15.45:0/3791856575 >> v1:172.21.15.113:6789/0 conn(0x7f95240ab590 legacy=0x7f95240c50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:00:51.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.606+0000 7f951b7fe700 1 -- 172.21.15.45:0/3791856575 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9524068cf0 con 0x7f9524065190 2023-12-22T10:00:51.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.606+0000 7f951b7fe700 1 --2- 172.21.15.45:0/3791856575 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9524065190 0x7f95240655f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f950c006fd0 tx=0x7f950c0090f0).ready entity=mon.0 client_cookie=95312966c868115a server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:51.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.606+0000 7f95237fe700 1 -- 172.21.15.45:0/3791856575 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f950c00b600 con 0x7f9524065190 2023-12-22T10:00:51.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.606+0000 7f95237fe700 1 -- 172.21.15.45:0/3791856575 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f950c00b760 con 0x7f9524065190 2023-12-22T10:00:51.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.606+0000 7f95237fe700 1 -- 172.21.15.45:0/3791856575 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f950c00bae0 con 0x7f9524065190 2023-12-22T10:00:51.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.606+0000 7f9529347700 1 -- 172.21.15.45:0/3791856575 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9524065190 msgr2=0x7f95240655f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:51.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.606+0000 7f9529347700 1 --2- 172.21.15.45:0/3791856575 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9524065190 0x7f95240655f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f950c006fd0 tx=0x7f950c0090f0).stop 2023-12-22T10:00:51.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.606+0000 7f9529347700 1 -- 172.21.15.45:0/3791856575 shutdown_connections 2023-12-22T10:00:51.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.606+0000 7f9529347700 1 --2- 172.21.15.45:0/3791856575 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9524065190 0x7f95240655f0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:51.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.606+0000 7f9529347700 1 --2- 172.21.15.45:0/3791856575 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f9524151490 0x7f9524151870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:51.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.606+0000 7f9529347700 1 -- 172.21.15.45:0/3791856575 >> 172.21.15.45:0/3791856575 conn(0x7f9524066a70 msgr2=0x7f9524066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:51.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.606+0000 7f9529347700 1 -- 172.21.15.45:0/3791856575 shutdown_connections 2023-12-22T10:00:51.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.606+0000 7f9529347700 1 -- 172.21.15.45:0/3791856575 wait complete. 2023-12-22T10:00:51.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.610+0000 7f9529347700 1 Processor -- start 2023-12-22T10:00:51.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.610+0000 7f9529347700 1 -- start start 2023-12-22T10:00:51.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.610+0000 7f9529347700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9524065190 0x7f9524148380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:51.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.610+0000 7f9529347700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f95240ab590 0x7f95241531d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:51.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.610+0000 7f9529347700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9524151490 0x7f95241536c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:51.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.614+0000 7f9529347700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9524153cb0 con 0x7f9524151490 2023-12-22T10:00:51.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.614+0000 7f9529347700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9524153f90 con 0x7f9524065190 2023-12-22T10:00:51.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.614+0000 7f9529347700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9524154270 con 0x7f95240ab590 2023-12-22T10:00:51.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.614+0000 7f9528b46700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9524151490 0x7f95241536c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:51.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.614+0000 7f9528b46700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9524151490 0x7f95241536c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34648/0 (socket says 172.21.15.45:34648) 2023-12-22T10:00:51.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.614+0000 7f9528b46700 1 -- 172.21.15.45:0/4002441255 learned_addr learned my addr 172.21.15.45:0/4002441255 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:51.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.614+0000 7f951b7fe700 1 --2- 172.21.15.45:0/4002441255 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f95240ab590 0x7f95241531d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:51.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.614+0000 7f9523fff700 1 --2- 172.21.15.45:0/4002441255 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9524065190 0x7f9524148380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:51.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.614+0000 7f9528b46700 1 -- 172.21.15.45:0/4002441255 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f95240ab590 msgr2=0x7f95241531d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:51.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.614+0000 7f9528b46700 1 --2- 172.21.15.45:0/4002441255 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f95240ab590 0x7f95241531d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:51.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.614+0000 7f9528b46700 1 -- 172.21.15.45:0/4002441255 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9524065190 msgr2=0x7f9524148380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:51.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.614+0000 7f9528b46700 1 --2- 172.21.15.45:0/4002441255 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9524065190 0x7f9524148380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:51.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.614+0000 7f9528b46700 1 -- 172.21.15.45:0/4002441255 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f950c009370 con 0x7f9524151490 2023-12-22T10:00:51.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.614+0000 7f951b7fe700 1 --2- 172.21.15.45:0/4002441255 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f95240ab590 0x7f95241531d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T10:00:51.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.614+0000 7f9528b46700 1 --2- 172.21.15.45:0/4002441255 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9524151490 0x7f95241536c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f951c002230 tx=0x7f951c0015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:51.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.614+0000 7f9520ff9700 1 -- 172.21.15.45:0/4002441255 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951c010510 con 0x7f9524151490 2023-12-22T10:00:51.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.614+0000 7f9520ff9700 1 -- 172.21.15.45:0/4002441255 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f951c010670 con 0x7f9524151490 2023-12-22T10:00:51.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.614+0000 7f9520ff9700 1 -- 172.21.15.45:0/4002441255 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951c0109f0 con 0x7f9524151490 2023-12-22T10:00:51.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.614+0000 7f9529347700 1 -- 172.21.15.45:0/4002441255 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9524154550 con 0x7f9524151490 2023-12-22T10:00:51.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.614+0000 7f9529347700 1 -- 172.21.15.45:0/4002441255 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9524138cb0 con 0x7f9524151490 2023-12-22T10:00:51.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.618+0000 7f9529347700 1 -- 172.21.15.45:0/4002441255 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9524063280 con 0x7f9524151490 2023-12-22T10:00:51.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.618+0000 7f9520ff9700 1 -- 172.21.15.45:0/4002441255 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f951c01b400 con 0x7f9524151490 2023-12-22T10:00:51.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.618+0000 7f9520ff9700 1 --2- 172.21.15.45:0/4002441255 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f950805a4e0 0x7f950805c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:51.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.618+0000 7f9520ff9700 1 -- 172.21.15.45:0/4002441255 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f951c0746c0 con 0x7f9524151490 2023-12-22T10:00:51.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.618+0000 7f9523fff700 1 --2- 172.21.15.45:0/4002441255 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f950805a4e0 0x7f950805c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:51.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.622+0000 7f9523fff700 1 --2- 172.21.15.45:0/4002441255 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f950805a4e0 0x7f950805c9a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f951400bb20 tx=0x7f9514008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:51.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.626+0000 7f9520ff9700 1 -- 172.21.15.45:0/4002441255 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f951c047d80 con 0x7f9524151490 2023-12-22T10:00:51.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.826+0000 7f9529347700 1 -- 172.21.15.45:0/4002441255 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f952414cb50 con 0x7f9524151490 2023-12-22T10:00:51.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.826+0000 7f9520ff9700 1 -- 172.21.15.45:0/4002441255 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4489 (secure 0 0 0) 0x7f951c04b3a0 con 0x7f9524151490 2023-12-22T10:00:51.823 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:00:51.824 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6833/3021221178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6832","nonce":3021221178},{"type":"v1","addr":"172.21.15.113:6833","nonce":3021221178}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6835/1307046651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":1307046651},{"type":"v1","addr":"172.21.15.113:6835","nonce":1307046651}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/3043486757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":3043486757},{"type":"v1","addr":"172.21.15.45:6835","nonce":3043486757}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T10:00:33.522493+0000","modified":"2023-12-22T10:00:36.550815+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6837/1007404834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":1007404834},{"type":"v1","addr":"172.21.15.45:6837","nonce":1007404834}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-12-22T10:00:51.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.830+0000 7f9529347700 1 -- 172.21.15.45:0/4002441255 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f950805a4e0 msgr2=0x7f950805c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:51.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.830+0000 7f9529347700 1 --2- 172.21.15.45:0/4002441255 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f950805a4e0 0x7f950805c9a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f951400bb20 tx=0x7f9514008040).stop 2023-12-22T10:00:51.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.830+0000 7f9529347700 1 -- 172.21.15.45:0/4002441255 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9524151490 msgr2=0x7f95241536c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:51.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.830+0000 7f9529347700 1 --2- 172.21.15.45:0/4002441255 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9524151490 0x7f95241536c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f951c002230 tx=0x7f951c0015e0).stop 2023-12-22T10:00:51.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.830+0000 7f9529347700 1 -- 172.21.15.45:0/4002441255 shutdown_connections 2023-12-22T10:00:51.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.830+0000 7f9529347700 1 --2- 172.21.15.45:0/4002441255 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9524151490 0x7f95241536c0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:51.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.830+0000 7f9529347700 1 --2- 172.21.15.45:0/4002441255 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f950805a4e0 0x7f950805c9a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:51.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.830+0000 7f9529347700 1 --2- 172.21.15.45:0/4002441255 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f95240ab590 0x7f95241531d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:51.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.830+0000 7f9529347700 1 --2- 172.21.15.45:0/4002441255 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9524065190 0x7f9524148380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:51.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.830+0000 7f9529347700 1 -- 172.21.15.45:0/4002441255 >> 172.21.15.45:0/4002441255 conn(0x7f9524066a70 msgr2=0x7f952414d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:51.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.830+0000 7f9529347700 1 -- 172.21.15.45:0/4002441255 shutdown_connections 2023-12-22T10:00:51.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:51.830+0000 7f9529347700 1 -- 172.21.15.45:0/4002441255 wait complete. 2023-12-22T10:00:51.828 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 8 2023-12-22T10:00:51.849 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T10:00:52.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.018+0000 7f1818a1b700 1 Processor -- start 2023-12-22T10:00:52.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.018+0000 7f1818a1b700 1 -- start start 2023-12-22T10:00:52.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.022+0000 7f1818a1b700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1814151cd0 0x7f18140a6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:52.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.022+0000 7f1818a1b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f18140a7200 0x7f18140c3160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:52.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.022+0000 7f1818a1b700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1814155740 con 0x7f18141518f0 2023-12-22T10:00:52.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.022+0000 7f1818a1b700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18140c40f0 con 0x7f18140a7200 2023-12-22T10:00:52.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.022+0000 7f1818a1b700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18140a7690 con 0x7f1814151cd0 2023-12-22T10:00:52.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.022+0000 7f1811d9b700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1814151cd0 0x7f18140a6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:52.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.022+0000 7f1812d9d700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f18140a7200 0x7f18140c3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:52.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.022+0000 7f1811d9b700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1814151cd0 0x7f18140a6d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.45:51486/0 (socket says 172.21.15.45:51486) 2023-12-22T10:00:52.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.022+0000 7f1811d9b700 1 -- 172.21.15.45:0/196659420 learned_addr learned my addr 172.21.15.45:0/196659420 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:52.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.022+0000 7f181259c700 1 --1- 172.21.15.45:0/196659420 >> v1:172.21.15.113:6789/0 conn(0x7f18141518f0 0x7f1814064890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.45:53498/0 (socket says 172.21.15.45:53498) 2023-12-22T10:00:52.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.026+0000 7f1812d9d700 1 -- 172.21.15.45:0/196659420 >> v2:172.21.15.113:3300/0 conn(0x7f1814151cd0 msgr2=0x7f18140a6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:00:52.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.026+0000 7f1812d9d700 1 --2- 172.21.15.45:0/196659420 >> v2:172.21.15.113:3300/0 conn(0x7f1814151cd0 0x7f18140a6d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:52.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.026+0000 7f1812d9d700 1 -- 172.21.15.45:0/196659420 >> v1:172.21.15.113:6789/0 conn(0x7f18141518f0 legacy=0x7f1814064890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:52.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.026+0000 7f1812d9d700 1 -- 172.21.15.45:0/196659420 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18140a61b0 con 0x7f18140a7200 2023-12-22T10:00:52.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.026+0000 7f181159a700 1 -- 172.21.15.45:0/196659420 <== mon.1 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2326855450 0 0) 0x7f1814155740 con 0x7f18141518f0 2023-12-22T10:00:52.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.026+0000 7f1812d9d700 1 --2- 172.21.15.45:0/196659420 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f18140a7200 0x7f18140c3160 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f18140680f0 tx=0x7f180c009780).ready entity=mon.0 client_cookie=aaf9a91b2db66f5f server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:52.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.026+0000 7f181159a700 1 -- 172.21.15.45:0/196659420 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f180c00e070 con 0x7f18140a7200 2023-12-22T10:00:52.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.026+0000 7f181159a700 1 -- 172.21.15.45:0/196659420 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f180c00bb60 con 0x7f18140a7200 2023-12-22T10:00:52.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.026+0000 7f181159a700 1 -- 172.21.15.45:0/196659420 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f180c012410 con 0x7f18140a7200 2023-12-22T10:00:52.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.026+0000 7f1818a1b700 1 -- 172.21.15.45:0/196659420 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f18140a7200 msgr2=0x7f18140c3160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:52.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.026+0000 7f1818a1b700 1 --2- 172.21.15.45:0/196659420 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f18140a7200 0x7f18140c3160 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f18140680f0 tx=0x7f180c009780).stop 2023-12-22T10:00:52.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.026+0000 7f1818a1b700 1 -- 172.21.15.45:0/196659420 shutdown_connections 2023-12-22T10:00:52.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.026+0000 7f1818a1b700 1 --2- 172.21.15.45:0/196659420 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f18140a7200 0x7f18140c3160 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:52.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.026+0000 7f1818a1b700 1 --2- 172.21.15.45:0/196659420 >> v2:172.21.15.113:3300/0 conn(0x7f1814151cd0 0x7f18140a6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:52.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.026+0000 7f1818a1b700 1 -- 172.21.15.45:0/196659420 >> 172.21.15.45:0/196659420 conn(0x7f1814066a70 msgr2=0x7f1814066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:52.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.026+0000 7f1818a1b700 1 -- 172.21.15.45:0/196659420 shutdown_connections 2023-12-22T10:00:52.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.026+0000 7f1818a1b700 1 -- 172.21.15.45:0/196659420 wait complete. 2023-12-22T10:00:52.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.030+0000 7f1818a1b700 1 Processor -- start 2023-12-22T10:00:52.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.030+0000 7f1818a1b700 1 -- start start 2023-12-22T10:00:52.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.030+0000 7f1818a1b700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f18140a7200 0x7f18141665f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:52.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.030+0000 7f1818a1b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f18141518f0 0x7f18140ab820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:52.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.030+0000 7f1818a1b700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1814151cd0 0x7f1814142ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:52.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.030+0000 7f1818a1b700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1814146ab0 con 0x7f18141518f0 2023-12-22T10:00:52.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.030+0000 7f1818a1b700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18141434e0 con 0x7f18140a7200 2023-12-22T10:00:52.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.030+0000 7f1818a1b700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f181414d990 con 0x7f1814151cd0 2023-12-22T10:00:52.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.030+0000 7f1811d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f18141518f0 0x7f18140ab820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:52.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.034+0000 7f181259c700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f18140a7200 0x7f18141665f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:52.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.034+0000 7f1812d9d700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1814151cd0 0x7f1814142ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:52.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.034+0000 7f1811d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f18141518f0 0x7f18140ab820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34668/0 (socket says 172.21.15.45:34668) 2023-12-22T10:00:52.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.034+0000 7f1811d9b700 1 -- 172.21.15.45:0/1264694308 learned_addr learned my addr 172.21.15.45:0/1264694308 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:52.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.034+0000 7f1812d9d700 1 --2- 172.21.15.45:0/1264694308 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1814151cd0 0x7f1814142ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.113:3301/0 says I am v2:172.21.15.45:43846/0 (socket says 172.21.15.45:43846) 2023-12-22T10:00:52.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.034+0000 7f1811d9b700 1 -- 172.21.15.45:0/1264694308 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1814151cd0 msgr2=0x7f1814142ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:52.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.034+0000 7f1811d9b700 1 --2- 172.21.15.45:0/1264694308 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1814151cd0 0x7f1814142ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:52.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.034+0000 7f1811d9b700 1 -- 172.21.15.45:0/1264694308 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f18140a7200 msgr2=0x7f18141665f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:52.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.034+0000 7f1811d9b700 1 --2- 172.21.15.45:0/1264694308 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f18140a7200 0x7f18141665f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:52.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.034+0000 7f1811d9b700 1 -- 172.21.15.45:0/1264694308 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f180c009a20 con 0x7f18141518f0 2023-12-22T10:00:52.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.034+0000 7f1811d9b700 1 --2- 172.21.15.45:0/1264694308 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f18141518f0 0x7f18140ab820 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f180800e900 tx=0x7f18080090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:52.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.034+0000 7f18027fc700 1 -- 172.21.15.45:0/1264694308 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1808012600 con 0x7f18141518f0 2023-12-22T10:00:52.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.034+0000 7f18027fc700 1 -- 172.21.15.45:0/1264694308 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1808012760 con 0x7f18141518f0 2023-12-22T10:00:52.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.034+0000 7f18027fc700 1 -- 172.21.15.45:0/1264694308 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1808012ae0 con 0x7f18141518f0 2023-12-22T10:00:52.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.034+0000 7f1818a1b700 1 -- 172.21.15.45:0/1264694308 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1814143780 con 0x7f18141518f0 2023-12-22T10:00:52.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.034+0000 7f1818a1b700 1 -- 172.21.15.45:0/1264694308 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1814143d40 con 0x7f18141518f0 2023-12-22T10:00:52.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.034+0000 7f1818a1b700 1 -- 172.21.15.45:0/1264694308 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f181406c070 con 0x7f18141518f0 2023-12-22T10:00:52.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.038+0000 7f18027fc700 1 -- 172.21.15.45:0/1264694308 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f180801b400 con 0x7f18141518f0 2023-12-22T10:00:52.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.038+0000 7f18027fc700 1 --2- 172.21.15.45:0/1264694308 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f17f405a510 0x7f17f405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:52.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.038+0000 7f18027fc700 1 -- 172.21.15.45:0/1264694308 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f1808074b10 con 0x7f18141518f0 2023-12-22T10:00:52.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.038+0000 7f181259c700 1 --2- 172.21.15.45:0/1264694308 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f17f405a510 0x7f17f405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:52.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.038+0000 7f181259c700 1 --2- 172.21.15.45:0/1264694308 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f17f405a510 0x7f17f405c9d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f18040011e0 tx=0x7f1804007bd0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:52.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.046+0000 7f18027fc700 1 -- 172.21.15.45:0/1264694308 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f1808048290 con 0x7f18141518f0 2023-12-22T10:00:52.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.210+0000 7f1818a1b700 1 -- 172.21.15.45:0/1264694308 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1814064fa0 con 0x7f18141518f0 2023-12-22T10:00:52.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.214+0000 7f18027fc700 1 -- 172.21.15.45:0/1264694308 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16928 (secure 0 0 0) 0x7f1808016030 con 0x7f18141518f0 2023-12-22T10:00:52.211 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:00:52.211 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":21,"fsid":"98b0837e-5e68-4c8f-a1a0-e9424baaad8f","created":"2023-12-22T10:00:15.010174+0000","modified":"2023-12-22T10:00:34.529651+0000","last_up_change":"2023-12-22T10:00:24.980513+0000","last_in_change":"2023-12-22T10:00:17.887172+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-12-22T10:00:25.069641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-12-22T10:00:26.906399+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-12-22T10:00:31.621311+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-12-22T10:00:32.538053+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e19943a0-1c6b-47df-b6bb-383472077890","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":33777},{"type":"v1","addr":"172.21.15.45:6819","nonce":33777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":33777},{"type":"v1","addr":"172.21.15.45:6822","nonce":33777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":33777},{"type":"v1","addr":"172.21.15.45:6830","nonce":33777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":33777},{"type":"v1","addr":"172.21.15.45:6826","nonce":33777}]},"public_addr":"172.21.15.45:6819/33777","cluster_addr":"172.21.15.45:6822/33777","heartbeat_back_addr":"172.21.15.45:6830/33777","heartbeat_front_addr":"172.21.15.45:6826/33777","state":["exists","up"]},{"osd":1,"uuid":"69670f34-f082-45a7-8f67-e962acc136e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":33775},{"type":"v1","addr":"172.21.15.45:6809","nonce":33775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":33775},{"type":"v1","addr":"172.21.15.45:6811","nonce":33775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":33775},{"type":"v1","addr":"172.21.15.45:6815","nonce":33775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":33775},{"type":"v1","addr":"172.21.15.45:6813","nonce":33775}]},"public_addr":"172.21.15.45:6809/33775","cluster_addr":"172.21.15.45:6811/33775","heartbeat_back_addr":"172.21.15.45:6815/33775","heartbeat_front_addr":"172.21.15.45:6813/33775","state":["exists","up"]},{"osd":2,"uuid":"d909d49b-82b8-401b-9947-e49dd167bb95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":33776},{"type":"v1","addr":"172.21.15.45:6801","nonce":33776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":33776},{"type":"v1","addr":"172.21.15.45:6803","nonce":33776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":33776},{"type":"v1","addr":"172.21.15.45:6807","nonce":33776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":33776},{"type":"v1","addr":"172.21.15.45:6805","nonce":33776}]},"public_addr":"172.21.15.45:6801/33776","cluster_addr":"172.21.15.45:6803/33776","heartbeat_back_addr":"172.21.15.45:6807/33776","heartbeat_front_addr":"172.21.15.45:6805/33776","state":["exists","up"]},{"osd":3,"uuid":"db104ca9-3a94-4d39-a2be-bd06db888095","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":33782},{"type":"v1","addr":"172.21.15.45:6817","nonce":33782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":33782},{"type":"v1","addr":"172.21.15.45:6823","nonce":33782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":33782},{"type":"v1","addr":"172.21.15.45:6831","nonce":33782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":33782},{"type":"v1","addr":"172.21.15.45:6827","nonce":33782}]},"public_addr":"172.21.15.45:6817/33782","cluster_addr":"172.21.15.45:6823/33782","heartbeat_back_addr":"172.21.15.45:6831/33782","heartbeat_front_addr":"172.21.15.45:6827/33782","state":["exists","up"]},{"osd":4,"uuid":"9f4eaff4-e433-4479-a0d1-ee7a33375ca6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":34099},{"type":"v1","addr":"172.21.15.113:6811","nonce":34099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":34099},{"type":"v1","addr":"172.21.15.113:6815","nonce":34099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":34099},{"type":"v1","addr":"172.21.15.113:6823","nonce":34099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6816","nonce":34099},{"type":"v1","addr":"172.21.15.113:6818","nonce":34099}]},"public_addr":"172.21.15.113:6811/34099","cluster_addr":"172.21.15.113:6815/34099","heartbeat_back_addr":"172.21.15.113:6823/34099","heartbeat_front_addr":"172.21.15.113:6818/34099","state":["exists","up"]},{"osd":5,"uuid":"1efc5591-180b-43af-8611-0068aadc5aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":34100},{"type":"v1","addr":"172.21.15.113:6801","nonce":34100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":34100},{"type":"v1","addr":"172.21.15.113:6803","nonce":34100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":34100},{"type":"v1","addr":"172.21.15.113:6807","nonce":34100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":34100},{"type":"v1","addr":"172.21.15.113:6805","nonce":34100}]},"public_addr":"172.21.15.113:6801/34100","cluster_addr":"172.21.15.113:6803/34100","heartbeat_back_addr":"172.21.15.113:6807/34100","heartbeat_front_addr":"172.21.15.113:6805/34100","state":["exists","up"]},{"osd":6,"uuid":"6c89d9d8-c153-4a48-afa9-97e4c403f1ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":34101},{"type":"v1","addr":"172.21.15.113:6810","nonce":34101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6812","nonce":34101},{"type":"v1","addr":"172.21.15.113:6814","nonce":34101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6822","nonce":34101},{"type":"v1","addr":"172.21.15.113:6824","nonce":34101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":34101},{"type":"v1","addr":"172.21.15.113:6819","nonce":34101}]},"public_addr":"172.21.15.113:6810/34101","cluster_addr":"172.21.15.113:6814/34101","heartbeat_back_addr":"172.21.15.113:6824/34101","heartbeat_front_addr":"172.21.15.113:6819/34101","state":["exists","up"]},{"osd":7,"uuid":"1855e70c-23f6-4c08-ad7f-774c2148235b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6821","nonce":34102},{"type":"v1","addr":"172.21.15.113:6825","nonce":34102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":34102},{"type":"v1","addr":"172.21.15.113:6827","nonce":34102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":34102},{"type":"v1","addr":"172.21.15.113:6831","nonce":34102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6828","nonce":34102},{"type":"v1","addr":"172.21.15.113:6829","nonce":34102}]},"public_addr":"172.21.15.113:6825/34102","cluster_addr":"172.21.15.113:6827/34102","heartbeat_back_addr":"172.21.15.113:6831/34102","heartbeat_front_addr":"172.21.15.113:6829/34102","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.812672+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.825045+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.700105+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.856563+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.954683+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.883234+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.883994+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.821686+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T10:00:52.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.218+0000 7f1818a1b700 1 -- 172.21.15.45:0/1264694308 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f17f405a510 msgr2=0x7f17f405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:52.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.218+0000 7f1818a1b700 1 --2- 172.21.15.45:0/1264694308 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f17f405a510 0x7f17f405c9d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f18040011e0 tx=0x7f1804007bd0).stop 2023-12-22T10:00:52.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.218+0000 7f1818a1b700 1 -- 172.21.15.45:0/1264694308 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f18141518f0 msgr2=0x7f18140ab820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:52.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.218+0000 7f1818a1b700 1 --2- 172.21.15.45:0/1264694308 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f18141518f0 0x7f18140ab820 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f180800e900 tx=0x7f18080090f0).stop 2023-12-22T10:00:52.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.218+0000 7f1818a1b700 1 -- 172.21.15.45:0/1264694308 shutdown_connections 2023-12-22T10:00:52.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.218+0000 7f1818a1b700 1 --2- 172.21.15.45:0/1264694308 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f17f405a510 0x7f17f405c9d0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:52.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.218+0000 7f1818a1b700 1 --2- 172.21.15.45:0/1264694308 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1814151cd0 0x7f1814142ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:52.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.218+0000 7f1818a1b700 1 --2- 172.21.15.45:0/1264694308 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f18141518f0 0x7f18140ab820 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:52.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.218+0000 7f1818a1b700 1 --2- 172.21.15.45:0/1264694308 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f18140a7200 0x7f18141665f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:52.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.218+0000 7f1818a1b700 1 -- 172.21.15.45:0/1264694308 >> 172.21.15.45:0/1264694308 conn(0x7f1814066a70 msgr2=0x7f18140c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:52.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.218+0000 7f1818a1b700 1 -- 172.21.15.45:0/1264694308 shutdown_connections 2023-12-22T10:00:52.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.218+0000 7f1818a1b700 1 -- 172.21.15.45:0/1264694308 wait complete. 2023-12-22T10:00:52.233 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T10:00:52.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.398+0000 7f7ea7279700 1 Processor -- start 2023-12-22T10:00:52.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.398+0000 7f7ea7279700 1 -- start start 2023-12-22T10:00:52.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.402+0000 7f7ea7279700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7ea00a8ad0 0x7f7ea0065860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:52.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.402+0000 7f7ea7279700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ea00c17e0 con 0x7f7ea00a8eb0 2023-12-22T10:00:52.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.402+0000 7f7ea7279700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ea00c2630 con 0x7f7ea015bb60 2023-12-22T10:00:52.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.402+0000 7f7ea7279700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea01584c0 con 0x7f7ea00a8ad0 2023-12-22T10:00:52.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.402+0000 7f7ea5a76700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f7ea00a8eb0 0x7f7ea00c10d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:37132/0 (socket says 172.21.15.45:37132) 2023-12-22T10:00:52.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.402+0000 7f7ea5a76700 1 -- 172.21.15.45:0/554961428 learned_addr learned my addr 172.21.15.45:0/554961428 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:00:52.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.402+0000 7f7ea6277700 1 --2- 172.21.15.45:0/554961428 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7ea00a8ad0 0x7f7ea0065860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:52.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.402+0000 7f7ea5275700 1 -- 172.21.15.45:0/554961428 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 657712249 0 0) 0x7f7e90001110 con 0x7f7ea00a8eb0 2023-12-22T10:00:52.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.402+0000 7f7ea5275700 1 -- 172.21.15.45:0/554961428 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e8c0033f0 con 0x7f7ea00a8eb0 2023-12-22T10:00:52.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.402+0000 7f7ea5275700 1 -- 172.21.15.45:0/554961428 <== mon.1 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3598358473 0 0) 0x7f7ea00c2630 con 0x7f7ea015bb60 2023-12-22T10:00:52.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.402+0000 7f7ea5275700 1 -- 172.21.15.45:0/554961428 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e90001110 con 0x7f7ea015bb60 2023-12-22T10:00:52.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.402+0000 7f7ea6277700 1 -- 172.21.15.45:0/554961428 >> v1:172.21.15.113:6789/0 conn(0x7f7ea015bb60 legacy=0x7f7ea0068a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:52.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.402+0000 7f7ea6277700 1 -- 172.21.15.45:0/554961428 >> v1:172.21.15.45:6789/0 conn(0x7f7ea00a8eb0 legacy=0x7f7ea00c10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:52.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.402+0000 7f7ea6277700 1 -- 172.21.15.45:0/554961428 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ea00c1a20 con 0x7f7ea00a8ad0 2023-12-22T10:00:52.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.402+0000 7f7ea6277700 1 --2- 172.21.15.45:0/554961428 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7ea00a8ad0 0x7f7ea0065860 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f7e9c009790 tx=0x7f7e9c009060).ready entity=mon.2 client_cookie=95d814b1630f350e server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:52.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.402+0000 7f7ea5275700 1 -- 172.21.15.45:0/554961428 <== mon.2 v2:172.21.15.113:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e9c00f510 con 0x7f7ea00a8ad0 2023-12-22T10:00:52.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.402+0000 7f7ea5275700 1 -- 172.21.15.45:0/554961428 <== mon.2 v2:172.21.15.113:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e9c00f670 con 0x7f7ea00a8ad0 2023-12-22T10:00:52.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.402+0000 7f7ea5275700 1 -- 172.21.15.45:0/554961428 <== mon.2 v2:172.21.15.113:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e9c00f9f0 con 0x7f7ea00a8ad0 2023-12-22T10:00:52.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.406+0000 7f7ea7279700 1 -- 172.21.15.45:0/554961428 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7ea00a8ad0 msgr2=0x7f7ea0065860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:52.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.406+0000 7f7ea7279700 1 --2- 172.21.15.45:0/554961428 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7ea00a8ad0 0x7f7ea0065860 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f7e9c009790 tx=0x7f7e9c009060).stop 2023-12-22T10:00:52.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.406+0000 7f7ea7279700 1 -- 172.21.15.45:0/554961428 shutdown_connections 2023-12-22T10:00:52.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.406+0000 7f7ea7279700 1 --2- 172.21.15.45:0/554961428 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7ea00a8ad0 0x7f7ea0065860 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:52.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.406+0000 7f7ea7279700 1 -- 172.21.15.45:0/554961428 >> 172.21.15.45:0/554961428 conn(0x7f7ea0067540 msgr2=0x7f7ea00c6460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:52.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.406+0000 7f7ea7279700 1 -- 172.21.15.45:0/554961428 shutdown_connections 2023-12-22T10:00:52.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.406+0000 7f7ea7279700 1 -- 172.21.15.45:0/554961428 wait complete. 2023-12-22T10:00:52.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.406+0000 7f7ea7279700 1 Processor -- start 2023-12-22T10:00:52.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.406+0000 7f7ea7279700 1 -- start start 2023-12-22T10:00:52.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.410+0000 7f7ea7279700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ea00a8ad0 0x7f7ea014eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:52.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.410+0000 7f7ea7279700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7ea015bb60 0x7f7ea015acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:52.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.410+0000 7f7ea7279700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7ea015b1a0 0x7f7ea00ab3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:52.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.410+0000 7f7ea7279700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea00aa120 con 0x7f7ea00a8ad0 2023-12-22T10:00:52.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.410+0000 7f7ea7279700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea00a9550 con 0x7f7ea015bb60 2023-12-22T10:00:52.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.410+0000 7f7ea7279700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea00a97f0 con 0x7f7ea015b1a0 2023-12-22T10:00:52.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.410+0000 7f7ea6277700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ea00a8ad0 0x7f7ea014eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:52.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.410+0000 7f7ea6277700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ea00a8ad0 0x7f7ea014eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34682/0 (socket says 172.21.15.45:34682) 2023-12-22T10:00:52.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.410+0000 7f7ea6277700 1 -- 172.21.15.45:0/341192413 learned_addr learned my addr 172.21.15.45:0/341192413 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:52.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.410+0000 7f7ea5a76700 1 --2- 172.21.15.45:0/341192413 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7ea015bb60 0x7f7ea015acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:52.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.410+0000 7f7ea6a78700 1 --2- 172.21.15.45:0/341192413 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7ea015b1a0 0x7f7ea00ab3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:52.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.410+0000 7f7ea6277700 1 -- 172.21.15.45:0/341192413 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7ea015b1a0 msgr2=0x7f7ea00ab3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:52.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.410+0000 7f7ea6277700 1 --2- 172.21.15.45:0/341192413 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7ea015b1a0 0x7f7ea00ab3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:52.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.410+0000 7f7ea6277700 1 -- 172.21.15.45:0/341192413 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7ea015bb60 msgr2=0x7f7ea015acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:52.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.410+0000 7f7ea6277700 1 --2- 172.21.15.45:0/341192413 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7ea015bb60 0x7f7ea015acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:52.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.410+0000 7f7ea6277700 1 -- 172.21.15.45:0/341192413 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e9c0092a0 con 0x7f7ea00a8ad0 2023-12-22T10:00:52.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.410+0000 7f7ea6a78700 1 --2- 172.21.15.45:0/341192413 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7ea015b1a0 0x7f7ea00ab3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-12-22T10:00:52.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.410+0000 7f7ea6277700 1 --2- 172.21.15.45:0/341192413 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ea00a8ad0 0x7f7ea014eb80 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f7e9c006d30 tx=0x7f7e9c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:52.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.410+0000 7f7e967fc700 1 -- 172.21.15.45:0/341192413 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e9c00f7e0 con 0x7f7ea00a8ad0 2023-12-22T10:00:52.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.410+0000 7f7e967fc700 1 -- 172.21.15.45:0/341192413 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e9c00f940 con 0x7f7ea00a8ad0 2023-12-22T10:00:52.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.410+0000 7f7e967fc700 1 -- 172.21.15.45:0/341192413 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e9c0236b0 con 0x7f7ea00a8ad0 2023-12-22T10:00:52.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.410+0000 7f7ea7279700 1 -- 172.21.15.45:0/341192413 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ea00a9ad0 con 0x7f7ea00a8ad0 2023-12-22T10:00:52.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.410+0000 7f7ea7279700 1 -- 172.21.15.45:0/341192413 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ea0169620 con 0x7f7ea00a8ad0 2023-12-22T10:00:52.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.414+0000 7f7ea7279700 1 -- 172.21.15.45:0/341192413 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ea0158180 con 0x7f7ea00a8ad0 2023-12-22T10:00:52.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.414+0000 7f7e967fc700 1 -- 172.21.15.45:0/341192413 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f7e9c023a60 con 0x7f7ea00a8ad0 2023-12-22T10:00:52.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.414+0000 7f7e967fc700 1 --2- 172.21.15.45:0/341192413 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f7e8405a540 0x7f7e8405ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:52.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.414+0000 7f7e967fc700 1 -- 172.21.15.45:0/341192413 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f7e9c075a40 con 0x7f7ea00a8ad0 2023-12-22T10:00:52.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.418+0000 7f7ea5a76700 1 --2- 172.21.15.45:0/341192413 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f7e8405a540 0x7f7e8405ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:52.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.418+0000 7f7ea5a76700 1 --2- 172.21.15.45:0/341192413 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f7e8405a540 0x7f7e8405ca00 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f7ea00a8880 tx=0x7f7e90009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:52.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.422+0000 7f7e967fc700 1 -- 172.21.15.45:0/341192413 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f7ea0158180 con 0x7f7ea00a8ad0 2023-12-22T10:00:52.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.618+0000 7f7ea7279700 1 -- 172.21.15.45:0/341192413 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7ea0158180 con 0x7f7ea00a8ad0 2023-12-22T10:00:52.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.622+0000 7f7e967fc700 1 -- 172.21.15.45:0/341192413 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4489 (secure 0 0 0) 0x7f7ea0158180 con 0x7f7ea00a8ad0 2023-12-22T10:00:52.618 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:00:52.618 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6833/3021221178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6832","nonce":3021221178},{"type":"v1","addr":"172.21.15.113:6833","nonce":3021221178}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6835/1307046651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":1307046651},{"type":"v1","addr":"172.21.15.113:6835","nonce":1307046651}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/3043486757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":3043486757},{"type":"v1","addr":"172.21.15.45:6835","nonce":3043486757}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T10:00:33.522493+0000","modified":"2023-12-22T10:00:36.550815+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6837/1007404834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":1007404834},{"type":"v1","addr":"172.21.15.45:6837","nonce":1007404834}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-12-22T10:00:52.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.622+0000 7f7ea7279700 1 -- 172.21.15.45:0/341192413 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f7e8405a540 msgr2=0x7f7e8405ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:52.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.622+0000 7f7ea7279700 1 --2- 172.21.15.45:0/341192413 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f7e8405a540 0x7f7e8405ca00 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f7ea00a8880 tx=0x7f7e90009040).stop 2023-12-22T10:00:52.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.622+0000 7f7ea7279700 1 -- 172.21.15.45:0/341192413 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ea00a8ad0 msgr2=0x7f7ea014eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:52.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.622+0000 7f7ea7279700 1 --2- 172.21.15.45:0/341192413 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ea00a8ad0 0x7f7ea014eb80 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f7e9c006d30 tx=0x7f7e9c017000).stop 2023-12-22T10:00:52.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.622+0000 7f7ea7279700 1 -- 172.21.15.45:0/341192413 shutdown_connections 2023-12-22T10:00:52.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.622+0000 7f7ea7279700 1 --2- 172.21.15.45:0/341192413 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f7e8405a540 0x7f7e8405ca00 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:52.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.622+0000 7f7ea7279700 1 --2- 172.21.15.45:0/341192413 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7ea015b1a0 0x7f7ea00ab3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:52.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.622+0000 7f7ea7279700 1 --2- 172.21.15.45:0/341192413 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7ea015bb60 0x7f7ea015acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:52.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.622+0000 7f7ea7279700 1 --2- 172.21.15.45:0/341192413 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ea00a8ad0 0x7f7ea014eb80 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:52.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.622+0000 7f7ea7279700 1 -- 172.21.15.45:0/341192413 >> 172.21.15.45:0/341192413 conn(0x7f7ea0067540 msgr2=0x7f7ea014fb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:52.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.626+0000 7f7ea7279700 1 -- 172.21.15.45:0/341192413 shutdown_connections 2023-12-22T10:00:52.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:52.626+0000 7f7ea7279700 1 -- 172.21.15.45:0/341192413 wait complete. 2023-12-22T10:00:52.622 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 8 2023-12-22T10:00:53.043 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-22T10:00:33.522493+0000', 'modified': '2023-12-22T10:00:36.550815+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4260}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4260': {'gid': 4260, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.45:6837/1007404834', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.45:6836', 'nonce': 1007404834}, {'type': 'v1', 'addr': '172.21.15.45:6837', 'nonce': 1007404834}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-12-22T10:00:53.043 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-22T10:00:53.043 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-12-22T10:00:53.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.234+0000 7efda0b07700 1 Processor -- start 2023-12-22T10:00:53.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.234+0000 7efda0b07700 1 -- start start 2023-12-22T10:00:53.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.238+0000 7efda0b07700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7efd9c1518f0 0x7efd9c0a9b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:53.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.238+0000 7efda0b07700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7efd9c151cd0 0x7efd9c065790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:53.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.238+0000 7efda0b07700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd9c069450 con 0x7efd9c0bbdd0 2023-12-22T10:00:53.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.238+0000 7efda0b07700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd9c068b20 con 0x7efd9c1518f0 2023-12-22T10:00:53.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.238+0000 7efda0b07700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd9c068e00 con 0x7efd9c151cd0 2023-12-22T10:00:53.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.238+0000 7efd9b7fe700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7efd9c1518f0 0x7efd9c0a9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:53.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.238+0000 7efd9affd700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7efd9c151cd0 0x7efd9c065790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:53.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.238+0000 7efd9affd700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7efd9c151cd0 0x7efd9c065790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.113:3301/0 says I am v2:172.21.15.45:43872/0 (socket says 172.21.15.45:43872) 2023-12-22T10:00:53.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.238+0000 7efd9affd700 1 -- 172.21.15.45:0/2951849717 learned_addr learned my addr 172.21.15.45:0/2951849717 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:53.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.238+0000 7efd9affd700 1 -- 172.21.15.45:0/2951849717 >> v2:172.21.15.113:3300/0 conn(0x7efd9c1518f0 msgr2=0x7efd9c0a9b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:00:53.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.238+0000 7efd9affd700 1 --2- 172.21.15.45:0/2951849717 >> v2:172.21.15.113:3300/0 conn(0x7efd9c1518f0 0x7efd9c0a9b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:53.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.238+0000 7efd9affd700 1 -- 172.21.15.45:0/2951849717 >> v1:172.21.15.113:6789/0 conn(0x7efd9c0bbdd0 legacy=0x7efd9c155620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:53.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.238+0000 7efd9affd700 1 -- 172.21.15.45:0/2951849717 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd9c0690e0 con 0x7efd9c151cd0 2023-12-22T10:00:53.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.242+0000 7efd9affd700 1 --2- 172.21.15.45:0/2951849717 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7efd9c151cd0 0x7efd9c065790 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7efd90006fd0 tx=0x7efd900090f0).ready entity=mon.2 client_cookie=c168948cec422cfd server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:53.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.242+0000 7efd9a7fc700 1 -- 172.21.15.45:0/2951849717 <== mon.2 v2:172.21.15.113:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd9000b580 con 0x7efd9c151cd0 2023-12-22T10:00:53.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.242+0000 7efd9a7fc700 1 -- 172.21.15.45:0/2951849717 <== mon.2 v2:172.21.15.113:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd9000b6e0 con 0x7efd9c151cd0 2023-12-22T10:00:53.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.242+0000 7efd9a7fc700 1 -- 172.21.15.45:0/2951849717 <== mon.2 v2:172.21.15.113:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd9000ba80 con 0x7efd9c151cd0 2023-12-22T10:00:53.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.242+0000 7efda0b07700 1 -- 172.21.15.45:0/2951849717 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7efd9c151cd0 msgr2=0x7efd9c065790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:53.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.242+0000 7efda0b07700 1 --2- 172.21.15.45:0/2951849717 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7efd9c151cd0 0x7efd9c065790 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7efd90006fd0 tx=0x7efd900090f0).stop 2023-12-22T10:00:53.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.242+0000 7efda0b07700 1 -- 172.21.15.45:0/2951849717 shutdown_connections 2023-12-22T10:00:53.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.242+0000 7efda0b07700 1 --2- 172.21.15.45:0/2951849717 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7efd9c151cd0 0x7efd9c065790 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:53.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.242+0000 7efda0b07700 1 --2- 172.21.15.45:0/2951849717 >> v2:172.21.15.113:3300/0 conn(0x7efd9c1518f0 0x7efd9c0a9b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:53.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.242+0000 7efda0b07700 1 -- 172.21.15.45:0/2951849717 >> 172.21.15.45:0/2951849717 conn(0x7efd9c067500 msgr2=0x7efd9c0c6400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:53.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.242+0000 7efda0b07700 1 -- 172.21.15.45:0/2951849717 shutdown_connections 2023-12-22T10:00:53.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.242+0000 7efda0b07700 1 -- 172.21.15.45:0/2951849717 wait complete. 2023-12-22T10:00:53.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.246+0000 7efda0b07700 1 Processor -- start 2023-12-22T10:00:53.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.246+0000 7efda0b07700 1 -- start start 2023-12-22T10:00:53.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.246+0000 7efda0b07700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd9c0bbdd0 0x7efd9c1576f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:53.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.246+0000 7efda0b07700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7efd9c1518f0 0x7efd9c14a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:53.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.246+0000 7efda0b07700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efd9c151cd0 0x7efd9c164440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:53.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.246+0000 7efda0b07700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd9c1599b0 con 0x7efd9c0bbdd0 2023-12-22T10:00:53.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.246+0000 7efda0b07700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd9c152df0 con 0x7efd9c151cd0 2023-12-22T10:00:53.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.246+0000 7efda0b07700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd9c1521e0 con 0x7efd9c1518f0 2023-12-22T10:00:53.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.250+0000 7efd9b7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd9c0bbdd0 0x7efd9c1576f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:53.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.250+0000 7efd9bfff700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efd9c151cd0 0x7efd9c164440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:53.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.250+0000 7efd9affd700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7efd9c1518f0 0x7efd9c14a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:53.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.250+0000 7efd9b7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd9c0bbdd0 0x7efd9c1576f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34684/0 (socket says 172.21.15.45:34684) 2023-12-22T10:00:53.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.250+0000 7efd9b7fe700 1 -- 172.21.15.45:0/2091417160 learned_addr learned my addr 172.21.15.45:0/2091417160 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:53.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.250+0000 7efd9bfff700 1 -- 172.21.15.45:0/2091417160 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7efd9c1518f0 msgr2=0x7efd9c14a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:53.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.250+0000 7efd9bfff700 1 --2- 172.21.15.45:0/2091417160 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7efd9c1518f0 0x7efd9c14a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:53.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.250+0000 7efd9bfff700 1 -- 172.21.15.45:0/2091417160 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd9c0bbdd0 msgr2=0x7efd9c1576f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:53.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.250+0000 7efd9bfff700 1 --2- 172.21.15.45:0/2091417160 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd9c0bbdd0 0x7efd9c1576f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:53.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.250+0000 7efd9bfff700 1 -- 172.21.15.45:0/2091417160 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd90009370 con 0x7efd9c151cd0 2023-12-22T10:00:53.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.250+0000 7efd9bfff700 1 --2- 172.21.15.45:0/2091417160 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efd9c151cd0 0x7efd9c164440 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7efd940013d0 tx=0x7efd94001530).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:53.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.250+0000 7efd837fe700 1 -- 172.21.15.45:0/2091417160 <== mon.1 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd9400e4a0 con 0x7efd9c151cd0 2023-12-22T10:00:53.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.250+0000 7efd837fe700 1 -- 172.21.15.45:0/2091417160 <== mon.1 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd9400e600 con 0x7efd9c151cd0 2023-12-22T10:00:53.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.250+0000 7efd837fe700 1 -- 172.21.15.45:0/2091417160 <== mon.1 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd9400e980 con 0x7efd9c151cd0 2023-12-22T10:00:53.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.250+0000 7efda0b07700 1 -- 172.21.15.45:0/2091417160 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd9c1524c0 con 0x7efd9c151cd0 2023-12-22T10:00:53.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.250+0000 7efda0b07700 1 -- 172.21.15.45:0/2091417160 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd9c152a80 con 0x7efd9c151cd0 2023-12-22T10:00:53.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.254+0000 7efd837fe700 1 -- 172.21.15.45:0/2091417160 <== mon.1 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7efd940123f0 con 0x7efd9c151cd0 2023-12-22T10:00:53.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.254+0000 7efdac114740 1 Processor -- start 2023-12-22T10:00:53.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.258+0000 7efdac114740 1 -- start start 2023-12-22T10:00:53.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.258+0000 7efd837fe700 1 --2- 172.21.15.45:0/2091417160 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7efd8805a510 0x7efd8805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:53.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.258+0000 7efd837fe700 1 -- 172.21.15.45:0/2091417160 <== mon.1 v2:172.21.15.113:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7efd94074000 con 0x7efd9c151cd0 2023-12-22T10:00:53.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.258+0000 7efd9affd700 1 --2- 172.21.15.45:0/2091417160 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7efd8805a510 0x7efd8805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:53.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.258+0000 7efdac114740 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x1aeaad0 0x1b11090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:53.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.258+0000 7efdac114740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x1aeaeb0 0x1b37140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:53.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.258+0000 7efdac114740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1b37630 0x1b37ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:53.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.258+0000 7efdac114740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a6b410 con 0x1b37630 2023-12-22T10:00:53.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.258+0000 7efdac114740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a6b550 con 0x1aeaeb0 2023-12-22T10:00:53.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.258+0000 7efdac114740 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x1a6ba00 con 0x1aeaad0 2023-12-22T10:00:53.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.258+0000 7efd9bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1b37630 0x1b37ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:53.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.258+0000 7efd9bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1b37630 0x1b37ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34688/0 (socket says 172.21.15.45:34688) 2023-12-22T10:00:53.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.258+0000 7efd9bfff700 1 -- 172.21.15.45:0/126798163 learned_addr learned my addr 172.21.15.45:0/126798163 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:53.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.258+0000 7efd9b7fe700 1 --2- 172.21.15.45:0/126798163 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x1aeaad0 0x1b11090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:53.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.258+0000 7efd9bfff700 1 -- 172.21.15.45:0/126798163 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x1aeaad0 msgr2=0x1b11090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:00:53.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.258+0000 7efd9bfff700 1 --2- 172.21.15.45:0/126798163 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x1aeaad0 0x1b11090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:53.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.258+0000 7efd9bfff700 1 -- 172.21.15.45:0/126798163 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x1aeaeb0 msgr2=0x1b37140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:00:53.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.258+0000 7efd9affd700 1 --2- 172.21.15.45:0/126798163 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x1aeaeb0 0x1b37140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:53.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.258+0000 7efd9bfff700 1 --2- 172.21.15.45:0/126798163 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x1aeaeb0 0x1b37140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:53.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.258+0000 7efd9bfff700 1 -- 172.21.15.45:0/126798163 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1a64730 con 0x1b37630 2023-12-22T10:00:53.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.258+0000 7efd9affd700 1 --2- 172.21.15.45:0/126798163 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x1aeaeb0 0x1b37140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-12-22T10:00:53.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.258+0000 7efd9affd700 1 --2- 172.21.15.45:0/2091417160 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7efd8805a510 0x7efd8805c9d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7efd9c152110 tx=0x7efd90017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:53.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.258+0000 7efd9bfff700 1 --2- 172.21.15.45:0/126798163 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1b37630 0x1b37ab0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7efd9404b2b0 tx=0x7efd9400f000).ready entity=mon.0 client_cookie=6cf85d429785b4be server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:53.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.258+0000 7efd80ff9700 1 -- 172.21.15.45:0/126798163 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd9404b320 con 0x1b37630 2023-12-22T10:00:53.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.258+0000 7efd80ff9700 1 -- 172.21.15.45:0/126798163 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd94050ac0 con 0x1b37630 2023-12-22T10:00:53.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.258+0000 7efd80ff9700 1 -- 172.21.15.45:0/126798163 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd9400ed70 con 0x1b37630 2023-12-22T10:00:53.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.258+0000 7efdac114740 1 -- 172.21.15.45:0/126798163 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1b37630 msgr2=0x1b37ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:53.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.258+0000 7efdac114740 1 --2- 172.21.15.45:0/126798163 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1b37630 0x1b37ab0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7efd9404b2b0 tx=0x7efd9400f000).stop 2023-12-22T10:00:53.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.262+0000 7efdac114740 1 -- 172.21.15.45:0/126798163 shutdown_connections 2023-12-22T10:00:53.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.262+0000 7efdac114740 1 --2- 172.21.15.45:0/126798163 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1b37630 0x1b37ab0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:53.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.262+0000 7efdac114740 1 --2- 172.21.15.45:0/126798163 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x1aeaeb0 0x1b37140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:53.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.262+0000 7efdac114740 1 --2- 172.21.15.45:0/126798163 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x1aeaad0 0x1b11090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:53.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.262+0000 7efdac114740 1 -- 172.21.15.45:0/126798163 >> 172.21.15.45:0/126798163 conn(0x18c9550 msgr2=0x1ae97e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:53.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.262+0000 7efdac114740 1 -- 172.21.15.45:0/126798163 shutdown_connections 2023-12-22T10:00:53.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.262+0000 7efdac114740 1 -- 172.21.15.45:0/126798163 wait complete. 2023-12-22T10:00:53.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.262+0000 7efdac114740 1 -- start start 2023-12-22T10:00:53.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.262+0000 7efdac114740 1 Processor -- start 2023-12-22T10:00:53.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.262+0000 7efdac114740 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x1aeaad0 0x1b0fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:53.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.262+0000 7efdac114740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1aeaeb0 0x1b175d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:53.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.262+0000 7efdac114740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x1b37630 0x1aeb650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:53.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.262+0000 7efdac114740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a36650 con 0x1aeaeb0 2023-12-22T10:00:53.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.262+0000 7efdac114740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x1b12800 con 0x1b37630 2023-12-22T10:00:53.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.262+0000 7efdac114740 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x1b32f50 con 0x1aeaad0 2023-12-22T10:00:53.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.262+0000 7efdac114740 10 client.0 ll_register_callbacks cb 0x1aa3020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-22T10:00:53.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.266+0000 7efd9affd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1aeaeb0 0x1b175d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:53.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.266+0000 7efd9affd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1aeaeb0 0x1b175d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34704/0 (socket says 172.21.15.45:34704) 2023-12-22T10:00:53.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.266+0000 7efd9affd700 1 -- 172.21.15.45:0/2638997199 learned_addr learned my addr 172.21.15.45:0/2638997199 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:53.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.266+0000 7efd9bfff700 1 --2- 172.21.15.45:0/2638997199 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x1b37630 0x1aeb650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:53.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.266+0000 7efd9b7fe700 1 --2- 172.21.15.45:0/2638997199 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x1aeaad0 0x1b0fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:53.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.266+0000 7efd9affd700 1 -- 172.21.15.45:0/2638997199 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x1aeaad0 msgr2=0x1b0fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:00:53.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.266+0000 7efd9affd700 1 --2- 172.21.15.45:0/2638997199 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x1aeaad0 0x1b0fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:53.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.266+0000 7efd9affd700 1 -- 172.21.15.45:0/2638997199 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x1b37630 msgr2=0x1aeb650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:00:53.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.266+0000 7efd9affd700 1 --2- 172.21.15.45:0/2638997199 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x1b37630 0x1aeb650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:53.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.266+0000 7efd9affd700 1 -- 172.21.15.45:0/2638997199 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd9c152a80 con 0x1aeaeb0 2023-12-22T10:00:53.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.266+0000 7efd9affd700 1 --2- 172.21.15.45:0/2638997199 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1aeaeb0 0x1b175d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7efd90009ea0 tx=0x7efd90022070).ready entity=mon.0 client_cookie=567bc7ccd7070791 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:53.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.266+0000 7efd79ffb700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-12-22T10:00:53.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.266+0000 7efd79ffb700 1 -- 172.21.15.45:0/2638997199 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd90011400 con 0x1aeaeb0 2023-12-22T10:00:53.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.266+0000 7efdac114740 1 -- 172.21.15.45:0/2638997199 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1a611a0 con 0x1aeaeb0 2023-12-22T10:00:53.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.266+0000 7efd79ffb700 1 -- 172.21.15.45:0/2638997199 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7efd90011560 con 0x1aeaeb0 2023-12-22T10:00:53.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.266+0000 7efd79ffb700 1 -- 172.21.15.45:0/2638997199 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7efd90011930 con 0x1aeaeb0 2023-12-22T10:00:53.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.266+0000 7efdac114740 10 client.4644 fetch_fsmap learned FSMap version 8 2023-12-22T10:00:53.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.266+0000 7efdac114740 1 -- 172.21.15.45:0/2638997199 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x1a5f960 con 0x1aeaeb0 2023-12-22T10:00:53.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.266+0000 7efd79ffb700 1 -- 172.21.15.45:0/2638997199 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1a611a0 con 0x1aeaeb0 2023-12-22T10:00:53.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.266+0000 7efd79ffb700 1 -- 172.21.15.45:0/2638997199 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 8) v1 ==== 3100+0+0 (secure 0 0 0) 0x7efd9002f020 con 0x1aeaeb0 2023-12-22T10:00:53.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.266+0000 7efdac114740 10 client.4644 fetch_fsmap finished waiting for FSMap version 8 2023-12-22T10:00:53.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.266+0000 7efdac114740 10 client.4644 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-22T10:00:53.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.266+0000 7efdac114740 20 client.4644 populate_metadata read hostname 'smithi045' 2023-12-22T10:00:53.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.266+0000 7efdac114740 1 --2- 172.21.15.45:0/2638997199 >> [v2:172.21.15.45:6836/1007404834,v1:172.21.15.45:6837/1007404834] conn(0x1b35fa0 0x1b4ad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:53.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.266+0000 7efdac114740 4 client.4644 mds_command: new command op to 4260 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-22T10:00:53.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.266+0000 7efdac114740 1 -- 172.21.15.45:0/2638997199 --> [v2:172.21.15.45:6836/1007404834,v1:172.21.15.45:6837/1007404834] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1a576f0 con 0x1b35fa0 2023-12-22T10:00:53.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.266+0000 7efd9b7fe700 1 --2- 172.21.15.45:0/2638997199 >> [v2:172.21.15.45:6836/1007404834,v1:172.21.15.45:6837/1007404834] conn(0x1b35fa0 0x1b4ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:53.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.270+0000 7efd79ffb700 10 client.4644 ms_handle_connect on v2:172.21.15.45:6836/1007404834 2023-12-22T10:00:53.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.270+0000 7efd9b7fe700 1 --2- 172.21.15.45:0/2638997199 >> [v2:172.21.15.45:6836/1007404834,v1:172.21.15.45:6837/1007404834] conn(0x1b35fa0 0x1b4ad70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=a75ed4f96867f57e server_cookie=56c4bb8b40d7f86d in_seq=0 out_seq=0 2023-12-22T10:00:53.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.270+0000 7efd79ffb700 1 -- 172.21.15.45:0/2638997199 <== mds.0 v2:172.21.15.45:6836/1007404834 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x1a576f0 con 0x1b35fa0 2023-12-22T10:00:53.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.270+0000 7efd79ffb700 10 client.4644 handle_command_reply: tid=0 2023-12-22T10:00:53.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.270+0000 7efdac114740 1 client.4644 shutdown 2023-12-22T10:00:53.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.270+0000 7efdac114740 1 -- 172.21.15.45:0/2638997199 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1aeaeb0 msgr2=0x1b175d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:53.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.270+0000 7efdac114740 1 --2- 172.21.15.45:0/2638997199 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1aeaeb0 0x1b175d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7efd90009ea0 tx=0x7efd90022070).stop 2023-12-22T10:00:53.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.270+0000 7efdac114740 1 -- 172.21.15.45:0/2638997199 shutdown_connections 2023-12-22T10:00:53.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.270+0000 7efdac114740 1 --2- 172.21.15.45:0/2638997199 >> [v2:172.21.15.45:6836/1007404834,v1:172.21.15.45:6837/1007404834] conn(0x1b35fa0 0x1b4ad70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:53.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.270+0000 7efdac114740 1 --2- 172.21.15.45:0/2638997199 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x1b37630 0x1aeb650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:53.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.270+0000 7efdac114740 1 --2- 172.21.15.45:0/2638997199 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1aeaeb0 0x1b175d0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:53.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.270+0000 7efdac114740 1 --2- 172.21.15.45:0/2638997199 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x1aeaad0 0x1b0fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:53.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.270+0000 7efdac114740 1 -- 172.21.15.45:0/2638997199 >> 172.21.15.45:0/2638997199 conn(0x18c9550 msgr2=0x1b32580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:53.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.270+0000 7efd79ffb700 0 client.4644 ms_handle_reset on v2:172.21.15.45:6836/1007404834 2023-12-22T10:00:53.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.270+0000 7efdac114740 1 -- 172.21.15.45:0/2638997199 shutdown_connections 2023-12-22T10:00:53.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.270+0000 7efdac114740 1 -- 172.21.15.45:0/2638997199 wait complete. 2023-12-22T10:00:53.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.270+0000 7efdac114740 20 client.4644 trim_cache size 0 max 16384 2023-12-22T10:00:53.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.290+0000 7efdac114740 1 Processor -- start 2023-12-22T10:00:53.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.290+0000 7efdac114740 1 -- start start 2023-12-22T10:00:53.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.294+0000 7efdac114740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x1aeaad0 0x1b2b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:53.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.294+0000 7efdac114740 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x1aeaeb0 0x1b28770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:53.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.294+0000 7efdac114740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1b37630 0x1ae43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:53.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.294+0000 7efdac114740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x1ae7980 con 0x1b37630 2023-12-22T10:00:53.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.294+0000 7efdac114740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x1b17d20 con 0x1aeaad0 2023-12-22T10:00:53.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.294+0000 7efdac114740 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x1ae8d50 con 0x1aeaeb0 2023-12-22T10:00:53.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.294+0000 7efd9affd700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x1aeaeb0 0x1b28770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:53.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.294+0000 7efd9bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1b37630 0x1ae43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:53.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.294+0000 7efd9affd700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x1aeaeb0 0x1b28770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.113:3301/0 says I am v2:172.21.15.45:43914/0 (socket says 172.21.15.45:43914) 2023-12-22T10:00:53.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.294+0000 7efd9affd700 1 -- 172.21.15.45:0/3264844994 learned_addr learned my addr 172.21.15.45:0/3264844994 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:53.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.294+0000 7efd9b7fe700 1 --2- 172.21.15.45:0/3264844994 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x1aeaad0 0x1b2b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:53.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.294+0000 7efd9affd700 1 -- 172.21.15.45:0/3264844994 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x1aeaad0 msgr2=0x1b2b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:00:53.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.294+0000 7efd9affd700 1 --2- 172.21.15.45:0/3264844994 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x1aeaad0 0x1b2b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:53.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.294+0000 7efd9affd700 1 -- 172.21.15.45:0/3264844994 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1b37630 msgr2=0x1ae43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:00:53.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.294+0000 7efd9affd700 1 --2- 172.21.15.45:0/3264844994 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1b37630 0x1ae43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:53.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.294+0000 7efd9affd700 1 -- 172.21.15.45:0/3264844994 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd9c164c90 con 0x1aeaeb0 2023-12-22T10:00:53.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.294+0000 7efd9b7fe700 1 --2- 172.21.15.45:0/3264844994 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x1aeaad0 0x1b2b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T10:00:53.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.294+0000 7efd9affd700 1 --2- 172.21.15.45:0/3264844994 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x1aeaeb0 0x1b28770 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7efd90000d30 tx=0x7efd9002a000).ready entity=mon.2 client_cookie=a9b770cfedc3c767 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:53.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.294+0000 7efd817fa700 1 -- 172.21.15.45:0/3264844994 <== mon.2 v2:172.21.15.113:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd9000bb60 con 0x1aeaeb0 2023-12-22T10:00:53.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.294+0000 7efd817fa700 1 -- 172.21.15.45:0/3264844994 <== mon.2 v2:172.21.15.113:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd9000bcc0 con 0x1aeaeb0 2023-12-22T10:00:53.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.294+0000 7efd817fa700 1 -- 172.21.15.45:0/3264844994 <== mon.2 v2:172.21.15.113:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd90011b60 con 0x1aeaeb0 2023-12-22T10:00:53.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.294+0000 7efdac114740 1 -- 172.21.15.45:0/3264844994 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x1aeaeb0 msgr2=0x1b28770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:53.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.294+0000 7efdac114740 1 --2- 172.21.15.45:0/3264844994 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x1aeaeb0 0x1b28770 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7efd90000d30 tx=0x7efd9002a000).stop 2023-12-22T10:00:53.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.294+0000 7efdac114740 1 -- 172.21.15.45:0/3264844994 shutdown_connections 2023-12-22T10:00:53.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.294+0000 7efdac114740 1 --2- 172.21.15.45:0/3264844994 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1b37630 0x1ae43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:53.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.294+0000 7efdac114740 1 --2- 172.21.15.45:0/3264844994 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x1aeaeb0 0x1b28770 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:53.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.294+0000 7efdac114740 1 --2- 172.21.15.45:0/3264844994 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x1aeaad0 0x1b2b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:53.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.294+0000 7efdac114740 1 -- 172.21.15.45:0/3264844994 >> 172.21.15.45:0/3264844994 conn(0x18c9550 msgr2=0x1b109a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:53.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.294+0000 7efdac114740 1 -- 172.21.15.45:0/3264844994 shutdown_connections 2023-12-22T10:00:53.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.294+0000 7efdac114740 1 -- 172.21.15.45:0/3264844994 wait complete. 2023-12-22T10:00:53.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.298+0000 7efdac114740 1 -- start start 2023-12-22T10:00:53.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.298+0000 7efdac114740 1 Processor -- start 2023-12-22T10:00:53.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.298+0000 7efdac114740 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x1aeaad0 0x1ae43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:53.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.298+0000 7efdac114740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1aeaeb0 0x1ae48b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:53.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.298+0000 7efdac114740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x1b37630 0x1b93520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:53.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.298+0000 7efdac114740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x1b0ff20 con 0x1aeaeb0 2023-12-22T10:00:53.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.298+0000 7efdac114740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x1ae4da0 con 0x1b37630 2023-12-22T10:00:53.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.298+0000 7efdac114740 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x1b0fcd0 con 0x1aeaad0 2023-12-22T10:00:53.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.298+0000 7efdac114740 10 client.0 ll_register_callbacks cb 0x7efd900090f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-22T10:00:53.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.298+0000 7efd9affd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1aeaeb0 0x1ae48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:53.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.298+0000 7efd9affd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1aeaeb0 0x1ae48b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34718/0 (socket says 172.21.15.45:34718) 2023-12-22T10:00:53.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.298+0000 7efd9affd700 1 -- 172.21.15.45:0/1209825175 learned_addr learned my addr 172.21.15.45:0/1209825175 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:53.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.298+0000 7efd9bfff700 1 --2- 172.21.15.45:0/1209825175 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x1b37630 0x1b93520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:53.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.298+0000 7efd9b7fe700 1 --2- 172.21.15.45:0/1209825175 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x1aeaad0 0x1ae43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:53.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.298+0000 7efd9affd700 1 -- 172.21.15.45:0/1209825175 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x1aeaad0 msgr2=0x1ae43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:00:53.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.298+0000 7efd9affd700 1 --2- 172.21.15.45:0/1209825175 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x1aeaad0 0x1ae43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:53.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.298+0000 7efd9affd700 1 -- 172.21.15.45:0/1209825175 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x1b37630 msgr2=0x1b93520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:00:53.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.298+0000 7efd9affd700 1 --2- 172.21.15.45:0/1209825175 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x1b37630 0x1b93520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:53.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.298+0000 7efd9affd700 1 -- 172.21.15.45:0/1209825175 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x1a5f960 con 0x1aeaeb0 2023-12-22T10:00:53.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.298+0000 7efd9affd700 1 --2- 172.21.15.45:0/1209825175 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1aeaeb0 0x1ae48b0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7efd9000b2a0 tx=0x7efd90020040).ready entity=mon.0 client_cookie=efd4558f7b2cf21f server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:53.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.298+0000 7efd79ffb700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-12-22T10:00:53.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.302+0000 7efd79ffb700 1 -- 172.21.15.45:0/1209825175 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd900313e0 con 0x1aeaeb0 2023-12-22T10:00:53.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.302+0000 7efd79ffb700 1 -- 172.21.15.45:0/1209825175 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7efd90031540 con 0x1aeaeb0 2023-12-22T10:00:53.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.302+0000 7efdac114740 1 -- 172.21.15.45:0/1209825175 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x19204e0 con 0x1aeaeb0 2023-12-22T10:00:53.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.302+0000 7efd79ffb700 1 -- 172.21.15.45:0/1209825175 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7efd90031950 con 0x1aeaeb0 2023-12-22T10:00:53.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.302+0000 7efdac114740 10 client.4650 fetch_fsmap learned FSMap version 8 2023-12-22T10:00:53.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.302+0000 7efdac114740 1 -- 172.21.15.45:0/1209825175 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x1a5f6b0 con 0x1aeaeb0 2023-12-22T10:00:53.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.302+0000 7efd79ffb700 1 -- 172.21.15.45:0/1209825175 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x19204e0 con 0x1aeaeb0 2023-12-22T10:00:53.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.302+0000 7efd79ffb700 1 -- 172.21.15.45:0/1209825175 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 8) v1 ==== 3100+0+0 (secure 0 0 0) 0x7efd90018030 con 0x1aeaeb0 2023-12-22T10:00:53.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.302+0000 7efdac114740 10 client.4650 fetch_fsmap finished waiting for FSMap version 8 2023-12-22T10:00:53.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.302+0000 7efdac114740 10 client.4650 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-22T10:00:53.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.302+0000 7efdac114740 20 client.4650 populate_metadata read hostname 'smithi045' 2023-12-22T10:00:53.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.302+0000 7efdac114740 1 --2- 172.21.15.45:0/1209825175 >> [v2:172.21.15.45:6836/1007404834,v1:172.21.15.45:6837/1007404834] conn(0x1b350c0 0x1b93a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:53.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.302+0000 7efdac114740 4 client.4650 mds_command: new command op to 4260 tid=0[{"prefix": "status"}] 2023-12-22T10:00:53.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.302+0000 7efdac114740 1 -- 172.21.15.45:0/1209825175 --> [v2:172.21.15.45:6836/1007404834,v1:172.21.15.45:6837/1007404834] -- command(tid 0: {"prefix": "status"}) v1 -- 0x18d6260 con 0x1b350c0 2023-12-22T10:00:53.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.302+0000 7efd9b7fe700 1 --2- 172.21.15.45:0/1209825175 >> [v2:172.21.15.45:6836/1007404834,v1:172.21.15.45:6837/1007404834] conn(0x1b350c0 0x1b93a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:53.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.302+0000 7efd9b7fe700 1 --2- 172.21.15.45:0/1209825175 >> [v2:172.21.15.45:6836/1007404834,v1:172.21.15.45:6837/1007404834] conn(0x1b350c0 0x1b93a10 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=29217abf857e2758 server_cookie=de7c9c0493df1d27 in_seq=0 out_seq=0 2023-12-22T10:00:53.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.302+0000 7efd79ffb700 10 client.4650 ms_handle_connect on v2:172.21.15.45:6836/1007404834 2023-12-22T10:00:53.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.302+0000 7efd79ffb700 1 -- 172.21.15.45:0/1209825175 <== mds.0 v2:172.21.15.45:6836/1007404834 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+323 (crc 0 0 0) 0x18d6260 con 0x1b350c0 2023-12-22T10:00:53.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.302+0000 7efd79ffb700 10 client.4650 handle_command_reply: tid=0 2023-12-22T10:00:53.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.302+0000 7efdac114740 1 client.4650 shutdown 2023-12-22T10:00:53.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.302+0000 7efdac114740 1 -- 172.21.15.45:0/1209825175 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1aeaeb0 msgr2=0x1ae48b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:53.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.302+0000 7efdac114740 1 --2- 172.21.15.45:0/1209825175 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1aeaeb0 0x1ae48b0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7efd9000b2a0 tx=0x7efd90020040).stop 2023-12-22T10:00:53.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.302+0000 7efdac114740 1 -- 172.21.15.45:0/1209825175 shutdown_connections 2023-12-22T10:00:53.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.302+0000 7efdac114740 1 --2- 172.21.15.45:0/1209825175 >> [v2:172.21.15.45:6836/1007404834,v1:172.21.15.45:6837/1007404834] conn(0x1b350c0 0x1b93a10 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:53.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.302+0000 7efd79ffb700 0 client.4650 ms_handle_reset on v2:172.21.15.45:6836/1007404834 2023-12-22T10:00:53.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.302+0000 7efdac114740 1 --2- 172.21.15.45:0/1209825175 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x1b37630 0x1b93520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:53.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.302+0000 7efdac114740 1 --2- 172.21.15.45:0/1209825175 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1aeaeb0 0x1ae48b0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:53.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.302+0000 7efdac114740 1 --2- 172.21.15.45:0/1209825175 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x1aeaad0 0x1ae43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:53.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.302+0000 7efdac114740 1 -- 172.21.15.45:0/1209825175 >> 172.21.15.45:0/1209825175 conn(0x18c9550 msgr2=0x1b28770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:53.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.306+0000 7efdac114740 1 -- 172.21.15.45:0/1209825175 shutdown_connections 2023-12-22T10:00:53.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.306+0000 7efdac114740 1 -- 172.21.15.45:0/1209825175 wait complete. 2023-12-22T10:00:53.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.306+0000 7efdac114740 20 client.4650 trim_cache size 0 max 16384 2023-12-22T10:00:53.303 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-22T10:00:53.303 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_fsid": "98b0837e-5e68-4c8f-a1a0-e9424baaad8f", 2023-12-22T10:00:53.303 INFO:teuthology.orchestra.run.smithi045.stdout: "whoami": 0, 2023-12-22T10:00:53.304 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 4260, 2023-12-22T10:00:53.304 INFO:teuthology.orchestra.run.smithi045.stdout: "want_state": "up:active", 2023-12-22T10:00:53.304 INFO:teuthology.orchestra.run.smithi045.stdout: "state": "up:active", 2023-12-22T10:00:53.304 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs", 2023-12-22T10:00:53.304 INFO:teuthology.orchestra.run.smithi045.stdout: "rank_uptime": 19.77888703, 2023-12-22T10:00:53.304 INFO:teuthology.orchestra.run.smithi045.stdout: "mdsmap_epoch": 8, 2023-12-22T10:00:53.304 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch": 21, 2023-12-22T10:00:53.304 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch_barrier": 21, 2023-12-22T10:00:53.304 INFO:teuthology.orchestra.run.smithi045.stdout: "uptime": 25.134594323999998 2023-12-22T10:00:53.304 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-22T10:00:53.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.306+0000 7efda0b07700 1 -- 172.21.15.45:0/2091417160 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7efd8805a510 msgr2=0x7efd8805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:53.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.306+0000 7efda0b07700 1 --2- 172.21.15.45:0/2091417160 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7efd8805a510 0x7efd8805c9d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7efd9c152110 tx=0x7efd90017000).stop 2023-12-22T10:00:53.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.306+0000 7efda0b07700 1 -- 172.21.15.45:0/2091417160 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efd9c151cd0 msgr2=0x7efd9c164440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:53.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.306+0000 7efda0b07700 1 --2- 172.21.15.45:0/2091417160 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efd9c151cd0 0x7efd9c164440 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7efd940013d0 tx=0x7efd94001530).stop 2023-12-22T10:00:53.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.306+0000 7efda0b07700 1 -- 172.21.15.45:0/2091417160 shutdown_connections 2023-12-22T10:00:53.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.306+0000 7efda0b07700 1 --2- 172.21.15.45:0/2091417160 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efd9c151cd0 0x7efd9c164440 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:53.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.306+0000 7efda0b07700 1 --2- 172.21.15.45:0/2091417160 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7efd8805a510 0x7efd8805c9d0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:53.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.306+0000 7efda0b07700 1 --2- 172.21.15.45:0/2091417160 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7efd9c1518f0 0x7efd9c14a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:53.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.306+0000 7efda0b07700 1 --2- 172.21.15.45:0/2091417160 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd9c0bbdd0 0x7efd9c1576f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:53.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.306+0000 7efda0b07700 1 -- 172.21.15.45:0/2091417160 >> 172.21.15.45:0/2091417160 conn(0x7efd9c067500 msgr2=0x7efd9c0aa310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:53.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.306+0000 7efda0b07700 1 -- 172.21.15.45:0/2091417160 shutdown_connections 2023-12-22T10:00:53.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.306+0000 7efda0b07700 1 -- 172.21.15.45:0/2091417160 wait complete. 2023-12-22T10:00:53.324 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-12-22T10:00:53.350 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-12-22T10:00:53.350 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-12-22T10:00:53.350 INFO:tasks.ceph_fuse:client.0 config is {} 2023-12-22T10:00:53.350 INFO:tasks.ceph_fuse:client.2 config is {} 2023-12-22T10:00:53.350 INFO:tasks.ceph_fuse:client.1 config is {} 2023-12-22T10:00:53.350 INFO:tasks.ceph_fuse:client.3 config is {} 2023-12-22T10:00:53.351 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T10:00:53.351 DEBUG:teuthology.orchestra.run.smithi113:> ip netns list 2023-12-22T10:00:53.372 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T10:00:53.372 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip link delete ceph-brx 2023-12-22T10:00:53.466 INFO:teuthology.orchestra.run.smithi113.stderr:Cannot find device "ceph-brx" 2023-12-22T10:00:53.469 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-22T10:00:53.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T10:00:53.470 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2023-12-22T10:00:53.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T10:00:53.490 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link delete ceph-brx 2023-12-22T10:00:53.577 INFO:teuthology.orchestra.run.smithi045.stderr:Cannot find device "ceph-brx" 2023-12-22T10:00:53.579 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-22T10:00:53.579 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-12-22T10:00:53.580 DEBUG:teuthology.orchestra.run.smithi045:> ceph fs ls 2023-12-22T10:00:53.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.766+0000 7fb555369700 1 Processor -- start 2023-12-22T10:00:53.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.766+0000 7fb555369700 1 -- start start 2023-12-22T10:00:53.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.766+0000 7fb555369700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb55014bc80 0x7fb5500c4b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:53.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.770+0000 7fb555369700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb5500c5050 0x7fb5500621b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:53.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.770+0000 7fb555369700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb55014c060 0x7fb5500626a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:53.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.770+0000 7fb555369700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb550065f50 con 0x7fb55014bc80 2023-12-22T10:00:53.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.770+0000 7fb555369700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb550062c70 con 0x7fb5500c5050 2023-12-22T10:00:53.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.770+0000 7fb555369700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb550062f50 con 0x7fb55014c060 2023-12-22T10:00:53.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.770+0000 7fb54effd700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb55014bc80 0x7fb5500c4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:53.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.770+0000 7fb54effd700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb55014bc80 0x7fb5500c4b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34722/0 (socket says 172.21.15.45:34722) 2023-12-22T10:00:53.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.770+0000 7fb54effd700 1 -- 172.21.15.45:0/3768803553 learned_addr learned my addr 172.21.15.45:0/3768803553 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:53.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.770+0000 7fb54f7fe700 1 --2- 172.21.15.45:0/3768803553 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb55014c060 0x7fb5500626a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:53.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.770+0000 7fb547fff700 1 --2- 172.21.15.45:0/3768803553 >> v2:172.21.15.113:3300/0 conn(0x7fb5500c5050 0x7fb5500621b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:53.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.770+0000 7fb54effd700 1 -- 172.21.15.45:0/3768803553 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb55014c060 msgr2=0x7fb5500626a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:00:53.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.770+0000 7fb54effd700 1 --2- 172.21.15.45:0/3768803553 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb55014c060 0x7fb5500626a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:53.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.770+0000 7fb54effd700 1 -- 172.21.15.45:0/3768803553 >> v2:172.21.15.113:3300/0 conn(0x7fb5500c5050 msgr2=0x7fb5500621b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:00:53.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.770+0000 7fb54effd700 1 --2- 172.21.15.45:0/3768803553 >> v2:172.21.15.113:3300/0 conn(0x7fb5500c5050 0x7fb5500621b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:53.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.770+0000 7fb54effd700 1 -- 172.21.15.45:0/3768803553 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb550065900 con 0x7fb55014bc80 2023-12-22T10:00:53.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.770+0000 7fb547fff700 1 --2- 172.21.15.45:0/3768803553 >> v2:172.21.15.113:3300/0 conn(0x7fb5500c5050 0x7fb5500621b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T10:00:53.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.770+0000 7fb54effd700 1 --2- 172.21.15.45:0/3768803553 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb55014bc80 0x7fb5500c4b60 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7fb5500636a0 tx=0x7fb5400090f0).ready entity=mon.0 client_cookie=20f91b6f810ca1da server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:53.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.770+0000 7fb54e7fc700 1 -- 172.21.15.45:0/3768803553 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54000b600 con 0x7fb55014bc80 2023-12-22T10:00:53.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.770+0000 7fb54e7fc700 1 -- 172.21.15.45:0/3768803553 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb54000b760 con 0x7fb55014bc80 2023-12-22T10:00:53.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.770+0000 7fb54e7fc700 1 -- 172.21.15.45:0/3768803553 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54000bae0 con 0x7fb55014bc80 2023-12-22T10:00:53.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.770+0000 7fb555369700 1 -- 172.21.15.45:0/3768803553 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb55014bc80 msgr2=0x7fb5500c4b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:53.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.770+0000 7fb555369700 1 --2- 172.21.15.45:0/3768803553 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb55014bc80 0x7fb5500c4b60 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7fb5500636a0 tx=0x7fb5400090f0).stop 2023-12-22T10:00:53.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.770+0000 7fb555369700 1 -- 172.21.15.45:0/3768803553 shutdown_connections 2023-12-22T10:00:53.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.770+0000 7fb555369700 1 --2- 172.21.15.45:0/3768803553 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb55014c060 0x7fb5500626a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:53.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.770+0000 7fb555369700 1 --2- 172.21.15.45:0/3768803553 >> v2:172.21.15.113:3300/0 conn(0x7fb5500c5050 0x7fb5500621b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:53.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.770+0000 7fb555369700 1 --2- 172.21.15.45:0/3768803553 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb55014bc80 0x7fb5500c4b60 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:53.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.770+0000 7fb555369700 1 -- 172.21.15.45:0/3768803553 >> 172.21.15.45:0/3768803553 conn(0x7fb550068600 msgr2=0x7fb5500a82f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:53.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.770+0000 7fb555369700 1 -- 172.21.15.45:0/3768803553 shutdown_connections 2023-12-22T10:00:53.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.770+0000 7fb555369700 1 -- 172.21.15.45:0/3768803553 wait complete. 2023-12-22T10:00:53.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.774+0000 7fb555369700 1 Processor -- start 2023-12-22T10:00:53.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.774+0000 7fb555369700 1 -- start start 2023-12-22T10:00:53.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.774+0000 7fb555369700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb5500c5050 0x7fb550131e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:53.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.774+0000 7fb555369700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb55014bc80 0x7fb5501528f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:53.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.774+0000 7fb555369700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb55014c060 0x7fb550152de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:53.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.774+0000 7fb555369700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb55013f8c0 con 0x7fb55014bc80 2023-12-22T10:00:53.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.774+0000 7fb555369700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb55013e630 con 0x7fb5500c5050 2023-12-22T10:00:53.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.774+0000 7fb555369700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb550153460 con 0x7fb55014c060 2023-12-22T10:00:53.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.778+0000 7fb547fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb55014bc80 0x7fb5501528f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:53.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.778+0000 7fb547fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb55014bc80 0x7fb5501528f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34730/0 (socket says 172.21.15.45:34730) 2023-12-22T10:00:53.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.778+0000 7fb547fff700 1 -- 172.21.15.45:0/3772489004 learned_addr learned my addr 172.21.15.45:0/3772489004 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:53.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.778+0000 7fb54effd700 1 --2- 172.21.15.45:0/3772489004 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb5500c5050 0x7fb550131e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:53.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.778+0000 7fb54f7fe700 1 --2- 172.21.15.45:0/3772489004 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb55014c060 0x7fb550152de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:53.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.778+0000 7fb547fff700 1 -- 172.21.15.45:0/3772489004 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb55014c060 msgr2=0x7fb550152de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:53.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.778+0000 7fb547fff700 1 --2- 172.21.15.45:0/3772489004 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb55014c060 0x7fb550152de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:53.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.778+0000 7fb547fff700 1 -- 172.21.15.45:0/3772489004 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb5500c5050 msgr2=0x7fb550131e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:53.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.778+0000 7fb547fff700 1 --2- 172.21.15.45:0/3772489004 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb5500c5050 0x7fb550131e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:53.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.778+0000 7fb547fff700 1 -- 172.21.15.45:0/3772489004 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb540009370 con 0x7fb55014bc80 2023-12-22T10:00:53.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.778+0000 7fb547fff700 1 --2- 172.21.15.45:0/3772489004 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb55014bc80 0x7fb5501528f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7fb538006fd0 tx=0x7fb538008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:53.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.778+0000 7fb546ffd700 1 -- 172.21.15.45:0/3772489004 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb538016070 con 0x7fb55014bc80 2023-12-22T10:00:53.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.778+0000 7fb546ffd700 1 -- 172.21.15.45:0/3772489004 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb538011590 con 0x7fb55014bc80 2023-12-22T10:00:53.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.778+0000 7fb555369700 1 -- 172.21.15.45:0/3772489004 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb550153740 con 0x7fb55014bc80 2023-12-22T10:00:53.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.778+0000 7fb546ffd700 1 -- 172.21.15.45:0/3772489004 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb538011910 con 0x7fb55014bc80 2023-12-22T10:00:53.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.778+0000 7fb555369700 1 -- 172.21.15.45:0/3772489004 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb55013f4e0 con 0x7fb55014bc80 2023-12-22T10:00:53.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.778+0000 7fb555369700 1 -- 172.21.15.45:0/3772489004 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb55013fa00 con 0x7fb55014bc80 2023-12-22T10:00:53.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.782+0000 7fb546ffd700 1 -- 172.21.15.45:0/3772489004 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fb538011d00 con 0x7fb55014bc80 2023-12-22T10:00:53.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.782+0000 7fb546ffd700 1 --2- 172.21.15.45:0/3772489004 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fb53005a4e0 0x7fb53005c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:53.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.782+0000 7fb546ffd700 1 -- 172.21.15.45:0/3772489004 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb538073fa0 con 0x7fb55014bc80 2023-12-22T10:00:53.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.782+0000 7fb54effd700 1 --2- 172.21.15.45:0/3772489004 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fb53005a4e0 0x7fb53005c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:53.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.782+0000 7fb54effd700 1 --2- 172.21.15.45:0/3772489004 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fb53005a4e0 0x7fb53005c9a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fb540009130 tx=0x7fb540017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:53.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.790+0000 7fb546ffd700 1 -- 172.21.15.45:0/3772489004 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb538047660 con 0x7fb55014bc80 2023-12-22T10:00:53.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.990+0000 7fb555369700 1 -- 172.21.15.45:0/3772489004 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb55006bb80 con 0x7fb55014bc80 2023-12-22T10:00:53.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.994+0000 7fb546ffd700 1 -- 172.21.15.45:0/3772489004 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fb53804ac80 con 0x7fb55014bc80 2023-12-22T10:00:53.993 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-22T10:00:53.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.994+0000 7fb555369700 1 -- 172.21.15.45:0/3772489004 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fb53005a4e0 msgr2=0x7fb53005c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:53.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.994+0000 7fb555369700 1 --2- 172.21.15.45:0/3772489004 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fb53005a4e0 0x7fb53005c9a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fb540009130 tx=0x7fb540017000).stop 2023-12-22T10:00:53.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.994+0000 7fb555369700 1 -- 172.21.15.45:0/3772489004 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb55014bc80 msgr2=0x7fb5501528f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:53.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.994+0000 7fb555369700 1 --2- 172.21.15.45:0/3772489004 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb55014bc80 0x7fb5501528f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7fb538006fd0 tx=0x7fb538008040).stop 2023-12-22T10:00:53.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.994+0000 7fb555369700 1 -- 172.21.15.45:0/3772489004 shutdown_connections 2023-12-22T10:00:53.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.994+0000 7fb555369700 1 --2- 172.21.15.45:0/3772489004 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fb53005a4e0 0x7fb53005c9a0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:53.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.994+0000 7fb555369700 1 --2- 172.21.15.45:0/3772489004 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb55014c060 0x7fb550152de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:53.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.994+0000 7fb555369700 1 --2- 172.21.15.45:0/3772489004 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb55014bc80 0x7fb5501528f0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:53.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.994+0000 7fb555369700 1 --2- 172.21.15.45:0/3772489004 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb5500c5050 0x7fb550131e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:53.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.994+0000 7fb555369700 1 -- 172.21.15.45:0/3772489004 >> 172.21.15.45:0/3772489004 conn(0x7fb550068600 msgr2=0x7fb5500aa5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:53.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.994+0000 7fb555369700 1 -- 172.21.15.45:0/3772489004 shutdown_connections 2023-12-22T10:00:53.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:53.994+0000 7fb555369700 1 -- 172.21.15.45:0/3772489004 wait complete. 2023-12-22T10:00:54.008 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-22T10:00:54.008 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-22T10:00:54.008 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi045.front.sepia.ceph.com 2023-12-22T10:00:54.009 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-22T10:00:54.009 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-22T10:00:54.009 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-22T10:00:54.009 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-22T10:00:54.009 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-22T10:00:54.009 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-22T10:00:54.009 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T10:00:54.009 DEBUG:teuthology.orchestra.run.smithi045:> ip addr 2023-12-22T10:00:54.029 INFO:teuthology.orchestra.run.smithi045.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-22T10:00:54.029 INFO:teuthology.orchestra.run.smithi045.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-22T10:00:54.029 INFO:teuthology.orchestra.run.smithi045.stdout: inet 127.0.0.1/8 scope host lo 2023-12-22T10:00:54.029 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-22T10:00:54.029 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 ::1/128 scope host 2023-12-22T10:00:54.029 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-22T10:00:54.029 INFO:teuthology.orchestra.run.smithi045.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-22T10:00:54.030 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a6 brd ff:ff:ff:ff:ff:ff 2023-12-22T10:00:54.030 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f0 2023-12-22T10:00:54.030 INFO:teuthology.orchestra.run.smithi045.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-22T10:00:54.030 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a7 brd ff:ff:ff:ff:ff:ff 2023-12-22T10:00:54.030 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f1 2023-12-22T10:00:54.030 INFO:teuthology.orchestra.run.smithi045.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-22T10:00:54.030 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:be brd ff:ff:ff:ff:ff:ff 2023-12-22T10:00:54.030 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f0 2023-12-22T10:00:54.030 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.21.15.45/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-12-22T10:00:54.030 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft 42396sec preferred_lft 42396sec 2023-12-22T10:00:54.030 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::ec4:7aff:febd:12be/64 scope link 2023-12-22T10:00:54.030 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-22T10:00:54.030 INFO:teuthology.orchestra.run.smithi045.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-22T10:00:54.030 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:bf brd ff:ff:ff:ff:ff:ff 2023-12-22T10:00:54.031 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f1 2023-12-22T10:00:54.031 INFO:teuthology.orchestra.run.smithi045.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-22T10:00:54.031 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 02:42:88:ee:73:7d brd ff:ff:ff:ff:ff:ff 2023-12-22T10:00:54.031 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-22T10:00:54.031 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-22T10:00:54.032 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-22T10:00:54.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T10:00:54.032 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-12-22T10:00:54.032 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-12-22T10:00:54.032 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link add name ceph-brx type bridge 2023-12-22T10:00:54.032 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip addr flush dev ceph-brx 2023-12-22T10:00:54.032 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set ceph-brx up 2023-12-22T10:00:54.032 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-22T10:00:54.032 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-12-22T10:00:54.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T10:00:54.192 DEBUG:teuthology.orchestra.run.smithi045:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-22T10:00:54.227 INFO:teuthology.orchestra.run.smithi045.stdout:1 2023-12-22T10:00:54.230 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T10:00:54.230 DEBUG:teuthology.orchestra.run.smithi045:> route 2023-12-22T10:00:54.314 INFO:teuthology.orchestra.run.smithi045.stdout:Kernel IP routing table 2023-12-22T10:00:54.314 INFO:teuthology.orchestra.run.smithi045.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-22T10:00:54.314 INFO:teuthology.orchestra.run.smithi045.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-12-22T10:00:54.314 INFO:teuthology.orchestra.run.smithi045.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-22T10:00:54.314 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-12-22T10:00:54.315 INFO:teuthology.orchestra.run.smithi045.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-22T10:00:54.315 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T10:00:54.315 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-12-22T10:00:54.315 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-12-22T10:00:54.315 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-22T10:00:54.315 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-22T10:00:54.315 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-22T10:00:54.315 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-12-22T10:00:54.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T10:00:54.455 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2023-12-22T10:00:54.477 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T10:00:54.477 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list-id 2023-12-22T10:00:54.544 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T10:00:54.544 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-12-22T10:00:54.545 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-12-22T10:00:54.545 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-22T10:00:54.545 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-12-22T10:00:54.545 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-12-22T10:00:54.661 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-12-22T10:00:54.661 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T10:00:54.661 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-12-22T10:00:54.661 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-12-22T10:00:54.661 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-12-22T10:00:54.661 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-22T10:00:54.661 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-12-22T10:00:54.661 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-12-22T10:00:54.662 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-12-22T10:00:54.662 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-12-22T10:00:54.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T10:00:54.833 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-12-22T10:00:54.833 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-12-22T10:00:54.833 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set brx.0 up 2023-12-22T10:00:54.833 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set dev brx.0 master ceph-brx 2023-12-22T10:00:54.833 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-12-22T10:00:54.907 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-12-22T10:00:54.908 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-22T10:00:54.908 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -m 0000 -p -v /home/ubuntu/cephtest/mnt.0 2023-12-22T10:00:54.925 INFO:teuthology.orchestra.run.smithi045.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-22T10:00:54.925 DEBUG:teuthology.orchestra.run.smithi045:> sudo modprobe fuse 2023-12-22T10:00:55.010 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-22T10:00:55.010 DEBUG:teuthology.orchestra.run.smithi045:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-22T10:00:55.086 INFO:teuthology.orchestra.run.smithi045.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-22T10:00:55.090 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-22T10:00:55.091 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-22T10:00:55.091 DEBUG:teuthology.orchestra.run.smithi045:> ls /sys/fs/fuse/connections 2023-12-22T10:00:55.151 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-22T10:00:55.152 DEBUG:teuthology.orchestra.run.smithi045:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' --id 0 /home/ubuntu/cephtest/mnt.0 2023-12-22T10:00:55.200 DEBUG:teuthology.orchestra.run.smithi045:> sudo modprobe fuse 2023-12-22T10:00:55.238 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-22T10:00:55.238 DEBUG:teuthology.orchestra.run.smithi045:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-22T10:00:55.319 INFO:teuthology.orchestra.run.smithi045.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-22T10:00:55.322 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-22T10:00:55.322 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-22T10:00:55.322 DEBUG:teuthology.orchestra.run.smithi045:> ls /sys/fs/fuse/connections 2023-12-22T10:00:55.326 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi045.stderr:2023-12-22T10:00:55.330+0000 7f8f0873e200 -1 init, newargv = 0x563947b1b0a0 newargc=15 2023-12-22T10:00:55.326 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi045.stderr:ceph-fuse[39049]: starting ceph client 2023-12-22T10:00:55.340 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi045.stderr:ceph-fuse[39049]: starting fuse 2023-12-22T10:00:55.341 INFO:teuthology.orchestra.run.smithi045.stdout:49 2023-12-22T10:00:55.342 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2023-12-22T10:00:55.342 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-22T10:00:55.342 DEBUG:teuthology.orchestra.run.smithi045:> import glob 2023-12-22T10:00:55.342 DEBUG:teuthology.orchestra.run.smithi045:> import re 2023-12-22T10:00:55.342 DEBUG:teuthology.orchestra.run.smithi045:> import os 2023-12-22T10:00:55.342 DEBUG:teuthology.orchestra.run.smithi045:> import subprocess 2023-12-22T10:00:55.342 DEBUG:teuthology.orchestra.run.smithi045:> 2023-12-22T10:00:55.342 DEBUG:teuthology.orchestra.run.smithi045:> def _find_admin_socket(client_name): 2023-12-22T10:00:55.342 DEBUG:teuthology.orchestra.run.smithi045:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-12-22T10:00:55.342 DEBUG:teuthology.orchestra.run.smithi045:> files = glob.glob(asok_path) 2023-12-22T10:00:55.342 DEBUG:teuthology.orchestra.run.smithi045:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-12-22T10:00:55.342 DEBUG:teuthology.orchestra.run.smithi045:> 2023-12-22T10:00:55.342 DEBUG:teuthology.orchestra.run.smithi045:> # Given a non-glob path, it better be there 2023-12-22T10:00:55.343 DEBUG:teuthology.orchestra.run.smithi045:> if "*" not in asok_path: 2023-12-22T10:00:55.343 DEBUG:teuthology.orchestra.run.smithi045:> assert(len(files) == 1) 2023-12-22T10:00:55.343 DEBUG:teuthology.orchestra.run.smithi045:> return files[0] 2023-12-22T10:00:55.343 DEBUG:teuthology.orchestra.run.smithi045:> 2023-12-22T10:00:55.343 DEBUG:teuthology.orchestra.run.smithi045:> for f in files: 2023-12-22T10:00:55.343 DEBUG:teuthology.orchestra.run.smithi045:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-22T10:00:55.343 DEBUG:teuthology.orchestra.run.smithi045:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-22T10:00:55.343 DEBUG:teuthology.orchestra.run.smithi045:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-22T10:00:55.343 DEBUG:teuthology.orchestra.run.smithi045:> contents = proc_f.read() 2023-12-22T10:00:55.344 DEBUG:teuthology.orchestra.run.smithi045:> if mountpoint in contents: 2023-12-22T10:00:55.344 DEBUG:teuthology.orchestra.run.smithi045:> return f 2023-12-22T10:00:55.344 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-22T10:00:55.344 DEBUG:teuthology.orchestra.run.smithi045:> 2023-12-22T10:00:55.344 DEBUG:teuthology.orchestra.run.smithi045:> print(_find_admin_socket("client.0")) 2023-12-22T10:00:55.344 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-22T10:00:55.508 INFO:teuthology.orchestra.run.smithi045.stdout:/var/run/ceph/ceph-client.0.39049.asok 2023-12-22T10:00:55.694 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.39049.asok 2023-12-22T10:00:55.694 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-22T10:00:55.694 DEBUG:teuthology.orchestra.run.smithi045:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.39049.asok status 2023-12-22T10:00:55.881 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-22T10:00:55.881 INFO:teuthology.orchestra.run.smithi045.stdout: "metadata": { 2023-12-22T10:00:55.881 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_sha1": "4ab91a455dc86ea102fdfa1407dbcce323929634", 2023-12-22T10:00:55.881 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_version": "ceph version 16.2.14-395-g4ab91a45 (4ab91a455dc86ea102fdfa1407dbcce323929634) pacific (stable)", 2023-12-22T10:00:55.881 INFO:teuthology.orchestra.run.smithi045.stdout: "entity_id": "0", 2023-12-22T10:00:55.881 INFO:teuthology.orchestra.run.smithi045.stdout: "hostname": "smithi045", 2023-12-22T10:00:55.881 INFO:teuthology.orchestra.run.smithi045.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-12-22T10:00:55.881 INFO:teuthology.orchestra.run.smithi045.stdout: "pid": "39049", 2023-12-22T10:00:55.882 INFO:teuthology.orchestra.run.smithi045.stdout: "root": "/" 2023-12-22T10:00:55.882 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:00:55.882 INFO:teuthology.orchestra.run.smithi045.stdout: "dentry_count": 0, 2023-12-22T10:00:55.882 INFO:teuthology.orchestra.run.smithi045.stdout: "dentry_pinned_count": 0, 2023-12-22T10:00:55.882 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 4665, 2023-12-22T10:00:55.882 INFO:teuthology.orchestra.run.smithi045.stdout: "inst": { 2023-12-22T10:00:55.882 INFO:teuthology.orchestra.run.smithi045.stdout: "name": { 2023-12-22T10:00:55.882 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "client", 2023-12-22T10:00:55.882 INFO:teuthology.orchestra.run.smithi045.stdout: "num": 4665 2023-12-22T10:00:55.882 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:00:55.882 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": { 2023-12-22T10:00:55.882 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-12-22T10:00:55.882 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:0", 2023-12-22T10:00:55.883 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1047865743 2023-12-22T10:00:55.883 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-22T10:00:55.883 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:00:55.883 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": { 2023-12-22T10:00:55.883 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-12-22T10:00:55.883 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:0", 2023-12-22T10:00:55.883 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1047865743 2023-12-22T10:00:55.883 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:00:55.883 INFO:teuthology.orchestra.run.smithi045.stdout: "inst_str": "client.4665 172.21.15.45:0/1047865743", 2023-12-22T10:00:55.883 INFO:teuthology.orchestra.run.smithi045.stdout: "addr_str": "172.21.15.45:0/1047865743", 2023-12-22T10:00:55.883 INFO:teuthology.orchestra.run.smithi045.stdout: "inode_count": 1, 2023-12-22T10:00:55.883 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_epoch": 8, 2023-12-22T10:00:55.883 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_epoch": 21, 2023-12-22T10:00:55.884 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_epoch_barrier": 0, 2023-12-22T10:00:55.884 INFO:teuthology.orchestra.run.smithi045.stdout: "blocklisted": false, 2023-12-22T10:00:55.884 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs" 2023-12-22T10:00:55.884 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-22T10:00:55.894 DEBUG:teuthology.orchestra.run.smithi045:> ceph fs ls 2023-12-22T10:00:56.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:56.038+0000 7fbbe981b700 1 Processor -- start 2023-12-22T10:00:56.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:56.038+0000 7fbbe981b700 1 -- start start 2023-12-22T10:00:56.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:56.042+0000 7fbbe981b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbbe4062dd0 0x7fbbe40621b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:56.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:56.042+0000 7fbbe981b700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fbbe40b0470 0x7fbbe40626a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:56.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:56.042+0000 7fbbe981b700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbe40af8d0 con 0x7fbbe4157f40 2023-12-22T10:00:56.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:56.042+0000 7fbbe981b700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbe4062b90 con 0x7fbbe4062dd0 2023-12-22T10:00:56.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:56.042+0000 7fbbe981b700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbe40aefa0 con 0x7fbbe40b0470 2023-12-22T10:00:56.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:56.042+0000 7fbbe27fc700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbbe4062dd0 0x7fbbe40621b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:56.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:56.042+0000 7fbbe27fc700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbbe4062dd0 0x7fbbe40621b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34744/0 (socket says 172.21.15.45:34744) 2023-12-22T10:00:56.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:56.042+0000 7fbbe27fc700 1 -- 172.21.15.45:0/3233642864 learned_addr learned my addr 172.21.15.45:0/3233642864 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:56.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:56.042+0000 7fbbe37fe700 1 --2- 172.21.15.45:0/3233642864 >> v2:172.21.15.113:3300/0 conn(0x7fbbe40b0470 0x7fbbe40626a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:56.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:56.042+0000 7fbbe27fc700 1 -- 172.21.15.45:0/3233642864 >> v2:172.21.15.113:3300/0 conn(0x7fbbe40b0470 msgr2=0x7fbbe40626a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:00:56.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:56.042+0000 7fbbe27fc700 1 --2- 172.21.15.45:0/3233642864 >> v2:172.21.15.113:3300/0 conn(0x7fbbe40b0470 0x7fbbe40626a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:56.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:56.042+0000 7fbbe27fc700 1 -- 172.21.15.45:0/3233642864 >> v1:172.21.15.45:6789/0 conn(0x7fbbe4157f40 legacy=0x7fbbe40afd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:56.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:56.042+0000 7fbbe27fc700 1 -- 172.21.15.45:0/3233642864 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbe40af280 con 0x7fbbe4062dd0 2023-12-22T10:00:56.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:56.042+0000 7fbbe27fc700 1 --2- 172.21.15.45:0/3233642864 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbbe4062dd0 0x7fbbe40621b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7fbbe40ac220 tx=0x7fbbd80090f0).ready entity=mon.0 client_cookie=9222686659610292 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:56.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:56.042+0000 7fbbe1ffb700 1 -- 172.21.15.45:0/3233642864 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd800b520 con 0x7fbbe4062dd0 2023-12-22T10:00:56.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:56.042+0000 7fbbe1ffb700 1 -- 172.21.15.45:0/3233642864 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbd800b680 con 0x7fbbe4062dd0 2023-12-22T10:00:56.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:56.042+0000 7fbbe1ffb700 1 -- 172.21.15.45:0/3233642864 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd800ba00 con 0x7fbbe4062dd0 2023-12-22T10:00:56.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:56.046+0000 7fbbe981b700 1 -- 172.21.15.45:0/3233642864 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbbe4062dd0 msgr2=0x7fbbe40621b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:56.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:56.046+0000 7fbbe981b700 1 --2- 172.21.15.45:0/3233642864 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbbe4062dd0 0x7fbbe40621b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7fbbe40ac220 tx=0x7fbbd80090f0).stop 2023-12-22T10:00:56.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:56.046+0000 7fbbe981b700 1 -- 172.21.15.45:0/3233642864 shutdown_connections 2023-12-22T10:00:56.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:56.046+0000 7fbbe981b700 1 --2- 172.21.15.45:0/3233642864 >> v2:172.21.15.113:3300/0 conn(0x7fbbe40b0470 0x7fbbe40626a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:56.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:56.046+0000 7fbbe981b700 1 --2- 172.21.15.45:0/3233642864 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbbe4062dd0 0x7fbbe40621b0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:56.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:56.046+0000 7fbbe981b700 1 -- 172.21.15.45:0/3233642864 >> 172.21.15.45:0/3233642864 conn(0x7fbbe4067b70 msgr2=0x7fbbe4067f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:56.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:56.046+0000 7fbbe981b700 1 -- 172.21.15.45:0/3233642864 shutdown_connections 2023-12-22T10:00:56.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:56.046+0000 7fbbe981b700 1 -- 172.21.15.45:0/3233642864 wait complete. 2023-12-22T10:00:56.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:56.050+0000 7fbbe981b700 1 Processor -- start 2023-12-22T10:00:56.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:56.050+0000 7fbbe981b700 1 -- start start 2023-12-22T10:00:56.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:56.050+0000 7fbbe981b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbbe40b0470 0x7fbbe41691d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:56.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:56.050+0000 7fbbe981b700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbbe4157f40 0x7fbbe414a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:56.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:56.050+0000 7fbbe981b700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fbbe414bd60 0x7fbbe414d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:56.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:56.050+0000 7fbbe981b700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe4151be0 con 0x7fbbe40b0470 2023-12-22T10:00:56.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:56.050+0000 7fbbe981b700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe414b690 con 0x7fbbe4157f40 2023-12-22T10:00:56.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:56.050+0000 7fbbe981b700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe41696c0 con 0x7fbbe414bd60 2023-12-22T10:00:56.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:56.050+0000 7fbbe2ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbbe40b0470 0x7fbbe41691d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:56.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:56.050+0000 7fbbe2ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbbe40b0470 0x7fbbe41691d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34756/0 (socket says 172.21.15.45:34756) 2023-12-22T10:00:56.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:56.050+0000 7fbbe2ffd700 1 -- 172.21.15.45:0/1224957354 learned_addr learned my addr 172.21.15.45:0/1224957354 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:00:56.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:56.050+0000 7fbbe27fc700 1 --2- 172.21.15.45:0/1224957354 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbbe4157f40 0x7fbbe414a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:56.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:56.050+0000 7fbbe37fe700 1 --2- 172.21.15.45:0/1224957354 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fbbe414bd60 0x7fbbe414d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:56.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:56.050+0000 7fbbe2ffd700 1 -- 172.21.15.45:0/1224957354 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fbbe414bd60 msgr2=0x7fbbe414d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:56.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:56.050+0000 7fbbe2ffd700 1 --2- 172.21.15.45:0/1224957354 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fbbe414bd60 0x7fbbe414d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:56.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:56.050+0000 7fbbe2ffd700 1 -- 172.21.15.45:0/1224957354 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbbe4157f40 msgr2=0x7fbbe414a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:56.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:56.050+0000 7fbbe2ffd700 1 --2- 172.21.15.45:0/1224957354 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbbe4157f40 0x7fbbe414a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:56.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:56.050+0000 7fbbe2ffd700 1 -- 172.21.15.45:0/1224957354 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbd8009370 con 0x7fbbe40b0470 2023-12-22T10:00:56.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:56.050+0000 7fbbe2ffd700 1 --2- 172.21.15.45:0/1224957354 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbbe40b0470 0x7fbbe41691d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7fbbd400c440 tx=0x7fbbd4007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:56.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:56.050+0000 7fbbcaffd700 1 -- 172.21.15.45:0/1224957354 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd4007020 con 0x7fbbe40b0470 2023-12-22T10:00:56.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:56.050+0000 7fbbcaffd700 1 -- 172.21.15.45:0/1224957354 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbd4007180 con 0x7fbbe40b0470 2023-12-22T10:00:56.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:56.050+0000 7fbbe981b700 1 -- 172.21.15.45:0/1224957354 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbe414c1f0 con 0x7fbbe40b0470 2023-12-22T10:00:56.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:56.054+0000 7fbbcaffd700 1 -- 172.21.15.45:0/1224957354 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd4007520 con 0x7fbbe40b0470 2023-12-22T10:00:56.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:56.054+0000 7fbbe981b700 1 -- 172.21.15.45:0/1224957354 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbe4151870 con 0x7fbbe40b0470 2023-12-22T10:00:56.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:56.054+0000 7fbbe981b700 1 -- 172.21.15.45:0/1224957354 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbe41522a0 con 0x7fbbe40b0470 2023-12-22T10:00:56.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:56.054+0000 7fbbcaffd700 1 -- 172.21.15.45:0/1224957354 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fbbd40068b0 con 0x7fbbe40b0470 2023-12-22T10:00:56.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:56.058+0000 7fbbcaffd700 1 --2- 172.21.15.45:0/1224957354 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fbbd005a4e0 0x7fbbd005c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:56.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:56.058+0000 7fbbcaffd700 1 -- 172.21.15.45:0/1224957354 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fbbd4073be0 con 0x7fbbe40b0470 2023-12-22T10:00:56.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:56.058+0000 7fbbe27fc700 1 --2- 172.21.15.45:0/1224957354 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fbbd005a4e0 0x7fbbd005c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:56.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:56.058+0000 7fbbe27fc700 1 --2- 172.21.15.45:0/1224957354 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fbbd005a4e0 0x7fbbd005c9a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7fbbe40ac220 tx=0x7fbbd8017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:56.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:56.062+0000 7fbbcaffd700 1 -- 172.21.15.45:0/1224957354 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fbbd4047300 con 0x7fbbe40b0470 2023-12-22T10:00:56.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:56.258+0000 7fbbe981b700 1 -- 172.21.15.45:0/1224957354 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fbbe406bb80 con 0x7fbbe40b0470 2023-12-22T10:00:56.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:56.262+0000 7fbbcaffd700 1 -- 172.21.15.45:0/1224957354 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fbbd404a920 con 0x7fbbe40b0470 2023-12-22T10:00:56.257 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-22T10:00:56.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:56.262+0000 7fbbe981b700 1 -- 172.21.15.45:0/1224957354 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fbbd005a4e0 msgr2=0x7fbbd005c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:56.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:56.262+0000 7fbbe981b700 1 --2- 172.21.15.45:0/1224957354 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fbbd005a4e0 0x7fbbd005c9a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7fbbe40ac220 tx=0x7fbbd8017000).stop 2023-12-22T10:00:56.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:56.262+0000 7fbbe981b700 1 -- 172.21.15.45:0/1224957354 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbbe40b0470 msgr2=0x7fbbe41691d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:56.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:56.262+0000 7fbbe981b700 1 --2- 172.21.15.45:0/1224957354 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbbe40b0470 0x7fbbe41691d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7fbbd400c440 tx=0x7fbbd4007e00).stop 2023-12-22T10:00:56.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:56.262+0000 7fbbe981b700 1 -- 172.21.15.45:0/1224957354 shutdown_connections 2023-12-22T10:00:56.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:56.262+0000 7fbbe981b700 1 --2- 172.21.15.45:0/1224957354 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fbbd005a4e0 0x7fbbd005c9a0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:56.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:56.262+0000 7fbbe981b700 1 --2- 172.21.15.45:0/1224957354 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fbbe414bd60 0x7fbbe414d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:56.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:56.262+0000 7fbbe981b700 1 --2- 172.21.15.45:0/1224957354 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbbe4157f40 0x7fbbe414a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:56.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:56.262+0000 7fbbe981b700 1 --2- 172.21.15.45:0/1224957354 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbbe40b0470 0x7fbbe41691d0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:56.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:56.262+0000 7fbbe981b700 1 -- 172.21.15.45:0/1224957354 >> 172.21.15.45:0/1224957354 conn(0x7fbbe4067b70 msgr2=0x7fbbe4068370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:56.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:56.262+0000 7fbbe981b700 1 -- 172.21.15.45:0/1224957354 shutdown_connections 2023-12-22T10:00:56.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:00:56.262+0000 7fbbe981b700 1 -- 172.21.15.45:0/1224957354 wait complete. 2023-12-22T10:00:56.280 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-22T10:00:56.280 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-22T10:00:56.280 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi045.front.sepia.ceph.com 2023-12-22T10:00:56.280 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-12-22T10:00:56.280 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-12-22T10:00:56.280 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-22T10:00:56.280 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-22T10:00:56.281 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-22T10:00:56.281 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-12-22T10:00:56.281 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T10:00:56.281 DEBUG:teuthology.orchestra.run.smithi045:> ip addr 2023-12-22T10:00:56.299 INFO:teuthology.orchestra.run.smithi045.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-22T10:00:56.299 INFO:teuthology.orchestra.run.smithi045.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-22T10:00:56.299 INFO:teuthology.orchestra.run.smithi045.stdout: inet 127.0.0.1/8 scope host lo 2023-12-22T10:00:56.299 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-22T10:00:56.300 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 ::1/128 scope host 2023-12-22T10:00:56.300 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-22T10:00:56.300 INFO:teuthology.orchestra.run.smithi045.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-22T10:00:56.300 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a6 brd ff:ff:ff:ff:ff:ff 2023-12-22T10:00:56.300 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f0 2023-12-22T10:00:56.300 INFO:teuthology.orchestra.run.smithi045.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-22T10:00:56.300 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a7 brd ff:ff:ff:ff:ff:ff 2023-12-22T10:00:56.300 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f1 2023-12-22T10:00:56.300 INFO:teuthology.orchestra.run.smithi045.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-22T10:00:56.300 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:be brd ff:ff:ff:ff:ff:ff 2023-12-22T10:00:56.300 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f0 2023-12-22T10:00:56.300 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.21.15.45/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-12-22T10:00:56.300 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft 42394sec preferred_lft 42394sec 2023-12-22T10:00:56.301 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::ec4:7aff:febd:12be/64 scope link 2023-12-22T10:00:56.301 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-22T10:00:56.301 INFO:teuthology.orchestra.run.smithi045.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-22T10:00:56.301 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:bf brd ff:ff:ff:ff:ff:ff 2023-12-22T10:00:56.301 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f1 2023-12-22T10:00:56.301 INFO:teuthology.orchestra.run.smithi045.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-22T10:00:56.301 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 02:42:88:ee:73:7d brd ff:ff:ff:ff:ff:ff 2023-12-22T10:00:56.301 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-22T10:00:56.301 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-22T10:00:56.301 INFO:teuthology.orchestra.run.smithi045.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-22T10:00:56.301 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether be:09:4b:53:de:10 brd ff:ff:ff:ff:ff:ff 2023-12-22T10:00:56.301 INFO:teuthology.orchestra.run.smithi045.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-22T10:00:56.301 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-22T10:00:56.302 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::1c22:c2ff:fec2:a6b8/64 scope link 2023-12-22T10:00:56.302 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-22T10:00:56.302 INFO:teuthology.orchestra.run.smithi045.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-22T10:00:56.302 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether be:09:4b:53:de:10 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-22T10:00:56.302 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::bc09:4bff:fe53:de10/64 scope link tentative 2023-12-22T10:00:56.302 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-22T10:00:56.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T10:00:56.303 DEBUG:teuthology.orchestra.run.smithi045:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-22T10:00:56.385 INFO:teuthology.orchestra.run.smithi045.stdout:1 2023-12-22T10:00:56.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T10:00:56.388 DEBUG:teuthology.orchestra.run.smithi045:> route 2023-12-22T10:00:56.449 INFO:teuthology.orchestra.run.smithi045.stdout:Kernel IP routing table 2023-12-22T10:00:56.450 INFO:teuthology.orchestra.run.smithi045.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-22T10:00:56.450 INFO:teuthology.orchestra.run.smithi045.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-12-22T10:00:56.450 INFO:teuthology.orchestra.run.smithi045.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-22T10:00:56.450 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-12-22T10:00:56.450 INFO:teuthology.orchestra.run.smithi045.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-22T10:00:56.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T10:00:56.451 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-12-22T10:00:56.451 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-12-22T10:00:56.451 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-22T10:00:56.451 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-22T10:00:56.451 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-22T10:00:56.451 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-12-22T10:00:56.590 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T10:00:56.590 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2023-12-22T10:00:56.610 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-22T10:00:56.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T10:00:56.611 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list-id 2023-12-22T10:00:56.674 INFO:teuthology.orchestra.run.smithi045.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-12-22T10:00:56.675 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T10:00:56.676 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-12-22T10:00:56.676 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-12-22T10:00:56.676 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-22T10:00:56.676 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-12-22T10:00:56.676 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-12-22T10:00:56.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T10:00:56.795 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-12-22T10:00:56.834 INFO:teuthology.orchestra.run.smithi045.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-22T10:00:56.834 INFO:teuthology.orchestra.run.smithi045.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-22T10:00:56.834 INFO:teuthology.orchestra.run.smithi045.stdout: inet 127.0.0.1/8 scope host lo 2023-12-22T10:00:56.834 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-22T10:00:56.834 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 ::1/128 scope host 2023-12-22T10:00:56.834 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-22T10:00:56.834 INFO:teuthology.orchestra.run.smithi045.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-22T10:00:56.834 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 6e:07:93:6a:3b:68 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-12-22T10:00:56.834 INFO:teuthology.orchestra.run.smithi045.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-12-22T10:00:56.835 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-22T10:00:56.835 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::6c07:93ff:fe6a:3b68/64 scope link 2023-12-22T10:00:56.835 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-22T10:00:56.837 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T10:00:56.837 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-12-22T10:00:56.919 INFO:teuthology.orchestra.run.smithi045.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-22T10:00:56.920 INFO:teuthology.orchestra.run.smithi045.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-22T10:00:56.920 INFO:teuthology.orchestra.run.smithi045.stdout: inet 127.0.0.1/8 scope host lo 2023-12-22T10:00:56.920 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-22T10:00:56.920 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 ::1/128 scope host 2023-12-22T10:00:56.920 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-22T10:00:56.920 INFO:teuthology.orchestra.run.smithi045.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-22T10:00:56.920 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 6e:07:93:6a:3b:68 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-12-22T10:00:56.920 INFO:teuthology.orchestra.run.smithi045.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-12-22T10:00:56.920 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-22T10:00:56.920 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::6c07:93ff:fe6a:3b68/64 scope link 2023-12-22T10:00:56.920 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-22T10:00:56.924 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-12-22T10:00:56.924 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T10:00:56.924 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-12-22T10:00:56.924 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-12-22T10:00:56.924 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-12-22T10:00:56.924 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-12-22T10:00:56.924 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-12-22T10:00:56.924 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-12-22T10:00:56.924 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-12-22T10:00:56.925 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-12-22T10:00:57.128 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T10:00:57.128 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-12-22T10:00:57.128 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-12-22T10:00:57.128 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set brx.1 up 2023-12-22T10:00:57.129 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set dev brx.1 master ceph-brx 2023-12-22T10:00:57.129 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-12-22T10:00:57.194 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2023-12-22T10:00:57.194 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-22T10:00:57.194 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -m 0000 -p -v /home/ubuntu/cephtest/mnt.2 2023-12-22T10:00:57.211 INFO:teuthology.orchestra.run.smithi045.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-12-22T10:00:57.211 DEBUG:teuthology.orchestra.run.smithi045:> sudo modprobe fuse 2023-12-22T10:00:57.296 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-22T10:00:57.296 DEBUG:teuthology.orchestra.run.smithi045:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-22T10:00:57.368 INFO:teuthology.orchestra.run.smithi045.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-22T10:00:57.370 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-22T10:00:57.371 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-22T10:00:57.371 DEBUG:teuthology.orchestra.run.smithi045:> ls /sys/fs/fuse/connections 2023-12-22T10:00:57.435 INFO:teuthology.orchestra.run.smithi045.stdout:49 2023-12-22T10:00:57.436 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [49] 2023-12-22T10:00:57.436 DEBUG:teuthology.orchestra.run.smithi045:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' --id 2 /home/ubuntu/cephtest/mnt.2 2023-12-22T10:00:57.484 DEBUG:teuthology.orchestra.run.smithi045:> sudo modprobe fuse 2023-12-22T10:00:57.516 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-22T10:00:57.516 DEBUG:teuthology.orchestra.run.smithi045:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-22T10:00:57.594 INFO:teuthology.orchestra.run.smithi045.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-22T10:00:57.597 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-22T10:00:57.598 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-22T10:00:57.598 DEBUG:teuthology.orchestra.run.smithi045:> ls /sys/fs/fuse/connections 2023-12-22T10:00:57.623 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi045.stderr:2023-12-22T10:00:57.626+0000 7f5e1113e200 -1 init, newargv = 0x55652edb5510 newargc=15 2023-12-22T10:00:57.623 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi045.stderr:ceph-fuse[39181]: starting ceph client 2023-12-22T10:00:57.635 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi045.stderr:ceph-fuse[39181]: starting fuse 2023-12-22T10:00:57.638 INFO:teuthology.orchestra.run.smithi045.stdout:49 2023-12-22T10:00:57.638 INFO:teuthology.orchestra.run.smithi045.stdout:50 2023-12-22T10:00:57.638 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49, 50] 2023-12-22T10:00:57.638 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-22T10:00:57.638 DEBUG:teuthology.orchestra.run.smithi045:> import glob 2023-12-22T10:00:57.639 DEBUG:teuthology.orchestra.run.smithi045:> import re 2023-12-22T10:00:57.639 DEBUG:teuthology.orchestra.run.smithi045:> import os 2023-12-22T10:00:57.639 DEBUG:teuthology.orchestra.run.smithi045:> import subprocess 2023-12-22T10:00:57.639 DEBUG:teuthology.orchestra.run.smithi045:> 2023-12-22T10:00:57.639 DEBUG:teuthology.orchestra.run.smithi045:> def _find_admin_socket(client_name): 2023-12-22T10:00:57.639 DEBUG:teuthology.orchestra.run.smithi045:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2023-12-22T10:00:57.639 DEBUG:teuthology.orchestra.run.smithi045:> files = glob.glob(asok_path) 2023-12-22T10:00:57.639 DEBUG:teuthology.orchestra.run.smithi045:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2023-12-22T10:00:57.639 DEBUG:teuthology.orchestra.run.smithi045:> 2023-12-22T10:00:57.639 DEBUG:teuthology.orchestra.run.smithi045:> # Given a non-glob path, it better be there 2023-12-22T10:00:57.639 DEBUG:teuthology.orchestra.run.smithi045:> if "*" not in asok_path: 2023-12-22T10:00:57.639 DEBUG:teuthology.orchestra.run.smithi045:> assert(len(files) == 1) 2023-12-22T10:00:57.639 DEBUG:teuthology.orchestra.run.smithi045:> return files[0] 2023-12-22T10:00:57.639 DEBUG:teuthology.orchestra.run.smithi045:> 2023-12-22T10:00:57.639 DEBUG:teuthology.orchestra.run.smithi045:> for f in files: 2023-12-22T10:00:57.640 DEBUG:teuthology.orchestra.run.smithi045:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-22T10:00:57.640 DEBUG:teuthology.orchestra.run.smithi045:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-22T10:00:57.640 DEBUG:teuthology.orchestra.run.smithi045:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-22T10:00:57.640 DEBUG:teuthology.orchestra.run.smithi045:> contents = proc_f.read() 2023-12-22T10:00:57.640 DEBUG:teuthology.orchestra.run.smithi045:> if mountpoint in contents: 2023-12-22T10:00:57.640 DEBUG:teuthology.orchestra.run.smithi045:> return f 2023-12-22T10:00:57.640 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-22T10:00:57.640 DEBUG:teuthology.orchestra.run.smithi045:> 2023-12-22T10:00:57.640 DEBUG:teuthology.orchestra.run.smithi045:> print(_find_admin_socket("client.2")) 2023-12-22T10:00:57.640 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-22T10:00:57.811 INFO:teuthology.orchestra.run.smithi045.stdout:/var/run/ceph/ceph-client.2.39181.asok 2023-12-22T10:00:57.994 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.39181.asok 2023-12-22T10:00:57.995 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-22T10:00:57.995 DEBUG:teuthology.orchestra.run.smithi045:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.39181.asok status 2023-12-22T10:00:58.178 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-22T10:00:58.179 INFO:teuthology.orchestra.run.smithi045.stdout: "metadata": { 2023-12-22T10:00:58.179 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_sha1": "4ab91a455dc86ea102fdfa1407dbcce323929634", 2023-12-22T10:00:58.179 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_version": "ceph version 16.2.14-395-g4ab91a45 (4ab91a455dc86ea102fdfa1407dbcce323929634) pacific (stable)", 2023-12-22T10:00:58.179 INFO:teuthology.orchestra.run.smithi045.stdout: "entity_id": "2", 2023-12-22T10:00:58.179 INFO:teuthology.orchestra.run.smithi045.stdout: "hostname": "smithi045", 2023-12-22T10:00:58.179 INFO:teuthology.orchestra.run.smithi045.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2023-12-22T10:00:58.179 INFO:teuthology.orchestra.run.smithi045.stdout: "pid": "39181", 2023-12-22T10:00:58.179 INFO:teuthology.orchestra.run.smithi045.stdout: "root": "/" 2023-12-22T10:00:58.179 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:00:58.179 INFO:teuthology.orchestra.run.smithi045.stdout: "dentry_count": 0, 2023-12-22T10:00:58.179 INFO:teuthology.orchestra.run.smithi045.stdout: "dentry_pinned_count": 0, 2023-12-22T10:00:58.179 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 4683, 2023-12-22T10:00:58.180 INFO:teuthology.orchestra.run.smithi045.stdout: "inst": { 2023-12-22T10:00:58.180 INFO:teuthology.orchestra.run.smithi045.stdout: "name": { 2023-12-22T10:00:58.180 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "client", 2023-12-22T10:00:58.180 INFO:teuthology.orchestra.run.smithi045.stdout: "num": 4683 2023-12-22T10:00:58.180 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:00:58.180 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": { 2023-12-22T10:00:58.180 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-12-22T10:00:58.180 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:0", 2023-12-22T10:00:58.180 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2110075206 2023-12-22T10:00:58.180 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-22T10:00:58.180 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:00:58.180 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": { 2023-12-22T10:00:58.180 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-12-22T10:00:58.180 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:0", 2023-12-22T10:00:58.181 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2110075206 2023-12-22T10:00:58.181 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:00:58.181 INFO:teuthology.orchestra.run.smithi045.stdout: "inst_str": "client.4683 172.21.15.45:0/2110075206", 2023-12-22T10:00:58.181 INFO:teuthology.orchestra.run.smithi045.stdout: "addr_str": "172.21.15.45:0/2110075206", 2023-12-22T10:00:58.181 INFO:teuthology.orchestra.run.smithi045.stdout: "inode_count": 1, 2023-12-22T10:00:58.181 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_epoch": 8, 2023-12-22T10:00:58.181 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_epoch": 21, 2023-12-22T10:00:58.181 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_epoch_barrier": 0, 2023-12-22T10:00:58.181 INFO:teuthology.orchestra.run.smithi045.stdout: "blocklisted": false, 2023-12-22T10:00:58.181 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs" 2023-12-22T10:00:58.181 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-22T10:00:58.192 DEBUG:teuthology.orchestra.run.smithi113:> ceph fs ls 2023-12-22T10:00:58.330 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:58.329+0000 7fd718c39700 1 Processor -- start 2023-12-22T10:00:58.330 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:58.329+0000 7fd718c39700 1 -- start start 2023-12-22T10:00:58.331 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:58.329+0000 7fd718c39700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd714153c00 0x7fd7140c2d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:58.331 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:58.329+0000 7fd718c39700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7140c4bd0 con 0x7fd7140c31f0 2023-12-22T10:00:58.331 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:58.329+0000 7fd718c39700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7140c36a0 con 0x7fd714153820 2023-12-22T10:00:58.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:58.329+0000 7fd718c39700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7140c17c0 con 0x7fd714153c00 2023-12-22T10:00:58.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:58.333+0000 7fd7137fe700 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fd714153820 0x7fd7140c5060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.113:54316/0 (socket says 172.21.15.113:54316) 2023-12-22T10:00:58.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:58.333+0000 7fd7137fe700 1 -- 172.21.15.113:0/1904922848 learned_addr learned my addr 172.21.15.113:0/1904922848 (peer_addr_for_me v1:172.21.15.113:0/0) 2023-12-22T10:00:58.332 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:58.333+0000 7fd712ffd700 1 --2- 172.21.15.113:0/1904922848 >> v2:172.21.15.45:3300/0 conn(0x7fd714153c00 0x7fd7140c2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:58.333 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:58.333+0000 7fd7127fc700 1 -- 172.21.15.113:0/1904922848 <== mon.1 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2603296483 0 0) 0x7fd7140c36a0 con 0x7fd714153820 2023-12-22T10:00:58.333 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:58.333+0000 7fd7127fc700 1 -- 172.21.15.113:0/1904922848 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6fc0033f0 con 0x7fd714153820 2023-12-22T10:00:58.334 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:58.333+0000 7fd7127fc700 1 -- 172.21.15.113:0/1904922848 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2908051891 0 0) 0x7fd7140c4bd0 con 0x7fd7140c31f0 2023-12-22T10:00:58.334 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:58.333+0000 7fd7127fc700 1 -- 172.21.15.113:0/1904922848 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7140c36a0 con 0x7fd7140c31f0 2023-12-22T10:00:58.334 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:58.333+0000 7fd712ffd700 1 -- 172.21.15.113:0/1904922848 >> v1:172.21.15.113:6789/0 conn(0x7fd714153820 legacy=0x7fd7140c5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:58.334 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:58.333+0000 7fd7127fc700 1 -- 172.21.15.113:0/1904922848 <== mon.1 v1:172.21.15.113:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 916592735 0 0) 0x7fd6fc0033f0 con 0x7fd714153820 2023-12-22T10:00:58.334 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:58.333+0000 7fd712ffd700 1 -- 172.21.15.113:0/1904922848 >> v1:172.21.15.45:6789/0 conn(0x7fd7140c31f0 legacy=0x7fd7140a9730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:58.334 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:58.333+0000 7fd712ffd700 1 -- 172.21.15.113:0/1904922848 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7140c1aa0 con 0x7fd714153c00 2023-12-22T10:00:58.334 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:58.333+0000 7fd712ffd700 1 --2- 172.21.15.113:0/1904922848 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd714153c00 0x7fd7140c2d00 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7fd7080096e0 tx=0x7fd708009060).ready entity=mon.0 client_cookie=9edf75d645e74203 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:58.335 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:58.333+0000 7fd7127fc700 1 -- 172.21.15.113:0/1904922848 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd704001470 con 0x7fd714153c00 2023-12-22T10:00:58.335 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:58.333+0000 7fd7127fc700 1 -- 172.21.15.113:0/1904922848 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd708011400 con 0x7fd714153c00 2023-12-22T10:00:58.335 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:58.333+0000 7fd7127fc700 1 -- 172.21.15.113:0/1904922848 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd708011780 con 0x7fd714153c00 2023-12-22T10:00:58.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:58.333+0000 7fd718c39700 1 -- 172.21.15.113:0/1904922848 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd714153c00 msgr2=0x7fd7140c2d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:58.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:58.333+0000 7fd718c39700 1 --2- 172.21.15.113:0/1904922848 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd714153c00 0x7fd7140c2d00 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7fd7080096e0 tx=0x7fd708009060).stop 2023-12-22T10:00:58.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:58.333+0000 7fd718c39700 1 -- 172.21.15.113:0/1904922848 shutdown_connections 2023-12-22T10:00:58.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:58.333+0000 7fd718c39700 1 --2- 172.21.15.113:0/1904922848 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd714153c00 0x7fd7140c2d00 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:58.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:58.333+0000 7fd718c39700 1 -- 172.21.15.113:0/1904922848 >> 172.21.15.113:0/1904922848 conn(0x7fd714067b70 msgr2=0x7fd714067f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:58.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:58.333+0000 7fd718c39700 1 -- 172.21.15.113:0/1904922848 shutdown_connections 2023-12-22T10:00:58.336 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:58.337+0000 7fd718c39700 1 -- 172.21.15.113:0/1904922848 wait complete. 2023-12-22T10:00:58.339 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:58.337+0000 7fd718c39700 1 Processor -- start 2023-12-22T10:00:58.339 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:58.337+0000 7fd718c39700 1 -- start start 2023-12-22T10:00:58.341 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:58.341+0000 7fd718c39700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd7140c31f0 0x7fd71414d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:58.341 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:58.341+0000 7fd718c39700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd714153820 0x7fd7140bfb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:58.341 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:58.341+0000 7fd718c39700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd714153c00 0x7fd7140bdf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:58.341 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:58.341+0000 7fd718c39700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7140bf6d0 con 0x7fd714153820 2023-12-22T10:00:58.341 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:58.341+0000 7fd718c39700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7140baa60 con 0x7fd714153c00 2023-12-22T10:00:58.341 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:58.341+0000 7fd718c39700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7140beac0 con 0x7fd7140c31f0 2023-12-22T10:00:58.342 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:58.341+0000 7fd7137fe700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd7140c31f0 0x7fd71414d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:58.342 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:58.341+0000 7fd713fff700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd714153c00 0x7fd7140bdf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:58.342 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:58.341+0000 7fd7137fe700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd7140c31f0 0x7fd71414d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.113:3301/0 says I am v2:172.21.15.113:42844/0 (socket says 172.21.15.113:42844) 2023-12-22T10:00:58.342 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:58.341+0000 7fd7137fe700 1 -- 172.21.15.113:0/2116646813 learned_addr learned my addr 172.21.15.113:0/2116646813 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-22T10:00:58.342 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:58.341+0000 7fd713fff700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd714153c00 0x7fd7140bdf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:37358/0 (socket says 172.21.15.113:37358) 2023-12-22T10:00:58.343 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:58.341+0000 7fd712ffd700 1 --2- 172.21.15.113:0/2116646813 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd714153820 0x7fd7140bfb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:58.344 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:58.341+0000 7fd713fff700 1 -- 172.21.15.113:0/2116646813 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd7140c31f0 msgr2=0x7fd71414d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:58.344 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:58.341+0000 7fd713fff700 1 --2- 172.21.15.113:0/2116646813 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd7140c31f0 0x7fd71414d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:58.344 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:58.341+0000 7fd713fff700 1 -- 172.21.15.113:0/2116646813 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd714153820 msgr2=0x7fd7140bfb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:58.344 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:58.341+0000 7fd713fff700 1 --2- 172.21.15.113:0/2116646813 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd714153820 0x7fd7140bfb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:58.344 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:58.341+0000 7fd713fff700 1 -- 172.21.15.113:0/2116646813 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7080092a0 con 0x7fd714153c00 2023-12-22T10:00:58.344 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:58.341+0000 7fd712ffd700 1 --2- 172.21.15.113:0/2116646813 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd714153820 0x7fd7140bfb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-12-22T10:00:58.344 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:58.341+0000 7fd7137fe700 1 --2- 172.21.15.113:0/2116646813 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd7140c31f0 0x7fd71414d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-12-22T10:00:58.344 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:58.341+0000 7fd713fff700 1 --2- 172.21.15.113:0/2116646813 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd714153c00 0x7fd7140bdf70 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7fd70c00c790 tx=0x7fd70c007ef0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:58.344 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:58.341+0000 7fd6fb7fe700 1 -- 172.21.15.113:0/2116646813 <== mon.1 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70c00e4a0 con 0x7fd714153c00 2023-12-22T10:00:58.344 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:58.341+0000 7fd6fb7fe700 1 -- 172.21.15.113:0/2116646813 <== mon.1 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd70c00e600 con 0x7fd714153c00 2023-12-22T10:00:58.344 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:58.341+0000 7fd6fb7fe700 1 -- 172.21.15.113:0/2116646813 <== mon.1 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70c00e980 con 0x7fd714153c00 2023-12-22T10:00:58.344 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:58.341+0000 7fd718c39700 1 -- 172.21.15.113:0/2116646813 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7140beda0 con 0x7fd714153c00 2023-12-22T10:00:58.345 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:58.345+0000 7fd718c39700 1 -- 172.21.15.113:0/2116646813 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7140bf360 con 0x7fd714153c00 2023-12-22T10:00:58.345 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:58.345+0000 7fd718c39700 1 -- 172.21.15.113:0/2116646813 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7140bf840 con 0x7fd714153c00 2023-12-22T10:00:58.346 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:58.345+0000 7fd6fb7fe700 1 -- 172.21.15.113:0/2116646813 <== mon.1 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fd70c012400 con 0x7fd714153c00 2023-12-22T10:00:58.348 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:58.345+0000 7fd6fb7fe700 1 --2- 172.21.15.113:0/2116646813 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fd70005a510 0x7fd70005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:00:58.348 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:58.349+0000 7fd6fb7fe700 1 -- 172.21.15.113:0/2116646813 <== mon.1 v2:172.21.15.113:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fd70c073d80 con 0x7fd714153c00 2023-12-22T10:00:58.348 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:58.349+0000 7fd7137fe700 1 --2- 172.21.15.113:0/2116646813 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fd70005a510 0x7fd70005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:00:58.349 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:58.349+0000 7fd7137fe700 1 --2- 172.21.15.113:0/2116646813 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fd70005a510 0x7fd70005c9d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7fd7040015a0 tx=0x7fd704000bc0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:00:58.356 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:58.357+0000 7fd6fb7fe700 1 -- 172.21.15.113:0/2116646813 <== mon.1 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd70c0475b0 con 0x7fd714153c00 2023-12-22T10:00:58.549 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:58.545+0000 7fd718c39700 1 -- 172.21.15.113:0/2116646813 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd71406bb80 con 0x7fd714153c00 2023-12-22T10:00:58.549 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:58.549+0000 7fd6fb7fe700 1 -- 172.21.15.113:0/2116646813 <== mon.1 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fd70c017030 con 0x7fd714153c00 2023-12-22T10:00:58.549 INFO:teuthology.orchestra.run.smithi113.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-22T10:00:58.551 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:58.549+0000 7fd718c39700 1 -- 172.21.15.113:0/2116646813 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fd70005a510 msgr2=0x7fd70005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:58.551 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:58.549+0000 7fd718c39700 1 --2- 172.21.15.113:0/2116646813 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fd70005a510 0x7fd70005c9d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7fd7040015a0 tx=0x7fd704000bc0).stop 2023-12-22T10:00:58.552 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:58.549+0000 7fd718c39700 1 -- 172.21.15.113:0/2116646813 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd714153c00 msgr2=0x7fd7140bdf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:00:58.552 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:58.549+0000 7fd718c39700 1 --2- 172.21.15.113:0/2116646813 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd714153c00 0x7fd7140bdf70 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7fd70c00c790 tx=0x7fd70c007ef0).stop 2023-12-22T10:00:58.552 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:58.549+0000 7fd718c39700 1 -- 172.21.15.113:0/2116646813 shutdown_connections 2023-12-22T10:00:58.552 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:58.549+0000 7fd718c39700 1 --2- 172.21.15.113:0/2116646813 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd714153c00 0x7fd7140bdf70 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:58.552 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:58.549+0000 7fd718c39700 1 --2- 172.21.15.113:0/2116646813 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd714153820 0x7fd7140bfb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:58.552 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:58.549+0000 7fd718c39700 1 --2- 172.21.15.113:0/2116646813 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fd70005a510 0x7fd70005c9d0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:58.552 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:58.549+0000 7fd718c39700 1 --2- 172.21.15.113:0/2116646813 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd7140c31f0 0x7fd71414d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:00:58.552 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:58.549+0000 7fd718c39700 1 -- 172.21.15.113:0/2116646813 >> 172.21.15.113:0/2116646813 conn(0x7fd714067b70 msgr2=0x7fd714067050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:00:58.553 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:58.553+0000 7fd718c39700 1 -- 172.21.15.113:0/2116646813 shutdown_connections 2023-12-22T10:00:58.553 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:00:58.553+0000 7fd718c39700 1 -- 172.21.15.113:0/2116646813 wait complete. 2023-12-22T10:00:58.568 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-22T10:00:58.568 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-22T10:00:58.568 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi113.front.sepia.ceph.com 2023-12-22T10:00:58.568 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-22T10:00:58.568 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-22T10:00:58.568 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-22T10:00:58.568 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-22T10:00:58.569 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-22T10:00:58.569 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-22T10:00:58.569 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T10:00:58.569 DEBUG:teuthology.orchestra.run.smithi113:> ip addr 2023-12-22T10:00:58.587 INFO:teuthology.orchestra.run.smithi113.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-22T10:00:58.588 INFO:teuthology.orchestra.run.smithi113.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-22T10:00:58.588 INFO:teuthology.orchestra.run.smithi113.stdout: inet 127.0.0.1/8 scope host lo 2023-12-22T10:00:58.588 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-22T10:00:58.588 INFO:teuthology.orchestra.run.smithi113.stdout: inet6 ::1/128 scope host 2023-12-22T10:00:58.588 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-22T10:00:58.588 INFO:teuthology.orchestra.run.smithi113.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-22T10:00:58.588 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether 0c:c4:7a:d8:db:44 brd ff:ff:ff:ff:ff:ff 2023-12-22T10:00:58.588 INFO:teuthology.orchestra.run.smithi113.stdout: altname enp7s0f0 2023-12-22T10:00:58.588 INFO:teuthology.orchestra.run.smithi113.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-22T10:00:58.588 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether 0c:c4:7a:d8:db:45 brd ff:ff:ff:ff:ff:ff 2023-12-22T10:00:58.588 INFO:teuthology.orchestra.run.smithi113.stdout: altname enp7s0f1 2023-12-22T10:00:58.588 INFO:teuthology.orchestra.run.smithi113.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-22T10:00:58.588 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether 0c:c4:7a:8f:d7:c0 brd ff:ff:ff:ff:ff:ff 2023-12-22T10:00:58.589 INFO:teuthology.orchestra.run.smithi113.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-22T10:00:58.589 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether 0c:c4:7a:8f:d7:c1 brd ff:ff:ff:ff:ff:ff 2023-12-22T10:00:58.589 INFO:teuthology.orchestra.run.smithi113.stdout: inet 172.21.15.113/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-22T10:00:58.589 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft 42394sec preferred_lft 42394sec 2023-12-22T10:00:58.589 INFO:teuthology.orchestra.run.smithi113.stdout: inet6 fe80::ec4:7aff:fe8f:d7c1/64 scope link 2023-12-22T10:00:58.589 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-22T10:00:58.589 INFO:teuthology.orchestra.run.smithi113.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-22T10:00:58.589 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether 02:42:6c:fd:da:a0 brd ff:ff:ff:ff:ff:ff 2023-12-22T10:00:58.589 INFO:teuthology.orchestra.run.smithi113.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-22T10:00:58.589 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-22T10:00:58.589 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-22T10:00:58.590 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T10:00:58.590 DEBUG:teuthology.orchestra.run.smithi113:> (cd / && exec bash -c ' 2023-12-22T10:00:58.590 DEBUG:teuthology.orchestra.run.smithi113:> set -e 2023-12-22T10:00:58.590 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip link add name ceph-brx type bridge 2023-12-22T10:00:58.590 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip addr flush dev ceph-brx 2023-12-22T10:00:58.590 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip link set ceph-brx up 2023-12-22T10:00:58.590 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-22T10:00:58.590 DEBUG:teuthology.orchestra.run.smithi113:> ') 2023-12-22T10:00:58.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T10:00:58.740 DEBUG:teuthology.orchestra.run.smithi113:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-22T10:00:58.772 INFO:teuthology.orchestra.run.smithi113.stdout:1 2023-12-22T10:00:58.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T10:00:58.775 DEBUG:teuthology.orchestra.run.smithi113:> route 2023-12-22T10:00:58.869 INFO:teuthology.orchestra.run.smithi113.stdout:Kernel IP routing table 2023-12-22T10:00:58.870 INFO:teuthology.orchestra.run.smithi113.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-22T10:00:58.870 INFO:teuthology.orchestra.run.smithi113.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-22T10:00:58.870 INFO:teuthology.orchestra.run.smithi113.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-22T10:00:58.870 INFO:teuthology.orchestra.run.smithi113.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-22T10:00:58.870 INFO:teuthology.orchestra.run.smithi113.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-12-22T10:00:58.870 INFO:teuthology.orchestra.run.smithi113.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-22T10:00:58.871 INFO:teuthology.orchestra.run.smithi113.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-22T10:00:58.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T10:00:58.871 DEBUG:teuthology.orchestra.run.smithi113:> (cd / && exec bash -c ' 2023-12-22T10:00:58.871 DEBUG:teuthology.orchestra.run.smithi113:> set -e 2023-12-22T10:00:58.872 DEBUG:teuthology.orchestra.run.smithi113:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-22T10:00:58.872 DEBUG:teuthology.orchestra.run.smithi113:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-22T10:00:58.872 DEBUG:teuthology.orchestra.run.smithi113:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-22T10:00:58.872 DEBUG:teuthology.orchestra.run.smithi113:> ') 2023-12-22T10:00:58.961 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T10:00:58.961 DEBUG:teuthology.orchestra.run.smithi113:> ip netns list 2023-12-22T10:00:58.978 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T10:00:58.979 DEBUG:teuthology.orchestra.run.smithi113:> ip netns list-id 2023-12-22T10:00:59.042 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T10:00:59.042 DEBUG:teuthology.orchestra.run.smithi113:> (cd / && exec bash -c ' 2023-12-22T10:00:59.042 DEBUG:teuthology.orchestra.run.smithi113:> set -e 2023-12-22T10:00:59.043 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-22T10:00:59.043 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-12-22T10:00:59.043 DEBUG:teuthology.orchestra.run.smithi113:> ') 2023-12-22T10:00:59.154 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-12-22T10:00:59.154 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T10:00:59.154 DEBUG:teuthology.orchestra.run.smithi113:> (cd / && exec bash -c ' 2023-12-22T10:00:59.155 DEBUG:teuthology.orchestra.run.smithi113:> set -e 2023-12-22T10:00:59.155 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-12-22T10:00:59.155 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-22T10:00:59.155 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-12-22T10:00:59.155 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-12-22T10:00:59.155 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-12-22T10:00:59.155 DEBUG:teuthology.orchestra.run.smithi113:> ') 2023-12-22T10:00:59.317 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T10:00:59.317 DEBUG:teuthology.orchestra.run.smithi113:> (cd / && exec bash -c ' 2023-12-22T10:00:59.317 DEBUG:teuthology.orchestra.run.smithi113:> set -e 2023-12-22T10:00:59.317 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip link set brx.0 up 2023-12-22T10:00:59.317 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip link set dev brx.0 master ceph-brx 2023-12-22T10:00:59.317 DEBUG:teuthology.orchestra.run.smithi113:> ') 2023-12-22T10:00:59.387 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-12-22T10:00:59.387 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-22T10:00:59.387 DEBUG:teuthology.orchestra.run.smithi113:> mkdir -m 0000 -p -v /home/ubuntu/cephtest/mnt.1 2023-12-22T10:00:59.403 INFO:teuthology.orchestra.run.smithi113.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-22T10:00:59.403 DEBUG:teuthology.orchestra.run.smithi113:> sudo modprobe fuse 2023-12-22T10:00:59.481 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-22T10:00:59.481 DEBUG:teuthology.orchestra.run.smithi113:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-22T10:00:59.562 INFO:teuthology.orchestra.run.smithi113.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-22T10:00:59.566 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-22T10:00:59.567 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-22T10:00:59.567 DEBUG:teuthology.orchestra.run.smithi113:> ls /sys/fs/fuse/connections 2023-12-22T10:00:59.624 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-22T10:00:59.625 DEBUG:teuthology.orchestra.run.smithi113:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' --id 1 /home/ubuntu/cephtest/mnt.1 2023-12-22T10:00:59.674 DEBUG:teuthology.orchestra.run.smithi113:> sudo modprobe fuse 2023-12-22T10:00:59.709 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-22T10:00:59.709 DEBUG:teuthology.orchestra.run.smithi113:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-22T10:00:59.785 INFO:teuthology.orchestra.run.smithi113.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-22T10:00:59.787 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-22T10:00:59.788 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-22T10:00:59.788 DEBUG:teuthology.orchestra.run.smithi113:> ls /sys/fs/fuse/connections 2023-12-22T10:00:59.804 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi113.stderr:2023-12-22T10:00:59.801+0000 7fc579504200 -1 init, newargv = 0x5629d36dc680 newargc=15 2023-12-22T10:00:59.804 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi113.stderr:ceph-fuse[37598]: starting ceph client 2023-12-22T10:00:59.820 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi113.stderr:ceph-fuse[37598]: starting fuse 2023-12-22T10:01:00.919 DEBUG:teuthology.orchestra.run.smithi113:> sudo modprobe fuse 2023-12-22T10:01:00.964 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-22T10:01:00.964 DEBUG:teuthology.orchestra.run.smithi113:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-22T10:01:01.044 INFO:teuthology.orchestra.run.smithi113.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-22T10:01:01.046 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-22T10:01:01.047 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-22T10:01:01.047 DEBUG:teuthology.orchestra.run.smithi113:> ls /sys/fs/fuse/connections 2023-12-22T10:01:01.109 INFO:teuthology.orchestra.run.smithi113.stdout:49 2023-12-22T10:01:01.109 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2023-12-22T10:01:01.109 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-22T10:01:01.109 DEBUG:teuthology.orchestra.run.smithi113:> import glob 2023-12-22T10:01:01.110 DEBUG:teuthology.orchestra.run.smithi113:> import re 2023-12-22T10:01:01.110 DEBUG:teuthology.orchestra.run.smithi113:> import os 2023-12-22T10:01:01.110 DEBUG:teuthology.orchestra.run.smithi113:> import subprocess 2023-12-22T10:01:01.110 DEBUG:teuthology.orchestra.run.smithi113:> 2023-12-22T10:01:01.110 DEBUG:teuthology.orchestra.run.smithi113:> def _find_admin_socket(client_name): 2023-12-22T10:01:01.110 DEBUG:teuthology.orchestra.run.smithi113:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-12-22T10:01:01.110 DEBUG:teuthology.orchestra.run.smithi113:> files = glob.glob(asok_path) 2023-12-22T10:01:01.110 DEBUG:teuthology.orchestra.run.smithi113:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-12-22T10:01:01.110 DEBUG:teuthology.orchestra.run.smithi113:> 2023-12-22T10:01:01.110 DEBUG:teuthology.orchestra.run.smithi113:> # Given a non-glob path, it better be there 2023-12-22T10:01:01.110 DEBUG:teuthology.orchestra.run.smithi113:> if "*" not in asok_path: 2023-12-22T10:01:01.110 DEBUG:teuthology.orchestra.run.smithi113:> assert(len(files) == 1) 2023-12-22T10:01:01.110 DEBUG:teuthology.orchestra.run.smithi113:> return files[0] 2023-12-22T10:01:01.110 DEBUG:teuthology.orchestra.run.smithi113:> 2023-12-22T10:01:01.111 DEBUG:teuthology.orchestra.run.smithi113:> for f in files: 2023-12-22T10:01:01.111 DEBUG:teuthology.orchestra.run.smithi113:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-22T10:01:01.111 DEBUG:teuthology.orchestra.run.smithi113:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-22T10:01:01.111 DEBUG:teuthology.orchestra.run.smithi113:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-22T10:01:01.111 DEBUG:teuthology.orchestra.run.smithi113:> contents = proc_f.read() 2023-12-22T10:01:01.111 DEBUG:teuthology.orchestra.run.smithi113:> if mountpoint in contents: 2023-12-22T10:01:01.111 DEBUG:teuthology.orchestra.run.smithi113:> return f 2023-12-22T10:01:01.111 DEBUG:teuthology.orchestra.run.smithi113:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-22T10:01:01.112 DEBUG:teuthology.orchestra.run.smithi113:> 2023-12-22T10:01:01.112 DEBUG:teuthology.orchestra.run.smithi113:> print(_find_admin_socket("client.1")) 2023-12-22T10:01:01.112 DEBUG:teuthology.orchestra.run.smithi113:> ' 2023-12-22T10:01:01.284 INFO:teuthology.orchestra.run.smithi113.stdout:/var/run/ceph/ceph-client.1.37598.asok 2023-12-22T10:01:01.468 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.37598.asok 2023-12-22T10:01:01.469 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-22T10:01:01.469 DEBUG:teuthology.orchestra.run.smithi113:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.37598.asok status 2023-12-22T10:01:01.648 INFO:teuthology.orchestra.run.smithi113.stdout:{ 2023-12-22T10:01:01.648 INFO:teuthology.orchestra.run.smithi113.stdout: "metadata": { 2023-12-22T10:01:01.648 INFO:teuthology.orchestra.run.smithi113.stdout: "ceph_sha1": "4ab91a455dc86ea102fdfa1407dbcce323929634", 2023-12-22T10:01:01.648 INFO:teuthology.orchestra.run.smithi113.stdout: "ceph_version": "ceph version 16.2.14-395-g4ab91a45 (4ab91a455dc86ea102fdfa1407dbcce323929634) pacific (stable)", 2023-12-22T10:01:01.648 INFO:teuthology.orchestra.run.smithi113.stdout: "entity_id": "1", 2023-12-22T10:01:01.648 INFO:teuthology.orchestra.run.smithi113.stdout: "hostname": "smithi113", 2023-12-22T10:01:01.649 INFO:teuthology.orchestra.run.smithi113.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-12-22T10:01:01.649 INFO:teuthology.orchestra.run.smithi113.stdout: "pid": "37598", 2023-12-22T10:01:01.649 INFO:teuthology.orchestra.run.smithi113.stdout: "root": "/" 2023-12-22T10:01:01.649 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-22T10:01:01.649 INFO:teuthology.orchestra.run.smithi113.stdout: "dentry_count": 0, 2023-12-22T10:01:01.649 INFO:teuthology.orchestra.run.smithi113.stdout: "dentry_pinned_count": 0, 2023-12-22T10:01:01.649 INFO:teuthology.orchestra.run.smithi113.stdout: "id": 4517, 2023-12-22T10:01:01.649 INFO:teuthology.orchestra.run.smithi113.stdout: "inst": { 2023-12-22T10:01:01.649 INFO:teuthology.orchestra.run.smithi113.stdout: "name": { 2023-12-22T10:01:01.649 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "client", 2023-12-22T10:01:01.649 INFO:teuthology.orchestra.run.smithi113.stdout: "num": 4517 2023-12-22T10:01:01.649 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-22T10:01:01.649 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": { 2023-12-22T10:01:01.649 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-22T10:01:01.650 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "192.168.0.1:0", 2023-12-22T10:01:01.650 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 3694789598 2023-12-22T10:01:01.650 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-22T10:01:01.650 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-22T10:01:01.650 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": { 2023-12-22T10:01:01.650 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-22T10:01:01.650 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "192.168.0.1:0", 2023-12-22T10:01:01.650 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 3694789598 2023-12-22T10:01:01.650 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-22T10:01:01.650 INFO:teuthology.orchestra.run.smithi113.stdout: "inst_str": "client.4517 192.168.0.1:0/3694789598", 2023-12-22T10:01:01.650 INFO:teuthology.orchestra.run.smithi113.stdout: "addr_str": "192.168.0.1:0/3694789598", 2023-12-22T10:01:01.650 INFO:teuthology.orchestra.run.smithi113.stdout: "inode_count": 1, 2023-12-22T10:01:01.650 INFO:teuthology.orchestra.run.smithi113.stdout: "mds_epoch": 8, 2023-12-22T10:01:01.650 INFO:teuthology.orchestra.run.smithi113.stdout: "osd_epoch": 21, 2023-12-22T10:01:01.650 INFO:teuthology.orchestra.run.smithi113.stdout: "osd_epoch_barrier": 0, 2023-12-22T10:01:01.651 INFO:teuthology.orchestra.run.smithi113.stdout: "blocklisted": false, 2023-12-22T10:01:01.651 INFO:teuthology.orchestra.run.smithi113.stdout: "fs_name": "cephfs" 2023-12-22T10:01:01.651 INFO:teuthology.orchestra.run.smithi113.stdout:} 2023-12-22T10:01:01.663 DEBUG:teuthology.orchestra.run.smithi113:> ceph fs ls 2023-12-22T10:01:01.792 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:01:01.793+0000 7f43e359e700 1 Processor -- start 2023-12-22T10:01:01.793 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:01:01.793+0000 7f43e359e700 1 -- start start 2023-12-22T10:01:01.794 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:01:01.793+0000 7f43e359e700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f43e4153820 0x7f43e40c5060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:01.794 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:01:01.793+0000 7f43e359e700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f43e4153c00 0x7f43e40c5550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:01.794 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:01:01.793+0000 7f43e359e700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43e40c4bd0 con 0x7f43e40c2d00 2023-12-22T10:01:01.794 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:01:01.793+0000 7f43e359e700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43e40c17c0 con 0x7f43e4153820 2023-12-22T10:01:01.795 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:01:01.793+0000 7f43e359e700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43e40c1aa0 con 0x7f43e4153c00 2023-12-22T10:01:01.795 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:01:01.793+0000 7f43d9d9b700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f43e4153c00 0x7f43e40c5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:01.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:01:01.793+0000 7f43d9d9b700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f43e4153c00 0x7f43e40c5550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.113:3301/0 says I am v2:172.21.15.113:42852/0 (socket says 172.21.15.113:42852) 2023-12-22T10:01:01.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:01:01.793+0000 7f43d9d9b700 1 -- 172.21.15.113:0/1229332102 learned_addr learned my addr 172.21.15.113:0/1229332102 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-22T10:01:01.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:01:01.793+0000 7f43e259c700 1 --2- 172.21.15.113:0/1229332102 >> v2:172.21.15.113:3300/0 conn(0x7f43e4153820 0x7f43e40c5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:01.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:01:01.793+0000 7f43d9d9b700 1 -- 172.21.15.113:0/1229332102 >> v2:172.21.15.113:3300/0 conn(0x7f43e4153820 msgr2=0x7f43e40c5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:01.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:01:01.793+0000 7f43d9d9b700 1 --2- 172.21.15.113:0/1229332102 >> v2:172.21.15.113:3300/0 conn(0x7f43e4153820 0x7f43e40c5060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:01.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:01:01.793+0000 7f43d9d9b700 1 -- 172.21.15.113:0/1229332102 >> v1:172.21.15.113:6789/0 conn(0x7f43e40c2d00 legacy=0x7f43e40a9730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:01.796 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:01:01.793+0000 7f43d9d9b700 1 -- 172.21.15.113:0/1229332102 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43e40c4580 con 0x7f43e4153c00 2023-12-22T10:01:01.797 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:01:01.797+0000 7f43d9d9b700 1 --2- 172.21.15.113:0/1229332102 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f43e4153c00 0x7f43e40c5550 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f43cc006fd0 tx=0x7f43cc0090f0).ready entity=mon.2 client_cookie=ee0695b02c841b2a server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:01.797 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:01:01.797+0000 7f43e1d9b700 1 -- 172.21.15.113:0/1229332102 <== mon.2 v2:172.21.15.113:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43cc00b600 con 0x7f43e4153c00 2023-12-22T10:01:01.797 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:01:01.797+0000 7f43e1d9b700 1 -- 172.21.15.113:0/1229332102 <== mon.2 v2:172.21.15.113:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43cc00b760 con 0x7f43e4153c00 2023-12-22T10:01:01.797 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:01:01.797+0000 7f43e1d9b700 1 -- 172.21.15.113:0/1229332102 <== mon.2 v2:172.21.15.113:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43cc00bae0 con 0x7f43e4153c00 2023-12-22T10:01:01.798 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:01:01.797+0000 7f43e359e700 1 -- 172.21.15.113:0/1229332102 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f43e4153c00 msgr2=0x7f43e40c5550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:01.798 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:01:01.797+0000 7f43e359e700 1 --2- 172.21.15.113:0/1229332102 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f43e4153c00 0x7f43e40c5550 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f43cc006fd0 tx=0x7f43cc0090f0).stop 2023-12-22T10:01:01.798 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:01:01.797+0000 7f43e359e700 1 -- 172.21.15.113:0/1229332102 shutdown_connections 2023-12-22T10:01:01.798 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:01:01.797+0000 7f43e359e700 1 --2- 172.21.15.113:0/1229332102 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f43e4153c00 0x7f43e40c5550 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:01.798 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:01:01.797+0000 7f43e359e700 1 --2- 172.21.15.113:0/1229332102 >> v2:172.21.15.113:3300/0 conn(0x7f43e4153820 0x7f43e40c5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:01.798 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:01:01.797+0000 7f43e359e700 1 -- 172.21.15.113:0/1229332102 >> 172.21.15.113:0/1229332102 conn(0x7f43e4067b70 msgr2=0x7f43e4067f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:01.798 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:01:01.797+0000 7f43e359e700 1 -- 172.21.15.113:0/1229332102 shutdown_connections 2023-12-22T10:01:01.798 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:01:01.797+0000 7f43e359e700 1 -- 172.21.15.113:0/1229332102 wait complete. 2023-12-22T10:01:01.800 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:01:01.801+0000 7f43e359e700 1 Processor -- start 2023-12-22T10:01:01.801 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:01:01.801+0000 7f43e359e700 1 -- start start 2023-12-22T10:01:01.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:01:01.801+0000 7f43e359e700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f43e40c2d00 0x7f43e4164ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:01.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:01:01.801+0000 7f43e359e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43e4153820 0x7f43e40bd500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:01.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:01:01.801+0000 7f43e359e700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f43e4153c00 0x7f43e414a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:01.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:01:01.801+0000 7f43e359e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43e41653b0 con 0x7f43e4153820 2023-12-22T10:01:01.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:01:01.801+0000 7f43e359e700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43e4155080 con 0x7f43e40c2d00 2023-12-22T10:01:01.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:01:01.801+0000 7f43e359e700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43e4155360 con 0x7f43e4153c00 2023-12-22T10:01:01.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:01:01.801+0000 7f43e259c700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f43e40c2d00 0x7f43e4164ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:01.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:01:01.801+0000 7f43e259c700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f43e40c2d00 0x7f43e4164ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.113:37374/0 (socket says 172.21.15.113:37374) 2023-12-22T10:01:01.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:01:01.801+0000 7f43e2d9d700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f43e4153c00 0x7f43e414a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:01.803 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:01:01.801+0000 7f43e259c700 1 -- 172.21.15.113:0/247528352 learned_addr learned my addr 172.21.15.113:0/247528352 (peer_addr_for_me v2:172.21.15.113:0/0) 2023-12-22T10:01:01.804 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:01:01.801+0000 7f43d9d9b700 1 --2- 172.21.15.113:0/247528352 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43e4153820 0x7f43e40bd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:01.805 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:01:01.801+0000 7f43e259c700 1 -- 172.21.15.113:0/247528352 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f43e4153c00 msgr2=0x7f43e414a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:01.805 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:01:01.801+0000 7f43e259c700 1 --2- 172.21.15.113:0/247528352 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f43e4153c00 0x7f43e414a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:01.805 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:01:01.801+0000 7f43e259c700 1 -- 172.21.15.113:0/247528352 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43e4153820 msgr2=0x7f43e40bd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:01.805 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:01:01.801+0000 7f43e259c700 1 --2- 172.21.15.113:0/247528352 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43e4153820 0x7f43e40bd500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:01.805 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:01:01.801+0000 7f43e259c700 1 -- 172.21.15.113:0/247528352 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43cc009370 con 0x7f43e40c2d00 2023-12-22T10:01:01.805 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:01:01.805+0000 7f43e2d9d700 1 --2- 172.21.15.113:0/247528352 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f43e4153c00 0x7f43e414a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-12-22T10:01:01.805 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:01:01.805+0000 7f43d9d9b700 1 --2- 172.21.15.113:0/247528352 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43e4153820 0x7f43e40bd500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T10:01:01.805 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:01:01.805+0000 7f43e259c700 1 --2- 172.21.15.113:0/247528352 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f43e40c2d00 0x7f43e4164ec0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f43d400d8c0 tx=0x7f43d4008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:01.805 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:01:01.805+0000 7f43daffd700 1 -- 172.21.15.113:0/247528352 <== mon.1 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43d40125f0 con 0x7f43e40c2d00 2023-12-22T10:01:01.805 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:01:01.805+0000 7f43daffd700 1 -- 172.21.15.113:0/247528352 <== mon.1 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43d4012750 con 0x7f43e40c2d00 2023-12-22T10:01:01.805 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:01:01.805+0000 7f43e359e700 1 -- 172.21.15.113:0/247528352 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43e40c6ac0 con 0x7f43e40c2d00 2023-12-22T10:01:01.805 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:01:01.805+0000 7f43daffd700 1 -- 172.21.15.113:0/247528352 <== mon.1 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43d4012ad0 con 0x7f43e40c2d00 2023-12-22T10:01:01.805 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:01:01.805+0000 7f43e359e700 1 -- 172.21.15.113:0/247528352 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43e40bd9f0 con 0x7f43e40c2d00 2023-12-22T10:01:01.806 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:01:01.805+0000 7f43e359e700 1 -- 172.21.15.113:0/247528352 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43e406bb80 con 0x7f43e40c2d00 2023-12-22T10:01:01.807 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:01:01.805+0000 7f43daffd700 1 -- 172.21.15.113:0/247528352 <== mon.1 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f43d4013480 con 0x7f43e40c2d00 2023-12-22T10:01:01.809 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:01:01.809+0000 7f43daffd700 1 --2- 172.21.15.113:0/247528352 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f43c405a510 0x7f43c405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:01.809 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:01:01.809+0000 7f43daffd700 1 -- 172.21.15.113:0/247528352 <== mon.1 v2:172.21.15.113:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f43d40748a0 con 0x7f43e40c2d00 2023-12-22T10:01:01.809 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:01:01.809+0000 7f43d9d9b700 1 --2- 172.21.15.113:0/247528352 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f43c405a510 0x7f43c405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:01.810 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:01:01.809+0000 7f43d9d9b700 1 --2- 172.21.15.113:0/247528352 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f43c405a510 0x7f43c405c9d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f43cc006fd0 tx=0x7f43cc017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:01.816 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:01:01.817+0000 7f43daffd700 1 -- 172.21.15.113:0/247528352 <== mon.1 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f43d4047fe0 con 0x7f43e40c2d00 2023-12-22T10:01:02.012 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:01:02.013+0000 7f43e359e700 1 -- 172.21.15.113:0/247528352 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f43e40c4860 con 0x7f43e40c2d00 2023-12-22T10:01:02.016 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:01:02.017+0000 7f43daffd700 1 -- 172.21.15.113:0/247528352 <== mon.1 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f43d404b600 con 0x7f43e40c2d00 2023-12-22T10:01:02.016 INFO:teuthology.orchestra.run.smithi113.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-22T10:01:02.019 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:01:02.017+0000 7f43e359e700 1 -- 172.21.15.113:0/247528352 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f43c405a510 msgr2=0x7f43c405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:02.019 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:01:02.017+0000 7f43e359e700 1 --2- 172.21.15.113:0/247528352 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f43c405a510 0x7f43c405c9d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f43cc006fd0 tx=0x7f43cc017000).stop 2023-12-22T10:01:02.019 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:01:02.017+0000 7f43e359e700 1 -- 172.21.15.113:0/247528352 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f43e40c2d00 msgr2=0x7f43e4164ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:02.019 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:01:02.017+0000 7f43e359e700 1 --2- 172.21.15.113:0/247528352 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f43e40c2d00 0x7f43e4164ec0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f43d400d8c0 tx=0x7f43d4008040).stop 2023-12-22T10:01:02.019 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:01:02.017+0000 7f43e359e700 1 -- 172.21.15.113:0/247528352 shutdown_connections 2023-12-22T10:01:02.019 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:01:02.017+0000 7f43e359e700 1 --2- 172.21.15.113:0/247528352 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f43c405a510 0x7f43c405c9d0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:02.019 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:01:02.017+0000 7f43e359e700 1 --2- 172.21.15.113:0/247528352 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f43e4153c00 0x7f43e414a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:02.019 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:01:02.017+0000 7f43e359e700 1 --2- 172.21.15.113:0/247528352 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43e4153820 0x7f43e40bd500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:02.019 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:01:02.017+0000 7f43e359e700 1 --2- 172.21.15.113:0/247528352 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f43e40c2d00 0x7f43e4164ec0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:02.019 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:01:02.017+0000 7f43e359e700 1 -- 172.21.15.113:0/247528352 >> 172.21.15.113:0/247528352 conn(0x7f43e4067b70 msgr2=0x7f43e414d110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:02.019 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:01:02.017+0000 7f43e359e700 1 -- 172.21.15.113:0/247528352 shutdown_connections 2023-12-22T10:01:02.020 INFO:teuthology.orchestra.run.smithi113.stderr:2023-12-22T10:01:02.017+0000 7f43e359e700 1 -- 172.21.15.113:0/247528352 wait complete. 2023-12-22T10:01:02.037 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-22T10:01:02.037 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-22T10:01:02.037 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi113.front.sepia.ceph.com 2023-12-22T10:01:02.037 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-12-22T10:01:02.037 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-12-22T10:01:02.037 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-22T10:01:02.037 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-22T10:01:02.037 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-22T10:01:02.037 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-12-22T10:01:02.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T10:01:02.038 DEBUG:teuthology.orchestra.run.smithi113:> ip addr 2023-12-22T10:01:02.057 INFO:teuthology.orchestra.run.smithi113.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-22T10:01:02.057 INFO:teuthology.orchestra.run.smithi113.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-22T10:01:02.057 INFO:teuthology.orchestra.run.smithi113.stdout: inet 127.0.0.1/8 scope host lo 2023-12-22T10:01:02.057 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-22T10:01:02.057 INFO:teuthology.orchestra.run.smithi113.stdout: inet6 ::1/128 scope host 2023-12-22T10:01:02.057 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-22T10:01:02.057 INFO:teuthology.orchestra.run.smithi113.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-22T10:01:02.057 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether 0c:c4:7a:d8:db:44 brd ff:ff:ff:ff:ff:ff 2023-12-22T10:01:02.058 INFO:teuthology.orchestra.run.smithi113.stdout: altname enp7s0f0 2023-12-22T10:01:02.058 INFO:teuthology.orchestra.run.smithi113.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-22T10:01:02.058 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether 0c:c4:7a:d8:db:45 brd ff:ff:ff:ff:ff:ff 2023-12-22T10:01:02.058 INFO:teuthology.orchestra.run.smithi113.stdout: altname enp7s0f1 2023-12-22T10:01:02.058 INFO:teuthology.orchestra.run.smithi113.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-22T10:01:02.058 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether 0c:c4:7a:8f:d7:c0 brd ff:ff:ff:ff:ff:ff 2023-12-22T10:01:02.058 INFO:teuthology.orchestra.run.smithi113.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-22T10:01:02.058 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether 0c:c4:7a:8f:d7:c1 brd ff:ff:ff:ff:ff:ff 2023-12-22T10:01:02.058 INFO:teuthology.orchestra.run.smithi113.stdout: inet 172.21.15.113/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-22T10:01:02.058 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft 42391sec preferred_lft 42391sec 2023-12-22T10:01:02.058 INFO:teuthology.orchestra.run.smithi113.stdout: inet6 fe80::ec4:7aff:fe8f:d7c1/64 scope link 2023-12-22T10:01:02.058 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-22T10:01:02.058 INFO:teuthology.orchestra.run.smithi113.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-22T10:01:02.058 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether 02:42:6c:fd:da:a0 brd ff:ff:ff:ff:ff:ff 2023-12-22T10:01:02.058 INFO:teuthology.orchestra.run.smithi113.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-22T10:01:02.059 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-22T10:01:02.059 INFO:teuthology.orchestra.run.smithi113.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-22T10:01:02.059 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether 42:19:b1:a4:70:f1 brd ff:ff:ff:ff:ff:ff 2023-12-22T10:01:02.059 INFO:teuthology.orchestra.run.smithi113.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-22T10:01:02.059 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-22T10:01:02.059 INFO:teuthology.orchestra.run.smithi113.stdout: inet6 fe80::5805:1fff:feaa:4242/64 scope link 2023-12-22T10:01:02.059 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-22T10:01:02.059 INFO:teuthology.orchestra.run.smithi113.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-22T10:01:02.059 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether 42:19:b1:a4:70:f1 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-22T10:01:02.059 INFO:teuthology.orchestra.run.smithi113.stdout: inet6 fe80::4019:b1ff:fea4:70f1/64 scope link 2023-12-22T10:01:02.059 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-22T10:01:02.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T10:01:02.060 DEBUG:teuthology.orchestra.run.smithi113:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-22T10:01:02.144 INFO:teuthology.orchestra.run.smithi113.stdout:1 2023-12-22T10:01:02.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T10:01:02.147 DEBUG:teuthology.orchestra.run.smithi113:> route 2023-12-22T10:01:02.219 INFO:teuthology.orchestra.run.smithi113.stdout:Kernel IP routing table 2023-12-22T10:01:02.220 INFO:teuthology.orchestra.run.smithi113.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-22T10:01:02.220 INFO:teuthology.orchestra.run.smithi113.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-22T10:01:02.220 INFO:teuthology.orchestra.run.smithi113.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-22T10:01:02.220 INFO:teuthology.orchestra.run.smithi113.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-22T10:01:02.220 INFO:teuthology.orchestra.run.smithi113.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-12-22T10:01:02.220 INFO:teuthology.orchestra.run.smithi113.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-22T10:01:02.220 INFO:teuthology.orchestra.run.smithi113.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-22T10:01:02.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T10:01:02.221 DEBUG:teuthology.orchestra.run.smithi113:> (cd / && exec bash -c ' 2023-12-22T10:01:02.221 DEBUG:teuthology.orchestra.run.smithi113:> set -e 2023-12-22T10:01:02.221 DEBUG:teuthology.orchestra.run.smithi113:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-22T10:01:02.222 DEBUG:teuthology.orchestra.run.smithi113:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-22T10:01:02.222 DEBUG:teuthology.orchestra.run.smithi113:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-22T10:01:02.222 DEBUG:teuthology.orchestra.run.smithi113:> ') 2023-12-22T10:01:02.356 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T10:01:02.356 DEBUG:teuthology.orchestra.run.smithi113:> ip netns list 2023-12-22T10:01:02.372 INFO:teuthology.orchestra.run.smithi113.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-22T10:01:02.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T10:01:02.374 DEBUG:teuthology.orchestra.run.smithi113:> ip netns list-id 2023-12-22T10:01:02.437 INFO:teuthology.orchestra.run.smithi113.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-12-22T10:01:02.438 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T10:01:02.438 DEBUG:teuthology.orchestra.run.smithi113:> (cd / && exec bash -c ' 2023-12-22T10:01:02.438 DEBUG:teuthology.orchestra.run.smithi113:> set -e 2023-12-22T10:01:02.438 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-22T10:01:02.438 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-12-22T10:01:02.438 DEBUG:teuthology.orchestra.run.smithi113:> ') 2023-12-22T10:01:02.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T10:01:02.556 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-12-22T10:01:02.591 INFO:teuthology.orchestra.run.smithi113.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-22T10:01:02.591 INFO:teuthology.orchestra.run.smithi113.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-22T10:01:02.591 INFO:teuthology.orchestra.run.smithi113.stdout: inet 127.0.0.1/8 scope host lo 2023-12-22T10:01:02.592 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-22T10:01:02.592 INFO:teuthology.orchestra.run.smithi113.stdout: inet6 ::1/128 scope host 2023-12-22T10:01:02.592 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-22T10:01:02.592 INFO:teuthology.orchestra.run.smithi113.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-22T10:01:02.592 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether 12:08:b7:31:c5:7a brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-12-22T10:01:02.592 INFO:teuthology.orchestra.run.smithi113.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-12-22T10:01:02.592 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-22T10:01:02.592 INFO:teuthology.orchestra.run.smithi113.stdout: inet6 fe80::1008:b7ff:fe31:c57a/64 scope link 2023-12-22T10:01:02.592 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-22T10:01:02.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T10:01:02.593 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-12-22T10:01:02.677 INFO:teuthology.orchestra.run.smithi113.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-22T10:01:02.677 INFO:teuthology.orchestra.run.smithi113.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-22T10:01:02.677 INFO:teuthology.orchestra.run.smithi113.stdout: inet 127.0.0.1/8 scope host lo 2023-12-22T10:01:02.677 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-22T10:01:02.677 INFO:teuthology.orchestra.run.smithi113.stdout: inet6 ::1/128 scope host 2023-12-22T10:01:02.678 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-22T10:01:02.678 INFO:teuthology.orchestra.run.smithi113.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-22T10:01:02.678 INFO:teuthology.orchestra.run.smithi113.stdout: link/ether 12:08:b7:31:c5:7a brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-12-22T10:01:02.678 INFO:teuthology.orchestra.run.smithi113.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-12-22T10:01:02.678 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-22T10:01:02.678 INFO:teuthology.orchestra.run.smithi113.stdout: inet6 fe80::1008:b7ff:fe31:c57a/64 scope link 2023-12-22T10:01:02.678 INFO:teuthology.orchestra.run.smithi113.stdout: valid_lft forever preferred_lft forever 2023-12-22T10:01:02.682 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-12-22T10:01:02.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T10:01:02.682 DEBUG:teuthology.orchestra.run.smithi113:> (cd / && exec bash -c ' 2023-12-22T10:01:02.682 DEBUG:teuthology.orchestra.run.smithi113:> set -e 2023-12-22T10:01:02.682 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-12-22T10:01:02.682 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-12-22T10:01:02.682 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-12-22T10:01:02.682 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-12-22T10:01:02.682 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-12-22T10:01:02.682 DEBUG:teuthology.orchestra.run.smithi113:> ') 2023-12-22T10:01:02.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T10:01:02.876 DEBUG:teuthology.orchestra.run.smithi113:> (cd / && exec bash -c ' 2023-12-22T10:01:02.876 DEBUG:teuthology.orchestra.run.smithi113:> set -e 2023-12-22T10:01:02.876 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip link set brx.1 up 2023-12-22T10:01:02.876 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip link set dev brx.1 master ceph-brx 2023-12-22T10:01:02.876 DEBUG:teuthology.orchestra.run.smithi113:> ') 2023-12-22T10:01:02.901 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:01:02.909 DEBUG:teuthology.orchestra.run.smithi113:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:01:02.949 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2023-12-22T10:01:02.949 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-22T10:01:02.949 DEBUG:teuthology.orchestra.run.smithi113:> mkdir -m 0000 -p -v /home/ubuntu/cephtest/mnt.3 2023-12-22T10:01:03.011 INFO:teuthology.orchestra.run.smithi113.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-12-22T10:01:03.011 DEBUG:teuthology.orchestra.run.smithi113:> sudo modprobe fuse 2023-12-22T10:01:03.093 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-22T10:01:03.093 DEBUG:teuthology.orchestra.run.smithi113:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-22T10:01:03.170 INFO:teuthology.orchestra.run.smithi113.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-22T10:01:03.172 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-22T10:01:03.173 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-22T10:01:03.173 DEBUG:teuthology.orchestra.run.smithi113:> ls /sys/fs/fuse/connections 2023-12-22T10:01:03.234 INFO:teuthology.orchestra.run.smithi113.stdout:49 2023-12-22T10:01:03.234 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [49] 2023-12-22T10:01:03.234 DEBUG:teuthology.orchestra.run.smithi113:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' --id 3 /home/ubuntu/cephtest/mnt.3 2023-12-22T10:01:03.282 DEBUG:teuthology.orchestra.run.smithi113:> sudo modprobe fuse 2023-12-22T10:01:03.321 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-22T10:01:03.321 DEBUG:teuthology.orchestra.run.smithi113:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-22T10:01:03.397 INFO:teuthology.orchestra.run.smithi113.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-22T10:01:03.401 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-22T10:01:03.401 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-22T10:01:03.401 DEBUG:teuthology.orchestra.run.smithi113:> ls /sys/fs/fuse/connections 2023-12-22T10:01:03.407 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi113.stderr:2023-12-22T10:01:03.405+0000 7f184b2db200 -1 init, newargv = 0x558b2114f3b0 newargc=15 2023-12-22T10:01:03.407 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi113.stderr:ceph-fuse[37736]: starting ceph client 2023-12-22T10:01:03.418 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi113.stderr:ceph-fuse[37736]: starting fuse 2023-12-22T10:01:03.421 INFO:teuthology.orchestra.run.smithi113.stdout:49 2023-12-22T10:01:03.421 INFO:teuthology.orchestra.run.smithi113.stdout:50 2023-12-22T10:01:03.421 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49, 50] 2023-12-22T10:01:03.422 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-22T10:01:03.422 DEBUG:teuthology.orchestra.run.smithi113:> import glob 2023-12-22T10:01:03.422 DEBUG:teuthology.orchestra.run.smithi113:> import re 2023-12-22T10:01:03.422 DEBUG:teuthology.orchestra.run.smithi113:> import os 2023-12-22T10:01:03.422 DEBUG:teuthology.orchestra.run.smithi113:> import subprocess 2023-12-22T10:01:03.422 DEBUG:teuthology.orchestra.run.smithi113:> 2023-12-22T10:01:03.422 DEBUG:teuthology.orchestra.run.smithi113:> def _find_admin_socket(client_name): 2023-12-22T10:01:03.422 DEBUG:teuthology.orchestra.run.smithi113:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2023-12-22T10:01:03.422 DEBUG:teuthology.orchestra.run.smithi113:> files = glob.glob(asok_path) 2023-12-22T10:01:03.422 DEBUG:teuthology.orchestra.run.smithi113:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2023-12-22T10:01:03.422 DEBUG:teuthology.orchestra.run.smithi113:> 2023-12-22T10:01:03.422 DEBUG:teuthology.orchestra.run.smithi113:> # Given a non-glob path, it better be there 2023-12-22T10:01:03.422 DEBUG:teuthology.orchestra.run.smithi113:> if "*" not in asok_path: 2023-12-22T10:01:03.423 DEBUG:teuthology.orchestra.run.smithi113:> assert(len(files) == 1) 2023-12-22T10:01:03.423 DEBUG:teuthology.orchestra.run.smithi113:> return files[0] 2023-12-22T10:01:03.423 DEBUG:teuthology.orchestra.run.smithi113:> 2023-12-22T10:01:03.423 DEBUG:teuthology.orchestra.run.smithi113:> for f in files: 2023-12-22T10:01:03.423 DEBUG:teuthology.orchestra.run.smithi113:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-22T10:01:03.423 DEBUG:teuthology.orchestra.run.smithi113:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-22T10:01:03.423 DEBUG:teuthology.orchestra.run.smithi113:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-22T10:01:03.423 DEBUG:teuthology.orchestra.run.smithi113:> contents = proc_f.read() 2023-12-22T10:01:03.423 DEBUG:teuthology.orchestra.run.smithi113:> if mountpoint in contents: 2023-12-22T10:01:03.423 DEBUG:teuthology.orchestra.run.smithi113:> return f 2023-12-22T10:01:03.423 DEBUG:teuthology.orchestra.run.smithi113:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-22T10:01:03.423 DEBUG:teuthology.orchestra.run.smithi113:> 2023-12-22T10:01:03.423 DEBUG:teuthology.orchestra.run.smithi113:> print(_find_admin_socket("client.3")) 2023-12-22T10:01:03.423 DEBUG:teuthology.orchestra.run.smithi113:> ' 2023-12-22T10:01:03.586 INFO:teuthology.orchestra.run.smithi113.stdout:/var/run/ceph/ceph-client.3.37736.asok 2023-12-22T10:01:03.772 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.37736.asok 2023-12-22T10:01:03.772 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-22T10:01:03.772 DEBUG:teuthology.orchestra.run.smithi113:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.37736.asok status 2023-12-22T10:01:03.953 INFO:teuthology.orchestra.run.smithi113.stdout:{ 2023-12-22T10:01:03.954 INFO:teuthology.orchestra.run.smithi113.stdout: "metadata": { 2023-12-22T10:01:03.954 INFO:teuthology.orchestra.run.smithi113.stdout: "ceph_sha1": "4ab91a455dc86ea102fdfa1407dbcce323929634", 2023-12-22T10:01:03.954 INFO:teuthology.orchestra.run.smithi113.stdout: "ceph_version": "ceph version 16.2.14-395-g4ab91a45 (4ab91a455dc86ea102fdfa1407dbcce323929634) pacific (stable)", 2023-12-22T10:01:03.954 INFO:teuthology.orchestra.run.smithi113.stdout: "entity_id": "3", 2023-12-22T10:01:03.954 INFO:teuthology.orchestra.run.smithi113.stdout: "hostname": "smithi113", 2023-12-22T10:01:03.954 INFO:teuthology.orchestra.run.smithi113.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2023-12-22T10:01:03.954 INFO:teuthology.orchestra.run.smithi113.stdout: "pid": "37736", 2023-12-22T10:01:03.954 INFO:teuthology.orchestra.run.smithi113.stdout: "root": "/" 2023-12-22T10:01:03.954 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-22T10:01:03.954 INFO:teuthology.orchestra.run.smithi113.stdout: "dentry_count": 0, 2023-12-22T10:01:03.954 INFO:teuthology.orchestra.run.smithi113.stdout: "dentry_pinned_count": 0, 2023-12-22T10:01:03.955 INFO:teuthology.orchestra.run.smithi113.stdout: "id": 4708, 2023-12-22T10:01:03.955 INFO:teuthology.orchestra.run.smithi113.stdout: "inst": { 2023-12-22T10:01:03.955 INFO:teuthology.orchestra.run.smithi113.stdout: "name": { 2023-12-22T10:01:03.955 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "client", 2023-12-22T10:01:03.955 INFO:teuthology.orchestra.run.smithi113.stdout: "num": 4708 2023-12-22T10:01:03.955 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-22T10:01:03.955 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": { 2023-12-22T10:01:03.955 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-22T10:01:03.955 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "192.168.0.2:0", 2023-12-22T10:01:03.955 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 2546580420 2023-12-22T10:01:03.955 INFO:teuthology.orchestra.run.smithi113.stdout: } 2023-12-22T10:01:03.955 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-22T10:01:03.955 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": { 2023-12-22T10:01:03.955 INFO:teuthology.orchestra.run.smithi113.stdout: "type": "v1", 2023-12-22T10:01:03.955 INFO:teuthology.orchestra.run.smithi113.stdout: "addr": "192.168.0.2:0", 2023-12-22T10:01:03.956 INFO:teuthology.orchestra.run.smithi113.stdout: "nonce": 2546580420 2023-12-22T10:01:03.956 INFO:teuthology.orchestra.run.smithi113.stdout: }, 2023-12-22T10:01:03.956 INFO:teuthology.orchestra.run.smithi113.stdout: "inst_str": "client.4708 192.168.0.2:0/2546580420", 2023-12-22T10:01:03.956 INFO:teuthology.orchestra.run.smithi113.stdout: "addr_str": "192.168.0.2:0/2546580420", 2023-12-22T10:01:03.956 INFO:teuthology.orchestra.run.smithi113.stdout: "inode_count": 1, 2023-12-22T10:01:03.956 INFO:teuthology.orchestra.run.smithi113.stdout: "mds_epoch": 8, 2023-12-22T10:01:03.956 INFO:teuthology.orchestra.run.smithi113.stdout: "osd_epoch": 21, 2023-12-22T10:01:03.956 INFO:teuthology.orchestra.run.smithi113.stdout: "osd_epoch_barrier": 0, 2023-12-22T10:01:03.956 INFO:teuthology.orchestra.run.smithi113.stdout: "blocklisted": false, 2023-12-22T10:01:03.956 INFO:teuthology.orchestra.run.smithi113.stdout: "fs_name": "cephfs" 2023-12-22T10:01:03.956 INFO:teuthology.orchestra.run.smithi113.stdout:} 2023-12-22T10:01:03.967 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-22T10:01:03.967 DEBUG:teuthology.orchestra.run.smithi045:> stat --file-system '--printf=%T 2023-12-22T10:01:03.967 DEBUG:teuthology.orchestra.run.smithi045:> ' -- /home/ubuntu/cephtest/mnt.0 2023-12-22T10:01:03.991 INFO:teuthology.orchestra.run.smithi045.stdout:fuseblk 2023-12-22T10:01:03.991 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-12-22T10:01:03.991 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-22T10:01:03.991 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-22T10:01:04.070 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-22T10:01:04.076 DEBUG:teuthology.orchestra.run.smithi045:> stat --file-system '--printf=%T 2023-12-22T10:01:04.076 DEBUG:teuthology.orchestra.run.smithi045:> ' -- /home/ubuntu/cephtest/mnt.2 2023-12-22T10:01:04.132 INFO:teuthology.orchestra.run.smithi045.stdout:fuseblk 2023-12-22T10:01:04.133 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2023-12-22T10:01:04.133 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-22T10:01:04.133 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-12-22T10:01:04.224 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-22T10:01:04.224 DEBUG:teuthology.orchestra.run.smithi113:> stat --file-system '--printf=%T 2023-12-22T10:01:04.224 DEBUG:teuthology.orchestra.run.smithi113:> ' -- /home/ubuntu/cephtest/mnt.1 2023-12-22T10:01:04.244 INFO:teuthology.orchestra.run.smithi113.stdout:fuseblk 2023-12-22T10:01:04.244 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-12-22T10:01:04.244 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-22T10:01:04.245 DEBUG:teuthology.orchestra.run.smithi113:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-22T10:01:04.324 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-22T10:01:04.324 DEBUG:teuthology.orchestra.run.smithi113:> stat --file-system '--printf=%T 2023-12-22T10:01:04.324 DEBUG:teuthology.orchestra.run.smithi113:> ' -- /home/ubuntu/cephtest/mnt.3 2023-12-22T10:01:04.387 INFO:teuthology.orchestra.run.smithi113.stdout:fuseblk 2023-12-22T10:01:04.388 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2023-12-22T10:01:04.388 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-22T10:01:04.388 DEBUG:teuthology.orchestra.run.smithi113:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-12-22T10:01:04.471 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-12-22T10:01:04.493 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T10:01:04.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:04.661+0000 7faaaa9f9700 1 Processor -- start 2023-12-22T10:01:04.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:04.665+0000 7faaaa9f9700 1 -- start start 2023-12-22T10:01:04.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:04.665+0000 7faaaa9f9700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7faaa40a8ad0 0x7faaa4065860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:04.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:04.665+0000 7faaaa9f9700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7faaa415bb60 0x7faaa415c010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:04.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:04.665+0000 7faaaa9f9700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faaa40c17e0 con 0x7faaa40a8eb0 2023-12-22T10:01:04.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:04.665+0000 7faaaa9f9700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faaa415c500 con 0x7faaa415bb60 2023-12-22T10:01:04.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:04.665+0000 7faaaa9f9700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaa40c2630 con 0x7faaa40a8ad0 2023-12-22T10:01:04.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:04.669+0000 7faaa99f7700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7faaa40a8ad0 0x7faaa4065860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:04.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:04.669+0000 7faaa99f7700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7faaa40a8ad0 0x7faaa4065860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.113:3301/0 says I am v2:172.21.15.45:36662/0 (socket says 172.21.15.45:36662) 2023-12-22T10:01:04.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:04.669+0000 7faaa99f7700 1 -- 172.21.15.45:0/3133377256 learned_addr learned my addr 172.21.15.45:0/3133377256 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:04.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:04.669+0000 7faaaa1f8700 1 --2- 172.21.15.45:0/3133377256 >> v2:172.21.15.45:3300/0 conn(0x7faaa415bb60 0x7faaa415c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:04.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:04.669+0000 7faaaa1f8700 1 -- 172.21.15.45:0/3133377256 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7faaa40a8ad0 msgr2=0x7faaa4065860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:04.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:04.669+0000 7faaaa1f8700 1 --2- 172.21.15.45:0/3133377256 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7faaa40a8ad0 0x7faaa4065860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:04.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:04.669+0000 7faaaa1f8700 1 -- 172.21.15.45:0/3133377256 >> v1:172.21.15.113:6789/0 conn(0x7faaa40a8eb0 legacy=0x7faaa40c10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:04.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:04.669+0000 7faaaa1f8700 1 -- 172.21.15.45:0/3133377256 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaa41584c0 con 0x7faaa415bb60 2023-12-22T10:01:04.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:04.669+0000 7faaaa1f8700 1 --2- 172.21.15.45:0/3133377256 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faaa415bb60 0x7faaa415c010 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7faa9c009760 tx=0x7faa9c009060).ready entity=mon.0 client_cookie=21b121c4617bb483 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:04.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:04.669+0000 7faaa89f5700 1 -- 172.21.15.45:0/3133377256 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa9c00f510 con 0x7faaa415bb60 2023-12-22T10:01:04.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:04.669+0000 7faaa89f5700 1 -- 172.21.15.45:0/3133377256 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa9c00f670 con 0x7faaa415bb60 2023-12-22T10:01:04.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:04.669+0000 7faaa89f5700 1 -- 172.21.15.45:0/3133377256 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa9c00f9f0 con 0x7faaa415bb60 2023-12-22T10:01:04.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:04.669+0000 7faaaa9f9700 1 -- 172.21.15.45:0/3133377256 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faaa415bb60 msgr2=0x7faaa415c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:04.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:04.669+0000 7faaaa9f9700 1 --2- 172.21.15.45:0/3133377256 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faaa415bb60 0x7faaa415c010 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7faa9c009760 tx=0x7faa9c009060).stop 2023-12-22T10:01:04.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:04.669+0000 7faaaa9f9700 1 -- 172.21.15.45:0/3133377256 shutdown_connections 2023-12-22T10:01:04.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:04.669+0000 7faaaa9f9700 1 --2- 172.21.15.45:0/3133377256 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faaa415bb60 0x7faaa415c010 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:04.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:04.669+0000 7faaaa9f9700 1 --2- 172.21.15.45:0/3133377256 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7faaa40a8ad0 0x7faaa4065860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:04.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:04.669+0000 7faaaa9f9700 1 -- 172.21.15.45:0/3133377256 >> 172.21.15.45:0/3133377256 conn(0x7faaa4067540 msgr2=0x7faaa40c6460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:04.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:04.669+0000 7faaaa9f9700 1 -- 172.21.15.45:0/3133377256 shutdown_connections 2023-12-22T10:01:04.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:04.669+0000 7faaaa9f9700 1 -- 172.21.15.45:0/3133377256 wait complete. 2023-12-22T10:01:04.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:04.673+0000 7faaaa9f9700 1 Processor -- start 2023-12-22T10:01:04.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:04.673+0000 7faaaa9f9700 1 -- start start 2023-12-22T10:01:04.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:04.673+0000 7faaaa9f9700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faaa40a8ad0 0x7faaa4153080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:04.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:04.673+0000 7faaaa9f9700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7faaa415bb60 0x7faaa40aacb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:04.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:04.673+0000 7faaaa9f9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faaa40ab1a0 0x7faaa40a94b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:04.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:04.673+0000 7faaaa9f9700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa4168810 con 0x7faaa40ab1a0 2023-12-22T10:01:04.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:04.673+0000 7faaaa9f9700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa4158680 con 0x7faaa40a8ad0 2023-12-22T10:01:04.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:04.673+0000 7faaaa9f9700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaa4158960 con 0x7faaa415bb60 2023-12-22T10:01:04.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:04.677+0000 7faaaa1f8700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faaa40ab1a0 0x7faaa40a94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:04.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:04.677+0000 7faaaa1f8700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faaa40ab1a0 0x7faaa40a94b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46516/0 (socket says 172.21.15.45:46516) 2023-12-22T10:01:04.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:04.677+0000 7faaaa1f8700 1 -- 172.21.15.45:0/1694862512 learned_addr learned my addr 172.21.15.45:0/1694862512 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:04.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:04.677+0000 7faaa91f6700 1 --2- 172.21.15.45:0/1694862512 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7faaa415bb60 0x7faaa40aacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:04.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:04.677+0000 7faaa99f7700 1 --2- 172.21.15.45:0/1694862512 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faaa40a8ad0 0x7faaa4153080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:04.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:04.677+0000 7faaaa1f8700 1 -- 172.21.15.45:0/1694862512 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7faaa415bb60 msgr2=0x7faaa40aacb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:04.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:04.677+0000 7faaaa1f8700 1 --2- 172.21.15.45:0/1694862512 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7faaa415bb60 0x7faaa40aacb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:04.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:04.677+0000 7faaaa1f8700 1 -- 172.21.15.45:0/1694862512 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faaa40a8ad0 msgr2=0x7faaa4153080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:04.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:04.677+0000 7faaaa1f8700 1 --2- 172.21.15.45:0/1694862512 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faaa40a8ad0 0x7faaa4153080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:04.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:04.677+0000 7faaaa1f8700 1 -- 172.21.15.45:0/1694862512 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa9c0092a0 con 0x7faaa40ab1a0 2023-12-22T10:01:04.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:04.677+0000 7faaaa1f8700 1 --2- 172.21.15.45:0/1694862512 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faaa40ab1a0 0x7faaa40a94b0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7faa9c009e00 tx=0x7faa9c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:04.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:04.677+0000 7faa99ffb700 1 -- 172.21.15.45:0/1694862512 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa9c00f510 con 0x7faaa40ab1a0 2023-12-22T10:01:04.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:04.677+0000 7faa99ffb700 1 -- 172.21.15.45:0/1694862512 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa9c00f9f0 con 0x7faaa40ab1a0 2023-12-22T10:01:04.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:04.677+0000 7faa99ffb700 1 -- 172.21.15.45:0/1694862512 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa9c01b660 con 0x7faaa40ab1a0 2023-12-22T10:01:04.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:04.677+0000 7faaaa9f9700 1 -- 172.21.15.45:0/1694862512 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaa40ab600 con 0x7faaa40ab1a0 2023-12-22T10:01:04.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:04.677+0000 7faaaa9f9700 1 -- 172.21.15.45:0/1694862512 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaa40aa410 con 0x7faaa40ab1a0 2023-12-22T10:01:04.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:04.681+0000 7faaaa9f9700 1 -- 172.21.15.45:0/1694862512 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faaa406a450 con 0x7faaa40ab1a0 2023-12-22T10:01:04.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:04.681+0000 7faa99ffb700 1 -- 172.21.15.45:0/1694862512 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7faa9c01ba10 con 0x7faaa40ab1a0 2023-12-22T10:01:04.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:04.681+0000 7faa99ffb700 1 --2- 172.21.15.45:0/1694862512 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7faa8805a510 0x7faa8805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:04.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:04.681+0000 7faa99ffb700 1 -- 172.21.15.45:0/1694862512 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7faa9c0762b0 con 0x7faaa40ab1a0 2023-12-22T10:01:04.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:04.681+0000 7faaa99f7700 1 --2- 172.21.15.45:0/1694862512 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7faa8805a510 0x7faa8805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:04.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:04.681+0000 7faaa99f7700 1 --2- 172.21.15.45:0/1694862512 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7faa8805a510 0x7faa8805c9d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7faaa0009fd0 tx=0x7faaa000b040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:04.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:04.689+0000 7faa99ffb700 1 -- 172.21.15.45:0/1694862512 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7faaa406a450 con 0x7faaa40ab1a0 2023-12-22T10:01:04.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:04.865+0000 7faaaa9f9700 1 -- 172.21.15.45:0/1694862512 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faaa406a450 con 0x7faaa40ab1a0 2023-12-22T10:01:04.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:04.869+0000 7faa99ffb700 1 -- 172.21.15.45:0/1694862512 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16928 (secure 0 0 0) 0x7faaa406a450 con 0x7faaa40ab1a0 2023-12-22T10:01:04.866 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:01:04.867 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":21,"fsid":"98b0837e-5e68-4c8f-a1a0-e9424baaad8f","created":"2023-12-22T10:00:15.010174+0000","modified":"2023-12-22T10:00:34.529651+0000","last_up_change":"2023-12-22T10:00:24.980513+0000","last_in_change":"2023-12-22T10:00:17.887172+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-12-22T10:00:25.069641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-12-22T10:00:26.906399+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-12-22T10:00:31.621311+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-12-22T10:00:32.538053+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e19943a0-1c6b-47df-b6bb-383472077890","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":33777},{"type":"v1","addr":"172.21.15.45:6819","nonce":33777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":33777},{"type":"v1","addr":"172.21.15.45:6822","nonce":33777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":33777},{"type":"v1","addr":"172.21.15.45:6830","nonce":33777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":33777},{"type":"v1","addr":"172.21.15.45:6826","nonce":33777}]},"public_addr":"172.21.15.45:6819/33777","cluster_addr":"172.21.15.45:6822/33777","heartbeat_back_addr":"172.21.15.45:6830/33777","heartbeat_front_addr":"172.21.15.45:6826/33777","state":["exists","up"]},{"osd":1,"uuid":"69670f34-f082-45a7-8f67-e962acc136e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":33775},{"type":"v1","addr":"172.21.15.45:6809","nonce":33775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":33775},{"type":"v1","addr":"172.21.15.45:6811","nonce":33775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":33775},{"type":"v1","addr":"172.21.15.45:6815","nonce":33775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":33775},{"type":"v1","addr":"172.21.15.45:6813","nonce":33775}]},"public_addr":"172.21.15.45:6809/33775","cluster_addr":"172.21.15.45:6811/33775","heartbeat_back_addr":"172.21.15.45:6815/33775","heartbeat_front_addr":"172.21.15.45:6813/33775","state":["exists","up"]},{"osd":2,"uuid":"d909d49b-82b8-401b-9947-e49dd167bb95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":33776},{"type":"v1","addr":"172.21.15.45:6801","nonce":33776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":33776},{"type":"v1","addr":"172.21.15.45:6803","nonce":33776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":33776},{"type":"v1","addr":"172.21.15.45:6807","nonce":33776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":33776},{"type":"v1","addr":"172.21.15.45:6805","nonce":33776}]},"public_addr":"172.21.15.45:6801/33776","cluster_addr":"172.21.15.45:6803/33776","heartbeat_back_addr":"172.21.15.45:6807/33776","heartbeat_front_addr":"172.21.15.45:6805/33776","state":["exists","up"]},{"osd":3,"uuid":"db104ca9-3a94-4d39-a2be-bd06db888095","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":33782},{"type":"v1","addr":"172.21.15.45:6817","nonce":33782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":33782},{"type":"v1","addr":"172.21.15.45:6823","nonce":33782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":33782},{"type":"v1","addr":"172.21.15.45:6831","nonce":33782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":33782},{"type":"v1","addr":"172.21.15.45:6827","nonce":33782}]},"public_addr":"172.21.15.45:6817/33782","cluster_addr":"172.21.15.45:6823/33782","heartbeat_back_addr":"172.21.15.45:6831/33782","heartbeat_front_addr":"172.21.15.45:6827/33782","state":["exists","up"]},{"osd":4,"uuid":"9f4eaff4-e433-4479-a0d1-ee7a33375ca6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":34099},{"type":"v1","addr":"172.21.15.113:6811","nonce":34099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":34099},{"type":"v1","addr":"172.21.15.113:6815","nonce":34099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":34099},{"type":"v1","addr":"172.21.15.113:6823","nonce":34099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6816","nonce":34099},{"type":"v1","addr":"172.21.15.113:6818","nonce":34099}]},"public_addr":"172.21.15.113:6811/34099","cluster_addr":"172.21.15.113:6815/34099","heartbeat_back_addr":"172.21.15.113:6823/34099","heartbeat_front_addr":"172.21.15.113:6818/34099","state":["exists","up"]},{"osd":5,"uuid":"1efc5591-180b-43af-8611-0068aadc5aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":34100},{"type":"v1","addr":"172.21.15.113:6801","nonce":34100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":34100},{"type":"v1","addr":"172.21.15.113:6803","nonce":34100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":34100},{"type":"v1","addr":"172.21.15.113:6807","nonce":34100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":34100},{"type":"v1","addr":"172.21.15.113:6805","nonce":34100}]},"public_addr":"172.21.15.113:6801/34100","cluster_addr":"172.21.15.113:6803/34100","heartbeat_back_addr":"172.21.15.113:6807/34100","heartbeat_front_addr":"172.21.15.113:6805/34100","state":["exists","up"]},{"osd":6,"uuid":"6c89d9d8-c153-4a48-afa9-97e4c403f1ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":34101},{"type":"v1","addr":"172.21.15.113:6810","nonce":34101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6812","nonce":34101},{"type":"v1","addr":"172.21.15.113:6814","nonce":34101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6822","nonce":34101},{"type":"v1","addr":"172.21.15.113:6824","nonce":34101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":34101},{"type":"v1","addr":"172.21.15.113:6819","nonce":34101}]},"public_addr":"172.21.15.113:6810/34101","cluster_addr":"172.21.15.113:6814/34101","heartbeat_back_addr":"172.21.15.113:6824/34101","heartbeat_front_addr":"172.21.15.113:6819/34101","state":["exists","up"]},{"osd":7,"uuid":"1855e70c-23f6-4c08-ad7f-774c2148235b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6821","nonce":34102},{"type":"v1","addr":"172.21.15.113:6825","nonce":34102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":34102},{"type":"v1","addr":"172.21.15.113:6827","nonce":34102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":34102},{"type":"v1","addr":"172.21.15.113:6831","nonce":34102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6828","nonce":34102},{"type":"v1","addr":"172.21.15.113:6829","nonce":34102}]},"public_addr":"172.21.15.113:6825/34102","cluster_addr":"172.21.15.113:6827/34102","heartbeat_back_addr":"172.21.15.113:6831/34102","heartbeat_front_addr":"172.21.15.113:6829/34102","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.812672+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.825045+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.700105+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.856563+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.954683+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.883234+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.883994+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.821686+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T10:01:04.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:04.869+0000 7faaaa9f9700 1 -- 172.21.15.45:0/1694862512 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7faa8805a510 msgr2=0x7faa8805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:04.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:04.869+0000 7faaaa9f9700 1 --2- 172.21.15.45:0/1694862512 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7faa8805a510 0x7faa8805c9d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7faaa0009fd0 tx=0x7faaa000b040).stop 2023-12-22T10:01:04.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:04.869+0000 7faaaa9f9700 1 -- 172.21.15.45:0/1694862512 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faaa40ab1a0 msgr2=0x7faaa40a94b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:04.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:04.869+0000 7faaaa9f9700 1 --2- 172.21.15.45:0/1694862512 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faaa40ab1a0 0x7faaa40a94b0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7faa9c009e00 tx=0x7faa9c017000).stop 2023-12-22T10:01:04.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:04.869+0000 7faaaa9f9700 1 -- 172.21.15.45:0/1694862512 shutdown_connections 2023-12-22T10:01:04.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:04.869+0000 7faaaa9f9700 1 --2- 172.21.15.45:0/1694862512 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faaa40ab1a0 0x7faaa40a94b0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:04.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:04.869+0000 7faaaa9f9700 1 --2- 172.21.15.45:0/1694862512 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7faa8805a510 0x7faa8805c9d0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:04.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:04.869+0000 7faaaa9f9700 1 --2- 172.21.15.45:0/1694862512 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7faaa415bb60 0x7faaa40aacb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:04.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:04.869+0000 7faaaa9f9700 1 --2- 172.21.15.45:0/1694862512 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faaa40a8ad0 0x7faaa4153080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:04.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:04.873+0000 7faaaa9f9700 1 -- 172.21.15.45:0/1694862512 >> 172.21.15.45:0/1694862512 conn(0x7faaa4067540 msgr2=0x7faaa4155110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:04.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:04.873+0000 7faaaa9f9700 1 -- 172.21.15.45:0/1694862512 shutdown_connections 2023-12-22T10:01:04.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:04.873+0000 7faaaa9f9700 1 -- 172.21.15.45:0/1694862512 wait complete. 2023-12-22T10:01:04.893 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-12-22T10:00:25.069641+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-12-22T10:00:26.906399+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-22T10:00:31.621311+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-12-22T10:00:32.538053+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-22T10:01:04.893 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-12-22T10:01:05.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.073+0000 7fdb46639700 1 Processor -- start 2023-12-22T10:01:05.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.073+0000 7fdb46639700 1 -- start start 2023-12-22T10:01:05.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.077+0000 7fdb46639700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fdb400acc10 0x7fdb400bfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:05.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.077+0000 7fdb46639700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb400ad450 con 0x7fdb400acff0 2023-12-22T10:01:05.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.077+0000 7fdb46639700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb400aa870 con 0x7fdb40067180 2023-12-22T10:01:05.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.077+0000 7fdb46639700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb400c0320 con 0x7fdb400acc10 2023-12-22T10:01:05.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.077+0000 7fdb44e36700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fdb400acff0 0x7fdb40066a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:40836/0 (socket says 172.21.15.45:40836) 2023-12-22T10:01:05.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.077+0000 7fdb44e36700 1 -- 172.21.15.45:0/2344410309 learned_addr learned my addr 172.21.15.45:0/2344410309 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:01:05.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.077+0000 7fdb45637700 1 --2- 172.21.15.45:0/2344410309 >> v2:172.21.15.45:3300/0 conn(0x7fdb400acc10 0x7fdb400bfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:05.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.077+0000 7fdb37fff700 1 -- 172.21.15.45:0/2344410309 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1237353039 0 0) 0x7fdb400ad450 con 0x7fdb400acff0 2023-12-22T10:01:05.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.077+0000 7fdb37fff700 1 -- 172.21.15.45:0/2344410309 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb2c0033f0 con 0x7fdb400acff0 2023-12-22T10:01:05.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.077+0000 7fdb37fff700 1 -- 172.21.15.45:0/2344410309 <== mon.1 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1919621783 0 0) 0x7fdb400aa870 con 0x7fdb40067180 2023-12-22T10:01:05.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.077+0000 7fdb37fff700 1 -- 172.21.15.45:0/2344410309 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb400ad450 con 0x7fdb40067180 2023-12-22T10:01:05.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.077+0000 7fdb45637700 1 -- 172.21.15.45:0/2344410309 >> v1:172.21.15.113:6789/0 conn(0x7fdb40067180 legacy=0x7fdb400ab310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:05.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.077+0000 7fdb45637700 1 -- 172.21.15.45:0/2344410309 >> v1:172.21.15.45:6789/0 conn(0x7fdb400acff0 legacy=0x7fdb40066a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:05.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.077+0000 7fdb45637700 1 -- 172.21.15.45:0/2344410309 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb400aab10 con 0x7fdb400acc10 2023-12-22T10:01:05.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.081+0000 7fdb45637700 1 --2- 172.21.15.45:0/2344410309 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb400acc10 0x7fdb400bfcd0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7fdb3c009760 tx=0x7fdb3c009060).ready entity=mon.0 client_cookie=6ab3238a82f9db3a server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:05.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.081+0000 7fdb37fff700 1 -- 172.21.15.45:0/2344410309 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb3c00d4a0 con 0x7fdb400acc10 2023-12-22T10:01:05.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.081+0000 7fdb37fff700 1 -- 172.21.15.45:0/2344410309 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb3c00d600 con 0x7fdb400acc10 2023-12-22T10:01:05.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.081+0000 7fdb37fff700 1 -- 172.21.15.45:0/2344410309 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb3c00d980 con 0x7fdb400acc10 2023-12-22T10:01:05.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.081+0000 7fdb46639700 1 -- 172.21.15.45:0/2344410309 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb400acc10 msgr2=0x7fdb400bfcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:05.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.081+0000 7fdb46639700 1 --2- 172.21.15.45:0/2344410309 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb400acc10 0x7fdb400bfcd0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7fdb3c009760 tx=0x7fdb3c009060).stop 2023-12-22T10:01:05.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.081+0000 7fdb46639700 1 -- 172.21.15.45:0/2344410309 shutdown_connections 2023-12-22T10:01:05.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.081+0000 7fdb46639700 1 --2- 172.21.15.45:0/2344410309 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb400acc10 0x7fdb400bfcd0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:05.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.081+0000 7fdb46639700 1 -- 172.21.15.45:0/2344410309 >> 172.21.15.45:0/2344410309 conn(0x7fdb400cb330 msgr2=0x7fdb400c7300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:05.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.081+0000 7fdb46639700 1 -- 172.21.15.45:0/2344410309 shutdown_connections 2023-12-22T10:01:05.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.081+0000 7fdb46639700 1 -- 172.21.15.45:0/2344410309 wait complete. 2023-12-22T10:01:05.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.085+0000 7fdb46639700 1 Processor -- start 2023-12-22T10:01:05.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.085+0000 7fdb46639700 1 -- start start 2023-12-22T10:01:05.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.085+0000 7fdb46639700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdb40067180 0x7fdb401589a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:05.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.085+0000 7fdb46639700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb400acc10 0x7fdb40158e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:05.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.085+0000 7fdb46639700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fdb400acff0 0x7fdb40156380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:05.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.085+0000 7fdb46639700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb40159380 con 0x7fdb400acc10 2023-12-22T10:01:05.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.085+0000 7fdb46639700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4013f2a0 con 0x7fdb40067180 2023-12-22T10:01:05.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.085+0000 7fdb46639700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4013f580 con 0x7fdb400acff0 2023-12-22T10:01:05.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.085+0000 7fdb44e36700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb400acc10 0x7fdb40158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:05.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.085+0000 7fdb44e36700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb400acc10 0x7fdb40158e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46546/0 (socket says 172.21.15.45:46546) 2023-12-22T10:01:05.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.085+0000 7fdb44e36700 1 -- 172.21.15.45:0/715647176 learned_addr learned my addr 172.21.15.45:0/715647176 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:05.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.085+0000 7fdb45637700 1 --2- 172.21.15.45:0/715647176 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdb40067180 0x7fdb401589a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:05.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.085+0000 7fdb45e38700 1 --2- 172.21.15.45:0/715647176 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fdb400acff0 0x7fdb40156380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:05.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.085+0000 7fdb44e36700 1 -- 172.21.15.45:0/715647176 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fdb400acff0 msgr2=0x7fdb40156380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:05.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.085+0000 7fdb44e36700 1 --2- 172.21.15.45:0/715647176 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fdb400acff0 0x7fdb40156380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:05.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.085+0000 7fdb44e36700 1 -- 172.21.15.45:0/715647176 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdb40067180 msgr2=0x7fdb401589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:05.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.085+0000 7fdb44e36700 1 --2- 172.21.15.45:0/715647176 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdb40067180 0x7fdb401589a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:05.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.085+0000 7fdb44e36700 1 -- 172.21.15.45:0/715647176 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb3c0092a0 con 0x7fdb400acc10 2023-12-22T10:01:05.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.085+0000 7fdb45e38700 1 --2- 172.21.15.45:0/715647176 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fdb400acff0 0x7fdb40156380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T10:01:05.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.085+0000 7fdb44e36700 1 --2- 172.21.15.45:0/715647176 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb400acc10 0x7fdb40158e90 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7fdb3000c560 tx=0x7fdb30007d20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:05.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.089+0000 7fdb357fa700 1 -- 172.21.15.45:0/715647176 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb300072e0 con 0x7fdb400acc10 2023-12-22T10:01:05.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.089+0000 7fdb357fa700 1 -- 172.21.15.45:0/715647176 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb30007440 con 0x7fdb400acc10 2023-12-22T10:01:05.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.089+0000 7fdb46639700 1 -- 172.21.15.45:0/715647176 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb4013f860 con 0x7fdb400acc10 2023-12-22T10:01:05.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.089+0000 7fdb357fa700 1 -- 172.21.15.45:0/715647176 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb300057a0 con 0x7fdb400acc10 2023-12-22T10:01:05.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.089+0000 7fdb46639700 1 -- 172.21.15.45:0/715647176 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb4013fe20 con 0x7fdb400acc10 2023-12-22T10:01:05.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.089+0000 7fdb46639700 1 -- 172.21.15.45:0/715647176 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb40047060 con 0x7fdb400acc10 2023-12-22T10:01:05.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.089+0000 7fdb357fa700 1 -- 172.21.15.45:0/715647176 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fdb30005b90 con 0x7fdb400acc10 2023-12-22T10:01:05.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.093+0000 7fdb357fa700 1 --2- 172.21.15.45:0/715647176 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fdb2405a510 0x7fdb2405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:05.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.093+0000 7fdb357fa700 1 -- 172.21.15.45:0/715647176 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fdb30073f30 con 0x7fdb400acc10 2023-12-22T10:01:05.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.093+0000 7fdb45637700 1 --2- 172.21.15.45:0/715647176 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fdb2405a510 0x7fdb2405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:05.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.093+0000 7fdb45637700 1 --2- 172.21.15.45:0/715647176 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fdb2405a510 0x7fdb2405c9d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7fdb3c006d60 tx=0x7fdb3c016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:05.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.097+0000 7fdb357fa700 1 -- 172.21.15.45:0/715647176 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fdb30047650 con 0x7fdb400acc10 2023-12-22T10:01:05.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.273+0000 7fdb46639700 1 -- 172.21.15.45:0/715647176 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fdb400aadf0 con 0x7fdb400acc10 2023-12-22T10:01:05.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.273+0000 7fdb357fa700 1 -- 172.21.15.45:0/715647176 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v21) v1 ==== 110+0+10 (secure 0 0 0) 0x7fdb3004ac70 con 0x7fdb400acc10 2023-12-22T10:01:05.273 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-12-22T10:01:05.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.277+0000 7fdb46639700 1 -- 172.21.15.45:0/715647176 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fdb2405a510 msgr2=0x7fdb2405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:05.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.277+0000 7fdb46639700 1 --2- 172.21.15.45:0/715647176 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fdb2405a510 0x7fdb2405c9d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7fdb3c006d60 tx=0x7fdb3c016000).stop 2023-12-22T10:01:05.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.277+0000 7fdb46639700 1 -- 172.21.15.45:0/715647176 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb400acc10 msgr2=0x7fdb40158e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:05.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.277+0000 7fdb46639700 1 --2- 172.21.15.45:0/715647176 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb400acc10 0x7fdb40158e90 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7fdb3000c560 tx=0x7fdb30007d20).stop 2023-12-22T10:01:05.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.277+0000 7fdb46639700 1 -- 172.21.15.45:0/715647176 shutdown_connections 2023-12-22T10:01:05.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.277+0000 7fdb46639700 1 --2- 172.21.15.45:0/715647176 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fdb2405a510 0x7fdb2405c9d0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:05.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.277+0000 7fdb46639700 1 --2- 172.21.15.45:0/715647176 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fdb400acff0 0x7fdb40156380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:05.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.277+0000 7fdb46639700 1 --2- 172.21.15.45:0/715647176 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb400acc10 0x7fdb40158e90 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:05.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.277+0000 7fdb46639700 1 --2- 172.21.15.45:0/715647176 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdb40067180 0x7fdb401589a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:05.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.277+0000 7fdb46639700 1 -- 172.21.15.45:0/715647176 >> 172.21.15.45:0/715647176 conn(0x7fdb400cb330 msgr2=0x7fdb401532f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:05.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.277+0000 7fdb46639700 1 -- 172.21.15.45:0/715647176 shutdown_connections 2023-12-22T10:01:05.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.277+0000 7fdb46639700 1 -- 172.21.15.45:0/715647176 wait complete. 2023-12-22T10:01:05.295 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-12-22T10:01:05.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.465+0000 7ff657507700 1 Processor -- start 2023-12-22T10:01:05.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.465+0000 7ff657507700 1 -- start start 2023-12-22T10:01:05.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.469+0000 7ff657507700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ff6500acca0 0x7ff6500ad080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:05.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.469+0000 7ff657507700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7ff6500c9d20 0x7ff6500c97e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:05.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.469+0000 7ff657507700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6500c5810 con 0x7ff6500ca230 2023-12-22T10:01:05.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.469+0000 7ff657507700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6500c8d90 con 0x7ff6500c9d20 2023-12-22T10:01:05.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.469+0000 7ff657507700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6500c9350 con 0x7ff6500acca0 2023-12-22T10:01:05.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.469+0000 7ff655d04700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7ff6500c9d20 0x7ff6500c97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:05.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.469+0000 7ff655d04700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7ff6500c9d20 0x7ff6500c97e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.45:57172/0 (socket says 172.21.15.45:57172) 2023-12-22T10:01:05.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.469+0000 7ff655d04700 1 -- 172.21.15.45:0/1779375118 learned_addr learned my addr 172.21.15.45:0/1779375118 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:05.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.469+0000 7ff656505700 1 --2- 172.21.15.45:0/1779375118 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ff6500acca0 0x7ff6500ad080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:05.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.469+0000 7ff656505700 1 -- 172.21.15.45:0/1779375118 >> v2:172.21.15.113:3300/0 conn(0x7ff6500c9d20 msgr2=0x7ff6500c97e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:05.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.469+0000 7ff656505700 1 --2- 172.21.15.45:0/1779375118 >> v2:172.21.15.113:3300/0 conn(0x7ff6500c9d20 0x7ff6500c97e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:05.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.469+0000 7ff656505700 1 -- 172.21.15.45:0/1779375118 >> v1:172.21.15.113:6789/0 conn(0x7ff6500ca230 legacy=0x7ff650068ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:05.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.469+0000 7ff656505700 1 -- 172.21.15.45:0/1779375118 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff650154070 con 0x7ff6500acca0 2023-12-22T10:01:05.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.469+0000 7ff655d04700 1 --2- 172.21.15.45:0/1779375118 >> v2:172.21.15.113:3300/0 conn(0x7ff6500c9d20 0x7ff6500c97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-12-22T10:01:05.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.469+0000 7ff656505700 1 --2- 172.21.15.45:0/1779375118 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ff6500acca0 0x7ff6500ad080 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7ff64c009760 tx=0x7ff64c009060).ready entity=mon.2 client_cookie=661edae0ceedd763 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:05.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.469+0000 7ff655503700 1 -- 172.21.15.45:0/1779375118 <== mon.2 v2:172.21.15.113:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff64c00f510 con 0x7ff6500acca0 2023-12-22T10:01:05.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.469+0000 7ff655503700 1 -- 172.21.15.45:0/1779375118 <== mon.2 v2:172.21.15.113:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff64c00f670 con 0x7ff6500acca0 2023-12-22T10:01:05.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.469+0000 7ff655503700 1 -- 172.21.15.45:0/1779375118 <== mon.2 v2:172.21.15.113:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff64c00f9f0 con 0x7ff6500acca0 2023-12-22T10:01:05.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.473+0000 7ff657507700 1 -- 172.21.15.45:0/1779375118 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ff6500acca0 msgr2=0x7ff6500ad080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:05.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.473+0000 7ff657507700 1 --2- 172.21.15.45:0/1779375118 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ff6500acca0 0x7ff6500ad080 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7ff64c009760 tx=0x7ff64c009060).stop 2023-12-22T10:01:05.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.473+0000 7ff657507700 1 -- 172.21.15.45:0/1779375118 shutdown_connections 2023-12-22T10:01:05.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.473+0000 7ff657507700 1 --2- 172.21.15.45:0/1779375118 >> v2:172.21.15.113:3300/0 conn(0x7ff6500c9d20 0x7ff6500c97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:05.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.473+0000 7ff657507700 1 --2- 172.21.15.45:0/1779375118 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ff6500acca0 0x7ff6500ad080 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:05.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.473+0000 7ff657507700 1 -- 172.21.15.45:0/1779375118 >> 172.21.15.45:0/1779375118 conn(0x7ff6500674f0 msgr2=0x7ff6500ca820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:05.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.473+0000 7ff657507700 1 -- 172.21.15.45:0/1779375118 shutdown_connections 2023-12-22T10:01:05.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.473+0000 7ff657507700 1 -- 172.21.15.45:0/1779375118 wait complete. 2023-12-22T10:01:05.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.477+0000 7ff657507700 1 Processor -- start 2023-12-22T10:01:05.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.477+0000 7ff657507700 1 -- start start 2023-12-22T10:01:05.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.477+0000 7ff657507700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff6500acca0 0x7ff650152200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:05.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.477+0000 7ff657507700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ff6500c9d20 0x7ff6500ad7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:05.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.477+0000 7ff657507700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6500ca230 0x7ff6500af030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:05.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.477+0000 7ff657507700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6500c19f0 con 0x7ff6500ca230 2023-12-22T10:01:05.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.477+0000 7ff657507700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6500ae200 con 0x7ff6500acca0 2023-12-22T10:01:05.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.477+0000 7ff657507700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6500ae4e0 con 0x7ff6500c9d20 2023-12-22T10:01:05.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.477+0000 7ff656d06700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6500ca230 0x7ff6500af030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:05.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.477+0000 7ff656505700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff6500acca0 0x7ff650152200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:05.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.477+0000 7ff656d06700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6500ca230 0x7ff6500af030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46554/0 (socket says 172.21.15.45:46554) 2023-12-22T10:01:05.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.477+0000 7ff656d06700 1 -- 172.21.15.45:0/3407218927 learned_addr learned my addr 172.21.15.45:0/3407218927 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:05.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.477+0000 7ff655d04700 1 --2- 172.21.15.45:0/3407218927 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ff6500c9d20 0x7ff6500ad7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:05.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.477+0000 7ff656505700 1 -- 172.21.15.45:0/3407218927 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ff6500c9d20 msgr2=0x7ff6500ad7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:05.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.477+0000 7ff656505700 1 --2- 172.21.15.45:0/3407218927 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ff6500c9d20 0x7ff6500ad7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:05.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.477+0000 7ff656505700 1 -- 172.21.15.45:0/3407218927 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6500ca230 msgr2=0x7ff6500af030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:05.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.477+0000 7ff656505700 1 --2- 172.21.15.45:0/3407218927 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6500ca230 0x7ff6500af030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:05.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.477+0000 7ff656505700 1 -- 172.21.15.45:0/3407218927 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff640009370 con 0x7ff6500acca0 2023-12-22T10:01:05.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.477+0000 7ff655d04700 1 --2- 172.21.15.45:0/3407218927 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ff6500c9d20 0x7ff6500ad7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-12-22T10:01:05.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.477+0000 7ff656505700 1 --2- 172.21.15.45:0/3407218927 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff6500acca0 0x7ff650152200 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7ff64c014000 tx=0x7ff64c017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:05.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.481+0000 7ff6467fc700 1 -- 172.21.15.45:0/3407218927 <== mon.1 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff64c00f7e0 con 0x7ff6500acca0 2023-12-22T10:01:05.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.481+0000 7ff6467fc700 1 -- 172.21.15.45:0/3407218927 <== mon.1 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff64c00f940 con 0x7ff6500acca0 2023-12-22T10:01:05.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.481+0000 7ff6467fc700 1 -- 172.21.15.45:0/3407218927 <== mon.1 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff64c01b690 con 0x7ff6500acca0 2023-12-22T10:01:05.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.481+0000 7ff657507700 1 -- 172.21.15.45:0/3407218927 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff64c0092a0 con 0x7ff6500acca0 2023-12-22T10:01:05.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.481+0000 7ff657507700 1 -- 172.21.15.45:0/3407218927 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6500aeaa0 con 0x7ff6500acca0 2023-12-22T10:01:05.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.481+0000 7ff657507700 1 -- 172.21.15.45:0/3407218927 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff650047060 con 0x7ff6500acca0 2023-12-22T10:01:05.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.485+0000 7ff6467fc700 1 -- 172.21.15.45:0/3407218927 <== mon.1 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7ff64c01ba80 con 0x7ff6500acca0 2023-12-22T10:01:05.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.485+0000 7ff6467fc700 1 --2- 172.21.15.45:0/3407218927 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7ff63405a560 0x7ff63405ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:05.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.485+0000 7ff6467fc700 1 -- 172.21.15.45:0/3407218927 <== mon.1 v2:172.21.15.113:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ff64c075d50 con 0x7ff6500acca0 2023-12-22T10:01:05.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.485+0000 7ff655d04700 1 --2- 172.21.15.45:0/3407218927 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7ff63405a560 0x7ff63405ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:05.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.485+0000 7ff655d04700 1 --2- 172.21.15.45:0/3407218927 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7ff63405a560 0x7ff63405ca20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7ff6500c3870 tx=0x7ff6400090f0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:05.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.493+0000 7ff6467fc700 1 -- 172.21.15.45:0/3407218927 <== mon.1 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff64c0494f0 con 0x7ff6500acca0 2023-12-22T10:01:05.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.665+0000 7ff657507700 1 -- 172.21.15.45:0/3407218927 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff6500c5a60 con 0x7ff6500acca0 2023-12-22T10:01:05.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.665+0000 7ff6467fc700 1 -- 172.21.15.45:0/3407218927 <== mon.1 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff64c028020 con 0x7ff6500acca0 2023-12-22T10:01:05.663 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-12-22T10:01:05.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.669+0000 7ff657507700 1 -- 172.21.15.45:0/3407218927 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7ff63405a560 msgr2=0x7ff63405ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:05.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.669+0000 7ff657507700 1 --2- 172.21.15.45:0/3407218927 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7ff63405a560 0x7ff63405ca20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7ff6500c3870 tx=0x7ff6400090f0).stop 2023-12-22T10:01:05.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.669+0000 7ff657507700 1 -- 172.21.15.45:0/3407218927 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff6500acca0 msgr2=0x7ff650152200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:05.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.669+0000 7ff657507700 1 --2- 172.21.15.45:0/3407218927 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff6500acca0 0x7ff650152200 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7ff64c014000 tx=0x7ff64c017000).stop 2023-12-22T10:01:05.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.669+0000 7ff657507700 1 -- 172.21.15.45:0/3407218927 shutdown_connections 2023-12-22T10:01:05.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.669+0000 7ff657507700 1 --2- 172.21.15.45:0/3407218927 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6500ca230 0x7ff6500af030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:05.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.669+0000 7ff657507700 1 --2- 172.21.15.45:0/3407218927 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7ff63405a560 0x7ff63405ca20 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:05.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.669+0000 7ff657507700 1 --2- 172.21.15.45:0/3407218927 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ff6500c9d20 0x7ff6500ad7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:05.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.669+0000 7ff657507700 1 --2- 172.21.15.45:0/3407218927 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff6500acca0 0x7ff650152200 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:05.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.669+0000 7ff657507700 1 -- 172.21.15.45:0/3407218927 >> 172.21.15.45:0/3407218927 conn(0x7ff6500674f0 msgr2=0x7ff6500c1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:05.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.669+0000 7ff657507700 1 -- 172.21.15.45:0/3407218927 shutdown_connections 2023-12-22T10:01:05.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.669+0000 7ff657507700 1 -- 172.21.15.45:0/3407218927 wait complete. 2023-12-22T10:01:05.685 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-22T10:01:05.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.857+0000 7f6abb59e700 1 Processor -- start 2023-12-22T10:01:05.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.861+0000 7f6abb59e700 1 -- start start 2023-12-22T10:01:05.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.861+0000 7f6abb59e700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f6abc0acca0 0x7f6abc0ad080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:05.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.861+0000 7f6abb59e700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f6abc0c9d20 0x7f6abc0c97e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:05.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.861+0000 7f6abb59e700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6abc0c5810 con 0x7f6abc0ca230 2023-12-22T10:01:05.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.861+0000 7f6abb59e700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6abc0c8d90 con 0x7f6abc0acca0 2023-12-22T10:01:05.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.861+0000 7f6abb59e700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6abc0c9350 con 0x7f6abc0c9d20 2023-12-22T10:01:05.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.861+0000 7f6aba59c700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f6abc0acca0 0x7f6abc0ad080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:05.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.861+0000 7f6ab9d9b700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f6abc0c9d20 0x7f6abc0c97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:05.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.861+0000 7f6abad9d700 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f6abc0ca230 0x7f6abc068ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.45:37188/0 (socket says 172.21.15.45:37188) 2023-12-22T10:01:05.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.861+0000 7f6ab9d9b700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f6abc0c9d20 0x7f6abc0c97e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.113:3301/0 says I am v2:172.21.15.45:36704/0 (socket says 172.21.15.45:36704) 2023-12-22T10:01:05.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.861+0000 7f6abad9d700 1 -- 172.21.15.45:0/2117889676 learned_addr learned my addr 172.21.15.45:0/2117889676 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:01:05.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.865+0000 7f6ab9d9b700 1 -- 172.21.15.45:0/2117889676 >> v2:172.21.15.113:3300/0 conn(0x7f6abc0acca0 msgr2=0x7f6abc0ad080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:05.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.865+0000 7f6ab9d9b700 1 --2- 172.21.15.45:0/2117889676 >> v2:172.21.15.113:3300/0 conn(0x7f6abc0acca0 0x7f6abc0ad080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:05.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.865+0000 7f6ab9d9b700 1 -- 172.21.15.45:0/2117889676 >> v1:172.21.15.113:6789/0 conn(0x7f6abc0ca230 legacy=0x7f6abc068ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:05.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.865+0000 7f6ab9d9b700 1 -- 172.21.15.45:0/2117889676 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6abc154070 con 0x7f6abc0c9d20 2023-12-22T10:01:05.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.865+0000 7f6ab9d9b700 1 --2- 172.21.15.45:0/2117889676 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f6abc0c9d20 0x7f6abc0c97e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f6ab0009760 tx=0x7f6ab0009060).ready entity=mon.2 client_cookie=cee6d84bef6c4b7 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:05.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.865+0000 7f6ab959a700 1 -- 172.21.15.45:0/2117889676 <== mon.2 v2:172.21.15.113:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ab000f510 con 0x7f6abc0c9d20 2023-12-22T10:01:05.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.865+0000 7f6ab959a700 1 -- 172.21.15.45:0/2117889676 <== mon.2 v2:172.21.15.113:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ab000f670 con 0x7f6abc0c9d20 2023-12-22T10:01:05.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.865+0000 7f6ab959a700 1 -- 172.21.15.45:0/2117889676 <== mon.2 v2:172.21.15.113:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ab000f9f0 con 0x7f6abc0c9d20 2023-12-22T10:01:05.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.865+0000 7f6abb59e700 1 -- 172.21.15.45:0/2117889676 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f6abc0c9d20 msgr2=0x7f6abc0c97e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:05.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.865+0000 7f6abb59e700 1 --2- 172.21.15.45:0/2117889676 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f6abc0c9d20 0x7f6abc0c97e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f6ab0009760 tx=0x7f6ab0009060).stop 2023-12-22T10:01:05.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.865+0000 7f6abb59e700 1 -- 172.21.15.45:0/2117889676 shutdown_connections 2023-12-22T10:01:05.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.865+0000 7f6abb59e700 1 --2- 172.21.15.45:0/2117889676 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f6abc0c9d20 0x7f6abc0c97e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:05.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.865+0000 7f6abb59e700 1 --2- 172.21.15.45:0/2117889676 >> v2:172.21.15.113:3300/0 conn(0x7f6abc0acca0 0x7f6abc0ad080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:05.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.865+0000 7f6abb59e700 1 -- 172.21.15.45:0/2117889676 >> 172.21.15.45:0/2117889676 conn(0x7f6abc0674f0 msgr2=0x7f6abc0ca820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:05.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.865+0000 7f6abb59e700 1 -- 172.21.15.45:0/2117889676 shutdown_connections 2023-12-22T10:01:05.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.865+0000 7f6abb59e700 1 -- 172.21.15.45:0/2117889676 wait complete. 2023-12-22T10:01:05.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.869+0000 7f6abb59e700 1 Processor -- start 2023-12-22T10:01:05.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.869+0000 7f6abb59e700 1 -- start start 2023-12-22T10:01:05.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.869+0000 7f6abb59e700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f6abc0acca0 0x7f6abc0ae5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:05.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.869+0000 7f6abb59e700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6abc0c9d20 0x7f6abc164080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:05.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.869+0000 7f6abb59e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6abc0ca230 0x7f6abc0ab190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:05.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.869+0000 7f6abb59e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6abc0aeaa0 con 0x7f6abc0ca230 2023-12-22T10:01:05.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.869+0000 7f6abb59e700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6abc0c3210 con 0x7f6abc0c9d20 2023-12-22T10:01:05.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.869+0000 7f6abb59e700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6abc0aece0 con 0x7f6abc0acca0 2023-12-22T10:01:05.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.869+0000 7f6abad9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6abc0ca230 0x7f6abc0ab190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:05.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.869+0000 7f6abad9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6abc0ca230 0x7f6abc0ab190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46568/0 (socket says 172.21.15.45:46568) 2023-12-22T10:01:05.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.869+0000 7f6abad9d700 1 -- 172.21.15.45:0/3116989439 learned_addr learned my addr 172.21.15.45:0/3116989439 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:05.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.869+0000 7f6ab9d9b700 1 --2- 172.21.15.45:0/3116989439 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6abc0c9d20 0x7f6abc164080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:05.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.869+0000 7f6aba59c700 1 --2- 172.21.15.45:0/3116989439 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f6abc0acca0 0x7f6abc0ae5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:05.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.869+0000 7f6abad9d700 1 -- 172.21.15.45:0/3116989439 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f6abc0acca0 msgr2=0x7f6abc0ae5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:05.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.869+0000 7f6abad9d700 1 --2- 172.21.15.45:0/3116989439 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f6abc0acca0 0x7f6abc0ae5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:05.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.869+0000 7f6abad9d700 1 -- 172.21.15.45:0/3116989439 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6abc0c9d20 msgr2=0x7f6abc164080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:05.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.869+0000 7f6abad9d700 1 --2- 172.21.15.45:0/3116989439 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6abc0c9d20 0x7f6abc164080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:05.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.869+0000 7f6abad9d700 1 -- 172.21.15.45:0/3116989439 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ab00092a0 con 0x7f6abc0ca230 2023-12-22T10:01:05.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.869+0000 7f6ab9d9b700 1 --2- 172.21.15.45:0/3116989439 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6abc0c9d20 0x7f6abc164080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T10:01:05.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.869+0000 7f6abad9d700 1 --2- 172.21.15.45:0/3116989439 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6abc0ca230 0x7f6abc0ab190 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f6ab400c790 tx=0x7f6ab40015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:05.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.873+0000 7f6aaa7fc700 1 -- 172.21.15.45:0/3116989439 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ab4005d30 con 0x7f6abc0ca230 2023-12-22T10:01:05.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.873+0000 7f6aaa7fc700 1 -- 172.21.15.45:0/3116989439 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ab4005e90 con 0x7f6abc0ca230 2023-12-22T10:01:05.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.873+0000 7f6abb59e700 1 -- 172.21.15.45:0/3116989439 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6abc0aefc0 con 0x7f6abc0ca230 2023-12-22T10:01:05.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.873+0000 7f6aaa7fc700 1 -- 172.21.15.45:0/3116989439 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ab4007320 con 0x7f6abc0ca230 2023-12-22T10:01:05.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.873+0000 7f6abb59e700 1 -- 172.21.15.45:0/3116989439 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6abc0c3790 con 0x7f6abc0ca230 2023-12-22T10:01:05.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.873+0000 7f6abb59e700 1 -- 172.21.15.45:0/3116989439 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6abc0af150 con 0x7f6abc0ca230 2023-12-22T10:01:05.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.873+0000 7f6aaa7fc700 1 -- 172.21.15.45:0/3116989439 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f6ab40076d0 con 0x7f6abc0ca230 2023-12-22T10:01:05.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.877+0000 7f6aaa7fc700 1 --2- 172.21.15.45:0/3116989439 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f6a9c05a540 0x7f6a9c05ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:05.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.877+0000 7f6aaa7fc700 1 -- 172.21.15.45:0/3116989439 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f6ab40748e0 con 0x7f6abc0ca230 2023-12-22T10:01:05.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.877+0000 7f6aba59c700 1 --2- 172.21.15.45:0/3116989439 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f6a9c05a540 0x7f6a9c05ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:05.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.877+0000 7f6aba59c700 1 --2- 172.21.15.45:0/3116989439 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f6a9c05a540 0x7f6a9c05ca00 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f6aac009b20 tx=0x7f6aac008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:05.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:05.885+0000 7f6aaa7fc700 1 -- 172.21.15.45:0/3116989439 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f6ab4048000 con 0x7f6abc0ca230 2023-12-22T10:01:06.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.057+0000 7f6abb59e700 1 -- 172.21.15.45:0/3116989439 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6abc0c3980 con 0x7f6abc0ca230 2023-12-22T10:01:06.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.057+0000 7f6aaa7fc700 1 -- 172.21.15.45:0/3116989439 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6ab404b620 con 0x7f6abc0ca230 2023-12-22T10:01:06.054 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-22T10:01:06.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.061+0000 7f6abb59e700 1 -- 172.21.15.45:0/3116989439 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f6a9c05a540 msgr2=0x7f6a9c05ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:06.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.061+0000 7f6abb59e700 1 --2- 172.21.15.45:0/3116989439 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f6a9c05a540 0x7f6a9c05ca00 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f6aac009b20 tx=0x7f6aac008040).stop 2023-12-22T10:01:06.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.061+0000 7f6abb59e700 1 -- 172.21.15.45:0/3116989439 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6abc0ca230 msgr2=0x7f6abc0ab190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:06.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.061+0000 7f6abb59e700 1 --2- 172.21.15.45:0/3116989439 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6abc0ca230 0x7f6abc0ab190 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f6ab400c790 tx=0x7f6ab40015e0).stop 2023-12-22T10:01:06.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.061+0000 7f6abb59e700 1 -- 172.21.15.45:0/3116989439 shutdown_connections 2023-12-22T10:01:06.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.061+0000 7f6abb59e700 1 --2- 172.21.15.45:0/3116989439 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6abc0ca230 0x7f6abc0ab190 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:06.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.061+0000 7f6abb59e700 1 --2- 172.21.15.45:0/3116989439 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6abc0c9d20 0x7f6abc164080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:06.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.061+0000 7f6abb59e700 1 --2- 172.21.15.45:0/3116989439 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f6a9c05a540 0x7f6a9c05ca00 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:06.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.061+0000 7f6abb59e700 1 --2- 172.21.15.45:0/3116989439 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f6abc0acca0 0x7f6abc0ae5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:06.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.061+0000 7f6abb59e700 1 -- 172.21.15.45:0/3116989439 >> 172.21.15.45:0/3116989439 conn(0x7f6abc0674f0 msgr2=0x7f6abc068ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:06.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.061+0000 7f6abb59e700 1 -- 172.21.15.45:0/3116989439 shutdown_connections 2023-12-22T10:01:06.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.061+0000 7f6abb59e700 1 -- 172.21.15.45:0/3116989439 wait complete. 2023-12-22T10:01:06.076 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-22T10:01:06.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.249+0000 7f1fadf79700 1 Processor -- start 2023-12-22T10:01:06.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.249+0000 7f1fadf79700 1 -- start start 2023-12-22T10:01:06.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.249+0000 7f1fadf79700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1fa814f310 0x7f1fa8152c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:06.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.249+0000 7f1fadf79700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1fa814f6f0 0x7f1fa80c4b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:06.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.249+0000 7f1fadf79700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1fa8065740 0x7f1fa80a87c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:06.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.249+0000 7f1fadf79700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fa8152780 con 0x7f1fa8065740 2023-12-22T10:01:06.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.249+0000 7f1fadf79700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fa80c5210 con 0x7f1fa814f310 2023-12-22T10:01:06.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.249+0000 7f1fadf79700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa8152130 con 0x7f1fa814f6f0 2023-12-22T10:01:06.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.249+0000 7f1fad778700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1fa8065740 0x7f1fa80a87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:06.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.249+0000 7f1fad778700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1fa8065740 0x7f1fa80a87c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46574/0 (socket says 172.21.15.45:46574) 2023-12-22T10:01:06.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.249+0000 7f1fad778700 1 -- 172.21.15.45:0/1629803131 learned_addr learned my addr 172.21.15.45:0/1629803131 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:06.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.249+0000 7f1f9ffff700 1 --2- 172.21.15.45:0/1629803131 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1fa814f6f0 0x7f1fa80c4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:06.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.249+0000 7f1facf77700 1 --2- 172.21.15.45:0/1629803131 >> v2:172.21.15.113:3300/0 conn(0x7f1fa814f310 0x7f1fa8152c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:06.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.253+0000 7f1f9ffff700 1 -- 172.21.15.45:0/1629803131 >> v2:172.21.15.113:3300/0 conn(0x7f1fa814f310 msgr2=0x7f1fa8152c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:06.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.253+0000 7f1f9ffff700 1 --2- 172.21.15.45:0/1629803131 >> v2:172.21.15.113:3300/0 conn(0x7f1fa814f310 0x7f1fa8152c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:06.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.253+0000 7f1f9ffff700 1 -- 172.21.15.45:0/1629803131 >> v2:172.21.15.45:3300/0 conn(0x7f1fa8065740 msgr2=0x7f1fa80a87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:06.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.253+0000 7f1f9ffff700 1 --2- 172.21.15.45:0/1629803131 >> v2:172.21.15.45:3300/0 conn(0x7f1fa8065740 0x7f1fa80a87c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:06.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.253+0000 7f1f9ffff700 1 -- 172.21.15.45:0/1629803131 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fa8152410 con 0x7f1fa814f6f0 2023-12-22T10:01:06.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.253+0000 7f1f9ffff700 1 --2- 172.21.15.45:0/1629803131 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1fa814f6f0 0x7f1fa80c4b80 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f1fa80c3ef0 tx=0x7f1f98009060).ready entity=mon.2 client_cookie=455d1b4ab1e250c8 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:06.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.253+0000 7f1f9f7fe700 1 -- 172.21.15.45:0/1629803131 <== mon.2 v2:172.21.15.113:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f9800d4a0 con 0x7f1fa814f6f0 2023-12-22T10:01:06.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.253+0000 7f1f9f7fe700 1 -- 172.21.15.45:0/1629803131 <== mon.2 v2:172.21.15.113:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f9800d600 con 0x7f1fa814f6f0 2023-12-22T10:01:06.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.253+0000 7f1f9f7fe700 1 -- 172.21.15.45:0/1629803131 <== mon.2 v2:172.21.15.113:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f9800d980 con 0x7f1fa814f6f0 2023-12-22T10:01:06.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.253+0000 7f1fadf79700 1 -- 172.21.15.45:0/1629803131 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1fa814f6f0 msgr2=0x7f1fa80c4b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:06.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.253+0000 7f1fadf79700 1 --2- 172.21.15.45:0/1629803131 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1fa814f6f0 0x7f1fa80c4b80 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f1fa80c3ef0 tx=0x7f1f98009060).stop 2023-12-22T10:01:06.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.253+0000 7f1fadf79700 1 -- 172.21.15.45:0/1629803131 shutdown_connections 2023-12-22T10:01:06.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.253+0000 7f1fadf79700 1 --2- 172.21.15.45:0/1629803131 >> v2:172.21.15.45:3300/0 conn(0x7f1fa8065740 0x7f1fa80a87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:06.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.253+0000 7f1fadf79700 1 --2- 172.21.15.45:0/1629803131 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1fa814f6f0 0x7f1fa80c4b80 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:06.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.253+0000 7f1fadf79700 1 --2- 172.21.15.45:0/1629803131 >> v2:172.21.15.113:3300/0 conn(0x7f1fa814f310 0x7f1fa8152c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:06.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.253+0000 7f1fadf79700 1 -- 172.21.15.45:0/1629803131 >> 172.21.15.45:0/1629803131 conn(0x7f1fa8067500 msgr2=0x7f1fa80c6440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:06.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.253+0000 7f1fadf79700 1 -- 172.21.15.45:0/1629803131 shutdown_connections 2023-12-22T10:01:06.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.253+0000 7f1fadf79700 1 -- 172.21.15.45:0/1629803131 wait complete. 2023-12-22T10:01:06.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.253+0000 7f1fadf79700 1 Processor -- start 2023-12-22T10:01:06.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.257+0000 7f1fadf79700 1 -- start start 2023-12-22T10:01:06.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.257+0000 7f1fadf79700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1fa8065740 0x7f1fa816b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:06.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.257+0000 7f1fadf79700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1fa814f310 0x7f1fa81687c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:06.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.257+0000 7f1fadf79700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1fa814f6f0 0x7f1fa8149cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:06.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.257+0000 7f1fadf79700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa814ae60 con 0x7f1fa814f6f0 2023-12-22T10:01:06.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.257+0000 7f1fadf79700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa8169130 con 0x7f1fa8065740 2023-12-22T10:01:06.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.257+0000 7f1fadf79700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa8169410 con 0x7f1fa814f310 2023-12-22T10:01:06.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.257+0000 7f1fad778700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1fa814f6f0 0x7f1fa8149cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:06.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.257+0000 7f1fad778700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1fa814f6f0 0x7f1fa8149cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46584/0 (socket says 172.21.15.45:46584) 2023-12-22T10:01:06.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.257+0000 7f1fad778700 1 -- 172.21.15.45:0/1017371548 learned_addr learned my addr 172.21.15.45:0/1017371548 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:06.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.257+0000 7f1facf77700 1 --2- 172.21.15.45:0/1017371548 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1fa8065740 0x7f1fa816b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:06.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.257+0000 7f1f9ffff700 1 --2- 172.21.15.45:0/1017371548 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1fa814f310 0x7f1fa81687c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:06.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.257+0000 7f1fad778700 1 -- 172.21.15.45:0/1017371548 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1fa814f310 msgr2=0x7f1fa81687c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:06.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.257+0000 7f1fad778700 1 --2- 172.21.15.45:0/1017371548 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1fa814f310 0x7f1fa81687c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:06.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.257+0000 7f1fad778700 1 -- 172.21.15.45:0/1017371548 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1fa8065740 msgr2=0x7f1fa816b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:06.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.257+0000 7f1fad778700 1 --2- 172.21.15.45:0/1017371548 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1fa8065740 0x7f1fa816b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:06.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.257+0000 7f1fad778700 1 -- 172.21.15.45:0/1017371548 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f980092a0 con 0x7f1fa814f6f0 2023-12-22T10:01:06.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.257+0000 7f1fad778700 1 --2- 172.21.15.45:0/1017371548 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1fa814f6f0 0x7f1fa8149cf0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f1fa0009e50 tx=0x7f1fa000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:06.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.257+0000 7f1f9cff9700 1 -- 172.21.15.45:0/1017371548 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa000c890 con 0x7f1fa814f6f0 2023-12-22T10:01:06.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.257+0000 7f1f9cff9700 1 -- 172.21.15.45:0/1017371548 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fa000f040 con 0x7f1fa814f6f0 2023-12-22T10:01:06.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.257+0000 7f1fadf79700 1 -- 172.21.15.45:0/1017371548 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fa814b100 con 0x7f1fa814f6f0 2023-12-22T10:01:06.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.257+0000 7f1f9cff9700 1 -- 172.21.15.45:0/1017371548 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa000cc00 con 0x7f1fa814f6f0 2023-12-22T10:01:06.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.257+0000 7f1fadf79700 1 -- 172.21.15.45:0/1017371548 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fa816b9f0 con 0x7f1fa814f6f0 2023-12-22T10:01:06.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.261+0000 7f1fadf79700 1 -- 172.21.15.45:0/1017371548 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fa816bb80 con 0x7f1fa814f6f0 2023-12-22T10:01:06.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.261+0000 7f1f9cff9700 1 -- 172.21.15.45:0/1017371548 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f1fa0014410 con 0x7f1fa814f6f0 2023-12-22T10:01:06.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.261+0000 7f1f9cff9700 1 --2- 172.21.15.45:0/1017371548 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f1f9405a4e0 0x7f1f9405c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:06.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.265+0000 7f1f9cff9700 1 -- 172.21.15.45:0/1017371548 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f1fa00748e0 con 0x7f1fa814f6f0 2023-12-22T10:01:06.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.265+0000 7f1facf77700 1 --2- 172.21.15.45:0/1017371548 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f1f9405a4e0 0x7f1f9405c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:06.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.265+0000 7f1facf77700 1 --2- 172.21.15.45:0/1017371548 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f1f9405a4e0 0x7f1f9405c9a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f1fa4009c30 tx=0x7f1fa4009060).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:06.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.269+0000 7f1f9cff9700 1 -- 172.21.15.45:0/1017371548 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f1fa816bb80 con 0x7f1fa814f6f0 2023-12-22T10:01:06.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.433+0000 7f1fadf79700 1 -- 172.21.15.45:0/1017371548 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1fa816bb80 con 0x7f1fa814f6f0 2023-12-22T10:01:06.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.433+0000 7f1f9cff9700 1 -- 172.21.15.45:0/1017371548 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1fa816bb80 con 0x7f1fa814f6f0 2023-12-22T10:01:06.431 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-22T10:01:06.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.437+0000 7f1fadf79700 1 -- 172.21.15.45:0/1017371548 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f1f9405a4e0 msgr2=0x7f1f9405c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:06.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.437+0000 7f1fadf79700 1 --2- 172.21.15.45:0/1017371548 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f1f9405a4e0 0x7f1f9405c9a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f1fa4009c30 tx=0x7f1fa4009060).stop 2023-12-22T10:01:06.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.437+0000 7f1fadf79700 1 -- 172.21.15.45:0/1017371548 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1fa814f6f0 msgr2=0x7f1fa8149cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:06.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.437+0000 7f1fadf79700 1 --2- 172.21.15.45:0/1017371548 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1fa814f6f0 0x7f1fa8149cf0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f1fa0009e50 tx=0x7f1fa000b040).stop 2023-12-22T10:01:06.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.437+0000 7f1fadf79700 1 -- 172.21.15.45:0/1017371548 shutdown_connections 2023-12-22T10:01:06.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.437+0000 7f1fadf79700 1 --2- 172.21.15.45:0/1017371548 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1fa814f6f0 0x7f1fa8149cf0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:06.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.437+0000 7f1fadf79700 1 --2- 172.21.15.45:0/1017371548 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f1f9405a4e0 0x7f1f9405c9a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:06.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.437+0000 7f1fadf79700 1 --2- 172.21.15.45:0/1017371548 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1fa814f310 0x7f1fa81687c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:06.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.437+0000 7f1fadf79700 1 --2- 172.21.15.45:0/1017371548 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1fa8065740 0x7f1fa816b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:06.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.437+0000 7f1fadf79700 1 -- 172.21.15.45:0/1017371548 >> 172.21.15.45:0/1017371548 conn(0x7f1fa8067500 msgr2=0x7f1fa8150150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:06.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.437+0000 7f1fadf79700 1 -- 172.21.15.45:0/1017371548 shutdown_connections 2023-12-22T10:01:06.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.437+0000 7f1fadf79700 1 -- 172.21.15.45:0/1017371548 wait complete. 2023-12-22T10:01:06.456 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T10:01:06.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.621+0000 7f8607569700 1 Processor -- start 2023-12-22T10:01:06.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.621+0000 7f8607569700 1 -- start start 2023-12-22T10:01:06.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.625+0000 7f8607569700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f86000c7b40 0x7f86000c8d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:06.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.625+0000 7f8607569700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f86000ac770 0x7f86000c9260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:06.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.625+0000 7f8607569700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86000c9aa0 con 0x7f86000ac390 2023-12-22T10:01:06.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.625+0000 7f8607569700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86000c9d80 con 0x7f86000c7b40 2023-12-22T10:01:06.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.625+0000 7f8607569700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86000ca060 con 0x7f86000ac770 2023-12-22T10:01:06.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.625+0000 7f8604b04700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f86000c7b40 0x7f86000c8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:06.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.625+0000 7f8604b04700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f86000c7b40 0x7f86000c8d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.45:57222/0 (socket says 172.21.15.45:57222) 2023-12-22T10:01:06.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.625+0000 7f8604b04700 1 -- 172.21.15.45:0/1912300957 learned_addr learned my addr 172.21.15.45:0/1912300957 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:06.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.625+0000 7f8605b06700 1 --2- 172.21.15.45:0/1912300957 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f86000ac770 0x7f86000c9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:06.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.625+0000 7f8605305700 1 --1- 172.21.15.45:0/1912300957 >> v1:172.21.15.113:6789/0 conn(0x7f86000ac390 0x7f86000c7430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.45:37198/0 (socket says 172.21.15.45:37198) 2023-12-22T10:01:06.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.625+0000 7f8604b04700 1 -- 172.21.15.45:0/1912300957 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f86000ac770 msgr2=0x7f86000c9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:06.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.625+0000 7f8604b04700 1 --2- 172.21.15.45:0/1912300957 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f86000ac770 0x7f86000c9260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:06.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.629+0000 7f8604b04700 1 -- 172.21.15.45:0/1912300957 >> v1:172.21.15.113:6789/0 conn(0x7f86000ac390 legacy=0x7f86000c7430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:06.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.629+0000 7f8604b04700 1 -- 172.21.15.45:0/1912300957 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86000ca340 con 0x7f86000c7b40 2023-12-22T10:01:06.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.629+0000 7f8604b04700 1 --2- 172.21.15.45:0/1912300957 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f86000c7b40 0x7f86000c8d70 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f85f0006fd0 tx=0x7f85f00090f0).ready entity=mon.1 client_cookie=f0a8bfd1eaf3b1b2 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:06.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.629+0000 7f85f7fff700 1 -- 172.21.15.45:0/1912300957 <== mon.1 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f000b580 con 0x7f86000c7b40 2023-12-22T10:01:06.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.629+0000 7f85f7fff700 1 -- 172.21.15.45:0/1912300957 <== mon.1 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85f000b6e0 con 0x7f86000c7b40 2023-12-22T10:01:06.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.629+0000 7f85f7fff700 1 -- 172.21.15.45:0/1912300957 <== mon.1 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f000ba60 con 0x7f86000c7b40 2023-12-22T10:01:06.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.629+0000 7f8607569700 1 -- 172.21.15.45:0/1912300957 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f86000c7b40 msgr2=0x7f86000c8d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:06.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.629+0000 7f8607569700 1 --2- 172.21.15.45:0/1912300957 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f86000c7b40 0x7f86000c8d70 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f85f0006fd0 tx=0x7f85f00090f0).stop 2023-12-22T10:01:06.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.629+0000 7f8607569700 1 -- 172.21.15.45:0/1912300957 shutdown_connections 2023-12-22T10:01:06.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.629+0000 7f8607569700 1 --2- 172.21.15.45:0/1912300957 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f86000ac770 0x7f86000c9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:06.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.629+0000 7f8607569700 1 --2- 172.21.15.45:0/1912300957 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f86000c7b40 0x7f86000c8d70 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:06.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.629+0000 7f8607569700 1 -- 172.21.15.45:0/1912300957 >> 172.21.15.45:0/1912300957 conn(0x7f8600082a30 msgr2=0x7f8600066a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:06.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.629+0000 7f8607569700 1 -- 172.21.15.45:0/1912300957 shutdown_connections 2023-12-22T10:01:06.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.629+0000 7f8607569700 1 -- 172.21.15.45:0/1912300957 wait complete. 2023-12-22T10:01:06.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.633+0000 7f8607569700 1 Processor -- start 2023-12-22T10:01:06.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.633+0000 7f8607569700 1 -- start start 2023-12-22T10:01:06.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.637+0000 7f8607569700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f86000ac390 0x7f860014d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:06.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.637+0000 7f8607569700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86000ac770 0x7f86001507c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:06.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.637+0000 7f8607569700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f86000c7b40 0x7f8600150cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:06.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.637+0000 7f8607569700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8600152100 con 0x7f86000ac770 2023-12-22T10:01:06.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.637+0000 7f8607569700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86001514f0 con 0x7f86000c7b40 2023-12-22T10:01:06.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.637+0000 7f8607569700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86001517d0 con 0x7f86000ac390 2023-12-22T10:01:06.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.637+0000 7f8604b04700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86000ac770 0x7f86001507c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:06.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.637+0000 7f8604b04700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86000ac770 0x7f86001507c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46586/0 (socket says 172.21.15.45:46586) 2023-12-22T10:01:06.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.637+0000 7f8604b04700 1 -- 172.21.15.45:0/411892013 learned_addr learned my addr 172.21.15.45:0/411892013 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:06.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.637+0000 7f8605b06700 1 --2- 172.21.15.45:0/411892013 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f86000c7b40 0x7f8600150cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:06.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.637+0000 7f8605305700 1 --2- 172.21.15.45:0/411892013 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f86000ac390 0x7f860014d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:06.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.637+0000 7f8605b06700 1 -- 172.21.15.45:0/411892013 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f86000ac390 msgr2=0x7f860014d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:06.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.637+0000 7f8605b06700 1 --2- 172.21.15.45:0/411892013 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f86000ac390 0x7f860014d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:06.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.637+0000 7f8605b06700 1 -- 172.21.15.45:0/411892013 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86000ac770 msgr2=0x7f86001507c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:06.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.637+0000 7f8605b06700 1 --2- 172.21.15.45:0/411892013 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86000ac770 0x7f86001507c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:06.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.637+0000 7f8605b06700 1 -- 172.21.15.45:0/411892013 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85f0009370 con 0x7f86000c7b40 2023-12-22T10:01:06.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.637+0000 7f8604b04700 1 --2- 172.21.15.45:0/411892013 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86000ac770 0x7f86001507c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-12-22T10:01:06.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.637+0000 7f8605b06700 1 --2- 172.21.15.45:0/411892013 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f86000c7b40 0x7f8600150cb0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f86000acba0 tx=0x7f85f800b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:06.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.637+0000 7f85f57fa700 1 -- 172.21.15.45:0/411892013 <== mon.1 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f800ca70 con 0x7f86000c7b40 2023-12-22T10:01:06.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.637+0000 7f85f57fa700 1 -- 172.21.15.45:0/411892013 <== mon.1 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85f800f040 con 0x7f86000c7b40 2023-12-22T10:01:06.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.637+0000 7f8607569700 1 -- 172.21.15.45:0/411892013 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8600151ab0 con 0x7f86000c7b40 2023-12-22T10:01:06.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.637+0000 7f85f57fa700 1 -- 172.21.15.45:0/411892013 <== mon.1 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f800cde0 con 0x7f86000c7b40 2023-12-22T10:01:06.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.637+0000 7f8607569700 1 -- 172.21.15.45:0/411892013 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86001511a0 con 0x7f86000c7b40 2023-12-22T10:01:06.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.641+0000 7f8607569700 1 -- 172.21.15.45:0/411892013 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f860006c070 con 0x7f86000c7b40 2023-12-22T10:01:06.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.641+0000 7f85f57fa700 1 -- 172.21.15.45:0/411892013 <== mon.1 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f85f8013610 con 0x7f86000c7b40 2023-12-22T10:01:06.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.645+0000 7f85f57fa700 1 --2- 172.21.15.45:0/411892013 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f85e405a560 0x7f85e405ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:06.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.645+0000 7f85f57fa700 1 -- 172.21.15.45:0/411892013 <== mon.1 v2:172.21.15.113:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f85f8074f40 con 0x7f86000c7b40 2023-12-22T10:01:06.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.645+0000 7f8605305700 1 --2- 172.21.15.45:0/411892013 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f85e405a560 0x7f85e405ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:06.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.645+0000 7f8605305700 1 --2- 172.21.15.45:0/411892013 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f85e405a560 0x7f85e405ca20 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f85fc007fd0 tx=0x7f85fc007d30).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:06.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.653+0000 7f85f57fa700 1 -- 172.21.15.45:0/411892013 <== mon.1 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f85f80486e0 con 0x7f86000c7b40 2023-12-22T10:01:06.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.817+0000 7f8607569700 1 -- 172.21.15.45:0/411892013 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f86000ca620 con 0x7f86000c7b40 2023-12-22T10:01:06.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.821+0000 7f85f57fa700 1 -- 172.21.15.45:0/411892013 <== mon.1 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16928 (secure 0 0 0) 0x7f85f804bd00 con 0x7f86000c7b40 2023-12-22T10:01:06.818 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:01:06.818 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":21,"fsid":"98b0837e-5e68-4c8f-a1a0-e9424baaad8f","created":"2023-12-22T10:00:15.010174+0000","modified":"2023-12-22T10:00:34.529651+0000","last_up_change":"2023-12-22T10:00:24.980513+0000","last_in_change":"2023-12-22T10:00:17.887172+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-12-22T10:00:25.069641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-12-22T10:00:26.906399+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-12-22T10:00:31.621311+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-12-22T10:00:32.538053+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e19943a0-1c6b-47df-b6bb-383472077890","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":33777},{"type":"v1","addr":"172.21.15.45:6819","nonce":33777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":33777},{"type":"v1","addr":"172.21.15.45:6822","nonce":33777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":33777},{"type":"v1","addr":"172.21.15.45:6830","nonce":33777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":33777},{"type":"v1","addr":"172.21.15.45:6826","nonce":33777}]},"public_addr":"172.21.15.45:6819/33777","cluster_addr":"172.21.15.45:6822/33777","heartbeat_back_addr":"172.21.15.45:6830/33777","heartbeat_front_addr":"172.21.15.45:6826/33777","state":["exists","up"]},{"osd":1,"uuid":"69670f34-f082-45a7-8f67-e962acc136e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":33775},{"type":"v1","addr":"172.21.15.45:6809","nonce":33775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":33775},{"type":"v1","addr":"172.21.15.45:6811","nonce":33775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":33775},{"type":"v1","addr":"172.21.15.45:6815","nonce":33775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":33775},{"type":"v1","addr":"172.21.15.45:6813","nonce":33775}]},"public_addr":"172.21.15.45:6809/33775","cluster_addr":"172.21.15.45:6811/33775","heartbeat_back_addr":"172.21.15.45:6815/33775","heartbeat_front_addr":"172.21.15.45:6813/33775","state":["exists","up"]},{"osd":2,"uuid":"d909d49b-82b8-401b-9947-e49dd167bb95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":33776},{"type":"v1","addr":"172.21.15.45:6801","nonce":33776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":33776},{"type":"v1","addr":"172.21.15.45:6803","nonce":33776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":33776},{"type":"v1","addr":"172.21.15.45:6807","nonce":33776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":33776},{"type":"v1","addr":"172.21.15.45:6805","nonce":33776}]},"public_addr":"172.21.15.45:6801/33776","cluster_addr":"172.21.15.45:6803/33776","heartbeat_back_addr":"172.21.15.45:6807/33776","heartbeat_front_addr":"172.21.15.45:6805/33776","state":["exists","up"]},{"osd":3,"uuid":"db104ca9-3a94-4d39-a2be-bd06db888095","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":33782},{"type":"v1","addr":"172.21.15.45:6817","nonce":33782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":33782},{"type":"v1","addr":"172.21.15.45:6823","nonce":33782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":33782},{"type":"v1","addr":"172.21.15.45:6831","nonce":33782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":33782},{"type":"v1","addr":"172.21.15.45:6827","nonce":33782}]},"public_addr":"172.21.15.45:6817/33782","cluster_addr":"172.21.15.45:6823/33782","heartbeat_back_addr":"172.21.15.45:6831/33782","heartbeat_front_addr":"172.21.15.45:6827/33782","state":["exists","up"]},{"osd":4,"uuid":"9f4eaff4-e433-4479-a0d1-ee7a33375ca6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":34099},{"type":"v1","addr":"172.21.15.113:6811","nonce":34099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":34099},{"type":"v1","addr":"172.21.15.113:6815","nonce":34099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":34099},{"type":"v1","addr":"172.21.15.113:6823","nonce":34099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6816","nonce":34099},{"type":"v1","addr":"172.21.15.113:6818","nonce":34099}]},"public_addr":"172.21.15.113:6811/34099","cluster_addr":"172.21.15.113:6815/34099","heartbeat_back_addr":"172.21.15.113:6823/34099","heartbeat_front_addr":"172.21.15.113:6818/34099","state":["exists","up"]},{"osd":5,"uuid":"1efc5591-180b-43af-8611-0068aadc5aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":34100},{"type":"v1","addr":"172.21.15.113:6801","nonce":34100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":34100},{"type":"v1","addr":"172.21.15.113:6803","nonce":34100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":34100},{"type":"v1","addr":"172.21.15.113:6807","nonce":34100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":34100},{"type":"v1","addr":"172.21.15.113:6805","nonce":34100}]},"public_addr":"172.21.15.113:6801/34100","cluster_addr":"172.21.15.113:6803/34100","heartbeat_back_addr":"172.21.15.113:6807/34100","heartbeat_front_addr":"172.21.15.113:6805/34100","state":["exists","up"]},{"osd":6,"uuid":"6c89d9d8-c153-4a48-afa9-97e4c403f1ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":34101},{"type":"v1","addr":"172.21.15.113:6810","nonce":34101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6812","nonce":34101},{"type":"v1","addr":"172.21.15.113:6814","nonce":34101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6822","nonce":34101},{"type":"v1","addr":"172.21.15.113:6824","nonce":34101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":34101},{"type":"v1","addr":"172.21.15.113:6819","nonce":34101}]},"public_addr":"172.21.15.113:6810/34101","cluster_addr":"172.21.15.113:6814/34101","heartbeat_back_addr":"172.21.15.113:6824/34101","heartbeat_front_addr":"172.21.15.113:6819/34101","state":["exists","up"]},{"osd":7,"uuid":"1855e70c-23f6-4c08-ad7f-774c2148235b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6821","nonce":34102},{"type":"v1","addr":"172.21.15.113:6825","nonce":34102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":34102},{"type":"v1","addr":"172.21.15.113:6827","nonce":34102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":34102},{"type":"v1","addr":"172.21.15.113:6831","nonce":34102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6828","nonce":34102},{"type":"v1","addr":"172.21.15.113:6829","nonce":34102}]},"public_addr":"172.21.15.113:6825/34102","cluster_addr":"172.21.15.113:6827/34102","heartbeat_back_addr":"172.21.15.113:6831/34102","heartbeat_front_addr":"172.21.15.113:6829/34102","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.812672+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.825045+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.700105+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.856563+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.954683+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.883234+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.883994+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.821686+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T10:01:06.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.825+0000 7f8607569700 1 -- 172.21.15.45:0/411892013 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f85e405a560 msgr2=0x7f85e405ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:06.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.825+0000 7f8607569700 1 --2- 172.21.15.45:0/411892013 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f85e405a560 0x7f85e405ca20 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f85fc007fd0 tx=0x7f85fc007d30).stop 2023-12-22T10:01:06.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.825+0000 7f8607569700 1 -- 172.21.15.45:0/411892013 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f86000c7b40 msgr2=0x7f8600150cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:06.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.825+0000 7f8607569700 1 --2- 172.21.15.45:0/411892013 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f86000c7b40 0x7f8600150cb0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f86000acba0 tx=0x7f85f800b040).stop 2023-12-22T10:01:06.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.825+0000 7f8607569700 1 -- 172.21.15.45:0/411892013 shutdown_connections 2023-12-22T10:01:06.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.825+0000 7f8607569700 1 --2- 172.21.15.45:0/411892013 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f86000c7b40 0x7f8600150cb0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:06.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.825+0000 7f8607569700 1 --2- 172.21.15.45:0/411892013 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86000ac770 0x7f86001507c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:06.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.825+0000 7f8607569700 1 --2- 172.21.15.45:0/411892013 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f85e405a560 0x7f85e405ca20 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:06.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.825+0000 7f8607569700 1 --2- 172.21.15.45:0/411892013 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f86000ac390 0x7f860014d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:06.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.825+0000 7f8607569700 1 -- 172.21.15.45:0/411892013 >> 172.21.15.45:0/411892013 conn(0x7f8600082a30 msgr2=0x7f8600150080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:06.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.825+0000 7f8607569700 1 -- 172.21.15.45:0/411892013 shutdown_connections 2023-12-22T10:01:06.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:06.825+0000 7f8607569700 1 -- 172.21.15.45:0/411892013 wait complete. 2023-12-22T10:01:06.845 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-12-22T10:00:25.069641+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-12-22T10:00:26.906399+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-22T10:00:31.621311+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-12-22T10:00:32.538053+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-22T10:01:06.846 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-12-22T10:01:07.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.021+0000 7fb0fd569700 1 Processor -- start 2023-12-22T10:01:07.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.021+0000 7fb0fd569700 1 -- start start 2023-12-22T10:01:07.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.021+0000 7fb0fd569700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb0f8066c10 0x7fb0f8066ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:07.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.021+0000 7fb0fd569700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0f80c1790 con 0x7fb0f80aca60 2023-12-22T10:01:07.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.021+0000 7fb0fd569700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0f80c0ec0 con 0x7fb0f80c1350 2023-12-22T10:01:07.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.021+0000 7fb0fd569700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f8153f50 con 0x7fb0f8066c10 2023-12-22T10:01:07.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.021+0000 7fb0f77fe700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fb0f80aca60 0x7fb0f80acee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:40852/0 (socket says 172.21.15.45:40852) 2023-12-22T10:01:07.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.021+0000 7fb0f77fe700 1 -- 172.21.15.45:0/510086659 learned_addr learned my addr 172.21.15.45:0/510086659 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:01:07.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.021+0000 7fb0f6ffd700 1 --2- 172.21.15.45:0/510086659 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb0f8066c10 0x7fb0f8066ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:07.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.021+0000 7fb0f5ffb700 1 -- 172.21.15.45:0/510086659 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3473329837 0 0) 0x7fb0f80c1790 con 0x7fb0f80aca60 2023-12-22T10:01:07.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.021+0000 7fb0f5ffb700 1 -- 172.21.15.45:0/510086659 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0e00033f0 con 0x7fb0f80aca60 2023-12-22T10:01:07.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.021+0000 7fb0f6ffd700 1 -- 172.21.15.45:0/510086659 >> v1:172.21.15.113:6789/0 conn(0x7fb0f80c1350 legacy=0x7fb0f80c5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:07.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.021+0000 7fb0f5ffb700 1 -- 172.21.15.45:0/510086659 <== mon.1 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2768507011 0 0) 0x7fb0f80c0ec0 con 0x7fb0f80c1350 2023-12-22T10:01:07.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.021+0000 7fb0f6ffd700 1 -- 172.21.15.45:0/510086659 >> v1:172.21.15.45:6789/0 conn(0x7fb0f80aca60 legacy=0x7fb0f80acee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:07.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.021+0000 7fb0f6ffd700 1 -- 172.21.15.45:0/510086659 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0f80c02b0 con 0x7fb0f8066c10 2023-12-22T10:01:07.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.025+0000 7fb0f6ffd700 1 --2- 172.21.15.45:0/510086659 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb0f8066c10 0x7fb0f8066ff0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fb0e8009790 tx=0x7fb0e8009060).ready entity=mon.2 client_cookie=6f3a4313f72c5a1e server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:07.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.025+0000 7fb0f5ffb700 1 -- 172.21.15.45:0/510086659 <== mon.2 v2:172.21.15.113:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e800b590 con 0x7fb0f8066c10 2023-12-22T10:01:07.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.025+0000 7fb0f5ffb700 1 -- 172.21.15.45:0/510086659 <== mon.2 v2:172.21.15.113:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0e800b6f0 con 0x7fb0f8066c10 2023-12-22T10:01:07.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.025+0000 7fb0f5ffb700 1 -- 172.21.15.45:0/510086659 <== mon.2 v2:172.21.15.113:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e800ba70 con 0x7fb0f8066c10 2023-12-22T10:01:07.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.025+0000 7fb0fd569700 1 -- 172.21.15.45:0/510086659 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb0f8066c10 msgr2=0x7fb0f8066ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:07.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.025+0000 7fb0fd569700 1 --2- 172.21.15.45:0/510086659 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb0f8066c10 0x7fb0f8066ff0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fb0e8009790 tx=0x7fb0e8009060).stop 2023-12-22T10:01:07.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.025+0000 7fb0fd569700 1 -- 172.21.15.45:0/510086659 shutdown_connections 2023-12-22T10:01:07.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.025+0000 7fb0fd569700 1 --2- 172.21.15.45:0/510086659 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb0f8066c10 0x7fb0f8066ff0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:07.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.025+0000 7fb0fd569700 1 -- 172.21.15.45:0/510086659 >> 172.21.15.45:0/510086659 conn(0x7fb0f80cb330 msgr2=0x7fb0f80c7340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:07.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.025+0000 7fb0fd569700 1 -- 172.21.15.45:0/510086659 shutdown_connections 2023-12-22T10:01:07.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.025+0000 7fb0fd569700 1 -- 172.21.15.45:0/510086659 wait complete. 2023-12-22T10:01:07.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.029+0000 7fb0fd569700 1 Processor -- start 2023-12-22T10:01:07.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.029+0000 7fb0fd569700 1 -- start start 2023-12-22T10:01:07.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.029+0000 7fb0fd569700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb0f8066c10 0x7fb0f8149290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:07.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.029+0000 7fb0fd569700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb0f80aca60 0x7fb0f8154f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:07.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.029+0000 7fb0fd569700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb0f80c1350 0x7fb0f80aec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:07.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.029+0000 7fb0fd569700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f81544d0 con 0x7fb0f8066c10 2023-12-22T10:01:07.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.029+0000 7fb0fd569700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f8154a70 con 0x7fb0f80c1350 2023-12-22T10:01:07.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.029+0000 7fb0fd569700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f80ae580 con 0x7fb0f80aca60 2023-12-22T10:01:07.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.029+0000 7fb0f6ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb0f8066c10 0x7fb0f8149290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:07.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.029+0000 7fb0f6ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb0f8066c10 0x7fb0f8149290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46594/0 (socket says 172.21.15.45:46594) 2023-12-22T10:01:07.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.029+0000 7fb0f6ffd700 1 -- 172.21.15.45:0/1739187740 learned_addr learned my addr 172.21.15.45:0/1739187740 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:07.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.029+0000 7fb0f77fe700 1 --2- 172.21.15.45:0/1739187740 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb0f80c1350 0x7fb0f80aec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:07.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.029+0000 7fb0f67fc700 1 --2- 172.21.15.45:0/1739187740 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb0f80aca60 0x7fb0f8154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:07.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.029+0000 7fb0f6ffd700 1 -- 172.21.15.45:0/1739187740 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb0f80aca60 msgr2=0x7fb0f8154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:07.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.029+0000 7fb0f6ffd700 1 --2- 172.21.15.45:0/1739187740 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb0f80aca60 0x7fb0f8154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:07.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.029+0000 7fb0f6ffd700 1 -- 172.21.15.45:0/1739187740 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb0f80c1350 msgr2=0x7fb0f80aec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:07.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.029+0000 7fb0f6ffd700 1 --2- 172.21.15.45:0/1739187740 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb0f80c1350 0x7fb0f80aec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:07.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.029+0000 7fb0f6ffd700 1 -- 172.21.15.45:0/1739187740 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0e80092a0 con 0x7fb0f8066c10 2023-12-22T10:01:07.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.029+0000 7fb0f6ffd700 1 --2- 172.21.15.45:0/1739187740 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb0f8066c10 0x7fb0f8149290 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7fb0e8009e30 tx=0x7fb0e8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:07.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.029+0000 7fb0deffd700 1 -- 172.21.15.45:0/1739187740 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e801a500 con 0x7fb0f8066c10 2023-12-22T10:01:07.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.033+0000 7fb0fd569700 1 -- 172.21.15.45:0/1739187740 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0f80ae860 con 0x7fb0f8066c10 2023-12-22T10:01:07.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.033+0000 7fb0deffd700 1 -- 172.21.15.45:0/1739187740 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0e801e070 con 0x7fb0f8066c10 2023-12-22T10:01:07.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.033+0000 7fb0deffd700 1 -- 172.21.15.45:0/1739187740 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e801a8d0 con 0x7fb0f8066c10 2023-12-22T10:01:07.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.033+0000 7fb0fd569700 1 -- 172.21.15.45:0/1739187740 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0f8149780 con 0x7fb0f8066c10 2023-12-22T10:01:07.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.033+0000 7fb0fd569700 1 -- 172.21.15.45:0/1739187740 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0f8149910 con 0x7fb0f8066c10 2023-12-22T10:01:07.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.033+0000 7fb0deffd700 1 -- 172.21.15.45:0/1739187740 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fb0e8020030 con 0x7fb0f8066c10 2023-12-22T10:01:07.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.037+0000 7fb0deffd700 1 --2- 172.21.15.45:0/1739187740 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fb0e405a4e0 0x7fb0e405c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:07.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.037+0000 7fb0deffd700 1 -- 172.21.15.45:0/1739187740 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb0e8075870 con 0x7fb0f8066c10 2023-12-22T10:01:07.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.037+0000 7fb0f67fc700 1 --2- 172.21.15.45:0/1739187740 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fb0e405a4e0 0x7fb0e405c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:07.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.037+0000 7fb0f67fc700 1 --2- 172.21.15.45:0/1739187740 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fb0e405a4e0 0x7fb0e405c9a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fb0f81506f0 tx=0x7fb0ec007d40).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:07.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.041+0000 7fb0deffd700 1 -- 172.21.15.45:0/1739187740 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb0e8048f30 con 0x7fb0f8066c10 2023-12-22T10:01:07.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.205+0000 7fb0fd569700 1 -- 172.21.15.45:0/1739187740 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fb0f8047060 con 0x7fb0f8066c10 2023-12-22T10:01:07.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.205+0000 7fb0deffd700 1 -- 172.21.15.45:0/1739187740 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v21) v1 ==== 110+0+10 (secure 0 0 0) 0x7fb0e804c550 con 0x7fb0f8066c10 2023-12-22T10:01:07.203 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-12-22T10:01:07.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.209+0000 7fb0fd569700 1 -- 172.21.15.45:0/1739187740 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fb0e405a4e0 msgr2=0x7fb0e405c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:07.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.209+0000 7fb0fd569700 1 --2- 172.21.15.45:0/1739187740 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fb0e405a4e0 0x7fb0e405c9a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fb0f81506f0 tx=0x7fb0ec007d40).stop 2023-12-22T10:01:07.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.209+0000 7fb0fd569700 1 -- 172.21.15.45:0/1739187740 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb0f8066c10 msgr2=0x7fb0f8149290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:07.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.209+0000 7fb0fd569700 1 --2- 172.21.15.45:0/1739187740 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb0f8066c10 0x7fb0f8149290 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7fb0e8009e30 tx=0x7fb0e8017000).stop 2023-12-22T10:01:07.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.209+0000 7fb0fd569700 1 -- 172.21.15.45:0/1739187740 shutdown_connections 2023-12-22T10:01:07.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.209+0000 7fb0fd569700 1 --2- 172.21.15.45:0/1739187740 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb0f80c1350 0x7fb0f80aec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:07.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.209+0000 7fb0fd569700 1 --2- 172.21.15.45:0/1739187740 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fb0e405a4e0 0x7fb0e405c9a0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:07.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.209+0000 7fb0fd569700 1 --2- 172.21.15.45:0/1739187740 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb0f80aca60 0x7fb0f8154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:07.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.209+0000 7fb0fd569700 1 --2- 172.21.15.45:0/1739187740 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb0f8066c10 0x7fb0f8149290 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:07.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.209+0000 7fb0fd569700 1 -- 172.21.15.45:0/1739187740 >> 172.21.15.45:0/1739187740 conn(0x7fb0f80cb330 msgr2=0x7fb0f80c9d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:07.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.209+0000 7fb0fd569700 1 -- 172.21.15.45:0/1739187740 shutdown_connections 2023-12-22T10:01:07.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.209+0000 7fb0fd569700 1 -- 172.21.15.45:0/1739187740 wait complete. 2023-12-22T10:01:07.228 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-12-22T10:01:07.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.393+0000 7fb4eed79700 1 Processor -- start 2023-12-22T10:01:07.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.397+0000 7fb4eed79700 1 -- start start 2023-12-22T10:01:07.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.401+0000 7fb4eed79700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb4e80691c0 0x7fb4e80ad080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:07.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.401+0000 7fb4eed79700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb4e80c9d20 0x7fb4e80c97e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:07.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.401+0000 7fb4eed79700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4e80c5810 con 0x7fb4e80acca0 2023-12-22T10:01:07.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.401+0000 7fb4eed79700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4e80c8d90 con 0x7fb4e80c9d20 2023-12-22T10:01:07.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.401+0000 7fb4eed79700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4e80c9350 con 0x7fb4e80691c0 2023-12-22T10:01:07.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.401+0000 7fb4edd77700 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fb4e80acca0 0x7fb4e8068ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.45:37216/0 (socket says 172.21.15.45:37216) 2023-12-22T10:01:07.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.401+0000 7fb4edd77700 1 -- 172.21.15.45:0/2287809661 learned_addr learned my addr 172.21.15.45:0/2287809661 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:01:07.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.401+0000 7fb4ed576700 1 --2- 172.21.15.45:0/2287809661 >> v2:172.21.15.113:3300/0 conn(0x7fb4e80691c0 0x7fb4e80ad080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:07.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.401+0000 7fb4ee578700 1 --2- 172.21.15.45:0/2287809661 >> v2:172.21.15.45:3300/0 conn(0x7fb4e80c9d20 0x7fb4e80c97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:07.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.401+0000 7fb4ee578700 1 -- 172.21.15.45:0/2287809661 >> v2:172.21.15.113:3300/0 conn(0x7fb4e80691c0 msgr2=0x7fb4e80ad080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:07.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.401+0000 7fb4ee578700 1 --2- 172.21.15.45:0/2287809661 >> v2:172.21.15.113:3300/0 conn(0x7fb4e80691c0 0x7fb4e80ad080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:07.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.401+0000 7fb4ee578700 1 -- 172.21.15.45:0/2287809661 >> v1:172.21.15.113:6789/0 conn(0x7fb4e80acca0 legacy=0x7fb4e8068ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:07.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.401+0000 7fb4ee578700 1 -- 172.21.15.45:0/2287809661 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4e8154070 con 0x7fb4e80c9d20 2023-12-22T10:01:07.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.401+0000 7fb4ee578700 1 --2- 172.21.15.45:0/2287809661 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb4e80c9d20 0x7fb4e80c97e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7fb4e8084100 tx=0x7fb4e0009780).ready entity=mon.0 client_cookie=8c816753d54a35f3 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:07.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.401+0000 7fb4ecd75700 1 -- 172.21.15.45:0/2287809661 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e000e070 con 0x7fb4e80c9d20 2023-12-22T10:01:07.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.401+0000 7fb4ecd75700 1 -- 172.21.15.45:0/2287809661 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4e000bb60 con 0x7fb4e80c9d20 2023-12-22T10:01:07.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.401+0000 7fb4ecd75700 1 -- 172.21.15.45:0/2287809661 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e0012410 con 0x7fb4e80c9d20 2023-12-22T10:01:07.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.401+0000 7fb4eed79700 1 -- 172.21.15.45:0/2287809661 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb4e80c9d20 msgr2=0x7fb4e80c97e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:07.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.401+0000 7fb4eed79700 1 --2- 172.21.15.45:0/2287809661 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb4e80c9d20 0x7fb4e80c97e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7fb4e8084100 tx=0x7fb4e0009780).stop 2023-12-22T10:01:07.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.401+0000 7fb4eed79700 1 -- 172.21.15.45:0/2287809661 shutdown_connections 2023-12-22T10:01:07.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.401+0000 7fb4eed79700 1 --2- 172.21.15.45:0/2287809661 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb4e80c9d20 0x7fb4e80c97e0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:07.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.401+0000 7fb4eed79700 1 --2- 172.21.15.45:0/2287809661 >> v2:172.21.15.113:3300/0 conn(0x7fb4e80691c0 0x7fb4e80ad080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:07.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.401+0000 7fb4eed79700 1 -- 172.21.15.45:0/2287809661 >> 172.21.15.45:0/2287809661 conn(0x7fb4e80674f0 msgr2=0x7fb4e80ca820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:07.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.405+0000 7fb4eed79700 1 -- 172.21.15.45:0/2287809661 shutdown_connections 2023-12-22T10:01:07.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.405+0000 7fb4eed79700 1 -- 172.21.15.45:0/2287809661 wait complete. 2023-12-22T10:01:07.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.405+0000 7fb4eed79700 1 Processor -- start 2023-12-22T10:01:07.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.405+0000 7fb4eed79700 1 -- start start 2023-12-22T10:01:07.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.405+0000 7fb4eed79700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb4e80691c0 0x7fb4e8156c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:07.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.405+0000 7fb4eed79700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb4e80acca0 0x7fb4e8154260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:07.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.405+0000 7fb4eed79700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb4e80c9d20 0x7fb4e8154750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:07.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.405+0000 7fb4eed79700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e81570f0 con 0x7fb4e80691c0 2023-12-22T10:01:07.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.405+0000 7fb4eed79700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e80c23f0 con 0x7fb4e80c9d20 2023-12-22T10:01:07.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.405+0000 7fb4eed79700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e80c2690 con 0x7fb4e80acca0 2023-12-22T10:01:07.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.405+0000 7fb4edd77700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb4e80691c0 0x7fb4e8156c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:07.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.405+0000 7fb4ed576700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb4e80acca0 0x7fb4e8154260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:07.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.405+0000 7fb4edd77700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb4e80691c0 0x7fb4e8156c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46620/0 (socket says 172.21.15.45:46620) 2023-12-22T10:01:07.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.405+0000 7fb4edd77700 1 -- 172.21.15.45:0/1999585571 learned_addr learned my addr 172.21.15.45:0/1999585571 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:07.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.405+0000 7fb4ee578700 1 --2- 172.21.15.45:0/1999585571 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb4e80c9d20 0x7fb4e8154750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:07.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.409+0000 7fb4edd77700 1 -- 172.21.15.45:0/1999585571 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb4e80acca0 msgr2=0x7fb4e8154260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:07.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.409+0000 7fb4edd77700 1 --2- 172.21.15.45:0/1999585571 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb4e80acca0 0x7fb4e8154260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:07.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.409+0000 7fb4edd77700 1 -- 172.21.15.45:0/1999585571 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb4e80c9d20 msgr2=0x7fb4e8154750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:07.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.409+0000 7fb4edd77700 1 --2- 172.21.15.45:0/1999585571 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb4e80c9d20 0x7fb4e8154750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:07.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.409+0000 7fb4edd77700 1 -- 172.21.15.45:0/1999585571 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4e0009a20 con 0x7fb4e80691c0 2023-12-22T10:01:07.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.409+0000 7fb4edd77700 1 --2- 172.21.15.45:0/1999585571 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb4e80691c0 0x7fb4e8156c00 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7fb4e4007fd0 tx=0x7fb4e4007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:07.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.409+0000 7fb4ddffb700 1 -- 172.21.15.45:0/1999585571 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e400ce10 con 0x7fb4e80691c0 2023-12-22T10:01:07.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.409+0000 7fb4ddffb700 1 -- 172.21.15.45:0/1999585571 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4e40072e0 con 0x7fb4e80691c0 2023-12-22T10:01:07.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.409+0000 7fb4ddffb700 1 -- 172.21.15.45:0/1999585571 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e4007660 con 0x7fb4e80691c0 2023-12-22T10:01:07.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.409+0000 7fb4eed79700 1 -- 172.21.15.45:0/1999585571 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4e80c2970 con 0x7fb4e80691c0 2023-12-22T10:01:07.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.409+0000 7fb4eed79700 1 -- 172.21.15.45:0/1999585571 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4e80b0820 con 0x7fb4e80691c0 2023-12-22T10:01:07.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.409+0000 7fb4eed79700 1 -- 172.21.15.45:0/1999585571 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4e8047060 con 0x7fb4e80691c0 2023-12-22T10:01:07.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.413+0000 7fb4ddffb700 1 -- 172.21.15.45:0/1999585571 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fb4e40059b0 con 0x7fb4e80691c0 2023-12-22T10:01:07.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.413+0000 7fb4ddffb700 1 --2- 172.21.15.45:0/1999585571 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fb4cc05a510 0x7fb4cc05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:07.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.413+0000 7fb4ddffb700 1 -- 172.21.15.45:0/1999585571 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb4e4073e90 con 0x7fb4e80691c0 2023-12-22T10:01:07.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.413+0000 7fb4ed576700 1 --2- 172.21.15.45:0/1999585571 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fb4cc05a510 0x7fb4cc05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:07.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.413+0000 7fb4ed576700 1 --2- 172.21.15.45:0/1999585571 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fb4cc05a510 0x7fb4cc05c9d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7fb4e8167300 tx=0x7fb4d8009060).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:07.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.421+0000 7fb4ddffb700 1 -- 172.21.15.45:0/1999585571 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb4e40475b0 con 0x7fb4e80691c0 2023-12-22T10:01:07.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.581+0000 7fb4eed79700 1 -- 172.21.15.45:0/1999585571 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb4e80c5a60 con 0x7fb4e80691c0 2023-12-22T10:01:07.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.585+0000 7fb4ddffb700 1 -- 172.21.15.45:0/1999585571 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb4e4075030 con 0x7fb4e80691c0 2023-12-22T10:01:07.581 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-12-22T10:01:07.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.585+0000 7fb4eed79700 1 -- 172.21.15.45:0/1999585571 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fb4cc05a510 msgr2=0x7fb4cc05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:07.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.585+0000 7fb4eed79700 1 --2- 172.21.15.45:0/1999585571 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fb4cc05a510 0x7fb4cc05c9d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7fb4e8167300 tx=0x7fb4d8009060).stop 2023-12-22T10:01:07.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.585+0000 7fb4eed79700 1 -- 172.21.15.45:0/1999585571 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb4e80691c0 msgr2=0x7fb4e8156c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:07.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.585+0000 7fb4eed79700 1 --2- 172.21.15.45:0/1999585571 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb4e80691c0 0x7fb4e8156c00 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7fb4e4007fd0 tx=0x7fb4e4007df0).stop 2023-12-22T10:01:07.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.585+0000 7fb4eed79700 1 -- 172.21.15.45:0/1999585571 shutdown_connections 2023-12-22T10:01:07.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.585+0000 7fb4eed79700 1 --2- 172.21.15.45:0/1999585571 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb4e80c9d20 0x7fb4e8154750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:07.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.585+0000 7fb4eed79700 1 --2- 172.21.15.45:0/1999585571 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fb4cc05a510 0x7fb4cc05c9d0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:07.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.585+0000 7fb4eed79700 1 --2- 172.21.15.45:0/1999585571 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb4e80acca0 0x7fb4e8154260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:07.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.585+0000 7fb4eed79700 1 --2- 172.21.15.45:0/1999585571 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb4e80691c0 0x7fb4e8156c00 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:07.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.585+0000 7fb4eed79700 1 -- 172.21.15.45:0/1999585571 >> 172.21.15.45:0/1999585571 conn(0x7fb4e80674f0 msgr2=0x7fb4e8153460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:07.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.585+0000 7fb4eed79700 1 -- 172.21.15.45:0/1999585571 shutdown_connections 2023-12-22T10:01:07.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.585+0000 7fb4eed79700 1 -- 172.21.15.45:0/1999585571 wait complete. 2023-12-22T10:01:07.607 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-22T10:01:07.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.785+0000 7fc055c79700 1 Processor -- start 2023-12-22T10:01:07.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.785+0000 7fc055c79700 1 -- start start 2023-12-22T10:01:07.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.785+0000 7fc055c79700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fc050065890 0x7fc0500c4c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:07.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.785+0000 7fc055c79700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc0500c5110 0x7fc0500c1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:07.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.785+0000 7fc055c79700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0500c55a0 con 0x7fc0500a8ba0 2023-12-22T10:01:07.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.785+0000 7fc055c79700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0500c11e0 con 0x7fc0500c5110 2023-12-22T10:01:07.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.785+0000 7fc055c79700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0501594c0 con 0x7fc050065890 2023-12-22T10:01:07.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.789+0000 7fc055478700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc0500c5110 0x7fc0500c1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:07.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.789+0000 7fc04ffff700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fc050065890 0x7fc0500c4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:07.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.789+0000 7fc04ffff700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fc050065890 0x7fc0500c4c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.45:39152/0 (socket says 172.21.15.45:39152) 2023-12-22T10:01:07.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.789+0000 7fc04ffff700 1 -- 172.21.15.45:0/332517029 learned_addr learned my addr 172.21.15.45:0/332517029 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:07.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.789+0000 7fc04ffff700 1 -- 172.21.15.45:0/332517029 >> v2:172.21.15.45:3300/0 conn(0x7fc0500c5110 msgr2=0x7fc0500c1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:07.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.789+0000 7fc04ffff700 1 --2- 172.21.15.45:0/332517029 >> v2:172.21.15.45:3300/0 conn(0x7fc0500c5110 0x7fc0500c1bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:07.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.789+0000 7fc04ffff700 1 -- 172.21.15.45:0/332517029 >> v1:172.21.15.113:6789/0 conn(0x7fc0500a8ba0 legacy=0x7fc0501584a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:07.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.789+0000 7fc04ffff700 1 -- 172.21.15.45:0/332517029 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc050068aa0 con 0x7fc050065890 2023-12-22T10:01:07.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.789+0000 7fc04ffff700 1 --2- 172.21.15.45:0/332517029 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc050065890 0x7fc0500c4c20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7fc050065d10 tx=0x7fc03c0090f0).ready entity=mon.1 client_cookie=eca76a4593ca0d79 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:07.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.789+0000 7fc04f7fe700 1 -- 172.21.15.45:0/332517029 <== mon.1 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03c00b520 con 0x7fc050065890 2023-12-22T10:01:07.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.789+0000 7fc04f7fe700 1 -- 172.21.15.45:0/332517029 <== mon.1 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc03c00b680 con 0x7fc050065890 2023-12-22T10:01:07.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.789+0000 7fc04f7fe700 1 -- 172.21.15.45:0/332517029 <== mon.1 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03c00ba00 con 0x7fc050065890 2023-12-22T10:01:07.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.789+0000 7fc055c79700 1 -- 172.21.15.45:0/332517029 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc050065890 msgr2=0x7fc0500c4c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:07.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.789+0000 7fc055c79700 1 --2- 172.21.15.45:0/332517029 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc050065890 0x7fc0500c4c20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7fc050065d10 tx=0x7fc03c0090f0).stop 2023-12-22T10:01:07.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.789+0000 7fc055c79700 1 -- 172.21.15.45:0/332517029 shutdown_connections 2023-12-22T10:01:07.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.789+0000 7fc055c79700 1 --2- 172.21.15.45:0/332517029 >> v2:172.21.15.45:3300/0 conn(0x7fc0500c5110 0x7fc0500c1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:07.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.789+0000 7fc055c79700 1 --2- 172.21.15.45:0/332517029 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc050065890 0x7fc0500c4c20 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:07.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.789+0000 7fc055c79700 1 -- 172.21.15.45:0/332517029 >> 172.21.15.45:0/332517029 conn(0x7fc050067500 msgr2=0x7fc0500c6440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:07.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.789+0000 7fc055c79700 1 -- 172.21.15.45:0/332517029 shutdown_connections 2023-12-22T10:01:07.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.789+0000 7fc055c79700 1 -- 172.21.15.45:0/332517029 wait complete. 2023-12-22T10:01:07.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.793+0000 7fc055c79700 1 Processor -- start 2023-12-22T10:01:07.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.793+0000 7fc055c79700 1 -- start start 2023-12-22T10:01:07.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.797+0000 7fc055c79700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc050065890 0x7fc0501566b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:07.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.797+0000 7fc055c79700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc0500a8ba0 0x7fc0500bf590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:07.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.797+0000 7fc055c79700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc0500c5110 0x7fc0500bfa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:07.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.797+0000 7fc055c79700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc05015af30 con 0x7fc050065890 2023-12-22T10:01:07.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.797+0000 7fc055c79700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc05015a080 con 0x7fc0500c5110 2023-12-22T10:01:07.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.797+0000 7fc055c79700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc05015a320 con 0x7fc0500a8ba0 2023-12-22T10:01:07.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.797+0000 7fc054c77700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc050065890 0x7fc0501566b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:07.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.797+0000 7fc054c77700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc050065890 0x7fc0501566b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50198/0 (socket says 172.21.15.45:50198) 2023-12-22T10:01:07.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.797+0000 7fc054c77700 1 -- 172.21.15.45:0/642630780 learned_addr learned my addr 172.21.15.45:0/642630780 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:07.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.797+0000 7fc04ffff700 1 --2- 172.21.15.45:0/642630780 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc0500a8ba0 0x7fc0500bf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:07.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.797+0000 7fc055478700 1 --2- 172.21.15.45:0/642630780 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc0500c5110 0x7fc0500bfa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:07.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.797+0000 7fc054c77700 1 -- 172.21.15.45:0/642630780 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc0500a8ba0 msgr2=0x7fc0500bf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:07.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.797+0000 7fc054c77700 1 --2- 172.21.15.45:0/642630780 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc0500a8ba0 0x7fc0500bf590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:07.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.797+0000 7fc054c77700 1 -- 172.21.15.45:0/642630780 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc0500c5110 msgr2=0x7fc0500bfa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:07.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.797+0000 7fc054c77700 1 --2- 172.21.15.45:0/642630780 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc0500c5110 0x7fc0500bfa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:07.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.797+0000 7fc054c77700 1 -- 172.21.15.45:0/642630780 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc03c009370 con 0x7fc050065890 2023-12-22T10:01:07.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.797+0000 7fc054c77700 1 --2- 172.21.15.45:0/642630780 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc050065890 0x7fc0501566b0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7fc04400c440 tx=0x7fc044007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:07.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.797+0000 7fc04cff9700 1 -- 172.21.15.45:0/642630780 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc044012400 con 0x7fc050065890 2023-12-22T10:01:07.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.797+0000 7fc04cff9700 1 -- 172.21.15.45:0/642630780 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc044012560 con 0x7fc050065890 2023-12-22T10:01:07.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.797+0000 7fc055c79700 1 -- 172.21.15.45:0/642630780 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc05015a600 con 0x7fc050065890 2023-12-22T10:01:07.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.801+0000 7fc04cff9700 1 -- 172.21.15.45:0/642630780 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc044012900 con 0x7fc050065890 2023-12-22T10:01:07.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.801+0000 7fc055c79700 1 -- 172.21.15.45:0/642630780 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc05015abc0 con 0x7fc050065890 2023-12-22T10:01:07.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.801+0000 7fc055c79700 1 -- 172.21.15.45:0/642630780 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc050047060 con 0x7fc050065890 2023-12-22T10:01:07.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.801+0000 7fc04cff9700 1 -- 172.21.15.45:0/642630780 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fc04401b3b0 con 0x7fc050065890 2023-12-22T10:01:07.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.805+0000 7fc04cff9700 1 --2- 172.21.15.45:0/642630780 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fc03405a510 0x7fc03405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:07.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.805+0000 7fc04cff9700 1 -- 172.21.15.45:0/642630780 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fc044073b60 con 0x7fc050065890 2023-12-22T10:01:07.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.805+0000 7fc04ffff700 1 --2- 172.21.15.45:0/642630780 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fc03405a510 0x7fc03405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:07.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.805+0000 7fc04ffff700 1 --2- 172.21.15.45:0/642630780 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fc03405a510 0x7fc03405c9d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7fc03c009130 tx=0x7fc03c017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:07.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.813+0000 7fc04cff9700 1 -- 172.21.15.45:0/642630780 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc0440472d0 con 0x7fc050065890 2023-12-22T10:01:07.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.981+0000 7fc055c79700 1 -- 172.21.15.45:0/642630780 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc050158f00 con 0x7fc050065890 2023-12-22T10:01:07.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.981+0000 7fc04cff9700 1 -- 172.21.15.45:0/642630780 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc044017070 con 0x7fc050065890 2023-12-22T10:01:07.978 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-22T10:01:07.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.981+0000 7fc055c79700 1 -- 172.21.15.45:0/642630780 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fc03405a510 msgr2=0x7fc03405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:07.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.981+0000 7fc055c79700 1 --2- 172.21.15.45:0/642630780 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fc03405a510 0x7fc03405c9d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7fc03c009130 tx=0x7fc03c017000).stop 2023-12-22T10:01:07.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.981+0000 7fc055c79700 1 -- 172.21.15.45:0/642630780 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc050065890 msgr2=0x7fc0501566b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:07.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.981+0000 7fc055c79700 1 --2- 172.21.15.45:0/642630780 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc050065890 0x7fc0501566b0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7fc04400c440 tx=0x7fc044007dc0).stop 2023-12-22T10:01:07.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.985+0000 7fc055c79700 1 -- 172.21.15.45:0/642630780 shutdown_connections 2023-12-22T10:01:07.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.985+0000 7fc055c79700 1 --2- 172.21.15.45:0/642630780 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc0500c5110 0x7fc0500bfa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:07.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.985+0000 7fc055c79700 1 --2- 172.21.15.45:0/642630780 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fc03405a510 0x7fc03405c9d0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:07.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.985+0000 7fc055c79700 1 --2- 172.21.15.45:0/642630780 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc0500a8ba0 0x7fc0500bf590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:07.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.985+0000 7fc055c79700 1 --2- 172.21.15.45:0/642630780 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc050065890 0x7fc0501566b0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:07.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.985+0000 7fc055c79700 1 -- 172.21.15.45:0/642630780 >> 172.21.15.45:0/642630780 conn(0x7fc050067500 msgr2=0x7fc0500c48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:07.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.985+0000 7fc055c79700 1 -- 172.21.15.45:0/642630780 shutdown_connections 2023-12-22T10:01:07.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:07.985+0000 7fc055c79700 1 -- 172.21.15.45:0/642630780 wait complete. 2023-12-22T10:01:08.004 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-22T10:01:08.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.181+0000 7f0184eb9700 1 Processor -- start 2023-12-22T10:01:08.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.181+0000 7f0184eb9700 1 -- start start 2023-12-22T10:01:08.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.185+0000 7f0184eb9700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f01800a9b00 0x7f01801527e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:08.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.185+0000 7f0184eb9700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f01800a9ee0 0x7f0180152f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:08.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.185+0000 7f0184eb9700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0180152cd0 con 0x7f0180065890 2023-12-22T10:01:08.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.185+0000 7f0184eb9700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0180153420 con 0x7f01800a9b00 2023-12-22T10:01:08.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.185+0000 7f0184eb9700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01800bc990 con 0x7f01800a9ee0 2023-12-22T10:01:08.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.185+0000 7f017f7fe700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f01800a9b00 0x7f01801527e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:08.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.185+0000 7f017f7fe700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f01800a9b00 0x7f01801527e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50200/0 (socket says 172.21.15.45:50200) 2023-12-22T10:01:08.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.185+0000 7f017f7fe700 1 -- 172.21.15.45:0/1100160594 learned_addr learned my addr 172.21.15.45:0/1100160594 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:08.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.185+0000 7f017effd700 1 --2- 172.21.15.45:0/1100160594 >> v2:172.21.15.113:3300/0 conn(0x7f01800a9ee0 0x7f0180152f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:08.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.185+0000 7f017f7fe700 1 -- 172.21.15.45:0/1100160594 >> v2:172.21.15.113:3300/0 conn(0x7f01800a9ee0 msgr2=0x7f0180152f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:08.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.185+0000 7f017f7fe700 1 --2- 172.21.15.45:0/1100160594 >> v2:172.21.15.113:3300/0 conn(0x7f01800a9ee0 0x7f0180152f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:08.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.185+0000 7f017f7fe700 1 -- 172.21.15.45:0/1100160594 >> v1:172.21.15.113:6789/0 conn(0x7f0180065890 legacy=0x7f01800c4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:08.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.185+0000 7f017f7fe700 1 -- 172.21.15.45:0/1100160594 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01800c7980 con 0x7f01800a9b00 2023-12-22T10:01:08.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.185+0000 7f017f7fe700 1 --2- 172.21.15.45:0/1100160594 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01800a9b00 0x7f01801527e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f0170006fd0 tx=0x7f01700090f0).ready entity=mon.0 client_cookie=5c06e94e23640130 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:08.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.185+0000 7f017e7fc700 1 -- 172.21.15.45:0/1100160594 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f017000b520 con 0x7f01800a9b00 2023-12-22T10:01:08.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.185+0000 7f017e7fc700 1 -- 172.21.15.45:0/1100160594 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f017000b680 con 0x7f01800a9b00 2023-12-22T10:01:08.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.185+0000 7f017e7fc700 1 -- 172.21.15.45:0/1100160594 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f017000ba00 con 0x7f01800a9b00 2023-12-22T10:01:08.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.189+0000 7f0184eb9700 1 -- 172.21.15.45:0/1100160594 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01800a9b00 msgr2=0x7f01801527e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:08.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.189+0000 7f0184eb9700 1 --2- 172.21.15.45:0/1100160594 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01800a9b00 0x7f01801527e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f0170006fd0 tx=0x7f01700090f0).stop 2023-12-22T10:01:08.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.189+0000 7f0184eb9700 1 -- 172.21.15.45:0/1100160594 shutdown_connections 2023-12-22T10:01:08.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.189+0000 7f0184eb9700 1 --2- 172.21.15.45:0/1100160594 >> v2:172.21.15.113:3300/0 conn(0x7f01800a9ee0 0x7f0180152f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:08.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.189+0000 7f0184eb9700 1 --2- 172.21.15.45:0/1100160594 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01800a9b00 0x7f01801527e0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:08.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.189+0000 7f0184eb9700 1 -- 172.21.15.45:0/1100160594 >> 172.21.15.45:0/1100160594 conn(0x7f0180062230 msgr2=0x7f0180062610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:08.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.189+0000 7f0184eb9700 1 -- 172.21.15.45:0/1100160594 shutdown_connections 2023-12-22T10:01:08.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.189+0000 7f0184eb9700 1 -- 172.21.15.45:0/1100160594 wait complete. 2023-12-22T10:01:08.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.189+0000 7f0184eb9700 1 Processor -- start 2023-12-22T10:01:08.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.189+0000 7f0184eb9700 1 -- start start 2023-12-22T10:01:08.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.193+0000 7f0184eb9700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f0180065890 0x7f01801674e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:08.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.193+0000 7f0184eb9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01800a9b00 0x7f0180164640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:08.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.193+0000 7f0184eb9700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f01800a9ee0 0x7f01800a8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:08.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.193+0000 7f0184eb9700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01801679d0 con 0x7f01800a9b00 2023-12-22T10:01:08.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.193+0000 7f0184eb9700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0180163ee0 con 0x7f01800a9ee0 2023-12-22T10:01:08.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.193+0000 7f0184eb9700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01801641b0 con 0x7f0180065890 2023-12-22T10:01:08.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.193+0000 7f017effd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01800a9b00 0x7f0180164640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:08.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.193+0000 7f017effd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01800a9b00 0x7f0180164640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50214/0 (socket says 172.21.15.45:50214) 2023-12-22T10:01:08.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.193+0000 7f017f7fe700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f0180065890 0x7f01801674e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:08.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.193+0000 7f017effd700 1 -- 172.21.15.45:0/2781423495 learned_addr learned my addr 172.21.15.45:0/2781423495 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:08.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.193+0000 7f017ffff700 1 --2- 172.21.15.45:0/2781423495 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f01800a9ee0 0x7f01800a8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:08.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.193+0000 7f017effd700 1 -- 172.21.15.45:0/2781423495 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f0180065890 msgr2=0x7f01801674e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:08.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.193+0000 7f017effd700 1 --2- 172.21.15.45:0/2781423495 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f0180065890 0x7f01801674e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:08.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.193+0000 7f017effd700 1 -- 172.21.15.45:0/2781423495 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f01800a9ee0 msgr2=0x7f01800a8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:08.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.193+0000 7f017effd700 1 --2- 172.21.15.45:0/2781423495 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f01800a9ee0 0x7f01800a8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:08.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.193+0000 7f017effd700 1 -- 172.21.15.45:0/2781423495 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0170009370 con 0x7f01800a9b00 2023-12-22T10:01:08.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.193+0000 7f017effd700 1 --2- 172.21.15.45:0/2781423495 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01800a9b00 0x7f0180164640 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f017400e930 tx=0x7f0174009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:08.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.193+0000 7f01677fe700 1 -- 172.21.15.45:0/2781423495 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0174012600 con 0x7f01800a9b00 2023-12-22T10:01:08.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.193+0000 7f01677fe700 1 -- 172.21.15.45:0/2781423495 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0174012760 con 0x7f01800a9b00 2023-12-22T10:01:08.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.193+0000 7f0184eb9700 1 -- 172.21.15.45:0/2781423495 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01800ad630 con 0x7f01800a9b00 2023-12-22T10:01:08.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.193+0000 7f01677fe700 1 -- 172.21.15.45:0/2781423495 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0174012ae0 con 0x7f01800a9b00 2023-12-22T10:01:08.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.193+0000 7f0184eb9700 1 -- 172.21.15.45:0/2781423495 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0180167ec0 con 0x7f01800a9b00 2023-12-22T10:01:08.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.197+0000 7f0184eb9700 1 -- 172.21.15.45:0/2781423495 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0180047060 con 0x7f01800a9b00 2023-12-22T10:01:08.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.197+0000 7f01677fe700 1 -- 172.21.15.45:0/2781423495 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f017401b400 con 0x7f01800a9b00 2023-12-22T10:01:08.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.197+0000 7f01677fe700 1 --2- 172.21.15.45:0/2781423495 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f016c05a510 0x7f016c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:08.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.197+0000 7f01677fe700 1 -- 172.21.15.45:0/2781423495 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f0174074c80 con 0x7f01800a9b00 2023-12-22T10:01:08.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.197+0000 7f017f7fe700 1 --2- 172.21.15.45:0/2781423495 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f016c05a510 0x7f016c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:08.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.201+0000 7f017f7fe700 1 --2- 172.21.15.45:0/2781423495 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f016c05a510 0x7f016c05c9d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f0170009130 tx=0x7f0170015000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:08.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.205+0000 7f01677fe700 1 -- 172.21.15.45:0/2781423495 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f0174048340 con 0x7f01800a9b00 2023-12-22T10:01:08.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.365+0000 7f0184eb9700 1 -- 172.21.15.45:0/2781423495 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f01800a68e0 con 0x7f01800a9b00 2023-12-22T10:01:08.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.365+0000 7f01677fe700 1 -- 172.21.15.45:0/2781423495 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f017404b960 con 0x7f01800a9b00 2023-12-22T10:01:08.365 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-22T10:01:08.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.373+0000 7f0184eb9700 1 -- 172.21.15.45:0/2781423495 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f016c05a510 msgr2=0x7f016c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:08.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.373+0000 7f0184eb9700 1 --2- 172.21.15.45:0/2781423495 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f016c05a510 0x7f016c05c9d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f0170009130 tx=0x7f0170015000).stop 2023-12-22T10:01:08.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.373+0000 7f0184eb9700 1 -- 172.21.15.45:0/2781423495 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01800a9b00 msgr2=0x7f0180164640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:08.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.373+0000 7f0184eb9700 1 --2- 172.21.15.45:0/2781423495 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01800a9b00 0x7f0180164640 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f017400e930 tx=0x7f0174009060).stop 2023-12-22T10:01:08.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.373+0000 7f0184eb9700 1 -- 172.21.15.45:0/2781423495 shutdown_connections 2023-12-22T10:01:08.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.373+0000 7f0184eb9700 1 --2- 172.21.15.45:0/2781423495 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f01800a9ee0 0x7f01800a8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:08.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.373+0000 7f0184eb9700 1 --2- 172.21.15.45:0/2781423495 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01800a9b00 0x7f0180164640 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:08.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.373+0000 7f0184eb9700 1 --2- 172.21.15.45:0/2781423495 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f016c05a510 0x7f016c05c9d0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:08.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.373+0000 7f0184eb9700 1 --2- 172.21.15.45:0/2781423495 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f0180065890 0x7f01801674e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:08.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.373+0000 7f0184eb9700 1 -- 172.21.15.45:0/2781423495 >> 172.21.15.45:0/2781423495 conn(0x7f0180062230 msgr2=0x7f0180066a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:08.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.373+0000 7f0184eb9700 1 -- 172.21.15.45:0/2781423495 shutdown_connections 2023-12-22T10:01:08.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.373+0000 7f0184eb9700 1 -- 172.21.15.45:0/2781423495 wait complete. 2023-12-22T10:01:08.395 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T10:01:08.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.557+0000 7f907d907700 1 Processor -- start 2023-12-22T10:01:08.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.557+0000 7f907d907700 1 -- start start 2023-12-22T10:01:08.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.561+0000 7f907d907700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f90780c1400 0x7f90780c5960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:08.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.561+0000 7f907d907700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f90780c5e50 0x7f90780aa940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:08.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.561+0000 7f907d907700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90780c0f70 con 0x7f90780a9ed0 2023-12-22T10:01:08.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.561+0000 7f907d907700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90780c1860 con 0x7f90780c1400 2023-12-22T10:01:08.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.561+0000 7f907d907700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90780aa2b0 con 0x7f90780c5e50 2023-12-22T10:01:08.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.561+0000 7f907c905700 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f90780a9ed0 0x7f90780bf910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.45:40354/0 (socket says 172.21.15.45:40354) 2023-12-22T10:01:08.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.561+0000 7f907c905700 1 -- 172.21.15.45:0/1283410449 learned_addr learned my addr 172.21.15.45:0/1283410449 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:01:08.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.561+0000 7f9077fff700 1 --2- 172.21.15.45:0/1283410449 >> v2:172.21.15.113:3300/0 conn(0x7f90780c1400 0x7f90780c5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:08.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.565+0000 7f907d106700 1 --2- 172.21.15.45:0/1283410449 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f90780c5e50 0x7f90780aa940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:08.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.565+0000 7f90777fe700 1 -- 172.21.15.45:0/1283410449 <== mon.1 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 497988828 0 0) 0x7f90780c0f70 con 0x7f90780a9ed0 2023-12-22T10:01:08.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.565+0000 7f90777fe700 1 -- 172.21.15.45:0/1283410449 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90680033f0 con 0x7f90780a9ed0 2023-12-22T10:01:08.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.565+0000 7f9077fff700 1 -- 172.21.15.45:0/1283410449 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f90780c5e50 msgr2=0x7f90780aa940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:08.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.565+0000 7f9077fff700 1 --2- 172.21.15.45:0/1283410449 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f90780c5e50 0x7f90780aa940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:08.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.565+0000 7f9077fff700 1 -- 172.21.15.45:0/1283410449 >> v1:172.21.15.113:6789/0 conn(0x7f90780a9ed0 legacy=0x7f90780bf910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:08.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.565+0000 7f9077fff700 1 -- 172.21.15.45:0/1283410449 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90780c0360 con 0x7f90780c1400 2023-12-22T10:01:08.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.565+0000 7f907d106700 1 --2- 172.21.15.45:0/1283410449 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f90780c5e50 0x7f90780aa940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-12-22T10:01:08.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.565+0000 7f9077fff700 1 --2- 172.21.15.45:0/1283410449 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f90780c1400 0x7f90780c5960 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f9064009760 tx=0x7f9064009060).ready entity=mon.1 client_cookie=d2270a3eb98ca88 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:08.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.565+0000 7f90777fe700 1 -- 172.21.15.45:0/1283410449 <== mon.1 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f906400d4a0 con 0x7f90780c1400 2023-12-22T10:01:08.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.565+0000 7f90777fe700 1 -- 172.21.15.45:0/1283410449 <== mon.1 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f906400d600 con 0x7f90780c1400 2023-12-22T10:01:08.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.565+0000 7f90777fe700 1 -- 172.21.15.45:0/1283410449 <== mon.1 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f906400d980 con 0x7f90780c1400 2023-12-22T10:01:08.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.565+0000 7f907d907700 1 -- 172.21.15.45:0/1283410449 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f90780c1400 msgr2=0x7f90780c5960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:08.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.565+0000 7f907d907700 1 --2- 172.21.15.45:0/1283410449 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f90780c1400 0x7f90780c5960 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f9064009760 tx=0x7f9064009060).stop 2023-12-22T10:01:08.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.565+0000 7f907d907700 1 -- 172.21.15.45:0/1283410449 shutdown_connections 2023-12-22T10:01:08.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.565+0000 7f907d907700 1 --2- 172.21.15.45:0/1283410449 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f90780c5e50 0x7f90780aa940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:08.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.565+0000 7f907d907700 1 --2- 172.21.15.45:0/1283410449 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f90780c1400 0x7f90780c5960 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:08.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.565+0000 7f907d907700 1 -- 172.21.15.45:0/1283410449 >> 172.21.15.45:0/1283410449 conn(0x7f9078067500 msgr2=0x7f90780ca9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:08.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.565+0000 7f907d907700 1 -- 172.21.15.45:0/1283410449 shutdown_connections 2023-12-22T10:01:08.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.565+0000 7f907d907700 1 -- 172.21.15.45:0/1283410449 wait complete. 2023-12-22T10:01:08.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.569+0000 7f907d907700 1 Processor -- start 2023-12-22T10:01:08.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.569+0000 7f907d907700 1 -- start start 2023-12-22T10:01:08.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.569+0000 7f907d907700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f90780a9ed0 0x7f907814c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:08.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.569+0000 7f907d907700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f90780c1400 0x7f907813f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:08.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.569+0000 7f907d907700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f90780c5e50 0x7f90781540b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:08.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.569+0000 7f907d907700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90780c1ae0 con 0x7f90780c5e50 2023-12-22T10:01:08.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.569+0000 7f907d907700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90780b0090 con 0x7f90780a9ed0 2023-12-22T10:01:08.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.569+0000 7f907d907700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90780afdb0 con 0x7f90780c1400 2023-12-22T10:01:08.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.569+0000 7f907d106700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f90780c5e50 0x7f90781540b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:08.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.569+0000 7f907c905700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f90780a9ed0 0x7f907814c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:08.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.569+0000 7f907d106700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f90780c5e50 0x7f90781540b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50230/0 (socket says 172.21.15.45:50230) 2023-12-22T10:01:08.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.569+0000 7f907d106700 1 -- 172.21.15.45:0/2821592981 learned_addr learned my addr 172.21.15.45:0/2821592981 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:08.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.569+0000 7f9077fff700 1 --2- 172.21.15.45:0/2821592981 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f90780c1400 0x7f907813f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:08.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.569+0000 7f907d106700 1 -- 172.21.15.45:0/2821592981 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f90780c1400 msgr2=0x7f907813f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:08.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.569+0000 7f907d106700 1 --2- 172.21.15.45:0/2821592981 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f90780c1400 0x7f907813f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:08.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.569+0000 7f907d106700 1 -- 172.21.15.45:0/2821592981 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f90780a9ed0 msgr2=0x7f907814c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:08.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.569+0000 7f907d106700 1 --2- 172.21.15.45:0/2821592981 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f90780a9ed0 0x7f907814c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:08.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.573+0000 7f907d106700 1 -- 172.21.15.45:0/2821592981 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9070009a20 con 0x7f90780c5e50 2023-12-22T10:01:08.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.573+0000 7f907d106700 1 --2- 172.21.15.45:0/2821592981 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f90780c5e50 0x7f90781540b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f9070009fc0 tx=0x7f907000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:08.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.573+0000 7f9074ff9700 1 -- 172.21.15.45:0/2821592981 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f907000cbd0 con 0x7f90780c5e50 2023-12-22T10:01:08.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.573+0000 7f9074ff9700 1 -- 172.21.15.45:0/2821592981 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f907000f040 con 0x7f90780c5e50 2023-12-22T10:01:08.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.573+0000 7f907d907700 1 -- 172.21.15.45:0/2821592981 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90640092a0 con 0x7f90780c5e50 2023-12-22T10:01:08.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.573+0000 7f9074ff9700 1 -- 172.21.15.45:0/2821592981 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9070013400 con 0x7f90780c5e50 2023-12-22T10:01:08.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.573+0000 7f907d907700 1 -- 172.21.15.45:0/2821592981 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90780af7c0 con 0x7f90780c5e50 2023-12-22T10:01:08.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.573+0000 7f907d907700 1 -- 172.21.15.45:0/2821592981 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90780c1c50 con 0x7f90780c5e50 2023-12-22T10:01:08.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.577+0000 7f9074ff9700 1 -- 172.21.15.45:0/2821592981 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f90700137f0 con 0x7f90780c5e50 2023-12-22T10:01:08.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.577+0000 7f9074ff9700 1 --2- 172.21.15.45:0/2821592981 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f905c05a510 0x7f905c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:08.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.577+0000 7f9074ff9700 1 -- 172.21.15.45:0/2821592981 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f90700751c0 con 0x7f90780c5e50 2023-12-22T10:01:08.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.577+0000 7f907c905700 1 --2- 172.21.15.45:0/2821592981 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f905c05a510 0x7f905c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:08.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.577+0000 7f907c905700 1 --2- 172.21.15.45:0/2821592981 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f905c05a510 0x7f905c05c9d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f906c007fd0 tx=0x7f906c009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:08.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.585+0000 7f9074ff9700 1 -- 172.21.15.45:0/2821592981 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f90700488e0 con 0x7f90780c5e50 2023-12-22T10:01:08.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.753+0000 7f907d907700 1 -- 172.21.15.45:0/2821592981 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f90780c0640 con 0x7f90780c5e50 2023-12-22T10:01:08.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.753+0000 7f9074ff9700 1 -- 172.21.15.45:0/2821592981 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16928 (secure 0 0 0) 0x7f907004bf00 con 0x7f90780c5e50 2023-12-22T10:01:08.752 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:01:08.753 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":21,"fsid":"98b0837e-5e68-4c8f-a1a0-e9424baaad8f","created":"2023-12-22T10:00:15.010174+0000","modified":"2023-12-22T10:00:34.529651+0000","last_up_change":"2023-12-22T10:00:24.980513+0000","last_in_change":"2023-12-22T10:00:17.887172+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-12-22T10:00:25.069641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-12-22T10:00:26.906399+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-12-22T10:00:31.621311+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-12-22T10:00:32.538053+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e19943a0-1c6b-47df-b6bb-383472077890","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":33777},{"type":"v1","addr":"172.21.15.45:6819","nonce":33777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":33777},{"type":"v1","addr":"172.21.15.45:6822","nonce":33777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":33777},{"type":"v1","addr":"172.21.15.45:6830","nonce":33777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":33777},{"type":"v1","addr":"172.21.15.45:6826","nonce":33777}]},"public_addr":"172.21.15.45:6819/33777","cluster_addr":"172.21.15.45:6822/33777","heartbeat_back_addr":"172.21.15.45:6830/33777","heartbeat_front_addr":"172.21.15.45:6826/33777","state":["exists","up"]},{"osd":1,"uuid":"69670f34-f082-45a7-8f67-e962acc136e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":33775},{"type":"v1","addr":"172.21.15.45:6809","nonce":33775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":33775},{"type":"v1","addr":"172.21.15.45:6811","nonce":33775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":33775},{"type":"v1","addr":"172.21.15.45:6815","nonce":33775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":33775},{"type":"v1","addr":"172.21.15.45:6813","nonce":33775}]},"public_addr":"172.21.15.45:6809/33775","cluster_addr":"172.21.15.45:6811/33775","heartbeat_back_addr":"172.21.15.45:6815/33775","heartbeat_front_addr":"172.21.15.45:6813/33775","state":["exists","up"]},{"osd":2,"uuid":"d909d49b-82b8-401b-9947-e49dd167bb95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":33776},{"type":"v1","addr":"172.21.15.45:6801","nonce":33776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":33776},{"type":"v1","addr":"172.21.15.45:6803","nonce":33776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":33776},{"type":"v1","addr":"172.21.15.45:6807","nonce":33776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":33776},{"type":"v1","addr":"172.21.15.45:6805","nonce":33776}]},"public_addr":"172.21.15.45:6801/33776","cluster_addr":"172.21.15.45:6803/33776","heartbeat_back_addr":"172.21.15.45:6807/33776","heartbeat_front_addr":"172.21.15.45:6805/33776","state":["exists","up"]},{"osd":3,"uuid":"db104ca9-3a94-4d39-a2be-bd06db888095","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":33782},{"type":"v1","addr":"172.21.15.45:6817","nonce":33782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":33782},{"type":"v1","addr":"172.21.15.45:6823","nonce":33782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":33782},{"type":"v1","addr":"172.21.15.45:6831","nonce":33782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":33782},{"type":"v1","addr":"172.21.15.45:6827","nonce":33782}]},"public_addr":"172.21.15.45:6817/33782","cluster_addr":"172.21.15.45:6823/33782","heartbeat_back_addr":"172.21.15.45:6831/33782","heartbeat_front_addr":"172.21.15.45:6827/33782","state":["exists","up"]},{"osd":4,"uuid":"9f4eaff4-e433-4479-a0d1-ee7a33375ca6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":34099},{"type":"v1","addr":"172.21.15.113:6811","nonce":34099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":34099},{"type":"v1","addr":"172.21.15.113:6815","nonce":34099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":34099},{"type":"v1","addr":"172.21.15.113:6823","nonce":34099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6816","nonce":34099},{"type":"v1","addr":"172.21.15.113:6818","nonce":34099}]},"public_addr":"172.21.15.113:6811/34099","cluster_addr":"172.21.15.113:6815/34099","heartbeat_back_addr":"172.21.15.113:6823/34099","heartbeat_front_addr":"172.21.15.113:6818/34099","state":["exists","up"]},{"osd":5,"uuid":"1efc5591-180b-43af-8611-0068aadc5aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":34100},{"type":"v1","addr":"172.21.15.113:6801","nonce":34100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":34100},{"type":"v1","addr":"172.21.15.113:6803","nonce":34100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":34100},{"type":"v1","addr":"172.21.15.113:6807","nonce":34100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":34100},{"type":"v1","addr":"172.21.15.113:6805","nonce":34100}]},"public_addr":"172.21.15.113:6801/34100","cluster_addr":"172.21.15.113:6803/34100","heartbeat_back_addr":"172.21.15.113:6807/34100","heartbeat_front_addr":"172.21.15.113:6805/34100","state":["exists","up"]},{"osd":6,"uuid":"6c89d9d8-c153-4a48-afa9-97e4c403f1ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":34101},{"type":"v1","addr":"172.21.15.113:6810","nonce":34101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6812","nonce":34101},{"type":"v1","addr":"172.21.15.113:6814","nonce":34101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6822","nonce":34101},{"type":"v1","addr":"172.21.15.113:6824","nonce":34101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":34101},{"type":"v1","addr":"172.21.15.113:6819","nonce":34101}]},"public_addr":"172.21.15.113:6810/34101","cluster_addr":"172.21.15.113:6814/34101","heartbeat_back_addr":"172.21.15.113:6824/34101","heartbeat_front_addr":"172.21.15.113:6819/34101","state":["exists","up"]},{"osd":7,"uuid":"1855e70c-23f6-4c08-ad7f-774c2148235b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6821","nonce":34102},{"type":"v1","addr":"172.21.15.113:6825","nonce":34102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":34102},{"type":"v1","addr":"172.21.15.113:6827","nonce":34102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":34102},{"type":"v1","addr":"172.21.15.113:6831","nonce":34102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6828","nonce":34102},{"type":"v1","addr":"172.21.15.113:6829","nonce":34102}]},"public_addr":"172.21.15.113:6825/34102","cluster_addr":"172.21.15.113:6827/34102","heartbeat_back_addr":"172.21.15.113:6831/34102","heartbeat_front_addr":"172.21.15.113:6829/34102","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.812672+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.825045+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.700105+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.856563+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.954683+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.883234+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.883994+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.821686+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T10:01:08.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.757+0000 7f907d907700 1 -- 172.21.15.45:0/2821592981 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f905c05a510 msgr2=0x7f905c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:08.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.757+0000 7f907d907700 1 --2- 172.21.15.45:0/2821592981 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f905c05a510 0x7f905c05c9d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f906c007fd0 tx=0x7f906c009040).stop 2023-12-22T10:01:08.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.757+0000 7f907d907700 1 -- 172.21.15.45:0/2821592981 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f90780c5e50 msgr2=0x7f90781540b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:08.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.757+0000 7f907d907700 1 --2- 172.21.15.45:0/2821592981 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f90780c5e50 0x7f90781540b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f9070009fc0 tx=0x7f907000b040).stop 2023-12-22T10:01:08.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.757+0000 7f907d907700 1 -- 172.21.15.45:0/2821592981 shutdown_connections 2023-12-22T10:01:08.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.757+0000 7f907d907700 1 --2- 172.21.15.45:0/2821592981 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f90780c5e50 0x7f90781540b0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:08.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.757+0000 7f907d907700 1 --2- 172.21.15.45:0/2821592981 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f905c05a510 0x7f905c05c9d0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:08.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.757+0000 7f907d907700 1 --2- 172.21.15.45:0/2821592981 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f90780c1400 0x7f907813f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:08.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.757+0000 7f907d907700 1 --2- 172.21.15.45:0/2821592981 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f90780a9ed0 0x7f907814c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:08.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.757+0000 7f907d907700 1 -- 172.21.15.45:0/2821592981 >> 172.21.15.45:0/2821592981 conn(0x7f9078067500 msgr2=0x7f90780ab7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:08.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.757+0000 7f907d907700 1 -- 172.21.15.45:0/2821592981 shutdown_connections 2023-12-22T10:01:08.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.757+0000 7f907d907700 1 -- 172.21.15.45:0/2821592981 wait complete. 2023-12-22T10:01:08.777 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-12-22T10:00:25.069641+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-12-22T10:00:26.906399+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-22T10:00:31.621311+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-12-22T10:00:32.538053+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-22T10:01:08.778 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-12-22T10:01:08.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.953+0000 7fd9e2a9b700 1 Processor -- start 2023-12-22T10:01:08.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.953+0000 7fd9e2a9b700 1 -- start start 2023-12-22T10:01:08.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.953+0000 7fd9e2a9b700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd9dc0ac0e0 0x7fd9dc0a7050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:08.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.953+0000 7fd9e2a9b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd9dc0c3160 0x7fd9dc0a5890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:08.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.953+0000 7fd9e2a9b700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9dc1521b0 con 0x7fd9dc0ac4c0 2023-12-22T10:01:08.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.953+0000 7fd9e2a9b700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9dc151fa0 con 0x7fd9dc0c3160 2023-12-22T10:01:08.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.953+0000 7fd9e2a9b700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9dc155d70 con 0x7fd9dc0ac0e0 2023-12-22T10:01:08.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.953+0000 7fd9d3fff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fd9dc0ac4c0 0x7fd9dc155660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:55868/0 (socket says 172.21.15.45:55868) 2023-12-22T10:01:08.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.953+0000 7fd9d3fff700 1 -- 172.21.15.45:0/2779545428 learned_addr learned my addr 172.21.15.45:0/2779545428 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:01:08.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.953+0000 7fd9e1038700 1 --2- 172.21.15.45:0/2779545428 >> v2:172.21.15.45:3300/0 conn(0x7fd9dc0c3160 0x7fd9dc0a5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:08.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.953+0000 7fd9e0837700 1 --2- 172.21.15.45:0/2779545428 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd9dc0ac0e0 0x7fd9dc0a7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:08.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.953+0000 7fd9d37fe700 1 -- 172.21.15.45:0/2779545428 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1732306689 0 0) 0x7fd9dc1521b0 con 0x7fd9dc0ac4c0 2023-12-22T10:01:08.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.953+0000 7fd9d37fe700 1 -- 172.21.15.45:0/2779545428 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9c40033f0 con 0x7fd9dc0ac4c0 2023-12-22T10:01:08.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.957+0000 7fd9d37fe700 1 -- 172.21.15.45:0/2779545428 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3831292713 0 0) 0x7fd9c40033f0 con 0x7fd9dc0ac4c0 2023-12-22T10:01:08.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.957+0000 7fd9d37fe700 1 -- 172.21.15.45:0/2779545428 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd9dc0ac0e0 msgr2=0x7fd9dc0a7050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:08.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.957+0000 7fd9d37fe700 1 --2- 172.21.15.45:0/2779545428 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd9dc0ac0e0 0x7fd9dc0a7050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:08.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.957+0000 7fd9d37fe700 1 -- 172.21.15.45:0/2779545428 >> v2:172.21.15.45:3300/0 conn(0x7fd9dc0c3160 msgr2=0x7fd9dc0a5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:08.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.957+0000 7fd9d37fe700 1 --2- 172.21.15.45:0/2779545428 >> v2:172.21.15.45:3300/0 conn(0x7fd9dc0c3160 0x7fd9dc0a5890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:08.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.957+0000 7fd9d37fe700 1 -- 172.21.15.45:0/2779545428 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9dc0c36e0 con 0x7fd9dc0ac4c0 2023-12-22T10:01:08.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.957+0000 7fd9d37fe700 1 -- 172.21.15.45:0/2779545428 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2619163070 0 0) 0x7fd9cc001470 con 0x7fd9dc0ac4c0 2023-12-22T10:01:08.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.957+0000 7fd9d37fe700 1 -- 172.21.15.45:0/2779545428 >> v1:172.21.15.45:6789/0 conn(0x7fd9dc0ac4c0 legacy=0x7fd9dc155660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:08.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.957+0000 7fd9d37fe700 1 --2- 172.21.15.45:0/2779545428 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd9dc0ac0e0 0x7fd9c40038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:08.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.957+0000 7fd9d37fe700 1 --2- 172.21.15.45:0/2779545428 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9c4003e10 0x7fd9c4004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:08.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.957+0000 7fd9d37fe700 1 --2- 172.21.15.45:0/2779545428 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd9c4004b80 0x7fd9c4005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:08.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.957+0000 7fd9d37fe700 1 -- 172.21.15.45:0/2779545428 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9dc151fa0 con 0x7fd9c4003e10 2023-12-22T10:01:08.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.957+0000 7fd9d37fe700 1 -- 172.21.15.45:0/2779545428 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9dc155d70 con 0x7fd9c4004b80 2023-12-22T10:01:08.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.957+0000 7fd9d37fe700 1 -- 172.21.15.45:0/2779545428 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c400b8e0 con 0x7fd9dc0ac0e0 2023-12-22T10:01:08.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.957+0000 7fd9d3fff700 1 --2- 172.21.15.45:0/2779545428 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9c4003e10 0x7fd9c4004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:08.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.957+0000 7fd9e1038700 1 --2- 172.21.15.45:0/2779545428 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd9c4004b80 0x7fd9c4005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:08.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.957+0000 7fd9e0837700 1 --2- 172.21.15.45:0/2779545428 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd9dc0ac0e0 0x7fd9c40038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:08.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.957+0000 7fd9d3fff700 1 -- 172.21.15.45:0/2779545428 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd9dc0ac0e0 msgr2=0x7fd9c40038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:08.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.957+0000 7fd9d3fff700 1 --2- 172.21.15.45:0/2779545428 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd9dc0ac0e0 0x7fd9c40038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:08.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.957+0000 7fd9d3fff700 1 -- 172.21.15.45:0/2779545428 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd9c4004b80 msgr2=0x7fd9c4005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:08.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.957+0000 7fd9d3fff700 1 --2- 172.21.15.45:0/2779545428 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd9c4004b80 0x7fd9c4005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:08.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.957+0000 7fd9d3fff700 1 -- 172.21.15.45:0/2779545428 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9c40033f0 con 0x7fd9c4003e10 2023-12-22T10:01:08.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.957+0000 7fd9d3fff700 1 --2- 172.21.15.45:0/2779545428 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9c4003e10 0x7fd9c4004690 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7fd9dc0679a0 tx=0x7fd9cc0077c0).ready entity=mon.0 client_cookie=8e251c451433d84b server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:08.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.957+0000 7fd9d37fe700 1 -- 172.21.15.45:0/2779545428 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9cc00ca70 con 0x7fd9c4003e10 2023-12-22T10:01:08.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.957+0000 7fd9d37fe700 1 -- 172.21.15.45:0/2779545428 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9cc00cbd0 con 0x7fd9c4003e10 2023-12-22T10:01:08.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.957+0000 7fd9d37fe700 1 -- 172.21.15.45:0/2779545428 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9cc0070d0 con 0x7fd9c4003e10 2023-12-22T10:01:08.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.957+0000 7fd9e2a9b700 1 -- 172.21.15.45:0/2779545428 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9c4003e10 msgr2=0x7fd9c4004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:08.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.957+0000 7fd9e2a9b700 1 --2- 172.21.15.45:0/2779545428 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9c4003e10 0x7fd9c4004690 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7fd9dc0679a0 tx=0x7fd9cc0077c0).stop 2023-12-22T10:01:08.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.957+0000 7fd9e1038700 1 -- 172.21.15.45:0/2779545428 reap_dead start 2023-12-22T10:01:08.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.957+0000 7fd9e2a9b700 1 -- 172.21.15.45:0/2779545428 shutdown_connections 2023-12-22T10:01:08.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.957+0000 7fd9e2a9b700 1 -- 172.21.15.45:0/2779545428 >> 172.21.15.45:0/2779545428 conn(0x7fd9dc066a70 msgr2=0x7fd9dc066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:08.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.957+0000 7fd9e2a9b700 1 -- 172.21.15.45:0/2779545428 shutdown_connections 2023-12-22T10:01:08.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.957+0000 7fd9e2a9b700 1 -- 172.21.15.45:0/2779545428 wait complete. 2023-12-22T10:01:08.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.961+0000 7fd9e2a9b700 1 Processor -- start 2023-12-22T10:01:08.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.961+0000 7fd9e2a9b700 1 -- start start 2023-12-22T10:01:08.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.965+0000 7fd9e2a9b700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd9dc168190 0x7fd9dc168570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:08.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.965+0000 7fd9e2a9b700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd9dc15c1c0 0x7fd9dc0beb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:08.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.965+0000 7fd9e2a9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9dc169320 0x7fd9dc0aa9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:08.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.965+0000 7fd9e2a9b700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9dc15c600 con 0x7fd9dc169320 2023-12-22T10:01:08.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.965+0000 7fd9e2a9b700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9dc168e90 con 0x7fd9dc15c1c0 2023-12-22T10:01:08.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.965+0000 7fd9e2a9b700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9dc0bf3d0 con 0x7fd9dc168190 2023-12-22T10:01:08.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.965+0000 7fd9e1038700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9dc169320 0x7fd9dc0aa9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:08.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.965+0000 7fd9e1038700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9dc169320 0x7fd9dc0aa9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50262/0 (socket says 172.21.15.45:50262) 2023-12-22T10:01:08.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.965+0000 7fd9e1038700 1 -- 172.21.15.45:0/2364802605 learned_addr learned my addr 172.21.15.45:0/2364802605 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:08.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.965+0000 7fd9e0837700 1 --2- 172.21.15.45:0/2364802605 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd9dc168190 0x7fd9dc168570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:08.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.965+0000 7fd9d3fff700 1 --2- 172.21.15.45:0/2364802605 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd9dc15c1c0 0x7fd9dc0beb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:08.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.965+0000 7fd9e1038700 1 -- 172.21.15.45:0/2364802605 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd9dc168190 msgr2=0x7fd9dc168570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:08.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.965+0000 7fd9e1038700 1 --2- 172.21.15.45:0/2364802605 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd9dc168190 0x7fd9dc168570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:08.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.965+0000 7fd9e1038700 1 -- 172.21.15.45:0/2364802605 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd9dc15c1c0 msgr2=0x7fd9dc0beb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:08.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.965+0000 7fd9e1038700 1 --2- 172.21.15.45:0/2364802605 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd9dc15c1c0 0x7fd9dc0beb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:08.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.965+0000 7fd9e1038700 1 -- 172.21.15.45:0/2364802605 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9dc0bf6b0 con 0x7fd9dc169320 2023-12-22T10:01:08.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.965+0000 7fd9e1038700 1 --2- 172.21.15.45:0/2364802605 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9dc169320 0x7fd9dc0aa9f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7fd9dc066160 tx=0x7fd9d4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:08.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.965+0000 7fd9d0ff9700 1 -- 172.21.15.45:0/2364802605 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d4015440 con 0x7fd9dc169320 2023-12-22T10:01:08.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.965+0000 7fd9d0ff9700 1 -- 172.21.15.45:0/2364802605 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9d40155a0 con 0x7fd9dc169320 2023-12-22T10:01:08.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.965+0000 7fd9d0ff9700 1 -- 172.21.15.45:0/2364802605 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d4015920 con 0x7fd9dc169320 2023-12-22T10:01:08.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.965+0000 7fd9e2a9b700 1 -- 172.21.15.45:0/2364802605 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9dc0bf990 con 0x7fd9dc169320 2023-12-22T10:01:08.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.965+0000 7fd9e2a9b700 1 -- 172.21.15.45:0/2364802605 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9dc0bf000 con 0x7fd9dc169320 2023-12-22T10:01:08.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.969+0000 7fd9e2a9b700 1 -- 172.21.15.45:0/2364802605 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9dc169000 con 0x7fd9dc169320 2023-12-22T10:01:08.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.969+0000 7fd9d0ff9700 1 -- 172.21.15.45:0/2364802605 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fd9d4015d10 con 0x7fd9dc169320 2023-12-22T10:01:08.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.969+0000 7fd9d0ff9700 1 --2- 172.21.15.45:0/2364802605 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fd9c805a540 0x7fd9c805ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:08.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.969+0000 7fd9d0ff9700 1 -- 172.21.15.45:0/2364802605 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fd9d4074400 con 0x7fd9dc169320 2023-12-22T10:01:08.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.969+0000 7fd9e0837700 1 --2- 172.21.15.45:0/2364802605 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fd9c805a540 0x7fd9c805ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:08.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.973+0000 7fd9e0837700 1 --2- 172.21.15.45:0/2364802605 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fd9c805a540 0x7fd9c805ca00 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fd9d8002880 tx=0x7fd9d800b040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:08.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:08.977+0000 7fd9d0ff9700 1 -- 172.21.15.45:0/2364802605 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd9d4047ac0 con 0x7fd9dc169320 2023-12-22T10:01:09.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.149+0000 7fd9e2a9b700 1 -- 172.21.15.45:0/2364802605 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fd9dc06c070 con 0x7fd9dc169320 2023-12-22T10:01:09.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.149+0000 7fd9d0ff9700 1 -- 172.21.15.45:0/2364802605 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v21) v1 ==== 110+0+10 (secure 0 0 0) 0x7fd9d404b0e0 con 0x7fd9dc169320 2023-12-22T10:01:09.146 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-12-22T10:01:09.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.149+0000 7fd9e2a9b700 1 -- 172.21.15.45:0/2364802605 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fd9c805a540 msgr2=0x7fd9c805ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:09.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.149+0000 7fd9e2a9b700 1 --2- 172.21.15.45:0/2364802605 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fd9c805a540 0x7fd9c805ca00 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fd9d8002880 tx=0x7fd9d800b040).stop 2023-12-22T10:01:09.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.149+0000 7fd9e2a9b700 1 -- 172.21.15.45:0/2364802605 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9dc169320 msgr2=0x7fd9dc0aa9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:09.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.149+0000 7fd9e2a9b700 1 --2- 172.21.15.45:0/2364802605 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9dc169320 0x7fd9dc0aa9f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7fd9dc066160 tx=0x7fd9d4008040).stop 2023-12-22T10:01:09.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.153+0000 7fd9e2a9b700 1 -- 172.21.15.45:0/2364802605 shutdown_connections 2023-12-22T10:01:09.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.153+0000 7fd9e2a9b700 1 --2- 172.21.15.45:0/2364802605 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9dc169320 0x7fd9dc0aa9f0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:09.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.153+0000 7fd9e2a9b700 1 --2- 172.21.15.45:0/2364802605 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd9dc15c1c0 0x7fd9dc0beb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:09.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.153+0000 7fd9e2a9b700 1 --2- 172.21.15.45:0/2364802605 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fd9c805a540 0x7fd9c805ca00 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:09.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.153+0000 7fd9e2a9b700 1 --2- 172.21.15.45:0/2364802605 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd9dc168190 0x7fd9dc168570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:09.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.153+0000 7fd9e2a9b700 1 -- 172.21.15.45:0/2364802605 >> 172.21.15.45:0/2364802605 conn(0x7fd9dc066a70 msgr2=0x7fd9dc0bff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:09.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.153+0000 7fd9e2a9b700 1 -- 172.21.15.45:0/2364802605 shutdown_connections 2023-12-22T10:01:09.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.153+0000 7fd9e2a9b700 1 -- 172.21.15.45:0/2364802605 wait complete. 2023-12-22T10:01:09.170 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-12-22T10:01:09.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.333+0000 7f45e65b9700 1 Processor -- start 2023-12-22T10:01:09.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.333+0000 7f45e65b9700 1 -- start start 2023-12-22T10:01:09.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.337+0000 7f45e65b9700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f45e00691c0 0x7f45e00ad080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:09.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.337+0000 7f45e65b9700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45e00c5810 con 0x7f45e00acca0 2023-12-22T10:01:09.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.337+0000 7f45e65b9700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45e00c8d90 con 0x7f45e00c9d20 2023-12-22T10:01:09.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.337+0000 7f45e65b9700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45e00c9350 con 0x7f45e00691c0 2023-12-22T10:01:09.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.337+0000 7f45e55b7700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f45e00acca0 0x7f45e0068ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:55870/0 (socket says 172.21.15.45:55870) 2023-12-22T10:01:09.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.337+0000 7f45e55b7700 1 -- 172.21.15.45:0/1032428793 learned_addr learned my addr 172.21.15.45:0/1032428793 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:01:09.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.337+0000 7f45e4db6700 1 --2- 172.21.15.45:0/1032428793 >> v2:172.21.15.113:3300/0 conn(0x7f45e00691c0 0x7f45e00ad080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:09.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.337+0000 7f45d7fff700 1 -- 172.21.15.45:0/1032428793 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3152031269 0 0) 0x7f45e00c5810 con 0x7f45e00acca0 2023-12-22T10:01:09.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.337+0000 7f45d7fff700 1 -- 172.21.15.45:0/1032428793 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45cc0033f0 con 0x7f45e00acca0 2023-12-22T10:01:09.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.337+0000 7f45d7fff700 1 -- 172.21.15.45:0/1032428793 <== mon.1 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1802462139 0 0) 0x7f45e00c8d90 con 0x7f45e00c9d20 2023-12-22T10:01:09.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.337+0000 7f45d7fff700 1 -- 172.21.15.45:0/1032428793 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45e00c5810 con 0x7f45e00c9d20 2023-12-22T10:01:09.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.337+0000 7f45e4db6700 1 -- 172.21.15.45:0/1032428793 >> v1:172.21.15.113:6789/0 conn(0x7f45e00c9d20 legacy=0x7f45e00aa5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:09.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.337+0000 7f45e4db6700 1 -- 172.21.15.45:0/1032428793 >> v1:172.21.15.45:6789/0 conn(0x7f45e00acca0 legacy=0x7f45e0068ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:09.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.337+0000 7f45d7fff700 1 -- 172.21.15.45:0/1032428793 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 371879401 0 0) 0x7f45cc0033f0 con 0x7f45e00acca0 2023-12-22T10:01:09.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.337+0000 7f45e4db6700 1 -- 172.21.15.45:0/1032428793 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45e0154070 con 0x7f45e00691c0 2023-12-22T10:01:09.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.337+0000 7f45e4db6700 1 --2- 172.21.15.45:0/1032428793 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f45e00691c0 0x7f45e00ad080 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f45d0009760 tx=0x7f45d0009060).ready entity=mon.1 client_cookie=60d758b730a6f57a server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:09.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.341+0000 7f45d7fff700 1 -- 172.21.15.45:0/1032428793 <== mon.1 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45dc001470 con 0x7f45e00691c0 2023-12-22T10:01:09.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.341+0000 7f45d7fff700 1 -- 172.21.15.45:0/1032428793 <== mon.1 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45d0011400 con 0x7f45e00691c0 2023-12-22T10:01:09.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.341+0000 7f45d7fff700 1 -- 172.21.15.45:0/1032428793 <== mon.1 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d0011780 con 0x7f45e00691c0 2023-12-22T10:01:09.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.341+0000 7f45e65b9700 1 -- 172.21.15.45:0/1032428793 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f45e00691c0 msgr2=0x7f45e00ad080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:09.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.341+0000 7f45e65b9700 1 --2- 172.21.15.45:0/1032428793 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f45e00691c0 0x7f45e00ad080 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f45d0009760 tx=0x7f45d0009060).stop 2023-12-22T10:01:09.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.341+0000 7f45e65b9700 1 -- 172.21.15.45:0/1032428793 shutdown_connections 2023-12-22T10:01:09.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.341+0000 7f45e65b9700 1 --2- 172.21.15.45:0/1032428793 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f45e00691c0 0x7f45e00ad080 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:09.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.341+0000 7f45e65b9700 1 -- 172.21.15.45:0/1032428793 >> 172.21.15.45:0/1032428793 conn(0x7f45e00674f0 msgr2=0x7f45e00ca820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:09.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.341+0000 7f45e65b9700 1 -- 172.21.15.45:0/1032428793 shutdown_connections 2023-12-22T10:01:09.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.341+0000 7f45e65b9700 1 -- 172.21.15.45:0/1032428793 wait complete. 2023-12-22T10:01:09.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.345+0000 7f45e65b9700 1 Processor -- start 2023-12-22T10:01:09.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.345+0000 7f45e65b9700 1 -- start start 2023-12-22T10:01:09.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.345+0000 7f45e65b9700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f45e00691c0 0x7f45e0156b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:09.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.345+0000 7f45e65b9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45e00acca0 0x7f45e00639a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:09.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.345+0000 7f45e65b9700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f45e00c9d20 0x7f45e014c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:09.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.345+0000 7f45e65b9700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45e00ae870 con 0x7f45e00acca0 2023-12-22T10:01:09.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.345+0000 7f45e65b9700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45e00adc60 con 0x7f45e00c9d20 2023-12-22T10:01:09.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.345+0000 7f45e65b9700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45e00adf40 con 0x7f45e00691c0 2023-12-22T10:01:09.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.345+0000 7f45e4db6700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45e00acca0 0x7f45e00639a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:09.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.349+0000 7f45e4db6700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45e00acca0 0x7f45e00639a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50274/0 (socket says 172.21.15.45:50274) 2023-12-22T10:01:09.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.349+0000 7f45e4db6700 1 -- 172.21.15.45:0/2099694345 learned_addr learned my addr 172.21.15.45:0/2099694345 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:09.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.349+0000 7f45e5db8700 1 --2- 172.21.15.45:0/2099694345 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f45e00c9d20 0x7f45e014c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:09.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.349+0000 7f45e55b7700 1 --2- 172.21.15.45:0/2099694345 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f45e00691c0 0x7f45e0156b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:09.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.349+0000 7f45e4db6700 1 -- 172.21.15.45:0/2099694345 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f45e00691c0 msgr2=0x7f45e0156b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:09.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.349+0000 7f45e4db6700 1 --2- 172.21.15.45:0/2099694345 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f45e00691c0 0x7f45e0156b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:09.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.349+0000 7f45e4db6700 1 -- 172.21.15.45:0/2099694345 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f45e00c9d20 msgr2=0x7f45e014c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:09.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.349+0000 7f45e4db6700 1 --2- 172.21.15.45:0/2099694345 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f45e00c9d20 0x7f45e014c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:09.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.349+0000 7f45e4db6700 1 -- 172.21.15.45:0/2099694345 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45d00092a0 con 0x7f45e00acca0 2023-12-22T10:01:09.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.349+0000 7f45e5db8700 1 --2- 172.21.15.45:0/2099694345 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f45e00c9d20 0x7f45e014c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T10:01:09.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.349+0000 7f45e4db6700 1 --2- 172.21.15.45:0/2099694345 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45e00acca0 0x7f45e00639a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f45e0083880 tx=0x7f45d0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:09.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.349+0000 7f45d57fa700 1 -- 172.21.15.45:0/2099694345 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d00108b0 con 0x7f45e00acca0 2023-12-22T10:01:09.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.349+0000 7f45d57fa700 1 -- 172.21.15.45:0/2099694345 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45d0010a10 con 0x7f45e00acca0 2023-12-22T10:01:09.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.349+0000 7f45d57fa700 1 -- 172.21.15.45:0/2099694345 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d0010d90 con 0x7f45e00acca0 2023-12-22T10:01:09.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.349+0000 7f45e65b9700 1 -- 172.21.15.45:0/2099694345 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45e00ae220 con 0x7f45e00acca0 2023-12-22T10:01:09.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.349+0000 7f45e65b9700 1 -- 172.21.15.45:0/2099694345 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45e0157000 con 0x7f45e00acca0 2023-12-22T10:01:09.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.349+0000 7f45e65b9700 1 -- 172.21.15.45:0/2099694345 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45e0047060 con 0x7f45e00acca0 2023-12-22T10:01:09.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.353+0000 7f45d57fa700 1 -- 172.21.15.45:0/2099694345 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f45d001d640 con 0x7f45e00acca0 2023-12-22T10:01:09.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.353+0000 7f45d57fa700 1 --2- 172.21.15.45:0/2099694345 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f45c405a510 0x7f45c405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:09.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.353+0000 7f45d57fa700 1 -- 172.21.15.45:0/2099694345 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f45d00753a0 con 0x7f45e00acca0 2023-12-22T10:01:09.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.353+0000 7f45e55b7700 1 --2- 172.21.15.45:0/2099694345 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f45c405a510 0x7f45c405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:09.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.353+0000 7f45e55b7700 1 --2- 172.21.15.45:0/2099694345 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f45c405a510 0x7f45c405c9d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f45dc0015a0 tx=0x7f45dc001990).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:09.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.361+0000 7f45d57fa700 1 -- 172.21.15.45:0/2099694345 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f45d0048b10 con 0x7f45e00acca0 2023-12-22T10:01:09.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.525+0000 7f45e65b9700 1 -- 172.21.15.45:0/2099694345 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f45e00ae9b0 con 0x7f45e00acca0 2023-12-22T10:01:09.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.525+0000 7f45d57fa700 1 -- 172.21.15.45:0/2099694345 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7f45d0022070 con 0x7f45e00acca0 2023-12-22T10:01:09.524 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-12-22T10:01:09.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.529+0000 7f45e65b9700 1 -- 172.21.15.45:0/2099694345 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f45c405a510 msgr2=0x7f45c405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:09.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.529+0000 7f45e65b9700 1 --2- 172.21.15.45:0/2099694345 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f45c405a510 0x7f45c405c9d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f45dc0015a0 tx=0x7f45dc001990).stop 2023-12-22T10:01:09.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.529+0000 7f45e65b9700 1 -- 172.21.15.45:0/2099694345 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45e00acca0 msgr2=0x7f45e00639a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:09.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.529+0000 7f45e65b9700 1 --2- 172.21.15.45:0/2099694345 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45e00acca0 0x7f45e00639a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f45e0083880 tx=0x7f45d0016000).stop 2023-12-22T10:01:09.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.533+0000 7f45e65b9700 1 -- 172.21.15.45:0/2099694345 shutdown_connections 2023-12-22T10:01:09.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.533+0000 7f45e65b9700 1 --2- 172.21.15.45:0/2099694345 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f45e00c9d20 0x7f45e014c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:09.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.533+0000 7f45e65b9700 1 --2- 172.21.15.45:0/2099694345 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45e00acca0 0x7f45e00639a0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:09.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.533+0000 7f45e65b9700 1 --2- 172.21.15.45:0/2099694345 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f45c405a510 0x7f45c405c9d0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:09.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.533+0000 7f45e65b9700 1 --2- 172.21.15.45:0/2099694345 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f45e00691c0 0x7f45e0156b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:09.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.533+0000 7f45e65b9700 1 -- 172.21.15.45:0/2099694345 >> 172.21.15.45:0/2099694345 conn(0x7f45e00674f0 msgr2=0x7f45e00c38d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:09.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.533+0000 7f45e65b9700 1 -- 172.21.15.45:0/2099694345 shutdown_connections 2023-12-22T10:01:09.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.533+0000 7f45e65b9700 1 -- 172.21.15.45:0/2099694345 wait complete. 2023-12-22T10:01:09.552 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-22T10:01:09.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.713+0000 7f13e46db700 1 Processor -- start 2023-12-22T10:01:09.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.717+0000 7f13e46db700 1 -- start start 2023-12-22T10:01:09.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.717+0000 7f13e46db700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f13dc1507b0 0x7f13dc064890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:09.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.717+0000 7f13e46db700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f13dc150b90 0x7f13dc064d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:09.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.717+0000 7f13e46db700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13dc0c2610 con 0x7f13dc0a5790 2023-12-22T10:01:09.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.717+0000 7f13e46db700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13dc0a7ab0 con 0x7f13dc150b90 2023-12-22T10:01:09.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.717+0000 7f13e46db700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13dc065350 con 0x7f13dc1507b0 2023-12-22T10:01:09.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.717+0000 7f13e1c76700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f13dc150b90 0x7f13dc064d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:09.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.721+0000 7f13e2477700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f13dc1507b0 0x7f13dc064890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:09.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.721+0000 7f13e1c76700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f13dc150b90 0x7f13dc064d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50276/0 (socket says 172.21.15.45:50276) 2023-12-22T10:01:09.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.721+0000 7f13e1c76700 1 -- 172.21.15.45:0/1163030999 learned_addr learned my addr 172.21.15.45:0/1163030999 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:09.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.721+0000 7f13e1475700 1 -- 172.21.15.45:0/1163030999 <== mon.1 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2273934134 0 0) 0x7f13dc0c2610 con 0x7f13dc0a5790 2023-12-22T10:01:09.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.721+0000 7f13e1475700 1 -- 172.21.15.45:0/1163030999 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13c80033f0 con 0x7f13dc0a5790 2023-12-22T10:01:09.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.721+0000 7f13e1c76700 1 -- 172.21.15.45:0/1163030999 >> v2:172.21.15.113:3300/0 conn(0x7f13dc1507b0 msgr2=0x7f13dc064890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:09.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.721+0000 7f13e1c76700 1 --2- 172.21.15.45:0/1163030999 >> v2:172.21.15.113:3300/0 conn(0x7f13dc1507b0 0x7f13dc064890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:09.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.721+0000 7f13e1c76700 1 -- 172.21.15.45:0/1163030999 >> v1:172.21.15.113:6789/0 conn(0x7f13dc0a5790 legacy=0x7f13dc0c2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:09.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.721+0000 7f13e1c76700 1 -- 172.21.15.45:0/1163030999 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13dc065630 con 0x7f13dc150b90 2023-12-22T10:01:09.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.721+0000 7f13e1c76700 1 --2- 172.21.15.45:0/1163030999 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13dc150b90 0x7f13dc064d80 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f13dc062fe0 tx=0x7f13cc0090f0).ready entity=mon.0 client_cookie=886ec5fd1f58099f server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:09.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.721+0000 7f13e1475700 1 -- 172.21.15.45:0/1163030999 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13cc00f510 con 0x7f13dc150b90 2023-12-22T10:01:09.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.721+0000 7f13e1475700 1 -- 172.21.15.45:0/1163030999 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13cc00f670 con 0x7f13dc150b90 2023-12-22T10:01:09.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.721+0000 7f13e1475700 1 -- 172.21.15.45:0/1163030999 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13cc00f9f0 con 0x7f13dc150b90 2023-12-22T10:01:09.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.721+0000 7f13e46db700 1 -- 172.21.15.45:0/1163030999 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13dc150b90 msgr2=0x7f13dc064d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:09.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.721+0000 7f13e46db700 1 --2- 172.21.15.45:0/1163030999 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13dc150b90 0x7f13dc064d80 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f13dc062fe0 tx=0x7f13cc0090f0).stop 2023-12-22T10:01:09.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.721+0000 7f13e46db700 1 -- 172.21.15.45:0/1163030999 shutdown_connections 2023-12-22T10:01:09.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.721+0000 7f13e46db700 1 --2- 172.21.15.45:0/1163030999 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13dc150b90 0x7f13dc064d80 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:09.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.721+0000 7f13e46db700 1 --2- 172.21.15.45:0/1163030999 >> v2:172.21.15.113:3300/0 conn(0x7f13dc1507b0 0x7f13dc064890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:09.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.721+0000 7f13e46db700 1 -- 172.21.15.45:0/1163030999 >> 172.21.15.45:0/1163030999 conn(0x7f13dc066a70 msgr2=0x7f13dc066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:09.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.721+0000 7f13e46db700 1 -- 172.21.15.45:0/1163030999 shutdown_connections 2023-12-22T10:01:09.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.721+0000 7f13e46db700 1 -- 172.21.15.45:0/1163030999 wait complete. 2023-12-22T10:01:09.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.725+0000 7f13e46db700 1 Processor -- start 2023-12-22T10:01:09.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.725+0000 7f13e46db700 1 -- start start 2023-12-22T10:01:09.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.725+0000 7f13e46db700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f13dc0a5790 0x7f13dc14f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:09.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.725+0000 7f13e46db700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f13dc1507b0 0x7f13dc1564d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:09.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.725+0000 7f13e46db700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13dc150b90 0x7f13dc1569c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:09.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.725+0000 7f13e46db700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13dc156eb0 con 0x7f13dc150b90 2023-12-22T10:01:09.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.725+0000 7f13e46db700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13dc14fed0 con 0x7f13dc0a5790 2023-12-22T10:01:09.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.725+0000 7f13e46db700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13dc0ab2f0 con 0x7f13dc1507b0 2023-12-22T10:01:09.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.725+0000 7f13e2c78700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13dc150b90 0x7f13dc1569c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:09.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.725+0000 7f13e2c78700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13dc150b90 0x7f13dc1569c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50282/0 (socket says 172.21.15.45:50282) 2023-12-22T10:01:09.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.725+0000 7f13e2c78700 1 -- 172.21.15.45:0/3646661658 learned_addr learned my addr 172.21.15.45:0/3646661658 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:09.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.725+0000 7f13e2477700 1 --2- 172.21.15.45:0/3646661658 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f13dc0a5790 0x7f13dc14f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:09.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.725+0000 7f13e1c76700 1 --2- 172.21.15.45:0/3646661658 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f13dc1507b0 0x7f13dc1564d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:09.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.725+0000 7f13e2c78700 1 -- 172.21.15.45:0/3646661658 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f13dc1507b0 msgr2=0x7f13dc1564d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:09.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.725+0000 7f13e2c78700 1 --2- 172.21.15.45:0/3646661658 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f13dc1507b0 0x7f13dc1564d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:09.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.725+0000 7f13e2c78700 1 -- 172.21.15.45:0/3646661658 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f13dc0a5790 msgr2=0x7f13dc14f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:09.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.725+0000 7f13e2c78700 1 --2- 172.21.15.45:0/3646661658 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f13dc0a5790 0x7f13dc14f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:09.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.725+0000 7f13e2c78700 1 -- 172.21.15.45:0/3646661658 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13cc009370 con 0x7f13dc150b90 2023-12-22T10:01:09.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.729+0000 7f13e2c78700 1 --2- 172.21.15.45:0/3646661658 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13dc150b90 0x7f13dc1569c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f13d400c740 tx=0x7f13d400cb00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:09.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.729+0000 7f13d27fc700 1 -- 172.21.15.45:0/3646661658 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d4010510 con 0x7f13dc150b90 2023-12-22T10:01:09.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.729+0000 7f13d27fc700 1 -- 172.21.15.45:0/3646661658 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13d4010670 con 0x7f13dc150b90 2023-12-22T10:01:09.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.729+0000 7f13d27fc700 1 -- 172.21.15.45:0/3646661658 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d40109f0 con 0x7f13dc150b90 2023-12-22T10:01:09.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.729+0000 7f13e46db700 1 -- 172.21.15.45:0/3646661658 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13dc0aa6e0 con 0x7f13dc150b90 2023-12-22T10:01:09.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.729+0000 7f13e46db700 1 -- 172.21.15.45:0/3646661658 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13dc0aaca0 con 0x7f13dc150b90 2023-12-22T10:01:09.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.729+0000 7f13e46db700 1 -- 172.21.15.45:0/3646661658 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13dc06c070 con 0x7f13dc150b90 2023-12-22T10:01:09.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.729+0000 7f13d27fc700 1 -- 172.21.15.45:0/3646661658 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f13d401b400 con 0x7f13dc150b90 2023-12-22T10:01:09.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.733+0000 7f13d27fc700 1 --2- 172.21.15.45:0/3646661658 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f13c005a540 0x7f13c005ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:09.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.733+0000 7f13d27fc700 1 -- 172.21.15.45:0/3646661658 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f13d4074710 con 0x7f13dc150b90 2023-12-22T10:01:09.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.733+0000 7f13e2477700 1 --2- 172.21.15.45:0/3646661658 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f13c005a540 0x7f13c005ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:09.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.733+0000 7f13e2477700 1 --2- 172.21.15.45:0/3646661658 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f13c005a540 0x7f13c005ca00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f13d8009bc0 tx=0x7f13d8008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:09.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.737+0000 7f13d27fc700 1 -- 172.21.15.45:0/3646661658 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f13d4047e90 con 0x7f13dc150b90 2023-12-22T10:01:09.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.901+0000 7f13e46db700 1 -- 172.21.15.45:0/3646661658 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f13dc156240 con 0x7f13dc150b90 2023-12-22T10:01:09.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.901+0000 7f13d27fc700 1 -- 172.21.15.45:0/3646661658 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f13d404b4b0 con 0x7f13dc150b90 2023-12-22T10:01:09.901 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-22T10:01:09.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.905+0000 7f13e46db700 1 -- 172.21.15.45:0/3646661658 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f13c005a540 msgr2=0x7f13c005ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:09.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.905+0000 7f13e46db700 1 --2- 172.21.15.45:0/3646661658 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f13c005a540 0x7f13c005ca00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f13d8009bc0 tx=0x7f13d8008040).stop 2023-12-22T10:01:09.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.905+0000 7f13e46db700 1 -- 172.21.15.45:0/3646661658 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13dc150b90 msgr2=0x7f13dc1569c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:09.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.905+0000 7f13e46db700 1 --2- 172.21.15.45:0/3646661658 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13dc150b90 0x7f13dc1569c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f13d400c740 tx=0x7f13d400cb00).stop 2023-12-22T10:01:09.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.905+0000 7f13e46db700 1 -- 172.21.15.45:0/3646661658 shutdown_connections 2023-12-22T10:01:09.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.905+0000 7f13e46db700 1 --2- 172.21.15.45:0/3646661658 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13dc150b90 0x7f13dc1569c0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:09.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.905+0000 7f13e46db700 1 --2- 172.21.15.45:0/3646661658 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f13c005a540 0x7f13c005ca00 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:09.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.905+0000 7f13e46db700 1 --2- 172.21.15.45:0/3646661658 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f13dc1507b0 0x7f13dc1564d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:09.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.905+0000 7f13e46db700 1 --2- 172.21.15.45:0/3646661658 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f13dc0a5790 0x7f13dc14f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:09.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.905+0000 7f13e46db700 1 -- 172.21.15.45:0/3646661658 >> 172.21.15.45:0/3646661658 conn(0x7f13dc066a70 msgr2=0x7f13dc0a8e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:09.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.905+0000 7f13e46db700 1 -- 172.21.15.45:0/3646661658 shutdown_connections 2023-12-22T10:01:09.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:09.905+0000 7f13e46db700 1 -- 172.21.15.45:0/3646661658 wait complete. 2023-12-22T10:01:09.926 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-22T10:01:10.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.101+0000 7f41ae039700 1 Processor -- start 2023-12-22T10:01:10.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.101+0000 7f41ae039700 1 -- start start 2023-12-22T10:01:10.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.105+0000 7f41ae039700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f41a80acca0 0x7f41a80ad080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:10.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.105+0000 7f41ae039700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f41a80c9d20 0x7f41a80c97e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:10.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.105+0000 7f41ae039700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41a80c5810 con 0x7f41a80ca230 2023-12-22T10:01:10.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.105+0000 7f41ae039700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41a80c8d90 con 0x7f41a80acca0 2023-12-22T10:01:10.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.105+0000 7f41ae039700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41a80c9350 con 0x7f41a80c9d20 2023-12-22T10:01:10.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.105+0000 7f41ad037700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f41a80acca0 0x7f41a80ad080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:10.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.105+0000 7f41ad037700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f41a80acca0 0x7f41a80ad080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50284/0 (socket says 172.21.15.45:50284) 2023-12-22T10:01:10.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.105+0000 7f41ad037700 1 -- 172.21.15.45:0/3525618552 learned_addr learned my addr 172.21.15.45:0/3525618552 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:10.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.105+0000 7f41ac836700 1 --2- 172.21.15.45:0/3525618552 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f41a80c9d20 0x7f41a80c97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:10.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.105+0000 7f41ad037700 1 -- 172.21.15.45:0/3525618552 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f41a80c9d20 msgr2=0x7f41a80c97e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:10.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.105+0000 7f41ad037700 1 --2- 172.21.15.45:0/3525618552 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f41a80c9d20 0x7f41a80c97e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:10.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.105+0000 7f41ad037700 1 -- 172.21.15.45:0/3525618552 >> v1:172.21.15.113:6789/0 conn(0x7f41a80ca230 legacy=0x7f41a8068ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:10.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.105+0000 7f41ad037700 1 -- 172.21.15.45:0/3525618552 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41a8154070 con 0x7f41a80acca0 2023-12-22T10:01:10.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.105+0000 7f41ad037700 1 --2- 172.21.15.45:0/3525618552 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41a80acca0 0x7f41a80ad080 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f41a4009f20 tx=0x7f41a4009840).ready entity=mon.0 client_cookie=218955c3f8967ab5 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:10.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.105+0000 7f419ffff700 1 -- 172.21.15.45:0/3525618552 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41a400e070 con 0x7f41a80acca0 2023-12-22T10:01:10.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.105+0000 7f419ffff700 1 -- 172.21.15.45:0/3525618552 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41a400b9d0 con 0x7f41a80acca0 2023-12-22T10:01:10.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.105+0000 7f419ffff700 1 -- 172.21.15.45:0/3525618552 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41a400bd50 con 0x7f41a80acca0 2023-12-22T10:01:10.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.109+0000 7f41ae039700 1 -- 172.21.15.45:0/3525618552 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41a80acca0 msgr2=0x7f41a80ad080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:10.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.109+0000 7f41ae039700 1 --2- 172.21.15.45:0/3525618552 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41a80acca0 0x7f41a80ad080 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f41a4009f20 tx=0x7f41a4009840).stop 2023-12-22T10:01:10.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.109+0000 7f41ae039700 1 -- 172.21.15.45:0/3525618552 shutdown_connections 2023-12-22T10:01:10.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.109+0000 7f41ae039700 1 --2- 172.21.15.45:0/3525618552 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f41a80c9d20 0x7f41a80c97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:10.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.109+0000 7f41ae039700 1 --2- 172.21.15.45:0/3525618552 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41a80acca0 0x7f41a80ad080 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:10.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.109+0000 7f41ae039700 1 -- 172.21.15.45:0/3525618552 >> 172.21.15.45:0/3525618552 conn(0x7f41a80674f0 msgr2=0x7f41a80ca820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:10.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.109+0000 7f41ae039700 1 -- 172.21.15.45:0/3525618552 shutdown_connections 2023-12-22T10:01:10.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.109+0000 7f41ae039700 1 -- 172.21.15.45:0/3525618552 wait complete. 2023-12-22T10:01:10.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.109+0000 7f41ae039700 1 Processor -- start 2023-12-22T10:01:10.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.109+0000 7f41ae039700 1 -- start start 2023-12-22T10:01:10.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.113+0000 7f41ae039700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f41a80acca0 0x7f41a8167870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:10.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.113+0000 7f41ae039700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41a80c9d20 0x7f41a8167d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:10.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.113+0000 7f41ae039700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f41a80ca230 0x7f41a80a8820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:10.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.113+0000 7f41ae039700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41a8168250 con 0x7f41a80c9d20 2023-12-22T10:01:10.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.113+0000 7f41ae039700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41a8166120 con 0x7f41a80ca230 2023-12-22T10:01:10.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.113+0000 7f41ae039700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41a8165510 con 0x7f41a80acca0 2023-12-22T10:01:10.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.113+0000 7f41ac836700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41a80c9d20 0x7f41a8167d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:10.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.113+0000 7f41ac836700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41a80c9d20 0x7f41a8167d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50296/0 (socket says 172.21.15.45:50296) 2023-12-22T10:01:10.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.113+0000 7f41ac836700 1 -- 172.21.15.45:0/1356155799 learned_addr learned my addr 172.21.15.45:0/1356155799 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:10.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.113+0000 7f41ad037700 1 --2- 172.21.15.45:0/1356155799 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f41a80acca0 0x7f41a8167870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:10.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.113+0000 7f41ad838700 1 --2- 172.21.15.45:0/1356155799 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f41a80ca230 0x7f41a80a8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:10.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.113+0000 7f41ac836700 1 -- 172.21.15.45:0/1356155799 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f41a80acca0 msgr2=0x7f41a8167870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:10.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.113+0000 7f41ac836700 1 --2- 172.21.15.45:0/1356155799 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f41a80acca0 0x7f41a8167870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:10.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.113+0000 7f41ac836700 1 -- 172.21.15.45:0/1356155799 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f41a80ca230 msgr2=0x7f41a80a8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:10.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.113+0000 7f41ac836700 1 --2- 172.21.15.45:0/1356155799 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f41a80ca230 0x7f41a80a8820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:10.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.113+0000 7f41ac836700 1 -- 172.21.15.45:0/1356155799 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41a4009ae0 con 0x7f41a80c9d20 2023-12-22T10:01:10.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.113+0000 7f41ad838700 1 --2- 172.21.15.45:0/1356155799 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f41a80ca230 0x7f41a80a8820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T10:01:10.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.113+0000 7f41ac836700 1 --2- 172.21.15.45:0/1356155799 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41a80c9d20 0x7f41a8167d60 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7f419800e8d0 tx=0x7f4198009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:10.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.113+0000 7f419d7fa700 1 -- 172.21.15.45:0/1356155799 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f419800c640 con 0x7f41a80c9d20 2023-12-22T10:01:10.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.113+0000 7f419d7fa700 1 -- 172.21.15.45:0/1356155799 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f419800c7a0 con 0x7f41a80c9d20 2023-12-22T10:01:10.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.113+0000 7f41ae039700 1 -- 172.21.15.45:0/1356155799 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41a81657f0 con 0x7f41a80c9d20 2023-12-22T10:01:10.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.113+0000 7f419d7fa700 1 -- 172.21.15.45:0/1356155799 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f419800cb20 con 0x7f41a80c9d20 2023-12-22T10:01:10.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.113+0000 7f41ae039700 1 -- 172.21.15.45:0/1356155799 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41a8165e30 con 0x7f41a80c9d20 2023-12-22T10:01:10.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.117+0000 7f41ae039700 1 -- 172.21.15.45:0/1356155799 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41a8047060 con 0x7f41a80c9d20 2023-12-22T10:01:10.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.117+0000 7f419d7fa700 1 -- 172.21.15.45:0/1356155799 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f419801b400 con 0x7f41a80c9d20 2023-12-22T10:01:10.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.117+0000 7f419d7fa700 1 --2- 172.21.15.45:0/1356155799 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f418c05a540 0x7f418c05ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:10.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.117+0000 7f419d7fa700 1 -- 172.21.15.45:0/1356155799 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f4198074bc0 con 0x7f41a80c9d20 2023-12-22T10:01:10.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.117+0000 7f41ad037700 1 --2- 172.21.15.45:0/1356155799 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f418c05a540 0x7f418c05ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:10.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.121+0000 7f41ad037700 1 --2- 172.21.15.45:0/1356155799 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f418c05a540 0x7f418c05ca00 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f41a400b9a0 tx=0x7f41a4009840).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:10.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.125+0000 7f419d7fa700 1 -- 172.21.15.45:0/1356155799 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f4198048330 con 0x7f41a80c9d20 2023-12-22T10:01:10.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.297+0000 7f41ae039700 1 -- 172.21.15.45:0/1356155799 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f41a80c5a60 con 0x7f41a80c9d20 2023-12-22T10:01:10.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.297+0000 7f419d7fa700 1 -- 172.21.15.45:0/1356155799 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f419804b950 con 0x7f41a80c9d20 2023-12-22T10:01:10.297 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-22T10:01:10.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.305+0000 7f41ae039700 1 -- 172.21.15.45:0/1356155799 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f418c05a540 msgr2=0x7f418c05ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:10.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.305+0000 7f41ae039700 1 --2- 172.21.15.45:0/1356155799 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f418c05a540 0x7f418c05ca00 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f41a400b9a0 tx=0x7f41a4009840).stop 2023-12-22T10:01:10.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.305+0000 7f41ae039700 1 -- 172.21.15.45:0/1356155799 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41a80c9d20 msgr2=0x7f41a8167d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:10.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.305+0000 7f41ae039700 1 --2- 172.21.15.45:0/1356155799 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41a80c9d20 0x7f41a8167d60 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7f419800e8d0 tx=0x7f4198009060).stop 2023-12-22T10:01:10.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.305+0000 7f41ae039700 1 -- 172.21.15.45:0/1356155799 shutdown_connections 2023-12-22T10:01:10.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.305+0000 7f41ae039700 1 --2- 172.21.15.45:0/1356155799 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f41a80ca230 0x7f41a80a8820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:10.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.305+0000 7f41ae039700 1 --2- 172.21.15.45:0/1356155799 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41a80c9d20 0x7f41a8167d60 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:10.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.305+0000 7f41ae039700 1 --2- 172.21.15.45:0/1356155799 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f418c05a540 0x7f418c05ca00 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:10.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.305+0000 7f41ae039700 1 --2- 172.21.15.45:0/1356155799 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f41a80acca0 0x7f41a8167870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:10.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.305+0000 7f41ae039700 1 -- 172.21.15.45:0/1356155799 >> 172.21.15.45:0/1356155799 conn(0x7f41a80674f0 msgr2=0x7f41a80ac210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:10.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.305+0000 7f41ae039700 1 -- 172.21.15.45:0/1356155799 shutdown_connections 2023-12-22T10:01:10.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.305+0000 7f41ae039700 1 -- 172.21.15.45:0/1356155799 wait complete. 2023-12-22T10:01:10.323 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T10:01:10.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.489+0000 7f5166769700 1 Processor -- start 2023-12-22T10:01:10.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.489+0000 7f5166769700 1 -- start start 2023-12-22T10:01:10.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.493+0000 7f5166769700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f5160151e80 0x7f51600a6a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:10.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.493+0000 7f5166769700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f51600bd7f0 0x7f51600622c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:10.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.493+0000 7f5166769700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5160153140 con 0x7f51600bc790 2023-12-22T10:01:10.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.493+0000 7f5166769700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5160152260 con 0x7f51600bd7f0 2023-12-22T10:01:10.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.493+0000 7f5166769700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5160152530 con 0x7f5160151e80 2023-12-22T10:01:10.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.493+0000 7f51577fe700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f51600bc790 0x7f51600bd0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:55882/0 (socket says 172.21.15.45:55882) 2023-12-22T10:01:10.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.493+0000 7f51577fe700 1 -- 172.21.15.45:0/117095243 learned_addr learned my addr 172.21.15.45:0/117095243 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:01:10.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.493+0000 7f5164d06700 1 --2- 172.21.15.45:0/117095243 >> v2:172.21.15.113:3300/0 conn(0x7f51600bd7f0 0x7f51600622c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:10.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.493+0000 7f515ffff700 1 --2- 172.21.15.45:0/117095243 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f5160151e80 0x7f51600a6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:10.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.493+0000 7f515f7fe700 1 -- 172.21.15.45:0/117095243 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3899502588 0 0) 0x7f5160153140 con 0x7f51600bc790 2023-12-22T10:01:10.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.493+0000 7f515f7fe700 1 -- 172.21.15.45:0/117095243 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f514c0033f0 con 0x7f51600bc790 2023-12-22T10:01:10.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.493+0000 7f515f7fe700 1 -- 172.21.15.45:0/117095243 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2886451777 0 0) 0x7f514c0033f0 con 0x7f51600bc790 2023-12-22T10:01:10.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.493+0000 7f515f7fe700 1 -- 172.21.15.45:0/117095243 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f5160151e80 msgr2=0x7f51600a6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:10.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.493+0000 7f515f7fe700 1 --2- 172.21.15.45:0/117095243 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f5160151e80 0x7f51600a6a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:10.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.493+0000 7f515f7fe700 1 -- 172.21.15.45:0/117095243 >> v2:172.21.15.113:3300/0 conn(0x7f51600bd7f0 msgr2=0x7f51600622c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:10.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.493+0000 7f515f7fe700 1 --2- 172.21.15.45:0/117095243 >> v2:172.21.15.113:3300/0 conn(0x7f51600bd7f0 0x7f51600622c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:10.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.493+0000 7f515f7fe700 1 -- 172.21.15.45:0/117095243 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5160152810 con 0x7f51600bc790 2023-12-22T10:01:10.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.493+0000 7f515f7fe700 1 -- 172.21.15.45:0/117095243 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2619163070 0 0) 0x7f5148001470 con 0x7f51600bc790 2023-12-22T10:01:10.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.493+0000 7f5164d06700 1 --2- 172.21.15.45:0/117095243 >> v2:172.21.15.113:3300/0 conn(0x7f51600bd7f0 0x7f51600622c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-12-22T10:01:10.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.493+0000 7f515f7fe700 1 -- 172.21.15.45:0/117095243 >> v1:172.21.15.45:6789/0 conn(0x7f51600bc790 legacy=0x7f51600bd0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:10.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.493+0000 7f515f7fe700 1 --2- 172.21.15.45:0/117095243 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f514c0038e0 0x7f514c003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:10.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.493+0000 7f515f7fe700 1 --2- 172.21.15.45:0/117095243 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f514c004690 0x7f514c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:10.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.493+0000 7f515f7fe700 1 --2- 172.21.15.45:0/117095243 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f5160151e80 0x7f514c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:10.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.493+0000 7f515f7fe700 1 -- 172.21.15.45:0/117095243 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5160152260 con 0x7f514c004690 2023-12-22T10:01:10.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.493+0000 7f515f7fe700 1 -- 172.21.15.45:0/117095243 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5160152530 con 0x7f514c0038e0 2023-12-22T10:01:10.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.493+0000 7f515f7fe700 1 -- 172.21.15.45:0/117095243 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f514c00b8e0 con 0x7f5160151e80 2023-12-22T10:01:10.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.493+0000 7f51577fe700 1 --2- 172.21.15.45:0/117095243 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f514c004690 0x7f514c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:10.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.497+0000 7f515ffff700 1 --2- 172.21.15.45:0/117095243 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f514c0038e0 0x7f514c003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:10.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.497+0000 7f5164d06700 1 --2- 172.21.15.45:0/117095243 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f5160151e80 0x7f514c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:10.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.497+0000 7f51577fe700 1 -- 172.21.15.45:0/117095243 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f5160151e80 msgr2=0x7f514c005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:10.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.497+0000 7f51577fe700 1 --2- 172.21.15.45:0/117095243 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f5160151e80 0x7f514c005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:10.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.497+0000 7f51577fe700 1 -- 172.21.15.45:0/117095243 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f514c0038e0 msgr2=0x7f514c003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:10.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.497+0000 7f51577fe700 1 --2- 172.21.15.45:0/117095243 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f514c0038e0 0x7f514c003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:10.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.497+0000 7f51577fe700 1 -- 172.21.15.45:0/117095243 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f514c0033f0 con 0x7f514c004690 2023-12-22T10:01:10.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.497+0000 7f5164d06700 1 --2- 172.21.15.45:0/117095243 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f5160151e80 0x7f514c005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T10:01:10.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.497+0000 7f51577fe700 1 --2- 172.21.15.45:0/117095243 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f514c004690 0x7f514c004b10 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f514800c1e0 tx=0x7f5148001e90).ready entity=mon.0 client_cookie=a2c1eaadc72752ca server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:10.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.497+0000 7f515f7fe700 1 -- 172.21.15.45:0/117095243 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5148007a60 con 0x7f514c004690 2023-12-22T10:01:10.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.497+0000 7f515f7fe700 1 -- 172.21.15.45:0/117095243 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f514800cab0 con 0x7f514c004690 2023-12-22T10:01:10.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.497+0000 7f515f7fe700 1 -- 172.21.15.45:0/117095243 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f514800ce50 con 0x7f514c004690 2023-12-22T10:01:10.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.497+0000 7f5166769700 1 -- 172.21.15.45:0/117095243 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f514c004690 msgr2=0x7f514c004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:10.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.497+0000 7f5166769700 1 --2- 172.21.15.45:0/117095243 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f514c004690 0x7f514c004b10 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f514800c1e0 tx=0x7f5148001e90).stop 2023-12-22T10:01:10.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.497+0000 7f5164d06700 1 -- 172.21.15.45:0/117095243 reap_dead start 2023-12-22T10:01:10.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.497+0000 7f5166769700 1 -- 172.21.15.45:0/117095243 shutdown_connections 2023-12-22T10:01:10.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.497+0000 7f5166769700 1 -- 172.21.15.45:0/117095243 >> 172.21.15.45:0/117095243 conn(0x7f5160066480 msgr2=0x7f5160067b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:10.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.497+0000 7f5166769700 1 -- 172.21.15.45:0/117095243 shutdown_connections 2023-12-22T10:01:10.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.497+0000 7f5166769700 1 -- 172.21.15.45:0/117095243 wait complete. 2023-12-22T10:01:10.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.501+0000 7f5166769700 1 Processor -- start 2023-12-22T10:01:10.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.501+0000 7f5166769700 1 -- start start 2023-12-22T10:01:10.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.501+0000 7f5166769700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f514c004690 0x7f51600ad190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:10.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.501+0000 7f5166769700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f51600abb40 0x7f516014afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:10.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.501+0000 7f5166769700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f516014b4a0 0x7f5160162220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:10.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.501+0000 7f5166769700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51600ab6b0 con 0x7f516014b4a0 2023-12-22T10:01:10.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.501+0000 7f5166769700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51600aaaa0 con 0x7f514c004690 2023-12-22T10:01:10.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.501+0000 7f5166769700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51600aad80 con 0x7f51600abb40 2023-12-22T10:01:10.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.501+0000 7f5164d06700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f516014b4a0 0x7f5160162220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:10.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.501+0000 7f5164d06700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f516014b4a0 0x7f5160162220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50324/0 (socket says 172.21.15.45:50324) 2023-12-22T10:01:10.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.501+0000 7f515ffff700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f514c004690 0x7f51600ad190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:10.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.501+0000 7f5164d06700 1 -- 172.21.15.45:0/2798837053 learned_addr learned my addr 172.21.15.45:0/2798837053 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:10.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.501+0000 7f51577fe700 1 --2- 172.21.15.45:0/2798837053 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f51600abb40 0x7f516014afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:10.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.505+0000 7f5164d06700 1 -- 172.21.15.45:0/2798837053 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f51600abb40 msgr2=0x7f516014afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:10.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.505+0000 7f5164d06700 1 --2- 172.21.15.45:0/2798837053 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f51600abb40 0x7f516014afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:10.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.505+0000 7f5164d06700 1 -- 172.21.15.45:0/2798837053 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f514c004690 msgr2=0x7f51600ad190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:10.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.505+0000 7f5164d06700 1 --2- 172.21.15.45:0/2798837053 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f514c004690 0x7f51600ad190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:10.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.505+0000 7f5164d06700 1 -- 172.21.15.45:0/2798837053 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51600ab060 con 0x7f516014b4a0 2023-12-22T10:01:10.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.505+0000 7f5164d06700 1 --2- 172.21.15.45:0/2798837053 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f516014b4a0 0x7f5160162220 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f51600a78e0 tx=0x7f5158008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:10.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.505+0000 7f515cff9700 1 -- 172.21.15.45:0/2798837053 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5158011e60 con 0x7f516014b4a0 2023-12-22T10:01:10.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.505+0000 7f515cff9700 1 -- 172.21.15.45:0/2798837053 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5158013550 con 0x7f516014b4a0 2023-12-22T10:01:10.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.505+0000 7f5166769700 1 -- 172.21.15.45:0/2798837053 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51600ab340 con 0x7f516014b4a0 2023-12-22T10:01:10.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.505+0000 7f515cff9700 1 -- 172.21.15.45:0/2798837053 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51580138d0 con 0x7f516014b4a0 2023-12-22T10:01:10.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.505+0000 7f5166769700 1 -- 172.21.15.45:0/2798837053 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51600ad680 con 0x7f516014b4a0 2023-12-22T10:01:10.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.505+0000 7f5166769700 1 -- 172.21.15.45:0/2798837053 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51600ab4d0 con 0x7f516014b4a0 2023-12-22T10:01:10.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.509+0000 7f515cff9700 1 -- 172.21.15.45:0/2798837053 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f5158013d00 con 0x7f516014b4a0 2023-12-22T10:01:10.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.509+0000 7f515cff9700 1 --2- 172.21.15.45:0/2798837053 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f514005a510 0x7f514005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:10.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.509+0000 7f515cff9700 1 -- 172.21.15.45:0/2798837053 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f5158074450 con 0x7f516014b4a0 2023-12-22T10:01:10.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.509+0000 7f515ffff700 1 --2- 172.21.15.45:0/2798837053 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f514005a510 0x7f514005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:10.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.509+0000 7f515ffff700 1 --2- 172.21.15.45:0/2798837053 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f514005a510 0x7f514005c9d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f51500094d0 tx=0x7f515000b040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:10.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.517+0000 7f515cff9700 1 -- 172.21.15.45:0/2798837053 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f51600ab4d0 con 0x7f516014b4a0 2023-12-22T10:01:10.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.681+0000 7f5166769700 1 -- 172.21.15.45:0/2798837053 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f51600ab7f0 con 0x7f516014b4a0 2023-12-22T10:01:10.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.681+0000 7f515cff9700 1 -- 172.21.15.45:0/2798837053 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16928 (secure 0 0 0) 0x7f5158047c20 con 0x7f516014b4a0 2023-12-22T10:01:10.680 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:01:10.680 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":21,"fsid":"98b0837e-5e68-4c8f-a1a0-e9424baaad8f","created":"2023-12-22T10:00:15.010174+0000","modified":"2023-12-22T10:00:34.529651+0000","last_up_change":"2023-12-22T10:00:24.980513+0000","last_in_change":"2023-12-22T10:00:17.887172+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-12-22T10:00:25.069641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-12-22T10:00:26.906399+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-12-22T10:00:31.621311+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-12-22T10:00:32.538053+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e19943a0-1c6b-47df-b6bb-383472077890","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":33777},{"type":"v1","addr":"172.21.15.45:6819","nonce":33777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":33777},{"type":"v1","addr":"172.21.15.45:6822","nonce":33777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":33777},{"type":"v1","addr":"172.21.15.45:6830","nonce":33777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":33777},{"type":"v1","addr":"172.21.15.45:6826","nonce":33777}]},"public_addr":"172.21.15.45:6819/33777","cluster_addr":"172.21.15.45:6822/33777","heartbeat_back_addr":"172.21.15.45:6830/33777","heartbeat_front_addr":"172.21.15.45:6826/33777","state":["exists","up"]},{"osd":1,"uuid":"69670f34-f082-45a7-8f67-e962acc136e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":33775},{"type":"v1","addr":"172.21.15.45:6809","nonce":33775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":33775},{"type":"v1","addr":"172.21.15.45:6811","nonce":33775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":33775},{"type":"v1","addr":"172.21.15.45:6815","nonce":33775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":33775},{"type":"v1","addr":"172.21.15.45:6813","nonce":33775}]},"public_addr":"172.21.15.45:6809/33775","cluster_addr":"172.21.15.45:6811/33775","heartbeat_back_addr":"172.21.15.45:6815/33775","heartbeat_front_addr":"172.21.15.45:6813/33775","state":["exists","up"]},{"osd":2,"uuid":"d909d49b-82b8-401b-9947-e49dd167bb95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":33776},{"type":"v1","addr":"172.21.15.45:6801","nonce":33776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":33776},{"type":"v1","addr":"172.21.15.45:6803","nonce":33776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":33776},{"type":"v1","addr":"172.21.15.45:6807","nonce":33776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":33776},{"type":"v1","addr":"172.21.15.45:6805","nonce":33776}]},"public_addr":"172.21.15.45:6801/33776","cluster_addr":"172.21.15.45:6803/33776","heartbeat_back_addr":"172.21.15.45:6807/33776","heartbeat_front_addr":"172.21.15.45:6805/33776","state":["exists","up"]},{"osd":3,"uuid":"db104ca9-3a94-4d39-a2be-bd06db888095","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":33782},{"type":"v1","addr":"172.21.15.45:6817","nonce":33782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":33782},{"type":"v1","addr":"172.21.15.45:6823","nonce":33782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":33782},{"type":"v1","addr":"172.21.15.45:6831","nonce":33782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":33782},{"type":"v1","addr":"172.21.15.45:6827","nonce":33782}]},"public_addr":"172.21.15.45:6817/33782","cluster_addr":"172.21.15.45:6823/33782","heartbeat_back_addr":"172.21.15.45:6831/33782","heartbeat_front_addr":"172.21.15.45:6827/33782","state":["exists","up"]},{"osd":4,"uuid":"9f4eaff4-e433-4479-a0d1-ee7a33375ca6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":34099},{"type":"v1","addr":"172.21.15.113:6811","nonce":34099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":34099},{"type":"v1","addr":"172.21.15.113:6815","nonce":34099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":34099},{"type":"v1","addr":"172.21.15.113:6823","nonce":34099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6816","nonce":34099},{"type":"v1","addr":"172.21.15.113:6818","nonce":34099}]},"public_addr":"172.21.15.113:6811/34099","cluster_addr":"172.21.15.113:6815/34099","heartbeat_back_addr":"172.21.15.113:6823/34099","heartbeat_front_addr":"172.21.15.113:6818/34099","state":["exists","up"]},{"osd":5,"uuid":"1efc5591-180b-43af-8611-0068aadc5aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":34100},{"type":"v1","addr":"172.21.15.113:6801","nonce":34100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":34100},{"type":"v1","addr":"172.21.15.113:6803","nonce":34100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":34100},{"type":"v1","addr":"172.21.15.113:6807","nonce":34100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":34100},{"type":"v1","addr":"172.21.15.113:6805","nonce":34100}]},"public_addr":"172.21.15.113:6801/34100","cluster_addr":"172.21.15.113:6803/34100","heartbeat_back_addr":"172.21.15.113:6807/34100","heartbeat_front_addr":"172.21.15.113:6805/34100","state":["exists","up"]},{"osd":6,"uuid":"6c89d9d8-c153-4a48-afa9-97e4c403f1ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":34101},{"type":"v1","addr":"172.21.15.113:6810","nonce":34101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6812","nonce":34101},{"type":"v1","addr":"172.21.15.113:6814","nonce":34101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6822","nonce":34101},{"type":"v1","addr":"172.21.15.113:6824","nonce":34101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":34101},{"type":"v1","addr":"172.21.15.113:6819","nonce":34101}]},"public_addr":"172.21.15.113:6810/34101","cluster_addr":"172.21.15.113:6814/34101","heartbeat_back_addr":"172.21.15.113:6824/34101","heartbeat_front_addr":"172.21.15.113:6819/34101","state":["exists","up"]},{"osd":7,"uuid":"1855e70c-23f6-4c08-ad7f-774c2148235b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6821","nonce":34102},{"type":"v1","addr":"172.21.15.113:6825","nonce":34102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":34102},{"type":"v1","addr":"172.21.15.113:6827","nonce":34102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":34102},{"type":"v1","addr":"172.21.15.113:6831","nonce":34102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6828","nonce":34102},{"type":"v1","addr":"172.21.15.113:6829","nonce":34102}]},"public_addr":"172.21.15.113:6825/34102","cluster_addr":"172.21.15.113:6827/34102","heartbeat_back_addr":"172.21.15.113:6831/34102","heartbeat_front_addr":"172.21.15.113:6829/34102","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.812672+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.825045+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.700105+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.856563+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.954683+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.883234+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.883994+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.821686+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T10:01:10.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.685+0000 7f5166769700 1 -- 172.21.15.45:0/2798837053 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f514005a510 msgr2=0x7f514005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:10.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.685+0000 7f5166769700 1 --2- 172.21.15.45:0/2798837053 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f514005a510 0x7f514005c9d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f51500094d0 tx=0x7f515000b040).stop 2023-12-22T10:01:10.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.685+0000 7f5166769700 1 -- 172.21.15.45:0/2798837053 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f516014b4a0 msgr2=0x7f5160162220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:10.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.685+0000 7f5166769700 1 --2- 172.21.15.45:0/2798837053 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f516014b4a0 0x7f5160162220 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f51600a78e0 tx=0x7f5158008040).stop 2023-12-22T10:01:10.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.685+0000 7f5166769700 1 -- 172.21.15.45:0/2798837053 shutdown_connections 2023-12-22T10:01:10.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.685+0000 7f5166769700 1 --2- 172.21.15.45:0/2798837053 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f516014b4a0 0x7f5160162220 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:10.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.685+0000 7f5166769700 1 --2- 172.21.15.45:0/2798837053 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f514005a510 0x7f514005c9d0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:10.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.685+0000 7f5166769700 1 --2- 172.21.15.45:0/2798837053 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f51600abb40 0x7f516014afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:10.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.685+0000 7f5166769700 1 --2- 172.21.15.45:0/2798837053 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f514c004690 0x7f51600ad190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:10.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.685+0000 7f5166769700 1 -- 172.21.15.45:0/2798837053 >> 172.21.15.45:0/2798837053 conn(0x7f5160066480 msgr2=0x7f516014d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:10.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.685+0000 7f5166769700 1 -- 172.21.15.45:0/2798837053 shutdown_connections 2023-12-22T10:01:10.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.685+0000 7f5166769700 1 -- 172.21.15.45:0/2798837053 wait complete. 2023-12-22T10:01:10.704 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-12-22T10:00:25.069641+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-12-22T10:00:26.906399+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-22T10:00:31.621311+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-12-22T10:00:32.538053+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-22T10:01:10.704 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-12-22T10:01:10.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.885+0000 7f1e4359e700 1 Processor -- start 2023-12-22T10:01:10.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.885+0000 7f1e4359e700 1 -- start start 2023-12-22T10:01:10.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.889+0000 7f1e4359e700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1e440acc10 0x7f1e440bfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:10.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.889+0000 7f1e4359e700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1e44067180 0x7f1e440c6c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:10.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.889+0000 7f1e4359e700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e440ad450 con 0x7f1e440acff0 2023-12-22T10:01:10.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.889+0000 7f1e4359e700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e440c7110 con 0x7f1e440acc10 2023-12-22T10:01:10.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.889+0000 7f1e4359e700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e440aa870 con 0x7f1e44067180 2023-12-22T10:01:10.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.889+0000 7f1e4259c700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1e440acc10 0x7f1e440bfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:10.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.889+0000 7f1e42d9d700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1e44067180 0x7f1e440c6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:10.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.889+0000 7f1e42d9d700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1e44067180 0x7f1e440c6c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.113:3301/0 says I am v2:172.21.15.45:58264/0 (socket says 172.21.15.45:58264) 2023-12-22T10:01:10.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.889+0000 7f1e42d9d700 1 -- 172.21.15.45:0/3151659703 learned_addr learned my addr 172.21.15.45:0/3151659703 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:10.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.889+0000 7f1e42d9d700 1 -- 172.21.15.45:0/3151659703 >> v2:172.21.15.113:3300/0 conn(0x7f1e440acc10 msgr2=0x7f1e440bfcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:10.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.889+0000 7f1e42d9d700 1 --2- 172.21.15.45:0/3151659703 >> v2:172.21.15.113:3300/0 conn(0x7f1e440acc10 0x7f1e440bfcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:10.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.889+0000 7f1e42d9d700 1 -- 172.21.15.45:0/3151659703 >> v1:172.21.15.113:6789/0 conn(0x7f1e440acff0 legacy=0x7f1e44066a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:10.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.889+0000 7f1e42d9d700 1 -- 172.21.15.45:0/3151659703 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e440c0320 con 0x7f1e44067180 2023-12-22T10:01:10.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.889+0000 7f1e42d9d700 1 --2- 172.21.15.45:0/3151659703 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1e44067180 0x7f1e440c6c20 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f1e3c009f20 tx=0x7f1e3c009840).ready entity=mon.2 client_cookie=62f06c962111d317 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:10.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.893+0000 7f1e4159a700 1 -- 172.21.15.45:0/3151659703 <== mon.2 v2:172.21.15.113:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e3c00e070 con 0x7f1e44067180 2023-12-22T10:01:10.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.893+0000 7f1e4159a700 1 -- 172.21.15.45:0/3151659703 <== mon.2 v2:172.21.15.113:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e3c00b9d0 con 0x7f1e44067180 2023-12-22T10:01:10.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.893+0000 7f1e4159a700 1 -- 172.21.15.45:0/3151659703 <== mon.2 v2:172.21.15.113:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e3c00bd50 con 0x7f1e44067180 2023-12-22T10:01:10.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.893+0000 7f1e4359e700 1 -- 172.21.15.45:0/3151659703 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1e44067180 msgr2=0x7f1e440c6c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:10.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.893+0000 7f1e4359e700 1 --2- 172.21.15.45:0/3151659703 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1e44067180 0x7f1e440c6c20 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f1e3c009f20 tx=0x7f1e3c009840).stop 2023-12-22T10:01:10.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.893+0000 7f1e4359e700 1 -- 172.21.15.45:0/3151659703 shutdown_connections 2023-12-22T10:01:10.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.893+0000 7f1e4359e700 1 --2- 172.21.15.45:0/3151659703 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1e44067180 0x7f1e440c6c20 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:10.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.893+0000 7f1e4359e700 1 --2- 172.21.15.45:0/3151659703 >> v2:172.21.15.113:3300/0 conn(0x7f1e440acc10 0x7f1e440bfcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:10.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.893+0000 7f1e4359e700 1 -- 172.21.15.45:0/3151659703 >> 172.21.15.45:0/3151659703 conn(0x7f1e440cb330 msgr2=0x7f1e440c7300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:10.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.893+0000 7f1e4359e700 1 -- 172.21.15.45:0/3151659703 shutdown_connections 2023-12-22T10:01:10.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.893+0000 7f1e4359e700 1 -- 172.21.15.45:0/3151659703 wait complete. 2023-12-22T10:01:10.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.897+0000 7f1e4359e700 1 Processor -- start 2023-12-22T10:01:10.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.897+0000 7f1e4359e700 1 -- start start 2023-12-22T10:01:10.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.897+0000 7f1e4359e700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1e44067180 0x7f1e4414d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:10.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.897+0000 7f1e4359e700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1e440acc10 0x7f1e44158410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:10.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.897+0000 7f1e4359e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1e440acff0 0x7f1e44158900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:10.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.897+0000 7f1e4359e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e44158df0 con 0x7f1e440acff0 2023-12-22T10:01:10.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.897+0000 7f1e4359e700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e4414fcb0 con 0x7f1e44067180 2023-12-22T10:01:10.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.897+0000 7f1e4359e700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e4414ee00 con 0x7f1e440acc10 2023-12-22T10:01:10.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.897+0000 7f1e42d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1e440acff0 0x7f1e44158900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:10.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.897+0000 7f1e4259c700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1e44067180 0x7f1e4414d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:10.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.897+0000 7f1e4259c700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1e44067180 0x7f1e4414d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.45:39320/0 (socket says 172.21.15.45:39320) 2023-12-22T10:01:10.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.897+0000 7f1e4259c700 1 -- 172.21.15.45:0/2942327741 learned_addr learned my addr 172.21.15.45:0/2942327741 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:10.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.897+0000 7f1e41d9b700 1 --2- 172.21.15.45:0/2942327741 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1e440acc10 0x7f1e44158410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:10.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.901+0000 7f1e4259c700 1 -- 172.21.15.45:0/2942327741 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1e440acc10 msgr2=0x7f1e44158410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:10.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.901+0000 7f1e4259c700 1 --2- 172.21.15.45:0/2942327741 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1e440acc10 0x7f1e44158410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:10.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.901+0000 7f1e4259c700 1 -- 172.21.15.45:0/2942327741 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1e440acff0 msgr2=0x7f1e44158900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:10.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.901+0000 7f1e4259c700 1 --2- 172.21.15.45:0/2942327741 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1e440acff0 0x7f1e44158900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:10.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.901+0000 7f1e4259c700 1 -- 172.21.15.45:0/2942327741 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e3c009ae0 con 0x7f1e44067180 2023-12-22T10:01:10.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.901+0000 7f1e4259c700 1 --2- 172.21.15.45:0/2942327741 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1e44067180 0x7f1e4414d270 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f1e3400e930 tx=0x7f1e34009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:10.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.901+0000 7f1e327fc700 1 -- 172.21.15.45:0/2942327741 <== mon.1 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e3400c670 con 0x7f1e44067180 2023-12-22T10:01:10.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.901+0000 7f1e327fc700 1 -- 172.21.15.45:0/2942327741 <== mon.1 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e3400c7d0 con 0x7f1e44067180 2023-12-22T10:01:10.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.901+0000 7f1e327fc700 1 -- 172.21.15.45:0/2942327741 <== mon.1 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e3400cb50 con 0x7f1e44067180 2023-12-22T10:01:10.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.901+0000 7f1e4359e700 1 -- 172.21.15.45:0/2942327741 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e4414f0a0 con 0x7f1e44067180 2023-12-22T10:01:10.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.901+0000 7f1e4359e700 1 -- 172.21.15.45:0/2942327741 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e4414f660 con 0x7f1e44067180 2023-12-22T10:01:10.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.901+0000 7f1e4359e700 1 -- 172.21.15.45:0/2942327741 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e44047060 con 0x7f1e44067180 2023-12-22T10:01:10.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.905+0000 7f1e327fc700 1 -- 172.21.15.45:0/2942327741 <== mon.1 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f1e3401b400 con 0x7f1e44067180 2023-12-22T10:01:10.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.905+0000 7f1e327fc700 1 --2- 172.21.15.45:0/2942327741 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f1e2405a510 0x7f1e2405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:10.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.905+0000 7f1e327fc700 1 -- 172.21.15.45:0/2942327741 <== mon.1 v2:172.21.15.113:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f1e34074d40 con 0x7f1e44067180 2023-12-22T10:01:10.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.905+0000 7f1e41d9b700 1 --2- 172.21.15.45:0/2942327741 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f1e2405a510 0x7f1e2405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:10.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.909+0000 7f1e41d9b700 1 --2- 172.21.15.45:0/2942327741 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f1e2405a510 0x7f1e2405c9d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f1e44154710 tx=0x7f1e38009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:10.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:10.917+0000 7f1e327fc700 1 -- 172.21.15.45:0/2942327741 <== mon.1 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f1e34048400 con 0x7f1e44067180 2023-12-22T10:01:11.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.085+0000 7f1e4359e700 1 -- 172.21.15.45:0/2942327741 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f1e440aab10 con 0x7f1e44067180 2023-12-22T10:01:11.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.089+0000 7f1e327fc700 1 -- 172.21.15.45:0/2942327741 <== mon.1 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v21) v1 ==== 110+0+10 (secure 0 0 0) 0x7f1e3404ba20 con 0x7f1e44067180 2023-12-22T10:01:11.086 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-12-22T10:01:11.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.093+0000 7f1e4359e700 1 -- 172.21.15.45:0/2942327741 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f1e2405a510 msgr2=0x7f1e2405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:11.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.093+0000 7f1e4359e700 1 --2- 172.21.15.45:0/2942327741 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f1e2405a510 0x7f1e2405c9d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f1e44154710 tx=0x7f1e38009040).stop 2023-12-22T10:01:11.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.093+0000 7f1e4359e700 1 -- 172.21.15.45:0/2942327741 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1e44067180 msgr2=0x7f1e4414d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:11.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.093+0000 7f1e4359e700 1 --2- 172.21.15.45:0/2942327741 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1e44067180 0x7f1e4414d270 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f1e3400e930 tx=0x7f1e34009060).stop 2023-12-22T10:01:11.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.093+0000 7f1e4359e700 1 -- 172.21.15.45:0/2942327741 shutdown_connections 2023-12-22T10:01:11.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.093+0000 7f1e4359e700 1 --2- 172.21.15.45:0/2942327741 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1e440acff0 0x7f1e44158900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:11.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.093+0000 7f1e4359e700 1 --2- 172.21.15.45:0/2942327741 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f1e2405a510 0x7f1e2405c9d0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:11.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.093+0000 7f1e4359e700 1 --2- 172.21.15.45:0/2942327741 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1e440acc10 0x7f1e44158410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:11.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.093+0000 7f1e4359e700 1 --2- 172.21.15.45:0/2942327741 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1e44067180 0x7f1e4414d270 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:11.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.093+0000 7f1e4359e700 1 -- 172.21.15.45:0/2942327741 >> 172.21.15.45:0/2942327741 conn(0x7f1e440cb330 msgr2=0x7f1e44159250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:11.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.093+0000 7f1e4359e700 1 -- 172.21.15.45:0/2942327741 shutdown_connections 2023-12-22T10:01:11.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.093+0000 7f1e4359e700 1 -- 172.21.15.45:0/2942327741 wait complete. 2023-12-22T10:01:11.114 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-12-22T10:01:11.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.277+0000 7f3a458db700 1 Processor -- start 2023-12-22T10:01:11.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.277+0000 7f3a458db700 1 -- start start 2023-12-22T10:01:11.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.281+0000 7f3a458db700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3a40153d80 0x7f3a40154160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:11.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.281+0000 7f3a458db700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f3a400c3ee0 0x7f3a400bbfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:11.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.281+0000 7f3a458db700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a40065080 con 0x7f3a40067f50 2023-12-22T10:01:11.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.281+0000 7f3a458db700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a40067dc0 con 0x7f3a40153d80 2023-12-22T10:01:11.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.281+0000 7f3a458db700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a40068380 con 0x7f3a400c3ee0 2023-12-22T10:01:11.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.281+0000 7f3a3effd700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3a40153d80 0x7f3a40154160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:11.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.281+0000 7f3a3effd700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3a40153d80 0x7f3a40154160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50328/0 (socket says 172.21.15.45:50328) 2023-12-22T10:01:11.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.281+0000 7f3a3effd700 1 -- 172.21.15.45:0/3223489492 learned_addr learned my addr 172.21.15.45:0/3223489492 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:11.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.281+0000 7f3a3e7fc700 1 --2- 172.21.15.45:0/3223489492 >> v2:172.21.15.113:3300/0 conn(0x7f3a400c3ee0 0x7f3a400bbfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:11.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.281+0000 7f3a3effd700 1 -- 172.21.15.45:0/3223489492 >> v2:172.21.15.113:3300/0 conn(0x7f3a400c3ee0 msgr2=0x7f3a400bbfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:11.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.281+0000 7f3a3effd700 1 --2- 172.21.15.45:0/3223489492 >> v2:172.21.15.113:3300/0 conn(0x7f3a400c3ee0 0x7f3a400bbfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:11.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.281+0000 7f3a3effd700 1 -- 172.21.15.45:0/3223489492 >> v1:172.21.15.113:6789/0 conn(0x7f3a40067f50 legacy=0x7f3a400c1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:11.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.281+0000 7f3a3effd700 1 -- 172.21.15.45:0/3223489492 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a40067520 con 0x7f3a40153d80 2023-12-22T10:01:11.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.281+0000 7f3a3effd700 1 --2- 172.21.15.45:0/3223489492 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a40153d80 0x7f3a40154160 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f3a400c1830 tx=0x7f3a300090f0).ready entity=mon.0 client_cookie=69b8c9281e5b5240 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:11.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.281+0000 7f3a3dffb700 1 -- 172.21.15.45:0/3223489492 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a3000b600 con 0x7f3a40153d80 2023-12-22T10:01:11.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.281+0000 7f3a3dffb700 1 -- 172.21.15.45:0/3223489492 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a3000b760 con 0x7f3a40153d80 2023-12-22T10:01:11.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.281+0000 7f3a3dffb700 1 -- 172.21.15.45:0/3223489492 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a3000bae0 con 0x7f3a40153d80 2023-12-22T10:01:11.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.285+0000 7f3a458db700 1 -- 172.21.15.45:0/3223489492 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a40153d80 msgr2=0x7f3a40154160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:11.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.285+0000 7f3a458db700 1 --2- 172.21.15.45:0/3223489492 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a40153d80 0x7f3a40154160 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f3a400c1830 tx=0x7f3a300090f0).stop 2023-12-22T10:01:11.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.285+0000 7f3a458db700 1 -- 172.21.15.45:0/3223489492 shutdown_connections 2023-12-22T10:01:11.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.285+0000 7f3a458db700 1 --2- 172.21.15.45:0/3223489492 >> v2:172.21.15.113:3300/0 conn(0x7f3a400c3ee0 0x7f3a400bbfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:11.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.285+0000 7f3a458db700 1 --2- 172.21.15.45:0/3223489492 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a40153d80 0x7f3a40154160 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:11.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.285+0000 7f3a458db700 1 -- 172.21.15.45:0/3223489492 >> 172.21.15.45:0/3223489492 conn(0x7f3a400c7800 msgr2=0x7f3a400c37d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:11.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.285+0000 7f3a458db700 1 -- 172.21.15.45:0/3223489492 shutdown_connections 2023-12-22T10:01:11.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.285+0000 7f3a458db700 1 -- 172.21.15.45:0/3223489492 wait complete. 2023-12-22T10:01:11.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.285+0000 7f3a458db700 1 Processor -- start 2023-12-22T10:01:11.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.285+0000 7f3a458db700 1 -- start start 2023-12-22T10:01:11.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.289+0000 7f3a458db700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a40067f50 0x7f3a40147330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:11.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.289+0000 7f3a458db700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f3a400c3ee0 0x7f3a400a8240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:11.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.289+0000 7f3a458db700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3a40153d80 0x7f3a400bcbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:11.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.289+0000 7f3a458db700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a400a7570 con 0x7f3a40067f50 2023-12-22T10:01:11.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.289+0000 7f3a458db700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a40147820 con 0x7f3a40153d80 2023-12-22T10:01:11.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.289+0000 7f3a458db700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a400a6960 con 0x7f3a400c3ee0 2023-12-22T10:01:11.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.289+0000 7f3a3effd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a40067f50 0x7f3a40147330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:11.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.289+0000 7f3a3effd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a40067f50 0x7f3a40147330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50334/0 (socket says 172.21.15.45:50334) 2023-12-22T10:01:11.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.289+0000 7f3a3effd700 1 -- 172.21.15.45:0/2756066206 learned_addr learned my addr 172.21.15.45:0/2756066206 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:11.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.289+0000 7f3a3f7fe700 1 --2- 172.21.15.45:0/2756066206 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3a40153d80 0x7f3a400bcbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:11.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.289+0000 7f3a3e7fc700 1 --2- 172.21.15.45:0/2756066206 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f3a400c3ee0 0x7f3a400a8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:11.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.289+0000 7f3a3effd700 1 -- 172.21.15.45:0/2756066206 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f3a400c3ee0 msgr2=0x7f3a400a8240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:11.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.289+0000 7f3a3effd700 1 --2- 172.21.15.45:0/2756066206 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f3a400c3ee0 0x7f3a400a8240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:11.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.289+0000 7f3a3effd700 1 -- 172.21.15.45:0/2756066206 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3a40153d80 msgr2=0x7f3a400bcbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:11.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.289+0000 7f3a3effd700 1 --2- 172.21.15.45:0/2756066206 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3a40153d80 0x7f3a400bcbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:11.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.289+0000 7f3a3effd700 1 -- 172.21.15.45:0/2756066206 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a30009370 con 0x7f3a40067f50 2023-12-22T10:01:11.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.289+0000 7f3a3e7fc700 1 --2- 172.21.15.45:0/2756066206 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f3a400c3ee0 0x7f3a400a8240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-12-22T10:01:11.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.289+0000 7f3a3f7fe700 1 --2- 172.21.15.45:0/2756066206 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3a40153d80 0x7f3a400bcbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-12-22T10:01:11.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.289+0000 7f3a3effd700 1 --2- 172.21.15.45:0/2756066206 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a40067f50 0x7f3a40147330 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7f3a30009130 tx=0x7f3a30017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:11.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.289+0000 7f3a26ffd700 1 -- 172.21.15.45:0/2756066206 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a3000b8d0 con 0x7f3a40067f50 2023-12-22T10:01:11.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.289+0000 7f3a26ffd700 1 -- 172.21.15.45:0/2756066206 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a3000ba30 con 0x7f3a40067f50 2023-12-22T10:01:11.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.289+0000 7f3a458db700 1 -- 172.21.15.45:0/2756066206 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a400a6c40 con 0x7f3a40067f50 2023-12-22T10:01:11.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.289+0000 7f3a26ffd700 1 -- 172.21.15.45:0/2756066206 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a3001c670 con 0x7f3a40067f50 2023-12-22T10:01:11.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.289+0000 7f3a458db700 1 -- 172.21.15.45:0/2756066206 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a400a7200 con 0x7f3a40067f50 2023-12-22T10:01:11.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.293+0000 7f3a458db700 1 -- 172.21.15.45:0/2756066206 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a40047060 con 0x7f3a40067f50 2023-12-22T10:01:11.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.293+0000 7f3a26ffd700 1 -- 172.21.15.45:0/2756066206 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f3a3001c9e0 con 0x7f3a40067f50 2023-12-22T10:01:11.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.293+0000 7f3a26ffd700 1 --2- 172.21.15.45:0/2756066206 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f3a2c05a510 0x7f3a2c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:11.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.293+0000 7f3a26ffd700 1 -- 172.21.15.45:0/2756066206 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f3a300765c0 con 0x7f3a40067f50 2023-12-22T10:01:11.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.293+0000 7f3a3e7fc700 1 --2- 172.21.15.45:0/2756066206 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f3a2c05a510 0x7f3a2c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:11.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.297+0000 7f3a3e7fc700 1 --2- 172.21.15.45:0/2756066206 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f3a2c05a510 0x7f3a2c05c9d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f3a400a96b0 tx=0x7f3a34008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:11.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.301+0000 7f3a26ffd700 1 -- 172.21.15.45:0/2756066206 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f3a30049ce0 con 0x7f3a40067f50 2023-12-22T10:01:11.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.461+0000 7f3a458db700 1 -- 172.21.15.45:0/2756066206 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3a40067800 con 0x7f3a40067f50 2023-12-22T10:01:11.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.465+0000 7f3a26ffd700 1 -- 172.21.15.45:0/2756066206 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3a300200a0 con 0x7f3a40067f50 2023-12-22T10:01:11.462 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-12-22T10:01:11.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.469+0000 7f3a458db700 1 -- 172.21.15.45:0/2756066206 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f3a2c05a510 msgr2=0x7f3a2c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:11.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.469+0000 7f3a458db700 1 --2- 172.21.15.45:0/2756066206 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f3a2c05a510 0x7f3a2c05c9d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f3a400a96b0 tx=0x7f3a34008040).stop 2023-12-22T10:01:11.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.469+0000 7f3a458db700 1 -- 172.21.15.45:0/2756066206 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a40067f50 msgr2=0x7f3a40147330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:11.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.469+0000 7f3a458db700 1 --2- 172.21.15.45:0/2756066206 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a40067f50 0x7f3a40147330 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7f3a30009130 tx=0x7f3a30017000).stop 2023-12-22T10:01:11.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.469+0000 7f3a458db700 1 -- 172.21.15.45:0/2756066206 shutdown_connections 2023-12-22T10:01:11.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.469+0000 7f3a458db700 1 --2- 172.21.15.45:0/2756066206 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3a40153d80 0x7f3a400bcbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:11.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.469+0000 7f3a458db700 1 --2- 172.21.15.45:0/2756066206 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f3a2c05a510 0x7f3a2c05c9d0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:11.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.469+0000 7f3a458db700 1 --2- 172.21.15.45:0/2756066206 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f3a400c3ee0 0x7f3a400a8240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:11.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.469+0000 7f3a458db700 1 --2- 172.21.15.45:0/2756066206 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a40067f50 0x7f3a40147330 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:11.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.469+0000 7f3a458db700 1 -- 172.21.15.45:0/2756066206 >> 172.21.15.45:0/2756066206 conn(0x7f3a400c7800 msgr2=0x7f3a4014d7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:11.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.469+0000 7f3a458db700 1 -- 172.21.15.45:0/2756066206 shutdown_connections 2023-12-22T10:01:11.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.469+0000 7f3a458db700 1 -- 172.21.15.45:0/2756066206 wait complete. 2023-12-22T10:01:11.487 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-22T10:01:11.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.661+0000 7f22d3769700 1 Processor -- start 2023-12-22T10:01:11.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.661+0000 7f22d3769700 1 -- start start 2023-12-22T10:01:11.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.661+0000 7f22d3769700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f22cc157d40 0x7f22cc158120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:11.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.661+0000 7f22d3769700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f22cc0c1670 0x7f22cc0c1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:11.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.661+0000 7f22d3769700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f22cc0a5810 0x7f22cc0a5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:11.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.661+0000 7f22d3769700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22cc069e00 con 0x7f22cc157d40 2023-12-22T10:01:11.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.661+0000 7f22d3769700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22cc0c1fe0 con 0x7f22cc0a5810 2023-12-22T10:01:11.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.661+0000 7f22d3769700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22cc069180 con 0x7f22cc0c1670 2023-12-22T10:01:11.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.665+0000 7f22d1505700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f22cc157d40 0x7f22cc158120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:11.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.665+0000 7f22d1505700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f22cc157d40 0x7f22cc158120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50346/0 (socket says 172.21.15.45:50346) 2023-12-22T10:01:11.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.665+0000 7f22d1505700 1 -- 172.21.15.45:0/2373999249 learned_addr learned my addr 172.21.15.45:0/2373999249 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:11.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.665+0000 7f22d1d06700 1 --2- 172.21.15.45:0/2373999249 >> v2:172.21.15.113:3300/0 conn(0x7f22cc0a5810 0x7f22cc0a5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:11.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.665+0000 7f22d0d04700 1 --2- 172.21.15.45:0/2373999249 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f22cc0c1670 0x7f22cc0c1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:11.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.665+0000 7f22d1505700 1 -- 172.21.15.45:0/2373999249 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f22cc0c1670 msgr2=0x7f22cc0c1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:11.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.665+0000 7f22d1505700 1 --2- 172.21.15.45:0/2373999249 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f22cc0c1670 0x7f22cc0c1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:11.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.665+0000 7f22d1505700 1 -- 172.21.15.45:0/2373999249 >> v2:172.21.15.113:3300/0 conn(0x7f22cc0a5810 msgr2=0x7f22cc0a5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:11.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.665+0000 7f22d1505700 1 --2- 172.21.15.45:0/2373999249 >> v2:172.21.15.113:3300/0 conn(0x7f22cc0a5810 0x7f22cc0a5ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:11.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.665+0000 7f22d1505700 1 -- 172.21.15.45:0/2373999249 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22cc069460 con 0x7f22cc157d40 2023-12-22T10:01:11.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.665+0000 7f22d1505700 1 --2- 172.21.15.45:0/2373999249 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22cc157d40 0x7f22cc158120 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f22cc0c22c0 tx=0x7f22c80090f0).ready entity=mon.0 client_cookie=33f7ba8c4a128ab8 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:11.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.665+0000 7f22c3fff700 1 -- 172.21.15.45:0/2373999249 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c800b520 con 0x7f22cc157d40 2023-12-22T10:01:11.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.665+0000 7f22c3fff700 1 -- 172.21.15.45:0/2373999249 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22c800b680 con 0x7f22cc157d40 2023-12-22T10:01:11.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.665+0000 7f22c3fff700 1 -- 172.21.15.45:0/2373999249 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c800ba00 con 0x7f22cc157d40 2023-12-22T10:01:11.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.665+0000 7f22d3769700 1 -- 172.21.15.45:0/2373999249 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22cc157d40 msgr2=0x7f22cc158120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:11.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.665+0000 7f22d3769700 1 --2- 172.21.15.45:0/2373999249 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22cc157d40 0x7f22cc158120 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f22cc0c22c0 tx=0x7f22c80090f0).stop 2023-12-22T10:01:11.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.665+0000 7f22d3769700 1 -- 172.21.15.45:0/2373999249 shutdown_connections 2023-12-22T10:01:11.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.665+0000 7f22d3769700 1 --2- 172.21.15.45:0/2373999249 >> v2:172.21.15.113:3300/0 conn(0x7f22cc0a5810 0x7f22cc0a5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:11.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.665+0000 7f22d3769700 1 --2- 172.21.15.45:0/2373999249 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f22cc0c1670 0x7f22cc0c1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:11.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.665+0000 7f22d3769700 1 --2- 172.21.15.45:0/2373999249 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22cc157d40 0x7f22cc158120 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:11.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.665+0000 7f22d3769700 1 -- 172.21.15.45:0/2373999249 >> 172.21.15.45:0/2373999249 conn(0x7f22cc066a70 msgr2=0x7f22cc066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:11.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.669+0000 7f22d3769700 1 -- 172.21.15.45:0/2373999249 shutdown_connections 2023-12-22T10:01:11.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.669+0000 7f22d3769700 1 -- 172.21.15.45:0/2373999249 wait complete. 2023-12-22T10:01:11.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.669+0000 7f22d3769700 1 Processor -- start 2023-12-22T10:01:11.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.669+0000 7f22d3769700 1 -- start start 2023-12-22T10:01:11.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.673+0000 7f22d3769700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f22cc0a5810 0x7f22cc1497e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:11.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.673+0000 7f22d3769700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22cc0c1670 0x7f22cc155030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:11.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.673+0000 7f22d3769700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f22cc157d40 0x7f22cc155520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:11.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.673+0000 7f22d3769700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22cc156070 con 0x7f22cc0c1670 2023-12-22T10:01:11.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.673+0000 7f22d3769700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22cc0bba70 con 0x7f22cc157d40 2023-12-22T10:01:11.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.673+0000 7f22d3769700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22cc155ab0 con 0x7f22cc0a5810 2023-12-22T10:01:11.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.673+0000 7f22d0d04700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22cc0c1670 0x7f22cc155030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:11.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.673+0000 7f22d0d04700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22cc0c1670 0x7f22cc155030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50358/0 (socket says 172.21.15.45:50358) 2023-12-22T10:01:11.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.673+0000 7f22d0d04700 1 -- 172.21.15.45:0/1391257641 learned_addr learned my addr 172.21.15.45:0/1391257641 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:11.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.673+0000 7f22d1d06700 1 --2- 172.21.15.45:0/1391257641 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f22cc157d40 0x7f22cc155520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:11.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.673+0000 7f22d1505700 1 --2- 172.21.15.45:0/1391257641 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f22cc0a5810 0x7f22cc1497e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:11.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.673+0000 7f22d0d04700 1 -- 172.21.15.45:0/1391257641 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f22cc0a5810 msgr2=0x7f22cc1497e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:11.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.673+0000 7f22d0d04700 1 --2- 172.21.15.45:0/1391257641 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f22cc0a5810 0x7f22cc1497e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:11.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.673+0000 7f22d0d04700 1 -- 172.21.15.45:0/1391257641 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f22cc157d40 msgr2=0x7f22cc155520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:11.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.673+0000 7f22d0d04700 1 --2- 172.21.15.45:0/1391257641 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f22cc157d40 0x7f22cc155520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:11.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.673+0000 7f22d0d04700 1 -- 172.21.15.45:0/1391257641 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22c8009370 con 0x7f22cc0c1670 2023-12-22T10:01:11.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.673+0000 7f22d0d04700 1 --2- 172.21.15.45:0/1391257641 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22cc0c1670 0x7f22cc155030 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7f22bc00d890 tx=0x7f22bc008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:11.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.673+0000 7f22c17fa700 1 -- 172.21.15.45:0/1391257641 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22bc011590 con 0x7f22cc0c1670 2023-12-22T10:01:11.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.673+0000 7f22c17fa700 1 -- 172.21.15.45:0/1391257641 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22bc0116f0 con 0x7f22cc0c1670 2023-12-22T10:01:11.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.673+0000 7f22d3769700 1 -- 172.21.15.45:0/1391257641 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22cc155d90 con 0x7f22cc0c1670 2023-12-22T10:01:11.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.673+0000 7f22c17fa700 1 -- 172.21.15.45:0/1391257641 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22bc011a70 con 0x7f22cc0c1670 2023-12-22T10:01:11.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.673+0000 7f22d3769700 1 -- 172.21.15.45:0/1391257641 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22cc0c0530 con 0x7f22cc0c1670 2023-12-22T10:01:11.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.677+0000 7f22d3769700 1 -- 172.21.15.45:0/1391257641 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22cc0bbeb0 con 0x7f22cc0c1670 2023-12-22T10:01:11.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.677+0000 7f22c17fa700 1 -- 172.21.15.45:0/1391257641 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f22bc01c460 con 0x7f22cc0c1670 2023-12-22T10:01:11.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.681+0000 7f22c17fa700 1 --2- 172.21.15.45:0/1391257641 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f22b005a510 0x7f22b005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:11.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.681+0000 7f22c17fa700 1 -- 172.21.15.45:0/1391257641 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f22bc074580 con 0x7f22cc0c1670 2023-12-22T10:01:11.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.681+0000 7f22d1505700 1 --2- 172.21.15.45:0/1391257641 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f22b005a510 0x7f22b005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:11.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.681+0000 7f22d1505700 1 --2- 172.21.15.45:0/1391257641 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f22b005a510 0x7f22b005c9d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f22c8009130 tx=0x7f22c8017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:11.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.685+0000 7f22c17fa700 1 -- 172.21.15.45:0/1391257641 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f22bc047c40 con 0x7f22cc0c1670 2023-12-22T10:01:11.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.849+0000 7f22d3769700 1 -- 172.21.15.45:0/1391257641 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f22cc069740 con 0x7f22cc0c1670 2023-12-22T10:01:11.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.853+0000 7f22c17fa700 1 -- 172.21.15.45:0/1391257641 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f22bc011e60 con 0x7f22cc0c1670 2023-12-22T10:01:11.850 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-22T10:01:11.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.857+0000 7f22d3769700 1 -- 172.21.15.45:0/1391257641 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f22b005a510 msgr2=0x7f22b005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:11.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.857+0000 7f22d3769700 1 --2- 172.21.15.45:0/1391257641 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f22b005a510 0x7f22b005c9d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f22c8009130 tx=0x7f22c8017000).stop 2023-12-22T10:01:11.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.857+0000 7f22d3769700 1 -- 172.21.15.45:0/1391257641 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22cc0c1670 msgr2=0x7f22cc155030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:11.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.857+0000 7f22d3769700 1 --2- 172.21.15.45:0/1391257641 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22cc0c1670 0x7f22cc155030 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7f22bc00d890 tx=0x7f22bc008040).stop 2023-12-22T10:01:11.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.857+0000 7f22d3769700 1 -- 172.21.15.45:0/1391257641 shutdown_connections 2023-12-22T10:01:11.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.857+0000 7f22d3769700 1 --2- 172.21.15.45:0/1391257641 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f22cc157d40 0x7f22cc155520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:11.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.857+0000 7f22d3769700 1 --2- 172.21.15.45:0/1391257641 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22cc0c1670 0x7f22cc155030 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:11.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.857+0000 7f22d3769700 1 --2- 172.21.15.45:0/1391257641 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f22b005a510 0x7f22b005c9d0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:11.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.857+0000 7f22d3769700 1 --2- 172.21.15.45:0/1391257641 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f22cc0a5810 0x7f22cc1497e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:11.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.857+0000 7f22d3769700 1 -- 172.21.15.45:0/1391257641 >> 172.21.15.45:0/1391257641 conn(0x7f22cc066a70 msgr2=0x7f22cc0aa1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:11.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.857+0000 7f22d3769700 1 -- 172.21.15.45:0/1391257641 shutdown_connections 2023-12-22T10:01:11.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:11.857+0000 7f22d3769700 1 -- 172.21.15.45:0/1391257641 wait complete. 2023-12-22T10:01:11.877 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-22T10:01:12.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.049+0000 7fb43759e700 1 Processor -- start 2023-12-22T10:01:12.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.049+0000 7fb43759e700 1 -- start start 2023-12-22T10:01:12.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.053+0000 7fb43759e700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb4380acca0 0x7fb4380ad080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:12.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.053+0000 7fb43759e700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb4380691c0 0x7fb4380c97e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:12.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.053+0000 7fb43759e700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4380c5810 con 0x7fb4380c9d20 2023-12-22T10:01:12.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.053+0000 7fb43759e700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4380c8d90 con 0x7fb4380acca0 2023-12-22T10:01:12.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.053+0000 7fb43759e700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4380c9350 con 0x7fb4380691c0 2023-12-22T10:01:12.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.053+0000 7fb43659c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb4380acca0 0x7fb4380ad080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:12.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.053+0000 7fb43659c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb4380acca0 0x7fb4380ad080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50364/0 (socket says 172.21.15.45:50364) 2023-12-22T10:01:12.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.053+0000 7fb43659c700 1 -- 172.21.15.45:0/2572950754 learned_addr learned my addr 172.21.15.45:0/2572950754 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:12.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.053+0000 7fb436d9d700 1 --2- 172.21.15.45:0/2572950754 >> v2:172.21.15.113:3300/0 conn(0x7fb4380691c0 0x7fb4380c97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:12.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.053+0000 7fb43659c700 1 -- 172.21.15.45:0/2572950754 >> v2:172.21.15.113:3300/0 conn(0x7fb4380691c0 msgr2=0x7fb4380c97e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:12.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.053+0000 7fb43659c700 1 --2- 172.21.15.45:0/2572950754 >> v2:172.21.15.113:3300/0 conn(0x7fb4380691c0 0x7fb4380c97e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:12.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.053+0000 7fb43659c700 1 -- 172.21.15.45:0/2572950754 >> v1:172.21.15.113:6789/0 conn(0x7fb4380c9d20 legacy=0x7fb438068ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:12.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.053+0000 7fb43659c700 1 -- 172.21.15.45:0/2572950754 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb438154070 con 0x7fb4380acca0 2023-12-22T10:01:12.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.053+0000 7fb43659c700 1 --2- 172.21.15.45:0/2572950754 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb4380acca0 0x7fb4380ad080 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7fb438069940 tx=0x7fb4280090f0).ready entity=mon.0 client_cookie=1d44bac7217273d8 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:12.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.053+0000 7fb43559a700 1 -- 172.21.15.45:0/2572950754 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb42800b520 con 0x7fb4380acca0 2023-12-22T10:01:12.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.053+0000 7fb43559a700 1 -- 172.21.15.45:0/2572950754 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb42800b680 con 0x7fb4380acca0 2023-12-22T10:01:12.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.053+0000 7fb43559a700 1 -- 172.21.15.45:0/2572950754 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb42800ba00 con 0x7fb4380acca0 2023-12-22T10:01:12.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.053+0000 7fb43759e700 1 -- 172.21.15.45:0/2572950754 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb4380acca0 msgr2=0x7fb4380ad080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:12.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.053+0000 7fb43759e700 1 --2- 172.21.15.45:0/2572950754 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb4380acca0 0x7fb4380ad080 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7fb438069940 tx=0x7fb4280090f0).stop 2023-12-22T10:01:12.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.057+0000 7fb43759e700 1 -- 172.21.15.45:0/2572950754 shutdown_connections 2023-12-22T10:01:12.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.057+0000 7fb43759e700 1 --2- 172.21.15.45:0/2572950754 >> v2:172.21.15.113:3300/0 conn(0x7fb4380691c0 0x7fb4380c97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:12.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.057+0000 7fb43759e700 1 --2- 172.21.15.45:0/2572950754 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb4380acca0 0x7fb4380ad080 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:12.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.057+0000 7fb43759e700 1 -- 172.21.15.45:0/2572950754 >> 172.21.15.45:0/2572950754 conn(0x7fb4380674f0 msgr2=0x7fb4380ca820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:12.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.057+0000 7fb43759e700 1 -- 172.21.15.45:0/2572950754 shutdown_connections 2023-12-22T10:01:12.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.057+0000 7fb43759e700 1 -- 172.21.15.45:0/2572950754 wait complete. 2023-12-22T10:01:12.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.057+0000 7fb43759e700 1 Processor -- start 2023-12-22T10:01:12.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.057+0000 7fb43759e700 1 -- start start 2023-12-22T10:01:12.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.061+0000 7fb43759e700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb4380691c0 0x7fb4380c34d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:12.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.061+0000 7fb43759e700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb4380acca0 0x7fb4380c18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:12.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.061+0000 7fb43759e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb4380c9d20 0x7fb4380c1db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:12.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.061+0000 7fb43759e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4380af860 con 0x7fb4380c9d20 2023-12-22T10:01:12.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.061+0000 7fb43759e700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4380c2430 con 0x7fb4380acca0 2023-12-22T10:01:12.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.061+0000 7fb43759e700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4380c2710 con 0x7fb4380691c0 2023-12-22T10:01:12.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.061+0000 7fb436d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb4380c9d20 0x7fb4380c1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:12.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.061+0000 7fb43659c700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb4380691c0 0x7fb4380c34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:12.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.061+0000 7fb436d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb4380c9d20 0x7fb4380c1db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50370/0 (socket says 172.21.15.45:50370) 2023-12-22T10:01:12.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.061+0000 7fb436d9d700 1 -- 172.21.15.45:0/2531639318 learned_addr learned my addr 172.21.15.45:0/2531639318 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:12.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.061+0000 7fb435d9b700 1 --2- 172.21.15.45:0/2531639318 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb4380acca0 0x7fb4380c18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:12.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.061+0000 7fb436d9d700 1 -- 172.21.15.45:0/2531639318 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb4380691c0 msgr2=0x7fb4380c34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:12.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.061+0000 7fb436d9d700 1 --2- 172.21.15.45:0/2531639318 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb4380691c0 0x7fb4380c34d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:12.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.061+0000 7fb436d9d700 1 -- 172.21.15.45:0/2531639318 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb4380acca0 msgr2=0x7fb4380c18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:12.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.061+0000 7fb436d9d700 1 --2- 172.21.15.45:0/2531639318 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb4380acca0 0x7fb4380c18c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:12.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.061+0000 7fb436d9d700 1 -- 172.21.15.45:0/2531639318 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb428009370 con 0x7fb4380c9d20 2023-12-22T10:01:12.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.061+0000 7fb436d9d700 1 --2- 172.21.15.45:0/2531639318 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb4380c9d20 0x7fb4380c1db0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7fb430009ec0 tx=0x7fb43000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:12.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.065+0000 7fb4267fc700 1 -- 172.21.15.45:0/2531639318 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb43000cb70 con 0x7fb4380c9d20 2023-12-22T10:01:12.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.065+0000 7fb4267fc700 1 -- 172.21.15.45:0/2531639318 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb43000f040 con 0x7fb4380c9d20 2023-12-22T10:01:12.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.065+0000 7fb43759e700 1 -- 172.21.15.45:0/2531639318 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4380c29f0 con 0x7fb4380c9d20 2023-12-22T10:01:12.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.065+0000 7fb4267fc700 1 -- 172.21.15.45:0/2531639318 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb430013400 con 0x7fb4380c9d20 2023-12-22T10:01:12.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.065+0000 7fb43759e700 1 -- 172.21.15.45:0/2531639318 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4380c2fb0 con 0x7fb4380c9d20 2023-12-22T10:01:12.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.065+0000 7fb43759e700 1 -- 172.21.15.45:0/2531639318 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb438047060 con 0x7fb4380c9d20 2023-12-22T10:01:12.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.065+0000 7fb4267fc700 1 -- 172.21.15.45:0/2531639318 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fb430013770 con 0x7fb4380c9d20 2023-12-22T10:01:12.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.065+0000 7fb4267fc700 1 --2- 172.21.15.45:0/2531639318 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fb41805a510 0x7fb41805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:12.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.069+0000 7fb4267fc700 1 -- 172.21.15.45:0/2531639318 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb4300750a0 con 0x7fb4380c9d20 2023-12-22T10:01:12.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.069+0000 7fb43659c700 1 --2- 172.21.15.45:0/2531639318 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fb41805a510 0x7fb41805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:12.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.069+0000 7fb43659c700 1 --2- 172.21.15.45:0/2531639318 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fb41805a510 0x7fb41805c9d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7fb428009130 tx=0x7fb428017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:12.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.073+0000 7fb4267fc700 1 -- 172.21.15.45:0/2531639318 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb4300487c0 con 0x7fb4380c9d20 2023-12-22T10:01:12.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.237+0000 7fb43759e700 1 -- 172.21.15.45:0/2531639318 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb4380c5a60 con 0x7fb4380c9d20 2023-12-22T10:01:12.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.237+0000 7fb4267fc700 1 -- 172.21.15.45:0/2531639318 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb43004bde0 con 0x7fb4380c9d20 2023-12-22T10:01:12.234 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-22T10:01:12.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.237+0000 7fb43759e700 1 -- 172.21.15.45:0/2531639318 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fb41805a510 msgr2=0x7fb41805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:12.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.237+0000 7fb43759e700 1 --2- 172.21.15.45:0/2531639318 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fb41805a510 0x7fb41805c9d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7fb428009130 tx=0x7fb428017000).stop 2023-12-22T10:01:12.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.237+0000 7fb43759e700 1 -- 172.21.15.45:0/2531639318 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb4380c9d20 msgr2=0x7fb4380c1db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:12.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.237+0000 7fb43759e700 1 --2- 172.21.15.45:0/2531639318 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb4380c9d20 0x7fb4380c1db0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7fb430009ec0 tx=0x7fb43000b040).stop 2023-12-22T10:01:12.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.241+0000 7fb43759e700 1 -- 172.21.15.45:0/2531639318 shutdown_connections 2023-12-22T10:01:12.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.241+0000 7fb43759e700 1 --2- 172.21.15.45:0/2531639318 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb4380c9d20 0x7fb4380c1db0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:12.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.241+0000 7fb43759e700 1 --2- 172.21.15.45:0/2531639318 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb4380acca0 0x7fb4380c18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:12.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.241+0000 7fb43759e700 1 --2- 172.21.15.45:0/2531639318 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fb41805a510 0x7fb41805c9d0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:12.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.241+0000 7fb43759e700 1 --2- 172.21.15.45:0/2531639318 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb4380691c0 0x7fb4380c34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:12.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.241+0000 7fb43759e700 1 -- 172.21.15.45:0/2531639318 >> 172.21.15.45:0/2531639318 conn(0x7fb4380674f0 msgr2=0x7fb4380ca820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:12.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.241+0000 7fb43759e700 1 -- 172.21.15.45:0/2531639318 shutdown_connections 2023-12-22T10:01:12.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.241+0000 7fb43759e700 1 -- 172.21.15.45:0/2531639318 wait complete. 2023-12-22T10:01:12.263 INFO:tasks.cephfs_test_runner:Starting test: test_rebuild_simple (tasks.cephfs.test_recovery_pool.TestRecoveryPool) 2023-12-22T10:01:12.264 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T10:01:12.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.425+0000 7f7aa4d69700 1 Processor -- start 2023-12-22T10:01:12.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.425+0000 7f7aa4d69700 1 -- start start 2023-12-22T10:01:12.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.429+0000 7f7aa4d69700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7aa0151cd0 0x7f7aa00a6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:12.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.429+0000 7f7aa4d69700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7aa00a76b0 con 0x7f7aa00a7200 2023-12-22T10:01:12.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.429+0000 7f7aa4d69700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7aa0155740 con 0x7f7aa01518f0 2023-12-22T10:01:12.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.429+0000 7f7aa4d69700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa00c40f0 con 0x7f7aa0151cd0 2023-12-22T10:01:12.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.429+0000 7f7a9ed9d700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f7aa00a7200 0x7f7aa00c3160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:55894/0 (socket says 172.21.15.45:55894) 2023-12-22T10:01:12.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.429+0000 7f7a9ed9d700 1 -- 172.21.15.45:0/1227229868 learned_addr learned my addr 172.21.15.45:0/1227229868 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:01:12.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.429+0000 7f7a95d9b700 1 --2- 172.21.15.45:0/1227229868 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7aa0151cd0 0x7f7aa00a6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:12.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.429+0000 7f7a9dd9b700 1 -- 172.21.15.45:0/1227229868 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1793642769 0 0) 0x7f7aa00a76b0 con 0x7f7aa00a7200 2023-12-22T10:01:12.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.429+0000 7f7a9dd9b700 1 -- 172.21.15.45:0/1227229868 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a8c0033f0 con 0x7f7aa00a7200 2023-12-22T10:01:12.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.429+0000 7f7a9dd9b700 1 -- 172.21.15.45:0/1227229868 <== mon.1 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3956706705 0 0) 0x7f7aa0155740 con 0x7f7aa01518f0 2023-12-22T10:01:12.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.429+0000 7f7a95d9b700 1 -- 172.21.15.45:0/1227229868 >> v1:172.21.15.113:6789/0 conn(0x7f7aa01518f0 legacy=0x7f7aa0064890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:12.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.429+0000 7f7a95d9b700 1 -- 172.21.15.45:0/1227229868 >> v1:172.21.15.45:6789/0 conn(0x7f7aa00a7200 legacy=0x7f7aa00c3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:12.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.429+0000 7f7a95d9b700 1 -- 172.21.15.45:0/1227229868 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aa00a61b0 con 0x7f7aa0151cd0 2023-12-22T10:01:12.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.429+0000 7f7a95d9b700 1 --2- 172.21.15.45:0/1227229868 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7aa0151cd0 0x7f7aa00a6d10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f7a88009790 tx=0x7f7a88009060).ready entity=mon.2 client_cookie=c553e69a7945130f server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:12.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.433+0000 7f7a9dd9b700 1 -- 172.21.15.45:0/1227229868 <== mon.2 v2:172.21.15.113:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a8800f510 con 0x7f7aa0151cd0 2023-12-22T10:01:12.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.433+0000 7f7a9dd9b700 1 -- 172.21.15.45:0/1227229868 <== mon.2 v2:172.21.15.113:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a8800f670 con 0x7f7aa0151cd0 2023-12-22T10:01:12.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.433+0000 7f7a9dd9b700 1 -- 172.21.15.45:0/1227229868 <== mon.2 v2:172.21.15.113:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a8800f9f0 con 0x7f7aa0151cd0 2023-12-22T10:01:12.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.433+0000 7f7aa4d69700 1 -- 172.21.15.45:0/1227229868 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7aa0151cd0 msgr2=0x7f7aa00a6d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:12.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.433+0000 7f7aa4d69700 1 --2- 172.21.15.45:0/1227229868 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7aa0151cd0 0x7f7aa00a6d10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f7a88009790 tx=0x7f7a88009060).stop 2023-12-22T10:01:12.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.433+0000 7f7aa4d69700 1 -- 172.21.15.45:0/1227229868 shutdown_connections 2023-12-22T10:01:12.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.433+0000 7f7aa4d69700 1 --2- 172.21.15.45:0/1227229868 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7aa0151cd0 0x7f7aa00a6d10 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:12.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.433+0000 7f7aa4d69700 1 -- 172.21.15.45:0/1227229868 >> 172.21.15.45:0/1227229868 conn(0x7f7aa0066a70 msgr2=0x7f7aa0066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:12.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.433+0000 7f7aa4d69700 1 -- 172.21.15.45:0/1227229868 shutdown_connections 2023-12-22T10:01:12.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.433+0000 7f7aa4d69700 1 -- 172.21.15.45:0/1227229868 wait complete. 2023-12-22T10:01:12.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.433+0000 7f7aa4d69700 1 Processor -- start 2023-12-22T10:01:12.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.433+0000 7f7aa4d69700 1 -- start start 2023-12-22T10:01:12.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.437+0000 7f7aa4d69700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7aa00a7200 0x7f7aa0167d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:12.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.437+0000 7f7aa4d69700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7aa01518f0 0x7f7aa0145b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:12.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.437+0000 7f7aa4d69700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7aa0151cd0 0x7f7aa0154db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:12.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.437+0000 7f7aa4d69700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa0154920 con 0x7f7aa0151cd0 2023-12-22T10:01:12.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.437+0000 7f7aa4d69700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa0153ff0 con 0x7f7aa01518f0 2023-12-22T10:01:12.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.437+0000 7f7aa4d69700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa01542d0 con 0x7f7aa00a7200 2023-12-22T10:01:12.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.437+0000 7f7a9ed9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7aa0151cd0 0x7f7aa0154db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:12.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.437+0000 7f7a9ed9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7aa0151cd0 0x7f7aa0154db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50374/0 (socket says 172.21.15.45:50374) 2023-12-22T10:01:12.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.437+0000 7f7a9ed9d700 1 -- 172.21.15.45:0/2708953724 learned_addr learned my addr 172.21.15.45:0/2708953724 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:12.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.437+0000 7f7a95d9b700 1 --2- 172.21.15.45:0/2708953724 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7aa01518f0 0x7f7aa0145b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:12.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.437+0000 7f7a9e59c700 1 --2- 172.21.15.45:0/2708953724 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7aa00a7200 0x7f7aa0167d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:12.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.437+0000 7f7a9ed9d700 1 -- 172.21.15.45:0/2708953724 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7aa00a7200 msgr2=0x7f7aa0167d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:12.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.437+0000 7f7a9ed9d700 1 --2- 172.21.15.45:0/2708953724 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7aa00a7200 0x7f7aa0167d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:12.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.437+0000 7f7a9ed9d700 1 -- 172.21.15.45:0/2708953724 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7aa01518f0 msgr2=0x7f7aa0145b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:12.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.437+0000 7f7a9ed9d700 1 --2- 172.21.15.45:0/2708953724 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7aa01518f0 0x7f7aa0145b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:12.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.437+0000 7f7a9ed9d700 1 -- 172.21.15.45:0/2708953724 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a880092a0 con 0x7f7aa0151cd0 2023-12-22T10:01:12.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.437+0000 7f7a9ed9d700 1 --2- 172.21.15.45:0/2708953724 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7aa0151cd0 0x7f7aa0154db0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7f7a980010e0 tx=0x7f7a98007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:12.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.437+0000 7f7a96ffd700 1 -- 172.21.15.45:0/2708953724 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a980070d0 con 0x7f7aa0151cd0 2023-12-22T10:01:12.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.437+0000 7f7a96ffd700 1 -- 172.21.15.45:0/2708953724 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a98007230 con 0x7f7aa0151cd0 2023-12-22T10:01:12.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.437+0000 7f7aa4d69700 1 -- 172.21.15.45:0/2708953724 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7aa01545b0 con 0x7f7aa0151cd0 2023-12-22T10:01:12.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.437+0000 7f7a96ffd700 1 -- 172.21.15.45:0/2708953724 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a980075b0 con 0x7f7aa0151cd0 2023-12-22T10:01:12.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.437+0000 7f7aa4d69700 1 -- 172.21.15.45:0/2708953724 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7aa0145200 con 0x7f7aa0151cd0 2023-12-22T10:01:12.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.441+0000 7f7aa4d69700 1 -- 172.21.15.45:0/2708953724 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7aa0154a90 con 0x7f7aa0151cd0 2023-12-22T10:01:12.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.441+0000 7f7a96ffd700 1 -- 172.21.15.45:0/2708953724 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f7a98005bc0 con 0x7f7aa0151cd0 2023-12-22T10:01:12.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.441+0000 7f7a96ffd700 1 --2- 172.21.15.45:0/2708953724 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f7a8005a540 0x7f7a8005ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:12.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.441+0000 7f7a96ffd700 1 -- 172.21.15.45:0/2708953724 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f7a98074200 con 0x7f7aa0151cd0 2023-12-22T10:01:12.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.445+0000 7f7a9e59c700 1 --2- 172.21.15.45:0/2708953724 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f7a8005a540 0x7f7a8005ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:12.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.445+0000 7f7a9e59c700 1 --2- 172.21.15.45:0/2708953724 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f7a8005a540 0x7f7a8005ca00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f7a90001560 tx=0x7f7a90007f30).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:12.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.449+0000 7f7a96ffd700 1 -- 172.21.15.45:0/2708953724 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f7a98047920 con 0x7f7aa0151cd0 2023-12-22T10:01:12.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.617+0000 7f7aa4d69700 1 -- 172.21.15.45:0/2708953724 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7aa0064fa0 con 0x7f7aa0151cd0 2023-12-22T10:01:12.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.617+0000 7f7a96ffd700 1 -- 172.21.15.45:0/2708953724 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16928 (secure 0 0 0) 0x7f7a98018020 con 0x7f7aa0151cd0 2023-12-22T10:01:12.617 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:01:12.617 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":21,"fsid":"98b0837e-5e68-4c8f-a1a0-e9424baaad8f","created":"2023-12-22T10:00:15.010174+0000","modified":"2023-12-22T10:00:34.529651+0000","last_up_change":"2023-12-22T10:00:24.980513+0000","last_in_change":"2023-12-22T10:00:17.887172+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-12-22T10:00:25.069641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-12-22T10:00:26.906399+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-12-22T10:00:31.621311+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-12-22T10:00:32.538053+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e19943a0-1c6b-47df-b6bb-383472077890","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":33777},{"type":"v1","addr":"172.21.15.45:6819","nonce":33777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":33777},{"type":"v1","addr":"172.21.15.45:6822","nonce":33777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":33777},{"type":"v1","addr":"172.21.15.45:6830","nonce":33777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":33777},{"type":"v1","addr":"172.21.15.45:6826","nonce":33777}]},"public_addr":"172.21.15.45:6819/33777","cluster_addr":"172.21.15.45:6822/33777","heartbeat_back_addr":"172.21.15.45:6830/33777","heartbeat_front_addr":"172.21.15.45:6826/33777","state":["exists","up"]},{"osd":1,"uuid":"69670f34-f082-45a7-8f67-e962acc136e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":33775},{"type":"v1","addr":"172.21.15.45:6809","nonce":33775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":33775},{"type":"v1","addr":"172.21.15.45:6811","nonce":33775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":33775},{"type":"v1","addr":"172.21.15.45:6815","nonce":33775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":33775},{"type":"v1","addr":"172.21.15.45:6813","nonce":33775}]},"public_addr":"172.21.15.45:6809/33775","cluster_addr":"172.21.15.45:6811/33775","heartbeat_back_addr":"172.21.15.45:6815/33775","heartbeat_front_addr":"172.21.15.45:6813/33775","state":["exists","up"]},{"osd":2,"uuid":"d909d49b-82b8-401b-9947-e49dd167bb95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":33776},{"type":"v1","addr":"172.21.15.45:6801","nonce":33776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":33776},{"type":"v1","addr":"172.21.15.45:6803","nonce":33776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":33776},{"type":"v1","addr":"172.21.15.45:6807","nonce":33776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":33776},{"type":"v1","addr":"172.21.15.45:6805","nonce":33776}]},"public_addr":"172.21.15.45:6801/33776","cluster_addr":"172.21.15.45:6803/33776","heartbeat_back_addr":"172.21.15.45:6807/33776","heartbeat_front_addr":"172.21.15.45:6805/33776","state":["exists","up"]},{"osd":3,"uuid":"db104ca9-3a94-4d39-a2be-bd06db888095","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":33782},{"type":"v1","addr":"172.21.15.45:6817","nonce":33782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":33782},{"type":"v1","addr":"172.21.15.45:6823","nonce":33782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":33782},{"type":"v1","addr":"172.21.15.45:6831","nonce":33782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":33782},{"type":"v1","addr":"172.21.15.45:6827","nonce":33782}]},"public_addr":"172.21.15.45:6817/33782","cluster_addr":"172.21.15.45:6823/33782","heartbeat_back_addr":"172.21.15.45:6831/33782","heartbeat_front_addr":"172.21.15.45:6827/33782","state":["exists","up"]},{"osd":4,"uuid":"9f4eaff4-e433-4479-a0d1-ee7a33375ca6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":34099},{"type":"v1","addr":"172.21.15.113:6811","nonce":34099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":34099},{"type":"v1","addr":"172.21.15.113:6815","nonce":34099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":34099},{"type":"v1","addr":"172.21.15.113:6823","nonce":34099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6816","nonce":34099},{"type":"v1","addr":"172.21.15.113:6818","nonce":34099}]},"public_addr":"172.21.15.113:6811/34099","cluster_addr":"172.21.15.113:6815/34099","heartbeat_back_addr":"172.21.15.113:6823/34099","heartbeat_front_addr":"172.21.15.113:6818/34099","state":["exists","up"]},{"osd":5,"uuid":"1efc5591-180b-43af-8611-0068aadc5aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":34100},{"type":"v1","addr":"172.21.15.113:6801","nonce":34100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":34100},{"type":"v1","addr":"172.21.15.113:6803","nonce":34100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":34100},{"type":"v1","addr":"172.21.15.113:6807","nonce":34100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":34100},{"type":"v1","addr":"172.21.15.113:6805","nonce":34100}]},"public_addr":"172.21.15.113:6801/34100","cluster_addr":"172.21.15.113:6803/34100","heartbeat_back_addr":"172.21.15.113:6807/34100","heartbeat_front_addr":"172.21.15.113:6805/34100","state":["exists","up"]},{"osd":6,"uuid":"6c89d9d8-c153-4a48-afa9-97e4c403f1ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":34101},{"type":"v1","addr":"172.21.15.113:6810","nonce":34101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6812","nonce":34101},{"type":"v1","addr":"172.21.15.113:6814","nonce":34101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6822","nonce":34101},{"type":"v1","addr":"172.21.15.113:6824","nonce":34101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":34101},{"type":"v1","addr":"172.21.15.113:6819","nonce":34101}]},"public_addr":"172.21.15.113:6810/34101","cluster_addr":"172.21.15.113:6814/34101","heartbeat_back_addr":"172.21.15.113:6824/34101","heartbeat_front_addr":"172.21.15.113:6819/34101","state":["exists","up"]},{"osd":7,"uuid":"1855e70c-23f6-4c08-ad7f-774c2148235b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6821","nonce":34102},{"type":"v1","addr":"172.21.15.113:6825","nonce":34102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":34102},{"type":"v1","addr":"172.21.15.113:6827","nonce":34102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":34102},{"type":"v1","addr":"172.21.15.113:6831","nonce":34102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6828","nonce":34102},{"type":"v1","addr":"172.21.15.113:6829","nonce":34102}]},"public_addr":"172.21.15.113:6825/34102","cluster_addr":"172.21.15.113:6827/34102","heartbeat_back_addr":"172.21.15.113:6831/34102","heartbeat_front_addr":"172.21.15.113:6829/34102","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.812672+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.825045+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.700105+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.856563+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.954683+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.883234+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.883994+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.821686+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T10:01:12.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.621+0000 7f7aa4d69700 1 -- 172.21.15.45:0/2708953724 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f7a8005a540 msgr2=0x7f7a8005ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:12.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.621+0000 7f7aa4d69700 1 --2- 172.21.15.45:0/2708953724 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f7a8005a540 0x7f7a8005ca00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f7a90001560 tx=0x7f7a90007f30).stop 2023-12-22T10:01:12.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.621+0000 7f7aa4d69700 1 -- 172.21.15.45:0/2708953724 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7aa0151cd0 msgr2=0x7f7aa0154db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:12.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.621+0000 7f7aa4d69700 1 --2- 172.21.15.45:0/2708953724 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7aa0151cd0 0x7f7aa0154db0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7f7a980010e0 tx=0x7f7a98007c50).stop 2023-12-22T10:01:12.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.621+0000 7f7aa4d69700 1 -- 172.21.15.45:0/2708953724 shutdown_connections 2023-12-22T10:01:12.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.621+0000 7f7aa4d69700 1 --2- 172.21.15.45:0/2708953724 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7aa0151cd0 0x7f7aa0154db0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:12.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.621+0000 7f7aa4d69700 1 --2- 172.21.15.45:0/2708953724 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7aa01518f0 0x7f7aa0145b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:12.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.621+0000 7f7aa4d69700 1 --2- 172.21.15.45:0/2708953724 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f7a8005a540 0x7f7a8005ca00 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:12.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.621+0000 7f7aa4d69700 1 --2- 172.21.15.45:0/2708953724 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7aa00a7200 0x7f7aa0167d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:12.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.621+0000 7f7aa4d69700 1 -- 172.21.15.45:0/2708953724 >> 172.21.15.45:0/2708953724 conn(0x7f7aa0066a70 msgr2=0x7f7aa00c5d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:12.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.621+0000 7f7aa4d69700 1 -- 172.21.15.45:0/2708953724 shutdown_connections 2023-12-22T10:01:12.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.621+0000 7f7aa4d69700 1 -- 172.21.15.45:0/2708953724 wait complete. 2023-12-22T10:01:12.642 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-12-22T10:00:25.069641+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-12-22T10:00:26.906399+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-22T10:00:31.621311+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-12-22T10:00:32.538053+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-22T10:01:12.642 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-12-22T10:01:12.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.805+0000 7f1f057b9700 1 Processor -- start 2023-12-22T10:01:12.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.805+0000 7f1f057b9700 1 -- start start 2023-12-22T10:01:12.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.805+0000 7f1f057b9700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1f001537a0 0x7f1f00158030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:12.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.805+0000 7f1f057b9700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1f00095e90 0x7f1f000bdff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:12.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.805+0000 7f1f057b9700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1f00094f10 0x7f1f000953c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:12.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.805+0000 7f1f057b9700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f000bee00 con 0x7f1f00095e90 2023-12-22T10:01:12.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.805+0000 7f1f057b9700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f00157620 con 0x7f1f00094f10 2023-12-22T10:01:12.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.805+0000 7f1f057b9700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f000958b0 con 0x7f1f001537a0 2023-12-22T10:01:12.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.805+0000 7f1ef7fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1f00095e90 0x7f1f000bdff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:12.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.809+0000 7f1efffff700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1f001537a0 0x7f1f00158030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:12.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.809+0000 7f1ef7fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1f00095e90 0x7f1f000bdff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50384/0 (socket says 172.21.15.45:50384) 2023-12-22T10:01:12.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.809+0000 7f1ef7fff700 1 -- 172.21.15.45:0/2108049390 learned_addr learned my addr 172.21.15.45:0/2108049390 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:12.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.809+0000 7f1f04fb8700 1 --2- 172.21.15.45:0/2108049390 >> v2:172.21.15.113:3300/0 conn(0x7f1f00094f10 0x7f1f000953c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:12.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.809+0000 7f1efffff700 1 -- 172.21.15.45:0/2108049390 >> v2:172.21.15.113:3300/0 conn(0x7f1f00094f10 msgr2=0x7f1f000953c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:12.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.809+0000 7f1efffff700 1 --2- 172.21.15.45:0/2108049390 >> v2:172.21.15.113:3300/0 conn(0x7f1f00094f10 0x7f1f000953c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:12.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.809+0000 7f1efffff700 1 -- 172.21.15.45:0/2108049390 >> v2:172.21.15.45:3300/0 conn(0x7f1f00095e90 msgr2=0x7f1f000bdff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:12.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.809+0000 7f1efffff700 1 --2- 172.21.15.45:0/2108049390 >> v2:172.21.15.45:3300/0 conn(0x7f1f00095e90 0x7f1f000bdff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:12.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.809+0000 7f1efffff700 1 -- 172.21.15.45:0/2108049390 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f00157ba0 con 0x7f1f001537a0 2023-12-22T10:01:12.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.809+0000 7f1efffff700 1 --2- 172.21.15.45:0/2108049390 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1f001537a0 0x7f1f00158030 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f1f0005ec40 tx=0x7f1ef0009060).ready entity=mon.2 client_cookie=819532b7ce16e001 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:12.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.809+0000 7f1eff7fe700 1 -- 172.21.15.45:0/2108049390 <== mon.2 v2:172.21.15.113:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ef000f510 con 0x7f1f001537a0 2023-12-22T10:01:12.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.809+0000 7f1eff7fe700 1 -- 172.21.15.45:0/2108049390 <== mon.2 v2:172.21.15.113:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ef000f670 con 0x7f1f001537a0 2023-12-22T10:01:12.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.809+0000 7f1eff7fe700 1 -- 172.21.15.45:0/2108049390 <== mon.2 v2:172.21.15.113:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ef000f9f0 con 0x7f1f001537a0 2023-12-22T10:01:12.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.809+0000 7f1f057b9700 1 -- 172.21.15.45:0/2108049390 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1f001537a0 msgr2=0x7f1f00158030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:12.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.809+0000 7f1f057b9700 1 --2- 172.21.15.45:0/2108049390 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1f001537a0 0x7f1f00158030 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f1f0005ec40 tx=0x7f1ef0009060).stop 2023-12-22T10:01:12.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.809+0000 7f1f057b9700 1 -- 172.21.15.45:0/2108049390 shutdown_connections 2023-12-22T10:01:12.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.809+0000 7f1f057b9700 1 --2- 172.21.15.45:0/2108049390 >> v2:172.21.15.113:3300/0 conn(0x7f1f00094f10 0x7f1f000953c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:12.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.809+0000 7f1f057b9700 1 --2- 172.21.15.45:0/2108049390 >> v2:172.21.15.45:3300/0 conn(0x7f1f00095e90 0x7f1f000bdff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:12.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.809+0000 7f1f057b9700 1 --2- 172.21.15.45:0/2108049390 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1f001537a0 0x7f1f00158030 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:12.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.809+0000 7f1f057b9700 1 -- 172.21.15.45:0/2108049390 >> 172.21.15.45:0/2108049390 conn(0x7f1f00067500 msgr2=0x7f1f000c8690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:12.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.809+0000 7f1f057b9700 1 -- 172.21.15.45:0/2108049390 shutdown_connections 2023-12-22T10:01:12.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.809+0000 7f1f057b9700 1 -- 172.21.15.45:0/2108049390 wait complete. 2023-12-22T10:01:12.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.813+0000 7f1f057b9700 1 Processor -- start 2023-12-22T10:01:12.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.813+0000 7f1f057b9700 1 -- start start 2023-12-22T10:01:12.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.813+0000 7f1f057b9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f00094f10 0x7f1f000c5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:12.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.813+0000 7f1f057b9700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1f00095e90 0x7f1f000c77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:12.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.813+0000 7f1f057b9700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1f001537a0 0x7f1f000aa4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:12.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.813+0000 7f1f057b9700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f00165020 con 0x7f1f00094f10 2023-12-22T10:01:12.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.813+0000 7f1f057b9700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f00164410 con 0x7f1f001537a0 2023-12-22T10:01:12.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.813+0000 7f1f057b9700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f001646f0 con 0x7f1f00095e90 2023-12-22T10:01:12.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.813+0000 7f1efffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f00094f10 0x7f1f000c5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:12.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.813+0000 7f1efffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f00094f10 0x7f1f000c5ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50392/0 (socket says 172.21.15.45:50392) 2023-12-22T10:01:12.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.813+0000 7f1efffff700 1 -- 172.21.15.45:0/573758874 learned_addr learned my addr 172.21.15.45:0/573758874 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:12.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.813+0000 7f1ef7fff700 1 --2- 172.21.15.45:0/573758874 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1f00095e90 0x7f1f000c77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:12.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.813+0000 7f1f04fb8700 1 --2- 172.21.15.45:0/573758874 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1f001537a0 0x7f1f000aa4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:12.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.813+0000 7f1efffff700 1 -- 172.21.15.45:0/573758874 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1f00095e90 msgr2=0x7f1f000c77a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:12.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.813+0000 7f1efffff700 1 --2- 172.21.15.45:0/573758874 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1f00095e90 0x7f1f000c77a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:12.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.813+0000 7f1efffff700 1 -- 172.21.15.45:0/573758874 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1f001537a0 msgr2=0x7f1f000aa4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:12.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.813+0000 7f1efffff700 1 --2- 172.21.15.45:0/573758874 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1f001537a0 0x7f1f000aa4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:12.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.813+0000 7f1efffff700 1 -- 172.21.15.45:0/573758874 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ef00092a0 con 0x7f1f00094f10 2023-12-22T10:01:12.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.813+0000 7f1ef7fff700 1 --2- 172.21.15.45:0/573758874 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1f00095e90 0x7f1f000c77a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T10:01:12.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.817+0000 7f1efffff700 1 --2- 172.21.15.45:0/573758874 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f00094f10 0x7f1f000c5ac0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f1ef0009dd0 tx=0x7f1ef0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:12.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.817+0000 7f1efcff9700 1 -- 172.21.15.45:0/573758874 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ef000f9f0 con 0x7f1f00094f10 2023-12-22T10:01:12.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.817+0000 7f1efcff9700 1 -- 172.21.15.45:0/573758874 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ef0000c90 con 0x7f1f00094f10 2023-12-22T10:01:12.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.817+0000 7f1efcff9700 1 -- 172.21.15.45:0/573758874 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ef001c670 con 0x7f1f00094f10 2023-12-22T10:01:12.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.817+0000 7f1f057b9700 1 -- 172.21.15.45:0/573758874 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f001649d0 con 0x7f1f00094f10 2023-12-22T10:01:12.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.817+0000 7f1f057b9700 1 -- 172.21.15.45:0/573758874 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f00164120 con 0x7f1f00094f10 2023-12-22T10:01:12.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.817+0000 7f1f057b9700 1 -- 172.21.15.45:0/573758874 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f00047060 con 0x7f1f00094f10 2023-12-22T10:01:12.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.817+0000 7f1efcff9700 1 -- 172.21.15.45:0/573758874 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f1ef001ca20 con 0x7f1f00094f10 2023-12-22T10:01:12.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.821+0000 7f1efcff9700 1 --2- 172.21.15.45:0/573758874 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f1ee005a510 0x7f1ee005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:12.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.821+0000 7f1efcff9700 1 -- 172.21.15.45:0/573758874 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f1ef00764f0 con 0x7f1f00094f10 2023-12-22T10:01:12.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.821+0000 7f1ef7fff700 1 --2- 172.21.15.45:0/573758874 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f1ee005a510 0x7f1ee005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:12.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.821+0000 7f1ef7fff700 1 --2- 172.21.15.45:0/573758874 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f1ee005a510 0x7f1ee005c9d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f1ee8006bc0 tx=0x7f1ee8008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:12.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.825+0000 7f1efcff9700 1 -- 172.21.15.45:0/573758874 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f1ef0049cd0 con 0x7f1f00094f10 2023-12-22T10:01:12.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.989+0000 7f1f057b9700 1 -- 172.21.15.45:0/573758874 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f1f000be840 con 0x7f1f00094f10 2023-12-22T10:01:12.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.989+0000 7f1efcff9700 1 -- 172.21.15.45:0/573758874 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v21) v1 ==== 110+0+10 (secure 0 0 0) 0x7f1ef002a0b0 con 0x7f1f00094f10 2023-12-22T10:01:12.988 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-12-22T10:01:12.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.993+0000 7f1f057b9700 1 -- 172.21.15.45:0/573758874 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f1ee005a510 msgr2=0x7f1ee005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:12.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.993+0000 7f1f057b9700 1 --2- 172.21.15.45:0/573758874 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f1ee005a510 0x7f1ee005c9d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f1ee8006bc0 tx=0x7f1ee8008040).stop 2023-12-22T10:01:12.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.993+0000 7f1f057b9700 1 -- 172.21.15.45:0/573758874 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f00094f10 msgr2=0x7f1f000c5ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:12.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.993+0000 7f1f057b9700 1 --2- 172.21.15.45:0/573758874 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f00094f10 0x7f1f000c5ac0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f1ef0009dd0 tx=0x7f1ef0017000).stop 2023-12-22T10:01:12.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.993+0000 7f1f057b9700 1 -- 172.21.15.45:0/573758874 shutdown_connections 2023-12-22T10:01:12.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.993+0000 7f1f057b9700 1 --2- 172.21.15.45:0/573758874 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1f001537a0 0x7f1f000aa4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:12.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.993+0000 7f1f057b9700 1 --2- 172.21.15.45:0/573758874 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f1ee005a510 0x7f1ee005c9d0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:12.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.993+0000 7f1f057b9700 1 --2- 172.21.15.45:0/573758874 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1f00095e90 0x7f1f000c77a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:12.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.993+0000 7f1f057b9700 1 --2- 172.21.15.45:0/573758874 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f00094f10 0x7f1f000c5ac0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:12.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.993+0000 7f1f057b9700 1 -- 172.21.15.45:0/573758874 >> 172.21.15.45:0/573758874 conn(0x7f1f00067500 msgr2=0x7f1f00154a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:12.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.993+0000 7f1f057b9700 1 -- 172.21.15.45:0/573758874 shutdown_connections 2023-12-22T10:01:12.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:12.997+0000 7f1f057b9700 1 -- 172.21.15.45:0/573758874 wait complete. 2023-12-22T10:01:13.018 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-12-22T10:01:13.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.193+0000 7fc4aa01b700 1 Processor -- start 2023-12-22T10:01:13.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.193+0000 7fc4aa01b700 1 -- start start 2023-12-22T10:01:13.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.197+0000 7fc4aa01b700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fc4a414e080 0x7fc4a40c93c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:13.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.197+0000 7fc4aa01b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc4a4154750 0x7fc4a4154ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:13.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.197+0000 7fc4aa01b700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4a40ca5f0 con 0x7fc4a40ca160 2023-12-22T10:01:13.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.197+0000 7fc4aa01b700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4a4154040 con 0x7fc4a4154750 2023-12-22T10:01:13.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.197+0000 7fc4aa01b700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4a4155090 con 0x7fc4a414e080 2023-12-22T10:01:13.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.197+0000 7fc4a3fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc4a4154750 0x7fc4a4154ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:13.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.197+0000 7fc4a3fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc4a4154750 0x7fc4a4154ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50394/0 (socket says 172.21.15.45:50394) 2023-12-22T10:01:13.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.197+0000 7fc4a3fff700 1 -- 172.21.15.45:0/2625487205 learned_addr learned my addr 172.21.15.45:0/2625487205 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:13.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.197+0000 7fc4a37fe700 1 --2- 172.21.15.45:0/2625487205 >> v2:172.21.15.113:3300/0 conn(0x7fc4a414e080 0x7fc4a40c93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:13.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.197+0000 7fc4a27fc700 1 -- 172.21.15.45:0/2625487205 <== mon.1 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2508861000 0 0) 0x7fc4a40ca5f0 con 0x7fc4a40ca160 2023-12-22T10:01:13.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.197+0000 7fc4a27fc700 1 -- 172.21.15.45:0/2625487205 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc48c0033f0 con 0x7fc4a40ca160 2023-12-22T10:01:13.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.197+0000 7fc4a3fff700 1 -- 172.21.15.45:0/2625487205 >> v2:172.21.15.113:3300/0 conn(0x7fc4a414e080 msgr2=0x7fc4a40c93c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:13.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.197+0000 7fc4a3fff700 1 --2- 172.21.15.45:0/2625487205 >> v2:172.21.15.113:3300/0 conn(0x7fc4a414e080 0x7fc4a40c93c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:13.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.197+0000 7fc4a3fff700 1 -- 172.21.15.45:0/2625487205 >> v1:172.21.15.113:6789/0 conn(0x7fc4a40ca160 legacy=0x7fc4a4157610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:13.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.197+0000 7fc4a3fff700 1 -- 172.21.15.45:0/2625487205 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4a41542c0 con 0x7fc4a4154750 2023-12-22T10:01:13.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.197+0000 7fc4a3fff700 1 --2- 172.21.15.45:0/2625487205 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc4a4154750 0x7fc4a4154ba0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7fc4a40839c0 tx=0x7fc49c009840).ready entity=mon.0 client_cookie=443ba674bf6d07c3 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:13.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.197+0000 7fc4a27fc700 1 -- 172.21.15.45:0/2625487205 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc49c00e070 con 0x7fc4a4154750 2023-12-22T10:01:13.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.197+0000 7fc4a27fc700 1 -- 172.21.15.45:0/2625487205 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc49c00b930 con 0x7fc4a4154750 2023-12-22T10:01:13.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.201+0000 7fc4a27fc700 1 -- 172.21.15.45:0/2625487205 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc49c00bcb0 con 0x7fc4a4154750 2023-12-22T10:01:13.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.201+0000 7fc4aa01b700 1 -- 172.21.15.45:0/2625487205 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc4a4154750 msgr2=0x7fc4a4154ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:13.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.201+0000 7fc4aa01b700 1 --2- 172.21.15.45:0/2625487205 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc4a4154750 0x7fc4a4154ba0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7fc4a40839c0 tx=0x7fc49c009840).stop 2023-12-22T10:01:13.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.201+0000 7fc4aa01b700 1 -- 172.21.15.45:0/2625487205 shutdown_connections 2023-12-22T10:01:13.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.201+0000 7fc4aa01b700 1 --2- 172.21.15.45:0/2625487205 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc4a4154750 0x7fc4a4154ba0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:13.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.201+0000 7fc4aa01b700 1 --2- 172.21.15.45:0/2625487205 >> v2:172.21.15.113:3300/0 conn(0x7fc4a414e080 0x7fc4a40c93c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:13.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.201+0000 7fc4aa01b700 1 -- 172.21.15.45:0/2625487205 >> 172.21.15.45:0/2625487205 conn(0x7fc4a4066a70 msgr2=0x7fc4a4066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:13.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.201+0000 7fc4aa01b700 1 -- 172.21.15.45:0/2625487205 shutdown_connections 2023-12-22T10:01:13.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.201+0000 7fc4aa01b700 1 -- 172.21.15.45:0/2625487205 wait complete. 2023-12-22T10:01:13.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.201+0000 7fc4aa01b700 1 Processor -- start 2023-12-22T10:01:13.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.201+0000 7fc4aa01b700 1 -- start start 2023-12-22T10:01:13.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.205+0000 7fc4aa01b700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc4a40ca160 0x7fc4a4166900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:13.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.205+0000 7fc4aa01b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc4a414e080 0x7fc4a40ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:13.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.205+0000 7fc4aa01b700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc4a4154750 0x7fc4a40acda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:13.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.205+0000 7fc4aa01b700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a4163d50 con 0x7fc4a414e080 2023-12-22T10:01:13.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.205+0000 7fc4aa01b700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a4164030 con 0x7fc4a40ca160 2023-12-22T10:01:13.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.205+0000 7fc4aa01b700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a4164310 con 0x7fc4a4154750 2023-12-22T10:01:13.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.205+0000 7fc4a2ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc4a414e080 0x7fc4a40ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:13.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.205+0000 7fc4a2ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc4a414e080 0x7fc4a40ac8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50396/0 (socket says 172.21.15.45:50396) 2023-12-22T10:01:13.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.205+0000 7fc4a2ffd700 1 -- 172.21.15.45:0/2547229755 learned_addr learned my addr 172.21.15.45:0/2547229755 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:13.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.205+0000 7fc4a3fff700 1 --2- 172.21.15.45:0/2547229755 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc4a4154750 0x7fc4a40acda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:13.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.205+0000 7fc4a37fe700 1 --2- 172.21.15.45:0/2547229755 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc4a40ca160 0x7fc4a4166900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:13.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.205+0000 7fc4a3fff700 1 -- 172.21.15.45:0/2547229755 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc4a40ca160 msgr2=0x7fc4a4166900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:13.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.205+0000 7fc4a3fff700 1 --2- 172.21.15.45:0/2547229755 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc4a40ca160 0x7fc4a4166900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:13.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.205+0000 7fc4a3fff700 1 -- 172.21.15.45:0/2547229755 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc4a414e080 msgr2=0x7fc4a40ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:13.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.205+0000 7fc4a3fff700 1 --2- 172.21.15.45:0/2547229755 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc4a414e080 0x7fc4a40ac8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:13.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.205+0000 7fc4a3fff700 1 -- 172.21.15.45:0/2547229755 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc49c009ae0 con 0x7fc4a4154750 2023-12-22T10:01:13.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.205+0000 7fc4a2ffd700 1 --2- 172.21.15.45:0/2547229755 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc4a414e080 0x7fc4a40ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-12-22T10:01:13.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.205+0000 7fc4a3fff700 1 --2- 172.21.15.45:0/2547229755 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc4a4154750 0x7fc4a40acda0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fc49c013000 tx=0x7fc49c009840).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:13.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.205+0000 7fc48b7fe700 1 -- 172.21.15.45:0/2547229755 <== mon.2 v2:172.21.15.113:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc49c00bea0 con 0x7fc4a4154750 2023-12-22T10:01:13.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.205+0000 7fc4aa01b700 1 -- 172.21.15.45:0/2547229755 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4a41645f0 con 0x7fc4a4154750 2023-12-22T10:01:13.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.205+0000 7fc48b7fe700 1 -- 172.21.15.45:0/2547229755 <== mon.2 v2:172.21.15.113:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc49c0092e0 con 0x7fc4a4154750 2023-12-22T10:01:13.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.205+0000 7fc48b7fe700 1 -- 172.21.15.45:0/2547229755 <== mon.2 v2:172.21.15.113:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc49c007840 con 0x7fc4a4154750 2023-12-22T10:01:13.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.205+0000 7fc4aa01b700 1 -- 172.21.15.45:0/2547229755 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4a414aa40 con 0x7fc4a4154750 2023-12-22T10:01:13.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.209+0000 7fc4aa01b700 1 -- 172.21.15.45:0/2547229755 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4a405eb10 con 0x7fc4a4154750 2023-12-22T10:01:13.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.209+0000 7fc48b7fe700 1 -- 172.21.15.45:0/2547229755 <== mon.2 v2:172.21.15.113:3301/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fc49c003040 con 0x7fc4a4154750 2023-12-22T10:01:13.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.209+0000 7fc48b7fe700 1 --2- 172.21.15.45:0/2547229755 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fc49005a510 0x7fc49005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:13.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.213+0000 7fc48b7fe700 1 -- 172.21.15.45:0/2547229755 <== mon.2 v2:172.21.15.113:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fc49c076170 con 0x7fc4a4154750 2023-12-22T10:01:13.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.213+0000 7fc4a37fe700 1 --2- 172.21.15.45:0/2547229755 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fc49005a510 0x7fc49005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:13.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.213+0000 7fc4a37fe700 1 --2- 172.21.15.45:0/2547229755 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fc49005a510 0x7fc49005c9d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7fc494009c30 tx=0x7fc494009060).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:13.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.217+0000 7fc48b7fe700 1 -- 172.21.15.45:0/2547229755 <== mon.2 v2:172.21.15.113:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc49c049910 con 0x7fc4a4154750 2023-12-22T10:01:13.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.381+0000 7fc4aa01b700 1 -- 172.21.15.45:0/2547229755 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc4a4164450 con 0x7fc4a4154750 2023-12-22T10:01:13.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.381+0000 7fc48b7fe700 1 -- 172.21.15.45:0/2547229755 <== mon.2 v2:172.21.15.113:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc4a4164450 con 0x7fc4a4154750 2023-12-22T10:01:13.380 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-12-22T10:01:13.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.385+0000 7fc4aa01b700 1 -- 172.21.15.45:0/2547229755 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fc49005a510 msgr2=0x7fc49005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:13.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.385+0000 7fc4aa01b700 1 --2- 172.21.15.45:0/2547229755 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fc49005a510 0x7fc49005c9d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7fc494009c30 tx=0x7fc494009060).stop 2023-12-22T10:01:13.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.385+0000 7fc4aa01b700 1 -- 172.21.15.45:0/2547229755 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc4a4154750 msgr2=0x7fc4a40acda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:13.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.385+0000 7fc4aa01b700 1 --2- 172.21.15.45:0/2547229755 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc4a4154750 0x7fc4a40acda0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fc49c013000 tx=0x7fc49c009840).stop 2023-12-22T10:01:13.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.385+0000 7fc4aa01b700 1 -- 172.21.15.45:0/2547229755 shutdown_connections 2023-12-22T10:01:13.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.385+0000 7fc4aa01b700 1 --2- 172.21.15.45:0/2547229755 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fc49005a510 0x7fc49005c9d0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:13.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.385+0000 7fc4aa01b700 1 --2- 172.21.15.45:0/2547229755 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc4a4154750 0x7fc4a40acda0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:13.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.385+0000 7fc4aa01b700 1 --2- 172.21.15.45:0/2547229755 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc4a414e080 0x7fc4a40ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:13.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.385+0000 7fc4aa01b700 1 --2- 172.21.15.45:0/2547229755 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc4a40ca160 0x7fc4a4166900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:13.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.385+0000 7fc4aa01b700 1 -- 172.21.15.45:0/2547229755 >> 172.21.15.45:0/2547229755 conn(0x7fc4a4066a70 msgr2=0x7fc4a4159ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:13.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.385+0000 7fc4aa01b700 1 -- 172.21.15.45:0/2547229755 shutdown_connections 2023-12-22T10:01:13.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.385+0000 7fc4aa01b700 1 -- 172.21.15.45:0/2547229755 wait complete. 2023-12-22T10:01:13.406 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-22T10:01:13.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.573+0000 7fb2ea279700 1 Processor -- start 2023-12-22T10:01:13.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.573+0000 7fb2ea279700 1 -- start start 2023-12-22T10:01:13.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.577+0000 7fb2ea279700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb2e40acc10 0x7fb2e40bfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:13.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.577+0000 7fb2ea279700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb2e40acff0 0x7fb2e40c6c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:13.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.577+0000 7fb2ea279700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2e40ad450 con 0x7fb2e4066a70 2023-12-22T10:01:13.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.577+0000 7fb2ea279700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2e40c7110 con 0x7fb2e40acff0 2023-12-22T10:01:13.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.577+0000 7fb2ea279700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e40aa870 con 0x7fb2e40acc10 2023-12-22T10:01:13.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.577+0000 7fb2e8a76700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb2e40acff0 0x7fb2e40c6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:13.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.577+0000 7fb2e8a76700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb2e40acff0 0x7fb2e40c6c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50404/0 (socket says 172.21.15.45:50404) 2023-12-22T10:01:13.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.577+0000 7fb2e8a76700 1 -- 172.21.15.45:0/1301668484 learned_addr learned my addr 172.21.15.45:0/1301668484 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:13.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.577+0000 7fb2e9277700 1 --2- 172.21.15.45:0/1301668484 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb2e40acc10 0x7fb2e40bfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:13.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.577+0000 7fb2e8a76700 1 -- 172.21.15.45:0/1301668484 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb2e40acc10 msgr2=0x7fb2e40bfcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:13.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.577+0000 7fb2e8a76700 1 --2- 172.21.15.45:0/1301668484 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb2e40acc10 0x7fb2e40bfcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:13.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.577+0000 7fb2e8a76700 1 -- 172.21.15.45:0/1301668484 >> v1:172.21.15.113:6789/0 conn(0x7fb2e4066a70 legacy=0x7fb2e40c5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:13.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.577+0000 7fb2e8a76700 1 -- 172.21.15.45:0/1301668484 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2e40c0320 con 0x7fb2e40acff0 2023-12-22T10:01:13.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.577+0000 7fb2e8a76700 1 --2- 172.21.15.45:0/1301668484 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2e40acff0 0x7fb2e40c6c20 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7fb2d4006fd0 tx=0x7fb2d40090f0).ready entity=mon.0 client_cookie=b300a91794baac18 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:13.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.577+0000 7fb2dbfff700 1 -- 172.21.15.45:0/1301668484 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d400b580 con 0x7fb2e40acff0 2023-12-22T10:01:13.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.577+0000 7fb2dbfff700 1 -- 172.21.15.45:0/1301668484 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2d400b6e0 con 0x7fb2e40acff0 2023-12-22T10:01:13.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.577+0000 7fb2dbfff700 1 -- 172.21.15.45:0/1301668484 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d400ba60 con 0x7fb2e40acff0 2023-12-22T10:01:13.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.577+0000 7fb2ea279700 1 -- 172.21.15.45:0/1301668484 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2e40acff0 msgr2=0x7fb2e40c6c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:13.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.577+0000 7fb2ea279700 1 --2- 172.21.15.45:0/1301668484 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2e40acff0 0x7fb2e40c6c20 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7fb2d4006fd0 tx=0x7fb2d40090f0).stop 2023-12-22T10:01:13.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.577+0000 7fb2ea279700 1 -- 172.21.15.45:0/1301668484 shutdown_connections 2023-12-22T10:01:13.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.577+0000 7fb2ea279700 1 --2- 172.21.15.45:0/1301668484 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2e40acff0 0x7fb2e40c6c20 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:13.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.577+0000 7fb2ea279700 1 --2- 172.21.15.45:0/1301668484 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb2e40acc10 0x7fb2e40bfcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:13.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.577+0000 7fb2ea279700 1 -- 172.21.15.45:0/1301668484 >> 172.21.15.45:0/1301668484 conn(0x7fb2e40cb330 msgr2=0x7fb2e40c7300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:13.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.577+0000 7fb2ea279700 1 -- 172.21.15.45:0/1301668484 shutdown_connections 2023-12-22T10:01:13.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.577+0000 7fb2ea279700 1 -- 172.21.15.45:0/1301668484 wait complete. 2023-12-22T10:01:13.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.581+0000 7fb2ea279700 1 Processor -- start 2023-12-22T10:01:13.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.581+0000 7fb2ea279700 1 -- start start 2023-12-22T10:01:13.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.581+0000 7fb2ea279700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb2e4066a70 0x7fb2e40c6510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:13.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.581+0000 7fb2ea279700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb2e40acc10 0x7fb2e40c3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:13.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.581+0000 7fb2ea279700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2e40acff0 0x7fb2e40c4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:13.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.581+0000 7fb2ea279700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e40c2230 con 0x7fb2e40acff0 2023-12-22T10:01:13.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.581+0000 7fb2ea279700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e40c4660 con 0x7fb2e4066a70 2023-12-22T10:01:13.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.581+0000 7fb2ea279700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e40c1900 con 0x7fb2e40acc10 2023-12-22T10:01:13.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.581+0000 7fb2e9a78700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2e40acff0 0x7fb2e40c4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:13.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.581+0000 7fb2e9277700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb2e4066a70 0x7fb2e40c6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:13.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.581+0000 7fb2e8a76700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb2e40acc10 0x7fb2e40c3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:13.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.581+0000 7fb2e9277700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb2e4066a70 0x7fb2e40c6510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.45:39424/0 (socket says 172.21.15.45:39424) 2023-12-22T10:01:13.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.581+0000 7fb2e9277700 1 -- 172.21.15.45:0/3400175736 learned_addr learned my addr 172.21.15.45:0/3400175736 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:13.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.585+0000 7fb2e8a76700 1 -- 172.21.15.45:0/3400175736 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb2e4066a70 msgr2=0x7fb2e40c6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:13.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.585+0000 7fb2e8a76700 1 --2- 172.21.15.45:0/3400175736 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb2e4066a70 0x7fb2e40c6510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:13.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.585+0000 7fb2e8a76700 1 -- 172.21.15.45:0/3400175736 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2e40acff0 msgr2=0x7fb2e40c4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:13.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.585+0000 7fb2e8a76700 1 --2- 172.21.15.45:0/3400175736 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2e40acff0 0x7fb2e40c4090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:13.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.585+0000 7fb2e8a76700 1 -- 172.21.15.45:0/3400175736 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2d4009370 con 0x7fb2e40acc10 2023-12-22T10:01:13.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.585+0000 7fb2e9a78700 1 --2- 172.21.15.45:0/3400175736 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2e40acff0 0x7fb2e40c4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-12-22T10:01:13.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.585+0000 7fb2e8a76700 1 --2- 172.21.15.45:0/3400175736 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb2e40acc10 0x7fb2e40c3ba0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fb2d4014000 tx=0x7fb2d4017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:13.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.585+0000 7fb2d97fa700 1 -- 172.21.15.45:0/3400175736 <== mon.2 v2:172.21.15.113:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d4000bc0 con 0x7fb2e40acc10 2023-12-22T10:01:13.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.585+0000 7fb2d97fa700 1 -- 172.21.15.45:0/3400175736 <== mon.2 v2:172.21.15.113:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2d400b850 con 0x7fb2e40acc10 2023-12-22T10:01:13.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.585+0000 7fb2d97fa700 1 -- 172.21.15.45:0/3400175736 <== mon.2 v2:172.21.15.113:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d4000d20 con 0x7fb2e40acc10 2023-12-22T10:01:13.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.585+0000 7fb2ea279700 1 -- 172.21.15.45:0/3400175736 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2e40c1be0 con 0x7fb2e40acc10 2023-12-22T10:01:13.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.585+0000 7fb2ea279700 1 -- 172.21.15.45:0/3400175736 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2e4156d40 con 0x7fb2e40acc10 2023-12-22T10:01:13.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.585+0000 7fb2ea279700 1 -- 172.21.15.45:0/3400175736 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2e4047060 con 0x7fb2e40acc10 2023-12-22T10:01:13.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.589+0000 7fb2d97fa700 1 -- 172.21.15.45:0/3400175736 <== mon.2 v2:172.21.15.113:3301/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fb2d401c900 con 0x7fb2e40acc10 2023-12-22T10:01:13.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.589+0000 7fb2d97fa700 1 --2- 172.21.15.45:0/3400175736 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fb2c805a510 0x7fb2c805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:13.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.589+0000 7fb2d97fa700 1 -- 172.21.15.45:0/3400175736 <== mon.2 v2:172.21.15.113:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb2d4075e30 con 0x7fb2e40acc10 2023-12-22T10:01:13.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.589+0000 7fb2e9277700 1 --2- 172.21.15.45:0/3400175736 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fb2c805a510 0x7fb2c805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:13.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.589+0000 7fb2e9277700 1 --2- 172.21.15.45:0/3400175736 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fb2c805a510 0x7fb2c805c9d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7fb2e0009cf0 tx=0x7fb2e0009060).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:13.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.601+0000 7fb2d97fa700 1 -- 172.21.15.45:0/3400175736 <== mon.2 v2:172.21.15.113:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb2d4049610 con 0x7fb2e40acc10 2023-12-22T10:01:13.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.765+0000 7fb2ea279700 1 -- 172.21.15.45:0/3400175736 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb2e40c1a40 con 0x7fb2e40acc10 2023-12-22T10:01:13.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.765+0000 7fb2d97fa700 1 -- 172.21.15.45:0/3400175736 <== mon.2 v2:172.21.15.113:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb2e40c1a40 con 0x7fb2e40acc10 2023-12-22T10:01:13.765 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-22T10:01:13.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.769+0000 7fb2ea279700 1 -- 172.21.15.45:0/3400175736 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fb2c805a510 msgr2=0x7fb2c805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:13.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.769+0000 7fb2ea279700 1 --2- 172.21.15.45:0/3400175736 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fb2c805a510 0x7fb2c805c9d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7fb2e0009cf0 tx=0x7fb2e0009060).stop 2023-12-22T10:01:13.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.769+0000 7fb2ea279700 1 -- 172.21.15.45:0/3400175736 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb2e40acc10 msgr2=0x7fb2e40c3ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:13.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.769+0000 7fb2ea279700 1 --2- 172.21.15.45:0/3400175736 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb2e40acc10 0x7fb2e40c3ba0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fb2d4014000 tx=0x7fb2d4017000).stop 2023-12-22T10:01:13.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.773+0000 7fb2ea279700 1 -- 172.21.15.45:0/3400175736 shutdown_connections 2023-12-22T10:01:13.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.773+0000 7fb2ea279700 1 --2- 172.21.15.45:0/3400175736 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2e40acff0 0x7fb2e40c4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:13.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.773+0000 7fb2ea279700 1 --2- 172.21.15.45:0/3400175736 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fb2c805a510 0x7fb2c805c9d0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:13.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.773+0000 7fb2ea279700 1 --2- 172.21.15.45:0/3400175736 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb2e40acc10 0x7fb2e40c3ba0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:13.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.773+0000 7fb2ea279700 1 --2- 172.21.15.45:0/3400175736 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb2e4066a70 0x7fb2e40c6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:13.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.773+0000 7fb2ea279700 1 -- 172.21.15.45:0/3400175736 >> 172.21.15.45:0/3400175736 conn(0x7fb2e40cb330 msgr2=0x7fb2e40ad970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:13.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.773+0000 7fb2ea279700 1 -- 172.21.15.45:0/3400175736 shutdown_connections 2023-12-22T10:01:13.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.773+0000 7fb2ea279700 1 -- 172.21.15.45:0/3400175736 wait complete. 2023-12-22T10:01:13.794 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-22T10:01:13.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.977+0000 7fa2a8ce4700 1 Processor -- start 2023-12-22T10:01:13.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.977+0000 7fa2a8ce4700 1 -- start start 2023-12-22T10:01:13.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.981+0000 7fa2a8ce4700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fa2a40acc10 0x7fa2a40bfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:13.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.981+0000 7fa2a8ce4700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fa2a4067180 0x7fa2a40c6c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:13.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.981+0000 7fa2a8ce4700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2a40ad450 con 0x7fa2a40acff0 2023-12-22T10:01:13.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.981+0000 7fa2a8ce4700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2a40c7110 con 0x7fa2a40acc10 2023-12-22T10:01:13.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.981+0000 7fa2a8ce4700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a40aa870 con 0x7fa2a4067180 2023-12-22T10:01:13.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.981+0000 7fa2a3fff700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fa2a4067180 0x7fa2a40c6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:13.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.981+0000 7fa2a37fe700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fa2a40acc10 0x7fa2a40bfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:13.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.981+0000 7fa2a3fff700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fa2a4067180 0x7fa2a40c6c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.113:3301/0 says I am v2:172.21.15.45:58396/0 (socket says 172.21.15.45:58396) 2023-12-22T10:01:13.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.981+0000 7fa2a3fff700 1 -- 172.21.15.45:0/3761717332 learned_addr learned my addr 172.21.15.45:0/3761717332 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:13.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.981+0000 7fa2a2ffd700 1 --1- 172.21.15.45:0/3761717332 >> v1:172.21.15.113:6789/0 conn(0x7fa2a40acff0 0x7fa2a4066a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.45:40452/0 (socket says 172.21.15.45:40452) 2023-12-22T10:01:13.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.981+0000 7fa2a27fc700 1 -- 172.21.15.45:0/3761717332 <== mon.1 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1983425505 0 0) 0x7fa2a40ad450 con 0x7fa2a40acff0 2023-12-22T10:01:13.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.981+0000 7fa2a27fc700 1 -- 172.21.15.45:0/3761717332 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa28c0033f0 con 0x7fa2a40acff0 2023-12-22T10:01:13.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.981+0000 7fa2a3fff700 1 -- 172.21.15.45:0/3761717332 >> v2:172.21.15.113:3300/0 conn(0x7fa2a40acc10 msgr2=0x7fa2a40bfcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:13.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.981+0000 7fa2a3fff700 1 --2- 172.21.15.45:0/3761717332 >> v2:172.21.15.113:3300/0 conn(0x7fa2a40acc10 0x7fa2a40bfcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:13.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.981+0000 7fa2a3fff700 1 -- 172.21.15.45:0/3761717332 >> v1:172.21.15.113:6789/0 conn(0x7fa2a40acff0 legacy=0x7fa2a4066a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:13.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.981+0000 7fa2a3fff700 1 -- 172.21.15.45:0/3761717332 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2a40c0320 con 0x7fa2a4067180 2023-12-22T10:01:13.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.981+0000 7fa2a37fe700 1 --2- 172.21.15.45:0/3761717332 >> v2:172.21.15.113:3300/0 conn(0x7fa2a40acc10 0x7fa2a40bfcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-12-22T10:01:13.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.981+0000 7fa2a3fff700 1 --2- 172.21.15.45:0/3761717332 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fa2a4067180 0x7fa2a40c6c20 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fa29c009f20 tx=0x7fa29c009840).ready entity=mon.2 client_cookie=b54f95f122be71d5 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:13.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.985+0000 7fa2a27fc700 1 -- 172.21.15.45:0/3761717332 <== mon.2 v2:172.21.15.113:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa29c00e070 con 0x7fa2a4067180 2023-12-22T10:01:13.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.985+0000 7fa2a27fc700 1 -- 172.21.15.45:0/3761717332 <== mon.2 v2:172.21.15.113:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa29c00b970 con 0x7fa2a4067180 2023-12-22T10:01:13.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.985+0000 7fa2a27fc700 1 -- 172.21.15.45:0/3761717332 <== mon.2 v2:172.21.15.113:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa29c00bcf0 con 0x7fa2a4067180 2023-12-22T10:01:13.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.985+0000 7fa2a8ce4700 1 -- 172.21.15.45:0/3761717332 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fa2a4067180 msgr2=0x7fa2a40c6c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:13.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.985+0000 7fa2a8ce4700 1 --2- 172.21.15.45:0/3761717332 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fa2a4067180 0x7fa2a40c6c20 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fa29c009f20 tx=0x7fa29c009840).stop 2023-12-22T10:01:13.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.985+0000 7fa2a8ce4700 1 -- 172.21.15.45:0/3761717332 shutdown_connections 2023-12-22T10:01:13.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.985+0000 7fa2a8ce4700 1 --2- 172.21.15.45:0/3761717332 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fa2a4067180 0x7fa2a40c6c20 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:13.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.985+0000 7fa2a8ce4700 1 --2- 172.21.15.45:0/3761717332 >> v2:172.21.15.113:3300/0 conn(0x7fa2a40acc10 0x7fa2a40bfcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:13.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.985+0000 7fa2a8ce4700 1 -- 172.21.15.45:0/3761717332 >> 172.21.15.45:0/3761717332 conn(0x7fa2a40cb330 msgr2=0x7fa2a40c7300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:13.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.985+0000 7fa2a8ce4700 1 -- 172.21.15.45:0/3761717332 shutdown_connections 2023-12-22T10:01:13.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.985+0000 7fa2a8ce4700 1 -- 172.21.15.45:0/3761717332 wait complete. 2023-12-22T10:01:13.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.989+0000 7fa2a8ce4700 1 Processor -- start 2023-12-22T10:01:13.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.989+0000 7fa2a8ce4700 1 -- start start 2023-12-22T10:01:13.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.989+0000 7fa2a8ce4700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fa2a4067180 0x7fa2a414fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:13.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.989+0000 7fa2a8ce4700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa2a40acc10 0x7fa2a4155ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:13.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.989+0000 7fa2a8ce4700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2a40acff0 0x7fa2a41458f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:13.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.989+0000 7fa2a8ce4700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a416c420 con 0x7fa2a40acff0 2023-12-22T10:01:13.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.989+0000 7fa2a8ce4700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a4150060 con 0x7fa2a40acc10 2023-12-22T10:01:13.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.989+0000 7fa2a8ce4700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a416b810 con 0x7fa2a4067180 2023-12-22T10:01:13.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.989+0000 7fa2a3fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2a40acff0 0x7fa2a41458f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:13.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.989+0000 7fa2a3fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2a40acff0 0x7fa2a41458f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50420/0 (socket says 172.21.15.45:50420) 2023-12-22T10:01:13.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.989+0000 7fa2a3fff700 1 -- 172.21.15.45:0/828251821 learned_addr learned my addr 172.21.15.45:0/828251821 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:13.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.989+0000 7fa2a37fe700 1 --2- 172.21.15.45:0/828251821 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fa2a4067180 0x7fa2a414fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:13.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.989+0000 7fa2a2ffd700 1 --2- 172.21.15.45:0/828251821 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa2a40acc10 0x7fa2a4155ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:13.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.993+0000 7fa2a3fff700 1 -- 172.21.15.45:0/828251821 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fa2a4067180 msgr2=0x7fa2a414fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:13.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.993+0000 7fa2a3fff700 1 --2- 172.21.15.45:0/828251821 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fa2a4067180 0x7fa2a414fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:13.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.993+0000 7fa2a3fff700 1 -- 172.21.15.45:0/828251821 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa2a40acc10 msgr2=0x7fa2a4155ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:13.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.993+0000 7fa2a3fff700 1 --2- 172.21.15.45:0/828251821 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa2a40acc10 0x7fa2a4155ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:13.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.993+0000 7fa2a3fff700 1 -- 172.21.15.45:0/828251821 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2940092a0 con 0x7fa2a40acff0 2023-12-22T10:01:13.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.993+0000 7fa2a3fff700 1 --2- 172.21.15.45:0/828251821 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2a40acff0 0x7fa2a41458f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7fa2a4046dd0 tx=0x7fa29c009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:13.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.993+0000 7fa28b7fe700 1 -- 172.21.15.45:0/828251821 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa29c007170 con 0x7fa2a40acff0 2023-12-22T10:01:13.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.993+0000 7fa28b7fe700 1 -- 172.21.15.45:0/828251821 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa29c0092e0 con 0x7fa2a40acff0 2023-12-22T10:01:13.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.993+0000 7fa2a8ce4700 1 -- 172.21.15.45:0/828251821 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa29c009ae0 con 0x7fa2a40acff0 2023-12-22T10:01:13.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.993+0000 7fa28b7fe700 1 -- 172.21.15.45:0/828251821 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa29c01e470 con 0x7fa2a40acff0 2023-12-22T10:01:13.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.993+0000 7fa2a8ce4700 1 -- 172.21.15.45:0/828251821 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2a416bdd0 con 0x7fa2a40acff0 2023-12-22T10:01:13.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.993+0000 7fa2a8ce4700 1 -- 172.21.15.45:0/828251821 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2a41541b0 con 0x7fa2a40acff0 2023-12-22T10:01:13.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.997+0000 7fa28b7fe700 1 -- 172.21.15.45:0/828251821 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fa29c003040 con 0x7fa2a40acff0 2023-12-22T10:01:13.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.997+0000 7fa28b7fe700 1 --2- 172.21.15.45:0/828251821 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fa29005a510 0x7fa29005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:13.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.997+0000 7fa28b7fe700 1 -- 172.21.15.45:0/828251821 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fa29c075c00 con 0x7fa2a40acff0 2023-12-22T10:01:13.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.997+0000 7fa2a37fe700 1 --2- 172.21.15.45:0/828251821 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fa29005a510 0x7fa29005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:13.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:13.997+0000 7fa2a37fe700 1 --2- 172.21.15.45:0/828251821 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fa29005a510 0x7fa29005c9d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7fa294009dc0 tx=0x7fa294009060).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:14.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:14.005+0000 7fa28b7fe700 1 -- 172.21.15.45:0/828251821 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fa2a41541b0 con 0x7fa2a40acff0 2023-12-22T10:01:14.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:14.173+0000 7fa2a8ce4700 1 -- 172.21.15.45:0/828251821 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa2a41541b0 con 0x7fa2a40acff0 2023-12-22T10:01:14.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:14.173+0000 7fa28b7fe700 1 -- 172.21.15.45:0/828251821 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa2a41541b0 con 0x7fa2a40acff0 2023-12-22T10:01:14.172 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-22T10:01:14.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:14.177+0000 7fa2a8ce4700 1 -- 172.21.15.45:0/828251821 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fa29005a510 msgr2=0x7fa29005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:14.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:14.177+0000 7fa2a8ce4700 1 --2- 172.21.15.45:0/828251821 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fa29005a510 0x7fa29005c9d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7fa294009dc0 tx=0x7fa294009060).stop 2023-12-22T10:01:14.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:14.177+0000 7fa2a8ce4700 1 -- 172.21.15.45:0/828251821 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2a40acff0 msgr2=0x7fa2a41458f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:14.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:14.177+0000 7fa2a8ce4700 1 --2- 172.21.15.45:0/828251821 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2a40acff0 0x7fa2a41458f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7fa2a4046dd0 tx=0x7fa29c009840).stop 2023-12-22T10:01:14.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:14.177+0000 7fa2a8ce4700 1 -- 172.21.15.45:0/828251821 shutdown_connections 2023-12-22T10:01:14.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:14.177+0000 7fa2a8ce4700 1 --2- 172.21.15.45:0/828251821 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2a40acff0 0x7fa2a41458f0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:14.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:14.177+0000 7fa2a8ce4700 1 --2- 172.21.15.45:0/828251821 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa2a40acc10 0x7fa2a4155ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:14.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:14.177+0000 7fa2a8ce4700 1 --2- 172.21.15.45:0/828251821 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fa29005a510 0x7fa29005c9d0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:14.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:14.177+0000 7fa2a8ce4700 1 --2- 172.21.15.45:0/828251821 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fa2a4067180 0x7fa2a414fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:14.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:14.177+0000 7fa2a8ce4700 1 -- 172.21.15.45:0/828251821 >> 172.21.15.45:0/828251821 conn(0x7fa2a40cb330 msgr2=0x7fa2a414c5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:14.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:14.177+0000 7fa2a8ce4700 1 -- 172.21.15.45:0/828251821 shutdown_connections 2023-12-22T10:01:14.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:14.177+0000 7fa2a8ce4700 1 -- 172.21.15.45:0/828251821 wait complete. 2023-12-22T10:01:14.197 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_recovery_pool.TestRecoveryPool.test_rebuild_simple' 2023-12-22T10:01:14.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:14.357+0000 7f6ec5239700 1 Processor -- start 2023-12-22T10:01:14.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:14.357+0000 7f6ec5239700 1 -- start start 2023-12-22T10:01:14.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:14.361+0000 7f6ec5239700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f6ec0150730 0x7f6ec0068a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:14.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:14.361+0000 7f6ec5239700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f6ec006a290 0x7f6ec00c20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:14.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:14.361+0000 7f6ec5239700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ec0068f70 con 0x7f6ec00c6b70 2023-12-22T10:01:14.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:14.361+0000 7f6ec5239700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ec00691f0 con 0x7f6ec0150730 2023-12-22T10:01:14.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:14.361+0000 7f6ec5239700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec00694d0 con 0x7f6ec006a290 2023-12-22T10:01:14.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:14.361+0000 7f6ec4a38700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f6ec00c6b70 0x7f6ec00c25d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:55898/0 (socket says 172.21.15.45:55898) 2023-12-22T10:01:14.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:14.361+0000 7f6ec4a38700 1 -- 172.21.15.45:0/3298534750 learned_addr learned my addr 172.21.15.45:0/3298534750 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:01:14.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:14.361+0000 7f6ebffff700 1 --2- 172.21.15.45:0/3298534750 >> v2:172.21.15.113:3300/0 conn(0x7f6ec0150730 0x7f6ec0068a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:14.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:14.361+0000 7f6eb77fe700 1 --2- 172.21.15.45:0/3298534750 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f6ec006a290 0x7f6ec00c20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:14.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:14.361+0000 7f6ebf7fe700 1 -- 172.21.15.45:0/3298534750 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1502252659 0 0) 0x7f6ec0068f70 con 0x7f6ec00c6b70 2023-12-22T10:01:14.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:14.361+0000 7f6ebf7fe700 1 -- 172.21.15.45:0/3298534750 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6eac0033f0 con 0x7f6ec00c6b70 2023-12-22T10:01:14.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:14.361+0000 7f6eb77fe700 1 -- 172.21.15.45:0/3298534750 >> v2:172.21.15.113:3300/0 conn(0x7f6ec0150730 msgr2=0x7f6ec0068a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:14.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:14.361+0000 7f6eb77fe700 1 --2- 172.21.15.45:0/3298534750 >> v2:172.21.15.113:3300/0 conn(0x7f6ec0150730 0x7f6ec0068a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:14.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:14.361+0000 7f6eb77fe700 1 -- 172.21.15.45:0/3298534750 >> v1:172.21.15.45:6789/0 conn(0x7f6ec00c6b70 legacy=0x7f6ec00c25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:14.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:14.361+0000 7f6ebf7fe700 1 -- 172.21.15.45:0/3298534750 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3026751586 0 0) 0x7f6eac0033f0 con 0x7f6ec00c6b70 2023-12-22T10:01:14.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:14.365+0000 7f6eb77fe700 1 -- 172.21.15.45:0/3298534750 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ec00697b0 con 0x7f6ec006a290 2023-12-22T10:01:14.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:14.365+0000 7f6eb77fe700 1 --2- 172.21.15.45:0/3298534750 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f6ec006a290 0x7f6ec00c20e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f6ea8009760 tx=0x7f6ea8009060).ready entity=mon.2 client_cookie=c6119349bf768b67 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:14.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:14.365+0000 7f6ebf7fe700 1 -- 172.21.15.45:0/3298534750 <== mon.2 v2:172.21.15.113:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb8001470 con 0x7f6ec006a290 2023-12-22T10:01:14.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:14.365+0000 7f6ebf7fe700 1 -- 172.21.15.45:0/3298534750 <== mon.2 v2:172.21.15.113:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ea8011400 con 0x7f6ec006a290 2023-12-22T10:01:14.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:14.365+0000 7f6ebf7fe700 1 -- 172.21.15.45:0/3298534750 <== mon.2 v2:172.21.15.113:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea8011780 con 0x7f6ec006a290 2023-12-22T10:01:14.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:14.365+0000 7f6ec5239700 1 -- 172.21.15.45:0/3298534750 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f6ec006a290 msgr2=0x7f6ec00c20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:14.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:14.365+0000 7f6ec5239700 1 --2- 172.21.15.45:0/3298534750 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f6ec006a290 0x7f6ec00c20e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f6ea8009760 tx=0x7f6ea8009060).stop 2023-12-22T10:01:14.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:14.365+0000 7f6ec5239700 1 -- 172.21.15.45:0/3298534750 shutdown_connections 2023-12-22T10:01:14.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:14.365+0000 7f6ec5239700 1 --2- 172.21.15.45:0/3298534750 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f6ec006a290 0x7f6ec00c20e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:14.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:14.365+0000 7f6ec5239700 1 --2- 172.21.15.45:0/3298534750 >> v2:172.21.15.113:3300/0 conn(0x7f6ec0150730 0x7f6ec0068a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:14.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:14.365+0000 7f6ec5239700 1 -- 172.21.15.45:0/3298534750 >> 172.21.15.45:0/3298534750 conn(0x7f6ec0067540 msgr2=0x7f6ec00c6460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:14.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:14.365+0000 7f6ec5239700 1 -- 172.21.15.45:0/3298534750 shutdown_connections 2023-12-22T10:01:14.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:14.365+0000 7f6ec5239700 1 -- 172.21.15.45:0/3298534750 wait complete. 2023-12-22T10:01:14.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:14.369+0000 7f6ec5239700 1 Processor -- start 2023-12-22T10:01:14.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:14.369+0000 7f6ec5239700 1 -- start start 2023-12-22T10:01:14.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:14.369+0000 7f6ec5239700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f6ec006a290 0x7f6ec014f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:14.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:14.369+0000 7f6ec5239700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6ec00c6b70 0x7f6ec00be650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:14.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:14.369+0000 7f6ec5239700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ec0150730 0x7f6ec00bfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:14.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:14.369+0000 7f6ec5239700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec00bf840 con 0x7f6ec0150730 2023-12-22T10:01:14.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:14.369+0000 7f6ec5239700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec014fe00 con 0x7f6ec00c6b70 2023-12-22T10:01:14.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:14.369+0000 7f6ec5239700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec00bec30 con 0x7f6ec006a290 2023-12-22T10:01:14.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:14.369+0000 7f6ec4a38700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ec0150730 0x7f6ec00bfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:14.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:14.369+0000 7f6ec4a38700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ec0150730 0x7f6ec00bfcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50424/0 (socket says 172.21.15.45:50424) 2023-12-22T10:01:14.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:14.369+0000 7f6ec4a38700 1 -- 172.21.15.45:0/1873321718 learned_addr learned my addr 172.21.15.45:0/1873321718 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:14.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:14.369+0000 7f6ebffff700 1 --2- 172.21.15.45:0/1873321718 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f6ec006a290 0x7f6ec014f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:14.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:14.369+0000 7f6eb77fe700 1 --2- 172.21.15.45:0/1873321718 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6ec00c6b70 0x7f6ec00be650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:14.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:14.369+0000 7f6ec4a38700 1 -- 172.21.15.45:0/1873321718 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f6ec006a290 msgr2=0x7f6ec014f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:14.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:14.369+0000 7f6ec4a38700 1 --2- 172.21.15.45:0/1873321718 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f6ec006a290 0x7f6ec014f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:14.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:14.369+0000 7f6ec4a38700 1 -- 172.21.15.45:0/1873321718 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6ec00c6b70 msgr2=0x7f6ec00be650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:14.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:14.369+0000 7f6ec4a38700 1 --2- 172.21.15.45:0/1873321718 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6ec00c6b70 0x7f6ec00be650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:14.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:14.369+0000 7f6ec4a38700 1 -- 172.21.15.45:0/1873321718 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ea80092a0 con 0x7f6ec0150730 2023-12-22T10:01:14.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:14.373+0000 7f6ebffff700 1 --2- 172.21.15.45:0/1873321718 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f6ec006a290 0x7f6ec014f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-12-22T10:01:14.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:14.373+0000 7f6eb77fe700 1 --2- 172.21.15.45:0/1873321718 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6ec00c6b70 0x7f6ec00be650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-12-22T10:01:14.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:14.373+0000 7f6ec4a38700 1 --2- 172.21.15.45:0/1873321718 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ec0150730 0x7f6ec00bfcd0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f6eb800c810 tx=0x7f6eb8001aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:14.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:14.373+0000 7f6ebcff9700 1 -- 172.21.15.45:0/1873321718 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb8007170 con 0x7f6ec0150730 2023-12-22T10:01:14.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:14.373+0000 7f6ebcff9700 1 -- 172.21.15.45:0/1873321718 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eb80072d0 con 0x7f6ec0150730 2023-12-22T10:01:14.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:14.373+0000 7f6ebcff9700 1 -- 172.21.15.45:0/1873321718 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb80048c0 con 0x7f6ec0150730 2023-12-22T10:01:14.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:14.373+0000 7f6ec5239700 1 -- 172.21.15.45:0/1873321718 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ec00bef10 con 0x7f6ec0150730 2023-12-22T10:01:14.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:14.373+0000 7f6ec5239700 1 -- 172.21.15.45:0/1873321718 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ec00bf4d0 con 0x7f6ec0150730 2023-12-22T10:01:14.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:14.373+0000 7f6ec5239700 1 -- 172.21.15.45:0/1873321718 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ec0047060 con 0x7f6ec0150730 2023-12-22T10:01:14.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:14.373+0000 7f6ebcff9700 1 -- 172.21.15.45:0/1873321718 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f6eb8004cf0 con 0x7f6ec0150730 2023-12-22T10:01:14.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:14.377+0000 7f6ebcff9700 1 --2- 172.21.15.45:0/1873321718 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f6ea005a510 0x7f6ea005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:14.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:14.377+0000 7f6ebcff9700 1 -- 172.21.15.45:0/1873321718 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f6eb8074330 con 0x7f6ec0150730 2023-12-22T10:01:14.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:14.377+0000 7f6ebffff700 1 --2- 172.21.15.45:0/1873321718 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f6ea005a510 0x7f6ea005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:14.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:14.377+0000 7f6ebffff700 1 --2- 172.21.15.45:0/1873321718 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f6ea005a510 0x7f6ea005c9d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f6ec014fc30 tx=0x7f6eb000b040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:14.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:14.381+0000 7f6ebcff9700 1 -- 172.21.15.45:0/1873321718 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f6eb8047a50 con 0x7f6ec0150730 2023-12-22T10:01:14.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:14.601+0000 7f6ec5239700 1 -- 172.21.15.45:0/1873321718 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_recovery_pool.TestRecoveryPool.test_rebuild_simple"]} v 0) v1 -- 0x7f6ec00bcb80 con 0x7f6ec0150730 2023-12-22T10:01:15.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:15.109+0000 7f6ebcff9700 1 -- 172.21.15.45:0/1873321718 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_recovery_pool.TestRecoveryPool.test_rebuild_simple"]}]=0 v57) v1 ==== 150+0+0 (secure 0 0 0) 0x7f6eb804b070 con 0x7f6ec0150730 2023-12-22T10:01:15.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:15.113+0000 7f6ec5239700 1 -- 172.21.15.45:0/1873321718 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f6ea005a510 msgr2=0x7f6ea005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:15.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:15.113+0000 7f6ec5239700 1 --2- 172.21.15.45:0/1873321718 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f6ea005a510 0x7f6ea005c9d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f6ec014fc30 tx=0x7f6eb000b040).stop 2023-12-22T10:01:15.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:15.113+0000 7f6ec5239700 1 -- 172.21.15.45:0/1873321718 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ec0150730 msgr2=0x7f6ec00bfcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:15.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:15.113+0000 7f6ec5239700 1 --2- 172.21.15.45:0/1873321718 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ec0150730 0x7f6ec00bfcd0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f6eb800c810 tx=0x7f6eb8001aa0).stop 2023-12-22T10:01:15.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:15.113+0000 7f6ec5239700 1 -- 172.21.15.45:0/1873321718 shutdown_connections 2023-12-22T10:01:15.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:15.113+0000 7f6ec5239700 1 --2- 172.21.15.45:0/1873321718 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ec0150730 0x7f6ec00bfcd0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:15.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:15.113+0000 7f6ec5239700 1 --2- 172.21.15.45:0/1873321718 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6ec00c6b70 0x7f6ec00be650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:15.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:15.113+0000 7f6ec5239700 1 --2- 172.21.15.45:0/1873321718 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f6ea005a510 0x7f6ea005c9d0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:15.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:15.113+0000 7f6ec5239700 1 --2- 172.21.15.45:0/1873321718 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f6ec006a290 0x7f6ec014f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:15.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:15.113+0000 7f6ec5239700 1 -- 172.21.15.45:0/1873321718 >> 172.21.15.45:0/1873321718 conn(0x7f6ec0067540 msgr2=0x7f6ec00c4420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:15.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:15.113+0000 7f6ec5239700 1 -- 172.21.15.45:0/1873321718 shutdown_connections 2023-12-22T10:01:15.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:15.113+0000 7f6ec5239700 1 -- 172.21.15.45:0/1873321718 wait complete. 2023-12-22T10:01:15.136 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-22T10:01:15.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:15.313+0000 7fe80409b700 1 Processor -- start 2023-12-22T10:01:15.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:15.313+0000 7fe80409b700 1 -- start start 2023-12-22T10:01:15.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:15.317+0000 7fe80409b700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fe7fc0c1d80 0x7fe7fc158120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:15.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:15.317+0000 7fe80409b700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fe7fc065930 0x7fe7fc0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:15.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:15.317+0000 7fe80409b700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7fc069180 con 0x7fe7fc157d40 2023-12-22T10:01:15.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:15.317+0000 7fe80409b700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7fc069e00 con 0x7fe7fc0c1d80 2023-12-22T10:01:15.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:15.317+0000 7fe80409b700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7fc069460 con 0x7fe7fc065930 2023-12-22T10:01:15.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:15.317+0000 7fe802638700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fe7fc065930 0x7fe7fc0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:15.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:15.317+0000 7fe801636700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fe7fc0c1d80 0x7fe7fc158120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:15.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:15.317+0000 7fe801636700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fe7fc0c1d80 0x7fe7fc158120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.45:39454/0 (socket says 172.21.15.45:39454) 2023-12-22T10:01:15.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:15.317+0000 7fe802638700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fe7fc065930 0x7fe7fc0a5810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.113:3301/0 says I am v2:172.21.15.45:58428/0 (socket says 172.21.15.45:58428) 2023-12-22T10:01:15.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:15.317+0000 7fe801636700 1 -- 172.21.15.45:0/2400928983 learned_addr learned my addr 172.21.15.45:0/2400928983 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:15.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:15.317+0000 7fe802638700 1 -- 172.21.15.45:0/2400928983 >> v2:172.21.15.113:3300/0 conn(0x7fe7fc0c1d80 msgr2=0x7fe7fc158120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:15.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:15.317+0000 7fe802638700 1 --2- 172.21.15.45:0/2400928983 >> v2:172.21.15.113:3300/0 conn(0x7fe7fc0c1d80 0x7fe7fc158120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:15.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:15.317+0000 7fe802638700 1 -- 172.21.15.45:0/2400928983 >> v1:172.21.15.113:6789/0 conn(0x7fe7fc157d40 legacy=0x7fe7fc0c1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:15.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:15.317+0000 7fe802638700 1 -- 172.21.15.45:0/2400928983 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7fc069740 con 0x7fe7fc065930 2023-12-22T10:01:15.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:15.321+0000 7fe802638700 1 --2- 172.21.15.45:0/2400928983 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fe7fc065930 0x7fe7fc0a5810 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fe7f4009e60 tx=0x7fe7f4009780).ready entity=mon.2 client_cookie=e15ffbaec38cc541 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:15.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:15.321+0000 7fe800e35700 1 -- 172.21.15.45:0/2400928983 <== mon.2 v2:172.21.15.113:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f400e070 con 0x7fe7fc065930 2023-12-22T10:01:15.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:15.321+0000 7fe800e35700 1 -- 172.21.15.45:0/2400928983 <== mon.2 v2:172.21.15.113:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7f400bb60 con 0x7fe7fc065930 2023-12-22T10:01:15.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:15.321+0000 7fe800e35700 1 -- 172.21.15.45:0/2400928983 <== mon.2 v2:172.21.15.113:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f4012410 con 0x7fe7fc065930 2023-12-22T10:01:15.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:15.321+0000 7fe80409b700 1 -- 172.21.15.45:0/2400928983 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fe7fc065930 msgr2=0x7fe7fc0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:15.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:15.321+0000 7fe80409b700 1 --2- 172.21.15.45:0/2400928983 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fe7fc065930 0x7fe7fc0a5810 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fe7f4009e60 tx=0x7fe7f4009780).stop 2023-12-22T10:01:15.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:15.321+0000 7fe80409b700 1 -- 172.21.15.45:0/2400928983 shutdown_connections 2023-12-22T10:01:15.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:15.321+0000 7fe80409b700 1 --2- 172.21.15.45:0/2400928983 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fe7fc065930 0x7fe7fc0a5810 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:15.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:15.321+0000 7fe80409b700 1 --2- 172.21.15.45:0/2400928983 >> v2:172.21.15.113:3300/0 conn(0x7fe7fc0c1d80 0x7fe7fc158120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:15.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:15.321+0000 7fe80409b700 1 -- 172.21.15.45:0/2400928983 >> 172.21.15.45:0/2400928983 conn(0x7fe7fc066a70 msgr2=0x7fe7fc066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:15.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:15.321+0000 7fe80409b700 1 -- 172.21.15.45:0/2400928983 shutdown_connections 2023-12-22T10:01:15.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:15.321+0000 7fe80409b700 1 -- 172.21.15.45:0/2400928983 wait complete. 2023-12-22T10:01:15.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:15.325+0000 7fe80409b700 1 Processor -- start 2023-12-22T10:01:15.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:15.325+0000 7fe80409b700 1 -- start start 2023-12-22T10:01:15.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:15.325+0000 7fe80409b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7fc065930 0x7fe7fc14a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:15.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:15.325+0000 7fe80409b700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fe7fc0c1d80 0x7fe7fc0c69c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:15.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:15.325+0000 7fe80409b700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe7fc157d40 0x7fe7fc16af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:15.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:15.325+0000 7fe80409b700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7fc16aab0 con 0x7fe7fc065930 2023-12-22T10:01:15.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:15.325+0000 7fe80409b700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7fc14a190 con 0x7fe7fc157d40 2023-12-22T10:01:15.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:15.325+0000 7fe80409b700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7fc169ea0 con 0x7fe7fc0c1d80 2023-12-22T10:01:15.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:15.325+0000 7fe801e37700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7fc065930 0x7fe7fc14a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:15.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:15.325+0000 7fe801e37700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7fc065930 0x7fe7fc14a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50430/0 (socket says 172.21.15.45:50430) 2023-12-22T10:01:15.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:15.325+0000 7fe801e37700 1 -- 172.21.15.45:0/923814236 learned_addr learned my addr 172.21.15.45:0/923814236 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:15.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:15.329+0000 7fe801636700 1 --2- 172.21.15.45:0/923814236 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fe7fc0c1d80 0x7fe7fc0c69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:15.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:15.329+0000 7fe802638700 1 --2- 172.21.15.45:0/923814236 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe7fc157d40 0x7fe7fc16af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:15.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:15.329+0000 7fe801e37700 1 -- 172.21.15.45:0/923814236 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fe7fc0c1d80 msgr2=0x7fe7fc0c69c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:15.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:15.329+0000 7fe801e37700 1 --2- 172.21.15.45:0/923814236 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fe7fc0c1d80 0x7fe7fc0c69c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:15.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:15.329+0000 7fe801e37700 1 -- 172.21.15.45:0/923814236 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe7fc157d40 msgr2=0x7fe7fc16af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:15.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:15.329+0000 7fe801e37700 1 --2- 172.21.15.45:0/923814236 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe7fc157d40 0x7fe7fc16af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:15.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:15.329+0000 7fe801e37700 1 -- 172.21.15.45:0/923814236 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7f4009a20 con 0x7fe7fc065930 2023-12-22T10:01:15.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:15.329+0000 7fe801636700 1 --2- 172.21.15.45:0/923814236 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fe7fc0c1d80 0x7fe7fc0c69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-12-22T10:01:15.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:15.329+0000 7fe801e37700 1 --2- 172.21.15.45:0/923814236 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7fc065930 0x7fe7fc14a710 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7fe7f800c470 tx=0x7fe7f8007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:15.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:15.329+0000 7fe7f1ffb700 1 -- 172.21.15.45:0/923814236 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f8007020 con 0x7fe7fc065930 2023-12-22T10:01:15.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:15.329+0000 7fe7f1ffb700 1 -- 172.21.15.45:0/923814236 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7f8007180 con 0x7fe7fc065930 2023-12-22T10:01:15.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:15.329+0000 7fe7f1ffb700 1 -- 172.21.15.45:0/923814236 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f8007520 con 0x7fe7fc065930 2023-12-22T10:01:15.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:15.329+0000 7fe80409b700 1 -- 172.21.15.45:0/923814236 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7fc16a180 con 0x7fe7fc065930 2023-12-22T10:01:15.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:15.329+0000 7fe80409b700 1 -- 172.21.15.45:0/923814236 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7fc16a740 con 0x7fe7fc065930 2023-12-22T10:01:15.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:15.329+0000 7fe80409b700 1 -- 172.21.15.45:0/923814236 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7fc06c070 con 0x7fe7fc065930 2023-12-22T10:01:15.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:15.333+0000 7fe7f1ffb700 1 -- 172.21.15.45:0/923814236 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fe7f80068b0 con 0x7fe7fc065930 2023-12-22T10:01:15.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:15.333+0000 7fe7f1ffb700 1 --2- 172.21.15.45:0/923814236 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fe7e005a510 0x7fe7e005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:15.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:15.333+0000 7fe7f1ffb700 1 -- 172.21.15.45:0/923814236 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fe7f8073a80 con 0x7fe7fc065930 2023-12-22T10:01:15.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:15.337+0000 7fe801636700 1 --2- 172.21.15.45:0/923814236 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fe7e005a510 0x7fe7e005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:15.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:15.337+0000 7fe801636700 1 --2- 172.21.15.45:0/923814236 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fe7e005a510 0x7fe7e005c9d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7fe7fc0c7380 tx=0x7fe7ec0090f0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:15.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:15.341+0000 7fe7f1ffb700 1 -- 172.21.15.45:0/923814236 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fe7f80471a0 con 0x7fe7fc065930 2023-12-22T10:01:15.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:15.509+0000 7fe80409b700 1 -- 172.21.15.45:0/923814236 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fe7fc069a20 con 0x7fe7fc065930 2023-12-22T10:01:15.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:15.521+0000 7fe7f1ffb700 1 -- 172.21.15.45:0/923814236 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v2)=0 v2) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe7f804a7c0 con 0x7fe7fc065930 2023-12-22T10:01:15.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:15.521+0000 7fe80409b700 1 -- 172.21.15.45:0/923814236 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fe7e005a510 msgr2=0x7fe7e005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:15.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:15.521+0000 7fe80409b700 1 --2- 172.21.15.45:0/923814236 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fe7e005a510 0x7fe7e005c9d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7fe7fc0c7380 tx=0x7fe7ec0090f0).stop 2023-12-22T10:01:15.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:15.521+0000 7fe80409b700 1 -- 172.21.15.45:0/923814236 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7fc065930 msgr2=0x7fe7fc14a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:15.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:15.521+0000 7fe80409b700 1 --2- 172.21.15.45:0/923814236 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7fc065930 0x7fe7fc14a710 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7fe7f800c470 tx=0x7fe7f8007e00).stop 2023-12-22T10:01:15.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:15.521+0000 7fe80409b700 1 -- 172.21.15.45:0/923814236 shutdown_connections 2023-12-22T10:01:15.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:15.521+0000 7fe80409b700 1 --2- 172.21.15.45:0/923814236 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe7fc157d40 0x7fe7fc16af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:15.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:15.521+0000 7fe80409b700 1 --2- 172.21.15.45:0/923814236 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fe7e005a510 0x7fe7e005c9d0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:15.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:15.525+0000 7fe80409b700 1 --2- 172.21.15.45:0/923814236 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fe7fc0c1d80 0x7fe7fc0c69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:15.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:15.525+0000 7fe80409b700 1 --2- 172.21.15.45:0/923814236 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7fc065930 0x7fe7fc14a710 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:15.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:15.525+0000 7fe80409b700 1 -- 172.21.15.45:0/923814236 >> 172.21.15.45:0/923814236 conn(0x7fe7fc066a70 msgr2=0x7fe7fc1541d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:15.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:15.525+0000 7fe80409b700 1 -- 172.21.15.45:0/923814236 shutdown_connections 2023-12-22T10:01:15.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:15.525+0000 7fe80409b700 1 -- 172.21.15.45:0/923814236 wait complete. 2023-12-22T10:01:15.545 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-22T10:01:15.545 DEBUG:teuthology.orchestra.run.smithi045:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-22T10:01:15.588 DEBUG:teuthology.orchestra.run.smithi113:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-22T10:01:15.632 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-22T10:01:15.632 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi045.front.sepia.ceph.com... 2023-12-22T10:01:15.632 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-12-22T10:01:15.633 DEBUG:teuthology.orchestra.run.smithi045:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-12-22T10:01:15.682 INFO:teuthology.orchestra.run:waiting for 900 2023-12-22T10:01:15.682 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi045.front.sepia.ceph.com 2023-12-22T10:01:15.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T10:01:15.683 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-22T10:01:15.760 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi113.front.sepia.ceph.com... 2023-12-22T10:01:15.761 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-12-22T10:01:15.761 DEBUG:teuthology.orchestra.run.smithi113:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-12-22T10:01:15.812 INFO:teuthology.orchestra.run:waiting for 900 2023-12-22T10:01:15.812 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi113.front.sepia.ceph.com 2023-12-22T10:01:15.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T10:01:15.812 DEBUG:teuthology.orchestra.run.smithi113:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-22T10:01:15.884 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi045.front.sepia.ceph.com... 2023-12-22T10:01:15.885 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-12-22T10:01:15.885 DEBUG:teuthology.orchestra.run.smithi045:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2023-12-22T10:01:15.922 INFO:teuthology.orchestra.run:waiting for 900 2023-12-22T10:01:15.923 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi045.front.sepia.ceph.com 2023-12-22T10:01:15.923 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T10:01:15.923 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-12-22T10:01:15.989 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi113.front.sepia.ceph.com... 2023-12-22T10:01:15.989 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-12-22T10:01:15.989 DEBUG:teuthology.orchestra.run.smithi113:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2023-12-22T10:01:16.021 INFO:teuthology.orchestra.run:waiting for 900 2023-12-22T10:01:16.021 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi113.front.sepia.ceph.com 2023-12-22T10:01:16.022 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T10:01:16.022 DEBUG:teuthology.orchestra.run.smithi113:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-12-22T10:01:16.089 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-12-22T10:01:16.089 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T10:01:16.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.261+0000 7f4e1c21b700 1 Processor -- start 2023-12-22T10:01:16.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.265+0000 7f4e1c21b700 1 -- start start 2023-12-22T10:01:16.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.265+0000 7f4e1c21b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4e141581f0 0x7f4e140c3080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:16.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.265+0000 7f4e1c21b700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e140a68b0 con 0x7f4e14157e10 2023-12-22T10:01:16.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.265+0000 7f4e1c21b700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e14065610 con 0x7f4e140c3570 2023-12-22T10:01:16.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.265+0000 7f4e1c21b700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e140658f0 con 0x7f4e141581f0 2023-12-22T10:01:16.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.265+0000 7f4e197b6700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4e141581f0 0x7f4e140c3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:16.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.265+0000 7f4e19fb7700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f4e14157e10 0x7f4e140c1820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:55908/0 (socket says 172.21.15.45:55908) 2023-12-22T10:01:16.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.265+0000 7f4e19fb7700 1 -- 172.21.15.45:0/1089390173 learned_addr learned my addr 172.21.15.45:0/1089390173 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:01:16.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.269+0000 7f4e18fb5700 1 -- 172.21.15.45:0/1089390173 <== mon.1 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2298167662 0 0) 0x7f4e14065610 con 0x7f4e140c3570 2023-12-22T10:01:16.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.269+0000 7f4e197b6700 1 -- 172.21.15.45:0/1089390173 >> v1:172.21.15.113:6789/0 conn(0x7f4e140c3570 legacy=0x7f4e140a7070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:16.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.269+0000 7f4e197b6700 1 -- 172.21.15.45:0/1089390173 >> v1:172.21.15.45:6789/0 conn(0x7f4e14157e10 legacy=0x7f4e140c1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:16.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.269+0000 7f4e197b6700 1 -- 172.21.15.45:0/1089390173 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e14065bd0 con 0x7f4e141581f0 2023-12-22T10:01:16.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.269+0000 7f4e197b6700 1 --2- 172.21.15.45:0/1089390173 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e141581f0 0x7f4e140c3080 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f4e04009760 tx=0x7f4e04009060).ready entity=mon.0 client_cookie=5ab35979fea2aee6 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:16.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.269+0000 7f4e18fb5700 1 -- 172.21.15.45:0/1089390173 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e0400f510 con 0x7f4e141581f0 2023-12-22T10:01:16.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.269+0000 7f4e18fb5700 1 -- 172.21.15.45:0/1089390173 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e0400f670 con 0x7f4e141581f0 2023-12-22T10:01:16.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.269+0000 7f4e18fb5700 1 -- 172.21.15.45:0/1089390173 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e0400f9f0 con 0x7f4e141581f0 2023-12-22T10:01:16.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.269+0000 7f4e1c21b700 1 -- 172.21.15.45:0/1089390173 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e141581f0 msgr2=0x7f4e140c3080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:16.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.269+0000 7f4e1c21b700 1 --2- 172.21.15.45:0/1089390173 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e141581f0 0x7f4e140c3080 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f4e04009760 tx=0x7f4e04009060).stop 2023-12-22T10:01:16.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.269+0000 7f4e1c21b700 1 -- 172.21.15.45:0/1089390173 shutdown_connections 2023-12-22T10:01:16.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.269+0000 7f4e1c21b700 1 --2- 172.21.15.45:0/1089390173 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e141581f0 0x7f4e140c3080 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:16.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.269+0000 7f4e1c21b700 1 -- 172.21.15.45:0/1089390173 >> 172.21.15.45:0/1089390173 conn(0x7f4e14066a70 msgr2=0x7f4e14066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:16.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.269+0000 7f4e1c21b700 1 -- 172.21.15.45:0/1089390173 shutdown_connections 2023-12-22T10:01:16.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.269+0000 7f4e1c21b700 1 -- 172.21.15.45:0/1089390173 wait complete. 2023-12-22T10:01:16.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.273+0000 7f4e1c21b700 1 Processor -- start 2023-12-22T10:01:16.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.273+0000 7f4e1c21b700 1 -- start start 2023-12-22T10:01:16.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.273+0000 7f4e1c21b700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f4e140c3570 0x7f4e1415c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:16.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.273+0000 7f4e1c21b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e14157e10 0x7f4e140bfbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:16.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.273+0000 7f4e1c21b700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4e141581f0 0x7f4e14153a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:16.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.273+0000 7f4e1c21b700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1415d990 con 0x7f4e14157e10 2023-12-22T10:01:16.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.273+0000 7f4e1c21b700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1415cd80 con 0x7f4e141581f0 2023-12-22T10:01:16.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.273+0000 7f4e1c21b700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1415d060 con 0x7f4e140c3570 2023-12-22T10:01:16.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.277+0000 7f4e197b6700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e14157e10 0x7f4e140bfbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:16.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.277+0000 7f4e197b6700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e14157e10 0x7f4e140bfbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50452/0 (socket says 172.21.15.45:50452) 2023-12-22T10:01:16.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.277+0000 7f4e197b6700 1 -- 172.21.15.45:0/283760021 learned_addr learned my addr 172.21.15.45:0/283760021 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:16.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.277+0000 7f4e19fb7700 1 --2- 172.21.15.45:0/283760021 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f4e140c3570 0x7f4e1415c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:16.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.277+0000 7f4e1a7b8700 1 --2- 172.21.15.45:0/283760021 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4e141581f0 0x7f4e14153a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:16.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.277+0000 7f4e197b6700 1 -- 172.21.15.45:0/283760021 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f4e140c3570 msgr2=0x7f4e1415c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:16.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.277+0000 7f4e197b6700 1 --2- 172.21.15.45:0/283760021 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f4e140c3570 0x7f4e1415c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:16.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.277+0000 7f4e197b6700 1 -- 172.21.15.45:0/283760021 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4e141581f0 msgr2=0x7f4e14153a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:16.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.277+0000 7f4e197b6700 1 --2- 172.21.15.45:0/283760021 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4e141581f0 0x7f4e14153a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:16.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.277+0000 7f4e197b6700 1 -- 172.21.15.45:0/283760021 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e040092a0 con 0x7f4e14157e10 2023-12-22T10:01:16.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.277+0000 7f4e197b6700 1 --2- 172.21.15.45:0/283760021 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e14157e10 0x7f4e140bfbd0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7f4e140643a0 tx=0x7f4e04017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:16.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.277+0000 7f4e09ffb700 1 -- 172.21.15.45:0/283760021 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e0400f9f0 con 0x7f4e14157e10 2023-12-22T10:01:16.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.277+0000 7f4e09ffb700 1 -- 172.21.15.45:0/283760021 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e04000c90 con 0x7f4e14157e10 2023-12-22T10:01:16.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.277+0000 7f4e1c21b700 1 -- 172.21.15.45:0/283760021 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e1415d340 con 0x7f4e14157e10 2023-12-22T10:01:16.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.277+0000 7f4e09ffb700 1 -- 172.21.15.45:0/283760021 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e0401b620 con 0x7f4e14157e10 2023-12-22T10:01:16.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.277+0000 7f4e1c21b700 1 -- 172.21.15.45:0/283760021 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e140c00c0 con 0x7f4e14157e10 2023-12-22T10:01:16.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.281+0000 7f4e1c21b700 1 -- 172.21.15.45:0/283760021 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e1406c070 con 0x7f4e14157e10 2023-12-22T10:01:16.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.281+0000 7f4e09ffb700 1 -- 172.21.15.45:0/283760021 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f4e0401b9d0 con 0x7f4e14157e10 2023-12-22T10:01:16.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.281+0000 7f4e09ffb700 1 --2- 172.21.15.45:0/283760021 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f4df805a510 0x7f4df805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:16.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.281+0000 7f4e09ffb700 1 -- 172.21.15.45:0/283760021 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f4e040760f0 con 0x7f4e14157e10 2023-12-22T10:01:16.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.281+0000 7f4e19fb7700 1 --2- 172.21.15.45:0/283760021 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f4df805a510 0x7f4df805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:16.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.281+0000 7f4e19fb7700 1 --2- 172.21.15.45:0/283760021 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f4df805a510 0x7f4df805c9d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f4e10005750 tx=0x7f4e10009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:16.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.289+0000 7f4e09ffb700 1 -- 172.21.15.45:0/283760021 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f4e04049810 con 0x7f4e14157e10 2023-12-22T10:01:16.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.489+0000 7f4e1c21b700 1 -- 172.21.15.45:0/283760021 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4e140c5130 con 0x7f4e14157e10 2023-12-22T10:01:16.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.489+0000 7f4e09ffb700 1 -- 172.21.15.45:0/283760021 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4489 (secure 0 0 0) 0x7f4e0404ce30 con 0x7f4e14157e10 2023-12-22T10:01:16.487 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:01:16.487 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6833/3021221178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6832","nonce":3021221178},{"type":"v1","addr":"172.21.15.113:6833","nonce":3021221178}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6835/1307046651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":1307046651},{"type":"v1","addr":"172.21.15.113:6835","nonce":1307046651}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/3043486757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":3043486757},{"type":"v1","addr":"172.21.15.45:6835","nonce":3043486757}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T10:00:33.522493+0000","modified":"2023-12-22T10:00:36.550815+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6837/1007404834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":1007404834},{"type":"v1","addr":"172.21.15.45:6837","nonce":1007404834}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-12-22T10:01:16.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.493+0000 7f4e1c21b700 1 -- 172.21.15.45:0/283760021 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f4df805a510 msgr2=0x7f4df805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:16.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.493+0000 7f4e1c21b700 1 --2- 172.21.15.45:0/283760021 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f4df805a510 0x7f4df805c9d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f4e10005750 tx=0x7f4e10009040).stop 2023-12-22T10:01:16.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.493+0000 7f4e1c21b700 1 -- 172.21.15.45:0/283760021 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e14157e10 msgr2=0x7f4e140bfbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:16.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.493+0000 7f4e1c21b700 1 --2- 172.21.15.45:0/283760021 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e14157e10 0x7f4e140bfbd0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7f4e140643a0 tx=0x7f4e04017000).stop 2023-12-22T10:01:16.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.493+0000 7f4e1c21b700 1 -- 172.21.15.45:0/283760021 shutdown_connections 2023-12-22T10:01:16.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.493+0000 7f4e1c21b700 1 --2- 172.21.15.45:0/283760021 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4e141581f0 0x7f4e14153a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:16.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.493+0000 7f4e1c21b700 1 --2- 172.21.15.45:0/283760021 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e14157e10 0x7f4e140bfbd0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:16.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.493+0000 7f4e1c21b700 1 --2- 172.21.15.45:0/283760021 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f4df805a510 0x7f4df805c9d0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:16.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.493+0000 7f4e1c21b700 1 --2- 172.21.15.45:0/283760021 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f4e140c3570 0x7f4e1415c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:16.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.493+0000 7f4e1c21b700 1 -- 172.21.15.45:0/283760021 >> 172.21.15.45:0/283760021 conn(0x7f4e14066a70 msgr2=0x7f4e141549a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:16.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.493+0000 7f4e1c21b700 1 -- 172.21.15.45:0/283760021 shutdown_connections 2023-12-22T10:01:16.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.493+0000 7f4e1c21b700 1 -- 172.21.15.45:0/283760021 wait complete. 2023-12-22T10:01:16.493 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 8 2023-12-22T10:01:16.511 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T10:01:16.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.677+0000 7fe3d929b700 1 Processor -- start 2023-12-22T10:01:16.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.681+0000 7fe3d929b700 1 -- start start 2023-12-22T10:01:16.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.681+0000 7fe3d929b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe3d41504d0 0x7fe3d41508b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:16.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.681+0000 7fe3d929b700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3d40c57e0 con 0x7fe3d40c4db0 2023-12-22T10:01:16.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.681+0000 7fe3d929b700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3d40c5ac0 con 0x7fe3d40c2840 2023-12-22T10:01:16.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.681+0000 7fe3d929b700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3d40a91b0 con 0x7fe3d41504d0 2023-12-22T10:01:16.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.681+0000 7fe3d2ffd700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe3d41504d0 0x7fe3d41508b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:16.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.681+0000 7fe3d2ffd700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe3d41504d0 0x7fe3d41508b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50458/0 (socket says 172.21.15.45:50458) 2023-12-22T10:01:16.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.681+0000 7fe3d2ffd700 1 -- 172.21.15.45:0/2146678690 learned_addr learned my addr 172.21.15.45:0/2146678690 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:16.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.681+0000 7fe3ca7fc700 1 --1- 172.21.15.45:0/2146678690 >> v1:172.21.15.45:6789/0 conn(0x7fe3d40c4db0 0x7fe3d40c2130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:55920/0 (socket says 172.21.15.45:55920) 2023-12-22T10:01:16.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.685+0000 7fe3d2ffd700 1 -- 172.21.15.45:0/2146678690 >> v1:172.21.15.113:6789/0 conn(0x7fe3d40c2840 legacy=0x7fe3d40ab2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:16.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.685+0000 7fe3d2ffd700 1 -- 172.21.15.45:0/2146678690 >> v1:172.21.15.45:6789/0 conn(0x7fe3d40c4db0 legacy=0x7fe3d40c2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:16.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.685+0000 7fe3d2ffd700 1 -- 172.21.15.45:0/2146678690 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3d40c5da0 con 0x7fe3d41504d0 2023-12-22T10:01:16.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.685+0000 7fe3d27fc700 1 -- 172.21.15.45:0/2146678690 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2261365950 0 0) 0x7fe3d40c57e0 con 0x7fe3d40c4db0 2023-12-22T10:01:16.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.685+0000 7fe3d2ffd700 1 --2- 172.21.15.45:0/2146678690 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3d41504d0 0x7fe3d41508b0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7fe3c4009f20 tx=0x7fe3c4009840).ready entity=mon.0 client_cookie=525bc71645696b15 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:16.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.685+0000 7fe3d27fc700 1 -- 172.21.15.45:0/2146678690 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c400e070 con 0x7fe3d41504d0 2023-12-22T10:01:16.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.685+0000 7fe3d27fc700 1 -- 172.21.15.45:0/2146678690 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3c400ba80 con 0x7fe3d41504d0 2023-12-22T10:01:16.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.685+0000 7fe3d27fc700 1 -- 172.21.15.45:0/2146678690 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c400be00 con 0x7fe3d41504d0 2023-12-22T10:01:16.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.685+0000 7fe3d929b700 1 -- 172.21.15.45:0/2146678690 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3d41504d0 msgr2=0x7fe3d41508b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:16.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.685+0000 7fe3d929b700 1 --2- 172.21.15.45:0/2146678690 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3d41504d0 0x7fe3d41508b0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7fe3c4009f20 tx=0x7fe3c4009840).stop 2023-12-22T10:01:16.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.685+0000 7fe3d929b700 1 -- 172.21.15.45:0/2146678690 shutdown_connections 2023-12-22T10:01:16.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.685+0000 7fe3d929b700 1 --2- 172.21.15.45:0/2146678690 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3d41504d0 0x7fe3d41508b0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:16.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.685+0000 7fe3d929b700 1 -- 172.21.15.45:0/2146678690 >> 172.21.15.45:0/2146678690 conn(0x7fe3d4067540 msgr2=0x7fe3d40c64a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:16.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.685+0000 7fe3d929b700 1 -- 172.21.15.45:0/2146678690 shutdown_connections 2023-12-22T10:01:16.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.685+0000 7fe3d929b700 1 -- 172.21.15.45:0/2146678690 wait complete. 2023-12-22T10:01:16.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.689+0000 7fe3d929b700 1 Processor -- start 2023-12-22T10:01:16.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.689+0000 7fe3d929b700 1 -- start start 2023-12-22T10:01:16.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.689+0000 7fe3d929b700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe3d40c2840 0x7fe3d40a86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:16.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.689+0000 7fe3d929b700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fe3d40c4db0 0x7fe3d40bdf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:16.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.689+0000 7fe3d929b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3d41504d0 0x7fe3d4164020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:16.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.689+0000 7fe3d929b700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d4165470 con 0x7fe3d41504d0 2023-12-22T10:01:16.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.689+0000 7fe3d929b700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d40be450 con 0x7fe3d40c2840 2023-12-22T10:01:16.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.689+0000 7fe3d929b700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d40be720 con 0x7fe3d40c4db0 2023-12-22T10:01:16.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.689+0000 7fe3d37fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3d41504d0 0x7fe3d4164020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:16.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.693+0000 7fe3d37fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3d41504d0 0x7fe3d4164020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50468/0 (socket says 172.21.15.45:50468) 2023-12-22T10:01:16.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.693+0000 7fe3d37fe700 1 -- 172.21.15.45:0/4069488627 learned_addr learned my addr 172.21.15.45:0/4069488627 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:16.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.693+0000 7fe3d2ffd700 1 --2- 172.21.15.45:0/4069488627 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe3d40c2840 0x7fe3d40a86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:16.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.693+0000 7fe3ca7fc700 1 --2- 172.21.15.45:0/4069488627 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fe3d40c4db0 0x7fe3d40bdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:16.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.693+0000 7fe3d37fe700 1 -- 172.21.15.45:0/4069488627 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fe3d40c4db0 msgr2=0x7fe3d40bdf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:16.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.693+0000 7fe3d37fe700 1 --2- 172.21.15.45:0/4069488627 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fe3d40c4db0 0x7fe3d40bdf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:16.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.693+0000 7fe3d37fe700 1 -- 172.21.15.45:0/4069488627 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe3d40c2840 msgr2=0x7fe3d40a86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:16.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.693+0000 7fe3d37fe700 1 --2- 172.21.15.45:0/4069488627 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe3d40c2840 0x7fe3d40a86d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:16.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.693+0000 7fe3d37fe700 1 -- 172.21.15.45:0/4069488627 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3c4009ae0 con 0x7fe3d41504d0 2023-12-22T10:01:16.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.693+0000 7fe3d37fe700 1 --2- 172.21.15.45:0/4069488627 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3d41504d0 0x7fe3d4164020 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7fe3cc00c440 tx=0x7fe3cc007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:16.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.693+0000 7fe3cb7fe700 1 -- 172.21.15.45:0/4069488627 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc00cea0 con 0x7fe3d41504d0 2023-12-22T10:01:16.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.693+0000 7fe3cb7fe700 1 -- 172.21.15.45:0/4069488627 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3cc001e90 con 0x7fe3d41504d0 2023-12-22T10:01:16.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.693+0000 7fe3cb7fe700 1 -- 172.21.15.45:0/4069488627 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc00f680 con 0x7fe3d41504d0 2023-12-22T10:01:16.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.693+0000 7fe3d929b700 1 -- 172.21.15.45:0/4069488627 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3d40bea00 con 0x7fe3d41504d0 2023-12-22T10:01:16.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.693+0000 7fe3d929b700 1 -- 172.21.15.45:0/4069488627 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3d40bfe40 con 0x7fe3d41504d0 2023-12-22T10:01:16.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.693+0000 7fe3d929b700 1 -- 172.21.15.45:0/4069488627 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3d4165240 con 0x7fe3d41504d0 2023-12-22T10:01:16.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.697+0000 7fe3cb7fe700 1 -- 172.21.15.45:0/4069488627 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fe3cc00fa70 con 0x7fe3d41504d0 2023-12-22T10:01:16.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.697+0000 7fe3cb7fe700 1 --2- 172.21.15.45:0/4069488627 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fe3b405a510 0x7fe3b405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:16.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.697+0000 7fe3cb7fe700 1 -- 172.21.15.45:0/4069488627 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fe3cc073bf0 con 0x7fe3d41504d0 2023-12-22T10:01:16.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.697+0000 7fe3d2ffd700 1 --2- 172.21.15.45:0/4069488627 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fe3b405a510 0x7fe3b405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:16.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.701+0000 7fe3d2ffd700 1 --2- 172.21.15.45:0/4069488627 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fe3b405a510 0x7fe3b405c9d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7fe3c4009590 tx=0x7fe3d40c59b0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:16.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.705+0000 7fe3cb7fe700 1 -- 172.21.15.45:0/4069488627 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fe3d4165240 con 0x7fe3d41504d0 2023-12-22T10:01:16.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.877+0000 7fe3d929b700 1 -- 172.21.15.45:0/4069488627 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe3d4165240 con 0x7fe3d41504d0 2023-12-22T10:01:16.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.877+0000 7fe3cb7fe700 1 -- 172.21.15.45:0/4069488627 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16928 (secure 0 0 0) 0x7fe3d4165240 con 0x7fe3d41504d0 2023-12-22T10:01:16.876 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:01:16.876 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":21,"fsid":"98b0837e-5e68-4c8f-a1a0-e9424baaad8f","created":"2023-12-22T10:00:15.010174+0000","modified":"2023-12-22T10:00:34.529651+0000","last_up_change":"2023-12-22T10:00:24.980513+0000","last_in_change":"2023-12-22T10:00:17.887172+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-12-22T10:00:25.069641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-12-22T10:00:26.906399+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-12-22T10:00:31.621311+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-12-22T10:00:32.538053+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e19943a0-1c6b-47df-b6bb-383472077890","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":33777},{"type":"v1","addr":"172.21.15.45:6819","nonce":33777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":33777},{"type":"v1","addr":"172.21.15.45:6822","nonce":33777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":33777},{"type":"v1","addr":"172.21.15.45:6830","nonce":33777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":33777},{"type":"v1","addr":"172.21.15.45:6826","nonce":33777}]},"public_addr":"172.21.15.45:6819/33777","cluster_addr":"172.21.15.45:6822/33777","heartbeat_back_addr":"172.21.15.45:6830/33777","heartbeat_front_addr":"172.21.15.45:6826/33777","state":["exists","up"]},{"osd":1,"uuid":"69670f34-f082-45a7-8f67-e962acc136e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":33775},{"type":"v1","addr":"172.21.15.45:6809","nonce":33775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":33775},{"type":"v1","addr":"172.21.15.45:6811","nonce":33775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":33775},{"type":"v1","addr":"172.21.15.45:6815","nonce":33775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":33775},{"type":"v1","addr":"172.21.15.45:6813","nonce":33775}]},"public_addr":"172.21.15.45:6809/33775","cluster_addr":"172.21.15.45:6811/33775","heartbeat_back_addr":"172.21.15.45:6815/33775","heartbeat_front_addr":"172.21.15.45:6813/33775","state":["exists","up"]},{"osd":2,"uuid":"d909d49b-82b8-401b-9947-e49dd167bb95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":33776},{"type":"v1","addr":"172.21.15.45:6801","nonce":33776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":33776},{"type":"v1","addr":"172.21.15.45:6803","nonce":33776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":33776},{"type":"v1","addr":"172.21.15.45:6807","nonce":33776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":33776},{"type":"v1","addr":"172.21.15.45:6805","nonce":33776}]},"public_addr":"172.21.15.45:6801/33776","cluster_addr":"172.21.15.45:6803/33776","heartbeat_back_addr":"172.21.15.45:6807/33776","heartbeat_front_addr":"172.21.15.45:6805/33776","state":["exists","up"]},{"osd":3,"uuid":"db104ca9-3a94-4d39-a2be-bd06db888095","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":33782},{"type":"v1","addr":"172.21.15.45:6817","nonce":33782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":33782},{"type":"v1","addr":"172.21.15.45:6823","nonce":33782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":33782},{"type":"v1","addr":"172.21.15.45:6831","nonce":33782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":33782},{"type":"v1","addr":"172.21.15.45:6827","nonce":33782}]},"public_addr":"172.21.15.45:6817/33782","cluster_addr":"172.21.15.45:6823/33782","heartbeat_back_addr":"172.21.15.45:6831/33782","heartbeat_front_addr":"172.21.15.45:6827/33782","state":["exists","up"]},{"osd":4,"uuid":"9f4eaff4-e433-4479-a0d1-ee7a33375ca6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":34099},{"type":"v1","addr":"172.21.15.113:6811","nonce":34099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":34099},{"type":"v1","addr":"172.21.15.113:6815","nonce":34099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":34099},{"type":"v1","addr":"172.21.15.113:6823","nonce":34099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6816","nonce":34099},{"type":"v1","addr":"172.21.15.113:6818","nonce":34099}]},"public_addr":"172.21.15.113:6811/34099","cluster_addr":"172.21.15.113:6815/34099","heartbeat_back_addr":"172.21.15.113:6823/34099","heartbeat_front_addr":"172.21.15.113:6818/34099","state":["exists","up"]},{"osd":5,"uuid":"1efc5591-180b-43af-8611-0068aadc5aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":34100},{"type":"v1","addr":"172.21.15.113:6801","nonce":34100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":34100},{"type":"v1","addr":"172.21.15.113:6803","nonce":34100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":34100},{"type":"v1","addr":"172.21.15.113:6807","nonce":34100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":34100},{"type":"v1","addr":"172.21.15.113:6805","nonce":34100}]},"public_addr":"172.21.15.113:6801/34100","cluster_addr":"172.21.15.113:6803/34100","heartbeat_back_addr":"172.21.15.113:6807/34100","heartbeat_front_addr":"172.21.15.113:6805/34100","state":["exists","up"]},{"osd":6,"uuid":"6c89d9d8-c153-4a48-afa9-97e4c403f1ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":34101},{"type":"v1","addr":"172.21.15.113:6810","nonce":34101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6812","nonce":34101},{"type":"v1","addr":"172.21.15.113:6814","nonce":34101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6822","nonce":34101},{"type":"v1","addr":"172.21.15.113:6824","nonce":34101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":34101},{"type":"v1","addr":"172.21.15.113:6819","nonce":34101}]},"public_addr":"172.21.15.113:6810/34101","cluster_addr":"172.21.15.113:6814/34101","heartbeat_back_addr":"172.21.15.113:6824/34101","heartbeat_front_addr":"172.21.15.113:6819/34101","state":["exists","up"]},{"osd":7,"uuid":"1855e70c-23f6-4c08-ad7f-774c2148235b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6821","nonce":34102},{"type":"v1","addr":"172.21.15.113:6825","nonce":34102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":34102},{"type":"v1","addr":"172.21.15.113:6827","nonce":34102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":34102},{"type":"v1","addr":"172.21.15.113:6831","nonce":34102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6828","nonce":34102},{"type":"v1","addr":"172.21.15.113:6829","nonce":34102}]},"public_addr":"172.21.15.113:6825/34102","cluster_addr":"172.21.15.113:6827/34102","heartbeat_back_addr":"172.21.15.113:6831/34102","heartbeat_front_addr":"172.21.15.113:6829/34102","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.812672+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.825045+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.700105+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.856563+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.954683+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.883234+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.883994+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.821686+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T10:01:16.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.881+0000 7fe3d929b700 1 -- 172.21.15.45:0/4069488627 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fe3b405a510 msgr2=0x7fe3b405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:16.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.881+0000 7fe3d929b700 1 --2- 172.21.15.45:0/4069488627 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fe3b405a510 0x7fe3b405c9d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7fe3c4009590 tx=0x7fe3d40c59b0).stop 2023-12-22T10:01:16.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.881+0000 7fe3d929b700 1 -- 172.21.15.45:0/4069488627 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3d41504d0 msgr2=0x7fe3d4164020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:16.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.881+0000 7fe3d929b700 1 --2- 172.21.15.45:0/4069488627 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3d41504d0 0x7fe3d4164020 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7fe3cc00c440 tx=0x7fe3cc007d70).stop 2023-12-22T10:01:16.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.881+0000 7fe3d929b700 1 -- 172.21.15.45:0/4069488627 shutdown_connections 2023-12-22T10:01:16.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.881+0000 7fe3d929b700 1 --2- 172.21.15.45:0/4069488627 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3d41504d0 0x7fe3d4164020 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:16.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.881+0000 7fe3d929b700 1 --2- 172.21.15.45:0/4069488627 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fe3b405a510 0x7fe3b405c9d0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:16.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.881+0000 7fe3d929b700 1 --2- 172.21.15.45:0/4069488627 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fe3d40c4db0 0x7fe3d40bdf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:16.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.881+0000 7fe3d929b700 1 --2- 172.21.15.45:0/4069488627 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe3d40c2840 0x7fe3d40a86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:16.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.881+0000 7fe3d929b700 1 -- 172.21.15.45:0/4069488627 >> 172.21.15.45:0/4069488627 conn(0x7fe3d4067540 msgr2=0x7fe3d41596d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:16.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.881+0000 7fe3d929b700 1 -- 172.21.15.45:0/4069488627 shutdown_connections 2023-12-22T10:01:16.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:16.881+0000 7fe3d929b700 1 -- 172.21.15.45:0/4069488627 wait complete. 2023-12-22T10:01:16.899 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-12-22T10:00:25.069641+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-12-22T10:00:26.906399+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-22T10:00:31.621311+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-12-22T10:00:32.538053+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-22T10:01:16.899 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-12-22T10:01:17.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.069+0000 7f5d11e5b700 1 Processor -- start 2023-12-22T10:01:17.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.069+0000 7f5d11e5b700 1 -- start start 2023-12-22T10:01:17.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.073+0000 7f5d11e5b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5d0c1507b0 0x7f5d0c064890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:17.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.073+0000 7f5d11e5b700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f5d0c0a5ea0 0x7f5d0c064d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:17.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.073+0000 7f5d11e5b700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d0c0c2610 con 0x7f5d0c150b90 2023-12-22T10:01:17.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.073+0000 7f5d11e5b700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d0c0a7ab0 con 0x7f5d0c1507b0 2023-12-22T10:01:17.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.073+0000 7f5d11e5b700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d0c065350 con 0x7f5d0c0a5ea0 2023-12-22T10:01:17.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.073+0000 7f5d0b7fe700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5d0c1507b0 0x7f5d0c064890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:17.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.073+0000 7f5d0b7fe700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5d0c1507b0 0x7f5d0c064890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50470/0 (socket says 172.21.15.45:50470) 2023-12-22T10:01:17.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.073+0000 7f5d0b7fe700 1 -- 172.21.15.45:0/1740838356 learned_addr learned my addr 172.21.15.45:0/1740838356 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:17.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.073+0000 7f5d0bfff700 1 --2- 172.21.15.45:0/1740838356 >> v2:172.21.15.113:3300/0 conn(0x7f5d0c0a5ea0 0x7f5d0c064d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:17.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.077+0000 7f5d0b7fe700 1 -- 172.21.15.45:0/1740838356 >> v2:172.21.15.113:3300/0 conn(0x7f5d0c0a5ea0 msgr2=0x7f5d0c064d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:17.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.077+0000 7f5d0b7fe700 1 --2- 172.21.15.45:0/1740838356 >> v2:172.21.15.113:3300/0 conn(0x7f5d0c0a5ea0 0x7f5d0c064d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:17.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.077+0000 7f5d0b7fe700 1 -- 172.21.15.45:0/1740838356 >> v1:172.21.15.113:6789/0 conn(0x7f5d0c150b90 legacy=0x7f5d0c0a5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:17.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.077+0000 7f5d0b7fe700 1 -- 172.21.15.45:0/1740838356 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d0c065630 con 0x7f5d0c1507b0 2023-12-22T10:01:17.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.077+0000 7f5d0bfff700 1 --2- 172.21.15.45:0/1740838356 >> v2:172.21.15.113:3300/0 conn(0x7f5d0c0a5ea0 0x7f5d0c064d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-12-22T10:01:17.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.077+0000 7f5d0b7fe700 1 --2- 172.21.15.45:0/1740838356 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d0c1507b0 0x7f5d0c064890 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f5d0c0a6280 tx=0x7f5cfc00b3b0).ready entity=mon.0 client_cookie=c28500cdc9debbeb server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:17.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.077+0000 7f5d0a7fc700 1 -- 172.21.15.45:0/1740838356 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cfc00d940 con 0x7f5d0c1507b0 2023-12-22T10:01:17.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.077+0000 7f5d0a7fc700 1 -- 172.21.15.45:0/1740838356 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cfc00daa0 con 0x7f5d0c1507b0 2023-12-22T10:01:17.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.077+0000 7f5d0a7fc700 1 -- 172.21.15.45:0/1740838356 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cfc00de20 con 0x7f5d0c1507b0 2023-12-22T10:01:17.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.077+0000 7f5d11e5b700 1 -- 172.21.15.45:0/1740838356 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d0c1507b0 msgr2=0x7f5d0c064890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:17.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.077+0000 7f5d11e5b700 1 --2- 172.21.15.45:0/1740838356 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d0c1507b0 0x7f5d0c064890 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f5d0c0a6280 tx=0x7f5cfc00b3b0).stop 2023-12-22T10:01:17.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.077+0000 7f5d11e5b700 1 -- 172.21.15.45:0/1740838356 shutdown_connections 2023-12-22T10:01:17.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.077+0000 7f5d11e5b700 1 --2- 172.21.15.45:0/1740838356 >> v2:172.21.15.113:3300/0 conn(0x7f5d0c0a5ea0 0x7f5d0c064d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:17.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.077+0000 7f5d11e5b700 1 --2- 172.21.15.45:0/1740838356 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d0c1507b0 0x7f5d0c064890 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:17.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.077+0000 7f5d11e5b700 1 -- 172.21.15.45:0/1740838356 >> 172.21.15.45:0/1740838356 conn(0x7f5d0c066a70 msgr2=0x7f5d0c066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:17.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.077+0000 7f5d11e5b700 1 -- 172.21.15.45:0/1740838356 shutdown_connections 2023-12-22T10:01:17.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.077+0000 7f5d11e5b700 1 -- 172.21.15.45:0/1740838356 wait complete. 2023-12-22T10:01:17.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.081+0000 7f5d11e5b700 1 Processor -- start 2023-12-22T10:01:17.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.081+0000 7f5d11e5b700 1 -- start start 2023-12-22T10:01:17.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.081+0000 7f5d11e5b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d0c0a5ea0 0x7f5d0c14b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:17.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.081+0000 7f5d11e5b700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5d0c1507b0 0x7f5d0c148c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:17.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.081+0000 7f5d11e5b700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f5d0c150b90 0x7f5d0c164080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:17.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.081+0000 7f5d11e5b700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d0c14a6d0 con 0x7f5d0c0a5ea0 2023-12-22T10:01:17.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.081+0000 7f5d11e5b700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d0c14ac70 con 0x7f5d0c1507b0 2023-12-22T10:01:17.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.081+0000 7f5d11e5b700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d0c164fb0 con 0x7f5d0c150b90 2023-12-22T10:01:17.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.085+0000 7f5d0b7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d0c0a5ea0 0x7f5d0c14b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:17.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.085+0000 7f5d0b7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d0c0a5ea0 0x7f5d0c14b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50482/0 (socket says 172.21.15.45:50482) 2023-12-22T10:01:17.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.085+0000 7f5d0b7fe700 1 -- 172.21.15.45:0/2880248075 learned_addr learned my addr 172.21.15.45:0/2880248075 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:17.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.085+0000 7f5d0bfff700 1 --2- 172.21.15.45:0/2880248075 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f5d0c150b90 0x7f5d0c164080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:17.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.085+0000 7f5d0affd700 1 --2- 172.21.15.45:0/2880248075 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5d0c1507b0 0x7f5d0c148c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:17.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.085+0000 7f5d0b7fe700 1 -- 172.21.15.45:0/2880248075 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f5d0c150b90 msgr2=0x7f5d0c164080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:17.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.085+0000 7f5d0b7fe700 1 --2- 172.21.15.45:0/2880248075 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f5d0c150b90 0x7f5d0c164080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:17.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.085+0000 7f5d0b7fe700 1 -- 172.21.15.45:0/2880248075 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5d0c1507b0 msgr2=0x7f5d0c148c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:17.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.085+0000 7f5d0b7fe700 1 --2- 172.21.15.45:0/2880248075 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5d0c1507b0 0x7f5d0c148c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:17.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.085+0000 7f5d0b7fe700 1 -- 172.21.15.45:0/2880248075 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d04009a20 con 0x7f5d0c0a5ea0 2023-12-22T10:01:17.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.085+0000 7f5d0b7fe700 1 --2- 172.21.15.45:0/2880248075 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d0c0a5ea0 0x7f5d0c14b100 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7f5cfc00e010 tx=0x7f5d0c0c2580).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:17.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.085+0000 7f5cf37fe700 1 -- 172.21.15.45:0/2880248075 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cfc01e070 con 0x7f5d0c0a5ea0 2023-12-22T10:01:17.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.085+0000 7f5cf37fe700 1 -- 172.21.15.45:0/2880248075 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cfc00bec0 con 0x7f5d0c0a5ea0 2023-12-22T10:01:17.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.085+0000 7f5d11e5b700 1 -- 172.21.15.45:0/2880248075 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cfc00b610 con 0x7f5d0c0a5ea0 2023-12-22T10:01:17.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.085+0000 7f5cf37fe700 1 -- 172.21.15.45:0/2880248075 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cfc00de20 con 0x7f5d0c0a5ea0 2023-12-22T10:01:17.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.085+0000 7f5d11e5b700 1 -- 172.21.15.45:0/2880248075 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d0c164d50 con 0x7f5d0c0a5ea0 2023-12-22T10:01:17.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.089+0000 7f5d11e5b700 1 -- 172.21.15.45:0/2880248075 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d0c0c0a80 con 0x7f5d0c0a5ea0 2023-12-22T10:01:17.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.089+0000 7f5cf37fe700 1 -- 172.21.15.45:0/2880248075 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f5cfc0238c0 con 0x7f5d0c0a5ea0 2023-12-22T10:01:17.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.089+0000 7f5cf37fe700 1 --2- 172.21.15.45:0/2880248075 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f5cf805a540 0x7f5cf805ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:17.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.089+0000 7f5cf37fe700 1 -- 172.21.15.45:0/2880248075 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f5cfc075ef0 con 0x7f5d0c0a5ea0 2023-12-22T10:01:17.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.089+0000 7f5d0affd700 1 --2- 172.21.15.45:0/2880248075 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f5cf805a540 0x7f5cf805ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:17.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.089+0000 7f5d0affd700 1 --2- 172.21.15.45:0/2880248075 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f5cf805a540 0x7f5cf805ca00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f5d0c0c1ae0 tx=0x7f5d00007d20).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:17.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.097+0000 7f5cf37fe700 1 -- 172.21.15.45:0/2880248075 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f5cfc049610 con 0x7f5d0c0a5ea0 2023-12-22T10:01:17.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.269+0000 7f5d11e5b700 1 -- 172.21.15.45:0/2880248075 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f5d0c06c070 con 0x7f5d0c0a5ea0 2023-12-22T10:01:17.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.273+0000 7f5cf37fe700 1 -- 172.21.15.45:0/2880248075 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v21) v1 ==== 110+0+10 (secure 0 0 0) 0x7f5cfc04cc30 con 0x7f5d0c0a5ea0 2023-12-22T10:01:17.270 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-12-22T10:01:17.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.277+0000 7f5d11e5b700 1 -- 172.21.15.45:0/2880248075 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f5cf805a540 msgr2=0x7f5cf805ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:17.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.277+0000 7f5d11e5b700 1 --2- 172.21.15.45:0/2880248075 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f5cf805a540 0x7f5cf805ca00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f5d0c0c1ae0 tx=0x7f5d00007d20).stop 2023-12-22T10:01:17.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.277+0000 7f5d11e5b700 1 -- 172.21.15.45:0/2880248075 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d0c0a5ea0 msgr2=0x7f5d0c14b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:17.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.277+0000 7f5d11e5b700 1 --2- 172.21.15.45:0/2880248075 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d0c0a5ea0 0x7f5d0c14b100 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7f5cfc00e010 tx=0x7f5d0c0c2580).stop 2023-12-22T10:01:17.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.277+0000 7f5d11e5b700 1 -- 172.21.15.45:0/2880248075 shutdown_connections 2023-12-22T10:01:17.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.277+0000 7f5d11e5b700 1 --2- 172.21.15.45:0/2880248075 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f5cf805a540 0x7f5cf805ca00 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:17.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.277+0000 7f5d11e5b700 1 --2- 172.21.15.45:0/2880248075 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f5d0c150b90 0x7f5d0c164080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:17.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.277+0000 7f5d11e5b700 1 --2- 172.21.15.45:0/2880248075 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5d0c1507b0 0x7f5d0c148c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:17.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.277+0000 7f5d11e5b700 1 --2- 172.21.15.45:0/2880248075 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d0c0a5ea0 0x7f5d0c14b100 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:17.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.277+0000 7f5d11e5b700 1 -- 172.21.15.45:0/2880248075 >> 172.21.15.45:0/2880248075 conn(0x7f5d0c066a70 msgr2=0x7f5d0c0a5790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:17.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.277+0000 7f5d11e5b700 1 -- 172.21.15.45:0/2880248075 shutdown_connections 2023-12-22T10:01:17.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.277+0000 7f5d11e5b700 1 -- 172.21.15.45:0/2880248075 wait complete. 2023-12-22T10:01:17.296 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-12-22T10:01:17.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.469+0000 7f3a67f46700 1 Processor -- start 2023-12-22T10:01:17.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.469+0000 7f3a67f46700 1 -- start start 2023-12-22T10:01:17.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.473+0000 7f3a67f46700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f3a600ac4c0 0x7f3a60155660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:17.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.473+0000 7f3a67f46700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f3a60155b50 0x7f3a600a5890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:17.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.473+0000 7f3a67f46700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a601521b0 con 0x7f3a600ac0e0 2023-12-22T10:01:17.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.473+0000 7f3a67f46700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a60151fa0 con 0x7f3a600ac4c0 2023-12-22T10:01:17.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.473+0000 7f3a67f46700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a600c36e0 con 0x7f3a60155b50 2023-12-22T10:01:17.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.473+0000 7f3a654e1700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f3a600ac4c0 0x7f3a60155660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:17.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.473+0000 7f3a654e1700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f3a600ac4c0 0x7f3a60155660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.45:39514/0 (socket says 172.21.15.45:39514) 2023-12-22T10:01:17.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.473+0000 7f3a654e1700 1 -- 172.21.15.45:0/1958273693 learned_addr learned my addr 172.21.15.45:0/1958273693 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:17.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.473+0000 7f3a664e3700 1 --2- 172.21.15.45:0/1958273693 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f3a60155b50 0x7f3a600a5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:17.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.473+0000 7f3a654e1700 1 -- 172.21.15.45:0/1958273693 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f3a60155b50 msgr2=0x7f3a600a5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:17.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.473+0000 7f3a654e1700 1 --2- 172.21.15.45:0/1958273693 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f3a60155b50 0x7f3a600a5890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:17.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.473+0000 7f3a654e1700 1 -- 172.21.15.45:0/1958273693 >> v1:172.21.15.113:6789/0 conn(0x7f3a600ac0e0 legacy=0x7f3a600a7050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:17.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.473+0000 7f3a654e1700 1 -- 172.21.15.45:0/1958273693 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a600c39c0 con 0x7f3a600ac4c0 2023-12-22T10:01:17.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.473+0000 7f3a654e1700 1 --2- 172.21.15.45:0/1958273693 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3a600ac4c0 0x7f3a60155660 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f3a50006fd0 tx=0x7f3a500090f0).ready entity=mon.1 client_cookie=5b320708f61107be server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:17.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.473+0000 7f3a64ce0700 1 -- 172.21.15.45:0/1958273693 <== mon.1 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a5000b580 con 0x7f3a600ac4c0 2023-12-22T10:01:17.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.473+0000 7f3a64ce0700 1 -- 172.21.15.45:0/1958273693 <== mon.1 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a5000b6e0 con 0x7f3a600ac4c0 2023-12-22T10:01:17.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.473+0000 7f3a64ce0700 1 -- 172.21.15.45:0/1958273693 <== mon.1 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a5000ba60 con 0x7f3a600ac4c0 2023-12-22T10:01:17.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.477+0000 7f3a67f46700 1 -- 172.21.15.45:0/1958273693 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3a600ac4c0 msgr2=0x7f3a60155660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:17.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.477+0000 7f3a67f46700 1 --2- 172.21.15.45:0/1958273693 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3a600ac4c0 0x7f3a60155660 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f3a50006fd0 tx=0x7f3a500090f0).stop 2023-12-22T10:01:17.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.477+0000 7f3a67f46700 1 -- 172.21.15.45:0/1958273693 shutdown_connections 2023-12-22T10:01:17.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.477+0000 7f3a67f46700 1 --2- 172.21.15.45:0/1958273693 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f3a60155b50 0x7f3a600a5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:17.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.477+0000 7f3a67f46700 1 --2- 172.21.15.45:0/1958273693 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3a600ac4c0 0x7f3a60155660 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:17.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.477+0000 7f3a67f46700 1 -- 172.21.15.45:0/1958273693 >> 172.21.15.45:0/1958273693 conn(0x7f3a60066a70 msgr2=0x7f3a60066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:17.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.477+0000 7f3a67f46700 1 -- 172.21.15.45:0/1958273693 shutdown_connections 2023-12-22T10:01:17.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.477+0000 7f3a67f46700 1 -- 172.21.15.45:0/1958273693 wait complete. 2023-12-22T10:01:17.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.477+0000 7f3a67f46700 1 Processor -- start 2023-12-22T10:01:17.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.477+0000 7f3a67f46700 1 -- start start 2023-12-22T10:01:17.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.481+0000 7f3a67f46700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a600ac0e0 0x7f3a60168010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:17.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.481+0000 7f3a67f46700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f3a60155b50 0x7f3a6014fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:17.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.481+0000 7f3a67f46700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3a600c58c0 0x7f3a600a0500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:17.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.481+0000 7f3a67f46700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a600a6410 con 0x7f3a600ac0e0 2023-12-22T10:01:17.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.481+0000 7f3a67f46700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a600c5430 con 0x7f3a600c58c0 2023-12-22T10:01:17.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.481+0000 7f3a67f46700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a60168500 con 0x7f3a60155b50 2023-12-22T10:01:17.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.481+0000 7f3a65ce2700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a600ac0e0 0x7f3a60168010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:17.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.481+0000 7f3a65ce2700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a600ac0e0 0x7f3a60168010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50498/0 (socket says 172.21.15.45:50498) 2023-12-22T10:01:17.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.481+0000 7f3a65ce2700 1 -- 172.21.15.45:0/3116002880 learned_addr learned my addr 172.21.15.45:0/3116002880 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:17.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.481+0000 7f3a654e1700 1 --2- 172.21.15.45:0/3116002880 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f3a60155b50 0x7f3a6014fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:17.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.481+0000 7f3a664e3700 1 --2- 172.21.15.45:0/3116002880 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3a600c58c0 0x7f3a600a0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:17.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.481+0000 7f3a65ce2700 1 -- 172.21.15.45:0/3116002880 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f3a60155b50 msgr2=0x7f3a6014fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:17.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.481+0000 7f3a65ce2700 1 --2- 172.21.15.45:0/3116002880 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f3a60155b50 0x7f3a6014fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:17.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.481+0000 7f3a65ce2700 1 -- 172.21.15.45:0/3116002880 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3a600c58c0 msgr2=0x7f3a600a0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:17.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.481+0000 7f3a65ce2700 1 --2- 172.21.15.45:0/3116002880 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3a600c58c0 0x7f3a600a0500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:17.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.481+0000 7f3a65ce2700 1 -- 172.21.15.45:0/3116002880 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a50009370 con 0x7f3a600ac0e0 2023-12-22T10:01:17.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.481+0000 7f3a65ce2700 1 --2- 172.21.15.45:0/3116002880 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a600ac0e0 0x7f3a60168010 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7f3a5c00c4c0 tx=0x7f3a5c007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:17.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.481+0000 7f3a55ffb700 1 -- 172.21.15.45:0/3116002880 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a5c007020 con 0x7f3a600ac0e0 2023-12-22T10:01:17.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.481+0000 7f3a55ffb700 1 -- 172.21.15.45:0/3116002880 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a5c001e90 con 0x7f3a600ac0e0 2023-12-22T10:01:17.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.481+0000 7f3a55ffb700 1 -- 172.21.15.45:0/3116002880 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a5c0073b0 con 0x7f3a600ac0e0 2023-12-22T10:01:17.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.481+0000 7f3a67f46700 1 -- 172.21.15.45:0/3116002880 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a600c4540 con 0x7f3a600ac0e0 2023-12-22T10:01:17.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.485+0000 7f3a67f46700 1 -- 172.21.15.45:0/3116002880 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a600c4b00 con 0x7f3a600ac0e0 2023-12-22T10:01:17.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.485+0000 7f3a67f46700 1 -- 172.21.15.45:0/3116002880 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a6006c070 con 0x7f3a600ac0e0 2023-12-22T10:01:17.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.485+0000 7f3a55ffb700 1 -- 172.21.15.45:0/3116002880 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f3a5c0068b0 con 0x7f3a600ac0e0 2023-12-22T10:01:17.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.485+0000 7f3a55ffb700 1 --2- 172.21.15.45:0/3116002880 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f3a4405a510 0x7f3a4405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:17.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.485+0000 7f3a55ffb700 1 -- 172.21.15.45:0/3116002880 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f3a5c074190 con 0x7f3a600ac0e0 2023-12-22T10:01:17.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.489+0000 7f3a654e1700 1 --2- 172.21.15.45:0/3116002880 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f3a4405a510 0x7f3a4405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:17.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.489+0000 7f3a654e1700 1 --2- 172.21.15.45:0/3116002880 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f3a4405a510 0x7f3a4405c9d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f3a50009fd0 tx=0x7f3a50017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:17.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.493+0000 7f3a55ffb700 1 -- 172.21.15.45:0/3116002880 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f3a5c047970 con 0x7f3a600ac0e0 2023-12-22T10:01:17.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.653+0000 7f3a67f46700 1 -- 172.21.15.45:0/3116002880 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3a600c3ca0 con 0x7f3a600ac0e0 2023-12-22T10:01:17.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.653+0000 7f3a55ffb700 1 -- 172.21.15.45:0/3116002880 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3a5c04af90 con 0x7f3a600ac0e0 2023-12-22T10:01:17.652 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-12-22T10:01:17.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.657+0000 7f3a67f46700 1 -- 172.21.15.45:0/3116002880 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f3a4405a510 msgr2=0x7f3a4405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:17.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.657+0000 7f3a67f46700 1 --2- 172.21.15.45:0/3116002880 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f3a4405a510 0x7f3a4405c9d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f3a50009fd0 tx=0x7f3a50017000).stop 2023-12-22T10:01:17.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.657+0000 7f3a67f46700 1 -- 172.21.15.45:0/3116002880 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a600ac0e0 msgr2=0x7f3a60168010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:17.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.657+0000 7f3a67f46700 1 --2- 172.21.15.45:0/3116002880 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a600ac0e0 0x7f3a60168010 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7f3a5c00c4c0 tx=0x7f3a5c007e00).stop 2023-12-22T10:01:17.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.657+0000 7f3a67f46700 1 -- 172.21.15.45:0/3116002880 shutdown_connections 2023-12-22T10:01:17.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.657+0000 7f3a67f46700 1 --2- 172.21.15.45:0/3116002880 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3a600c58c0 0x7f3a600a0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:17.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.657+0000 7f3a67f46700 1 --2- 172.21.15.45:0/3116002880 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f3a4405a510 0x7f3a4405c9d0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:17.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.657+0000 7f3a67f46700 1 --2- 172.21.15.45:0/3116002880 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f3a60155b50 0x7f3a6014fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:17.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.657+0000 7f3a67f46700 1 --2- 172.21.15.45:0/3116002880 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a600ac0e0 0x7f3a60168010 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:17.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.657+0000 7f3a67f46700 1 -- 172.21.15.45:0/3116002880 >> 172.21.15.45:0/3116002880 conn(0x7f3a60066a70 msgr2=0x7f3a600c1470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:17.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.661+0000 7f3a67f46700 1 -- 172.21.15.45:0/3116002880 shutdown_connections 2023-12-22T10:01:17.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.661+0000 7f3a67f46700 1 -- 172.21.15.45:0/3116002880 wait complete. 2023-12-22T10:01:17.676 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-22T10:01:17.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.849+0000 7f5476a79700 1 Processor -- start 2023-12-22T10:01:17.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.849+0000 7f5476a79700 1 -- start start 2023-12-22T10:01:17.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.853+0000 7f5476a79700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5470065890 0x7f54700c4c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:17.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.853+0000 7f5476a79700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54700c55a0 con 0x7f54700a8ba0 2023-12-22T10:01:17.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.853+0000 7f5476a79700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54701594c0 con 0x7f54700c5110 2023-12-22T10:01:17.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.853+0000 7f5476a79700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54700c11e0 con 0x7f5470065890 2023-12-22T10:01:17.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.853+0000 7f5475276700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5470065890 0x7f54700c4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:17.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.853+0000 7f5475276700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5470065890 0x7f54700c4c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44532/0 (socket says 172.21.15.45:44532) 2023-12-22T10:01:17.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.853+0000 7f5475276700 1 -- 172.21.15.45:0/3853512636 learned_addr learned my addr 172.21.15.45:0/3853512636 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:17.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.853+0000 7f5475276700 1 -- 172.21.15.45:0/3853512636 >> v1:172.21.15.113:6789/0 conn(0x7f54700c5110 legacy=0x7f54700c1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:17.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.853+0000 7f5475276700 1 -- 172.21.15.45:0/3853512636 >> v1:172.21.15.45:6789/0 conn(0x7f54700a8ba0 legacy=0x7f54701584a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:17.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.853+0000 7f5475276700 1 -- 172.21.15.45:0/3853512636 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5470068aa0 con 0x7f5470065890 2023-12-22T10:01:17.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.857+0000 7f5475276700 1 --2- 172.21.15.45:0/3853512636 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5470065890 0x7f54700c4c20 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f5460006fd0 tx=0x7f54600090f0).ready entity=mon.0 client_cookie=f0b6e3812b4c8f56 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:17.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.857+0000 7f5474a75700 1 -- 172.21.15.45:0/3853512636 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f546000b600 con 0x7f5470065890 2023-12-22T10:01:17.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.857+0000 7f5474a75700 1 -- 172.21.15.45:0/3853512636 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f546000b760 con 0x7f5470065890 2023-12-22T10:01:17.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.857+0000 7f5474a75700 1 -- 172.21.15.45:0/3853512636 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f546000bae0 con 0x7f5470065890 2023-12-22T10:01:17.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.857+0000 7f5476a79700 1 -- 172.21.15.45:0/3853512636 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5470065890 msgr2=0x7f54700c4c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:17.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.857+0000 7f5476a79700 1 --2- 172.21.15.45:0/3853512636 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5470065890 0x7f54700c4c20 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f5460006fd0 tx=0x7f54600090f0).stop 2023-12-22T10:01:17.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.857+0000 7f5476a79700 1 -- 172.21.15.45:0/3853512636 shutdown_connections 2023-12-22T10:01:17.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.857+0000 7f5476a79700 1 --2- 172.21.15.45:0/3853512636 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5470065890 0x7f54700c4c20 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:17.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.857+0000 7f5476a79700 1 -- 172.21.15.45:0/3853512636 >> 172.21.15.45:0/3853512636 conn(0x7f5470067500 msgr2=0x7f54700c6440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:17.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.857+0000 7f5476a79700 1 -- 172.21.15.45:0/3853512636 shutdown_connections 2023-12-22T10:01:17.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.857+0000 7f5476a79700 1 -- 172.21.15.45:0/3853512636 wait complete. 2023-12-22T10:01:17.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.861+0000 7f5476a79700 1 Processor -- start 2023-12-22T10:01:17.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.861+0000 7f5476a79700 1 -- start start 2023-12-22T10:01:17.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.861+0000 7f5476a79700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5470065890 0x7f547014ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:17.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.861+0000 7f5476a79700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54700a8ba0 0x7f547015acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:17.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.861+0000 7f5476a79700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f54700c5110 0x7f547015b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:17.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.861+0000 7f5476a79700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f547015b6b0 con 0x7f54700a8ba0 2023-12-22T10:01:17.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.861+0000 7f5476a79700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f547015d470 con 0x7f5470065890 2023-12-22T10:01:17.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.861+0000 7f5476a79700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f547015c860 con 0x7f54700c5110 2023-12-22T10:01:17.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.861+0000 7f5475276700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54700a8ba0 0x7f547015acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:17.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.861+0000 7f5475276700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54700a8ba0 0x7f547015acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44536/0 (socket says 172.21.15.45:44536) 2023-12-22T10:01:17.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.861+0000 7f5475276700 1 -- 172.21.15.45:0/2861787239 learned_addr learned my addr 172.21.15.45:0/2861787239 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:17.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.861+0000 7f5475a77700 1 --2- 172.21.15.45:0/2861787239 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5470065890 0x7f547014ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:17.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.861+0000 7f5476278700 1 --2- 172.21.15.45:0/2861787239 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f54700c5110 0x7f547015b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:17.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.865+0000 7f5475276700 1 -- 172.21.15.45:0/2861787239 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f54700c5110 msgr2=0x7f547015b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:17.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.865+0000 7f5475276700 1 --2- 172.21.15.45:0/2861787239 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f54700c5110 0x7f547015b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:17.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.865+0000 7f5475276700 1 -- 172.21.15.45:0/2861787239 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5470065890 msgr2=0x7f547014ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:17.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.865+0000 7f5475276700 1 --2- 172.21.15.45:0/2861787239 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5470065890 0x7f547014ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:17.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.865+0000 7f5475276700 1 -- 172.21.15.45:0/2861787239 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5460009370 con 0x7f54700a8ba0 2023-12-22T10:01:17.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.865+0000 7f5475a77700 1 --2- 172.21.15.45:0/2861787239 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5470065890 0x7f547014ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-12-22T10:01:17.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.865+0000 7f5475276700 1 --2- 172.21.15.45:0/2861787239 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54700a8ba0 0x7f547015acd0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7f54600092f0 tx=0x7f5460017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:17.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.865+0000 7f5465ffb700 1 -- 172.21.15.45:0/2861787239 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f546000b8d0 con 0x7f54700a8ba0 2023-12-22T10:01:17.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.865+0000 7f5465ffb700 1 -- 172.21.15.45:0/2861787239 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f546000ba30 con 0x7f54700a8ba0 2023-12-22T10:01:17.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.865+0000 7f5476a79700 1 -- 172.21.15.45:0/2861787239 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f547015cb40 con 0x7f54700a8ba0 2023-12-22T10:01:17.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.865+0000 7f5465ffb700 1 -- 172.21.15.45:0/2861787239 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f546001a430 con 0x7f54700a8ba0 2023-12-22T10:01:17.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.865+0000 7f5476a79700 1 -- 172.21.15.45:0/2861787239 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f547015d100 con 0x7f54700a8ba0 2023-12-22T10:01:17.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.865+0000 7f5476a79700 1 -- 172.21.15.45:0/2861787239 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5470047060 con 0x7f54700a8ba0 2023-12-22T10:01:17.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.869+0000 7f5465ffb700 1 -- 172.21.15.45:0/2861787239 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f5460021020 con 0x7f54700a8ba0 2023-12-22T10:01:17.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.869+0000 7f5465ffb700 1 --2- 172.21.15.45:0/2861787239 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f545405a510 0x7f545405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:17.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.869+0000 7f5465ffb700 1 -- 172.21.15.45:0/2861787239 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f5460075f40 con 0x7f54700a8ba0 2023-12-22T10:01:17.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.869+0000 7f5475a77700 1 --2- 172.21.15.45:0/2861787239 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f545405a510 0x7f545405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:17.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.869+0000 7f5475a77700 1 --2- 172.21.15.45:0/2861787239 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f545405a510 0x7f545405c9d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f546c001c40 tx=0x7f546c009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:17.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:17.877+0000 7f5465ffb700 1 -- 172.21.15.45:0/2861787239 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f5460049660 con 0x7f54700a8ba0 2023-12-22T10:01:18.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.041+0000 7f5476a79700 1 -- 172.21.15.45:0/2861787239 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5470158f00 con 0x7f54700a8ba0 2023-12-22T10:01:18.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.045+0000 7f5465ffb700 1 -- 172.21.15.45:0/2861787239 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5460029070 con 0x7f54700a8ba0 2023-12-22T10:01:18.042 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-22T10:01:18.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.045+0000 7f5476a79700 1 -- 172.21.15.45:0/2861787239 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f545405a510 msgr2=0x7f545405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:18.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.045+0000 7f5476a79700 1 --2- 172.21.15.45:0/2861787239 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f545405a510 0x7f545405c9d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f546c001c40 tx=0x7f546c009040).stop 2023-12-22T10:01:18.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.045+0000 7f5476a79700 1 -- 172.21.15.45:0/2861787239 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54700a8ba0 msgr2=0x7f547015acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:18.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.045+0000 7f5476a79700 1 --2- 172.21.15.45:0/2861787239 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54700a8ba0 0x7f547015acd0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7f54600092f0 tx=0x7f5460017000).stop 2023-12-22T10:01:18.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.045+0000 7f5476a79700 1 -- 172.21.15.45:0/2861787239 shutdown_connections 2023-12-22T10:01:18.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.045+0000 7f5476a79700 1 --2- 172.21.15.45:0/2861787239 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f545405a510 0x7f545405c9d0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:18.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.045+0000 7f5476a79700 1 --2- 172.21.15.45:0/2861787239 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f54700c5110 0x7f547015b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:18.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.045+0000 7f5476a79700 1 --2- 172.21.15.45:0/2861787239 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54700a8ba0 0x7f547015acd0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:18.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.045+0000 7f5476a79700 1 --2- 172.21.15.45:0/2861787239 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5470065890 0x7f547014ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:18.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.045+0000 7f5476a79700 1 -- 172.21.15.45:0/2861787239 >> 172.21.15.45:0/2861787239 conn(0x7f5470067500 msgr2=0x7f54700c1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:18.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.049+0000 7f5476a79700 1 -- 172.21.15.45:0/2861787239 shutdown_connections 2023-12-22T10:01:18.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.049+0000 7f5476a79700 1 -- 172.21.15.45:0/2861787239 wait complete. 2023-12-22T10:01:18.067 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-22T10:01:18.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.245+0000 7f55d3fdb700 1 Processor -- start 2023-12-22T10:01:18.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.245+0000 7f55d3fdb700 1 -- start start 2023-12-22T10:01:18.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.249+0000 7f55d3fdb700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f55cc0c5900 0x7f55cc0ac6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:18.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.249+0000 7f55d3fdb700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f55cc0aa660 0x7f55cc0c7430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:18.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.249+0000 7f55d3fdb700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55cc0c8d50 con 0x7f55cc0ac2d0 2023-12-22T10:01:18.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.249+0000 7f55d3fdb700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55cc0c95f0 con 0x7f55cc0aa660 2023-12-22T10:01:18.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.249+0000 7f55d3fdb700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55cc0aaaf0 con 0x7f55cc0c5900 2023-12-22T10:01:18.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.249+0000 7f55d1d77700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f55cc0ac2d0 0x7f55cc158050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51724/0 (socket says 172.21.15.45:51724) 2023-12-22T10:01:18.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.249+0000 7f55d1d77700 1 -- 172.21.15.45:0/3437735504 learned_addr learned my addr 172.21.15.45:0/3437735504 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:01:18.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.249+0000 7f55d1576700 1 --2- 172.21.15.45:0/3437735504 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f55cc0c5900 0x7f55cc0ac6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:18.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.249+0000 7f55d2578700 1 --2- 172.21.15.45:0/3437735504 >> v2:172.21.15.113:3300/0 conn(0x7f55cc0aa660 0x7f55cc0c7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:18.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.253+0000 7f55d0d75700 1 -- 172.21.15.45:0/3437735504 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3096400972 0 0) 0x7f55cc0c8d50 con 0x7f55cc0ac2d0 2023-12-22T10:01:18.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.253+0000 7f55d0d75700 1 -- 172.21.15.45:0/3437735504 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55b80033f0 con 0x7f55cc0ac2d0 2023-12-22T10:01:18.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.253+0000 7f55d1576700 1 -- 172.21.15.45:0/3437735504 >> v2:172.21.15.113:3300/0 conn(0x7f55cc0aa660 msgr2=0x7f55cc0c7430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:18.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.253+0000 7f55d1576700 1 --2- 172.21.15.45:0/3437735504 >> v2:172.21.15.113:3300/0 conn(0x7f55cc0aa660 0x7f55cc0c7430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:18.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.253+0000 7f55d1576700 1 -- 172.21.15.45:0/3437735504 >> v1:172.21.15.45:6789/0 conn(0x7f55cc0ac2d0 legacy=0x7f55cc158050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:18.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.253+0000 7f55d1576700 1 -- 172.21.15.45:0/3437735504 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55cc0c5ee0 con 0x7f55cc0c5900 2023-12-22T10:01:18.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.253+0000 7f55d2578700 1 --2- 172.21.15.45:0/3437735504 >> v2:172.21.15.113:3300/0 conn(0x7f55cc0aa660 0x7f55cc0c7430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-12-22T10:01:18.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.253+0000 7f55d1576700 1 --2- 172.21.15.45:0/3437735504 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f55cc0c5900 0x7f55cc0ac6b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f55bc009760 tx=0x7f55bc009060).ready entity=mon.2 client_cookie=f25c600553da5cd4 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:18.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.253+0000 7f55d0d75700 1 -- 172.21.15.45:0/3437735504 <== mon.2 v2:172.21.15.113:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55bc00d4a0 con 0x7f55cc0c5900 2023-12-22T10:01:18.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.253+0000 7f55d0d75700 1 -- 172.21.15.45:0/3437735504 <== mon.2 v2:172.21.15.113:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55bc00d600 con 0x7f55cc0c5900 2023-12-22T10:01:18.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.253+0000 7f55d0d75700 1 -- 172.21.15.45:0/3437735504 <== mon.2 v2:172.21.15.113:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55bc00d980 con 0x7f55cc0c5900 2023-12-22T10:01:18.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.253+0000 7f55d3fdb700 1 -- 172.21.15.45:0/3437735504 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f55cc0c5900 msgr2=0x7f55cc0ac6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:18.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.253+0000 7f55d3fdb700 1 --2- 172.21.15.45:0/3437735504 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f55cc0c5900 0x7f55cc0ac6b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f55bc009760 tx=0x7f55bc009060).stop 2023-12-22T10:01:18.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.253+0000 7f55d3fdb700 1 -- 172.21.15.45:0/3437735504 shutdown_connections 2023-12-22T10:01:18.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.253+0000 7f55d3fdb700 1 --2- 172.21.15.45:0/3437735504 >> v2:172.21.15.113:3300/0 conn(0x7f55cc0aa660 0x7f55cc0c7430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:18.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.253+0000 7f55d3fdb700 1 --2- 172.21.15.45:0/3437735504 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f55cc0c5900 0x7f55cc0ac6b0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:18.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.253+0000 7f55d3fdb700 1 -- 172.21.15.45:0/3437735504 >> 172.21.15.45:0/3437735504 conn(0x7f55cc082a50 msgr2=0x7f55cc066a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:18.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.253+0000 7f55d3fdb700 1 -- 172.21.15.45:0/3437735504 shutdown_connections 2023-12-22T10:01:18.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.253+0000 7f55d3fdb700 1 -- 172.21.15.45:0/3437735504 wait complete. 2023-12-22T10:01:18.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.257+0000 7f55d3fdb700 1 Processor -- start 2023-12-22T10:01:18.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.257+0000 7f55d3fdb700 1 -- start start 2023-12-22T10:01:18.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.257+0000 7f55d3fdb700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f55cc0aa660 0x7f55cc163610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:18.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.257+0000 7f55d3fdb700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f55cc0ac2d0 0x7f55cc14c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:18.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.257+0000 7f55d3fdb700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f55cc0c5900 0x7f55cc1673b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:18.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.257+0000 7f55d3fdb700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55cc0afd00 con 0x7f55cc0c5900 2023-12-22T10:01:18.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.257+0000 7f55d3fdb700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55cc14f9d0 con 0x7f55cc0ac2d0 2023-12-22T10:01:18.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.257+0000 7f55d3fdb700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55cc0af3d0 con 0x7f55cc0aa660 2023-12-22T10:01:18.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.257+0000 7f55d2578700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f55cc0c5900 0x7f55cc1673b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:18.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.257+0000 7f55d2578700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f55cc0c5900 0x7f55cc1673b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44552/0 (socket says 172.21.15.45:44552) 2023-12-22T10:01:18.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.257+0000 7f55d2578700 1 -- 172.21.15.45:0/3982312943 learned_addr learned my addr 172.21.15.45:0/3982312943 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:18.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.257+0000 7f55d1576700 1 --2- 172.21.15.45:0/3982312943 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f55cc0ac2d0 0x7f55cc14c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:18.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.257+0000 7f55d1d77700 1 --2- 172.21.15.45:0/3982312943 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f55cc0aa660 0x7f55cc163610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:18.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.261+0000 7f55d2578700 1 -- 172.21.15.45:0/3982312943 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f55cc0aa660 msgr2=0x7f55cc163610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:18.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.261+0000 7f55d2578700 1 --2- 172.21.15.45:0/3982312943 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f55cc0aa660 0x7f55cc163610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:18.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.261+0000 7f55d2578700 1 -- 172.21.15.45:0/3982312943 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f55cc0ac2d0 msgr2=0x7f55cc14c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:18.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.261+0000 7f55d2578700 1 --2- 172.21.15.45:0/3982312943 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f55cc0ac2d0 0x7f55cc14c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:18.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.261+0000 7f55d2578700 1 -- 172.21.15.45:0/3982312943 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55c4009a20 con 0x7f55cc0c5900 2023-12-22T10:01:18.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.261+0000 7f55d1576700 1 --2- 172.21.15.45:0/3982312943 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f55cc0ac2d0 0x7f55cc14c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-12-22T10:01:18.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.261+0000 7f55d2578700 1 --2- 172.21.15.45:0/3982312943 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f55cc0c5900 0x7f55cc1673b0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f55c4009fc0 tx=0x7f55c400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:18.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.261+0000 7f55c1ffb700 1 -- 172.21.15.45:0/3982312943 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c400cbd0 con 0x7f55cc0c5900 2023-12-22T10:01:18.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.261+0000 7f55c1ffb700 1 -- 172.21.15.45:0/3982312943 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55c400f040 con 0x7f55cc0c5900 2023-12-22T10:01:18.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.261+0000 7f55c1ffb700 1 -- 172.21.15.45:0/3982312943 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c4013400 con 0x7f55cc0c5900 2023-12-22T10:01:18.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.261+0000 7f55d3fdb700 1 -- 172.21.15.45:0/3982312943 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55bc0092a0 con 0x7f55cc0c5900 2023-12-22T10:01:18.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.261+0000 7f55d3fdb700 1 -- 172.21.15.45:0/3982312943 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55cc0af990 con 0x7f55cc0c5900 2023-12-22T10:01:18.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.261+0000 7f55d3fdb700 1 -- 172.21.15.45:0/3982312943 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55cc0afe70 con 0x7f55cc0c5900 2023-12-22T10:01:18.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.265+0000 7f55c1ffb700 1 -- 172.21.15.45:0/3982312943 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f55c40137f0 con 0x7f55cc0c5900 2023-12-22T10:01:18.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.265+0000 7f55c1ffb700 1 --2- 172.21.15.45:0/3982312943 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f55b005a510 0x7f55b005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:18.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.265+0000 7f55c1ffb700 1 -- 172.21.15.45:0/3982312943 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f55c40750f0 con 0x7f55cc0c5900 2023-12-22T10:01:18.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.265+0000 7f55d1d77700 1 --2- 172.21.15.45:0/3982312943 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f55b005a510 0x7f55b005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:18.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.265+0000 7f55d1d77700 1 --2- 172.21.15.45:0/3982312943 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f55b005a510 0x7f55b005c9d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f55c8005750 tx=0x7f55c8009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:18.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.273+0000 7f55c1ffb700 1 -- 172.21.15.45:0/3982312943 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f55c40488d0 con 0x7f55cc0c5900 2023-12-22T10:01:18.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.437+0000 7f55d3fdb700 1 -- 172.21.15.45:0/3982312943 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f55cc06c070 con 0x7f55cc0c5900 2023-12-22T10:01:18.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.437+0000 7f55c1ffb700 1 -- 172.21.15.45:0/3982312943 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f55c404bef0 con 0x7f55cc0c5900 2023-12-22T10:01:18.437 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-22T10:01:18.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.441+0000 7f55d3fdb700 1 -- 172.21.15.45:0/3982312943 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f55b005a510 msgr2=0x7f55b005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:18.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.441+0000 7f55d3fdb700 1 --2- 172.21.15.45:0/3982312943 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f55b005a510 0x7f55b005c9d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f55c8005750 tx=0x7f55c8009040).stop 2023-12-22T10:01:18.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.441+0000 7f55d3fdb700 1 -- 172.21.15.45:0/3982312943 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f55cc0c5900 msgr2=0x7f55cc1673b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:18.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.441+0000 7f55d3fdb700 1 --2- 172.21.15.45:0/3982312943 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f55cc0c5900 0x7f55cc1673b0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f55c4009fc0 tx=0x7f55c400b040).stop 2023-12-22T10:01:18.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.441+0000 7f55d3fdb700 1 -- 172.21.15.45:0/3982312943 shutdown_connections 2023-12-22T10:01:18.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.441+0000 7f55d3fdb700 1 --2- 172.21.15.45:0/3982312943 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f55cc0c5900 0x7f55cc1673b0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:18.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.441+0000 7f55d3fdb700 1 --2- 172.21.15.45:0/3982312943 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f55cc0ac2d0 0x7f55cc14c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:18.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.441+0000 7f55d3fdb700 1 --2- 172.21.15.45:0/3982312943 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f55b005a510 0x7f55b005c9d0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:18.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.441+0000 7f55d3fdb700 1 --2- 172.21.15.45:0/3982312943 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f55cc0aa660 0x7f55cc163610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:18.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.441+0000 7f55d3fdb700 1 -- 172.21.15.45:0/3982312943 >> 172.21.15.45:0/3982312943 conn(0x7f55cc082a50 msgr2=0x7f55cc0c0b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:18.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.441+0000 7f55d3fdb700 1 -- 172.21.15.45:0/3982312943 shutdown_connections 2023-12-22T10:01:18.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.441+0000 7f55d3fdb700 1 -- 172.21.15.45:0/3982312943 wait complete. 2023-12-22T10:01:18.460 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T10:01:18.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.625+0000 7f331d7f9700 1 Processor -- start 2023-12-22T10:01:18.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.625+0000 7f331d7f9700 1 -- start start 2023-12-22T10:01:18.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.629+0000 7f331d7f9700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f3318151a20 0x7f3318155750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:18.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.629+0000 7f331d7f9700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3318151e00 0x7f3318155c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:18.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.629+0000 7f331d7f9700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f33180bbe10 0x7f3318069700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:18.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.629+0000 7f331d7f9700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33180bc660 con 0x7f3318151e00 2023-12-22T10:01:18.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.629+0000 7f331d7f9700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3318156130 con 0x7f33180bbe10 2023-12-22T10:01:18.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.629+0000 7f331d7f9700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3318069270 con 0x7f3318151a20 2023-12-22T10:01:18.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.629+0000 7f330f7fe700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3318151e00 0x7f3318155c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:18.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.629+0000 7f330f7fe700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3318151e00 0x7f3318155c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44568/0 (socket says 172.21.15.45:44568) 2023-12-22T10:01:18.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.629+0000 7f330f7fe700 1 -- 172.21.15.45:0/2487741693 learned_addr learned my addr 172.21.15.45:0/2487741693 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:18.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.629+0000 7f331cff8700 1 --2- 172.21.15.45:0/2487741693 >> v2:172.21.15.113:3300/0 conn(0x7f33180bbe10 0x7f3318069700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:18.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.629+0000 7f3317fff700 1 --2- 172.21.15.45:0/2487741693 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f3318151a20 0x7f3318155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:18.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.629+0000 7f330f7fe700 1 -- 172.21.15.45:0/2487741693 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f3318151a20 msgr2=0x7f3318155750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:18.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.629+0000 7f330f7fe700 1 --2- 172.21.15.45:0/2487741693 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f3318151a20 0x7f3318155750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:18.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.629+0000 7f330f7fe700 1 -- 172.21.15.45:0/2487741693 >> v2:172.21.15.113:3300/0 conn(0x7f33180bbe10 msgr2=0x7f3318069700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:18.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.629+0000 7f330f7fe700 1 --2- 172.21.15.45:0/2487741693 >> v2:172.21.15.113:3300/0 conn(0x7f33180bbe10 0x7f3318069700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:18.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.629+0000 7f330f7fe700 1 -- 172.21.15.45:0/2487741693 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33180bc380 con 0x7f3318151e00 2023-12-22T10:01:18.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.629+0000 7f331cff8700 1 --2- 172.21.15.45:0/2487741693 >> v2:172.21.15.113:3300/0 conn(0x7f33180bbe10 0x7f3318069700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T10:01:18.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.629+0000 7f3317fff700 1 --2- 172.21.15.45:0/2487741693 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f3318151a20 0x7f3318155750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-12-22T10:01:18.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.629+0000 7f330f7fe700 1 --2- 172.21.15.45:0/2487741693 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3318151e00 0x7f3318155c40 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f3318063b00 tx=0x7f33000090f0).ready entity=mon.0 client_cookie=99f1d1c23e3f932d server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:18.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.629+0000 7f33177fe700 1 -- 172.21.15.45:0/2487741693 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330000b690 con 0x7f3318151e00 2023-12-22T10:01:18.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.629+0000 7f33177fe700 1 -- 172.21.15.45:0/2487741693 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f330000b7f0 con 0x7f3318151e00 2023-12-22T10:01:18.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.629+0000 7f33177fe700 1 -- 172.21.15.45:0/2487741693 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330000bb70 con 0x7f3318151e00 2023-12-22T10:01:18.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.633+0000 7f331d7f9700 1 -- 172.21.15.45:0/2487741693 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3318151e00 msgr2=0x7f3318155c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:18.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.633+0000 7f331d7f9700 1 --2- 172.21.15.45:0/2487741693 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3318151e00 0x7f3318155c40 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f3318063b00 tx=0x7f33000090f0).stop 2023-12-22T10:01:18.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.633+0000 7f331d7f9700 1 -- 172.21.15.45:0/2487741693 shutdown_connections 2023-12-22T10:01:18.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.633+0000 7f331d7f9700 1 --2- 172.21.15.45:0/2487741693 >> v2:172.21.15.113:3300/0 conn(0x7f33180bbe10 0x7f3318069700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:18.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.633+0000 7f331d7f9700 1 --2- 172.21.15.45:0/2487741693 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3318151e00 0x7f3318155c40 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:18.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.633+0000 7f331d7f9700 1 --2- 172.21.15.45:0/2487741693 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f3318151a20 0x7f3318155750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:18.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.633+0000 7f331d7f9700 1 -- 172.21.15.45:0/2487741693 >> 172.21.15.45:0/2487741693 conn(0x7f3318067540 msgr2=0x7f33180c6460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:18.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.633+0000 7f331d7f9700 1 -- 172.21.15.45:0/2487741693 shutdown_connections 2023-12-22T10:01:18.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.633+0000 7f331d7f9700 1 -- 172.21.15.45:0/2487741693 wait complete. 2023-12-22T10:01:18.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.633+0000 7f331d7f9700 1 Processor -- start 2023-12-22T10:01:18.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.633+0000 7f331d7f9700 1 -- start start 2023-12-22T10:01:18.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.637+0000 7f331d7f9700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f33180bbe10 0x7f3318161e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:18.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.637+0000 7f331d7f9700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3318151a20 0x7f331814eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:18.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.637+0000 7f331d7f9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3318151e00 0x7f331814efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:18.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.637+0000 7f331d7f9700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f331814f4d0 con 0x7f3318151e00 2023-12-22T10:01:18.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.637+0000 7f331d7f9700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3318162350 con 0x7f3318151a20 2023-12-22T10:01:18.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.637+0000 7f331d7f9700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33181527e0 con 0x7f33180bbe10 2023-12-22T10:01:18.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.637+0000 7f331cff8700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3318151e00 0x7f331814efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:18.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.637+0000 7f331cff8700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3318151e00 0x7f331814efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44580/0 (socket says 172.21.15.45:44580) 2023-12-22T10:01:18.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.637+0000 7f331cff8700 1 -- 172.21.15.45:0/1930175330 learned_addr learned my addr 172.21.15.45:0/1930175330 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:18.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.637+0000 7f330f7fe700 1 --2- 172.21.15.45:0/1930175330 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3318151a20 0x7f331814eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:18.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.637+0000 7f3317fff700 1 --2- 172.21.15.45:0/1930175330 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f33180bbe10 0x7f3318161e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:18.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.637+0000 7f331cff8700 1 -- 172.21.15.45:0/1930175330 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f33180bbe10 msgr2=0x7f3318161e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:18.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.637+0000 7f331cff8700 1 --2- 172.21.15.45:0/1930175330 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f33180bbe10 0x7f3318161e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:18.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.637+0000 7f331cff8700 1 -- 172.21.15.45:0/1930175330 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3318151a20 msgr2=0x7f331814eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:18.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.637+0000 7f331cff8700 1 --2- 172.21.15.45:0/1930175330 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3318151a20 0x7f331814eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:18.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.637+0000 7f331cff8700 1 -- 172.21.15.45:0/1930175330 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3300009370 con 0x7f3318151e00 2023-12-22T10:01:18.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.637+0000 7f330f7fe700 1 --2- 172.21.15.45:0/1930175330 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3318151a20 0x7f331814eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T10:01:18.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.637+0000 7f331cff8700 1 --2- 172.21.15.45:0/1930175330 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3318151e00 0x7f331814efe0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7f331000d680 tx=0x7f3310008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:18.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.637+0000 7f3314ff9700 1 -- 172.21.15.45:0/1930175330 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3310011590 con 0x7f3318151e00 2023-12-22T10:01:18.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.637+0000 7f3314ff9700 1 -- 172.21.15.45:0/1930175330 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33100116f0 con 0x7f3318151e00 2023-12-22T10:01:18.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.637+0000 7f3314ff9700 1 -- 172.21.15.45:0/1930175330 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3310011a70 con 0x7f3318151e00 2023-12-22T10:01:18.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.637+0000 7f331d7f9700 1 -- 172.21.15.45:0/1930175330 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3318152ac0 con 0x7f3318151e00 2023-12-22T10:01:18.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.637+0000 7f331d7f9700 1 -- 172.21.15.45:0/1930175330 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3318153080 con 0x7f3318151e00 2023-12-22T10:01:18.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.641+0000 7f331d7f9700 1 -- 172.21.15.45:0/1930175330 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3318047060 con 0x7f3318151e00 2023-12-22T10:01:18.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.641+0000 7f3314ff9700 1 -- 172.21.15.45:0/1930175330 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f3310012420 con 0x7f3318151e00 2023-12-22T10:01:18.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.641+0000 7f3314ff9700 1 --2- 172.21.15.45:0/1930175330 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f32f805a510 0x7f32f805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:18.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.645+0000 7f3314ff9700 1 -- 172.21.15.45:0/1930175330 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f3310074260 con 0x7f3318151e00 2023-12-22T10:01:18.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.645+0000 7f3317fff700 1 --2- 172.21.15.45:0/1930175330 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f32f805a510 0x7f32f805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:18.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.645+0000 7f3317fff700 1 --2- 172.21.15.45:0/1930175330 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f32f805a510 0x7f32f805c9d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f330800e650 tx=0x7f3308007710).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:18.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.649+0000 7f3314ff9700 1 -- 172.21.15.45:0/1930175330 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f33100479e0 con 0x7f3318151e00 2023-12-22T10:01:18.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.849+0000 7f331d7f9700 1 -- 172.21.15.45:0/1930175330 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3318068c20 con 0x7f3318151e00 2023-12-22T10:01:18.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.849+0000 7f3314ff9700 1 -- 172.21.15.45:0/1930175330 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4489 (secure 0 0 0) 0x7f3310011e60 con 0x7f3318151e00 2023-12-22T10:01:18.848 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:01:18.848 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6833/3021221178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6832","nonce":3021221178},{"type":"v1","addr":"172.21.15.113:6833","nonce":3021221178}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6835/1307046651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":1307046651},{"type":"v1","addr":"172.21.15.113:6835","nonce":1307046651}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/3043486757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":3043486757},{"type":"v1","addr":"172.21.15.45:6835","nonce":3043486757}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T10:00:33.522493+0000","modified":"2023-12-22T10:00:36.550815+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6837/1007404834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":1007404834},{"type":"v1","addr":"172.21.15.45:6837","nonce":1007404834}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-12-22T10:01:18.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.853+0000 7f331d7f9700 1 -- 172.21.15.45:0/1930175330 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f32f805a510 msgr2=0x7f32f805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:18.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.853+0000 7f331d7f9700 1 --2- 172.21.15.45:0/1930175330 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f32f805a510 0x7f32f805c9d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f330800e650 tx=0x7f3308007710).stop 2023-12-22T10:01:18.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.853+0000 7f331d7f9700 1 -- 172.21.15.45:0/1930175330 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3318151e00 msgr2=0x7f331814efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:18.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.853+0000 7f331d7f9700 1 --2- 172.21.15.45:0/1930175330 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3318151e00 0x7f331814efe0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7f331000d680 tx=0x7f3310008040).stop 2023-12-22T10:01:18.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.853+0000 7f331d7f9700 1 -- 172.21.15.45:0/1930175330 shutdown_connections 2023-12-22T10:01:18.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.853+0000 7f331d7f9700 1 --2- 172.21.15.45:0/1930175330 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3318151e00 0x7f331814efe0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:18.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.853+0000 7f331d7f9700 1 --2- 172.21.15.45:0/1930175330 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3318151a20 0x7f331814eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:18.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.853+0000 7f331d7f9700 1 --2- 172.21.15.45:0/1930175330 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f32f805a510 0x7f32f805c9d0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:18.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.853+0000 7f331d7f9700 1 --2- 172.21.15.45:0/1930175330 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f33180bbe10 0x7f3318161e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:18.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.853+0000 7f331d7f9700 1 -- 172.21.15.45:0/1930175330 >> 172.21.15.45:0/1930175330 conn(0x7f3318067540 msgr2=0x7f33180aabf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:18.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.853+0000 7f331d7f9700 1 -- 172.21.15.45:0/1930175330 shutdown_connections 2023-12-22T10:01:18.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:18.853+0000 7f331d7f9700 1 -- 172.21.15.45:0/1930175330 wait complete. 2023-12-22T10:01:18.854 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 8 2023-12-22T10:01:18.872 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T10:01:19.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.041+0000 7f8028e39700 1 Processor -- start 2023-12-22T10:01:19.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.041+0000 7f8028e39700 1 -- start start 2023-12-22T10:01:19.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.045+0000 7f8028e39700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f8024150730 0x7f8024068a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:19.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.045+0000 7f8028e39700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f802406a290 0x7f80240c20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:19.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.045+0000 7f8028e39700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f80240c6b70 0x7f80240c25d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:19.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.045+0000 7f8028e39700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8024068f70 con 0x7f802406a290 2023-12-22T10:01:19.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.045+0000 7f8028e39700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80240691f0 con 0x7f80240c6b70 2023-12-22T10:01:19.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.045+0000 7f8028e39700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80240694d0 con 0x7f8024150730 2023-12-22T10:01:19.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.045+0000 7f8022ffd700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f802406a290 0x7f80240c20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:19.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.045+0000 7f8022ffd700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f802406a290 0x7f80240c20e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44584/0 (socket says 172.21.15.45:44584) 2023-12-22T10:01:19.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.045+0000 7f8022ffd700 1 -- 172.21.15.45:0/1006068463 learned_addr learned my addr 172.21.15.45:0/1006068463 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:19.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.045+0000 7f80237fe700 1 --2- 172.21.15.45:0/1006068463 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f8024150730 0x7f8024068a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:19.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.045+0000 7f8023fff700 1 --2- 172.21.15.45:0/1006068463 >> v2:172.21.15.113:3300/0 conn(0x7f80240c6b70 0x7f80240c25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:19.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.045+0000 7f8022ffd700 1 -- 172.21.15.45:0/1006068463 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f8024150730 msgr2=0x7f8024068a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:19.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.045+0000 7f8022ffd700 1 --2- 172.21.15.45:0/1006068463 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f8024150730 0x7f8024068a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:19.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.045+0000 7f8022ffd700 1 -- 172.21.15.45:0/1006068463 >> v2:172.21.15.113:3300/0 conn(0x7f80240c6b70 msgr2=0x7f80240c25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:19.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.045+0000 7f8022ffd700 1 --2- 172.21.15.45:0/1006068463 >> v2:172.21.15.113:3300/0 conn(0x7f80240c6b70 0x7f80240c25d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:19.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.045+0000 7f8022ffd700 1 -- 172.21.15.45:0/1006068463 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80240697b0 con 0x7f802406a290 2023-12-22T10:01:19.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.045+0000 7f8022ffd700 1 --2- 172.21.15.45:0/1006068463 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f802406a290 0x7f80240c20e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7f8024064640 tx=0x7f80180090f0).ready entity=mon.0 client_cookie=6b1aaf6d9d85aa server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:19.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.045+0000 7f80227fc700 1 -- 172.21.15.45:0/1006068463 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f801800f510 con 0x7f802406a290 2023-12-22T10:01:19.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.045+0000 7f80227fc700 1 -- 172.21.15.45:0/1006068463 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f801800f670 con 0x7f802406a290 2023-12-22T10:01:19.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.045+0000 7f80227fc700 1 -- 172.21.15.45:0/1006068463 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f801800f9f0 con 0x7f802406a290 2023-12-22T10:01:19.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.049+0000 7f8028e39700 1 -- 172.21.15.45:0/1006068463 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f802406a290 msgr2=0x7f80240c20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:19.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.049+0000 7f8028e39700 1 --2- 172.21.15.45:0/1006068463 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f802406a290 0x7f80240c20e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7f8024064640 tx=0x7f80180090f0).stop 2023-12-22T10:01:19.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.049+0000 7f8028e39700 1 -- 172.21.15.45:0/1006068463 shutdown_connections 2023-12-22T10:01:19.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.049+0000 7f8028e39700 1 --2- 172.21.15.45:0/1006068463 >> v2:172.21.15.113:3300/0 conn(0x7f80240c6b70 0x7f80240c25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:19.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.049+0000 7f8028e39700 1 --2- 172.21.15.45:0/1006068463 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f802406a290 0x7f80240c20e0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:19.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.049+0000 7f8028e39700 1 --2- 172.21.15.45:0/1006068463 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f8024150730 0x7f8024068a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:19.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.049+0000 7f8028e39700 1 -- 172.21.15.45:0/1006068463 >> 172.21.15.45:0/1006068463 conn(0x7f8024067540 msgr2=0x7f80240c6460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:19.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.049+0000 7f8028e39700 1 -- 172.21.15.45:0/1006068463 shutdown_connections 2023-12-22T10:01:19.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.049+0000 7f8028e39700 1 -- 172.21.15.45:0/1006068463 wait complete. 2023-12-22T10:01:19.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.049+0000 7f8028e39700 1 Processor -- start 2023-12-22T10:01:19.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.049+0000 7f8028e39700 1 -- start start 2023-12-22T10:01:19.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.053+0000 7f8028e39700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f802406a290 0x7f80240bd500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:19.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.053+0000 7f8028e39700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80240c6b70 0x7f8024152af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:19.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.053+0000 7f8028e39700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f8024150730 0x7f802413acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:19.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.053+0000 7f8028e39700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f802414d910 con 0x7f80240c6b70 2023-12-22T10:01:19.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.053+0000 7f8028e39700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f802414cd00 con 0x7f802406a290 2023-12-22T10:01:19.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.053+0000 7f8028e39700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f802414cfe0 con 0x7f8024150730 2023-12-22T10:01:19.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.053+0000 7f8022ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80240c6b70 0x7f8024152af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:19.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.053+0000 7f8022ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80240c6b70 0x7f8024152af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44594/0 (socket says 172.21.15.45:44594) 2023-12-22T10:01:19.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.053+0000 7f8022ffd700 1 -- 172.21.15.45:0/3391571712 learned_addr learned my addr 172.21.15.45:0/3391571712 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:19.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.053+0000 7f80237fe700 1 --2- 172.21.15.45:0/3391571712 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f802406a290 0x7f80240bd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:19.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.053+0000 7f8023fff700 1 --2- 172.21.15.45:0/3391571712 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f8024150730 0x7f802413acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:19.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.053+0000 7f8022ffd700 1 -- 172.21.15.45:0/3391571712 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f8024150730 msgr2=0x7f802413acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:19.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.053+0000 7f8022ffd700 1 --2- 172.21.15.45:0/3391571712 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f8024150730 0x7f802413acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:19.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.053+0000 7f8022ffd700 1 -- 172.21.15.45:0/3391571712 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f802406a290 msgr2=0x7f80240bd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:19.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.053+0000 7f8022ffd700 1 --2- 172.21.15.45:0/3391571712 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f802406a290 0x7f80240bd500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:19.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.053+0000 7f8022ffd700 1 -- 172.21.15.45:0/3391571712 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8018009370 con 0x7f80240c6b70 2023-12-22T10:01:19.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.053+0000 7f8022ffd700 1 --2- 172.21.15.45:0/3391571712 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80240c6b70 0x7f8024152af0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7f8018011000 tx=0x7f8018017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:19.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.053+0000 7f800b7fe700 1 -- 172.21.15.45:0/3391571712 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f801800f7e0 con 0x7f80240c6b70 2023-12-22T10:01:19.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.053+0000 7f800b7fe700 1 -- 172.21.15.45:0/3391571712 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f801800f940 con 0x7f80240c6b70 2023-12-22T10:01:19.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.053+0000 7f8028e39700 1 -- 172.21.15.45:0/3391571712 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f802414d2c0 con 0x7f80240c6b70 2023-12-22T10:01:19.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.053+0000 7f800b7fe700 1 -- 172.21.15.45:0/3391571712 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f801801b660 con 0x7f80240c6b70 2023-12-22T10:01:19.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.053+0000 7f8028e39700 1 -- 172.21.15.45:0/3391571712 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80240bd9f0 con 0x7f80240c6b70 2023-12-22T10:01:19.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.057+0000 7f8028e39700 1 -- 172.21.15.45:0/3391571712 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f802414da80 con 0x7f80240c6b70 2023-12-22T10:01:19.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.057+0000 7f800b7fe700 1 -- 172.21.15.45:0/3391571712 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f801801ba50 con 0x7f80240c6b70 2023-12-22T10:01:19.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.057+0000 7f800b7fe700 1 --2- 172.21.15.45:0/3391571712 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f801005a4e0 0x7f801005c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:19.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.057+0000 7f800b7fe700 1 -- 172.21.15.45:0/3391571712 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f8018075da0 con 0x7f80240c6b70 2023-12-22T10:01:19.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.061+0000 7f80237fe700 1 --2- 172.21.15.45:0/3391571712 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f801005a4e0 0x7f801005c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:19.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.061+0000 7f80237fe700 1 --2- 172.21.15.45:0/3391571712 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f801005a4e0 0x7f801005c9a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f8014009c30 tx=0x7f8014009060).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:19.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.065+0000 7f800b7fe700 1 -- 172.21.15.45:0/3391571712 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f8018049580 con 0x7f80240c6b70 2023-12-22T10:01:19.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.225+0000 7f8028e39700 1 -- 172.21.15.45:0/3391571712 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8024047060 con 0x7f80240c6b70 2023-12-22T10:01:19.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.229+0000 7f800b7fe700 1 -- 172.21.15.45:0/3391571712 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16928 (secure 0 0 0) 0x7f801804cba0 con 0x7f80240c6b70 2023-12-22T10:01:19.227 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:01:19.227 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":21,"fsid":"98b0837e-5e68-4c8f-a1a0-e9424baaad8f","created":"2023-12-22T10:00:15.010174+0000","modified":"2023-12-22T10:00:34.529651+0000","last_up_change":"2023-12-22T10:00:24.980513+0000","last_in_change":"2023-12-22T10:00:17.887172+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-12-22T10:00:25.069641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-12-22T10:00:26.906399+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-12-22T10:00:31.621311+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-12-22T10:00:32.538053+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e19943a0-1c6b-47df-b6bb-383472077890","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":33777},{"type":"v1","addr":"172.21.15.45:6819","nonce":33777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":33777},{"type":"v1","addr":"172.21.15.45:6822","nonce":33777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":33777},{"type":"v1","addr":"172.21.15.45:6830","nonce":33777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":33777},{"type":"v1","addr":"172.21.15.45:6826","nonce":33777}]},"public_addr":"172.21.15.45:6819/33777","cluster_addr":"172.21.15.45:6822/33777","heartbeat_back_addr":"172.21.15.45:6830/33777","heartbeat_front_addr":"172.21.15.45:6826/33777","state":["exists","up"]},{"osd":1,"uuid":"69670f34-f082-45a7-8f67-e962acc136e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":33775},{"type":"v1","addr":"172.21.15.45:6809","nonce":33775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":33775},{"type":"v1","addr":"172.21.15.45:6811","nonce":33775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":33775},{"type":"v1","addr":"172.21.15.45:6815","nonce":33775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":33775},{"type":"v1","addr":"172.21.15.45:6813","nonce":33775}]},"public_addr":"172.21.15.45:6809/33775","cluster_addr":"172.21.15.45:6811/33775","heartbeat_back_addr":"172.21.15.45:6815/33775","heartbeat_front_addr":"172.21.15.45:6813/33775","state":["exists","up"]},{"osd":2,"uuid":"d909d49b-82b8-401b-9947-e49dd167bb95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":33776},{"type":"v1","addr":"172.21.15.45:6801","nonce":33776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":33776},{"type":"v1","addr":"172.21.15.45:6803","nonce":33776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":33776},{"type":"v1","addr":"172.21.15.45:6807","nonce":33776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":33776},{"type":"v1","addr":"172.21.15.45:6805","nonce":33776}]},"public_addr":"172.21.15.45:6801/33776","cluster_addr":"172.21.15.45:6803/33776","heartbeat_back_addr":"172.21.15.45:6807/33776","heartbeat_front_addr":"172.21.15.45:6805/33776","state":["exists","up"]},{"osd":3,"uuid":"db104ca9-3a94-4d39-a2be-bd06db888095","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":33782},{"type":"v1","addr":"172.21.15.45:6817","nonce":33782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":33782},{"type":"v1","addr":"172.21.15.45:6823","nonce":33782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":33782},{"type":"v1","addr":"172.21.15.45:6831","nonce":33782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":33782},{"type":"v1","addr":"172.21.15.45:6827","nonce":33782}]},"public_addr":"172.21.15.45:6817/33782","cluster_addr":"172.21.15.45:6823/33782","heartbeat_back_addr":"172.21.15.45:6831/33782","heartbeat_front_addr":"172.21.15.45:6827/33782","state":["exists","up"]},{"osd":4,"uuid":"9f4eaff4-e433-4479-a0d1-ee7a33375ca6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":34099},{"type":"v1","addr":"172.21.15.113:6811","nonce":34099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":34099},{"type":"v1","addr":"172.21.15.113:6815","nonce":34099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":34099},{"type":"v1","addr":"172.21.15.113:6823","nonce":34099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6816","nonce":34099},{"type":"v1","addr":"172.21.15.113:6818","nonce":34099}]},"public_addr":"172.21.15.113:6811/34099","cluster_addr":"172.21.15.113:6815/34099","heartbeat_back_addr":"172.21.15.113:6823/34099","heartbeat_front_addr":"172.21.15.113:6818/34099","state":["exists","up"]},{"osd":5,"uuid":"1efc5591-180b-43af-8611-0068aadc5aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":34100},{"type":"v1","addr":"172.21.15.113:6801","nonce":34100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":34100},{"type":"v1","addr":"172.21.15.113:6803","nonce":34100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":34100},{"type":"v1","addr":"172.21.15.113:6807","nonce":34100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":34100},{"type":"v1","addr":"172.21.15.113:6805","nonce":34100}]},"public_addr":"172.21.15.113:6801/34100","cluster_addr":"172.21.15.113:6803/34100","heartbeat_back_addr":"172.21.15.113:6807/34100","heartbeat_front_addr":"172.21.15.113:6805/34100","state":["exists","up"]},{"osd":6,"uuid":"6c89d9d8-c153-4a48-afa9-97e4c403f1ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":34101},{"type":"v1","addr":"172.21.15.113:6810","nonce":34101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6812","nonce":34101},{"type":"v1","addr":"172.21.15.113:6814","nonce":34101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6822","nonce":34101},{"type":"v1","addr":"172.21.15.113:6824","nonce":34101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":34101},{"type":"v1","addr":"172.21.15.113:6819","nonce":34101}]},"public_addr":"172.21.15.113:6810/34101","cluster_addr":"172.21.15.113:6814/34101","heartbeat_back_addr":"172.21.15.113:6824/34101","heartbeat_front_addr":"172.21.15.113:6819/34101","state":["exists","up"]},{"osd":7,"uuid":"1855e70c-23f6-4c08-ad7f-774c2148235b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6821","nonce":34102},{"type":"v1","addr":"172.21.15.113:6825","nonce":34102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":34102},{"type":"v1","addr":"172.21.15.113:6827","nonce":34102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":34102},{"type":"v1","addr":"172.21.15.113:6831","nonce":34102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6828","nonce":34102},{"type":"v1","addr":"172.21.15.113:6829","nonce":34102}]},"public_addr":"172.21.15.113:6825/34102","cluster_addr":"172.21.15.113:6827/34102","heartbeat_back_addr":"172.21.15.113:6831/34102","heartbeat_front_addr":"172.21.15.113:6829/34102","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.812672+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.825045+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.700105+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.856563+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.954683+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.883234+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.883994+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.821686+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T10:01:19.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.233+0000 7f8028e39700 1 -- 172.21.15.45:0/3391571712 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f801005a4e0 msgr2=0x7f801005c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:19.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.233+0000 7f8028e39700 1 --2- 172.21.15.45:0/3391571712 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f801005a4e0 0x7f801005c9a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f8014009c30 tx=0x7f8014009060).stop 2023-12-22T10:01:19.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.233+0000 7f8028e39700 1 -- 172.21.15.45:0/3391571712 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80240c6b70 msgr2=0x7f8024152af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:19.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.233+0000 7f8028e39700 1 --2- 172.21.15.45:0/3391571712 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80240c6b70 0x7f8024152af0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7f8018011000 tx=0x7f8018017000).stop 2023-12-22T10:01:19.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.233+0000 7f8028e39700 1 -- 172.21.15.45:0/3391571712 shutdown_connections 2023-12-22T10:01:19.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.233+0000 7f8028e39700 1 --2- 172.21.15.45:0/3391571712 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f801005a4e0 0x7f801005c9a0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:19.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.233+0000 7f8028e39700 1 --2- 172.21.15.45:0/3391571712 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f8024150730 0x7f802413acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:19.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.233+0000 7f8028e39700 1 --2- 172.21.15.45:0/3391571712 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80240c6b70 0x7f8024152af0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:19.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.233+0000 7f8028e39700 1 --2- 172.21.15.45:0/3391571712 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f802406a290 0x7f80240bd500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:19.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.233+0000 7f8028e39700 1 -- 172.21.15.45:0/3391571712 >> 172.21.15.45:0/3391571712 conn(0x7f8024067540 msgr2=0x7f80240c20a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:19.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.233+0000 7f8028e39700 1 -- 172.21.15.45:0/3391571712 shutdown_connections 2023-12-22T10:01:19.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.233+0000 7f8028e39700 1 -- 172.21.15.45:0/3391571712 wait complete. 2023-12-22T10:01:19.249 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-22T10:01:19.250 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T10:01:19.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.413+0000 7f26b91db700 1 Processor -- start 2023-12-22T10:01:19.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.417+0000 7f26b91db700 1 -- start start 2023-12-22T10:01:19.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.417+0000 7f26b91db700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f26b4151cd0 0x7f26b40a6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:19.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.417+0000 7f26b91db700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f26b40a7200 0x7f26b40c3160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:19.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.417+0000 7f26b91db700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26b40a76b0 con 0x7f26b41518f0 2023-12-22T10:01:19.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.417+0000 7f26b91db700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26b40c40f0 con 0x7f26b4151cd0 2023-12-22T10:01:19.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.417+0000 7f26b91db700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26b4155740 con 0x7f26b40a7200 2023-12-22T10:01:19.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.417+0000 7f26abfff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f26b4151cd0 0x7f26b40a6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:19.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.417+0000 7f26abfff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f26b4151cd0 0x7f26b40a6d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44602/0 (socket says 172.21.15.45:44602) 2023-12-22T10:01:19.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.417+0000 7f26abfff700 1 -- 172.21.15.45:0/400537123 learned_addr learned my addr 172.21.15.45:0/400537123 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:19.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.417+0000 7f26b2d9d700 1 --1- 172.21.15.45:0/400537123 >> v1:172.21.15.113:6789/0 conn(0x7f26b41518f0 0x7f26b4064890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.45:51750/0 (socket says 172.21.15.45:51750) 2023-12-22T10:01:19.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.417+0000 7f26b359e700 1 --2- 172.21.15.45:0/400537123 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f26b40a7200 0x7f26b40c3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:19.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.421+0000 7f26abfff700 1 -- 172.21.15.45:0/400537123 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f26b40a7200 msgr2=0x7f26b40c3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:19.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.421+0000 7f26abfff700 1 --2- 172.21.15.45:0/400537123 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f26b40a7200 0x7f26b40c3160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:19.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.421+0000 7f26abfff700 1 -- 172.21.15.45:0/400537123 >> v1:172.21.15.113:6789/0 conn(0x7f26b41518f0 legacy=0x7f26b4064890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:19.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.421+0000 7f26abfff700 1 -- 172.21.15.45:0/400537123 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26b40a61b0 con 0x7f26b4151cd0 2023-12-22T10:01:19.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.421+0000 7f26abfff700 1 --2- 172.21.15.45:0/400537123 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26b4151cd0 0x7f26b40a6d10 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f269c006fd0 tx=0x7f269c0090f0).ready entity=mon.0 client_cookie=4e91e1635c826874 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:19.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.421+0000 7f26b259c700 1 -- 172.21.15.45:0/400537123 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f269c00b580 con 0x7f26b4151cd0 2023-12-22T10:01:19.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.421+0000 7f26b259c700 1 -- 172.21.15.45:0/400537123 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f269c00b6e0 con 0x7f26b4151cd0 2023-12-22T10:01:19.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.421+0000 7f26b259c700 1 -- 172.21.15.45:0/400537123 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f269c00ba60 con 0x7f26b4151cd0 2023-12-22T10:01:19.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.421+0000 7f26b91db700 1 -- 172.21.15.45:0/400537123 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26b4151cd0 msgr2=0x7f26b40a6d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:19.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.421+0000 7f26b91db700 1 --2- 172.21.15.45:0/400537123 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26b4151cd0 0x7f26b40a6d10 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f269c006fd0 tx=0x7f269c0090f0).stop 2023-12-22T10:01:19.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.421+0000 7f26b91db700 1 -- 172.21.15.45:0/400537123 shutdown_connections 2023-12-22T10:01:19.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.421+0000 7f26b91db700 1 --2- 172.21.15.45:0/400537123 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f26b40a7200 0x7f26b40c3160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:19.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.421+0000 7f26b91db700 1 --2- 172.21.15.45:0/400537123 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26b4151cd0 0x7f26b40a6d10 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:19.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.421+0000 7f26b91db700 1 -- 172.21.15.45:0/400537123 >> 172.21.15.45:0/400537123 conn(0x7f26b4066a70 msgr2=0x7f26b4066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:19.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.421+0000 7f26b91db700 1 -- 172.21.15.45:0/400537123 shutdown_connections 2023-12-22T10:01:19.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.421+0000 7f26b91db700 1 -- 172.21.15.45:0/400537123 wait complete. 2023-12-22T10:01:19.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.425+0000 7f26b91db700 1 Processor -- start 2023-12-22T10:01:19.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.425+0000 7f26b91db700 1 -- start start 2023-12-22T10:01:19.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.425+0000 7f26b91db700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26b40a7200 0x7f26b4159400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:19.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.425+0000 7f26b91db700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f26b41518f0 0x7f26b4165700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:19.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.425+0000 7f26b91db700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f26b4151cd0 0x7f26b414bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:19.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.425+0000 7f26b91db700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26b4150950 con 0x7f26b40a7200 2023-12-22T10:01:19.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.425+0000 7f26b91db700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26b40aab00 con 0x7f26b41518f0 2023-12-22T10:01:19.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.425+0000 7f26b91db700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26b4165bf0 con 0x7f26b4151cd0 2023-12-22T10:01:19.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.425+0000 7f26b2d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26b40a7200 0x7f26b4159400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:19.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.425+0000 7f26b2d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26b40a7200 0x7f26b4159400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44604/0 (socket says 172.21.15.45:44604) 2023-12-22T10:01:19.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.425+0000 7f26b2d9d700 1 -- 172.21.15.45:0/2833461729 learned_addr learned my addr 172.21.15.45:0/2833461729 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:19.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.429+0000 7f26abfff700 1 --2- 172.21.15.45:0/2833461729 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f26b41518f0 0x7f26b4165700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:19.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.429+0000 7f26b359e700 1 --2- 172.21.15.45:0/2833461729 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f26b4151cd0 0x7f26b414bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:19.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.429+0000 7f26b2d9d700 1 -- 172.21.15.45:0/2833461729 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f26b4151cd0 msgr2=0x7f26b414bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:19.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.429+0000 7f26b2d9d700 1 --2- 172.21.15.45:0/2833461729 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f26b4151cd0 0x7f26b414bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:19.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.429+0000 7f26b2d9d700 1 -- 172.21.15.45:0/2833461729 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f26b41518f0 msgr2=0x7f26b4165700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:19.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.429+0000 7f26b2d9d700 1 --2- 172.21.15.45:0/2833461729 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f26b41518f0 0x7f26b4165700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:19.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.429+0000 7f26b2d9d700 1 -- 172.21.15.45:0/2833461729 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f269c009370 con 0x7f26b40a7200 2023-12-22T10:01:19.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.429+0000 7f26b359e700 1 --2- 172.21.15.45:0/2833461729 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f26b4151cd0 0x7f26b414bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-12-22T10:01:19.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.429+0000 7f26b2d9d700 1 --2- 172.21.15.45:0/2833461729 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26b40a7200 0x7f26b4159400 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f26a400c4f0 tx=0x7f26a4007db0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:19.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.429+0000 7f26aaffd700 1 -- 172.21.15.45:0/2833461729 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26a40072e0 con 0x7f26b40a7200 2023-12-22T10:01:19.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.429+0000 7f26aaffd700 1 -- 172.21.15.45:0/2833461729 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26a4007440 con 0x7f26b40a7200 2023-12-22T10:01:19.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.429+0000 7f26b91db700 1 -- 172.21.15.45:0/2833461729 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26b414e5d0 con 0x7f26b40a7200 2023-12-22T10:01:19.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.429+0000 7f26aaffd700 1 -- 172.21.15.45:0/2833461729 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26a40058f0 con 0x7f26b40a7200 2023-12-22T10:01:19.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.429+0000 7f26b91db700 1 -- 172.21.15.45:0/2833461729 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26b414eb90 con 0x7f26b40a7200 2023-12-22T10:01:19.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.429+0000 7f26b91db700 1 -- 172.21.15.45:0/2833461729 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26b414d920 con 0x7f26b40a7200 2023-12-22T10:01:19.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.433+0000 7f26aaffd700 1 -- 172.21.15.45:0/2833461729 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f26a4005ce0 con 0x7f26b40a7200 2023-12-22T10:01:19.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.433+0000 7f26aaffd700 1 --2- 172.21.15.45:0/2833461729 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f269405a510 0x7f269405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:19.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.433+0000 7f26aaffd700 1 -- 172.21.15.45:0/2833461729 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f26a4073f70 con 0x7f26b40a7200 2023-12-22T10:01:19.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.433+0000 7f26abfff700 1 --2- 172.21.15.45:0/2833461729 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f269405a510 0x7f269405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:19.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.433+0000 7f26abfff700 1 --2- 172.21.15.45:0/2833461729 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f269405a510 0x7f269405c9d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f269c009130 tx=0x7f269c017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:19.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.437+0000 7f26aaffd700 1 -- 172.21.15.45:0/2833461729 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f26b414d920 con 0x7f26b40a7200 2023-12-22T10:01:19.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.633+0000 7f26b91db700 1 -- 172.21.15.45:0/2833461729 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f26b414d920 con 0x7f26b40a7200 2023-12-22T10:01:19.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.633+0000 7f26aaffd700 1 -- 172.21.15.45:0/2833461729 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4489 (secure 0 0 0) 0x7f26b414d920 con 0x7f26b40a7200 2023-12-22T10:01:19.632 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:01:19.632 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6833/3021221178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6832","nonce":3021221178},{"type":"v1","addr":"172.21.15.113:6833","nonce":3021221178}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6835/1307046651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":1307046651},{"type":"v1","addr":"172.21.15.113:6835","nonce":1307046651}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/3043486757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":3043486757},{"type":"v1","addr":"172.21.15.45:6835","nonce":3043486757}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T10:00:33.522493+0000","modified":"2023-12-22T10:00:36.550815+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6837/1007404834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":1007404834},{"type":"v1","addr":"172.21.15.45:6837","nonce":1007404834}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-12-22T10:01:19.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.637+0000 7f26b91db700 1 -- 172.21.15.45:0/2833461729 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f269405a510 msgr2=0x7f269405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:19.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.637+0000 7f26b91db700 1 --2- 172.21.15.45:0/2833461729 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f269405a510 0x7f269405c9d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f269c009130 tx=0x7f269c017000).stop 2023-12-22T10:01:19.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.637+0000 7f26b91db700 1 -- 172.21.15.45:0/2833461729 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26b40a7200 msgr2=0x7f26b4159400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:19.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.637+0000 7f26b91db700 1 --2- 172.21.15.45:0/2833461729 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26b40a7200 0x7f26b4159400 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f26a400c4f0 tx=0x7f26a4007db0).stop 2023-12-22T10:01:19.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.637+0000 7f26b91db700 1 -- 172.21.15.45:0/2833461729 shutdown_connections 2023-12-22T10:01:19.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.637+0000 7f26b91db700 1 --2- 172.21.15.45:0/2833461729 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f269405a510 0x7f269405c9d0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:19.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.637+0000 7f26b91db700 1 --2- 172.21.15.45:0/2833461729 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f26b4151cd0 0x7f26b414bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:19.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.637+0000 7f26b91db700 1 --2- 172.21.15.45:0/2833461729 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f26b41518f0 0x7f26b4165700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:19.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.637+0000 7f26b91db700 1 --2- 172.21.15.45:0/2833461729 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26b40a7200 0x7f26b4159400 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:19.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.637+0000 7f26b91db700 1 -- 172.21.15.45:0/2833461729 >> 172.21.15.45:0/2833461729 conn(0x7f26b4066a70 msgr2=0x7f26b414d210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:19.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.637+0000 7f26b91db700 1 -- 172.21.15.45:0/2833461729 shutdown_connections 2023-12-22T10:01:19.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.641+0000 7f26b91db700 1 -- 172.21.15.45:0/2833461729 wait complete. 2023-12-22T10:01:19.640 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 8 2023-12-22T10:01:19.658 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T10:01:19.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.821+0000 7fdc98f46700 1 Processor -- start 2023-12-22T10:01:19.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.821+0000 7fdc98f46700 1 -- start start 2023-12-22T10:01:19.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.821+0000 7fdc98f46700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fdc9414e340 0x7fdc940bf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:19.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.821+0000 7fdc98f46700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fdc940bdce0 0x7fdc94154b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:19.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.821+0000 7fdc98f46700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fdc94062b30 0x7fdc94062f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:19.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.821+0000 7fdc98f46700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc94068600 con 0x7fdc94062b30 2023-12-22T10:01:19.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.821+0000 7fdc98f46700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc940bf770 con 0x7fdc940bdce0 2023-12-22T10:01:19.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.821+0000 7fdc98f46700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc94063450 con 0x7fdc9414e340 2023-12-22T10:01:19.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.821+0000 7fdc92d9d700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fdc94062b30 0x7fdc94062f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:19.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.821+0000 7fdc92d9d700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fdc94062b30 0x7fdc94062f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44606/0 (socket says 172.21.15.45:44606) 2023-12-22T10:01:19.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.821+0000 7fdc92d9d700 1 -- 172.21.15.45:0/2496220457 learned_addr learned my addr 172.21.15.45:0/2496220457 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:19.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.821+0000 7fdc91d9b700 1 --2- 172.21.15.45:0/2496220457 >> v2:172.21.15.113:3300/0 conn(0x7fdc940bdce0 0x7fdc94154b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:19.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.821+0000 7fdc9259c700 1 --2- 172.21.15.45:0/2496220457 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fdc9414e340 0x7fdc940bf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:19.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.825+0000 7fdc92d9d700 1 -- 172.21.15.45:0/2496220457 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fdc9414e340 msgr2=0x7fdc940bf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:19.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.825+0000 7fdc92d9d700 1 --2- 172.21.15.45:0/2496220457 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fdc9414e340 0x7fdc940bf280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:19.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.825+0000 7fdc92d9d700 1 -- 172.21.15.45:0/2496220457 >> v2:172.21.15.113:3300/0 conn(0x7fdc940bdce0 msgr2=0x7fdc94154b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:19.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.825+0000 7fdc92d9d700 1 --2- 172.21.15.45:0/2496220457 >> v2:172.21.15.113:3300/0 conn(0x7fdc940bdce0 0x7fdc94154b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:19.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.825+0000 7fdc92d9d700 1 -- 172.21.15.45:0/2496220457 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc940be1e0 con 0x7fdc94062b30 2023-12-22T10:01:19.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.825+0000 7fdc92d9d700 1 --2- 172.21.15.45:0/2496220457 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc94062b30 0x7fdc94062f60 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7fdc940c6380 tx=0x7fdc8c009840).ready entity=mon.0 client_cookie=909d4bd54b488c19 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:19.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.825+0000 7fdc9159a700 1 -- 172.21.15.45:0/2496220457 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc8c00e070 con 0x7fdc94062b30 2023-12-22T10:01:19.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.825+0000 7fdc9159a700 1 -- 172.21.15.45:0/2496220457 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc8c00b930 con 0x7fdc94062b30 2023-12-22T10:01:19.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.825+0000 7fdc9159a700 1 -- 172.21.15.45:0/2496220457 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc8c00bcb0 con 0x7fdc94062b30 2023-12-22T10:01:19.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.825+0000 7fdc98f46700 1 -- 172.21.15.45:0/2496220457 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc94062b30 msgr2=0x7fdc94062f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:19.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.825+0000 7fdc98f46700 1 --2- 172.21.15.45:0/2496220457 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc94062b30 0x7fdc94062f60 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7fdc940c6380 tx=0x7fdc8c009840).stop 2023-12-22T10:01:19.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.825+0000 7fdc98f46700 1 -- 172.21.15.45:0/2496220457 shutdown_connections 2023-12-22T10:01:19.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.825+0000 7fdc98f46700 1 --2- 172.21.15.45:0/2496220457 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc94062b30 0x7fdc94062f60 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:19.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.825+0000 7fdc98f46700 1 --2- 172.21.15.45:0/2496220457 >> v2:172.21.15.113:3300/0 conn(0x7fdc940bdce0 0x7fdc94154b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:19.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.825+0000 7fdc98f46700 1 --2- 172.21.15.45:0/2496220457 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fdc9414e340 0x7fdc940bf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:19.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.825+0000 7fdc98f46700 1 -- 172.21.15.45:0/2496220457 >> 172.21.15.45:0/2496220457 conn(0x7fdc940c8870 msgr2=0x7fdc940c8c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:19.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.829+0000 7fdc98f46700 1 -- 172.21.15.45:0/2496220457 shutdown_connections 2023-12-22T10:01:19.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.829+0000 7fdc98f46700 1 -- 172.21.15.45:0/2496220457 wait complete. 2023-12-22T10:01:19.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.829+0000 7fdc98f46700 1 Processor -- start 2023-12-22T10:01:19.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.829+0000 7fdc98f46700 1 -- start start 2023-12-22T10:01:19.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.829+0000 7fdc98f46700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc94062b30 0x7fdc941411e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:19.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.829+0000 7fdc98f46700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fdc940bdce0 0x7fdc94158a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:19.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.829+0000 7fdc98f46700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdc9414e340 0x7fdc94158f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:19.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.829+0000 7fdc98f46700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc94159560 con 0x7fdc94062b30 2023-12-22T10:01:19.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.829+0000 7fdc98f46700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc94159840 con 0x7fdc9414e340 2023-12-22T10:01:19.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.829+0000 7fdc98f46700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc94159b20 con 0x7fdc940bdce0 2023-12-22T10:01:19.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.829+0000 7fdc9259c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc94062b30 0x7fdc941411e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:19.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.833+0000 7fdc9259c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc94062b30 0x7fdc941411e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44618/0 (socket says 172.21.15.45:44618) 2023-12-22T10:01:19.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.833+0000 7fdc9259c700 1 -- 172.21.15.45:0/253965470 learned_addr learned my addr 172.21.15.45:0/253965470 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:19.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.833+0000 7fdc91d9b700 1 --2- 172.21.15.45:0/253965470 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fdc940bdce0 0x7fdc94158a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:19.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.833+0000 7fdc92d9d700 1 --2- 172.21.15.45:0/253965470 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdc9414e340 0x7fdc94158f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:19.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.833+0000 7fdc9259c700 1 -- 172.21.15.45:0/253965470 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fdc940bdce0 msgr2=0x7fdc94158a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:19.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.833+0000 7fdc9259c700 1 --2- 172.21.15.45:0/253965470 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fdc940bdce0 0x7fdc94158a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:19.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.833+0000 7fdc9259c700 1 -- 172.21.15.45:0/253965470 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdc9414e340 msgr2=0x7fdc94158f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:19.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.833+0000 7fdc9259c700 1 --2- 172.21.15.45:0/253965470 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdc9414e340 0x7fdc94158f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:19.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.833+0000 7fdc9259c700 1 -- 172.21.15.45:0/253965470 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc8c009ae0 con 0x7fdc94062b30 2023-12-22T10:01:19.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.833+0000 7fdc92d9d700 1 --2- 172.21.15.45:0/253965470 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdc9414e340 0x7fdc94158f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-12-22T10:01:19.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.833+0000 7fdc9259c700 1 --2- 172.21.15.45:0/253965470 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc94062b30 0x7fdc941411e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7fdc8400e930 tx=0x7fdc84009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:19.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.833+0000 7fdc827fc700 1 -- 172.21.15.45:0/253965470 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc8400eed0 con 0x7fdc94062b30 2023-12-22T10:01:19.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.833+0000 7fdc827fc700 1 -- 172.21.15.45:0/253965470 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc8400c850 con 0x7fdc94062b30 2023-12-22T10:01:19.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.833+0000 7fdc827fc700 1 -- 172.21.15.45:0/253965470 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc8400cbd0 con 0x7fdc94062b30 2023-12-22T10:01:19.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.833+0000 7fdc98f46700 1 -- 172.21.15.45:0/253965470 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc94159e00 con 0x7fdc94062b30 2023-12-22T10:01:19.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.833+0000 7fdc98f46700 1 -- 172.21.15.45:0/253965470 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc9414bc10 con 0x7fdc94062b30 2023-12-22T10:01:19.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.833+0000 7fdc98f46700 1 -- 172.21.15.45:0/253965470 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc9406c070 con 0x7fdc94062b30 2023-12-22T10:01:19.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.837+0000 7fdc827fc700 1 -- 172.21.15.45:0/253965470 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fdc8401b400 con 0x7fdc94062b30 2023-12-22T10:01:19.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.837+0000 7fdc827fc700 1 --2- 172.21.15.45:0/253965470 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fdc7405a4e0 0x7fdc7405c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:19.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.837+0000 7fdc827fc700 1 -- 172.21.15.45:0/253965470 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fdc84074ce0 con 0x7fdc94062b30 2023-12-22T10:01:19.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.837+0000 7fdc91d9b700 1 --2- 172.21.15.45:0/253965470 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fdc7405a4e0 0x7fdc7405c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:19.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.837+0000 7fdc91d9b700 1 --2- 172.21.15.45:0/253965470 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fdc7405a4e0 0x7fdc7405c9a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7fdc94145090 tx=0x7fdc88008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:19.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:19.845+0000 7fdc827fc700 1 -- 172.21.15.45:0/253965470 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fdc84048550 con 0x7fdc94062b30 2023-12-22T10:01:20.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.053+0000 7fdc98f46700 1 -- 172.21.15.45:0/253965470 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdc940be4c0 con 0x7fdc94062b30 2023-12-22T10:01:20.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.057+0000 7fdc827fc700 1 -- 172.21.15.45:0/253965470 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4489 (secure 0 0 0) 0x7fdc8404e1a0 con 0x7fdc94062b30 2023-12-22T10:01:20.054 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:01:20.054 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6833/3021221178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6832","nonce":3021221178},{"type":"v1","addr":"172.21.15.113:6833","nonce":3021221178}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6835/1307046651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":1307046651},{"type":"v1","addr":"172.21.15.113:6835","nonce":1307046651}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/3043486757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":3043486757},{"type":"v1","addr":"172.21.15.45:6835","nonce":3043486757}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T10:00:33.522493+0000","modified":"2023-12-22T10:00:36.550815+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6837/1007404834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":1007404834},{"type":"v1","addr":"172.21.15.45:6837","nonce":1007404834}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-12-22T10:01:20.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.057+0000 7fdc98f46700 1 -- 172.21.15.45:0/253965470 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fdc7405a4e0 msgr2=0x7fdc7405c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:20.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.057+0000 7fdc98f46700 1 --2- 172.21.15.45:0/253965470 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fdc7405a4e0 0x7fdc7405c9a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7fdc94145090 tx=0x7fdc88008040).stop 2023-12-22T10:01:20.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.057+0000 7fdc98f46700 1 -- 172.21.15.45:0/253965470 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc94062b30 msgr2=0x7fdc941411e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:20.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.057+0000 7fdc98f46700 1 --2- 172.21.15.45:0/253965470 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc94062b30 0x7fdc941411e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7fdc8400e930 tx=0x7fdc84009060).stop 2023-12-22T10:01:20.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.057+0000 7fdc98f46700 1 -- 172.21.15.45:0/253965470 shutdown_connections 2023-12-22T10:01:20.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.057+0000 7fdc98f46700 1 --2- 172.21.15.45:0/253965470 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdc9414e340 0x7fdc94158f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:20.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.057+0000 7fdc98f46700 1 --2- 172.21.15.45:0/253965470 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fdc7405a4e0 0x7fdc7405c9a0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:20.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.057+0000 7fdc98f46700 1 --2- 172.21.15.45:0/253965470 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fdc940bdce0 0x7fdc94158a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:20.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.057+0000 7fdc98f46700 1 --2- 172.21.15.45:0/253965470 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc94062b30 0x7fdc941411e0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:20.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.057+0000 7fdc98f46700 1 -- 172.21.15.45:0/253965470 >> 172.21.15.45:0/253965470 conn(0x7fdc940c8870 msgr2=0x7fdc94146620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:20.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.057+0000 7fdc98f46700 1 -- 172.21.15.45:0/253965470 shutdown_connections 2023-12-22T10:01:20.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.061+0000 7fdc98f46700 1 -- 172.21.15.45:0/253965470 wait complete. 2023-12-22T10:01:20.060 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 8 2023-12-22T10:01:20.077 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T10:01:20.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.245+0000 7f09c359e700 1 Processor -- start 2023-12-22T10:01:20.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.245+0000 7f09c359e700 1 -- start start 2023-12-22T10:01:20.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.249+0000 7f09c359e700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f09c414fd40 0x7f09c4150120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:20.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.249+0000 7f09c359e700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f09c40645b0 0x7f09c4064a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:20.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.249+0000 7f09c359e700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09c4064f30 con 0x7f09c4065890 2023-12-22T10:01:20.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.249+0000 7f09c359e700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09c40c1cc0 con 0x7f09c40645b0 2023-12-22T10:01:20.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.249+0000 7f09c359e700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09c40c1fa0 con 0x7f09c414fd40 2023-12-22T10:01:20.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.249+0000 7f09c1d9b700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f09c4065890 0x7f09c4069490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51738/0 (socket says 172.21.15.45:51738) 2023-12-22T10:01:20.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.249+0000 7f09c1d9b700 1 -- 172.21.15.45:0/597529728 learned_addr learned my addr 172.21.15.45:0/597529728 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:01:20.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.249+0000 7f09c2d9d700 1 --2- 172.21.15.45:0/597529728 >> v2:172.21.15.113:3300/0 conn(0x7f09c40645b0 0x7f09c4064a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:20.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.249+0000 7f09c259c700 1 --2- 172.21.15.45:0/597529728 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f09c414fd40 0x7f09c4150120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:20.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.249+0000 7f09c159a700 1 -- 172.21.15.45:0/597529728 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1093318721 0 0) 0x7f09c4064f30 con 0x7f09c4065890 2023-12-22T10:01:20.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.249+0000 7f09c159a700 1 -- 172.21.15.45:0/597529728 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09ac0033f0 con 0x7f09c4065890 2023-12-22T10:01:20.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.253+0000 7f09c259c700 1 -- 172.21.15.45:0/597529728 >> v2:172.21.15.113:3300/0 conn(0x7f09c40645b0 msgr2=0x7f09c4064a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:20.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.253+0000 7f09c259c700 1 --2- 172.21.15.45:0/597529728 >> v2:172.21.15.113:3300/0 conn(0x7f09c40645b0 0x7f09c4064a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:20.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.253+0000 7f09c259c700 1 -- 172.21.15.45:0/597529728 >> v1:172.21.15.45:6789/0 conn(0x7f09c4065890 legacy=0x7f09c4069490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:20.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.253+0000 7f09c259c700 1 -- 172.21.15.45:0/597529728 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09c40c2280 con 0x7f09c414fd40 2023-12-22T10:01:20.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.253+0000 7f09c259c700 1 --2- 172.21.15.45:0/597529728 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f09c414fd40 0x7f09c4150120 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f09b4009760 tx=0x7f09b4009060).ready entity=mon.2 client_cookie=72428c52150c4326 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:20.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.253+0000 7f09c159a700 1 -- 172.21.15.45:0/597529728 <== mon.2 v2:172.21.15.113:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b400f6b0 con 0x7f09c414fd40 2023-12-22T10:01:20.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.253+0000 7f09c159a700 1 -- 172.21.15.45:0/597529728 <== mon.2 v2:172.21.15.113:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09b400f810 con 0x7f09c414fd40 2023-12-22T10:01:20.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.253+0000 7f09c159a700 1 -- 172.21.15.45:0/597529728 <== mon.2 v2:172.21.15.113:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b400fb90 con 0x7f09c414fd40 2023-12-22T10:01:20.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.253+0000 7f09c359e700 1 -- 172.21.15.45:0/597529728 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f09c414fd40 msgr2=0x7f09c4150120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:20.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.253+0000 7f09c359e700 1 --2- 172.21.15.45:0/597529728 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f09c414fd40 0x7f09c4150120 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f09b4009760 tx=0x7f09b4009060).stop 2023-12-22T10:01:20.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.253+0000 7f09c359e700 1 -- 172.21.15.45:0/597529728 shutdown_connections 2023-12-22T10:01:20.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.253+0000 7f09c359e700 1 --2- 172.21.15.45:0/597529728 >> v2:172.21.15.113:3300/0 conn(0x7f09c40645b0 0x7f09c4064a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:20.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.253+0000 7f09c359e700 1 --2- 172.21.15.45:0/597529728 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f09c414fd40 0x7f09c4150120 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:20.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.253+0000 7f09c359e700 1 -- 172.21.15.45:0/597529728 >> 172.21.15.45:0/597529728 conn(0x7f09c4067540 msgr2=0x7f09c40c6460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:20.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.253+0000 7f09c359e700 1 -- 172.21.15.45:0/597529728 shutdown_connections 2023-12-22T10:01:20.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.253+0000 7f09c359e700 1 -- 172.21.15.45:0/597529728 wait complete. 2023-12-22T10:01:20.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.253+0000 7f09c359e700 1 Processor -- start 2023-12-22T10:01:20.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.257+0000 7f09c359e700 1 -- start start 2023-12-22T10:01:20.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.257+0000 7f09c359e700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f09c40645b0 0x7f09c41486a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:20.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.257+0000 7f09c359e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09c4065890 0x7f09c414bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:20.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.257+0000 7f09c359e700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f09c414fd40 0x7f09c40bf950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:20.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.257+0000 7f09c359e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09c40ab170 con 0x7f09c4065890 2023-12-22T10:01:20.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.257+0000 7f09c359e700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09c40aa560 con 0x7f09c414fd40 2023-12-22T10:01:20.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.257+0000 7f09c359e700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09c40aa840 con 0x7f09c40645b0 2023-12-22T10:01:20.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.257+0000 7f09c1d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09c4065890 0x7f09c414bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:20.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.257+0000 7f09c1d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09c4065890 0x7f09c414bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44632/0 (socket says 172.21.15.45:44632) 2023-12-22T10:01:20.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.257+0000 7f09c1d9b700 1 -- 172.21.15.45:0/1913290350 learned_addr learned my addr 172.21.15.45:0/1913290350 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:20.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.257+0000 7f09c1d9b700 1 -- 172.21.15.45:0/1913290350 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f09c40645b0 msgr2=0x7f09c41486a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:20.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.257+0000 7f09c1d9b700 1 --2- 172.21.15.45:0/1913290350 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f09c40645b0 0x7f09c41486a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-12-22T10:01:20.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.257+0000 7f09c1d9b700 1 -- 172.21.15.45:0/1913290350 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f09c414fd40 msgr2=0x7f09c40bf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:20.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.257+0000 7f09c2d9d700 1 --2- 172.21.15.45:0/1913290350 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f09c414fd40 0x7f09c40bf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:20.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.257+0000 7f09c1d9b700 1 --2- 172.21.15.45:0/1913290350 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f09c414fd40 0x7f09c40bf950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:20.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.257+0000 7f09c1d9b700 1 -- 172.21.15.45:0/1913290350 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09b40092a0 con 0x7f09c4065890 2023-12-22T10:01:20.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.257+0000 7f09c2d9d700 1 --2- 172.21.15.45:0/1913290350 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f09c414fd40 0x7f09c40bf950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-12-22T10:01:20.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.257+0000 7f09c1d9b700 1 --2- 172.21.15.45:0/1913290350 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09c4065890 0x7f09c414bb80 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f09b800c420 tx=0x7f09b8007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:20.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.257+0000 7f09b27fc700 1 -- 172.21.15.45:0/1913290350 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b80072e0 con 0x7f09c4065890 2023-12-22T10:01:20.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.257+0000 7f09b27fc700 1 -- 172.21.15.45:0/1913290350 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09b8007440 con 0x7f09c4065890 2023-12-22T10:01:20.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.257+0000 7f09c359e700 1 -- 172.21.15.45:0/1913290350 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09c40aab20 con 0x7f09c4065890 2023-12-22T10:01:20.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.257+0000 7f09b27fc700 1 -- 172.21.15.45:0/1913290350 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b80057a0 con 0x7f09c4065890 2023-12-22T10:01:20.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.257+0000 7f09c359e700 1 -- 172.21.15.45:0/1913290350 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09c4148b90 con 0x7f09c4065890 2023-12-22T10:01:20.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.261+0000 7f09c359e700 1 -- 172.21.15.45:0/1913290350 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09c4047060 con 0x7f09c4065890 2023-12-22T10:01:20.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.261+0000 7f09b27fc700 1 -- 172.21.15.45:0/1913290350 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f09b8005bd0 con 0x7f09c4065890 2023-12-22T10:01:20.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.261+0000 7f09b27fc700 1 --2- 172.21.15.45:0/1913290350 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f09a405a510 0x7f09a405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:20.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.261+0000 7f09b27fc700 1 -- 172.21.15.45:0/1913290350 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f09b80740c0 con 0x7f09c4065890 2023-12-22T10:01:20.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.265+0000 7f09c259c700 1 --2- 172.21.15.45:0/1913290350 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f09a405a510 0x7f09a405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:20.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.265+0000 7f09c259c700 1 --2- 172.21.15.45:0/1913290350 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f09a405a510 0x7f09a405c9d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f09b400f470 tx=0x7f09b4018000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:20.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.269+0000 7f09b27fc700 1 -- 172.21.15.45:0/1913290350 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f09b80477e0 con 0x7f09c4065890 2023-12-22T10:01:20.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.437+0000 7f09c359e700 1 -- 172.21.15.45:0/1913290350 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f09c40ab2b0 con 0x7f09c4065890 2023-12-22T10:01:20.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.437+0000 7f09b27fc700 1 -- 172.21.15.45:0/1913290350 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16928 (secure 0 0 0) 0x7f09b8007d90 con 0x7f09c4065890 2023-12-22T10:01:20.436 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:01:20.437 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":21,"fsid":"98b0837e-5e68-4c8f-a1a0-e9424baaad8f","created":"2023-12-22T10:00:15.010174+0000","modified":"2023-12-22T10:00:34.529651+0000","last_up_change":"2023-12-22T10:00:24.980513+0000","last_in_change":"2023-12-22T10:00:17.887172+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-12-22T10:00:25.069641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-12-22T10:00:26.906399+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-12-22T10:00:31.621311+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-12-22T10:00:32.538053+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e19943a0-1c6b-47df-b6bb-383472077890","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":33777},{"type":"v1","addr":"172.21.15.45:6819","nonce":33777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":33777},{"type":"v1","addr":"172.21.15.45:6822","nonce":33777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":33777},{"type":"v1","addr":"172.21.15.45:6830","nonce":33777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":33777},{"type":"v1","addr":"172.21.15.45:6826","nonce":33777}]},"public_addr":"172.21.15.45:6819/33777","cluster_addr":"172.21.15.45:6822/33777","heartbeat_back_addr":"172.21.15.45:6830/33777","heartbeat_front_addr":"172.21.15.45:6826/33777","state":["exists","up"]},{"osd":1,"uuid":"69670f34-f082-45a7-8f67-e962acc136e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":33775},{"type":"v1","addr":"172.21.15.45:6809","nonce":33775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":33775},{"type":"v1","addr":"172.21.15.45:6811","nonce":33775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":33775},{"type":"v1","addr":"172.21.15.45:6815","nonce":33775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":33775},{"type":"v1","addr":"172.21.15.45:6813","nonce":33775}]},"public_addr":"172.21.15.45:6809/33775","cluster_addr":"172.21.15.45:6811/33775","heartbeat_back_addr":"172.21.15.45:6815/33775","heartbeat_front_addr":"172.21.15.45:6813/33775","state":["exists","up"]},{"osd":2,"uuid":"d909d49b-82b8-401b-9947-e49dd167bb95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":33776},{"type":"v1","addr":"172.21.15.45:6801","nonce":33776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":33776},{"type":"v1","addr":"172.21.15.45:6803","nonce":33776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":33776},{"type":"v1","addr":"172.21.15.45:6807","nonce":33776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":33776},{"type":"v1","addr":"172.21.15.45:6805","nonce":33776}]},"public_addr":"172.21.15.45:6801/33776","cluster_addr":"172.21.15.45:6803/33776","heartbeat_back_addr":"172.21.15.45:6807/33776","heartbeat_front_addr":"172.21.15.45:6805/33776","state":["exists","up"]},{"osd":3,"uuid":"db104ca9-3a94-4d39-a2be-bd06db888095","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":33782},{"type":"v1","addr":"172.21.15.45:6817","nonce":33782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":33782},{"type":"v1","addr":"172.21.15.45:6823","nonce":33782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":33782},{"type":"v1","addr":"172.21.15.45:6831","nonce":33782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":33782},{"type":"v1","addr":"172.21.15.45:6827","nonce":33782}]},"public_addr":"172.21.15.45:6817/33782","cluster_addr":"172.21.15.45:6823/33782","heartbeat_back_addr":"172.21.15.45:6831/33782","heartbeat_front_addr":"172.21.15.45:6827/33782","state":["exists","up"]},{"osd":4,"uuid":"9f4eaff4-e433-4479-a0d1-ee7a33375ca6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":34099},{"type":"v1","addr":"172.21.15.113:6811","nonce":34099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":34099},{"type":"v1","addr":"172.21.15.113:6815","nonce":34099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":34099},{"type":"v1","addr":"172.21.15.113:6823","nonce":34099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6816","nonce":34099},{"type":"v1","addr":"172.21.15.113:6818","nonce":34099}]},"public_addr":"172.21.15.113:6811/34099","cluster_addr":"172.21.15.113:6815/34099","heartbeat_back_addr":"172.21.15.113:6823/34099","heartbeat_front_addr":"172.21.15.113:6818/34099","state":["exists","up"]},{"osd":5,"uuid":"1efc5591-180b-43af-8611-0068aadc5aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":34100},{"type":"v1","addr":"172.21.15.113:6801","nonce":34100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":34100},{"type":"v1","addr":"172.21.15.113:6803","nonce":34100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":34100},{"type":"v1","addr":"172.21.15.113:6807","nonce":34100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":34100},{"type":"v1","addr":"172.21.15.113:6805","nonce":34100}]},"public_addr":"172.21.15.113:6801/34100","cluster_addr":"172.21.15.113:6803/34100","heartbeat_back_addr":"172.21.15.113:6807/34100","heartbeat_front_addr":"172.21.15.113:6805/34100","state":["exists","up"]},{"osd":6,"uuid":"6c89d9d8-c153-4a48-afa9-97e4c403f1ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":34101},{"type":"v1","addr":"172.21.15.113:6810","nonce":34101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6812","nonce":34101},{"type":"v1","addr":"172.21.15.113:6814","nonce":34101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6822","nonce":34101},{"type":"v1","addr":"172.21.15.113:6824","nonce":34101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":34101},{"type":"v1","addr":"172.21.15.113:6819","nonce":34101}]},"public_addr":"172.21.15.113:6810/34101","cluster_addr":"172.21.15.113:6814/34101","heartbeat_back_addr":"172.21.15.113:6824/34101","heartbeat_front_addr":"172.21.15.113:6819/34101","state":["exists","up"]},{"osd":7,"uuid":"1855e70c-23f6-4c08-ad7f-774c2148235b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6821","nonce":34102},{"type":"v1","addr":"172.21.15.113:6825","nonce":34102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":34102},{"type":"v1","addr":"172.21.15.113:6827","nonce":34102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":34102},{"type":"v1","addr":"172.21.15.113:6831","nonce":34102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6828","nonce":34102},{"type":"v1","addr":"172.21.15.113:6829","nonce":34102}]},"public_addr":"172.21.15.113:6825/34102","cluster_addr":"172.21.15.113:6827/34102","heartbeat_back_addr":"172.21.15.113:6831/34102","heartbeat_front_addr":"172.21.15.113:6829/34102","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.812672+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.825045+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.700105+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.856563+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.954683+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.883234+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.883994+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.821686+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T10:01:20.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.441+0000 7f09c359e700 1 -- 172.21.15.45:0/1913290350 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f09a405a510 msgr2=0x7f09a405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:20.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.441+0000 7f09c359e700 1 --2- 172.21.15.45:0/1913290350 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f09a405a510 0x7f09a405c9d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f09b400f470 tx=0x7f09b4018000).stop 2023-12-22T10:01:20.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.441+0000 7f09c359e700 1 -- 172.21.15.45:0/1913290350 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09c4065890 msgr2=0x7f09c414bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:20.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.441+0000 7f09c359e700 1 --2- 172.21.15.45:0/1913290350 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09c4065890 0x7f09c414bb80 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f09b800c420 tx=0x7f09b8007c50).stop 2023-12-22T10:01:20.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.441+0000 7f09c359e700 1 -- 172.21.15.45:0/1913290350 shutdown_connections 2023-12-22T10:01:20.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.441+0000 7f09c359e700 1 --2- 172.21.15.45:0/1913290350 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f09c414fd40 0x7f09c40bf950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:20.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.441+0000 7f09c359e700 1 --2- 172.21.15.45:0/1913290350 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09c4065890 0x7f09c414bb80 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:20.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.441+0000 7f09c359e700 1 --2- 172.21.15.45:0/1913290350 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f09a405a510 0x7f09a405c9d0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:20.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.441+0000 7f09c359e700 1 --2- 172.21.15.45:0/1913290350 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f09c40645b0 0x7f09c41486a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-12-22T10:01:20.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.441+0000 7f09c359e700 1 -- 172.21.15.45:0/1913290350 >> 172.21.15.45:0/1913290350 conn(0x7f09c4067540 msgr2=0x7f09c40bb490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:20.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.441+0000 7f09c359e700 1 -- 172.21.15.45:0/1913290350 shutdown_connections 2023-12-22T10:01:20.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.441+0000 7f09c359e700 1 -- 172.21.15.45:0/1913290350 wait complete. 2023-12-22T10:01:20.463 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-22T10:01:20.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.633+0000 7f5aff49b700 1 Processor -- start 2023-12-22T10:01:20.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.633+0000 7f5aff49b700 1 -- start start 2023-12-22T10:01:20.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.637+0000 7f5aff49b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5af8157e10 0x7f5af80c1820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:20.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.637+0000 7f5aff49b700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f5af80c3790 0x7f5af80c1d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:20.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.637+0000 7f5aff49b700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5af80a68b0 con 0x7f5af81581f0 2023-12-22T10:01:20.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.637+0000 7f5aff49b700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5af8065610 con 0x7f5af8157e10 2023-12-22T10:01:20.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.637+0000 7f5aff49b700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5af80658f0 con 0x7f5af80c3790 2023-12-22T10:01:20.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.637+0000 7f5afca36700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f5af81581f0 0x7f5af80c3080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51740/0 (socket says 172.21.15.45:51740) 2023-12-22T10:01:20.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.637+0000 7f5afd237700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5af8157e10 0x7f5af80c1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:20.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.637+0000 7f5afca36700 1 -- 172.21.15.45:0/209659137 learned_addr learned my addr 172.21.15.45:0/209659137 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:01:20.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.637+0000 7f5afda38700 1 --2- 172.21.15.45:0/209659137 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f5af80c3790 0x7f5af80c1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:20.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.637+0000 7f5afd237700 1 -- 172.21.15.45:0/209659137 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f5af80c3790 msgr2=0x7f5af80c1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:20.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.637+0000 7f5afd237700 1 --2- 172.21.15.45:0/209659137 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f5af80c3790 0x7f5af80c1d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:20.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.637+0000 7f5afd237700 1 -- 172.21.15.45:0/209659137 >> v1:172.21.15.45:6789/0 conn(0x7f5af81581f0 legacy=0x7f5af80c3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:20.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.637+0000 7f5afd237700 1 -- 172.21.15.45:0/209659137 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5af8065bd0 con 0x7f5af8157e10 2023-12-22T10:01:20.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.637+0000 7f5afd237700 1 --2- 172.21.15.45:0/209659137 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5af8157e10 0x7f5af80c1820 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7f5af4009e60 tx=0x7f5af4009780).ready entity=mon.0 client_cookie=5c3b2e8cf1ef845 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:20.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.637+0000 7f5aeffff700 1 -- 172.21.15.45:0/209659137 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af400e070 con 0x7f5af8157e10 2023-12-22T10:01:20.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.637+0000 7f5aeffff700 1 -- 172.21.15.45:0/209659137 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5af400bc30 con 0x7f5af8157e10 2023-12-22T10:01:20.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.637+0000 7f5aeffff700 1 -- 172.21.15.45:0/209659137 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af4012410 con 0x7f5af8157e10 2023-12-22T10:01:20.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.637+0000 7f5aff49b700 1 -- 172.21.15.45:0/209659137 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5af8157e10 msgr2=0x7f5af80c1820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:20.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.637+0000 7f5aff49b700 1 --2- 172.21.15.45:0/209659137 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5af8157e10 0x7f5af80c1820 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7f5af4009e60 tx=0x7f5af4009780).stop 2023-12-22T10:01:20.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.637+0000 7f5aff49b700 1 -- 172.21.15.45:0/209659137 shutdown_connections 2023-12-22T10:01:20.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.637+0000 7f5aff49b700 1 --2- 172.21.15.45:0/209659137 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f5af80c3790 0x7f5af80c1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:20.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.637+0000 7f5aff49b700 1 --2- 172.21.15.45:0/209659137 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5af8157e10 0x7f5af80c1820 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:20.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.637+0000 7f5aff49b700 1 -- 172.21.15.45:0/209659137 >> 172.21.15.45:0/209659137 conn(0x7f5af8066a70 msgr2=0x7f5af8066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:20.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.641+0000 7f5aff49b700 1 -- 172.21.15.45:0/209659137 shutdown_connections 2023-12-22T10:01:20.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.641+0000 7f5aff49b700 1 -- 172.21.15.45:0/209659137 wait complete. 2023-12-22T10:01:20.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.641+0000 7f5aff49b700 1 Processor -- start 2023-12-22T10:01:20.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.641+0000 7f5aff49b700 1 -- start start 2023-12-22T10:01:20.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.645+0000 7f5aff49b700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5af80c3790 0x7f5af80ac250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:20.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.645+0000 7f5aff49b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5af8157e10 0x7f5af80be8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:20.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.645+0000 7f5aff49b700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f5af81581f0 0x7f5af80bedd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:20.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.645+0000 7f5aff49b700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5af80c04f0 con 0x7f5af8157e10 2023-12-22T10:01:20.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.645+0000 7f5aff49b700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5af80bc320 con 0x7f5af80c3790 2023-12-22T10:01:20.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.645+0000 7f5aff49b700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5af80bf450 con 0x7f5af81581f0 2023-12-22T10:01:20.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.645+0000 7f5afca36700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5af8157e10 0x7f5af80be8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:20.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.645+0000 7f5afca36700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5af8157e10 0x7f5af80be8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44650/0 (socket says 172.21.15.45:44650) 2023-12-22T10:01:20.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.645+0000 7f5afca36700 1 -- 172.21.15.45:0/1048699705 learned_addr learned my addr 172.21.15.45:0/1048699705 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:20.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.645+0000 7f5afd237700 1 --2- 172.21.15.45:0/1048699705 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5af80c3790 0x7f5af80ac250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:20.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.645+0000 7f5afda38700 1 --2- 172.21.15.45:0/1048699705 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f5af81581f0 0x7f5af80bedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:20.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.645+0000 7f5afca36700 1 -- 172.21.15.45:0/1048699705 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f5af81581f0 msgr2=0x7f5af80bedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:20.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.645+0000 7f5afca36700 1 --2- 172.21.15.45:0/1048699705 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f5af81581f0 0x7f5af80bedd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:20.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.645+0000 7f5afca36700 1 -- 172.21.15.45:0/1048699705 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5af80c3790 msgr2=0x7f5af80ac250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:20.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.645+0000 7f5afca36700 1 --2- 172.21.15.45:0/1048699705 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5af80c3790 0x7f5af80ac250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:20.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.645+0000 7f5afca36700 1 -- 172.21.15.45:0/1048699705 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5af4009a20 con 0x7f5af8157e10 2023-12-22T10:01:20.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.645+0000 7f5afca36700 1 --2- 172.21.15.45:0/1048699705 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5af8157e10 0x7f5af80be8e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7f5ae800c440 tx=0x7f5ae8007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:20.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.645+0000 7f5aed7fa700 1 -- 172.21.15.45:0/1048699705 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae80070d0 con 0x7f5af8157e10 2023-12-22T10:01:20.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.645+0000 7f5aed7fa700 1 -- 172.21.15.45:0/1048699705 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ae8007230 con 0x7f5af8157e10 2023-12-22T10:01:20.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.645+0000 7f5aff49b700 1 -- 172.21.15.45:0/1048699705 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5af80bf730 con 0x7f5af8157e10 2023-12-22T10:01:20.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.645+0000 7f5aed7fa700 1 -- 172.21.15.45:0/1048699705 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae80075d0 con 0x7f5af8157e10 2023-12-22T10:01:20.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.645+0000 7f5aff49b700 1 -- 172.21.15.45:0/1048699705 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5af80bfcf0 con 0x7f5af8157e10 2023-12-22T10:01:20.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.649+0000 7f5aff49b700 1 -- 172.21.15.45:0/1048699705 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5af806c070 con 0x7f5af8157e10 2023-12-22T10:01:20.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.649+0000 7f5aed7fa700 1 -- 172.21.15.45:0/1048699705 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f5ae80059b0 con 0x7f5af8157e10 2023-12-22T10:01:20.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.649+0000 7f5aed7fa700 1 --2- 172.21.15.45:0/1048699705 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f5adc05a510 0x7f5adc05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:20.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.649+0000 7f5aed7fa700 1 -- 172.21.15.45:0/1048699705 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f5ae8073d30 con 0x7f5af8157e10 2023-12-22T10:01:20.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.653+0000 7f5afd237700 1 --2- 172.21.15.45:0/1048699705 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f5adc05a510 0x7f5adc05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:20.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.653+0000 7f5afd237700 1 --2- 172.21.15.45:0/1048699705 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f5adc05a510 0x7f5adc05c9d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f5af4009e60 tx=0x7f5af4009780).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:20.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.657+0000 7f5aed7fa700 1 -- 172.21.15.45:0/1048699705 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f5ae8047450 con 0x7f5af8157e10 2023-12-22T10:01:20.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:20.861+0000 7f5aff49b700 1 -- 172.21.15.45:0/1048699705 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f5af815e4f0 con 0x7f5af8157e10 2023-12-22T10:01:21.807 INFO:tasks.ceph.mon.a.smithi045.stderr:2023-12-22T10:01:21.809+0000 7fd344a42700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-22T10:01:21.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:21.817+0000 7f5aed7fa700 1 -- 172.21.15.45:0/1048699705 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7f5ae804aa70 con 0x7f5af8157e10 2023-12-22T10:01:21.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:21.821+0000 7f5aff49b700 1 -- 172.21.15.45:0/1048699705 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f5adc05a510 msgr2=0x7f5adc05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:21.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:21.821+0000 7f5aff49b700 1 --2- 172.21.15.45:0/1048699705 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f5adc05a510 0x7f5adc05c9d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f5af4009e60 tx=0x7f5af4009780).stop 2023-12-22T10:01:21.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:21.821+0000 7f5aff49b700 1 -- 172.21.15.45:0/1048699705 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5af8157e10 msgr2=0x7f5af80be8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:21.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:21.821+0000 7f5aff49b700 1 --2- 172.21.15.45:0/1048699705 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5af8157e10 0x7f5af80be8e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7f5ae800c440 tx=0x7f5ae8007de0).stop 2023-12-22T10:01:21.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:21.825+0000 7f5aff49b700 1 -- 172.21.15.45:0/1048699705 shutdown_connections 2023-12-22T10:01:21.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:21.825+0000 7f5aff49b700 1 --2- 172.21.15.45:0/1048699705 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f5adc05a510 0x7f5adc05c9d0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:21.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:21.825+0000 7f5aff49b700 1 --2- 172.21.15.45:0/1048699705 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f5af81581f0 0x7f5af80bedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:21.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:21.825+0000 7f5aff49b700 1 --2- 172.21.15.45:0/1048699705 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5af8157e10 0x7f5af80be8e0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:21.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:21.825+0000 7f5aff49b700 1 --2- 172.21.15.45:0/1048699705 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5af80c3790 0x7f5af80ac250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:21.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:21.825+0000 7f5aff49b700 1 -- 172.21.15.45:0/1048699705 >> 172.21.15.45:0/1048699705 conn(0x7f5af8066a70 msgr2=0x7f5af8066e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:21.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:21.825+0000 7f5aff49b700 1 -- 172.21.15.45:0/1048699705 shutdown_connections 2023-12-22T10:01:21.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:21.825+0000 7f5aff49b700 1 -- 172.21.15.45:0/1048699705 wait complete. 2023-12-22T10:01:21.823 INFO:teuthology.orchestra.run.smithi045.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-22T10:01:21.825 INFO:tasks.ceph.mds.a.smithi045.stderr: -2646> 2023-12-22T10:00:39.194+0000 7f373d49e700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-22T10:01:21.849 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-22T10:01:21.883 INFO:tasks.ceph.mds.a.smithi045.stdout:starting mds.a at 2023-12-22T10:01:22.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:22.013+0000 7fa6dbf46700 1 Processor -- start 2023-12-22T10:01:22.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:22.013+0000 7fa6dbf46700 1 -- start start 2023-12-22T10:01:22.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:22.013+0000 7fa6dbf46700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa6d40c1d80 0x7fa6d4158120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:22.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:22.013+0000 7fa6dbf46700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fa6d4065930 0x7fa6d40a5810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:22.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:22.013+0000 7fa6dbf46700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6d4069180 con 0x7fa6d4157d40 2023-12-22T10:01:22.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:22.013+0000 7fa6dbf46700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6d4069e00 con 0x7fa6d40c1d80 2023-12-22T10:01:22.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:22.013+0000 7fa6dbf46700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6d4069460 con 0x7fa6d4065930 2023-12-22T10:01:22.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:22.013+0000 7fa6d94e1700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa6d40c1d80 0x7fa6d4158120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:22.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:22.013+0000 7fa6d9ce2700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fa6d4157d40 0x7fa6d40c1670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51748/0 (socket says 172.21.15.45:51748) 2023-12-22T10:01:22.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:22.013+0000 7fa6d9ce2700 1 -- 172.21.15.45:0/601692959 learned_addr learned my addr 172.21.15.45:0/601692959 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:01:22.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:22.013+0000 7fa6da4e3700 1 --2- 172.21.15.45:0/601692959 >> v2:172.21.15.113:3300/0 conn(0x7fa6d4065930 0x7fa6d40a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:22.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:22.013+0000 7fa6d8ce0700 1 -- 172.21.15.45:0/601692959 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2656374226 0 0) 0x7fa6d4069180 con 0x7fa6d4157d40 2023-12-22T10:01:22.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:22.017+0000 7fa6d8ce0700 1 -- 172.21.15.45:0/601692959 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6c00033f0 con 0x7fa6d4157d40 2023-12-22T10:01:22.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:22.017+0000 7fa6d94e1700 1 -- 172.21.15.45:0/601692959 >> v2:172.21.15.113:3300/0 conn(0x7fa6d4065930 msgr2=0x7fa6d40a5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:22.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:22.017+0000 7fa6d94e1700 1 --2- 172.21.15.45:0/601692959 >> v2:172.21.15.113:3300/0 conn(0x7fa6d4065930 0x7fa6d40a5810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:22.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:22.017+0000 7fa6d8ce0700 1 -- 172.21.15.45:0/601692959 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 668652788 0 0) 0x7fa6c00033f0 con 0x7fa6d4157d40 2023-12-22T10:01:22.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:22.017+0000 7fa6d94e1700 1 -- 172.21.15.45:0/601692959 >> v1:172.21.15.45:6789/0 conn(0x7fa6d4157d40 legacy=0x7fa6d40c1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:22.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:22.017+0000 7fa6d94e1700 1 -- 172.21.15.45:0/601692959 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6d4069740 con 0x7fa6d40c1d80 2023-12-22T10:01:22.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:22.017+0000 7fa6d94e1700 1 --2- 172.21.15.45:0/601692959 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa6d40c1d80 0x7fa6d4158120 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7fa6d40a6500 tx=0x7fa6c4009060).ready entity=mon.0 client_cookie=75a3ffa26d39cd63 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:22.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:22.017+0000 7fa6d8ce0700 1 -- 172.21.15.45:0/601692959 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d0001470 con 0x7fa6d40c1d80 2023-12-22T10:01:22.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:22.017+0000 7fa6d8ce0700 1 -- 172.21.15.45:0/601692959 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6c40090d0 con 0x7fa6d40c1d80 2023-12-22T10:01:22.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:22.017+0000 7fa6d8ce0700 1 -- 172.21.15.45:0/601692959 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c4011610 con 0x7fa6d40c1d80 2023-12-22T10:01:22.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:22.017+0000 7fa6dbf46700 1 -- 172.21.15.45:0/601692959 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa6d40c1d80 msgr2=0x7fa6d4158120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:22.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:22.017+0000 7fa6dbf46700 1 --2- 172.21.15.45:0/601692959 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa6d40c1d80 0x7fa6d4158120 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7fa6d40a6500 tx=0x7fa6c4009060).stop 2023-12-22T10:01:22.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:22.017+0000 7fa6dbf46700 1 -- 172.21.15.45:0/601692959 shutdown_connections 2023-12-22T10:01:22.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:22.017+0000 7fa6dbf46700 1 --2- 172.21.15.45:0/601692959 >> v2:172.21.15.113:3300/0 conn(0x7fa6d4065930 0x7fa6d40a5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:22.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:22.017+0000 7fa6dbf46700 1 --2- 172.21.15.45:0/601692959 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa6d40c1d80 0x7fa6d4158120 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:22.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:22.017+0000 7fa6dbf46700 1 -- 172.21.15.45:0/601692959 >> 172.21.15.45:0/601692959 conn(0x7fa6d4066a70 msgr2=0x7fa6d4066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:22.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:22.017+0000 7fa6dbf46700 1 -- 172.21.15.45:0/601692959 shutdown_connections 2023-12-22T10:01:22.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:22.017+0000 7fa6dbf46700 1 -- 172.21.15.45:0/601692959 wait complete. 2023-12-22T10:01:22.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:22.021+0000 7fa6dbf46700 1 Processor -- start 2023-12-22T10:01:22.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:22.021+0000 7fa6dbf46700 1 -- start start 2023-12-22T10:01:22.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:22.025+0000 7fa6dbf46700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fa6d4065930 0x7fa6d4158780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:22.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:22.025+0000 7fa6dbf46700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa6d40c1d80 0x7fa6d415d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:22.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:22.025+0000 7fa6dbf46700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa6d4157d40 0x7fa6d415d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:22.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:22.025+0000 7fa6dbf46700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d415da40 con 0x7fa6d4157d40 2023-12-22T10:01:22.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:22.025+0000 7fa6dbf46700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d40aa320 con 0x7fa6d40c1d80 2023-12-22T10:01:22.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:22.025+0000 7fa6dbf46700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d40aaea0 con 0x7fa6d4065930 2023-12-22T10:01:22.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:22.025+0000 7fa6da4e3700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa6d4157d40 0x7fa6d415d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:22.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:22.025+0000 7fa6da4e3700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa6d4157d40 0x7fa6d415d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44680/0 (socket says 172.21.15.45:44680) 2023-12-22T10:01:22.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:22.025+0000 7fa6da4e3700 1 -- 172.21.15.45:0/3369838666 learned_addr learned my addr 172.21.15.45:0/3369838666 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:22.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:22.025+0000 7fa6d94e1700 1 --2- 172.21.15.45:0/3369838666 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa6d40c1d80 0x7fa6d415d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:22.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:22.025+0000 7fa6d9ce2700 1 --2- 172.21.15.45:0/3369838666 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fa6d4065930 0x7fa6d4158780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:22.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:22.025+0000 7fa6da4e3700 1 -- 172.21.15.45:0/3369838666 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fa6d4065930 msgr2=0x7fa6d4158780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:22.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:22.025+0000 7fa6da4e3700 1 --2- 172.21.15.45:0/3369838666 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fa6d4065930 0x7fa6d4158780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:22.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:22.025+0000 7fa6da4e3700 1 -- 172.21.15.45:0/3369838666 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa6d40c1d80 msgr2=0x7fa6d415d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:22.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:22.025+0000 7fa6da4e3700 1 --2- 172.21.15.45:0/3369838666 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa6d40c1d80 0x7fa6d415d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:22.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:22.025+0000 7fa6da4e3700 1 -- 172.21.15.45:0/3369838666 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6c40092a0 con 0x7fa6d4157d40 2023-12-22T10:01:22.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:22.025+0000 7fa6da4e3700 1 --2- 172.21.15.45:0/3369838666 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa6d4157d40 0x7fa6d415d550 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7fa6cc009ef0 tx=0x7fa6cc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:22.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:22.025+0000 7fa6c9ffb700 1 -- 172.21.15.45:0/3369838666 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6cc00cc50 con 0x7fa6d4157d40 2023-12-22T10:01:22.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:22.025+0000 7fa6c9ffb700 1 -- 172.21.15.45:0/3369838666 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6cc00f040 con 0x7fa6d4157d40 2023-12-22T10:01:22.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:22.025+0000 7fa6c9ffb700 1 -- 172.21.15.45:0/3369838666 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6cc013400 con 0x7fa6d4157d40 2023-12-22T10:01:22.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:22.025+0000 7fa6dbf46700 1 -- 172.21.15.45:0/3369838666 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6d40aa570 con 0x7fa6d4157d40 2023-12-22T10:01:22.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:22.025+0000 7fa6dbf46700 1 -- 172.21.15.45:0/3369838666 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6d40aabb0 con 0x7fa6d4157d40 2023-12-22T10:01:22.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:22.025+0000 7fa6dbf46700 1 -- 172.21.15.45:0/3369838666 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6d40ab010 con 0x7fa6d4157d40 2023-12-22T10:01:22.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:22.029+0000 7fa6c9ffb700 1 -- 172.21.15.45:0/3369838666 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fa6cc013770 con 0x7fa6d4157d40 2023-12-22T10:01:22.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:22.029+0000 7fa6c9ffb700 1 --2- 172.21.15.45:0/3369838666 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fa6b805a510 0x7fa6b805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:22.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:22.029+0000 7fa6c9ffb700 1 -- 172.21.15.45:0/3369838666 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6236+0+0 (secure 0 0 0) 0x7fa6cc075250 con 0x7fa6d4157d40 2023-12-22T10:01:22.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:22.029+0000 7fa6d9ce2700 1 --2- 172.21.15.45:0/3369838666 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fa6b805a510 0x7fa6b805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:22.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:22.033+0000 7fa6d9ce2700 1 --2- 172.21.15.45:0/3369838666 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fa6b805a510 0x7fa6b805c9d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7fa6d00011e0 tx=0x7fa6d0001490).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:22.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:22.037+0000 7fa6c9ffb700 1 -- 172.21.15.45:0/3369838666 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fa6cc048900 con 0x7fa6d4157d40 2023-12-22T10:01:22.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:22.233+0000 7fa6dbf46700 1 -- 172.21.15.45:0/3369838666 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fa6d4069a20 con 0x7fa6d4157d40 2023-12-22T10:01:22.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:22.877+0000 7fa6c9ffb700 1 -- 172.21.15.45:0/3369838666 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7fa6cc04bf20 con 0x7fa6d4157d40 2023-12-22T10:01:22.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:22.881+0000 7fa6dbf46700 1 -- 172.21.15.45:0/3369838666 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fa6b805a510 msgr2=0x7fa6b805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:22.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:22.881+0000 7fa6dbf46700 1 --2- 172.21.15.45:0/3369838666 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fa6b805a510 0x7fa6b805c9d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7fa6d00011e0 tx=0x7fa6d0001490).stop 2023-12-22T10:01:22.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:22.881+0000 7fa6dbf46700 1 -- 172.21.15.45:0/3369838666 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa6d4157d40 msgr2=0x7fa6d415d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:22.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:22.881+0000 7fa6dbf46700 1 --2- 172.21.15.45:0/3369838666 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa6d4157d40 0x7fa6d415d550 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7fa6cc009ef0 tx=0x7fa6cc00b040).stop 2023-12-22T10:01:22.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:22.881+0000 7fa6dbf46700 1 -- 172.21.15.45:0/3369838666 shutdown_connections 2023-12-22T10:01:22.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:22.881+0000 7fa6dbf46700 1 --2- 172.21.15.45:0/3369838666 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa6d4157d40 0x7fa6d415d550 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:22.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:22.881+0000 7fa6dbf46700 1 --2- 172.21.15.45:0/3369838666 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa6d40c1d80 0x7fa6d415d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:22.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:22.881+0000 7fa6dbf46700 1 --2- 172.21.15.45:0/3369838666 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fa6b805a510 0x7fa6b805c9d0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:22.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:22.881+0000 7fa6dbf46700 1 --2- 172.21.15.45:0/3369838666 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fa6d4065930 0x7fa6d4158780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:22.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:22.881+0000 7fa6dbf46700 1 -- 172.21.15.45:0/3369838666 >> 172.21.15.45:0/3369838666 conn(0x7fa6d4066a70 msgr2=0x7fa6d40a7ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:22.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:22.885+0000 7fa6dbf46700 1 -- 172.21.15.45:0/3369838666 shutdown_connections 2023-12-22T10:01:22.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:22.885+0000 7fa6dbf46700 1 -- 172.21.15.45:0/3369838666 wait complete. 2023-12-22T10:01:22.905 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-22T10:01:23.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:23.121+0000 7f0ea3fff700 1 Processor -- start 2023-12-22T10:01:23.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:23.121+0000 7f0ea3fff700 1 -- start start 2023-12-22T10:01:23.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:23.125+0000 7f0ea3fff700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f0ea4153b30 0x7f0ea4158020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:23.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:23.125+0000 7f0ea3fff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ea40657b0 con 0x7f0ea40c4340 2023-12-22T10:01:23.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:23.125+0000 7f0ea3fff700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ea40c53e0 con 0x7f0ea4064d30 2023-12-22T10:01:23.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:23.125+0000 7f0ea3fff700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea406a860 con 0x7f0ea4153b30 2023-12-22T10:01:23.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:23.125+0000 7f0e9a7fc700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f0ea40c4340 0x7f0ea4064620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51764/0 (socket says 172.21.15.45:51764) 2023-12-22T10:01:23.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:23.125+0000 7f0e9a7fc700 1 -- 172.21.15.45:0/1838987596 learned_addr learned my addr 172.21.15.45:0/1838987596 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:01:23.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:23.125+0000 7f0ea2ffd700 1 --2- 172.21.15.45:0/1838987596 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f0ea4153b30 0x7f0ea4158020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:23.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:23.125+0000 7f0ea2ffd700 1 -- 172.21.15.45:0/1838987596 >> v1:172.21.15.113:6789/0 conn(0x7f0ea4064d30 legacy=0x7f0ea40c13e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:23.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:23.125+0000 7f0ea2ffd700 1 -- 172.21.15.45:0/1838987596 >> v1:172.21.15.45:6789/0 conn(0x7f0ea40c4340 legacy=0x7f0ea4064620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:23.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:23.125+0000 7f0ea27fc700 1 -- 172.21.15.45:0/1838987596 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4064259202 0 0) 0x7f0ea40657b0 con 0x7f0ea40c4340 2023-12-22T10:01:23.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:23.125+0000 7f0ea2ffd700 1 -- 172.21.15.45:0/1838987596 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ea4154f20 con 0x7f0ea4153b30 2023-12-22T10:01:23.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:23.125+0000 7f0ea2ffd700 1 --2- 172.21.15.45:0/1838987596 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f0ea4153b30 0x7f0ea4158020 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f0e94009710 tx=0x7f0e94009060).ready entity=mon.2 client_cookie=22a41bb17d9c7ca4 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:23.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:23.125+0000 7f0ea27fc700 1 -- 172.21.15.45:0/1838987596 <== mon.2 v2:172.21.15.113:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e9400f510 con 0x7f0ea4153b30 2023-12-22T10:01:23.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:23.125+0000 7f0ea27fc700 1 -- 172.21.15.45:0/1838987596 <== mon.2 v2:172.21.15.113:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e9400f670 con 0x7f0ea4153b30 2023-12-22T10:01:23.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:23.125+0000 7f0ea27fc700 1 -- 172.21.15.45:0/1838987596 <== mon.2 v2:172.21.15.113:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e9400f9f0 con 0x7f0ea4153b30 2023-12-22T10:01:23.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:23.129+0000 7f0ea3fff700 1 -- 172.21.15.45:0/1838987596 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f0ea4153b30 msgr2=0x7f0ea4158020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:23.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:23.129+0000 7f0ea3fff700 1 --2- 172.21.15.45:0/1838987596 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f0ea4153b30 0x7f0ea4158020 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f0e94009710 tx=0x7f0e94009060).stop 2023-12-22T10:01:23.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:23.129+0000 7f0ea3fff700 1 -- 172.21.15.45:0/1838987596 shutdown_connections 2023-12-22T10:01:23.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:23.129+0000 7f0ea3fff700 1 --2- 172.21.15.45:0/1838987596 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f0ea4153b30 0x7f0ea4158020 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:23.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:23.129+0000 7f0ea3fff700 1 -- 172.21.15.45:0/1838987596 >> 172.21.15.45:0/1838987596 conn(0x7f0ea4067500 msgr2=0x7f0ea40c6440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:23.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:23.129+0000 7f0ea3fff700 1 -- 172.21.15.45:0/1838987596 shutdown_connections 2023-12-22T10:01:23.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:23.129+0000 7f0ea3fff700 1 -- 172.21.15.45:0/1838987596 wait complete. 2023-12-22T10:01:23.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:23.133+0000 7f0ea3fff700 1 Processor -- start 2023-12-22T10:01:23.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:23.133+0000 7f0ea3fff700 1 -- start start 2023-12-22T10:01:23.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:23.133+0000 7f0ea3fff700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f0ea4064d30 0x7f0ea40bfaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:23.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:23.133+0000 7f0ea3fff700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0ea4153b30 0x7f0ea40a3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:23.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:23.133+0000 7f0ea3fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ea413e910 0x7f0ea413df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:23.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:23.133+0000 7f0ea3fff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea40a53b0 con 0x7f0ea413e910 2023-12-22T10:01:23.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:23.133+0000 7f0ea3fff700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea40a47a0 con 0x7f0ea4153b30 2023-12-22T10:01:23.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:23.133+0000 7f0ea3fff700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea40a4a80 con 0x7f0ea4064d30 2023-12-22T10:01:23.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:23.133+0000 7f0ea37fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ea413e910 0x7f0ea413df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:23.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:23.133+0000 7f0ea37fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ea413e910 0x7f0ea413df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44686/0 (socket says 172.21.15.45:44686) 2023-12-22T10:01:23.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:23.133+0000 7f0ea37fe700 1 -- 172.21.15.45:0/3648601225 learned_addr learned my addr 172.21.15.45:0/3648601225 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:23.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:23.133+0000 7f0ea2ffd700 1 --2- 172.21.15.45:0/3648601225 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f0ea4064d30 0x7f0ea40bfaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:23.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:23.133+0000 7f0e9a7fc700 1 --2- 172.21.15.45:0/3648601225 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0ea4153b30 0x7f0ea40a3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:23.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:23.133+0000 7f0ea37fe700 1 -- 172.21.15.45:0/3648601225 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f0ea4064d30 msgr2=0x7f0ea40bfaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:23.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:23.133+0000 7f0ea37fe700 1 --2- 172.21.15.45:0/3648601225 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f0ea4064d30 0x7f0ea40bfaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:23.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:23.133+0000 7f0ea37fe700 1 -- 172.21.15.45:0/3648601225 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0ea4153b30 msgr2=0x7f0ea40a3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:23.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:23.133+0000 7f0ea37fe700 1 --2- 172.21.15.45:0/3648601225 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0ea4153b30 0x7f0ea40a3f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:23.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:23.133+0000 7f0ea37fe700 1 -- 172.21.15.45:0/3648601225 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e940092a0 con 0x7f0ea413e910 2023-12-22T10:01:23.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:23.133+0000 7f0ea2ffd700 1 --2- 172.21.15.45:0/3648601225 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f0ea4064d30 0x7f0ea40bfaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T10:01:23.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:23.133+0000 7f0ea37fe700 1 --2- 172.21.15.45:0/3648601225 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ea413e910 0x7f0ea413df20 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7f0e9c00c860 tx=0x7f0e9c001640).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:23.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:23.137+0000 7f0e9b7fe700 1 -- 172.21.15.45:0/3648601225 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e9c00a600 con 0x7f0ea413e910 2023-12-22T10:01:23.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:23.137+0000 7f0e9b7fe700 1 -- 172.21.15.45:0/3648601225 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e9c00a760 con 0x7f0ea413e910 2023-12-22T10:01:23.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:23.137+0000 7f0ea3fff700 1 -- 172.21.15.45:0/3648601225 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ea40a4d60 con 0x7f0ea413e910 2023-12-22T10:01:23.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:23.137+0000 7f0e9b7fe700 1 -- 172.21.15.45:0/3648601225 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e9c00ab20 con 0x7f0ea413e910 2023-12-22T10:01:23.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:23.137+0000 7f0ea3fff700 1 -- 172.21.15.45:0/3648601225 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ea40a4440 con 0x7f0ea413e910 2023-12-22T10:01:23.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:23.137+0000 7f0ea3fff700 1 -- 172.21.15.45:0/3648601225 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ea4047060 con 0x7f0ea413e910 2023-12-22T10:01:23.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:23.137+0000 7f0e9b7fe700 1 -- 172.21.15.45:0/3648601225 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f0e9c01b400 con 0x7f0ea413e910 2023-12-22T10:01:23.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:23.141+0000 7f0e9b7fe700 1 --2- 172.21.15.45:0/3648601225 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f0e8405a510 0x7f0e8405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:23.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:23.141+0000 7f0e9b7fe700 1 -- 172.21.15.45:0/3648601225 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6236+0+0 (secure 0 0 0) 0x7f0e9c074910 con 0x7f0ea413e910 2023-12-22T10:01:23.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:23.141+0000 7f0ea2ffd700 1 --2- 172.21.15.45:0/3648601225 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f0e8405a510 0x7f0e8405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:23.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:23.141+0000 7f0ea2ffd700 1 --2- 172.21.15.45:0/3648601225 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f0e8405a510 0x7f0e8405c9d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f0e94006d30 tx=0x7f0e94015000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:23.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:23.149+0000 7f0e9b7fe700 1 -- 172.21.15.45:0/3648601225 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f0e9c047f60 con 0x7f0ea413e910 2023-12-22T10:01:23.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:23.313+0000 7f0ea3fff700 1 -- 172.21.15.45:0/3648601225 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0ea40c47d0 con 0x7f0ea413e910 2023-12-22T10:01:24.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:24.164+0000 7f0e9b7fe700 1 -- 172.21.15.45:0/3648601225 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v25) v1 ==== 181+0+0 (secure 0 0 0) 0x7f0e9c04b580 con 0x7f0ea413e910 2023-12-22T10:01:24.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:24.168+0000 7f0ea3fff700 1 -- 172.21.15.45:0/3648601225 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f0e8405a510 msgr2=0x7f0e8405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:24.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:24.168+0000 7f0ea3fff700 1 --2- 172.21.15.45:0/3648601225 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f0e8405a510 0x7f0e8405c9d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f0e94006d30 tx=0x7f0e94015000).stop 2023-12-22T10:01:24.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:24.168+0000 7f0ea3fff700 1 -- 172.21.15.45:0/3648601225 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ea413e910 msgr2=0x7f0ea413df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:24.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:24.168+0000 7f0ea3fff700 1 --2- 172.21.15.45:0/3648601225 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ea413e910 0x7f0ea413df20 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7f0e9c00c860 tx=0x7f0e9c001640).stop 2023-12-22T10:01:24.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:24.168+0000 7f0ea3fff700 1 -- 172.21.15.45:0/3648601225 shutdown_connections 2023-12-22T10:01:24.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:24.168+0000 7f0ea3fff700 1 --2- 172.21.15.45:0/3648601225 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ea413e910 0x7f0ea413df20 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:24.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:24.168+0000 7f0ea3fff700 1 --2- 172.21.15.45:0/3648601225 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0ea4153b30 0x7f0ea40a3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:24.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:24.168+0000 7f0ea3fff700 1 --2- 172.21.15.45:0/3648601225 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f0e8405a510 0x7f0e8405c9d0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:24.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:24.168+0000 7f0ea3fff700 1 --2- 172.21.15.45:0/3648601225 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f0ea4064d30 0x7f0ea40bfaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:24.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:24.168+0000 7f0ea3fff700 1 -- 172.21.15.45:0/3648601225 >> 172.21.15.45:0/3648601225 conn(0x7f0ea4067500 msgr2=0x7f0ea40c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:24.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:24.168+0000 7f0ea3fff700 1 -- 172.21.15.45:0/3648601225 shutdown_connections 2023-12-22T10:01:24.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:24.168+0000 7f0ea3fff700 1 -- 172.21.15.45:0/3648601225 wait complete. 2023-12-22T10:01:24.171 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_metadata' removed 2023-12-22T10:01:24.190 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-22T10:01:24.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:24.368+0000 7f1e07146700 1 Processor -- start 2023-12-22T10:01:24.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:24.372+0000 7f1e07146700 1 -- start start 2023-12-22T10:01:24.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:24.372+0000 7f1e07146700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1e000c5220 0x7f1e000c5600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:24.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:24.372+0000 7f1e07146700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1e00067f00 0x7f1e00156c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:24.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:24.372+0000 7f1e07146700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e00066e60 con 0x7f1e00157180 2023-12-22T10:01:24.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:24.372+0000 7f1e07146700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e00067140 con 0x7f1e000c5220 2023-12-22T10:01:24.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:24.372+0000 7f1e07146700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e00067420 con 0x7f1e00067f00 2023-12-22T10:01:24.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:24.372+0000 7f1e056e3700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f1e00157180 0x7f1e000c2870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51768/0 (socket says 172.21.15.45:51768) 2023-12-22T10:01:24.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:24.372+0000 7f1e056e3700 1 -- 172.21.15.45:0/490322308 learned_addr learned my addr 172.21.15.45:0/490322308 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:01:24.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:24.372+0000 7f1dfffff700 1 --2- 172.21.15.45:0/490322308 >> v2:172.21.15.113:3300/0 conn(0x7f1e00067f00 0x7f1e00156c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:24.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:24.372+0000 7f1e04ee2700 1 --2- 172.21.15.45:0/490322308 >> v2:172.21.15.45:3300/0 conn(0x7f1e000c5220 0x7f1e000c5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:24.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:24.376+0000 7f1dff7fe700 1 -- 172.21.15.45:0/490322308 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 708268198 0 0) 0x7f1e00066e60 con 0x7f1e00157180 2023-12-22T10:01:24.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:24.376+0000 7f1dff7fe700 1 -- 172.21.15.45:0/490322308 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1df00033f0 con 0x7f1e00157180 2023-12-22T10:01:24.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:24.376+0000 7f1dff7fe700 1 -- 172.21.15.45:0/490322308 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1407359569 0 0) 0x7f1df00033f0 con 0x7f1e00157180 2023-12-22T10:01:24.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:24.376+0000 7f1dfffff700 1 -- 172.21.15.45:0/490322308 >> v2:172.21.15.45:3300/0 conn(0x7f1e000c5220 msgr2=0x7f1e000c5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:24.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:24.376+0000 7f1dfffff700 1 --2- 172.21.15.45:0/490322308 >> v2:172.21.15.45:3300/0 conn(0x7f1e000c5220 0x7f1e000c5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:24.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:24.376+0000 7f1dfffff700 1 -- 172.21.15.45:0/490322308 >> v1:172.21.15.45:6789/0 conn(0x7f1e00157180 legacy=0x7f1e000c2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:24.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:24.376+0000 7f1dfffff700 1 -- 172.21.15.45:0/490322308 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e00067700 con 0x7f1e00067f00 2023-12-22T10:01:24.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:24.376+0000 7f1e04ee2700 1 --2- 172.21.15.45:0/490322308 >> v2:172.21.15.45:3300/0 conn(0x7f1e000c5220 0x7f1e000c5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-12-22T10:01:24.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:24.376+0000 7f1dfffff700 1 --2- 172.21.15.45:0/490322308 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1e00067f00 0x7f1e00156c90 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f1e00064a60 tx=0x7f1dec009060).ready entity=mon.1 client_cookie=504aa45be7afef8d server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:24.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:24.376+0000 7f1dff7fe700 1 -- 172.21.15.45:0/490322308 <== mon.1 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df80017f0 con 0x7f1e00067f00 2023-12-22T10:01:24.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:24.376+0000 7f1dff7fe700 1 -- 172.21.15.45:0/490322308 <== mon.1 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dec011400 con 0x7f1e00067f00 2023-12-22T10:01:24.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:24.376+0000 7f1dff7fe700 1 -- 172.21.15.45:0/490322308 <== mon.1 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dec011780 con 0x7f1e00067f00 2023-12-22T10:01:24.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:24.376+0000 7f1e07146700 1 -- 172.21.15.45:0/490322308 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1e00067f00 msgr2=0x7f1e00156c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:24.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:24.376+0000 7f1e07146700 1 --2- 172.21.15.45:0/490322308 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1e00067f00 0x7f1e00156c90 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f1e00064a60 tx=0x7f1dec009060).stop 2023-12-22T10:01:24.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:24.376+0000 7f1e07146700 1 -- 172.21.15.45:0/490322308 shutdown_connections 2023-12-22T10:01:24.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:24.376+0000 7f1e07146700 1 --2- 172.21.15.45:0/490322308 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1e00067f00 0x7f1e00156c90 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:24.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:24.376+0000 7f1e07146700 1 --2- 172.21.15.45:0/490322308 >> v2:172.21.15.45:3300/0 conn(0x7f1e000c5220 0x7f1e000c5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:24.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:24.376+0000 7f1e07146700 1 -- 172.21.15.45:0/490322308 >> 172.21.15.45:0/490322308 conn(0x7f1e000c3a80 msgr2=0x7f1e000c3e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:24.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:24.376+0000 7f1e07146700 1 -- 172.21.15.45:0/490322308 shutdown_connections 2023-12-22T10:01:24.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:24.376+0000 7f1e07146700 1 -- 172.21.15.45:0/490322308 wait complete. 2023-12-22T10:01:24.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:24.380+0000 7f1e07146700 1 Processor -- start 2023-12-22T10:01:24.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:24.380+0000 7f1e07146700 1 -- start start 2023-12-22T10:01:24.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:24.384+0000 7f1e07146700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1e00067f00 0x7f1e001681a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:24.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:24.384+0000 7f1e07146700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1e000c5220 0x7f1e00152e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:24.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:24.384+0000 7f1e07146700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1e00157180 0x7f1e000a9f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:24.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:24.384+0000 7f1e07146700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e000ab3f0 con 0x7f1e000c5220 2023-12-22T10:01:24.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:24.384+0000 7f1e07146700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e000aa7e0 con 0x7f1e00157180 2023-12-22T10:01:24.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:24.384+0000 7f1e07146700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e000aaac0 con 0x7f1e00067f00 2023-12-22T10:01:24.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:24.384+0000 7f1dfffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1e000c5220 0x7f1e00152e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:24.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:24.384+0000 7f1dfffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1e000c5220 0x7f1e00152e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44698/0 (socket says 172.21.15.45:44698) 2023-12-22T10:01:24.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:24.384+0000 7f1dfffff700 1 -- 172.21.15.45:0/3635438840 learned_addr learned my addr 172.21.15.45:0/3635438840 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:24.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:24.384+0000 7f1e056e3700 1 --2- 172.21.15.45:0/3635438840 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1e00157180 0x7f1e000a9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:24.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:24.384+0000 7f1e04ee2700 1 --2- 172.21.15.45:0/3635438840 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1e00067f00 0x7f1e001681a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:24.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:24.384+0000 7f1dfffff700 1 -- 172.21.15.45:0/3635438840 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1e00067f00 msgr2=0x7f1e001681a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:24.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:24.384+0000 7f1dfffff700 1 --2- 172.21.15.45:0/3635438840 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1e00067f00 0x7f1e001681a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:24.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:24.384+0000 7f1dfffff700 1 -- 172.21.15.45:0/3635438840 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1e00157180 msgr2=0x7f1e000a9f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:24.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:24.384+0000 7f1dfffff700 1 --2- 172.21.15.45:0/3635438840 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1e00157180 0x7f1e000a9f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:24.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:24.384+0000 7f1dfffff700 1 -- 172.21.15.45:0/3635438840 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1df4009240 con 0x7f1e000c5220 2023-12-22T10:01:24.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:24.384+0000 7f1dfffff700 1 --2- 172.21.15.45:0/3635438840 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1e000c5220 0x7f1e00152e20 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7f1dec006d30 tx=0x7f1dec016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:24.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:24.384+0000 7f1dfcff9700 1 -- 172.21.15.45:0/3635438840 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dec010840 con 0x7f1e000c5220 2023-12-22T10:01:24.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:24.384+0000 7f1dfcff9700 1 -- 172.21.15.45:0/3635438840 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dec0109a0 con 0x7f1e000c5220 2023-12-22T10:01:24.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:24.384+0000 7f1dfcff9700 1 -- 172.21.15.45:0/3635438840 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dec010d40 con 0x7f1e000c5220 2023-12-22T10:01:24.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:24.384+0000 7f1e07146700 1 -- 172.21.15.45:0/3635438840 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dec0092a0 con 0x7f1e000c5220 2023-12-22T10:01:24.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:24.384+0000 7f1e07146700 1 -- 172.21.15.45:0/3635438840 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e000ab080 con 0x7f1e000c5220 2023-12-22T10:01:24.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:24.388+0000 7f1e07146700 1 -- 172.21.15.45:0/3635438840 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e000ab5a0 con 0x7f1e000c5220 2023-12-22T10:01:24.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:24.388+0000 7f1dfcff9700 1 -- 172.21.15.45:0/3635438840 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f1dec0263b0 con 0x7f1e000c5220 2023-12-22T10:01:24.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:24.388+0000 7f1dfcff9700 1 --2- 172.21.15.45:0/3635438840 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f1de405a4e0 0x7f1de405c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:24.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:24.388+0000 7f1dfcff9700 1 -- 172.21.15.45:0/3635438840 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5769+0+0 (secure 0 0 0) 0x7f1dec0752d0 con 0x7f1e000c5220 2023-12-22T10:01:24.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:24.388+0000 7f1e04ee2700 1 --2- 172.21.15.45:0/3635438840 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f1de405a4e0 0x7f1de405c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:24.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:24.392+0000 7f1e04ee2700 1 --2- 172.21.15.45:0/3635438840 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f1de405a4e0 0x7f1de405c9a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f1e00169360 tx=0x7f1df4009060).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:24.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:24.396+0000 7f1dfcff9700 1 -- 172.21.15.45:0/3635438840 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f1e000ab5a0 con 0x7f1e000c5220 2023-12-22T10:01:24.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:24.556+0000 7f1e07146700 1 -- 172.21.15.45:0/3635438840 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1e000ab530 con 0x7f1e000c5220 2023-12-22T10:01:25.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:25.172+0000 7f1dfcff9700 1 -- 172.21.15.45:0/3635438840 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v26) v1 ==== 169+0+0 (secure 0 0 0) 0x7f1dec022070 con 0x7f1e000c5220 2023-12-22T10:01:25.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:25.176+0000 7f1e07146700 1 -- 172.21.15.45:0/3635438840 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f1de405a4e0 msgr2=0x7f1de405c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:25.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:25.176+0000 7f1e07146700 1 --2- 172.21.15.45:0/3635438840 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f1de405a4e0 0x7f1de405c9a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f1e00169360 tx=0x7f1df4009060).stop 2023-12-22T10:01:25.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:25.176+0000 7f1e07146700 1 -- 172.21.15.45:0/3635438840 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1e000c5220 msgr2=0x7f1e00152e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:25.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:25.176+0000 7f1e07146700 1 --2- 172.21.15.45:0/3635438840 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1e000c5220 0x7f1e00152e20 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7f1dec006d30 tx=0x7f1dec016000).stop 2023-12-22T10:01:25.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:25.176+0000 7f1e07146700 1 -- 172.21.15.45:0/3635438840 shutdown_connections 2023-12-22T10:01:25.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:25.176+0000 7f1e07146700 1 --2- 172.21.15.45:0/3635438840 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1e00157180 0x7f1e000a9f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:25.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:25.176+0000 7f1e07146700 1 --2- 172.21.15.45:0/3635438840 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1e000c5220 0x7f1e00152e20 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:25.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:25.176+0000 7f1e07146700 1 --2- 172.21.15.45:0/3635438840 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f1de405a4e0 0x7f1de405c9a0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:25.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:25.176+0000 7f1e07146700 1 --2- 172.21.15.45:0/3635438840 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1e00067f00 0x7f1e001681a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:25.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:25.176+0000 7f1e07146700 1 -- 172.21.15.45:0/3635438840 >> 172.21.15.45:0/3635438840 conn(0x7f1e000c3a80 msgr2=0x7f1e00154e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:25.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:25.176+0000 7f1e07146700 1 -- 172.21.15.45:0/3635438840 shutdown_connections 2023-12-22T10:01:25.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:25.176+0000 7f1e07146700 1 -- 172.21.15.45:0/3635438840 wait complete. 2023-12-22T10:01:25.178 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data' removed 2023-12-22T10:01:25.197 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-22T10:01:25.197 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-22T10:01:25.198 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-22T10:01:25.198 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T10:01:25.198 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-22T10:01:25.198 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-22T10:01:25.198 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-22T10:01:25.199 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T10:01:25.199 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-22T10:01:25.199 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-22T10:01:25.199 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-22T10:01:25.199 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T10:01:25.199 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-22T10:01:25.199 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-22T10:01:25.200 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-22T10:01:25.200 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T10:01:25.219 INFO:tasks.ceph.mds.d:Stopped 2023-12-22T10:01:25.219 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-22T10:01:25.221 INFO:tasks.ceph.mds.b:Stopped 2023-12-22T10:01:25.221 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-22T10:01:25.223 INFO:tasks.ceph.mds.c:Stopped 2023-12-22T10:01:25.223 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-22T10:01:25.225 INFO:tasks.ceph.mds.a:Stopped 2023-12-22T10:01:25.225 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-22T10:01:25.270 INFO:tasks.ceph.mds.d:Started 2023-12-22T10:01:25.270 DEBUG:teuthology.parallel:result is None 2023-12-22T10:01:25.276 INFO:tasks.ceph.mds.b:Started 2023-12-22T10:01:25.276 DEBUG:teuthology.parallel:result is None 2023-12-22T10:01:25.279 INFO:tasks.ceph.mds.c:Started 2023-12-22T10:01:25.279 DEBUG:teuthology.parallel:result is None 2023-12-22T10:01:25.286 INFO:tasks.ceph.mds.a:Started 2023-12-22T10:01:25.286 DEBUG:teuthology.parallel:result is None 2023-12-22T10:01:25.287 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph o s d ' ' b l o c k l i s t ' ' c l e a r 2023-12-22T10:01:25.376 INFO:tasks.ceph.mds.d.smithi113.stdout:starting mds.d at 2023-12-22T10:01:25.384 INFO:tasks.ceph.mds.b.smithi113.stdout:starting mds.b at 2023-12-22T10:01:25.386 INFO:tasks.ceph.mds.c.smithi045.stdout:starting mds.c at 2023-12-22T10:01:25.409 INFO:tasks.ceph.mds.a.smithi045.stdout:starting mds.a at 2023-12-22T10:01:25.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:25.468+0000 7fe8deb07700 1 Processor -- start 2023-12-22T10:01:25.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:25.468+0000 7fe8deb07700 1 -- start start 2023-12-22T10:01:25.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:25.472+0000 7fe8deb07700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe8d80c1330 0x7fe8d8068c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:25.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:25.472+0000 7fe8deb07700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fe8d8069120 0x7fe8d80aa6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:25.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:25.472+0000 7fe8deb07700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8d80c0ea0 con 0x7fe8d80a9dc0 2023-12-22T10:01:25.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:25.472+0000 7fe8deb07700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8d8153f30 con 0x7fe8d80c1330 2023-12-22T10:01:25.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:25.472+0000 7fe8deb07700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8d80c1790 con 0x7fe8d8069120 2023-12-22T10:01:25.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:25.472+0000 7fe8dd304700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe8d80c1330 0x7fe8d8068c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:25.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:25.472+0000 7fe8dd304700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe8d80c1330 0x7fe8d8068c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44724/0 (socket says 172.21.15.45:44724) 2023-12-22T10:01:25.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:25.472+0000 7fe8dd304700 1 -- 172.21.15.45:0/4243845596 learned_addr learned my addr 172.21.15.45:0/4243845596 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:25.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:25.472+0000 7fe8ddb05700 1 --1- 172.21.15.45:0/4243845596 >> v1:172.21.15.45:6789/0 conn(0x7fe8d80a9dc0 0x7fe8d80c5890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51808/0 (socket says 172.21.15.45:51808) 2023-12-22T10:01:25.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:25.472+0000 7fe8de306700 1 --2- 172.21.15.45:0/4243845596 >> v2:172.21.15.113:3300/0 conn(0x7fe8d8069120 0x7fe8d80aa6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:25.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:25.472+0000 7fe8dd304700 1 -- 172.21.15.45:0/4243845596 >> v2:172.21.15.113:3300/0 conn(0x7fe8d8069120 msgr2=0x7fe8d80aa6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:25.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:25.472+0000 7fe8dd304700 1 --2- 172.21.15.45:0/4243845596 >> v2:172.21.15.113:3300/0 conn(0x7fe8d8069120 0x7fe8d80aa6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:25.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:25.472+0000 7fe8dd304700 1 -- 172.21.15.45:0/4243845596 >> v1:172.21.15.45:6789/0 conn(0x7fe8d80a9dc0 legacy=0x7fe8d80c5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:25.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:25.472+0000 7fe8dd304700 1 -- 172.21.15.45:0/4243845596 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d80aa1a0 con 0x7fe8d80c1330 2023-12-22T10:01:25.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:25.472+0000 7fe8dcb03700 1 -- 172.21.15.45:0/4243845596 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 85313671 0 0) 0x7fe8d80c0ea0 con 0x7fe8d80a9dc0 2023-12-22T10:01:25.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:25.472+0000 7fe8dd304700 1 --2- 172.21.15.45:0/4243845596 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8d80c1330 0x7fe8d8068c30 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7fe8d80ca820 tx=0x7fe8c80090f0).ready entity=mon.0 client_cookie=b2db740d7fd5390e server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:25.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:25.476+0000 7fe8dcb03700 1 -- 172.21.15.45:0/4243845596 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c800b520 con 0x7fe8d80c1330 2023-12-22T10:01:25.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:25.476+0000 7fe8dcb03700 1 -- 172.21.15.45:0/4243845596 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8c800b680 con 0x7fe8d80c1330 2023-12-22T10:01:25.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:25.476+0000 7fe8dcb03700 1 -- 172.21.15.45:0/4243845596 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c800ba00 con 0x7fe8d80c1330 2023-12-22T10:01:25.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:25.476+0000 7fe8deb07700 1 -- 172.21.15.45:0/4243845596 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8d80c1330 msgr2=0x7fe8d8068c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:25.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:25.476+0000 7fe8deb07700 1 --2- 172.21.15.45:0/4243845596 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8d80c1330 0x7fe8d8068c30 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7fe8d80ca820 tx=0x7fe8c80090f0).stop 2023-12-22T10:01:25.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:25.476+0000 7fe8deb07700 1 -- 172.21.15.45:0/4243845596 shutdown_connections 2023-12-22T10:01:25.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:25.476+0000 7fe8deb07700 1 --2- 172.21.15.45:0/4243845596 >> v2:172.21.15.113:3300/0 conn(0x7fe8d8069120 0x7fe8d80aa6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:25.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:25.476+0000 7fe8deb07700 1 --2- 172.21.15.45:0/4243845596 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8d80c1330 0x7fe8d8068c30 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:25.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:25.476+0000 7fe8deb07700 1 -- 172.21.15.45:0/4243845596 >> 172.21.15.45:0/4243845596 conn(0x7fe8d8067500 msgr2=0x7fe8d80ca880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:25.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:25.476+0000 7fe8deb07700 1 -- 172.21.15.45:0/4243845596 shutdown_connections 2023-12-22T10:01:25.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:25.476+0000 7fe8deb07700 1 -- 172.21.15.45:0/4243845596 wait complete. 2023-12-22T10:01:25.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:25.480+0000 7fe8deb07700 1 Processor -- start 2023-12-22T10:01:25.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:25.480+0000 7fe8deb07700 1 -- start start 2023-12-22T10:01:25.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:25.480+0000 7fe8deb07700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8d8069120 0x7fe8d80adc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:25.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:25.480+0000 7fe8deb07700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fe8d80a9dc0 0x7fe8d80ae0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:25.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:25.480+0000 7fe8deb07700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe8d80c1330 0x7fe8d8155040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:25.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:25.480+0000 7fe8deb07700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d80af380 con 0x7fe8d8069120 2023-12-22T10:01:25.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:25.480+0000 7fe8deb07700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d80b0780 con 0x7fe8d80c1330 2023-12-22T10:01:25.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:25.480+0000 7fe8deb07700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d80ae770 con 0x7fe8d80a9dc0 2023-12-22T10:01:25.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:25.480+0000 7fe8ddb05700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8d8069120 0x7fe8d80adc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:25.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:25.480+0000 7fe8ddb05700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8d8069120 0x7fe8d80adc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44728/0 (socket says 172.21.15.45:44728) 2023-12-22T10:01:25.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:25.480+0000 7fe8ddb05700 1 -- 172.21.15.45:0/1559029020 learned_addr learned my addr 172.21.15.45:0/1559029020 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:25.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:25.480+0000 7fe8dd304700 1 --2- 172.21.15.45:0/1559029020 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fe8d80a9dc0 0x7fe8d80ae0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:25.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:25.480+0000 7fe8ddb05700 1 -- 172.21.15.45:0/1559029020 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fe8d80a9dc0 msgr2=0x7fe8d80ae0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:25.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:25.480+0000 7fe8ddb05700 1 --2- 172.21.15.45:0/1559029020 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fe8d80a9dc0 0x7fe8d80ae0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:25.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:25.480+0000 7fe8ddb05700 1 -- 172.21.15.45:0/1559029020 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe8d80c1330 msgr2=0x7fe8d8155040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:25.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:25.480+0000 7fe8ddb05700 1 --2- 172.21.15.45:0/1559029020 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe8d80c1330 0x7fe8d8155040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-12-22T10:01:25.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:25.480+0000 7fe8ddb05700 1 -- 172.21.15.45:0/1559029020 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8c8009370 con 0x7fe8d8069120 2023-12-22T10:01:25.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:25.480+0000 7fe8ddb05700 1 --2- 172.21.15.45:0/1559029020 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8d8069120 0x7fe8d80adc00 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7fe8d400c560 tx=0x7fe8d4007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:25.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:25.484+0000 7fe8cdffb700 1 -- 172.21.15.45:0/1559029020 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d40072e0 con 0x7fe8d8069120 2023-12-22T10:01:25.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:25.484+0000 7fe8cdffb700 1 -- 172.21.15.45:0/1559029020 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8d4007440 con 0x7fe8d8069120 2023-12-22T10:01:25.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:25.484+0000 7fe8cdffb700 1 -- 172.21.15.45:0/1559029020 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d40058f0 con 0x7fe8d8069120 2023-12-22T10:01:25.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:25.484+0000 7fe8deb07700 1 -- 172.21.15.45:0/1559029020 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8d80aea50 con 0x7fe8d8069120 2023-12-22T10:01:25.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:25.484+0000 7fe8deb07700 1 -- 172.21.15.45:0/1559029020 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8d80af010 con 0x7fe8d8069120 2023-12-22T10:01:25.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:25.488+0000 7fe8cdffb700 1 -- 172.21.15.45:0/1559029020 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fe8d4005ce0 con 0x7fe8d8069120 2023-12-22T10:01:25.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:25.488+0000 7fe8cdffb700 1 --2- 172.21.15.45:0/1559029020 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fe8bc05a560 0x7fe8bc05ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:25.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:25.488+0000 7fe8cdffb700 1 -- 172.21.15.45:0/1559029020 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5355+0+0 (secure 0 0 0) 0x7fe8d4073e00 con 0x7fe8d8069120 2023-12-22T10:01:25.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:25.492+0000 7fe8deb07700 1 -- 172.21.15.45:0/1559029020 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8d8047060 con 0x7fe8d8069120 2023-12-22T10:01:25.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:25.492+0000 7fe8dd304700 1 --2- 172.21.15.45:0/1559029020 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fe8bc05a560 0x7fe8bc05ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:25.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:25.492+0000 7fe8dd304700 1 --2- 172.21.15.45:0/1559029020 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fe8bc05a560 0x7fe8bc05ca20 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7fe8c8009130 tx=0x7fe8c8017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:25.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:25.500+0000 7fe8cdffb700 1 -- 172.21.15.45:0/1559029020 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fe8d4018070 con 0x7fe8d8069120 2023-12-22T10:01:25.842 INFO:teuthology.orchestra.run.smithi045.stderr:no valid command found; 10 closest matches: 2023-12-22T10:01:25.842 INFO:teuthology.orchestra.run.smithi045.stderr:pg stat 2023-12-22T10:01:25.842 INFO:teuthology.orchestra.run.smithi045.stderr:pg getmap 2023-12-22T10:01:25.842 INFO:teuthology.orchestra.run.smithi045.stderr:pg dump [all|summary|sum|delta|pools|osds|pgs|pgs_brief...] 2023-12-22T10:01:25.842 INFO:teuthology.orchestra.run.smithi045.stderr:pg dump_json [all|summary|sum|pools|osds|pgs...] 2023-12-22T10:01:25.842 INFO:teuthology.orchestra.run.smithi045.stderr:pg dump_pools_json 2023-12-22T10:01:25.842 INFO:teuthology.orchestra.run.smithi045.stderr:pg ls-by-pool [...] 2023-12-22T10:01:25.843 INFO:teuthology.orchestra.run.smithi045.stderr:pg ls-by-primary [] [...] 2023-12-22T10:01:25.843 INFO:teuthology.orchestra.run.smithi045.stderr:pg ls-by-osd [] [...] 2023-12-22T10:01:25.843 INFO:teuthology.orchestra.run.smithi045.stderr:pg ls [] [...] 2023-12-22T10:01:25.843 INFO:teuthology.orchestra.run.smithi045.stderr:pg dump_stuck [inactive|unclean|stale|undersized|degraded...] [] 2023-12-22T10:01:25.843 INFO:teuthology.orchestra.run.smithi045.stderr:Error EINVAL: invalid command 2023-12-22T10:01:25.855 DEBUG:teuthology.orchestra.run:got remote process result: 22 2023-12-22T10:01:25.856 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-22T10:01:26.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.020+0000 7f515341b700 1 Processor -- start 2023-12-22T10:01:26.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.020+0000 7f515341b700 1 -- start start 2023-12-22T10:01:26.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.024+0000 7f515341b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f514c157e10 0x7f514c0c1820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:26.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.024+0000 7f515341b700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f514c0a68b0 con 0x7f514c0c3790 2023-12-22T10:01:26.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.024+0000 7f515341b700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f514c065610 con 0x7f514c1581f0 2023-12-22T10:01:26.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.024+0000 7f515341b700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f514c0658f0 con 0x7f514c157e10 2023-12-22T10:01:26.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.024+0000 7f51511b7700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f514c157e10 0x7f514c0c1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:26.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.024+0000 7f51511b7700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f514c157e10 0x7f514c0c1820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44732/0 (socket says 172.21.15.45:44732) 2023-12-22T10:01:26.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.024+0000 7f51511b7700 1 -- 172.21.15.45:0/888968377 learned_addr learned my addr 172.21.15.45:0/888968377 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:26.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.024+0000 7f51511b7700 1 -- 172.21.15.45:0/888968377 >> v1:172.21.15.113:6789/0 conn(0x7f514c1581f0 legacy=0x7f514c0c3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:26.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.024+0000 7f51511b7700 1 -- 172.21.15.45:0/888968377 >> v1:172.21.15.45:6789/0 conn(0x7f514c0c3790 legacy=0x7f514c0a7070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:26.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.024+0000 7f51511b7700 1 -- 172.21.15.45:0/888968377 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f514c065bd0 con 0x7f514c157e10 2023-12-22T10:01:26.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.024+0000 7f51511b7700 1 --2- 172.21.15.45:0/888968377 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f514c157e10 0x7f514c0c1820 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7f5148006fd0 tx=0x7f51480090f0).ready entity=mon.0 client_cookie=9346ba9043ec41e2 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:26.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.024+0000 7f5143fff700 1 -- 172.21.15.45:0/888968377 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f514800b600 con 0x7f514c157e10 2023-12-22T10:01:26.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.024+0000 7f5143fff700 1 -- 172.21.15.45:0/888968377 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f514800b760 con 0x7f514c157e10 2023-12-22T10:01:26.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.024+0000 7f5143fff700 1 -- 172.21.15.45:0/888968377 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f514800bae0 con 0x7f514c157e10 2023-12-22T10:01:26.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.028+0000 7f515341b700 1 -- 172.21.15.45:0/888968377 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f514c157e10 msgr2=0x7f514c0c1820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:26.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.028+0000 7f515341b700 1 --2- 172.21.15.45:0/888968377 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f514c157e10 0x7f514c0c1820 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7f5148006fd0 tx=0x7f51480090f0).stop 2023-12-22T10:01:26.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.028+0000 7f515341b700 1 -- 172.21.15.45:0/888968377 shutdown_connections 2023-12-22T10:01:26.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.028+0000 7f515341b700 1 --2- 172.21.15.45:0/888968377 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f514c157e10 0x7f514c0c1820 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:26.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.028+0000 7f515341b700 1 -- 172.21.15.45:0/888968377 >> 172.21.15.45:0/888968377 conn(0x7f514c066a70 msgr2=0x7f514c066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:26.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.028+0000 7f515341b700 1 -- 172.21.15.45:0/888968377 shutdown_connections 2023-12-22T10:01:26.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.028+0000 7f515341b700 1 -- 172.21.15.45:0/888968377 wait complete. 2023-12-22T10:01:26.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.028+0000 7f515341b700 1 Processor -- start 2023-12-22T10:01:26.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.032+0000 7f515341b700 1 -- start start 2023-12-22T10:01:26.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.032+0000 7f515341b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f514c0c3790 0x7f514c152b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:26.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.032+0000 7f515341b700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f514c157e10 0x7f514c1596d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:26.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.032+0000 7f515341b700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f514c1581f0 0x7f514c155f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:26.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.032+0000 7f515341b700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f514c0aab90 con 0x7f514c0c3790 2023-12-22T10:01:26.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.032+0000 7f515341b700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f514c0ab9d0 con 0x7f514c1581f0 2023-12-22T10:01:26.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.032+0000 7f515341b700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f514c0aadc0 con 0x7f514c157e10 2023-12-22T10:01:26.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.032+0000 7f51511b7700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f514c0c3790 0x7f514c152b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:26.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.032+0000 7f51511b7700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f514c0c3790 0x7f514c152b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44748/0 (socket says 172.21.15.45:44748) 2023-12-22T10:01:26.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.032+0000 7f51511b7700 1 -- 172.21.15.45:0/362227762 learned_addr learned my addr 172.21.15.45:0/362227762 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:26.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.032+0000 7f51509b6700 1 --2- 172.21.15.45:0/362227762 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f514c157e10 0x7f514c1596d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:26.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.032+0000 7f51511b7700 1 -- 172.21.15.45:0/362227762 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f514c157e10 msgr2=0x7f514c1596d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:26.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.032+0000 7f51511b7700 1 --2- 172.21.15.45:0/362227762 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f514c157e10 0x7f514c1596d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:26.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.032+0000 7f51511b7700 1 -- 172.21.15.45:0/362227762 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f514c1581f0 msgr2=0x7f514c155f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:26.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.032+0000 7f51519b8700 1 --2- 172.21.15.45:0/362227762 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f514c1581f0 0x7f514c155f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:26.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.032+0000 7f51511b7700 1 --2- 172.21.15.45:0/362227762 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f514c1581f0 0x7f514c155f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:26.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.032+0000 7f51511b7700 1 -- 172.21.15.45:0/362227762 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5148009370 con 0x7f514c0c3790 2023-12-22T10:01:26.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.032+0000 7f51509b6700 1 --2- 172.21.15.45:0/362227762 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f514c157e10 0x7f514c1596d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-12-22T10:01:26.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.032+0000 7f51519b8700 1 --2- 172.21.15.45:0/362227762 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f514c1581f0 0x7f514c155f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-12-22T10:01:26.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.032+0000 7f51511b7700 1 --2- 172.21.15.45:0/362227762 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f514c0c3790 0x7f514c152b60 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7f5148009f50 tx=0x7f5148017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:26.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.036+0000 7f51417fa700 1 -- 172.21.15.45:0/362227762 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f514800bae0 con 0x7f514c0c3790 2023-12-22T10:01:26.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.036+0000 7f51417fa700 1 -- 172.21.15.45:0/362227762 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5148000c90 con 0x7f514c0c3790 2023-12-22T10:01:26.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.036+0000 7f515341b700 1 -- 172.21.15.45:0/362227762 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f514c0ab0a0 con 0x7f514c0c3790 2023-12-22T10:01:26.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.036+0000 7f51417fa700 1 -- 172.21.15.45:0/362227762 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f514801a430 con 0x7f514c0c3790 2023-12-22T10:01:26.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.036+0000 7f515341b700 1 -- 172.21.15.45:0/362227762 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f514c0ab660 con 0x7f514c0c3790 2023-12-22T10:01:26.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.036+0000 7f515341b700 1 -- 172.21.15.45:0/362227762 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f514c06c070 con 0x7f514c0c3790 2023-12-22T10:01:26.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.036+0000 7f51417fa700 1 -- 172.21.15.45:0/362227762 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f5148021020 con 0x7f514c0c3790 2023-12-22T10:01:26.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.040+0000 7f51417fa700 1 --2- 172.21.15.45:0/362227762 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f513005a540 0x7f513005ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:26.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.040+0000 7f51417fa700 1 -- 172.21.15.45:0/362227762 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f5148075ce0 con 0x7f514c0c3790 2023-12-22T10:01:26.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.040+0000 7f51509b6700 1 --2- 172.21.15.45:0/362227762 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f513005a540 0x7f513005ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:26.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.040+0000 7f51509b6700 1 --2- 172.21.15.45:0/362227762 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f513005a540 0x7f513005ca00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f514c0acb10 tx=0x7f513c009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:26.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.048+0000 7f51417fa700 1 -- 172.21.15.45:0/362227762 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f5148049780 con 0x7f514c0c3790 2023-12-22T10:01:26.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.220+0000 7f515341b700 1 -- 172.21.15.45:0/362227762 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f514c0c22e0 con 0x7f514c0c3790 2023-12-22T10:01:26.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.220+0000 7f51417fa700 1 -- 172.21.15.45:0/362227762 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v30) v1 ==== 81+0+29555 (secure 0 0 0) 0x7f5148029030 con 0x7f514c0c3790 2023-12-22T10:01:26.221 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:01:26.221 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-22T10:01:26.221 INFO:teuthology.orchestra.run.smithi045.stdout: "epoch": 30, 2023-12-22T10:01:26.222 INFO:teuthology.orchestra.run.smithi045.stdout: "fsid": "98b0837e-5e68-4c8f-a1a0-e9424baaad8f", 2023-12-22T10:01:26.222 INFO:teuthology.orchestra.run.smithi045.stdout: "created": "2023-12-22T10:00:15.010174+0000", 2023-12-22T10:01:26.222 INFO:teuthology.orchestra.run.smithi045.stdout: "modified": "2023-12-22T10:01:25.426529+0000", 2023-12-22T10:01:26.222 INFO:teuthology.orchestra.run.smithi045.stdout: "last_up_change": "2023-12-22T10:00:24.980513+0000", 2023-12-22T10:01:26.222 INFO:teuthology.orchestra.run.smithi045.stdout: "last_in_change": "2023-12-22T10:00:17.887172+0000", 2023-12-22T10:01:26.222 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-22T10:01:26.223 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_num": 5799936, 2023-12-22T10:01:26.223 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_set": [ 2023-12-22T10:01:26.223 INFO:teuthology.orchestra.run.smithi045.stdout: "pglog_hardlimit", 2023-12-22T10:01:26.223 INFO:teuthology.orchestra.run.smithi045.stdout: "purged_snapdirs", 2023-12-22T10:01:26.223 INFO:teuthology.orchestra.run.smithi045.stdout: "recovery_deletes", 2023-12-22T10:01:26.223 INFO:teuthology.orchestra.run.smithi045.stdout: "sortbitwise" 2023-12-22T10:01:26.224 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-12-22T10:01:26.224 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_version": 4, 2023-12-22T10:01:26.224 INFO:teuthology.orchestra.run.smithi045.stdout: "full_ratio": 0.94999998807907104, 2023-12-22T10:01:26.224 INFO:teuthology.orchestra.run.smithi045.stdout: "backfillfull_ratio": 0.89999997615814209, 2023-12-22T10:01:26.224 INFO:teuthology.orchestra.run.smithi045.stdout: "nearfull_ratio": 0.85000002384185791, 2023-12-22T10:01:26.224 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_snapshot": "", 2023-12-22T10:01:26.225 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_max": 4, 2023-12-22T10:01:26.225 INFO:teuthology.orchestra.run.smithi045.stdout: "max_osd": 8, 2023-12-22T10:01:26.225 INFO:teuthology.orchestra.run.smithi045.stdout: "require_min_compat_client": "luminous", 2023-12-22T10:01:26.225 INFO:teuthology.orchestra.run.smithi045.stdout: "min_compat_client": "jewel", 2023-12-22T10:01:26.225 INFO:teuthology.orchestra.run.smithi045.stdout: "require_osd_release": "pacific", 2023-12-22T10:01:26.225 INFO:teuthology.orchestra.run.smithi045.stdout: "pools": [ 2023-12-22T10:01:26.226 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:26.226 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 1, 2023-12-22T10:01:26.226 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "device_health_metrics", 2023-12-22T10:01:26.226 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-12-22T10:00:25.069641+0000", 2023-12-22T10:01:26.226 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2023-12-22T10:01:26.226 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool", 2023-12-22T10:01:26.226 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-12-22T10:01:26.227 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-12-22T10:01:26.227 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-12-22T10:01:26.227 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-12-22T10:01:26.227 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-12-22T10:01:26.227 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-12-22T10:01:26.227 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-12-22T10:01:26.228 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-22T10:01:26.228 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-12-22T10:01:26.228 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-12-22T10:01:26.228 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 1, 2023-12-22T10:01:26.228 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 1, 2023-12-22T10:01:26.228 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 1, 2023-12-22T10:01:26.229 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 1, 2023-12-22T10:01:26.229 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 1, 2023-12-22T10:01:26.229 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-12-22T10:01:26.229 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-12-22T10:01:26.229 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-12-22T10:01:26.229 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-12-22T10:01:26.230 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-12-22T10:01:26.230 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-12-22T10:01:26.230 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-12-22T10:01:26.230 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:26.230 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "16", 2023-12-22T10:01:26.230 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-12-22T10:01:26.231 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-22T10:01:26.231 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-12-22T10:01:26.231 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-12-22T10:01:26.231 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-12-22T10:01:26.231 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-12-22T10:01:26.231 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-12-22T10:01:26.232 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-12-22T10:01:26.232 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-12-22T10:01:26.232 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-12-22T10:01:26.232 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-12-22T10:01:26.232 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-12-22T10:01:26.232 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-12-22T10:01:26.232 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-12-22T10:01:26.233 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-12-22T10:01:26.233 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-12-22T10:01:26.233 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-12-22T10:01:26.233 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-12-22T10:01:26.233 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-22T10:01:26.233 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-22T10:01:26.233 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-22T10:01:26.233 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-12-22T10:01:26.233 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-12-22T10:01:26.234 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-12-22T10:01:26.234 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-12-22T10:01:26.234 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-12-22T10:01:26.234 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:26.234 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-12-22T10:01:26.234 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-12-22T10:01:26.234 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-12-22T10:01:26.234 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-12-22T10:01:26.234 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-12-22T10:01:26.235 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-12-22T10:01:26.235 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-12-22T10:01:26.235 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-12-22T10:01:26.235 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-12-22T10:01:26.235 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-12-22T10:01:26.235 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-12-22T10:01:26.235 INFO:teuthology.orchestra.run.smithi045.stdout: "options": { 2023-12-22T10:01:26.235 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_max": 32, 2023-12-22T10:01:26.235 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_min": 1 2023-12-22T10:01:26.236 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:26.236 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-12-22T10:01:26.236 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr_devicehealth": {} 2023-12-22T10:01:26.236 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-22T10:01:26.236 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:26.237 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:26.237 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 2, 2023-12-22T10:01:26.237 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": "rbd", 2023-12-22T10:01:26.237 INFO:teuthology.orchestra.run.smithi045.stdout: "create_time": "2023-12-22T10:00:26.906399+0000", 2023-12-22T10:01:26.237 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2023-12-22T10:01:26.237 INFO:teuthology.orchestra.run.smithi045.stdout: "flags_names": "hashpspool", 2023-12-22T10:01:26.237 INFO:teuthology.orchestra.run.smithi045.stdout: "type": 1, 2023-12-22T10:01:26.238 INFO:teuthology.orchestra.run.smithi045.stdout: "size": 2, 2023-12-22T10:01:26.238 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": 1, 2023-12-22T10:01:26.238 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_rule": 0, 2023-12-22T10:01:26.238 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_count": 0, 2023-12-22T10:01:26.238 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_target": 0, 2023-12-22T10:01:26.238 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_barrier": 0, 2023-12-22T10:01:26.238 INFO:teuthology.orchestra.run.smithi045.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-22T10:01:26.238 INFO:teuthology.orchestra.run.smithi045.stdout: "object_hash": 2, 2023-12-22T10:01:26.238 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscale_mode": "off", 2023-12-22T10:01:26.238 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": 8, 2023-12-22T10:01:26.238 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num": 8, 2023-12-22T10:01:26.238 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_placement_num_target": 8, 2023-12-22T10:01:26.238 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_target": 8, 2023-12-22T10:01:26.238 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num_pending": 8, 2023-12-22T10:01:26.239 INFO:teuthology.orchestra.run.smithi045.stdout: "last_pg_merge_meta": { 2023-12-22T10:01:26.239 INFO:teuthology.orchestra.run.smithi045.stdout: "source_pgid": "0.0", 2023-12-22T10:01:26.239 INFO:teuthology.orchestra.run.smithi045.stdout: "ready_epoch": 0, 2023-12-22T10:01:26.239 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_started": 0, 2023-12-22T10:01:26.239 INFO:teuthology.orchestra.run.smithi045.stdout: "last_epoch_clean": 0, 2023-12-22T10:01:26.239 INFO:teuthology.orchestra.run.smithi045.stdout: "source_version": "0'0", 2023-12-22T10:01:26.239 INFO:teuthology.orchestra.run.smithi045.stdout: "target_version": "0'0" 2023-12-22T10:01:26.239 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:26.239 INFO:teuthology.orchestra.run.smithi045.stdout: "last_change": "17", 2023-12-22T10:01:26.239 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend": "0", 2023-12-22T10:01:26.239 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-22T10:01:26.239 INFO:teuthology.orchestra.run.smithi045.stdout: "last_force_op_resend_preluminous": "0", 2023-12-22T10:01:26.239 INFO:teuthology.orchestra.run.smithi045.stdout: "auid": 0, 2023-12-22T10:01:26.240 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_mode": "selfmanaged", 2023-12-22T10:01:26.240 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_seq": 0, 2023-12-22T10:01:26.240 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_epoch": 0, 2023-12-22T10:01:26.240 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_snaps": [], 2023-12-22T10:01:26.240 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps": "[]", 2023-12-22T10:01:26.240 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_bytes": 0, 2023-12-22T10:01:26.240 INFO:teuthology.orchestra.run.smithi045.stdout: "quota_max_objects": 0, 2023-12-22T10:01:26.240 INFO:teuthology.orchestra.run.smithi045.stdout: "tiers": [], 2023-12-22T10:01:26.240 INFO:teuthology.orchestra.run.smithi045.stdout: "tier_of": -1, 2023-12-22T10:01:26.241 INFO:teuthology.orchestra.run.smithi045.stdout: "read_tier": -1, 2023-12-22T10:01:26.241 INFO:teuthology.orchestra.run.smithi045.stdout: "write_tier": -1, 2023-12-22T10:01:26.241 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_mode": "none", 2023-12-22T10:01:26.241 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_bytes": 0, 2023-12-22T10:01:26.241 INFO:teuthology.orchestra.run.smithi045.stdout: "target_max_objects": 0, 2023-12-22T10:01:26.241 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-22T10:01:26.241 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-22T10:01:26.241 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-22T10:01:26.241 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_flush_age": 0, 2023-12-22T10:01:26.241 INFO:teuthology.orchestra.run.smithi045.stdout: "cache_min_evict_age": 0, 2023-12-22T10:01:26.241 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profile": "", 2023-12-22T10:01:26.241 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_params": { 2023-12-22T10:01:26.241 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "none" 2023-12-22T10:01:26.241 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:26.242 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_period": 0, 2023-12-22T10:01:26.242 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_count": 0, 2023-12-22T10:01:26.242 INFO:teuthology.orchestra.run.smithi045.stdout: "use_gmt_hitset": true, 2023-12-22T10:01:26.242 INFO:teuthology.orchestra.run.smithi045.stdout: "min_read_recency_for_promote": 0, 2023-12-22T10:01:26.242 INFO:teuthology.orchestra.run.smithi045.stdout: "min_write_recency_for_promote": 0, 2023-12-22T10:01:26.242 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_grade_decay_rate": 0, 2023-12-22T10:01:26.242 INFO:teuthology.orchestra.run.smithi045.stdout: "hit_set_search_last_n": 0, 2023-12-22T10:01:26.242 INFO:teuthology.orchestra.run.smithi045.stdout: "grade_table": [], 2023-12-22T10:01:26.242 INFO:teuthology.orchestra.run.smithi045.stdout: "stripe_width": 0, 2023-12-22T10:01:26.242 INFO:teuthology.orchestra.run.smithi045.stdout: "expected_num_objects": 0, 2023-12-22T10:01:26.242 INFO:teuthology.orchestra.run.smithi045.stdout: "fast_read": false, 2023-12-22T10:01:26.243 INFO:teuthology.orchestra.run.smithi045.stdout: "options": {}, 2023-12-22T10:01:26.243 INFO:teuthology.orchestra.run.smithi045.stdout: "application_metadata": { 2023-12-22T10:01:26.243 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd": {} 2023-12-22T10:01:26.243 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-22T10:01:26.243 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-22T10:01:26.243 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-12-22T10:01:26.243 INFO:teuthology.orchestra.run.smithi045.stdout: "osds": [ 2023-12-22T10:01:26.243 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:26.243 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 0, 2023-12-22T10:01:26.243 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "e19943a0-1c6b-47df-b6bb-383472077890", 2023-12-22T10:01:26.243 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-12-22T10:01:26.244 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-12-22T10:01:26.244 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-12-22T10:01:26.244 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-12-22T10:01:26.244 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-12-22T10:01:26.244 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-12-22T10:01:26.244 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-12-22T10:01:26.244 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 19, 2023-12-22T10:01:26.244 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-12-22T10:01:26.244 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-12-22T10:01:26.244 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-12-22T10:01:26.244 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-12-22T10:01:26.244 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:26.245 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-12-22T10:01:26.245 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6818", 2023-12-22T10:01:26.245 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 33777 2023-12-22T10:01:26.245 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:26.245 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:26.245 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-12-22T10:01:26.245 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6819", 2023-12-22T10:01:26.245 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 33777 2023-12-22T10:01:26.245 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-22T10:01:26.245 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-12-22T10:01:26.245 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:26.245 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-12-22T10:01:26.245 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-12-22T10:01:26.245 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:26.246 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-12-22T10:01:26.246 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6821", 2023-12-22T10:01:26.246 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 33777 2023-12-22T10:01:26.246 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:26.246 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:26.246 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-12-22T10:01:26.246 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6822", 2023-12-22T10:01:26.246 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 33777 2023-12-22T10:01:26.246 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-22T10:01:26.246 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-12-22T10:01:26.246 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:26.247 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-12-22T10:01:26.247 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-12-22T10:01:26.247 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:26.247 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-12-22T10:01:26.247 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6828", 2023-12-22T10:01:26.247 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 33777 2023-12-22T10:01:26.247 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:26.247 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:26.247 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-12-22T10:01:26.247 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6830", 2023-12-22T10:01:26.247 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 33777 2023-12-22T10:01:26.247 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-22T10:01:26.247 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-12-22T10:01:26.247 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:26.248 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-12-22T10:01:26.248 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-12-22T10:01:26.248 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:26.248 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-12-22T10:01:26.248 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6824", 2023-12-22T10:01:26.248 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 33777 2023-12-22T10:01:26.248 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:26.248 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:26.248 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-12-22T10:01:26.248 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6826", 2023-12-22T10:01:26.248 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 33777 2023-12-22T10:01:26.248 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-22T10:01:26.249 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-12-22T10:01:26.249 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:26.249 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6819/33777", 2023-12-22T10:01:26.249 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6822/33777", 2023-12-22T10:01:26.249 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6830/33777", 2023-12-22T10:01:26.249 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6826/33777", 2023-12-22T10:01:26.249 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-12-22T10:01:26.249 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-12-22T10:01:26.249 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-12-22T10:01:26.249 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-12-22T10:01:26.249 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:26.250 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:26.250 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 1, 2023-12-22T10:01:26.250 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "69670f34-f082-45a7-8f67-e962acc136e6", 2023-12-22T10:01:26.250 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-12-22T10:01:26.250 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-12-22T10:01:26.250 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-12-22T10:01:26.250 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-12-22T10:01:26.250 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-12-22T10:01:26.250 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-12-22T10:01:26.250 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-12-22T10:01:26.250 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 19, 2023-12-22T10:01:26.250 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-12-22T10:01:26.251 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-12-22T10:01:26.251 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-12-22T10:01:26.251 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-12-22T10:01:26.251 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:26.251 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-12-22T10:01:26.251 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6808", 2023-12-22T10:01:26.251 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 33775 2023-12-22T10:01:26.251 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:26.251 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:26.251 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-12-22T10:01:26.251 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6809", 2023-12-22T10:01:26.251 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 33775 2023-12-22T10:01:26.251 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-22T10:01:26.252 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-12-22T10:01:26.252 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:26.252 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-12-22T10:01:26.252 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-12-22T10:01:26.252 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:26.252 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-12-22T10:01:26.252 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6810", 2023-12-22T10:01:26.252 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 33775 2023-12-22T10:01:26.252 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:26.252 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:26.252 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-12-22T10:01:26.252 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6811", 2023-12-22T10:01:26.252 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 33775 2023-12-22T10:01:26.252 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-22T10:01:26.252 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-12-22T10:01:26.252 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:26.253 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-12-22T10:01:26.253 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-12-22T10:01:26.253 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:26.253 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-12-22T10:01:26.253 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6814", 2023-12-22T10:01:26.253 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 33775 2023-12-22T10:01:26.253 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:26.253 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:26.253 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-12-22T10:01:26.253 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6815", 2023-12-22T10:01:26.253 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 33775 2023-12-22T10:01:26.253 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-22T10:01:26.253 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-12-22T10:01:26.253 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:26.254 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-12-22T10:01:26.254 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-12-22T10:01:26.254 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:26.254 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-12-22T10:01:26.254 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6812", 2023-12-22T10:01:26.254 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 33775 2023-12-22T10:01:26.254 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:26.254 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:26.254 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-12-22T10:01:26.254 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6813", 2023-12-22T10:01:26.254 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 33775 2023-12-22T10:01:26.254 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-22T10:01:26.254 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-12-22T10:01:26.254 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:26.254 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6809/33775", 2023-12-22T10:01:26.255 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6811/33775", 2023-12-22T10:01:26.255 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6815/33775", 2023-12-22T10:01:26.255 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6813/33775", 2023-12-22T10:01:26.255 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-12-22T10:01:26.255 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-12-22T10:01:26.255 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-12-22T10:01:26.255 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-12-22T10:01:26.255 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:26.255 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:26.255 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 2, 2023-12-22T10:01:26.255 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "d909d49b-82b8-401b-9947-e49dd167bb95", 2023-12-22T10:01:26.255 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-12-22T10:01:26.255 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-12-22T10:01:26.255 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-12-22T10:01:26.256 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-12-22T10:01:26.256 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-12-22T10:01:26.256 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-12-22T10:01:26.256 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-12-22T10:01:26.256 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 19, 2023-12-22T10:01:26.256 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-12-22T10:01:26.256 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-12-22T10:01:26.256 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-12-22T10:01:26.256 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-12-22T10:01:26.256 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:26.257 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-12-22T10:01:26.257 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6800", 2023-12-22T10:01:26.257 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 33776 2023-12-22T10:01:26.257 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:26.257 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:26.257 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-12-22T10:01:26.257 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6801", 2023-12-22T10:01:26.257 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 33776 2023-12-22T10:01:26.257 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-22T10:01:26.257 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-12-22T10:01:26.257 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:26.258 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-12-22T10:01:26.258 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-12-22T10:01:26.258 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:26.258 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-12-22T10:01:26.258 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6802", 2023-12-22T10:01:26.258 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 33776 2023-12-22T10:01:26.258 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:26.258 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:26.258 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-12-22T10:01:26.258 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6803", 2023-12-22T10:01:26.258 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 33776 2023-12-22T10:01:26.258 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-22T10:01:26.258 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-12-22T10:01:26.258 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:26.259 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-12-22T10:01:26.259 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-12-22T10:01:26.259 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:26.259 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-12-22T10:01:26.259 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6806", 2023-12-22T10:01:26.259 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 33776 2023-12-22T10:01:26.259 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:26.259 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:26.259 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-12-22T10:01:26.259 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6807", 2023-12-22T10:01:26.259 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 33776 2023-12-22T10:01:26.259 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-22T10:01:26.259 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-12-22T10:01:26.260 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:26.260 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-12-22T10:01:26.260 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-12-22T10:01:26.260 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:26.260 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-12-22T10:01:26.260 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6804", 2023-12-22T10:01:26.260 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 33776 2023-12-22T10:01:26.260 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:26.260 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:26.260 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-12-22T10:01:26.260 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6805", 2023-12-22T10:01:26.260 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 33776 2023-12-22T10:01:26.260 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-22T10:01:26.260 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-12-22T10:01:26.261 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:26.261 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6801/33776", 2023-12-22T10:01:26.261 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6803/33776", 2023-12-22T10:01:26.261 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6807/33776", 2023-12-22T10:01:26.261 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6805/33776", 2023-12-22T10:01:26.261 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-12-22T10:01:26.261 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-12-22T10:01:26.261 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-12-22T10:01:26.261 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-12-22T10:01:26.261 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:26.262 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:26.262 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 3, 2023-12-22T10:01:26.262 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "db104ca9-3a94-4d39-a2be-bd06db888095", 2023-12-22T10:01:26.262 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-12-22T10:01:26.262 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-12-22T10:01:26.262 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-12-22T10:01:26.262 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-12-22T10:01:26.262 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-12-22T10:01:26.262 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-12-22T10:01:26.262 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-12-22T10:01:26.263 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 23, 2023-12-22T10:01:26.263 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-12-22T10:01:26.263 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-12-22T10:01:26.263 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-12-22T10:01:26.263 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-12-22T10:01:26.263 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:26.263 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-12-22T10:01:26.263 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6816", 2023-12-22T10:01:26.263 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 33782 2023-12-22T10:01:26.263 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:26.263 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:26.264 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-12-22T10:01:26.264 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6817", 2023-12-22T10:01:26.264 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 33782 2023-12-22T10:01:26.264 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-22T10:01:26.264 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-12-22T10:01:26.264 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:26.264 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-12-22T10:01:26.264 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-12-22T10:01:26.264 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:26.264 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-12-22T10:01:26.264 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6820", 2023-12-22T10:01:26.264 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 33782 2023-12-22T10:01:26.265 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:26.265 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:26.265 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-12-22T10:01:26.265 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6823", 2023-12-22T10:01:26.265 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 33782 2023-12-22T10:01:26.265 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-22T10:01:26.265 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-12-22T10:01:26.265 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:26.265 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-12-22T10:01:26.265 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-12-22T10:01:26.265 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:26.265 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-12-22T10:01:26.265 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6829", 2023-12-22T10:01:26.265 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 33782 2023-12-22T10:01:26.266 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:26.266 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:26.266 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-12-22T10:01:26.266 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6831", 2023-12-22T10:01:26.266 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 33782 2023-12-22T10:01:26.266 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-22T10:01:26.266 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-12-22T10:01:26.266 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:26.266 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-12-22T10:01:26.266 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-12-22T10:01:26.266 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:26.266 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-12-22T10:01:26.266 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6825", 2023-12-22T10:01:26.266 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 33782 2023-12-22T10:01:26.266 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:26.266 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:26.267 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-12-22T10:01:26.267 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6827", 2023-12-22T10:01:26.267 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 33782 2023-12-22T10:01:26.267 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-22T10:01:26.267 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-12-22T10:01:26.267 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:26.267 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.45:6817/33782", 2023-12-22T10:01:26.267 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.45:6823/33782", 2023-12-22T10:01:26.267 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.45:6831/33782", 2023-12-22T10:01:26.267 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.45:6827/33782", 2023-12-22T10:01:26.267 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-12-22T10:01:26.267 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-12-22T10:01:26.267 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-12-22T10:01:26.267 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-12-22T10:01:26.268 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:26.268 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:26.268 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 4, 2023-12-22T10:01:26.268 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "9f4eaff4-e433-4479-a0d1-ee7a33375ca6", 2023-12-22T10:01:26.268 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-12-22T10:01:26.268 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-12-22T10:01:26.268 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-12-22T10:01:26.268 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-12-22T10:01:26.268 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-12-22T10:01:26.268 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-12-22T10:01:26.268 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-12-22T10:01:26.268 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 19, 2023-12-22T10:01:26.268 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-12-22T10:01:26.268 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-12-22T10:01:26.268 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-12-22T10:01:26.269 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-12-22T10:01:26.269 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:26.269 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-12-22T10:01:26.269 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.113:6809", 2023-12-22T10:01:26.269 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 34099 2023-12-22T10:01:26.269 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:26.269 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:26.269 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-12-22T10:01:26.269 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.113:6811", 2023-12-22T10:01:26.269 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 34099 2023-12-22T10:01:26.269 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-22T10:01:26.269 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-12-22T10:01:26.269 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:26.270 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-12-22T10:01:26.270 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-12-22T10:01:26.270 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:26.270 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-12-22T10:01:26.270 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.113:6813", 2023-12-22T10:01:26.270 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 34099 2023-12-22T10:01:26.270 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:26.270 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:26.270 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-12-22T10:01:26.270 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.113:6815", 2023-12-22T10:01:26.270 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 34099 2023-12-22T10:01:26.270 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-22T10:01:26.270 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-12-22T10:01:26.271 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:26.271 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-12-22T10:01:26.271 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-12-22T10:01:26.271 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:26.271 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-12-22T10:01:26.271 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.113:6820", 2023-12-22T10:01:26.272 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 34099 2023-12-22T10:01:26.272 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:26.272 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:26.272 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-12-22T10:01:26.272 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.113:6823", 2023-12-22T10:01:26.272 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 34099 2023-12-22T10:01:26.272 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-22T10:01:26.272 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-12-22T10:01:26.272 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:26.273 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-12-22T10:01:26.273 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-12-22T10:01:26.273 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:26.273 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-12-22T10:01:26.273 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.113:6816", 2023-12-22T10:01:26.273 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 34099 2023-12-22T10:01:26.273 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:26.273 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:26.273 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-12-22T10:01:26.274 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.113:6818", 2023-12-22T10:01:26.274 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 34099 2023-12-22T10:01:26.274 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-22T10:01:26.274 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-12-22T10:01:26.274 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:26.274 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.113:6811/34099", 2023-12-22T10:01:26.274 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.113:6815/34099", 2023-12-22T10:01:26.275 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.113:6823/34099", 2023-12-22T10:01:26.275 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.113:6818/34099", 2023-12-22T10:01:26.275 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-12-22T10:01:26.275 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-12-22T10:01:26.275 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-12-22T10:01:26.275 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-12-22T10:01:26.275 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:26.276 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:26.276 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 5, 2023-12-22T10:01:26.276 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "1efc5591-180b-43af-8611-0068aadc5aa1", 2023-12-22T10:01:26.276 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-12-22T10:01:26.276 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-12-22T10:01:26.276 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-12-22T10:01:26.276 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-12-22T10:01:26.277 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-12-22T10:01:26.277 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-12-22T10:01:26.277 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-12-22T10:01:26.277 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 19, 2023-12-22T10:01:26.277 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-12-22T10:01:26.277 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-12-22T10:01:26.277 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-12-22T10:01:26.277 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-12-22T10:01:26.277 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:26.278 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-12-22T10:01:26.278 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.113:6800", 2023-12-22T10:01:26.278 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 34100 2023-12-22T10:01:26.278 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:26.278 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:26.278 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-12-22T10:01:26.279 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.113:6801", 2023-12-22T10:01:26.279 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 34100 2023-12-22T10:01:26.279 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-22T10:01:26.279 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-12-22T10:01:26.279 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:26.279 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-12-22T10:01:26.279 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-12-22T10:01:26.280 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:26.280 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-12-22T10:01:26.280 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.113:6802", 2023-12-22T10:01:26.280 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 34100 2023-12-22T10:01:26.280 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:26.280 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:26.280 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-12-22T10:01:26.281 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.113:6803", 2023-12-22T10:01:26.281 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 34100 2023-12-22T10:01:26.281 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-22T10:01:26.281 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-12-22T10:01:26.281 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:26.281 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-12-22T10:01:26.281 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-12-22T10:01:26.281 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:26.282 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-12-22T10:01:26.282 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.113:6806", 2023-12-22T10:01:26.282 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 34100 2023-12-22T10:01:26.282 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:26.282 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:26.282 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-12-22T10:01:26.282 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.113:6807", 2023-12-22T10:01:26.282 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 34100 2023-12-22T10:01:26.282 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-22T10:01:26.283 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-12-22T10:01:26.283 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:26.283 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-12-22T10:01:26.283 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-12-22T10:01:26.283 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:26.283 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-12-22T10:01:26.283 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.113:6804", 2023-12-22T10:01:26.283 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 34100 2023-12-22T10:01:26.284 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:26.284 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:26.284 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-12-22T10:01:26.284 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.113:6805", 2023-12-22T10:01:26.284 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 34100 2023-12-22T10:01:26.284 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-22T10:01:26.284 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-12-22T10:01:26.285 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:26.285 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.113:6801/34100", 2023-12-22T10:01:26.285 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.113:6803/34100", 2023-12-22T10:01:26.285 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.113:6807/34100", 2023-12-22T10:01:26.285 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.113:6805/34100", 2023-12-22T10:01:26.285 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-12-22T10:01:26.285 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-12-22T10:01:26.285 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-12-22T10:01:26.285 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-12-22T10:01:26.285 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:26.285 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:26.286 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 6, 2023-12-22T10:01:26.286 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "6c89d9d8-c153-4a48-afa9-97e4c403f1ee", 2023-12-22T10:01:26.286 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-12-22T10:01:26.286 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-12-22T10:01:26.286 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-12-22T10:01:26.286 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-12-22T10:01:26.286 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-12-22T10:01:26.286 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-12-22T10:01:26.286 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-12-22T10:01:26.286 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 19, 2023-12-22T10:01:26.286 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-12-22T10:01:26.286 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-12-22T10:01:26.286 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-12-22T10:01:26.286 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-12-22T10:01:26.286 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:26.287 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-12-22T10:01:26.287 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.113:6808", 2023-12-22T10:01:26.287 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 34101 2023-12-22T10:01:26.287 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:26.287 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:26.287 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-12-22T10:01:26.287 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.113:6810", 2023-12-22T10:01:26.287 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 34101 2023-12-22T10:01:26.287 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-22T10:01:26.287 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-12-22T10:01:26.287 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:26.287 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-12-22T10:01:26.287 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-12-22T10:01:26.287 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:26.287 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-12-22T10:01:26.288 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.113:6812", 2023-12-22T10:01:26.288 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 34101 2023-12-22T10:01:26.288 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:26.288 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:26.288 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-12-22T10:01:26.288 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.113:6814", 2023-12-22T10:01:26.288 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 34101 2023-12-22T10:01:26.288 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-22T10:01:26.288 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-12-22T10:01:26.288 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:26.288 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-12-22T10:01:26.288 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-12-22T10:01:26.288 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:26.288 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-12-22T10:01:26.289 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.113:6822", 2023-12-22T10:01:26.289 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 34101 2023-12-22T10:01:26.289 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:26.289 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:26.289 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-12-22T10:01:26.289 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.113:6824", 2023-12-22T10:01:26.289 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 34101 2023-12-22T10:01:26.289 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-22T10:01:26.289 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-12-22T10:01:26.289 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:26.289 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-12-22T10:01:26.289 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-12-22T10:01:26.289 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:26.289 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-12-22T10:01:26.290 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.113:6817", 2023-12-22T10:01:26.290 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 34101 2023-12-22T10:01:26.290 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:26.290 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:26.290 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-12-22T10:01:26.290 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.113:6819", 2023-12-22T10:01:26.290 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 34101 2023-12-22T10:01:26.290 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-22T10:01:26.291 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-12-22T10:01:26.291 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:26.291 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.113:6810/34101", 2023-12-22T10:01:26.291 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.113:6814/34101", 2023-12-22T10:01:26.291 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.113:6824/34101", 2023-12-22T10:01:26.291 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.113:6819/34101", 2023-12-22T10:01:26.291 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-12-22T10:01:26.291 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-12-22T10:01:26.292 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-12-22T10:01:26.292 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-12-22T10:01:26.292 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:26.292 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:26.292 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 7, 2023-12-22T10:01:26.292 INFO:teuthology.orchestra.run.smithi045.stdout: "uuid": "1855e70c-23f6-4c08-ad7f-774c2148235b", 2023-12-22T10:01:26.292 INFO:teuthology.orchestra.run.smithi045.stdout: "up": 1, 2023-12-22T10:01:26.293 INFO:teuthology.orchestra.run.smithi045.stdout: "in": 1, 2023-12-22T10:01:26.293 INFO:teuthology.orchestra.run.smithi045.stdout: "weight": 1, 2023-12-22T10:01:26.293 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_affinity": 1, 2023-12-22T10:01:26.293 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_begin": 0, 2023-12-22T10:01:26.293 INFO:teuthology.orchestra.run.smithi045.stdout: "last_clean_end": 0, 2023-12-22T10:01:26.293 INFO:teuthology.orchestra.run.smithi045.stdout: "up_from": 13, 2023-12-22T10:01:26.294 INFO:teuthology.orchestra.run.smithi045.stdout: "up_thru": 19, 2023-12-22T10:01:26.294 INFO:teuthology.orchestra.run.smithi045.stdout: "down_at": 0, 2023-12-22T10:01:26.294 INFO:teuthology.orchestra.run.smithi045.stdout: "lost_at": 0, 2023-12-22T10:01:26.294 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addrs": { 2023-12-22T10:01:26.294 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-12-22T10:01:26.294 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:26.294 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-12-22T10:01:26.295 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.113:6821", 2023-12-22T10:01:26.295 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 34102 2023-12-22T10:01:26.295 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:26.295 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:26.295 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-12-22T10:01:26.295 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.113:6825", 2023-12-22T10:01:26.295 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 34102 2023-12-22T10:01:26.295 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-22T10:01:26.296 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-12-22T10:01:26.296 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:26.296 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addrs": { 2023-12-22T10:01:26.296 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-12-22T10:01:26.296 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:26.296 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-12-22T10:01:26.296 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.113:6826", 2023-12-22T10:01:26.296 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 34102 2023-12-22T10:01:26.297 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:26.297 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:26.297 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-12-22T10:01:26.297 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.113:6827", 2023-12-22T10:01:26.297 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 34102 2023-12-22T10:01:26.297 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-22T10:01:26.298 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-12-22T10:01:26.298 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:26.298 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addrs": { 2023-12-22T10:01:26.298 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-12-22T10:01:26.298 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:26.298 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-12-22T10:01:26.299 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.113:6830", 2023-12-22T10:01:26.299 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 34102 2023-12-22T10:01:26.299 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:26.299 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:26.299 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-12-22T10:01:26.299 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.113:6831", 2023-12-22T10:01:26.299 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 34102 2023-12-22T10:01:26.299 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-22T10:01:26.299 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-12-22T10:01:26.300 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:26.300 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addrs": { 2023-12-22T10:01:26.300 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2023-12-22T10:01:26.300 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:26.300 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2023-12-22T10:01:26.300 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.113:6828", 2023-12-22T10:01:26.300 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 34102 2023-12-22T10:01:26.300 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:26.300 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:26.300 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-12-22T10:01:26.300 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.113:6829", 2023-12-22T10:01:26.300 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 34102 2023-12-22T10:01:26.300 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-22T10:01:26.300 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-12-22T10:01:26.301 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:26.301 INFO:teuthology.orchestra.run.smithi045.stdout: "public_addr": "172.21.15.113:6825/34102", 2023-12-22T10:01:26.301 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_addr": "172.21.15.113:6827/34102", 2023-12-22T10:01:26.301 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_back_addr": "172.21.15.113:6831/34102", 2023-12-22T10:01:26.301 INFO:teuthology.orchestra.run.smithi045.stdout: "heartbeat_front_addr": "172.21.15.113:6829/34102", 2023-12-22T10:01:26.301 INFO:teuthology.orchestra.run.smithi045.stdout: "state": [ 2023-12-22T10:01:26.301 INFO:teuthology.orchestra.run.smithi045.stdout: "exists", 2023-12-22T10:01:26.301 INFO:teuthology.orchestra.run.smithi045.stdout: "up" 2023-12-22T10:01:26.301 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-12-22T10:01:26.301 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-22T10:01:26.301 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-12-22T10:01:26.301 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_xinfo": [ 2023-12-22T10:01:26.301 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:26.302 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 0, 2023-12-22T10:01:26.302 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-12-22T10:01:26.302 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-12-22T10:01:26.302 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-12-22T10:01:26.302 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138314316775423, 2023-12-22T10:01:26.302 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-12-22T10:01:26.302 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-12-22T10:00:23.812672+0000", 2023-12-22T10:01:26.303 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-12-22T10:01:26.303 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:26.303 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:26.303 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 1, 2023-12-22T10:01:26.303 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-12-22T10:01:26.303 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-12-22T10:01:26.303 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-12-22T10:01:26.304 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138314316775423, 2023-12-22T10:01:26.304 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-12-22T10:01:26.304 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-12-22T10:00:23.825045+0000", 2023-12-22T10:01:26.304 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-12-22T10:01:26.304 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:26.304 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:26.304 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 2, 2023-12-22T10:01:26.305 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-12-22T10:01:26.305 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-12-22T10:01:26.305 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-12-22T10:01:26.305 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138314316775423, 2023-12-22T10:01:26.305 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-12-22T10:01:26.305 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-12-22T10:00:23.700105+0000", 2023-12-22T10:01:26.306 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-12-22T10:01:26.306 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:26.306 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:26.306 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 3, 2023-12-22T10:01:26.306 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-12-22T10:01:26.306 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-12-22T10:01:26.306 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-12-22T10:01:26.306 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138314316775423, 2023-12-22T10:01:26.306 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-12-22T10:01:26.306 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-12-22T10:00:23.856563+0000", 2023-12-22T10:01:26.306 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-12-22T10:01:26.306 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:26.306 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:26.307 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 4, 2023-12-22T10:01:26.307 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-12-22T10:01:26.307 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-12-22T10:01:26.307 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-12-22T10:01:26.307 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138314316775423, 2023-12-22T10:01:26.307 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-12-22T10:01:26.307 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-12-22T10:00:23.954683+0000", 2023-12-22T10:01:26.307 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-12-22T10:01:26.307 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:26.307 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:26.307 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 5, 2023-12-22T10:01:26.307 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-12-22T10:01:26.308 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-12-22T10:01:26.308 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-12-22T10:01:26.308 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138314316775423, 2023-12-22T10:01:26.308 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-12-22T10:01:26.308 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-12-22T10:00:23.883234+0000", 2023-12-22T10:01:26.308 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-12-22T10:01:26.308 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:26.308 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:26.308 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 6, 2023-12-22T10:01:26.308 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-12-22T10:01:26.309 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-12-22T10:01:26.309 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-12-22T10:01:26.309 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138314316775423, 2023-12-22T10:01:26.309 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-12-22T10:01:26.309 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-12-22T10:00:23.883994+0000", 2023-12-22T10:01:26.309 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-12-22T10:01:26.309 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:26.309 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:26.309 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": 7, 2023-12-22T10:01:26.309 INFO:teuthology.orchestra.run.smithi045.stdout: "down_stamp": "0.000000", 2023-12-22T10:01:26.309 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_probability": 0, 2023-12-22T10:01:26.309 INFO:teuthology.orchestra.run.smithi045.stdout: "laggy_interval": 0, 2023-12-22T10:01:26.309 INFO:teuthology.orchestra.run.smithi045.stdout: "features": 4540138314316775423, 2023-12-22T10:01:26.310 INFO:teuthology.orchestra.run.smithi045.stdout: "old_weight": 0, 2023-12-22T10:01:26.310 INFO:teuthology.orchestra.run.smithi045.stdout: "last_purged_snaps_scrub": "2023-12-22T10:00:23.821686+0000", 2023-12-22T10:01:26.310 INFO:teuthology.orchestra.run.smithi045.stdout: "dead_epoch": 0 2023-12-22T10:01:26.310 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-22T10:01:26.310 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-12-22T10:01:26.310 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap": [], 2023-12-22T10:01:26.310 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_upmap_items": [], 2023-12-22T10:01:26.310 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_temp": [], 2023-12-22T10:01:26.310 INFO:teuthology.orchestra.run.smithi045.stdout: "primary_temp": [], 2023-12-22T10:01:26.310 INFO:teuthology.orchestra.run.smithi045.stdout: "blocklist": { 2023-12-22T10:01:26.310 INFO:teuthology.orchestra.run.smithi045.stdout: "172.21.15.45:6837/1007404834": "2023-12-23T10:01:20.865002+0000", 2023-12-22T10:01:26.310 INFO:teuthology.orchestra.run.smithi045.stdout: "172.21.15.45:6836/1007404834": "2023-12-23T10:01:20.865002+0000" 2023-12-22T10:01:26.310 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:26.311 INFO:teuthology.orchestra.run.smithi045.stdout: "range_blocklist": {}, 2023-12-22T10:01:26.311 INFO:teuthology.orchestra.run.smithi045.stdout: "erasure_code_profiles": { 2023-12-22T10:01:26.311 INFO:teuthology.orchestra.run.smithi045.stdout: "default": { 2023-12-22T10:01:26.311 INFO:teuthology.orchestra.run.smithi045.stdout: "crush-failure-domain": "osd", 2023-12-22T10:01:26.311 INFO:teuthology.orchestra.run.smithi045.stdout: "k": "2", 2023-12-22T10:01:26.311 INFO:teuthology.orchestra.run.smithi045.stdout: "m": "1", 2023-12-22T10:01:26.311 INFO:teuthology.orchestra.run.smithi045.stdout: "plugin": "jerasure", 2023-12-22T10:01:26.311 INFO:teuthology.orchestra.run.smithi045.stdout: "ruleset-failure-domain": "osd", 2023-12-22T10:01:26.311 INFO:teuthology.orchestra.run.smithi045.stdout: "technique": "reed_sol_van" 2023-12-22T10:01:26.311 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-22T10:01:26.312 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:26.312 INFO:teuthology.orchestra.run.smithi045.stdout: "removed_snaps_queue": [], 2023-12-22T10:01:26.312 INFO:teuthology.orchestra.run.smithi045.stdout: "new_removed_snaps": [], 2023-12-22T10:01:26.312 INFO:teuthology.orchestra.run.smithi045.stdout: "new_purged_snaps": [], 2023-12-22T10:01:26.312 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_node_flags": {}, 2023-12-22T10:01:26.312 INFO:teuthology.orchestra.run.smithi045.stdout: "device_class_flags": {}, 2023-12-22T10:01:26.313 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode": { 2023-12-22T10:01:26.313 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode_enabled": false, 2023-12-22T10:01:26.313 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_bucket_count": 0, 2023-12-22T10:01:26.313 INFO:teuthology.orchestra.run.smithi045.stdout: "degraded_stretch_mode": 0, 2023-12-22T10:01:26.313 INFO:teuthology.orchestra.run.smithi045.stdout: "recovering_stretch_mode": 0, 2023-12-22T10:01:26.313 INFO:teuthology.orchestra.run.smithi045.stdout: "stretch_mode_bucket": 0 2023-12-22T10:01:26.313 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-22T10:01:26.314 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-22T10:01:26.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.224+0000 7f515341b700 1 -- 172.21.15.45:0/362227762 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f513005a540 msgr2=0x7f513005ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:26.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.224+0000 7f515341b700 1 --2- 172.21.15.45:0/362227762 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f513005a540 0x7f513005ca00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f514c0acb10 tx=0x7f513c009040).stop 2023-12-22T10:01:26.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.224+0000 7f515341b700 1 -- 172.21.15.45:0/362227762 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f514c0c3790 msgr2=0x7f514c152b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:26.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.224+0000 7f515341b700 1 --2- 172.21.15.45:0/362227762 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f514c0c3790 0x7f514c152b60 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7f5148009f50 tx=0x7f5148017000).stop 2023-12-22T10:01:26.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.224+0000 7f515341b700 1 -- 172.21.15.45:0/362227762 shutdown_connections 2023-12-22T10:01:26.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.224+0000 7f515341b700 1 --2- 172.21.15.45:0/362227762 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f514c1581f0 0x7f514c155f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:26.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.224+0000 7f515341b700 1 --2- 172.21.15.45:0/362227762 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f513005a540 0x7f513005ca00 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:26.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.224+0000 7f515341b700 1 --2- 172.21.15.45:0/362227762 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f514c157e10 0x7f514c1596d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:26.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.224+0000 7f515341b700 1 --2- 172.21.15.45:0/362227762 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f514c0c3790 0x7f514c152b60 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:26.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.224+0000 7f515341b700 1 -- 172.21.15.45:0/362227762 >> 172.21.15.45:0/362227762 conn(0x7f514c066a70 msgr2=0x7f514c15de60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:26.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.224+0000 7f515341b700 1 -- 172.21.15.45:0/362227762 shutdown_connections 2023-12-22T10:01:26.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.224+0000 7f515341b700 1 -- 172.21.15.45:0/362227762 wait complete. 2023-12-22T10:01:26.318 INFO:tasks.cephfs.cephfs_test_case:Removing 2 blocklist entries 2023-12-22T10:01:26.318 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist rm 172.21.15.45:6837/1007404834 2023-12-22T10:01:26.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.488+0000 7f2276f07700 1 Processor -- start 2023-12-22T10:01:26.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.488+0000 7f2276f07700 1 -- start start 2023-12-22T10:01:26.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.492+0000 7f2276f07700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f22700a8ba0 0x7f22701584a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:26.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.492+0000 7f2276f07700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f2270065890 0x7f22700c4c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:26.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.492+0000 7f2276f07700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22701594c0 con 0x7f2270158990 2023-12-22T10:01:26.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.492+0000 7f2276f07700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22700c11e0 con 0x7f22700a8ba0 2023-12-22T10:01:26.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.492+0000 7f2276f07700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2270068aa0 con 0x7f2270065890 2023-12-22T10:01:26.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.492+0000 7f2275704700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f2270065890 0x7f22700c4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:26.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.492+0000 7f2275f05700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f22700a8ba0 0x7f22701584a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:26.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.492+0000 7f2275f05700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f22700a8ba0 0x7f22701584a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.45:35940/0 (socket says 172.21.15.45:35940) 2023-12-22T10:01:26.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.492+0000 7f2275f05700 1 -- 172.21.15.45:0/1928407783 learned_addr learned my addr 172.21.15.45:0/1928407783 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:26.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.492+0000 7f2274f03700 1 -- 172.21.15.45:0/1928407783 <== mon.1 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3244443651 0 0) 0x7f22701594c0 con 0x7f2270158990 2023-12-22T10:01:26.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.492+0000 7f2275f05700 1 -- 172.21.15.45:0/1928407783 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f2270065890 msgr2=0x7f22700c4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:26.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.492+0000 7f2275f05700 1 --2- 172.21.15.45:0/1928407783 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f2270065890 0x7f22700c4c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:26.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.492+0000 7f2275f05700 1 -- 172.21.15.45:0/1928407783 >> v1:172.21.15.113:6789/0 conn(0x7f2270158990 legacy=0x7f227015ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:26.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.492+0000 7f2275f05700 1 -- 172.21.15.45:0/1928407783 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2270158f00 con 0x7f22700a8ba0 2023-12-22T10:01:26.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.492+0000 7f2275f05700 1 --2- 172.21.15.45:0/1928407783 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f22700a8ba0 0x7f22701584a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f226c006fd0 tx=0x7f226c0090f0).ready entity=mon.1 client_cookie=a239f1488b3a8c0d server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:26.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.496+0000 7f2274f03700 1 -- 172.21.15.45:0/1928407783 <== mon.1 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f226c00b580 con 0x7f22700a8ba0 2023-12-22T10:01:26.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.496+0000 7f2274f03700 1 -- 172.21.15.45:0/1928407783 <== mon.1 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f226c00b6e0 con 0x7f22700a8ba0 2023-12-22T10:01:26.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.496+0000 7f2274f03700 1 -- 172.21.15.45:0/1928407783 <== mon.1 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f226c00ba60 con 0x7f22700a8ba0 2023-12-22T10:01:26.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.496+0000 7f2276f07700 1 -- 172.21.15.45:0/1928407783 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f22700a8ba0 msgr2=0x7f22701584a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:26.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.496+0000 7f2276f07700 1 --2- 172.21.15.45:0/1928407783 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f22700a8ba0 0x7f22701584a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f226c006fd0 tx=0x7f226c0090f0).stop 2023-12-22T10:01:26.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.496+0000 7f2276f07700 1 -- 172.21.15.45:0/1928407783 shutdown_connections 2023-12-22T10:01:26.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.496+0000 7f2276f07700 1 --2- 172.21.15.45:0/1928407783 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f2270065890 0x7f22700c4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:26.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.496+0000 7f2276f07700 1 --2- 172.21.15.45:0/1928407783 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f22700a8ba0 0x7f22701584a0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:26.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.496+0000 7f2276f07700 1 -- 172.21.15.45:0/1928407783 >> 172.21.15.45:0/1928407783 conn(0x7f2270067500 msgr2=0x7f22700c6440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:26.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.496+0000 7f2276f07700 1 -- 172.21.15.45:0/1928407783 shutdown_connections 2023-12-22T10:01:26.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.496+0000 7f2276f07700 1 -- 172.21.15.45:0/1928407783 wait complete. 2023-12-22T10:01:26.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.500+0000 7f2276f07700 1 Processor -- start 2023-12-22T10:01:26.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.500+0000 7f2276f07700 1 -- start start 2023-12-22T10:01:26.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.500+0000 7f2276f07700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2270065890 0x7f22700abfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:26.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.500+0000 7f2276f07700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f22700a8ba0 0x7f227015bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:26.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.500+0000 7f2276f07700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2270158990 0x7f2270068c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:26.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.500+0000 7f2276f07700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22700c02a0 con 0x7f2270065890 2023-12-22T10:01:26.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.500+0000 7f2276f07700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22700bd7e0 con 0x7f2270158990 2023-12-22T10:01:26.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.500+0000 7f2276f07700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22700bf200 con 0x7f22700a8ba0 2023-12-22T10:01:26.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.500+0000 7f2275f05700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2270065890 0x7f22700abfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:26.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.500+0000 7f2275f05700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2270065890 0x7f22700abfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44764/0 (socket says 172.21.15.45:44764) 2023-12-22T10:01:26.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.500+0000 7f2275f05700 1 -- 172.21.15.45:0/2335391545 learned_addr learned my addr 172.21.15.45:0/2335391545 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:26.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.500+0000 7f2275704700 1 --2- 172.21.15.45:0/2335391545 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f22700a8ba0 0x7f227015bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:26.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.500+0000 7f2276706700 1 --2- 172.21.15.45:0/2335391545 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2270158990 0x7f2270068c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:26.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.504+0000 7f2275f05700 1 -- 172.21.15.45:0/2335391545 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f22700a8ba0 msgr2=0x7f227015bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:26.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.504+0000 7f2275f05700 1 --2- 172.21.15.45:0/2335391545 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f22700a8ba0 0x7f227015bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:26.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.504+0000 7f2275f05700 1 -- 172.21.15.45:0/2335391545 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2270158990 msgr2=0x7f2270068c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:26.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.504+0000 7f2275f05700 1 --2- 172.21.15.45:0/2335391545 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2270158990 0x7f2270068c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:26.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.504+0000 7f2275f05700 1 -- 172.21.15.45:0/2335391545 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f226c009370 con 0x7f2270065890 2023-12-22T10:01:26.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.504+0000 7f2276706700 1 --2- 172.21.15.45:0/2335391545 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2270158990 0x7f2270068c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T10:01:26.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.504+0000 7f2275f05700 1 --2- 172.21.15.45:0/2335391545 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2270065890 0x7f22700abfb0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7f226c009130 tx=0x7f226c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:26.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.504+0000 7f2265ffb700 1 -- 172.21.15.45:0/2335391545 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f226c00b850 con 0x7f2270065890 2023-12-22T10:01:26.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.504+0000 7f2265ffb700 1 -- 172.21.15.45:0/2335391545 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f226c00b9b0 con 0x7f2270065890 2023-12-22T10:01:26.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.504+0000 7f2265ffb700 1 -- 172.21.15.45:0/2335391545 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f226c01b660 con 0x7f2270065890 2023-12-22T10:01:26.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.504+0000 7f2276f07700 1 -- 172.21.15.45:0/2335391545 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22700bf4e0 con 0x7f2270065890 2023-12-22T10:01:26.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.504+0000 7f2276f07700 1 -- 172.21.15.45:0/2335391545 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22700bfaa0 con 0x7f2270065890 2023-12-22T10:01:26.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.504+0000 7f2276f07700 1 -- 172.21.15.45:0/2335391545 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2270047060 con 0x7f2270065890 2023-12-22T10:01:26.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.504+0000 7f2265ffb700 1 -- 172.21.15.45:0/2335391545 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f226c01b9d0 con 0x7f2270065890 2023-12-22T10:01:26.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.508+0000 7f2265ffb700 1 --2- 172.21.15.45:0/2335391545 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f225405a4e0 0x7f225405c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:26.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.508+0000 7f2265ffb700 1 -- 172.21.15.45:0/2335391545 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f226c075e90 con 0x7f2270065890 2023-12-22T10:01:26.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.508+0000 7f2275704700 1 --2- 172.21.15.45:0/2335391545 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f225405a4e0 0x7f225405c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:26.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.508+0000 7f2275704700 1 --2- 172.21.15.45:0/2335391545 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f225405a4e0 0x7f225405c9a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f2270156000 tx=0x7f2260009060).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:26.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.512+0000 7f2265ffb700 1 -- 172.21.15.45:0/2335391545 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f226c0498b0 con 0x7f2270065890 2023-12-22T10:01:26.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:26.688+0000 7f2276f07700 1 -- 172.21.15.45:0/2335391545 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.45:6837/1007404834"} v 0) v1 -- 0x7f22701591e0 con 0x7f2270065890 2023-12-22T10:01:27.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:27.448+0000 7f2265ffb700 1 -- 172.21.15.45:0/2335391545 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.45:6837/1007404834"}]=0 un-blocklisting 172.21.15.45:6837/1007404834 v31) v1 ==== 166+0+0 (secure 0 0 0) 0x7f226c077030 con 0x7f2270065890 2023-12-22T10:01:27.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:27.452+0000 7f2276f07700 1 -- 172.21.15.45:0/2335391545 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f225405a4e0 msgr2=0x7f225405c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:27.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:27.452+0000 7f2276f07700 1 --2- 172.21.15.45:0/2335391545 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f225405a4e0 0x7f225405c9a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f2270156000 tx=0x7f2260009060).stop 2023-12-22T10:01:27.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:27.452+0000 7f2276f07700 1 -- 172.21.15.45:0/2335391545 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2270065890 msgr2=0x7f22700abfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:27.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:27.452+0000 7f2276f07700 1 --2- 172.21.15.45:0/2335391545 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2270065890 0x7f22700abfb0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7f226c009130 tx=0x7f226c017000).stop 2023-12-22T10:01:27.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:27.452+0000 7f2276f07700 1 -- 172.21.15.45:0/2335391545 shutdown_connections 2023-12-22T10:01:27.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:27.452+0000 7f2276f07700 1 --2- 172.21.15.45:0/2335391545 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2270158990 0x7f2270068c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:27.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:27.452+0000 7f2276f07700 1 --2- 172.21.15.45:0/2335391545 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f225405a4e0 0x7f225405c9a0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:27.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:27.452+0000 7f2276f07700 1 --2- 172.21.15.45:0/2335391545 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f22700a8ba0 0x7f227015bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:27.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:27.452+0000 7f2276f07700 1 --2- 172.21.15.45:0/2335391545 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2270065890 0x7f22700abfb0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:27.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:27.452+0000 7f2276f07700 1 -- 172.21.15.45:0/2335391545 >> 172.21.15.45:0/2335391545 conn(0x7f2270067500 msgr2=0x7f22700c1d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:27.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:27.452+0000 7f2276f07700 1 -- 172.21.15.45:0/2335391545 shutdown_connections 2023-12-22T10:01:27.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:27.452+0000 7f2276f07700 1 -- 172.21.15.45:0/2335391545 wait complete. 2023-12-22T10:01:27.453 INFO:teuthology.orchestra.run.smithi045.stderr:un-blocklisting 172.21.15.45:6837/1007404834 2023-12-22T10:01:27.471 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist rm 172.21.15.45:6836/1007404834 2023-12-22T10:01:27.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:27.648+0000 7f9862f1b700 1 Processor -- start 2023-12-22T10:01:27.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:27.648+0000 7f9862f1b700 1 -- start start 2023-12-22T10:01:27.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:27.652+0000 7f9862f1b700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f985c157d40 0x7f985c158120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:27.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:27.652+0000 7f9862f1b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f985c0a5f20 0x7f985c0c1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:27.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:27.652+0000 7f9862f1b700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f985c0c1fe0 con 0x7f985c0c1670 2023-12-22T10:01:27.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:27.652+0000 7f9862f1b700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f985c069e00 con 0x7f985c0a5f20 2023-12-22T10:01:27.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:27.652+0000 7f9862f1b700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f985c069180 con 0x7f985c157d40 2023-12-22T10:01:27.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:27.652+0000 7f9860cb7700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f985c157d40 0x7f985c158120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:27.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:27.652+0000 7f98614b8700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f985c0a5f20 0x7f985c0c1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:27.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:27.652+0000 7f9853fff700 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f985c0c1670 0x7f985c0a5810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.45:51802/0 (socket says 172.21.15.45:51802) 2023-12-22T10:01:27.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:27.652+0000 7f9853fff700 1 -- 172.21.15.45:0/1157969833 learned_addr learned my addr 172.21.15.45:0/1157969833 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:01:27.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:27.652+0000 7f98614b8700 1 -- 172.21.15.45:0/1157969833 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f985c157d40 msgr2=0x7f985c158120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:27.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:27.652+0000 7f98614b8700 1 --2- 172.21.15.45:0/1157969833 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f985c157d40 0x7f985c158120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:27.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:27.652+0000 7f98614b8700 1 -- 172.21.15.45:0/1157969833 >> v1:172.21.15.113:6789/0 conn(0x7f985c0c1670 legacy=0x7f985c0a5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:27.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:27.652+0000 7f98614b8700 1 -- 172.21.15.45:0/1157969833 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f985c069460 con 0x7f985c0a5f20 2023-12-22T10:01:27.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:27.652+0000 7f98537fe700 1 -- 172.21.15.45:0/1157969833 <== mon.1 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 729276734 0 0) 0x7f985c0c1fe0 con 0x7f985c0c1670 2023-12-22T10:01:27.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:27.652+0000 7f98614b8700 1 --2- 172.21.15.45:0/1157969833 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f985c0a5f20 0x7f985c0c1af0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7f9854009e60 tx=0x7f9854009780).ready entity=mon.0 client_cookie=8228ec9090e4a453 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:27.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:27.656+0000 7f98537fe700 1 -- 172.21.15.45:0/1157969833 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f985400e070 con 0x7f985c0a5f20 2023-12-22T10:01:27.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:27.656+0000 7f98537fe700 1 -- 172.21.15.45:0/1157969833 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f985400bb60 con 0x7f985c0a5f20 2023-12-22T10:01:27.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:27.656+0000 7f98537fe700 1 -- 172.21.15.45:0/1157969833 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9854012410 con 0x7f985c0a5f20 2023-12-22T10:01:27.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:27.656+0000 7f9862f1b700 1 -- 172.21.15.45:0/1157969833 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f985c0a5f20 msgr2=0x7f985c0c1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:27.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:27.656+0000 7f9862f1b700 1 --2- 172.21.15.45:0/1157969833 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f985c0a5f20 0x7f985c0c1af0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7f9854009e60 tx=0x7f9854009780).stop 2023-12-22T10:01:27.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:27.656+0000 7f9862f1b700 1 -- 172.21.15.45:0/1157969833 shutdown_connections 2023-12-22T10:01:27.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:27.656+0000 7f9862f1b700 1 --2- 172.21.15.45:0/1157969833 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f985c0a5f20 0x7f985c0c1af0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:27.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:27.656+0000 7f9862f1b700 1 --2- 172.21.15.45:0/1157969833 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f985c157d40 0x7f985c158120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:27.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:27.656+0000 7f9862f1b700 1 -- 172.21.15.45:0/1157969833 >> 172.21.15.45:0/1157969833 conn(0x7f985c066a70 msgr2=0x7f985c066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:27.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:27.656+0000 7f9862f1b700 1 -- 172.21.15.45:0/1157969833 shutdown_connections 2023-12-22T10:01:27.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:27.656+0000 7f9862f1b700 1 -- 172.21.15.45:0/1157969833 wait complete. 2023-12-22T10:01:27.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:27.660+0000 7f9862f1b700 1 Processor -- start 2023-12-22T10:01:27.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:27.660+0000 7f9862f1b700 1 -- start start 2023-12-22T10:01:27.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:27.660+0000 7f9862f1b700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f985c0a5f20 0x7f985c150340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:27.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:27.660+0000 7f9862f1b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f985c0c1670 0x7f985c13ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:27.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:27.660+0000 7f9862f1b700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f985c157d40 0x7f985c152520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:27.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:27.660+0000 7f9862f1b700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f985c0c4540 con 0x7f985c0c1670 2023-12-22T10:01:27.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:27.660+0000 7f9862f1b700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f985c152090 con 0x7f985c157d40 2023-12-22T10:01:27.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:27.660+0000 7f9862f1b700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f985c0c4790 con 0x7f985c0a5f20 2023-12-22T10:01:27.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:27.660+0000 7f9853fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f985c0c1670 0x7f985c13ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:27.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:27.660+0000 7f9853fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f985c0c1670 0x7f985c13ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44788/0 (socket says 172.21.15.45:44788) 2023-12-22T10:01:27.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:27.660+0000 7f9853fff700 1 -- 172.21.15.45:0/4247866998 learned_addr learned my addr 172.21.15.45:0/4247866998 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:27.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:27.660+0000 7f9860cb7700 1 --2- 172.21.15.45:0/4247866998 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f985c0a5f20 0x7f985c150340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:27.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:27.660+0000 7f98614b8700 1 --2- 172.21.15.45:0/4247866998 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f985c157d40 0x7f985c152520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:27.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:27.660+0000 7f9853fff700 1 -- 172.21.15.45:0/4247866998 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f985c0a5f20 msgr2=0x7f985c150340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:27.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:27.660+0000 7f9853fff700 1 --2- 172.21.15.45:0/4247866998 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f985c0a5f20 0x7f985c150340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:27.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:27.660+0000 7f9853fff700 1 -- 172.21.15.45:0/4247866998 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f985c157d40 msgr2=0x7f985c152520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:27.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:27.660+0000 7f9853fff700 1 --2- 172.21.15.45:0/4247866998 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f985c157d40 0x7f985c152520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:27.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:27.660+0000 7f9853fff700 1 -- 172.21.15.45:0/4247866998 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9854009a20 con 0x7f985c0c1670 2023-12-22T10:01:27.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:27.660+0000 7f9853fff700 1 --2- 172.21.15.45:0/4247866998 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f985c0c1670 0x7f985c13ccc0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7f984c00c4d0 tx=0x7f984c007c30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:27.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:27.660+0000 7f9850ff9700 1 -- 172.21.15.45:0/4247866998 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f984c00ce40 con 0x7f985c0c1670 2023-12-22T10:01:27.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:27.660+0000 7f9850ff9700 1 -- 172.21.15.45:0/4247866998 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f984c0072e0 con 0x7f985c0c1670 2023-12-22T10:01:27.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:27.660+0000 7f9850ff9700 1 -- 172.21.15.45:0/4247866998 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f984c007660 con 0x7f985c0c1670 2023-12-22T10:01:27.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:27.660+0000 7f9862f1b700 1 -- 172.21.15.45:0/4247866998 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f985c0c4a70 con 0x7f985c0c1670 2023-12-22T10:01:27.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:27.660+0000 7f9862f1b700 1 -- 172.21.15.45:0/4247866998 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f985c0c4d50 con 0x7f985c0c1670 2023-12-22T10:01:27.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:27.664+0000 7f9862f1b700 1 -- 172.21.15.45:0/4247866998 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f985c06c070 con 0x7f985c0c1670 2023-12-22T10:01:27.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:27.664+0000 7f9850ff9700 1 -- 172.21.15.45:0/4247866998 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f984c0059b0 con 0x7f985c0c1670 2023-12-22T10:01:27.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:27.668+0000 7f9850ff9700 1 --2- 172.21.15.45:0/4247866998 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f984805a510 0x7f984805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:27.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:27.668+0000 7f9850ff9700 1 -- 172.21.15.45:0/4247866998 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5312+0+0 (secure 0 0 0) 0x7f984c073c30 con 0x7f985c0c1670 2023-12-22T10:01:27.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:27.668+0000 7f9860cb7700 1 --2- 172.21.15.45:0/4247866998 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f984805a510 0x7f984805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:27.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:27.668+0000 7f9860cb7700 1 --2- 172.21.15.45:0/4247866998 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f984805a510 0x7f984805c9d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f9858009c30 tx=0x7f9858009060).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:27.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:27.672+0000 7f9850ff9700 1 -- 172.21.15.45:0/4247866998 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f984c0476a0 con 0x7f985c0c1670 2023-12-22T10:01:27.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:27.848+0000 7f9862f1b700 1 -- 172.21.15.45:0/4247866998 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.45:6836/1007404834"} v 0) v1 -- 0x7f985c069740 con 0x7f985c0c1670 2023-12-22T10:01:28.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:28.460+0000 7f9850ff9700 1 -- 172.21.15.45:0/4247866998 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.45:6836/1007404834"}]=0 un-blocklisting 172.21.15.45:6836/1007404834 v32) v1 ==== 166+0+0 (secure 0 0 0) 0x7f984c04acc0 con 0x7f985c0c1670 2023-12-22T10:01:28.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:28.464+0000 7f9862f1b700 1 -- 172.21.15.45:0/4247866998 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f984805a510 msgr2=0x7f984805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:28.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:28.464+0000 7f9862f1b700 1 --2- 172.21.15.45:0/4247866998 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f984805a510 0x7f984805c9d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f9858009c30 tx=0x7f9858009060).stop 2023-12-22T10:01:28.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:28.464+0000 7f9862f1b700 1 -- 172.21.15.45:0/4247866998 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f985c0c1670 msgr2=0x7f985c13ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:28.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:28.464+0000 7f9862f1b700 1 --2- 172.21.15.45:0/4247866998 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f985c0c1670 0x7f985c13ccc0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7f984c00c4d0 tx=0x7f984c007c30).stop 2023-12-22T10:01:28.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:28.464+0000 7f9862f1b700 1 -- 172.21.15.45:0/4247866998 shutdown_connections 2023-12-22T10:01:28.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:28.464+0000 7f9862f1b700 1 --2- 172.21.15.45:0/4247866998 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f985c157d40 0x7f985c152520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:28.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:28.464+0000 7f9862f1b700 1 --2- 172.21.15.45:0/4247866998 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f985c0c1670 0x7f985c13ccc0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:28.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:28.464+0000 7f9862f1b700 1 --2- 172.21.15.45:0/4247866998 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f984805a510 0x7f984805c9d0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:28.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:28.464+0000 7f9862f1b700 1 --2- 172.21.15.45:0/4247866998 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f985c0a5f20 0x7f985c150340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:28.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:28.464+0000 7f9862f1b700 1 -- 172.21.15.45:0/4247866998 >> 172.21.15.45:0/4247866998 conn(0x7f985c066a70 msgr2=0x7f985c155c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:28.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:28.464+0000 7f9862f1b700 1 -- 172.21.15.45:0/4247866998 shutdown_connections 2023-12-22T10:01:28.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:28.464+0000 7f9862f1b700 1 -- 172.21.15.45:0/4247866998 wait complete. 2023-12-22T10:01:28.467 INFO:teuthology.orchestra.run.smithi045.stderr:un-blocklisting 172.21.15.45:6836/1007404834 2023-12-22T10:01:28.488 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-22T10:01:28.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:28.652+0000 7fbc935a9700 1 Processor -- start 2023-12-22T10:01:28.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:28.652+0000 7fbc935a9700 1 -- start start 2023-12-22T10:01:28.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:28.652+0000 7fbc935a9700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbc8c157e10 0x7fbc8c0c1820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:28.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:28.652+0000 7fbc935a9700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fbc8c1581f0 0x7fbc8c0c1d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:28.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:28.652+0000 7fbc935a9700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fbc8c0c3080 0x7fbc8c0c3530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:28.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:28.652+0000 7fbc935a9700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc8c0a68b0 con 0x7fbc8c157e10 2023-12-22T10:01:28.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:28.652+0000 7fbc935a9700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc8c065610 con 0x7fbc8c1581f0 2023-12-22T10:01:28.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:28.652+0000 7fbc935a9700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc8c0658f0 con 0x7fbc8c0c3080 2023-12-22T10:01:28.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:28.656+0000 7fbc91345700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbc8c157e10 0x7fbc8c0c1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:28.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:28.656+0000 7fbc91345700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbc8c157e10 0x7fbc8c0c1820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34840/0 (socket says 172.21.15.45:34840) 2023-12-22T10:01:28.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:28.656+0000 7fbc91345700 1 -- 172.21.15.45:0/73762623 learned_addr learned my addr 172.21.15.45:0/73762623 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:28.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:28.656+0000 7fbc90b44700 1 --2- 172.21.15.45:0/73762623 >> v2:172.21.15.113:3300/0 conn(0x7fbc8c1581f0 0x7fbc8c0c1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:28.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:28.656+0000 7fbc91b46700 1 --2- 172.21.15.45:0/73762623 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fbc8c0c3080 0x7fbc8c0c3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:28.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:28.656+0000 7fbc91345700 1 -- 172.21.15.45:0/73762623 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fbc8c0c3080 msgr2=0x7fbc8c0c3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:28.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:28.656+0000 7fbc91345700 1 --2- 172.21.15.45:0/73762623 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fbc8c0c3080 0x7fbc8c0c3530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:28.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:28.656+0000 7fbc91345700 1 -- 172.21.15.45:0/73762623 >> v2:172.21.15.113:3300/0 conn(0x7fbc8c1581f0 msgr2=0x7fbc8c0c1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:28.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:28.656+0000 7fbc91345700 1 --2- 172.21.15.45:0/73762623 >> v2:172.21.15.113:3300/0 conn(0x7fbc8c1581f0 0x7fbc8c0c1d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:28.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:28.656+0000 7fbc91345700 1 -- 172.21.15.45:0/73762623 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc8c065bd0 con 0x7fbc8c157e10 2023-12-22T10:01:28.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:28.656+0000 7fbc91b46700 1 --2- 172.21.15.45:0/73762623 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fbc8c0c3080 0x7fbc8c0c3530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-12-22T10:01:28.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:28.656+0000 7fbc91345700 1 --2- 172.21.15.45:0/73762623 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc8c157e10 0x7fbc8c0c1820 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7fbc8c0a66a0 tx=0x7fbc880090f0).ready entity=mon.0 client_cookie=955d4fd0ecd36a2b server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:28.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:28.656+0000 7fbc83fff700 1 -- 172.21.15.45:0/73762623 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc8800b600 con 0x7fbc8c157e10 2023-12-22T10:01:28.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:28.656+0000 7fbc83fff700 1 -- 172.21.15.45:0/73762623 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc8800b760 con 0x7fbc8c157e10 2023-12-22T10:01:28.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:28.656+0000 7fbc83fff700 1 -- 172.21.15.45:0/73762623 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc8800bae0 con 0x7fbc8c157e10 2023-12-22T10:01:28.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:28.656+0000 7fbc935a9700 1 -- 172.21.15.45:0/73762623 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc8c157e10 msgr2=0x7fbc8c0c1820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:28.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:28.656+0000 7fbc935a9700 1 --2- 172.21.15.45:0/73762623 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc8c157e10 0x7fbc8c0c1820 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7fbc8c0a66a0 tx=0x7fbc880090f0).stop 2023-12-22T10:01:28.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:28.656+0000 7fbc935a9700 1 -- 172.21.15.45:0/73762623 shutdown_connections 2023-12-22T10:01:28.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:28.656+0000 7fbc935a9700 1 --2- 172.21.15.45:0/73762623 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fbc8c0c3080 0x7fbc8c0c3530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:28.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:28.656+0000 7fbc935a9700 1 --2- 172.21.15.45:0/73762623 >> v2:172.21.15.113:3300/0 conn(0x7fbc8c1581f0 0x7fbc8c0c1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:28.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:28.656+0000 7fbc935a9700 1 --2- 172.21.15.45:0/73762623 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc8c157e10 0x7fbc8c0c1820 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:28.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:28.656+0000 7fbc935a9700 1 -- 172.21.15.45:0/73762623 >> 172.21.15.45:0/73762623 conn(0x7fbc8c066a70 msgr2=0x7fbc8c066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:28.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:28.656+0000 7fbc935a9700 1 -- 172.21.15.45:0/73762623 shutdown_connections 2023-12-22T10:01:28.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:28.656+0000 7fbc935a9700 1 -- 172.21.15.45:0/73762623 wait complete. 2023-12-22T10:01:28.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:28.660+0000 7fbc935a9700 1 Processor -- start 2023-12-22T10:01:28.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:28.660+0000 7fbc935a9700 1 -- start start 2023-12-22T10:01:28.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:28.660+0000 7fbc935a9700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fbc8c0c3080 0x7fbc8c0c7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:28.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:28.660+0000 7fbc935a9700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbc8c157e10 0x7fbc8c152aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:28.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:28.660+0000 7fbc935a9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc8c1581f0 0x7fbc8c0beff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:28.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:28.660+0000 7fbc935a9700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc8c0bc720 con 0x7fbc8c1581f0 2023-12-22T10:01:28.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:28.660+0000 7fbc935a9700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc8c0c74f0 con 0x7fbc8c157e10 2023-12-22T10:01:28.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:28.660+0000 7fbc935a9700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc8c0bbba0 con 0x7fbc8c0c3080 2023-12-22T10:01:28.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:28.660+0000 7fbc91b46700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc8c1581f0 0x7fbc8c0beff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:28.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:28.660+0000 7fbc91b46700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc8c1581f0 0x7fbc8c0beff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34842/0 (socket says 172.21.15.45:34842) 2023-12-22T10:01:28.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:28.660+0000 7fbc91b46700 1 -- 172.21.15.45:0/2113626081 learned_addr learned my addr 172.21.15.45:0/2113626081 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:28.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:28.660+0000 7fbc90b44700 1 --2- 172.21.15.45:0/2113626081 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbc8c157e10 0x7fbc8c152aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:28.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:28.660+0000 7fbc91345700 1 --2- 172.21.15.45:0/2113626081 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fbc8c0c3080 0x7fbc8c0c7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:28.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:28.664+0000 7fbc91b46700 1 -- 172.21.15.45:0/2113626081 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fbc8c0c3080 msgr2=0x7fbc8c0c7000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:28.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:28.664+0000 7fbc91b46700 1 --2- 172.21.15.45:0/2113626081 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fbc8c0c3080 0x7fbc8c0c7000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:28.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:28.664+0000 7fbc91b46700 1 -- 172.21.15.45:0/2113626081 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbc8c157e10 msgr2=0x7fbc8c152aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:28.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:28.664+0000 7fbc91b46700 1 --2- 172.21.15.45:0/2113626081 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbc8c157e10 0x7fbc8c152aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:28.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:28.664+0000 7fbc91b46700 1 -- 172.21.15.45:0/2113626081 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc88009370 con 0x7fbc8c1581f0 2023-12-22T10:01:28.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:28.664+0000 7fbc91b46700 1 --2- 172.21.15.45:0/2113626081 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc8c1581f0 0x7fbc8c0beff0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7fbc8400a380 tx=0x7fbc84007900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:28.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:28.664+0000 7fbc817fa700 1 -- 172.21.15.45:0/2113626081 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc84016470 con 0x7fbc8c1581f0 2023-12-22T10:01:28.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:28.664+0000 7fbc817fa700 1 -- 172.21.15.45:0/2113626081 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc840165d0 con 0x7fbc8c1581f0 2023-12-22T10:01:28.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:28.664+0000 7fbc935a9700 1 -- 172.21.15.45:0/2113626081 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc8c0bbe80 con 0x7fbc8c1581f0 2023-12-22T10:01:28.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:28.664+0000 7fbc817fa700 1 -- 172.21.15.45:0/2113626081 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc84016950 con 0x7fbc8c1581f0 2023-12-22T10:01:28.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:28.664+0000 7fbc935a9700 1 -- 172.21.15.45:0/2113626081 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc8c0bc440 con 0x7fbc8c1581f0 2023-12-22T10:01:28.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:28.664+0000 7fbc935a9700 1 -- 172.21.15.45:0/2113626081 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc8c16b590 con 0x7fbc8c1581f0 2023-12-22T10:01:28.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:28.668+0000 7fbc817fa700 1 -- 172.21.15.45:0/2113626081 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fbc84013070 con 0x7fbc8c1581f0 2023-12-22T10:01:28.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:28.668+0000 7fbc817fa700 1 --2- 172.21.15.45:0/2113626081 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fbc7005a510 0x7fbc7005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:28.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:28.668+0000 7fbc817fa700 1 -- 172.21.15.45:0/2113626081 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fbc840751c0 con 0x7fbc8c1581f0 2023-12-22T10:01:28.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:28.668+0000 7fbc91345700 1 --2- 172.21.15.45:0/2113626081 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fbc7005a510 0x7fbc7005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:28.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:28.668+0000 7fbc91345700 1 --2- 172.21.15.45:0/2113626081 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fbc7005a510 0x7fbc7005c9d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7fbc88009130 tx=0x7fbc88017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:28.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:28.672+0000 7fbc817fa700 1 -- 172.21.15.45:0/2113626081 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fbc84048c30 con 0x7fbc8c1581f0 2023-12-22T10:01:28.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:28.892+0000 7fbc935a9700 1 -- 172.21.15.45:0/2113626081 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fbc8c0a6b50 con 0x7fbc8c1581f0 2023-12-22T10:01:28.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:28.892+0000 7fbc817fa700 1 -- 172.21.15.45:0/2113626081 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6645 (secure 0 0 0) 0x7fbc8404c250 con 0x7fbc8c1581f0 2023-12-22T10:01:28.892 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:01:28.892 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-22T10:01:28.892 INFO:teuthology.orchestra.run.smithi045.stdout: "auth_dump": [ 2023-12-22T10:01:28.892 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:28.892 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.a", 2023-12-22T10:01:28.892 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAHXoVlqc61MhAAPD8joFf9bw/GcDPT6N8/3w==", 2023-12-22T10:01:28.892 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-22T10:01:28.893 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-12-22T10:01:28.893 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-12-22T10:01:28.893 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-12-22T10:01:28.893 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-22T10:01:28.893 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-22T10:01:28.893 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:28.893 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:28.893 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.b", 2023-12-22T10:01:28.893 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAIXoVlovyZCRAAFWq+P1UMNexooN7YnmR4Mg==", 2023-12-22T10:01:28.893 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-22T10:01:28.893 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-12-22T10:01:28.893 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-12-22T10:01:28.893 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-12-22T10:01:28.894 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-22T10:01:28.894 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-22T10:01:28.894 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:28.894 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:28.894 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.c", 2023-12-22T10:01:28.894 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAIXoVl+/VuARAAS7BSMEweIw+gJSXfsBYiqA==", 2023-12-22T10:01:28.894 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-22T10:01:28.894 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-12-22T10:01:28.894 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-12-22T10:01:28.894 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-12-22T10:01:28.894 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-22T10:01:28.894 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-22T10:01:28.894 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:28.895 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:28.895 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.d", 2023-12-22T10:01:28.895 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAIXoVlm4aAExAAt1TQj2/UrmuvttPaBtXEtw==", 2023-12-22T10:01:28.895 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-22T10:01:28.895 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-12-22T10:01:28.895 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-12-22T10:01:28.895 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-12-22T10:01:28.895 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-22T10:01:28.895 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-22T10:01:28.895 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:28.895 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:28.895 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.0", 2023-12-22T10:01:28.895 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAKXoVla+TQBBAAWfXaheCMCXIvlomPbXhO/g==", 2023-12-22T10:01:28.895 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-22T10:01:28.896 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-12-22T10:01:28.896 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-12-22T10:01:28.896 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-22T10:01:28.896 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-22T10:01:28.896 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:28.896 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:28.896 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.1", 2023-12-22T10:01:28.896 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQANXoVlzD/rLhAAh4CLB2zVod4fxnP/TId6aA==", 2023-12-22T10:01:28.897 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-22T10:01:28.897 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-12-22T10:01:28.897 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-12-22T10:01:28.897 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-22T10:01:28.897 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-22T10:01:28.897 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:28.897 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:28.897 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.2", 2023-12-22T10:01:28.897 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQARXoVlCVgtHBAACxKO/3tVUdVowe/c+cOF+w==", 2023-12-22T10:01:28.898 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-22T10:01:28.898 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-12-22T10:01:28.898 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-12-22T10:01:28.898 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-22T10:01:28.898 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-22T10:01:28.898 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:28.898 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:28.898 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.3", 2023-12-22T10:01:28.898 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAVXoVlSl5mCxAAYUAAa9xI4bFitu8+eGp+vg==", 2023-12-22T10:01:28.898 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-22T10:01:28.898 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-12-22T10:01:28.898 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-12-22T10:01:28.898 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-22T10:01:28.899 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-22T10:01:28.899 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:28.899 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:28.899 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.4", 2023-12-22T10:01:28.899 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAcXoVl38KFGhAA9u2gcU9/rvZwg6kRF0sdXA==", 2023-12-22T10:01:28.899 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-22T10:01:28.899 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-12-22T10:01:28.899 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-12-22T10:01:28.899 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-22T10:01:28.899 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-22T10:01:28.900 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:28.900 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:28.900 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.5", 2023-12-22T10:01:28.900 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAgXoVloe3UCBAAlI19r9B60/VgkTbKmRJ77g==", 2023-12-22T10:01:28.900 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-22T10:01:28.900 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-12-22T10:01:28.900 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-12-22T10:01:28.900 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-22T10:01:28.900 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-22T10:01:28.900 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:28.900 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:28.900 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.6", 2023-12-22T10:01:28.901 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAjXoVlVgFaNBAAIjAa/m8tbt0y256h+NvA4Q==", 2023-12-22T10:01:28.901 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-22T10:01:28.901 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-12-22T10:01:28.901 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-12-22T10:01:28.901 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-22T10:01:28.901 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-22T10:01:28.901 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:28.901 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:28.901 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.7", 2023-12-22T10:01:28.901 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAnXoVlZOR/IhAAlnxdbjYLlrLtXfP3mPu0dw==", 2023-12-22T10:01:28.901 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-22T10:01:28.901 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-12-22T10:01:28.902 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-12-22T10:01:28.902 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-22T10:01:28.902 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-22T10:01:28.902 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:28.902 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:28.902 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.0", 2023-12-22T10:01:28.902 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAIXoVl5rrdGRAAyhekUq4nON03SOMbtnxU0w==", 2023-12-22T10:01:28.902 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-22T10:01:28.902 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-12-22T10:01:28.902 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow r", 2023-12-22T10:01:28.902 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow rw", 2023-12-22T10:01:28.902 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rwx" 2023-12-22T10:01:28.902 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-22T10:01:28.902 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:28.902 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:28.903 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.1", 2023-12-22T10:01:28.903 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAIXoVlWoihJBAAmHWLfHGqngUrp6ezLgDb/Q==", 2023-12-22T10:01:28.903 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-22T10:01:28.903 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-12-22T10:01:28.903 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow r", 2023-12-22T10:01:28.903 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow rw", 2023-12-22T10:01:28.903 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rwx" 2023-12-22T10:01:28.903 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-22T10:01:28.903 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:28.903 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:28.904 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.2", 2023-12-22T10:01:28.905 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAIXoVlW9EnHxAAjfP6mm3JJRqZTWF6fc8vWA==", 2023-12-22T10:01:28.905 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-22T10:01:28.905 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-12-22T10:01:28.905 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow r", 2023-12-22T10:01:28.905 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow rw", 2023-12-22T10:01:28.905 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rwx" 2023-12-22T10:01:28.905 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-22T10:01:28.905 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:28.905 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:28.905 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.3", 2023-12-22T10:01:28.905 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAIXoVlOCbgKRAAL+EeTyy93asMce+2PSmB0w==", 2023-12-22T10:01:28.905 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-22T10:01:28.905 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-12-22T10:01:28.905 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow r", 2023-12-22T10:01:28.906 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow rw", 2023-12-22T10:01:28.906 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rwx" 2023-12-22T10:01:28.906 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-22T10:01:28.906 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:28.906 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:28.906 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.admin", 2023-12-22T10:01:28.906 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAHXoVlc9QzCRAANcOJe8a00dQsJbgpyWTWlQ==", 2023-12-22T10:01:28.906 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-22T10:01:28.906 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-12-22T10:01:28.906 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-12-22T10:01:28.906 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-12-22T10:01:28.906 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-22T10:01:28.906 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-22T10:01:28.906 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:28.907 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:28.907 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.bootstrap-mds", 2023-12-22T10:01:28.907 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAvXoVlRUCnABAAG3vzsZ5SBcfvSiTaIYkE4g==", 2023-12-22T10:01:28.907 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-22T10:01:28.907 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile bootstrap-mds" 2023-12-22T10:01:28.907 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-22T10:01:28.907 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:28.908 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:28.908 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.bootstrap-mgr", 2023-12-22T10:01:28.908 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAvXoVlgF2nABAAzgkgdmEvyREYLOBJ1AagCg==", 2023-12-22T10:01:28.908 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-22T10:01:28.908 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile bootstrap-mgr" 2023-12-22T10:01:28.908 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-22T10:01:28.908 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:28.908 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:28.908 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.bootstrap-osd", 2023-12-22T10:01:28.908 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAvXoVlbnWnABAAuge3X8EbNYvZc09NsClgHg==", 2023-12-22T10:01:28.908 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-22T10:01:28.908 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile bootstrap-osd" 2023-12-22T10:01:28.908 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-22T10:01:28.908 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:28.908 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:28.909 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.bootstrap-rbd", 2023-12-22T10:01:28.909 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAvXoVlR42nABAAoeLMAvGrb+lmsteVx64XeQ==", 2023-12-22T10:01:28.909 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-22T10:01:28.909 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile bootstrap-rbd" 2023-12-22T10:01:28.909 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-22T10:01:28.909 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:28.909 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:28.909 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-12-22T10:01:28.909 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAvXoVltaSnABAA8dBTvKO8tYerIrjjW7jIDg==", 2023-12-22T10:01:28.909 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-22T10:01:28.909 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-12-22T10:01:28.909 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-22T10:01:28.909 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:28.910 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:28.910 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.bootstrap-rgw", 2023-12-22T10:01:28.910 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAvXoVlDLmnABAAfR1lDsuCjxMkCGvxNm/g2Q==", 2023-12-22T10:01:28.910 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-22T10:01:28.910 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile bootstrap-rgw" 2023-12-22T10:01:28.910 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-22T10:01:28.910 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:28.910 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:28.910 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mgr.x", 2023-12-22T10:01:28.910 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAHXoVlwlHvLBAAR/rp51Gi4gA94bQfB9/+EA==", 2023-12-22T10:01:28.910 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-22T10:01:28.910 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-12-22T10:01:28.910 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile mgr", 2023-12-22T10:01:28.910 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-22T10:01:28.911 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-22T10:01:28.911 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:28.911 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:28.911 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mgr.y", 2023-12-22T10:01:28.911 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAHXoVlZcGGJRAAxSVvfqKMEi08ilZlO7XowQ==", 2023-12-22T10:01:28.911 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-22T10:01:28.911 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-12-22T10:01:28.911 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile mgr", 2023-12-22T10:01:28.911 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-22T10:01:28.911 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-22T10:01:28.911 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-22T10:01:28.911 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-12-22T10:01:28.911 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-22T10:01:28.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:28.896+0000 7fbc935a9700 1 -- 172.21.15.45:0/2113626081 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fbc7005a510 msgr2=0x7fbc7005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:28.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:28.896+0000 7fbc935a9700 1 --2- 172.21.15.45:0/2113626081 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fbc7005a510 0x7fbc7005c9d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7fbc88009130 tx=0x7fbc88017000).stop 2023-12-22T10:01:28.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:28.896+0000 7fbc935a9700 1 -- 172.21.15.45:0/2113626081 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc8c1581f0 msgr2=0x7fbc8c0beff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:28.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:28.896+0000 7fbc935a9700 1 --2- 172.21.15.45:0/2113626081 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc8c1581f0 0x7fbc8c0beff0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7fbc8400a380 tx=0x7fbc84007900).stop 2023-12-22T10:01:28.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:28.896+0000 7fbc935a9700 1 -- 172.21.15.45:0/2113626081 shutdown_connections 2023-12-22T10:01:28.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:28.896+0000 7fbc935a9700 1 --2- 172.21.15.45:0/2113626081 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc8c1581f0 0x7fbc8c0beff0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:28.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:28.896+0000 7fbc935a9700 1 --2- 172.21.15.45:0/2113626081 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbc8c157e10 0x7fbc8c152aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:28.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:28.896+0000 7fbc935a9700 1 --2- 172.21.15.45:0/2113626081 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fbc7005a510 0x7fbc7005c9d0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:28.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:28.896+0000 7fbc935a9700 1 --2- 172.21.15.45:0/2113626081 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fbc8c0c3080 0x7fbc8c0c7000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:28.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:28.896+0000 7fbc935a9700 1 -- 172.21.15.45:0/2113626081 >> 172.21.15.45:0/2113626081 conn(0x7fbc8c066a70 msgr2=0x7fbc8c154a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:28.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:28.896+0000 7fbc935a9700 1 -- 172.21.15.45:0/2113626081 shutdown_connections 2023-12-22T10:01:28.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:28.896+0000 7fbc935a9700 1 -- 172.21.15.45:0/2113626081 wait complete. 2023-12-22T10:01:28.917 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-12-22T10:01:29.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.084+0000 7ffa0565b700 1 Processor -- start 2023-12-22T10:01:29.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.084+0000 7ffa0565b700 1 -- start start 2023-12-22T10:01:29.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.088+0000 7ffa0565b700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7ffa00153870 0x7ffa00158070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:29.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.088+0000 7ffa0565b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ffa00153c50 0x7ffa000c7460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:29.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.088+0000 7ffa0565b700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa000aa690 con 0x7ffa000ca680 2023-12-22T10:01:29.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.088+0000 7ffa0565b700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa000c59d0 con 0x7ffa00153c50 2023-12-22T10:01:29.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.088+0000 7ffa0565b700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa00157620 con 0x7ffa00153870 2023-12-22T10:01:29.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.088+0000 7ff9ff7fe700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ffa00153c50 0x7ffa000c7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:29.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.088+0000 7ff9feffd700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7ffa00153870 0x7ffa00158070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:29.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.088+0000 7ff9ff7fe700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ffa00153c50 0x7ffa000c7460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34856/0 (socket says 172.21.15.45:34856) 2023-12-22T10:01:29.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.088+0000 7ff9feffd700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7ffa00153870 0x7ffa00158070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.45:33334/0 (socket says 172.21.15.45:33334) 2023-12-22T10:01:29.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.088+0000 7ff9ff7fe700 1 -- 172.21.15.45:0/471135407 learned_addr learned my addr 172.21.15.45:0/471135407 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:29.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.088+0000 7ff9ff7fe700 1 -- 172.21.15.45:0/471135407 >> v2:172.21.15.113:3300/0 conn(0x7ffa00153870 msgr2=0x7ffa00158070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:29.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.088+0000 7ff9ff7fe700 1 --2- 172.21.15.45:0/471135407 >> v2:172.21.15.113:3300/0 conn(0x7ffa00153870 0x7ffa00158070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:29.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.092+0000 7ff9ff7fe700 1 -- 172.21.15.45:0/471135407 >> v1:172.21.15.113:6789/0 conn(0x7ffa000ca680 legacy=0x7ffa000c5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:29.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.092+0000 7ff9ff7fe700 1 -- 172.21.15.45:0/471135407 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa00157be0 con 0x7ffa00153c50 2023-12-22T10:01:29.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.092+0000 7ff9feffd700 1 --2- 172.21.15.45:0/471135407 >> v2:172.21.15.113:3300/0 conn(0x7ffa00153870 0x7ffa00158070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-12-22T10:01:29.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.092+0000 7ff9ff7fe700 1 --2- 172.21.15.45:0/471135407 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa00153c50 0x7ffa000c7460 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7ffa00083d50 tx=0x7ff9f8009840).ready entity=mon.0 client_cookie=d4721eebced31ea0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:29.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.092+0000 7ff9fdffb700 1 -- 172.21.15.45:0/471135407 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f800e070 con 0x7ffa00153c50 2023-12-22T10:01:29.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.092+0000 7ff9fdffb700 1 -- 172.21.15.45:0/471135407 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9f800bab0 con 0x7ffa00153c50 2023-12-22T10:01:29.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.092+0000 7ff9fdffb700 1 -- 172.21.15.45:0/471135407 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f800be30 con 0x7ffa00153c50 2023-12-22T10:01:29.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.092+0000 7ffa0565b700 1 -- 172.21.15.45:0/471135407 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa00153c50 msgr2=0x7ffa000c7460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:29.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.092+0000 7ffa0565b700 1 --2- 172.21.15.45:0/471135407 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa00153c50 0x7ffa000c7460 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7ffa00083d50 tx=0x7ff9f8009840).stop 2023-12-22T10:01:29.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.092+0000 7ffa0565b700 1 -- 172.21.15.45:0/471135407 shutdown_connections 2023-12-22T10:01:29.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.092+0000 7ffa0565b700 1 --2- 172.21.15.45:0/471135407 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa00153c50 0x7ffa000c7460 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:29.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.092+0000 7ffa0565b700 1 --2- 172.21.15.45:0/471135407 >> v2:172.21.15.113:3300/0 conn(0x7ffa00153870 0x7ffa00158070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:29.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.092+0000 7ffa0565b700 1 -- 172.21.15.45:0/471135407 >> 172.21.15.45:0/471135407 conn(0x7ffa00082a80 msgr2=0x7ffa00066a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:29.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.092+0000 7ffa0565b700 1 -- 172.21.15.45:0/471135407 shutdown_connections 2023-12-22T10:01:29.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.092+0000 7ffa0565b700 1 -- 172.21.15.45:0/471135407 wait complete. 2023-12-22T10:01:29.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.096+0000 7ffa0565b700 1 Processor -- start 2023-12-22T10:01:29.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.096+0000 7ffa0565b700 1 -- start start 2023-12-22T10:01:29.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.096+0000 7ffa0565b700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffa00153870 0x7ffa00164b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:29.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.096+0000 7ffa0565b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa00153c50 0x7ffa000b0020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:29.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.096+0000 7ffa0565b700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ffa001561e0 0x7ffa0014e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:29.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.096+0000 7ffa0565b700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa000b0850 con 0x7ffa00153c50 2023-12-22T10:01:29.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.096+0000 7ffa0565b700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa00155420 con 0x7ffa00153870 2023-12-22T10:01:29.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.096+0000 7ffa0565b700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa00155700 con 0x7ffa001561e0 2023-12-22T10:01:29.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.096+0000 7ff9fe7fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa00153c50 0x7ffa000b0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:29.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.096+0000 7ff9feffd700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffa00153870 0x7ffa00164b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:29.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.096+0000 7ff9fe7fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa00153c50 0x7ffa000b0020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34862/0 (socket says 172.21.15.45:34862) 2023-12-22T10:01:29.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.096+0000 7ff9fe7fc700 1 -- 172.21.15.45:0/532828899 learned_addr learned my addr 172.21.15.45:0/532828899 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:29.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.100+0000 7ff9ff7fe700 1 --2- 172.21.15.45:0/532828899 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ffa001561e0 0x7ffa0014e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:29.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.100+0000 7ff9feffd700 1 -- 172.21.15.45:0/532828899 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ffa001561e0 msgr2=0x7ffa0014e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:29.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.100+0000 7ff9feffd700 1 --2- 172.21.15.45:0/532828899 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ffa001561e0 0x7ffa0014e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:29.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.100+0000 7ff9feffd700 1 -- 172.21.15.45:0/532828899 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa00153c50 msgr2=0x7ffa000b0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:29.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.100+0000 7ff9feffd700 1 --2- 172.21.15.45:0/532828899 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa00153c50 0x7ffa000b0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:29.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.100+0000 7ff9feffd700 1 -- 172.21.15.45:0/532828899 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9f00092a0 con 0x7ffa00153870 2023-12-22T10:01:29.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.100+0000 7ff9fe7fc700 1 --2- 172.21.15.45:0/532828899 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa00153c50 0x7ffa000b0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-12-22T10:01:29.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.100+0000 7ff9feffd700 1 --2- 172.21.15.45:0/532828899 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffa00153870 0x7ffa00164b20 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7ff9f000e980 tx=0x7ff9f0009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:29.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.100+0000 7ff9e6ffd700 1 -- 172.21.15.45:0/532828899 <== mon.1 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f0012600 con 0x7ffa00153870 2023-12-22T10:01:29.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.100+0000 7ff9e6ffd700 1 -- 172.21.15.45:0/532828899 <== mon.1 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9f0012760 con 0x7ffa00153870 2023-12-22T10:01:29.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.100+0000 7ffa0565b700 1 -- 172.21.15.45:0/532828899 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9f8009ae0 con 0x7ffa00153870 2023-12-22T10:01:29.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.100+0000 7ff9e6ffd700 1 -- 172.21.15.45:0/532828899 <== mon.1 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f0012ae0 con 0x7ffa00153870 2023-12-22T10:01:29.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.100+0000 7ffa0565b700 1 -- 172.21.15.45:0/532828899 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa00155cc0 con 0x7ffa00153870 2023-12-22T10:01:29.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.100+0000 7ffa0565b700 1 -- 172.21.15.45:0/532828899 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa0006c070 con 0x7ffa00153870 2023-12-22T10:01:29.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.104+0000 7ff9e6ffd700 1 -- 172.21.15.45:0/532828899 <== mon.1 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7ff9f001b400 con 0x7ffa00153870 2023-12-22T10:01:29.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.104+0000 7ff9e6ffd700 1 --2- 172.21.15.45:0/532828899 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7ff9ec05a510 0x7ff9ec05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:29.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.104+0000 7ff9e6ffd700 1 -- 172.21.15.45:0/532828899 <== mon.1 v2:172.21.15.113:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5269+0+0 (secure 0 0 0) 0x7ff9f00749e0 con 0x7ffa00153870 2023-12-22T10:01:29.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.104+0000 7ff9fe7fc700 1 --2- 172.21.15.45:0/532828899 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7ff9ec05a510 0x7ff9ec05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:29.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.108+0000 7ff9fe7fc700 1 --2- 172.21.15.45:0/532828899 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7ff9ec05a510 0x7ff9ec05c9d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7ffa000aa0a0 tx=0x7ff9f4009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:29.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.112+0000 7ff9e6ffd700 1 -- 172.21.15.45:0/532828899 <== mon.1 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff9f00483f0 con 0x7ffa00153870 2023-12-22T10:01:29.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.332+0000 7ffa0565b700 1 -- 172.21.15.45:0/532828899 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7ffa0005f2c0 con 0x7ffa00153870 2023-12-22T10:01:29.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.344+0000 7ff9e6ffd700 1 -- 172.21.15.45:0/532828899 <== mon.1 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 updated v7) v1 ==== 97+0+0 (secure 0 0 0) 0x7ff9f0016070 con 0x7ffa00153870 2023-12-22T10:01:29.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.348+0000 7ffa0565b700 1 -- 172.21.15.45:0/532828899 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7ff9ec05a510 msgr2=0x7ff9ec05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:29.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.348+0000 7ffa0565b700 1 --2- 172.21.15.45:0/532828899 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7ff9ec05a510 0x7ff9ec05c9d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7ffa000aa0a0 tx=0x7ff9f4009040).stop 2023-12-22T10:01:29.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.348+0000 7ffa0565b700 1 -- 172.21.15.45:0/532828899 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffa00153870 msgr2=0x7ffa00164b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:29.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.348+0000 7ffa0565b700 1 --2- 172.21.15.45:0/532828899 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffa00153870 0x7ffa00164b20 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7ff9f000e980 tx=0x7ff9f0009060).stop 2023-12-22T10:01:29.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.348+0000 7ffa0565b700 1 -- 172.21.15.45:0/532828899 shutdown_connections 2023-12-22T10:01:29.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.348+0000 7ffa0565b700 1 --2- 172.21.15.45:0/532828899 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7ff9ec05a510 0x7ff9ec05c9d0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:29.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.348+0000 7ffa0565b700 1 --2- 172.21.15.45:0/532828899 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ffa001561e0 0x7ffa0014e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:29.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.348+0000 7ffa0565b700 1 --2- 172.21.15.45:0/532828899 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa00153c50 0x7ffa000b0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:29.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.348+0000 7ffa0565b700 1 --2- 172.21.15.45:0/532828899 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffa00153870 0x7ffa00164b20 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:29.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.348+0000 7ffa0565b700 1 -- 172.21.15.45:0/532828899 >> 172.21.15.45:0/532828899 conn(0x7ffa00082a80 msgr2=0x7ffa000c7460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:29.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.348+0000 7ffa0565b700 1 -- 172.21.15.45:0/532828899 shutdown_connections 2023-12-22T10:01:29.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.348+0000 7ffa0565b700 1 -- 172.21.15.45:0/532828899 wait complete. 2023-12-22T10:01:29.349 INFO:teuthology.orchestra.run.smithi045.stderr:updated 2023-12-22T10:01:29.367 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-12-22T10:01:29.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.532+0000 7f4eceb47700 1 Processor -- start 2023-12-22T10:01:29.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.532+0000 7f4eceb47700 1 -- start start 2023-12-22T10:01:29.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.532+0000 7f4eceb47700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f4ec8062a40 0x7f4ec80c7840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:29.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.532+0000 7f4eceb47700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ec80bc5b0 con 0x7f4ec80bda50 2023-12-22T10:01:29.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.532+0000 7f4eceb47700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ec80c42b0 con 0x7f4ec80c7460 2023-12-22T10:01:29.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.532+0000 7f4eceb47700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec80c4db0 con 0x7f4ec8062a40 2023-12-22T10:01:29.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.532+0000 7f4ece346700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f4ec80bda50 0x7f4ec80c7d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:41236/0 (socket says 172.21.15.45:41236) 2023-12-22T10:01:29.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.532+0000 7f4ece346700 1 -- 172.21.15.45:0/1434695531 learned_addr learned my addr 172.21.15.45:0/1434695531 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:01:29.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.532+0000 7f4ecd344700 1 --2- 172.21.15.45:0/1434695531 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f4ec8062a40 0x7f4ec80c7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:29.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.536+0000 7f4eccb43700 1 -- 172.21.15.45:0/1434695531 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3538065590 0 0) 0x7f4ec80bc5b0 con 0x7f4ec80bda50 2023-12-22T10:01:29.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.536+0000 7f4eccb43700 1 -- 172.21.15.45:0/1434695531 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4eb40033f0 con 0x7f4ec80bda50 2023-12-22T10:01:29.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.536+0000 7f4ecd344700 1 -- 172.21.15.45:0/1434695531 >> v1:172.21.15.113:6789/0 conn(0x7f4ec80c7460 legacy=0x7f4ec80c3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:29.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.536+0000 7f4ecd344700 1 -- 172.21.15.45:0/1434695531 >> v1:172.21.15.45:6789/0 conn(0x7f4ec80bda50 legacy=0x7f4ec80c7d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:29.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.536+0000 7f4ecd344700 1 -- 172.21.15.45:0/1434695531 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ec80c4510 con 0x7f4ec8062a40 2023-12-22T10:01:29.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.536+0000 7f4ecd344700 1 --2- 172.21.15.45:0/1434695531 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f4ec8062a40 0x7f4ec80c7840 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f4eb8009790 tx=0x7f4eb8009060).ready entity=mon.2 client_cookie=c658ea38d591f9c6 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:29.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.536+0000 7f4eccb43700 1 -- 172.21.15.45:0/1434695531 <== mon.2 v2:172.21.15.113:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb800f510 con 0x7f4ec8062a40 2023-12-22T10:01:29.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.536+0000 7f4eccb43700 1 -- 172.21.15.45:0/1434695531 <== mon.2 v2:172.21.15.113:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4eb800f670 con 0x7f4ec8062a40 2023-12-22T10:01:29.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.536+0000 7f4eccb43700 1 -- 172.21.15.45:0/1434695531 <== mon.2 v2:172.21.15.113:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb800f9f0 con 0x7f4ec8062a40 2023-12-22T10:01:29.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.536+0000 7f4eceb47700 1 -- 172.21.15.45:0/1434695531 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f4ec8062a40 msgr2=0x7f4ec80c7840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:29.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.536+0000 7f4eceb47700 1 --2- 172.21.15.45:0/1434695531 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f4ec8062a40 0x7f4ec80c7840 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f4eb8009790 tx=0x7f4eb8009060).stop 2023-12-22T10:01:29.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.536+0000 7f4eceb47700 1 -- 172.21.15.45:0/1434695531 shutdown_connections 2023-12-22T10:01:29.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.536+0000 7f4eceb47700 1 --2- 172.21.15.45:0/1434695531 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f4ec8062a40 0x7f4ec80c7840 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:29.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.536+0000 7f4eceb47700 1 -- 172.21.15.45:0/1434695531 >> 172.21.15.45:0/1434695531 conn(0x7f4ec8068610 msgr2=0x7f4ec8062230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:29.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.540+0000 7f4eceb47700 1 -- 172.21.15.45:0/1434695531 shutdown_connections 2023-12-22T10:01:29.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.540+0000 7f4eceb47700 1 -- 172.21.15.45:0/1434695531 wait complete. 2023-12-22T10:01:29.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.540+0000 7f4eceb47700 1 Processor -- start 2023-12-22T10:01:29.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.540+0000 7f4eceb47700 1 -- start start 2023-12-22T10:01:29.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.544+0000 7f4eceb47700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ec8062a40 0x7f4ec8144f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:29.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.544+0000 7f4eceb47700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f4ec80bda50 0x7f4ec80c6850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:29.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.544+0000 7f4eceb47700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4ec80c7460 0x7f4ec80c6d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:29.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.544+0000 7f4eceb47700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec80c7230 con 0x7f4ec8062a40 2023-12-22T10:01:29.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.544+0000 7f4eceb47700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec80c0790 con 0x7f4ec80c7460 2023-12-22T10:01:29.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.544+0000 7f4eceb47700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec80c09e0 con 0x7f4ec80bda50 2023-12-22T10:01:29.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.544+0000 7f4ecdb45700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ec8062a40 0x7f4ec8144f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:29.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.544+0000 7f4ecdb45700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ec8062a40 0x7f4ec8144f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34874/0 (socket says 172.21.15.45:34874) 2023-12-22T10:01:29.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.544+0000 7f4ecdb45700 1 -- 172.21.15.45:0/2686035636 learned_addr learned my addr 172.21.15.45:0/2686035636 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:29.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.544+0000 7f4ece346700 1 --2- 172.21.15.45:0/2686035636 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4ec80c7460 0x7f4ec80c6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:29.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.544+0000 7f4ecd344700 1 --2- 172.21.15.45:0/2686035636 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f4ec80bda50 0x7f4ec80c6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:29.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.544+0000 7f4ecdb45700 1 -- 172.21.15.45:0/2686035636 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f4ec80bda50 msgr2=0x7f4ec80c6850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:29.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.544+0000 7f4ecdb45700 1 --2- 172.21.15.45:0/2686035636 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f4ec80bda50 0x7f4ec80c6850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:29.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.544+0000 7f4ecdb45700 1 -- 172.21.15.45:0/2686035636 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4ec80c7460 msgr2=0x7f4ec80c6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:29.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.544+0000 7f4ecdb45700 1 --2- 172.21.15.45:0/2686035636 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4ec80c7460 0x7f4ec80c6d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:29.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.544+0000 7f4ecdb45700 1 -- 172.21.15.45:0/2686035636 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eb80092a0 con 0x7f4ec8062a40 2023-12-22T10:01:29.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.544+0000 7f4ece346700 1 --2- 172.21.15.45:0/2686035636 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4ec80c7460 0x7f4ec80c6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T10:01:29.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.544+0000 7f4ecdb45700 1 --2- 172.21.15.45:0/2686035636 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ec8062a40 0x7f4ec8144f00 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7f4ec400c4c0 tx=0x7f4ec4007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:29.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.544+0000 7f4ebdffb700 1 -- 172.21.15.45:0/2686035636 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec4007020 con 0x7f4ec8062a40 2023-12-22T10:01:29.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.544+0000 7f4ebdffb700 1 -- 172.21.15.45:0/2686035636 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ec4001e90 con 0x7f4ec8062a40 2023-12-22T10:01:29.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.544+0000 7f4eceb47700 1 -- 172.21.15.45:0/2686035636 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ec80c0cc0 con 0x7f4ec8062a40 2023-12-22T10:01:29.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.544+0000 7f4ebdffb700 1 -- 172.21.15.45:0/2686035636 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec40073d0 con 0x7f4ec8062a40 2023-12-22T10:01:29.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.548+0000 7f4eceb47700 1 -- 172.21.15.45:0/2686035636 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ec80c1300 con 0x7f4ec8062a40 2023-12-22T10:01:29.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.548+0000 7f4eceb47700 1 -- 172.21.15.45:0/2686035636 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ec8047060 con 0x7f4ec8062a40 2023-12-22T10:01:29.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.548+0000 7f4ebdffb700 1 -- 172.21.15.45:0/2686035636 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f4ec40068b0 con 0x7f4ec8062a40 2023-12-22T10:01:29.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.552+0000 7f4ebdffb700 1 --2- 172.21.15.45:0/2686035636 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f4eac05a510 0x7f4eac05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:29.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.552+0000 7f4ebdffb700 1 -- 172.21.15.45:0/2686035636 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f4ec4073e20 con 0x7f4ec8062a40 2023-12-22T10:01:29.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.552+0000 7f4ecd344700 1 --2- 172.21.15.45:0/2686035636 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f4eac05a510 0x7f4eac05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:29.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.552+0000 7f4ecd344700 1 --2- 172.21.15.45:0/2686035636 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f4eac05a510 0x7f4eac05c9d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f4ec8062e20 tx=0x7f4eb8017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:29.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.560+0000 7f4ebdffb700 1 -- 172.21.15.45:0/2686035636 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f4ec4047890 con 0x7f4ec8062a40 2023-12-22T10:01:29.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.780+0000 7f4eceb47700 1 -- 172.21.15.45:0/2686035636 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f4ec805e670 con 0x7f4ec8062a40 2023-12-22T10:01:29.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.788+0000 7f4ebdffb700 1 -- 172.21.15.45:0/2686035636 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 updated v8) v1 ==== 97+0+0 (secure 0 0 0) 0x7f4ec404aeb0 con 0x7f4ec8062a40 2023-12-22T10:01:29.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.792+0000 7f4eceb47700 1 -- 172.21.15.45:0/2686035636 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f4eac05a510 msgr2=0x7f4eac05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:29.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.792+0000 7f4eceb47700 1 --2- 172.21.15.45:0/2686035636 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f4eac05a510 0x7f4eac05c9d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f4ec8062e20 tx=0x7f4eb8017000).stop 2023-12-22T10:01:29.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.792+0000 7f4eceb47700 1 -- 172.21.15.45:0/2686035636 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ec8062a40 msgr2=0x7f4ec8144f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:29.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.792+0000 7f4eceb47700 1 --2- 172.21.15.45:0/2686035636 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ec8062a40 0x7f4ec8144f00 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7f4ec400c4c0 tx=0x7f4ec4007e00).stop 2023-12-22T10:01:29.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.792+0000 7f4eceb47700 1 -- 172.21.15.45:0/2686035636 shutdown_connections 2023-12-22T10:01:29.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.792+0000 7f4eceb47700 1 --2- 172.21.15.45:0/2686035636 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4ec80c7460 0x7f4ec80c6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:29.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.792+0000 7f4eceb47700 1 --2- 172.21.15.45:0/2686035636 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f4eac05a510 0x7f4eac05c9d0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:29.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.792+0000 7f4eceb47700 1 --2- 172.21.15.45:0/2686035636 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f4ec80bda50 0x7f4ec80c6850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:29.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.792+0000 7f4eceb47700 1 --2- 172.21.15.45:0/2686035636 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ec8062a40 0x7f4ec8144f00 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:29.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.792+0000 7f4eceb47700 1 -- 172.21.15.45:0/2686035636 >> 172.21.15.45:0/2686035636 conn(0x7f4ec8068610 msgr2=0x7f4ec814e800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:29.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.792+0000 7f4eceb47700 1 -- 172.21.15.45:0/2686035636 shutdown_connections 2023-12-22T10:01:29.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:29.792+0000 7f4eceb47700 1 -- 172.21.15.45:0/2686035636 wait complete. 2023-12-22T10:01:29.794 INFO:teuthology.orchestra.run.smithi045.stderr:updated 2023-12-22T10:01:29.815 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-12-22T10:01:29.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.000+0000 7f189fda9700 1 Processor -- start 2023-12-22T10:01:29.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.000+0000 7f189fda9700 1 -- start start 2023-12-22T10:01:30.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.004+0000 7f189fda9700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1898157e10 0x7f18980c1820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:30.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.004+0000 7f189fda9700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f18981581f0 0x7f18980c1d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:30.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.004+0000 7f189fda9700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f18980c3080 0x7f18980c3530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:30.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.004+0000 7f189fda9700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18980a68b0 con 0x7f18981581f0 2023-12-22T10:01:30.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.004+0000 7f189fda9700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1898065610 con 0x7f1898157e10 2023-12-22T10:01:30.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.004+0000 7f189fda9700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18980658f0 con 0x7f18980c3080 2023-12-22T10:01:30.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.004+0000 7f189d344700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f18981581f0 0x7f18980c1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:30.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.004+0000 7f189d344700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f18981581f0 0x7f18980c1d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34882/0 (socket says 172.21.15.45:34882) 2023-12-22T10:01:30.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.004+0000 7f189d344700 1 -- 172.21.15.45:0/3403053244 learned_addr learned my addr 172.21.15.45:0/3403053244 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:30.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.004+0000 7f189db45700 1 --2- 172.21.15.45:0/3403053244 >> v2:172.21.15.113:3300/0 conn(0x7f1898157e10 0x7f18980c1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:30.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.004+0000 7f189e346700 1 --2- 172.21.15.45:0/3403053244 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f18980c3080 0x7f18980c3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:30.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.004+0000 7f189db45700 1 -- 172.21.15.45:0/3403053244 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f18980c3080 msgr2=0x7f18980c3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:30.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.004+0000 7f189db45700 1 --2- 172.21.15.45:0/3403053244 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f18980c3080 0x7f18980c3530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:30.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.004+0000 7f189db45700 1 -- 172.21.15.45:0/3403053244 >> v2:172.21.15.45:3300/0 conn(0x7f18981581f0 msgr2=0x7f18980c1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:30.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.004+0000 7f189db45700 1 --2- 172.21.15.45:0/3403053244 >> v2:172.21.15.45:3300/0 conn(0x7f18981581f0 0x7f18980c1d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:30.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.004+0000 7f189db45700 1 -- 172.21.15.45:0/3403053244 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1898065bd0 con 0x7f1898157e10 2023-12-22T10:01:30.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.004+0000 7f189d344700 1 --2- 172.21.15.45:0/3403053244 >> v2:172.21.15.45:3300/0 conn(0x7f18981581f0 0x7f18980c1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-12-22T10:01:30.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.004+0000 7f189db45700 1 --2- 172.21.15.45:0/3403053244 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1898157e10 0x7f18980c1820 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f18980639e0 tx=0x7f1894009060).ready entity=mon.1 client_cookie=141e0b91b09b647e server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:30.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.004+0000 7f189cb43700 1 -- 172.21.15.45:0/3403053244 <== mon.1 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f189400d4a0 con 0x7f1898157e10 2023-12-22T10:01:30.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.004+0000 7f189cb43700 1 -- 172.21.15.45:0/3403053244 <== mon.1 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f189400d600 con 0x7f1898157e10 2023-12-22T10:01:30.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.004+0000 7f189cb43700 1 -- 172.21.15.45:0/3403053244 <== mon.1 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f189400d980 con 0x7f1898157e10 2023-12-22T10:01:30.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.008+0000 7f189fda9700 1 -- 172.21.15.45:0/3403053244 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1898157e10 msgr2=0x7f18980c1820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:30.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.008+0000 7f189fda9700 1 --2- 172.21.15.45:0/3403053244 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1898157e10 0x7f18980c1820 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f18980639e0 tx=0x7f1894009060).stop 2023-12-22T10:01:30.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.008+0000 7f189fda9700 1 -- 172.21.15.45:0/3403053244 shutdown_connections 2023-12-22T10:01:30.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.008+0000 7f189fda9700 1 --2- 172.21.15.45:0/3403053244 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f18980c3080 0x7f18980c3530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:30.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.008+0000 7f189fda9700 1 --2- 172.21.15.45:0/3403053244 >> v2:172.21.15.45:3300/0 conn(0x7f18981581f0 0x7f18980c1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:30.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.008+0000 7f189fda9700 1 --2- 172.21.15.45:0/3403053244 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1898157e10 0x7f18980c1820 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:30.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.008+0000 7f189fda9700 1 -- 172.21.15.45:0/3403053244 >> 172.21.15.45:0/3403053244 conn(0x7f1898066a70 msgr2=0x7f1898066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:30.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.008+0000 7f189fda9700 1 -- 172.21.15.45:0/3403053244 shutdown_connections 2023-12-22T10:01:30.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.008+0000 7f189fda9700 1 -- 172.21.15.45:0/3403053244 wait complete. 2023-12-22T10:01:30.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.012+0000 7f189fda9700 1 Processor -- start 2023-12-22T10:01:30.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.012+0000 7f189fda9700 1 -- start start 2023-12-22T10:01:30.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.012+0000 7f189fda9700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f18980c3080 0x7f18980bc9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:30.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.012+0000 7f189fda9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1898157e10 0x7f18980bda20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:30.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.012+0000 7f189fda9700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f18981581f0 0x7f1898146a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:30.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.012+0000 7f189fda9700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18980bc550 con 0x7f1898157e10 2023-12-22T10:01:30.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.012+0000 7f189fda9700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18980bb940 con 0x7f18981581f0 2023-12-22T10:01:30.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.012+0000 7f189fda9700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18980bbc20 con 0x7f18980c3080 2023-12-22T10:01:30.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.012+0000 7f189d344700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1898157e10 0x7f18980bda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:30.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.012+0000 7f189d344700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1898157e10 0x7f18980bda20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34886/0 (socket says 172.21.15.45:34886) 2023-12-22T10:01:30.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.012+0000 7f189d344700 1 -- 172.21.15.45:0/1171222973 learned_addr learned my addr 172.21.15.45:0/1171222973 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:30.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.012+0000 7f189db45700 1 --2- 172.21.15.45:0/1171222973 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f18980c3080 0x7f18980bc9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:30.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.012+0000 7f189e346700 1 --2- 172.21.15.45:0/1171222973 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f18981581f0 0x7f1898146a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:30.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.012+0000 7f189d344700 1 -- 172.21.15.45:0/1171222973 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f18980c3080 msgr2=0x7f18980bc9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:30.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.012+0000 7f189d344700 1 --2- 172.21.15.45:0/1171222973 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f18980c3080 0x7f18980bc9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:30.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.012+0000 7f189d344700 1 -- 172.21.15.45:0/1171222973 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f18981581f0 msgr2=0x7f1898146a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:30.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.012+0000 7f189d344700 1 --2- 172.21.15.45:0/1171222973 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f18981581f0 0x7f1898146a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:30.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.012+0000 7f189d344700 1 -- 172.21.15.45:0/1171222973 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1888009370 con 0x7f1898157e10 2023-12-22T10:01:30.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.016+0000 7f189d344700 1 --2- 172.21.15.45:0/1171222973 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1898157e10 0x7f18980bda20 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7f1888009fd0 tx=0x7f18880090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:30.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.016+0000 7f188dffb700 1 -- 172.21.15.45:0/1171222973 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1888012600 con 0x7f1898157e10 2023-12-22T10:01:30.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.016+0000 7f188dffb700 1 -- 172.21.15.45:0/1171222973 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1888012760 con 0x7f1898157e10 2023-12-22T10:01:30.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.016+0000 7f188dffb700 1 -- 172.21.15.45:0/1171222973 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1888012ae0 con 0x7f1898157e10 2023-12-22T10:01:30.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.016+0000 7f189fda9700 1 -- 172.21.15.45:0/1171222973 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18940092a0 con 0x7f1898157e10 2023-12-22T10:01:30.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.016+0000 7f189fda9700 1 -- 172.21.15.45:0/1171222973 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18980bc1e0 con 0x7f1898157e10 2023-12-22T10:01:30.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.016+0000 7f189fda9700 1 -- 172.21.15.45:0/1171222973 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18980bc6c0 con 0x7f1898157e10 2023-12-22T10:01:30.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.016+0000 7f188dffb700 1 -- 172.21.15.45:0/1171222973 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f188801b400 con 0x7f1898157e10 2023-12-22T10:01:30.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.020+0000 7f188dffb700 1 --2- 172.21.15.45:0/1171222973 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f187c05a510 0x7f187c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:30.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.020+0000 7f188dffb700 1 -- 172.21.15.45:0/1171222973 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f18880748d0 con 0x7f1898157e10 2023-12-22T10:01:30.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.020+0000 7f189db45700 1 --2- 172.21.15.45:0/1171222973 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f187c05a510 0x7f187c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:30.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.020+0000 7f189db45700 1 --2- 172.21.15.45:0/1171222973 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f187c05a510 0x7f187c05c9d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f189400d260 tx=0x7f1894016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:30.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.024+0000 7f188dffb700 1 -- 172.21.15.45:0/1171222973 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f18880483a0 con 0x7f1898157e10 2023-12-22T10:01:30.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.244+0000 7f189fda9700 1 -- 172.21.15.45:0/1171222973 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f18980a6b50 con 0x7f1898157e10 2023-12-22T10:01:30.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.252+0000 7f188dffb700 1 -- 172.21.15.45:0/1171222973 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 updated v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7f188804b9c0 con 0x7f1898157e10 2023-12-22T10:01:30.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.256+0000 7f189fda9700 1 -- 172.21.15.45:0/1171222973 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f187c05a510 msgr2=0x7f187c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:30.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.256+0000 7f189fda9700 1 --2- 172.21.15.45:0/1171222973 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f187c05a510 0x7f187c05c9d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f189400d260 tx=0x7f1894016000).stop 2023-12-22T10:01:30.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.256+0000 7f189fda9700 1 -- 172.21.15.45:0/1171222973 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1898157e10 msgr2=0x7f18980bda20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:30.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.256+0000 7f189fda9700 1 --2- 172.21.15.45:0/1171222973 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1898157e10 0x7f18980bda20 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7f1888009fd0 tx=0x7f18880090f0).stop 2023-12-22T10:01:30.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.256+0000 7f189fda9700 1 -- 172.21.15.45:0/1171222973 shutdown_connections 2023-12-22T10:01:30.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.256+0000 7f189fda9700 1 --2- 172.21.15.45:0/1171222973 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f18981581f0 0x7f1898146a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:30.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.256+0000 7f189fda9700 1 --2- 172.21.15.45:0/1171222973 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1898157e10 0x7f18980bda20 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:30.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.256+0000 7f189fda9700 1 --2- 172.21.15.45:0/1171222973 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f187c05a510 0x7f187c05c9d0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:30.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.256+0000 7f189fda9700 1 --2- 172.21.15.45:0/1171222973 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f18980c3080 0x7f18980bc9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:30.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.256+0000 7f189fda9700 1 -- 172.21.15.45:0/1171222973 >> 172.21.15.45:0/1171222973 conn(0x7f1898066a70 msgr2=0x7f1898154920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:30.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.256+0000 7f189fda9700 1 -- 172.21.15.45:0/1171222973 shutdown_connections 2023-12-22T10:01:30.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.256+0000 7f189fda9700 1 -- 172.21.15.45:0/1171222973 wait complete. 2023-12-22T10:01:30.259 INFO:teuthology.orchestra.run.smithi045.stderr:updated 2023-12-22T10:01:30.279 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-12-22T10:01:30.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.444+0000 7f0928369700 1 Processor -- start 2023-12-22T10:01:30.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.444+0000 7f0928369700 1 -- start start 2023-12-22T10:01:30.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.448+0000 7f0928369700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f09201518f0 0x7f0920064890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:30.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.448+0000 7f0928369700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0920155740 con 0x7f0920151cd0 2023-12-22T10:01:30.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.448+0000 7f0928369700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09200a61b0 con 0x7f09200a7420 2023-12-22T10:01:30.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.448+0000 7f0928369700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09200c40f0 con 0x7f09201518f0 2023-12-22T10:01:30.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.448+0000 7f0925904700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f0920151cd0 0x7f09200a6d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:41250/0 (socket says 172.21.15.45:41250) 2023-12-22T10:01:30.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.448+0000 7f0925904700 1 -- 172.21.15.45:0/991648033 learned_addr learned my addr 172.21.15.45:0/991648033 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:01:30.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.448+0000 7f0926105700 1 --2- 172.21.15.45:0/991648033 >> v2:172.21.15.113:3300/0 conn(0x7f09201518f0 0x7f0920064890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:30.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.448+0000 7f0925103700 1 -- 172.21.15.45:0/991648033 <== mon.1 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 835751398 0 0) 0x7f09200a61b0 con 0x7f09200a7420 2023-12-22T10:01:30.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.448+0000 7f0925103700 1 -- 172.21.15.45:0/991648033 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f090c0033f0 con 0x7f09200a7420 2023-12-22T10:01:30.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.448+0000 7f0925103700 1 -- 172.21.15.45:0/991648033 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3083985244 0 0) 0x7f0920155740 con 0x7f0920151cd0 2023-12-22T10:01:30.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.448+0000 7f0925103700 1 -- 172.21.15.45:0/991648033 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09200a61b0 con 0x7f0920151cd0 2023-12-22T10:01:30.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.448+0000 7f0926105700 1 -- 172.21.15.45:0/991648033 >> v1:172.21.15.113:6789/0 conn(0x7f09200a7420 legacy=0x7f09200c3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:30.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.448+0000 7f0926105700 1 -- 172.21.15.45:0/991648033 >> v1:172.21.15.45:6789/0 conn(0x7f0920151cd0 legacy=0x7f09200a6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:30.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.448+0000 7f0926105700 1 -- 172.21.15.45:0/991648033 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09200a5910 con 0x7f09201518f0 2023-12-22T10:01:30.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.448+0000 7f0926105700 1 --2- 172.21.15.45:0/991648033 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f09201518f0 0x7f0920064890 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f091c009760 tx=0x7f091c009060).ready entity=mon.1 client_cookie=2e0469c48f66d2cd server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:30.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.448+0000 7f0925103700 1 -- 172.21.15.45:0/991648033 <== mon.1 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f091c00d4a0 con 0x7f09201518f0 2023-12-22T10:01:30.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.448+0000 7f0925103700 1 -- 172.21.15.45:0/991648033 <== mon.1 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f091c00d600 con 0x7f09201518f0 2023-12-22T10:01:30.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.448+0000 7f0925103700 1 -- 172.21.15.45:0/991648033 <== mon.1 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f091c00d980 con 0x7f09201518f0 2023-12-22T10:01:30.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.452+0000 7f0928369700 1 -- 172.21.15.45:0/991648033 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f09201518f0 msgr2=0x7f0920064890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:30.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.452+0000 7f0928369700 1 --2- 172.21.15.45:0/991648033 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f09201518f0 0x7f0920064890 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f091c009760 tx=0x7f091c009060).stop 2023-12-22T10:01:30.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.452+0000 7f0928369700 1 -- 172.21.15.45:0/991648033 shutdown_connections 2023-12-22T10:01:30.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.452+0000 7f0928369700 1 --2- 172.21.15.45:0/991648033 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f09201518f0 0x7f0920064890 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:30.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.452+0000 7f0928369700 1 -- 172.21.15.45:0/991648033 >> 172.21.15.45:0/991648033 conn(0x7f0920066a70 msgr2=0x7f0920066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:30.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.452+0000 7f0928369700 1 -- 172.21.15.45:0/991648033 shutdown_connections 2023-12-22T10:01:30.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.452+0000 7f0928369700 1 -- 172.21.15.45:0/991648033 wait complete. 2023-12-22T10:01:30.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.452+0000 7f0928369700 1 Processor -- start 2023-12-22T10:01:30.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.452+0000 7f0928369700 1 -- start start 2023-12-22T10:01:30.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.456+0000 7f0928369700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f09200a7420 0x7f09201456c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:30.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.456+0000 7f0928369700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f09201518f0 0x7f09200aa220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:30.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.456+0000 7f0928369700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0920151cd0 0x7f0920069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:30.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.456+0000 7f0928369700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f092014dd40 con 0x7f0920151cd0 2023-12-22T10:01:30.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.456+0000 7f0928369700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09200a9c30 con 0x7f09201518f0 2023-12-22T10:01:30.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.456+0000 7f0928369700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0920147fb0 con 0x7f09200a7420 2023-12-22T10:01:30.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.456+0000 7f0926906700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0920151cd0 0x7f0920069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:30.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.456+0000 7f0926906700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0920151cd0 0x7f0920069300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34896/0 (socket says 172.21.15.45:34896) 2023-12-22T10:01:30.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.456+0000 7f0925904700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f09201518f0 0x7f09200aa220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:30.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.456+0000 7f0926105700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f09200a7420 0x7f09201456c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:30.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.456+0000 7f0926906700 1 -- 172.21.15.45:0/359440232 learned_addr learned my addr 172.21.15.45:0/359440232 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:30.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.456+0000 7f0926906700 1 -- 172.21.15.45:0/359440232 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f09200a7420 msgr2=0x7f09201456c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:30.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.456+0000 7f0926906700 1 --2- 172.21.15.45:0/359440232 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f09200a7420 0x7f09201456c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:30.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.456+0000 7f0926906700 1 -- 172.21.15.45:0/359440232 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f09201518f0 msgr2=0x7f09200aa220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:30.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.456+0000 7f0926906700 1 --2- 172.21.15.45:0/359440232 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f09201518f0 0x7f09200aa220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:30.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.456+0000 7f0926906700 1 -- 172.21.15.45:0/359440232 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f091c0092a0 con 0x7f0920151cd0 2023-12-22T10:01:30.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.456+0000 7f0925904700 1 --2- 172.21.15.45:0/359440232 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f09201518f0 0x7f09200aa220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-12-22T10:01:30.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.456+0000 7f0926906700 1 --2- 172.21.15.45:0/359440232 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0920151cd0 0x7f0920069300 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7f091800c790 tx=0x7f0918007f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:30.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.456+0000 7f09167fc700 1 -- 172.21.15.45:0/359440232 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f091800e4a0 con 0x7f0920151cd0 2023-12-22T10:01:30.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.456+0000 7f09167fc700 1 -- 172.21.15.45:0/359440232 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f091800e600 con 0x7f0920151cd0 2023-12-22T10:01:30.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.456+0000 7f09167fc700 1 -- 172.21.15.45:0/359440232 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f091800e9c0 con 0x7f0920151cd0 2023-12-22T10:01:30.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.456+0000 7f0928369700 1 -- 172.21.15.45:0/359440232 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0920148290 con 0x7f0920151cd0 2023-12-22T10:01:30.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.460+0000 7f0928369700 1 -- 172.21.15.45:0/359440232 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0920145bb0 con 0x7f0920151cd0 2023-12-22T10:01:30.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.460+0000 7f0928369700 1 -- 172.21.15.45:0/359440232 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09200a94c0 con 0x7f0920151cd0 2023-12-22T10:01:30.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.460+0000 7f09167fc700 1 -- 172.21.15.45:0/359440232 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f091801b3b0 con 0x7f0920151cd0 2023-12-22T10:01:30.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.464+0000 7f09167fc700 1 --2- 172.21.15.45:0/359440232 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f090405a510 0x7f090405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:30.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.464+0000 7f09167fc700 1 -- 172.21.15.45:0/359440232 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f0918073cc0 con 0x7f0920151cd0 2023-12-22T10:01:30.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.464+0000 7f0926105700 1 --2- 172.21.15.45:0/359440232 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f090405a510 0x7f090405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:30.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.464+0000 7f0926105700 1 --2- 172.21.15.45:0/359440232 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f090405a510 0x7f090405c9d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f091c006d60 tx=0x7f091c016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:30.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.468+0000 7f09167fc700 1 -- 172.21.15.45:0/359440232 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f09200a94c0 con 0x7f0920151cd0 2023-12-22T10:01:30.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.688+0000 7f0928369700 1 -- 172.21.15.45:0/359440232 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f09200a94c0 con 0x7f0920151cd0 2023-12-22T10:01:30.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.696+0000 7f09167fc700 1 -- 172.21.15.45:0/359440232 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 updated v10) v1 ==== 97+0+0 (secure 0 0 0) 0x7f09200a94c0 con 0x7f0920151cd0 2023-12-22T10:01:30.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.704+0000 7f0928369700 1 -- 172.21.15.45:0/359440232 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f090405a510 msgr2=0x7f090405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:30.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.704+0000 7f0928369700 1 --2- 172.21.15.45:0/359440232 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f090405a510 0x7f090405c9d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f091c006d60 tx=0x7f091c016000).stop 2023-12-22T10:01:30.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.704+0000 7f0928369700 1 -- 172.21.15.45:0/359440232 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0920151cd0 msgr2=0x7f0920069300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:30.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.704+0000 7f0928369700 1 --2- 172.21.15.45:0/359440232 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0920151cd0 0x7f0920069300 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7f091800c790 tx=0x7f0918007f40).stop 2023-12-22T10:01:30.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.704+0000 7f0928369700 1 -- 172.21.15.45:0/359440232 shutdown_connections 2023-12-22T10:01:30.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.704+0000 7f0928369700 1 --2- 172.21.15.45:0/359440232 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0920151cd0 0x7f0920069300 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:30.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.704+0000 7f0928369700 1 --2- 172.21.15.45:0/359440232 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f09201518f0 0x7f09200aa220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:30.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.704+0000 7f0928369700 1 --2- 172.21.15.45:0/359440232 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f090405a510 0x7f090405c9d0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:30.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.704+0000 7f0928369700 1 --2- 172.21.15.45:0/359440232 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f09200a7420 0x7f09201456c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:30.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.704+0000 7f0928369700 1 -- 172.21.15.45:0/359440232 >> 172.21.15.45:0/359440232 conn(0x7f0920066a70 msgr2=0x7f09201464e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:30.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.704+0000 7f0928369700 1 -- 172.21.15.45:0/359440232 shutdown_connections 2023-12-22T10:01:30.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.704+0000 7f0928369700 1 -- 172.21.15.45:0/359440232 wait complete. 2023-12-22T10:01:30.704 INFO:teuthology.orchestra.run.smithi045.stderr:updated 2023-12-22T10:01:30.723 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-12-22T10:01:30.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.888+0000 7f17103a9700 1 Processor -- start 2023-12-22T10:01:30.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.888+0000 7f17103a9700 1 -- start start 2023-12-22T10:01:30.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.892+0000 7f17103a9700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f17081518f0 0x7f1708064890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:30.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.892+0000 7f17103a9700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1708151cd0 0x7f17080a6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:30.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.892+0000 7f17103a9700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1708155740 con 0x7f1708064d80 2023-12-22T10:01:30.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.892+0000 7f17103a9700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17080c40f0 con 0x7f17081518f0 2023-12-22T10:01:30.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.896+0000 7f17103a9700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17080a61b0 con 0x7f1708151cd0 2023-12-22T10:01:30.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.896+0000 7f170e145700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f17081518f0 0x7f1708064890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:30.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.896+0000 7f170e145700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f17081518f0 0x7f1708064890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34912/0 (socket says 172.21.15.45:34912) 2023-12-22T10:01:30.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.896+0000 7f170e145700 1 -- 172.21.15.45:0/1612535506 learned_addr learned my addr 172.21.15.45:0/1612535506 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:30.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.896+0000 7f170d944700 1 --2- 172.21.15.45:0/1612535506 >> v2:172.21.15.113:3300/0 conn(0x7f1708151cd0 0x7f17080a6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:30.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.896+0000 7f170e145700 1 -- 172.21.15.45:0/1612535506 >> v2:172.21.15.113:3300/0 conn(0x7f1708151cd0 msgr2=0x7f17080a6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:30.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.896+0000 7f170e145700 1 --2- 172.21.15.45:0/1612535506 >> v2:172.21.15.113:3300/0 conn(0x7f1708151cd0 0x7f17080a6d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:30.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.896+0000 7f170e145700 1 -- 172.21.15.45:0/1612535506 >> v1:172.21.15.113:6789/0 conn(0x7f1708064d80 legacy=0x7f17080c3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:30.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.896+0000 7f170e145700 1 -- 172.21.15.45:0/1612535506 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17080a5910 con 0x7f17081518f0 2023-12-22T10:01:30.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.896+0000 7f170d944700 1 --2- 172.21.15.45:0/1612535506 >> v2:172.21.15.113:3300/0 conn(0x7f1708151cd0 0x7f17080a6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T10:01:30.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.896+0000 7f170e145700 1 --2- 172.21.15.45:0/1612535506 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f17081518f0 0x7f1708064890 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7f17080680f0 tx=0x7f17040090f0).ready entity=mon.0 client_cookie=b15b872c1aa359d5 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:30.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.896+0000 7f170d143700 1 -- 172.21.15.45:0/1612535506 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f170400b600 con 0x7f17081518f0 2023-12-22T10:01:30.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.896+0000 7f170d143700 1 -- 172.21.15.45:0/1612535506 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f170400b760 con 0x7f17081518f0 2023-12-22T10:01:30.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.896+0000 7f170d143700 1 -- 172.21.15.45:0/1612535506 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f170400bae0 con 0x7f17081518f0 2023-12-22T10:01:30.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.896+0000 7f17103a9700 1 -- 172.21.15.45:0/1612535506 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f17081518f0 msgr2=0x7f1708064890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:30.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.896+0000 7f17103a9700 1 --2- 172.21.15.45:0/1612535506 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f17081518f0 0x7f1708064890 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7f17080680f0 tx=0x7f17040090f0).stop 2023-12-22T10:01:30.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.896+0000 7f17103a9700 1 -- 172.21.15.45:0/1612535506 shutdown_connections 2023-12-22T10:01:30.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.896+0000 7f17103a9700 1 --2- 172.21.15.45:0/1612535506 >> v2:172.21.15.113:3300/0 conn(0x7f1708151cd0 0x7f17080a6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:30.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.896+0000 7f17103a9700 1 --2- 172.21.15.45:0/1612535506 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f17081518f0 0x7f1708064890 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:30.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.896+0000 7f17103a9700 1 -- 172.21.15.45:0/1612535506 >> 172.21.15.45:0/1612535506 conn(0x7f1708066a70 msgr2=0x7f1708066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:30.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.896+0000 7f17103a9700 1 -- 172.21.15.45:0/1612535506 shutdown_connections 2023-12-22T10:01:30.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.896+0000 7f17103a9700 1 -- 172.21.15.45:0/1612535506 wait complete. 2023-12-22T10:01:30.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.900+0000 7f17103a9700 1 Processor -- start 2023-12-22T10:01:30.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.900+0000 7f17103a9700 1 -- start start 2023-12-22T10:01:30.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.904+0000 7f17103a9700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1708064d80 0x7f170814c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:30.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.904+0000 7f17103a9700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f17081518f0 0x7f1708150170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:30.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.904+0000 7f17103a9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1708151cd0 0x7f17080ab490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:30.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.904+0000 7f17103a9700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f170814fce0 con 0x7f1708151cd0 2023-12-22T10:01:30.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.904+0000 7f17103a9700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f170814f0d0 con 0x7f17081518f0 2023-12-22T10:01:30.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.904+0000 7f17103a9700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f170814f3b0 con 0x7f1708064d80 2023-12-22T10:01:30.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.904+0000 7f170e946700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1708151cd0 0x7f17080ab490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:30.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.904+0000 7f170e946700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1708151cd0 0x7f17080ab490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34924/0 (socket says 172.21.15.45:34924) 2023-12-22T10:01:30.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.904+0000 7f170e946700 1 -- 172.21.15.45:0/2472032766 learned_addr learned my addr 172.21.15.45:0/2472032766 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:30.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.904+0000 7f170d944700 1 --2- 172.21.15.45:0/2472032766 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f17081518f0 0x7f1708150170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:30.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.904+0000 7f170e145700 1 --2- 172.21.15.45:0/2472032766 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1708064d80 0x7f170814c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:30.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.904+0000 7f170e946700 1 -- 172.21.15.45:0/2472032766 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1708064d80 msgr2=0x7f170814c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:30.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.904+0000 7f170e946700 1 --2- 172.21.15.45:0/2472032766 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1708064d80 0x7f170814c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:30.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.904+0000 7f170e946700 1 -- 172.21.15.45:0/2472032766 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f17081518f0 msgr2=0x7f1708150170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:30.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.904+0000 7f170e946700 1 --2- 172.21.15.45:0/2472032766 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f17081518f0 0x7f1708150170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:30.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.904+0000 7f170e946700 1 -- 172.21.15.45:0/2472032766 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1704009370 con 0x7f1708151cd0 2023-12-22T10:01:30.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.904+0000 7f170d944700 1 --2- 172.21.15.45:0/2472032766 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f17081518f0 0x7f1708150170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T10:01:30.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.904+0000 7f170e946700 1 --2- 172.21.15.45:0/2472032766 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1708151cd0 0x7f17080ab490 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7f170000c790 tx=0x7f1700001530).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:30.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.904+0000 7f16fe7fc700 1 -- 172.21.15.45:0/2472032766 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1700010510 con 0x7f1708151cd0 2023-12-22T10:01:30.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.904+0000 7f16fe7fc700 1 -- 172.21.15.45:0/2472032766 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1700010670 con 0x7f1708151cd0 2023-12-22T10:01:30.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.904+0000 7f17103a9700 1 -- 172.21.15.45:0/2472032766 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f170814f690 con 0x7f1708151cd0 2023-12-22T10:01:30.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.904+0000 7f16fe7fc700 1 -- 172.21.15.45:0/2472032766 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17000109f0 con 0x7f1708151cd0 2023-12-22T10:01:30.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.904+0000 7f17103a9700 1 -- 172.21.15.45:0/2472032766 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f170814edb0 con 0x7f1708151cd0 2023-12-22T10:01:30.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.908+0000 7f17103a9700 1 -- 172.21.15.45:0/2472032766 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f170814fe90 con 0x7f1708151cd0 2023-12-22T10:01:30.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.908+0000 7f16fe7fc700 1 -- 172.21.15.45:0/2472032766 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f170001b3b0 con 0x7f1708151cd0 2023-12-22T10:01:30.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.912+0000 7f16fe7fc700 1 --2- 172.21.15.45:0/2472032766 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f16ec05a510 0x7f16ec05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:30.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.912+0000 7f16fe7fc700 1 -- 172.21.15.45:0/2472032766 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f1700073d60 con 0x7f1708151cd0 2023-12-22T10:01:30.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.912+0000 7f170e145700 1 --2- 172.21.15.45:0/2472032766 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f16ec05a510 0x7f16ec05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:30.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.912+0000 7f170e145700 1 --2- 172.21.15.45:0/2472032766 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f16ec05a510 0x7f16ec05c9d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f170400b3c0 tx=0x7f1704017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:30.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:30.916+0000 7f16fe7fc700 1 -- 172.21.15.45:0/2472032766 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f170814fe90 con 0x7f1708151cd0 2023-12-22T10:01:31.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.136+0000 7f17103a9700 1 -- 172.21.15.45:0/2472032766 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f170806c070 con 0x7f1708151cd0 2023-12-22T10:01:31.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.148+0000 7f16fe7fc700 1 -- 172.21.15.45:0/2472032766 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 updated v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f1700047820 con 0x7f1708151cd0 2023-12-22T10:01:31.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.148+0000 7f17103a9700 1 -- 172.21.15.45:0/2472032766 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f16ec05a510 msgr2=0x7f16ec05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:31.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.148+0000 7f17103a9700 1 --2- 172.21.15.45:0/2472032766 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f16ec05a510 0x7f16ec05c9d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f170400b3c0 tx=0x7f1704017000).stop 2023-12-22T10:01:31.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.148+0000 7f17103a9700 1 -- 172.21.15.45:0/2472032766 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1708151cd0 msgr2=0x7f17080ab490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:31.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.148+0000 7f17103a9700 1 --2- 172.21.15.45:0/2472032766 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1708151cd0 0x7f17080ab490 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7f170000c790 tx=0x7f1700001530).stop 2023-12-22T10:01:31.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.148+0000 7f17103a9700 1 -- 172.21.15.45:0/2472032766 shutdown_connections 2023-12-22T10:01:31.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.148+0000 7f17103a9700 1 --2- 172.21.15.45:0/2472032766 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1708151cd0 0x7f17080ab490 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:31.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.148+0000 7f17103a9700 1 --2- 172.21.15.45:0/2472032766 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f17081518f0 0x7f1708150170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:31.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.148+0000 7f17103a9700 1 --2- 172.21.15.45:0/2472032766 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f16ec05a510 0x7f16ec05c9d0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:31.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.148+0000 7f17103a9700 1 --2- 172.21.15.45:0/2472032766 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1708064d80 0x7f170814c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:31.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.148+0000 7f17103a9700 1 -- 172.21.15.45:0/2472032766 >> 172.21.15.45:0/2472032766 conn(0x7f1708066a70 msgr2=0x7f1708069a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:31.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.152+0000 7f17103a9700 1 -- 172.21.15.45:0/2472032766 shutdown_connections 2023-12-22T10:01:31.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.152+0000 7f17103a9700 1 -- 172.21.15.45:0/2472032766 wait complete. 2023-12-22T10:01:31.151 INFO:teuthology.orchestra.run.smithi045.stderr:updated 2023-12-22T10:01:31.169 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-12-22T10:01:31.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.328+0000 7fb3cbfff700 1 Processor -- start 2023-12-22T10:01:31.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.328+0000 7fb3cbfff700 1 -- start start 2023-12-22T10:01:31.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.332+0000 7fb3cbfff700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb3cc0ac3f0 0x7fb3cc0c04f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:31.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.332+0000 7fb3cbfff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3cc0aa9b0 con 0x7fb3cc0c0110 2023-12-22T10:01:31.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.332+0000 7fb3cbfff700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3cc0c63a0 con 0x7fb3cc0cb130 2023-12-22T10:01:31.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.332+0000 7fb3cbfff700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3cc0c6c20 con 0x7fb3cc0ac3f0 2023-12-22T10:01:31.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.332+0000 7fb3caffd700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fb3cc0c0110 0x7fb3cc0c5c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:41256/0 (socket says 172.21.15.45:41256) 2023-12-22T10:01:31.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.332+0000 7fb3caffd700 1 -- 172.21.15.45:0/1841144726 learned_addr learned my addr 172.21.15.45:0/1841144726 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:01:31.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.332+0000 7fb3cb7fe700 1 --2- 172.21.15.45:0/1841144726 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb3cc0ac3f0 0x7fb3cc0c04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:31.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.332+0000 7fb3c9ffb700 1 -- 172.21.15.45:0/1841144726 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 779103814 0 0) 0x7fb3cc0aa9b0 con 0x7fb3cc0c0110 2023-12-22T10:01:31.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.332+0000 7fb3c9ffb700 1 -- 172.21.15.45:0/1841144726 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3b40033f0 con 0x7fb3cc0c0110 2023-12-22T10:01:31.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.332+0000 7fb3c9ffb700 1 -- 172.21.15.45:0/1841144726 <== mon.1 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1546083281 0 0) 0x7fb3cc0c63a0 con 0x7fb3cc0cb130 2023-12-22T10:01:31.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.332+0000 7fb3c9ffb700 1 -- 172.21.15.45:0/1841144726 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3cc0aa9b0 con 0x7fb3cc0cb130 2023-12-22T10:01:31.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.332+0000 7fb3cb7fe700 1 -- 172.21.15.45:0/1841144726 >> v1:172.21.15.113:6789/0 conn(0x7fb3cc0cb130 legacy=0x7fb3cc157c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:31.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.332+0000 7fb3c9ffb700 1 -- 172.21.15.45:0/1841144726 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2124567042 0 0) 0x7fb3b40033f0 con 0x7fb3cc0c0110 2023-12-22T10:01:31.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.332+0000 7fb3cb7fe700 1 -- 172.21.15.45:0/1841144726 >> v1:172.21.15.45:6789/0 conn(0x7fb3cc0c0110 legacy=0x7fb3cc0c5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:31.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.332+0000 7fb3cb7fe700 1 -- 172.21.15.45:0/1841144726 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3cc0c6660 con 0x7fb3cc0ac3f0 2023-12-22T10:01:31.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.336+0000 7fb3cb7fe700 1 --2- 172.21.15.45:0/1841144726 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb3cc0ac3f0 0x7fb3cc0c04f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7fb3c4009e90 tx=0x7fb3c4009780).ready entity=mon.2 client_cookie=644f97a5399cf3d5 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:31.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.336+0000 7fb3c9ffb700 1 -- 172.21.15.45:0/1841144726 <== mon.2 v2:172.21.15.113:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c400e070 con 0x7fb3cc0ac3f0 2023-12-22T10:01:31.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.336+0000 7fb3c9ffb700 1 -- 172.21.15.45:0/1841144726 <== mon.2 v2:172.21.15.113:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3c400b7a0 con 0x7fb3cc0ac3f0 2023-12-22T10:01:31.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.336+0000 7fb3c9ffb700 1 -- 172.21.15.45:0/1841144726 <== mon.2 v2:172.21.15.113:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3bc001490 con 0x7fb3cc0ac3f0 2023-12-22T10:01:31.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.336+0000 7fb3cbfff700 1 -- 172.21.15.45:0/1841144726 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb3cc0ac3f0 msgr2=0x7fb3cc0c04f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:31.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.336+0000 7fb3cbfff700 1 --2- 172.21.15.45:0/1841144726 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb3cc0ac3f0 0x7fb3cc0c04f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7fb3c4009e90 tx=0x7fb3c4009780).stop 2023-12-22T10:01:31.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.336+0000 7fb3cbfff700 1 -- 172.21.15.45:0/1841144726 shutdown_connections 2023-12-22T10:01:31.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.336+0000 7fb3cbfff700 1 --2- 172.21.15.45:0/1841144726 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb3cc0ac3f0 0x7fb3cc0c04f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:31.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.336+0000 7fb3cbfff700 1 -- 172.21.15.45:0/1841144726 >> 172.21.15.45:0/1841144726 conn(0x7fb3cc067540 msgr2=0x7fb3cc0ca940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:31.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.336+0000 7fb3cbfff700 1 -- 172.21.15.45:0/1841144726 shutdown_connections 2023-12-22T10:01:31.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.336+0000 7fb3cbfff700 1 -- 172.21.15.45:0/1841144726 wait complete. 2023-12-22T10:01:31.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.340+0000 7fb3cbfff700 1 Processor -- start 2023-12-22T10:01:31.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.340+0000 7fb3cbfff700 1 -- start start 2023-12-22T10:01:31.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.340+0000 7fb3cbfff700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb3cc0ac3f0 0x7fb3cc0c19e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:31.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.340+0000 7fb3cbfff700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb3cc0c0110 0x7fb3cc164e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:31.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.340+0000 7fb3cbfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3cc0cb130 0x7fb3cc0b0380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:31.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.340+0000 7fb3cbfff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3cc156260 con 0x7fb3cc0cb130 2023-12-22T10:01:31.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.340+0000 7fb3cbfff700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3cc0c1ed0 con 0x7fb3cc0c0110 2023-12-22T10:01:31.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.340+0000 7fb3cbfff700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3cc165370 con 0x7fb3cc0ac3f0 2023-12-22T10:01:31.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.340+0000 7fb3cb7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3cc0cb130 0x7fb3cc0b0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:31.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.344+0000 7fb3cb7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3cc0cb130 0x7fb3cc0b0380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34932/0 (socket says 172.21.15.45:34932) 2023-12-22T10:01:31.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.344+0000 7fb3cb7fe700 1 -- 172.21.15.45:0/780146963 learned_addr learned my addr 172.21.15.45:0/780146963 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:31.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.344+0000 7fb3caffd700 1 --2- 172.21.15.45:0/780146963 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb3cc0ac3f0 0x7fb3cc0c19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:31.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.344+0000 7fb3ca7fc700 1 --2- 172.21.15.45:0/780146963 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb3cc0c0110 0x7fb3cc164e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:31.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.344+0000 7fb3cb7fe700 1 -- 172.21.15.45:0/780146963 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb3cc0ac3f0 msgr2=0x7fb3cc0c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:31.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.344+0000 7fb3cb7fe700 1 --2- 172.21.15.45:0/780146963 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb3cc0ac3f0 0x7fb3cc0c19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:31.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.344+0000 7fb3cb7fe700 1 -- 172.21.15.45:0/780146963 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb3cc0c0110 msgr2=0x7fb3cc164e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:31.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.344+0000 7fb3cb7fe700 1 --2- 172.21.15.45:0/780146963 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb3cc0c0110 0x7fb3cc164e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:31.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.344+0000 7fb3cb7fe700 1 -- 172.21.15.45:0/780146963 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3c4009a20 con 0x7fb3cc0cb130 2023-12-22T10:01:31.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.344+0000 7fb3caffd700 1 --2- 172.21.15.45:0/780146963 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb3cc0ac3f0 0x7fb3cc0c19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T10:01:31.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.344+0000 7fb3cb7fe700 1 --2- 172.21.15.45:0/780146963 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3cc0cb130 0x7fb3cc0b0380 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7fb3c400b610 tx=0x7fb3c4009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:31.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.344+0000 7fb3b2ffd700 1 -- 172.21.15.45:0/780146963 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c401e440 con 0x7fb3cc0cb130 2023-12-22T10:01:31.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.344+0000 7fb3b2ffd700 1 -- 172.21.15.45:0/780146963 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3c401e5a0 con 0x7fb3cc0cb130 2023-12-22T10:01:31.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.344+0000 7fb3b2ffd700 1 -- 172.21.15.45:0/780146963 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c401e920 con 0x7fb3cc0cb130 2023-12-22T10:01:31.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.344+0000 7fb3cbfff700 1 -- 172.21.15.45:0/780146963 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3cc0c2130 con 0x7fb3cc0cb130 2023-12-22T10:01:31.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.344+0000 7fb3cbfff700 1 -- 172.21.15.45:0/780146963 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3cc0c26f0 con 0x7fb3cc0cb130 2023-12-22T10:01:31.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.348+0000 7fb3cbfff700 1 -- 172.21.15.45:0/780146963 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3cc1563d0 con 0x7fb3cc0cb130 2023-12-22T10:01:31.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.348+0000 7fb3b2ffd700 1 -- 172.21.15.45:0/780146963 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fb3c4003040 con 0x7fb3cc0cb130 2023-12-22T10:01:31.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.352+0000 7fb3b2ffd700 1 --2- 172.21.15.45:0/780146963 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fb3b805a510 0x7fb3b805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:31.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.352+0000 7fb3b2ffd700 1 -- 172.21.15.45:0/780146963 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fb3c4075ba0 con 0x7fb3cc0cb130 2023-12-22T10:01:31.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.352+0000 7fb3caffd700 1 --2- 172.21.15.45:0/780146963 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fb3b805a510 0x7fb3b805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:31.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.352+0000 7fb3caffd700 1 --2- 172.21.15.45:0/780146963 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fb3b805a510 0x7fb3b805c9d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7fb3bc0015c0 tx=0x7fb3bc0019b0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:31.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.356+0000 7fb3b2ffd700 1 -- 172.21.15.45:0/780146963 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb3c40496c0 con 0x7fb3cc0cb130 2023-12-22T10:01:31.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.572+0000 7fb3cbfff700 1 -- 172.21.15.45:0/780146963 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fb3cc0c6940 con 0x7fb3cc0cb130 2023-12-22T10:01:31.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.580+0000 7fb3b2ffd700 1 -- 172.21.15.45:0/780146963 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 updated v12) v1 ==== 97+0+0 (secure 0 0 0) 0x7fb3c4023070 con 0x7fb3cc0cb130 2023-12-22T10:01:31.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.584+0000 7fb3cbfff700 1 -- 172.21.15.45:0/780146963 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fb3b805a510 msgr2=0x7fb3b805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:31.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.584+0000 7fb3cbfff700 1 --2- 172.21.15.45:0/780146963 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fb3b805a510 0x7fb3b805c9d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7fb3bc0015c0 tx=0x7fb3bc0019b0).stop 2023-12-22T10:01:31.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.584+0000 7fb3cbfff700 1 -- 172.21.15.45:0/780146963 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3cc0cb130 msgr2=0x7fb3cc0b0380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:31.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.584+0000 7fb3cbfff700 1 --2- 172.21.15.45:0/780146963 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3cc0cb130 0x7fb3cc0b0380 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7fb3c400b610 tx=0x7fb3c4009780).stop 2023-12-22T10:01:31.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.584+0000 7fb3cbfff700 1 -- 172.21.15.45:0/780146963 shutdown_connections 2023-12-22T10:01:31.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.584+0000 7fb3cbfff700 1 --2- 172.21.15.45:0/780146963 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3cc0cb130 0x7fb3cc0b0380 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:31.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.584+0000 7fb3cbfff700 1 --2- 172.21.15.45:0/780146963 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb3cc0c0110 0x7fb3cc164e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:31.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.584+0000 7fb3cbfff700 1 --2- 172.21.15.45:0/780146963 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fb3b805a510 0x7fb3b805c9d0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:31.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.584+0000 7fb3cbfff700 1 --2- 172.21.15.45:0/780146963 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb3cc0ac3f0 0x7fb3cc0c19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:31.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.584+0000 7fb3cbfff700 1 -- 172.21.15.45:0/780146963 >> 172.21.15.45:0/780146963 conn(0x7fb3cc067540 msgr2=0x7fb3cc155900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:31.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.584+0000 7fb3cbfff700 1 -- 172.21.15.45:0/780146963 shutdown_connections 2023-12-22T10:01:31.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.584+0000 7fb3cbfff700 1 -- 172.21.15.45:0/780146963 wait complete. 2023-12-22T10:01:31.586 INFO:teuthology.orchestra.run.smithi045.stderr:updated 2023-12-22T10:01:31.606 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T10:01:31.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.780+0000 7f20362f1700 1 Processor -- start 2023-12-22T10:01:31.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.780+0000 7f20362f1700 1 -- start start 2023-12-22T10:01:31.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.784+0000 7f20362f1700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2030067590 0x7f2030154590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:31.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.784+0000 7f20362f1700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20300c3c70 con 0x7f2030153aa0 2023-12-22T10:01:31.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.784+0000 7f20362f1700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20300c27d0 con 0x7f20300c02e0 2023-12-22T10:01:31.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.784+0000 7f20362f1700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2030065870 con 0x7f2030067590 2023-12-22T10:01:31.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.784+0000 7f202ffff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f2030153aa0 0x7f20300bfbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:41268/0 (socket says 172.21.15.45:41268) 2023-12-22T10:01:31.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.784+0000 7f203488e700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2030067590 0x7f2030154590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:31.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.784+0000 7f202ffff700 1 -- 172.21.15.45:0/54194284 learned_addr learned my addr 172.21.15.45:0/54194284 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:01:31.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.784+0000 7f203488e700 1 -- 172.21.15.45:0/54194284 >> v1:172.21.15.113:6789/0 conn(0x7f20300c02e0 legacy=0x7f2030153e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:31.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.784+0000 7f203488e700 1 -- 172.21.15.45:0/54194284 >> v1:172.21.15.45:6789/0 conn(0x7f2030153aa0 legacy=0x7f20300bfbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:31.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.784+0000 7f203488e700 1 -- 172.21.15.45:0/54194284 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2030065b50 con 0x7f2030067590 2023-12-22T10:01:31.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.784+0000 7f203488e700 1 --2- 172.21.15.45:0/54194284 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2030067590 0x7f2030154590 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7f2028009e60 tx=0x7f2028009780).ready entity=mon.0 client_cookie=b343fecb9d0c8e65 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:31.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.784+0000 7f202f7fe700 1 -- 172.21.15.45:0/54194284 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f202800e070 con 0x7f2030067590 2023-12-22T10:01:31.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.784+0000 7f202f7fe700 1 -- 172.21.15.45:0/54194284 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f202800bc30 con 0x7f2030067590 2023-12-22T10:01:31.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.784+0000 7f202f7fe700 1 -- 172.21.15.45:0/54194284 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2028012410 con 0x7f2030067590 2023-12-22T10:01:31.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.788+0000 7f20362f1700 1 -- 172.21.15.45:0/54194284 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2030067590 msgr2=0x7f2030154590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:31.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.788+0000 7f20362f1700 1 --2- 172.21.15.45:0/54194284 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2030067590 0x7f2030154590 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7f2028009e60 tx=0x7f2028009780).stop 2023-12-22T10:01:31.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.788+0000 7f20362f1700 1 -- 172.21.15.45:0/54194284 shutdown_connections 2023-12-22T10:01:31.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.788+0000 7f20362f1700 1 --2- 172.21.15.45:0/54194284 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2030067590 0x7f2030154590 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:31.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.788+0000 7f20362f1700 1 -- 172.21.15.45:0/54194284 >> 172.21.15.45:0/54194284 conn(0x7f2030066a70 msgr2=0x7f2030066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:31.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.788+0000 7f20362f1700 1 -- 172.21.15.45:0/54194284 shutdown_connections 2023-12-22T10:01:31.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.788+0000 7f20362f1700 1 -- 172.21.15.45:0/54194284 wait complete. 2023-12-22T10:01:31.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.792+0000 7f20362f1700 1 Processor -- start 2023-12-22T10:01:31.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.792+0000 7f20362f1700 1 -- start start 2023-12-22T10:01:31.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.792+0000 7f20362f1700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f2030067590 0x7f203013aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:31.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.792+0000 7f20362f1700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f20300c02e0 0x7f2030163780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:31.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.792+0000 7f20362f1700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2030153aa0 0x7f2030155a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:31.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.792+0000 7f20362f1700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20301555a0 con 0x7f20300c02e0 2023-12-22T10:01:31.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.792+0000 7f20362f1700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f203014c180 con 0x7f2030153aa0 2023-12-22T10:01:31.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.792+0000 7f20362f1700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f203014b850 con 0x7f2030067590 2023-12-22T10:01:31.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.792+0000 7f2027fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f20300c02e0 0x7f2030163780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:31.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.792+0000 7f2027fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f20300c02e0 0x7f2030163780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34946/0 (socket says 172.21.15.45:34946) 2023-12-22T10:01:31.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.792+0000 7f2027fff700 1 -- 172.21.15.45:0/3484294870 learned_addr learned my addr 172.21.15.45:0/3484294870 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:31.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.792+0000 7f202ffff700 1 --2- 172.21.15.45:0/3484294870 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f2030067590 0x7f203013aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:31.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.792+0000 7f203488e700 1 --2- 172.21.15.45:0/3484294870 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2030153aa0 0x7f2030155a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:31.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.796+0000 7f2027fff700 1 -- 172.21.15.45:0/3484294870 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f2030067590 msgr2=0x7f203013aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:31.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.796+0000 7f2027fff700 1 --2- 172.21.15.45:0/3484294870 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f2030067590 0x7f203013aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:31.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.796+0000 7f2027fff700 1 -- 172.21.15.45:0/3484294870 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2030153aa0 msgr2=0x7f2030155a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:31.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.796+0000 7f2027fff700 1 --2- 172.21.15.45:0/3484294870 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2030153aa0 0x7f2030155a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:31.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.796+0000 7f2027fff700 1 -- 172.21.15.45:0/3484294870 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2028009a20 con 0x7f20300c02e0 2023-12-22T10:01:31.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.796+0000 7f2027fff700 1 --2- 172.21.15.45:0/3484294870 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f20300c02e0 0x7f2030163780 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7f201800c4c0 tx=0x7f2018007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:31.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.796+0000 7f202cff9700 1 -- 172.21.15.45:0/3484294870 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f201800ce10 con 0x7f20300c02e0 2023-12-22T10:01:31.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.796+0000 7f202cff9700 1 -- 172.21.15.45:0/3484294870 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2018007020 con 0x7f20300c02e0 2023-12-22T10:01:31.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.796+0000 7f20362f1700 1 -- 172.21.15.45:0/3484294870 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f203014bb30 con 0x7f20300c02e0 2023-12-22T10:01:31.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.796+0000 7f202cff9700 1 -- 172.21.15.45:0/3484294870 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20180073c0 con 0x7f20300c02e0 2023-12-22T10:01:31.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.796+0000 7f20362f1700 1 -- 172.21.15.45:0/3484294870 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2030163c70 con 0x7f20300c02e0 2023-12-22T10:01:31.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.796+0000 7f20362f1700 1 -- 172.21.15.45:0/3484294870 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f203006c070 con 0x7f20300c02e0 2023-12-22T10:01:31.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.800+0000 7f202cff9700 1 -- 172.21.15.45:0/3484294870 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f20180068b0 con 0x7f20300c02e0 2023-12-22T10:01:31.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.800+0000 7f202cff9700 1 --2- 172.21.15.45:0/3484294870 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f201005a510 0x7f201005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:31.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.800+0000 7f202cff9700 1 -- 172.21.15.45:0/3484294870 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f2018073800 con 0x7f20300c02e0 2023-12-22T10:01:31.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.800+0000 7f202ffff700 1 --2- 172.21.15.45:0/3484294870 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f201005a510 0x7f201005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:31.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.800+0000 7f202ffff700 1 --2- 172.21.15.45:0/3484294870 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f201005a510 0x7f201005c9d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f2020007fd0 tx=0x7f2020009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:31.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.804+0000 7f202cff9700 1 -- 172.21.15.45:0/3484294870 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f2018047270 con 0x7f20300c02e0 2023-12-22T10:01:31.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.980+0000 7f20362f1700 1 -- 172.21.15.45:0/3484294870 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2030065e30 con 0x7f20300c02e0 2023-12-22T10:01:31.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.980+0000 7f202cff9700 1 -- 172.21.15.45:0/3484294870 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+13712 (secure 0 0 0) 0x7f201804a890 con 0x7f20300c02e0 2023-12-22T10:01:31.981 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:01:31.981 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":32,"fsid":"98b0837e-5e68-4c8f-a1a0-e9424baaad8f","created":"2023-12-22T10:00:15.010174+0000","modified":"2023-12-22T10:01:28.449379+0000","last_up_change":"2023-12-22T10:00:24.980513+0000","last_in_change":"2023-12-22T10:00:17.887172+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-12-22T10:00:25.069641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-12-22T10:00:26.906399+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"e19943a0-1c6b-47df-b6bb-383472077890","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":33777},{"type":"v1","addr":"172.21.15.45:6819","nonce":33777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":33777},{"type":"v1","addr":"172.21.15.45:6822","nonce":33777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":33777},{"type":"v1","addr":"172.21.15.45:6830","nonce":33777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":33777},{"type":"v1","addr":"172.21.15.45:6826","nonce":33777}]},"public_addr":"172.21.15.45:6819/33777","cluster_addr":"172.21.15.45:6822/33777","heartbeat_back_addr":"172.21.15.45:6830/33777","heartbeat_front_addr":"172.21.15.45:6826/33777","state":["exists","up"]},{"osd":1,"uuid":"69670f34-f082-45a7-8f67-e962acc136e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":33775},{"type":"v1","addr":"172.21.15.45:6809","nonce":33775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":33775},{"type":"v1","addr":"172.21.15.45:6811","nonce":33775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":33775},{"type":"v1","addr":"172.21.15.45:6815","nonce":33775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":33775},{"type":"v1","addr":"172.21.15.45:6813","nonce":33775}]},"public_addr":"172.21.15.45:6809/33775","cluster_addr":"172.21.15.45:6811/33775","heartbeat_back_addr":"172.21.15.45:6815/33775","heartbeat_front_addr":"172.21.15.45:6813/33775","state":["exists","up"]},{"osd":2,"uuid":"d909d49b-82b8-401b-9947-e49dd167bb95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":33776},{"type":"v1","addr":"172.21.15.45:6801","nonce":33776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":33776},{"type":"v1","addr":"172.21.15.45:6803","nonce":33776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":33776},{"type":"v1","addr":"172.21.15.45:6807","nonce":33776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":33776},{"type":"v1","addr":"172.21.15.45:6805","nonce":33776}]},"public_addr":"172.21.15.45:6801/33776","cluster_addr":"172.21.15.45:6803/33776","heartbeat_back_addr":"172.21.15.45:6807/33776","heartbeat_front_addr":"172.21.15.45:6805/33776","state":["exists","up"]},{"osd":3,"uuid":"db104ca9-3a94-4d39-a2be-bd06db888095","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":33782},{"type":"v1","addr":"172.21.15.45:6817","nonce":33782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":33782},{"type":"v1","addr":"172.21.15.45:6823","nonce":33782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":33782},{"type":"v1","addr":"172.21.15.45:6831","nonce":33782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":33782},{"type":"v1","addr":"172.21.15.45:6827","nonce":33782}]},"public_addr":"172.21.15.45:6817/33782","cluster_addr":"172.21.15.45:6823/33782","heartbeat_back_addr":"172.21.15.45:6831/33782","heartbeat_front_addr":"172.21.15.45:6827/33782","state":["exists","up"]},{"osd":4,"uuid":"9f4eaff4-e433-4479-a0d1-ee7a33375ca6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":34099},{"type":"v1","addr":"172.21.15.113:6811","nonce":34099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":34099},{"type":"v1","addr":"172.21.15.113:6815","nonce":34099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":34099},{"type":"v1","addr":"172.21.15.113:6823","nonce":34099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6816","nonce":34099},{"type":"v1","addr":"172.21.15.113:6818","nonce":34099}]},"public_addr":"172.21.15.113:6811/34099","cluster_addr":"172.21.15.113:6815/34099","heartbeat_back_addr":"172.21.15.113:6823/34099","heartbeat_front_addr":"172.21.15.113:6818/34099","state":["exists","up"]},{"osd":5,"uuid":"1efc5591-180b-43af-8611-0068aadc5aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":34100},{"type":"v1","addr":"172.21.15.113:6801","nonce":34100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":34100},{"type":"v1","addr":"172.21.15.113:6803","nonce":34100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":34100},{"type":"v1","addr":"172.21.15.113:6807","nonce":34100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":34100},{"type":"v1","addr":"172.21.15.113:6805","nonce":34100}]},"public_addr":"172.21.15.113:6801/34100","cluster_addr":"172.21.15.113:6803/34100","heartbeat_back_addr":"172.21.15.113:6807/34100","heartbeat_front_addr":"172.21.15.113:6805/34100","state":["exists","up"]},{"osd":6,"uuid":"6c89d9d8-c153-4a48-afa9-97e4c403f1ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":34101},{"type":"v1","addr":"172.21.15.113:6810","nonce":34101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6812","nonce":34101},{"type":"v1","addr":"172.21.15.113:6814","nonce":34101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6822","nonce":34101},{"type":"v1","addr":"172.21.15.113:6824","nonce":34101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":34101},{"type":"v1","addr":"172.21.15.113:6819","nonce":34101}]},"public_addr":"172.21.15.113:6810/34101","cluster_addr":"172.21.15.113:6814/34101","heartbeat_back_addr":"172.21.15.113:6824/34101","heartbeat_front_addr":"172.21.15.113:6819/34101","state":["exists","up"]},{"osd":7,"uuid":"1855e70c-23f6-4c08-ad7f-774c2148235b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6821","nonce":34102},{"type":"v1","addr":"172.21.15.113:6825","nonce":34102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":34102},{"type":"v1","addr":"172.21.15.113:6827","nonce":34102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":34102},{"type":"v1","addr":"172.21.15.113:6831","nonce":34102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6828","nonce":34102},{"type":"v1","addr":"172.21.15.113:6829","nonce":34102}]},"public_addr":"172.21.15.113:6825/34102","cluster_addr":"172.21.15.113:6827/34102","heartbeat_back_addr":"172.21.15.113:6831/34102","heartbeat_front_addr":"172.21.15.113:6829/34102","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.812672+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.825045+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.700105+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.856563+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.954683+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.883234+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.883994+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.821686+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T10:01:31.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.984+0000 7f20362f1700 1 -- 172.21.15.45:0/3484294870 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f201005a510 msgr2=0x7f201005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:31.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.984+0000 7f20362f1700 1 --2- 172.21.15.45:0/3484294870 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f201005a510 0x7f201005c9d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f2020007fd0 tx=0x7f2020009040).stop 2023-12-22T10:01:31.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.984+0000 7f20362f1700 1 -- 172.21.15.45:0/3484294870 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f20300c02e0 msgr2=0x7f2030163780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:31.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.984+0000 7f20362f1700 1 --2- 172.21.15.45:0/3484294870 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f20300c02e0 0x7f2030163780 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7f201800c4c0 tx=0x7f2018007dd0).stop 2023-12-22T10:01:31.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.988+0000 7f20362f1700 1 -- 172.21.15.45:0/3484294870 shutdown_connections 2023-12-22T10:01:31.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.988+0000 7f20362f1700 1 --2- 172.21.15.45:0/3484294870 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2030153aa0 0x7f2030155a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:31.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.988+0000 7f20362f1700 1 --2- 172.21.15.45:0/3484294870 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f20300c02e0 0x7f2030163780 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:31.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.988+0000 7f20362f1700 1 --2- 172.21.15.45:0/3484294870 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f201005a510 0x7f201005c9d0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:31.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.988+0000 7f20362f1700 1 --2- 172.21.15.45:0/3484294870 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f2030067590 0x7f203013aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:31.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.988+0000 7f20362f1700 1 -- 172.21.15.45:0/3484294870 >> 172.21.15.45:0/3484294870 conn(0x7f2030066a70 msgr2=0x7f20300c5760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:31.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.988+0000 7f20362f1700 1 -- 172.21.15.45:0/3484294870 shutdown_connections 2023-12-22T10:01:31.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:31.988+0000 7f20362f1700 1 -- 172.21.15.45:0/3484294870 wait complete. 2023-12-22T10:01:32.006 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-12-22T10:00:25.069641+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-12-22T10:00:26.906399+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-12-22T10:01:32.007 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-12-22T10:01:32.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.176+0000 7f7cbb29b700 1 Processor -- start 2023-12-22T10:01:32.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.176+0000 7f7cbb29b700 1 -- start start 2023-12-22T10:01:32.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.180+0000 7f7cbb29b700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7cb414dca0 0x7f7cb4153fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:32.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.180+0000 7f7cbb29b700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7cb4158020 0x7f7cb414e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:32.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.180+0000 7f7cbb29b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7cb40c5760 0x7f7cb40c5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:32.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.180+0000 7f7cbb29b700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cb40ad320 con 0x7f7cb40c5760 2023-12-22T10:01:32.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.180+0000 7f7cbb29b700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cb40c7750 con 0x7f7cb414dca0 2023-12-22T10:01:32.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.180+0000 7f7cbb29b700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb414e570 con 0x7f7cb4158020 2023-12-22T10:01:32.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.180+0000 7f7cb9838700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7cb40c5760 0x7f7cb40c5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:32.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.180+0000 7f7cb9037700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7cb414dca0 0x7f7cb4153fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:32.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.180+0000 7f7cb8836700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7cb4158020 0x7f7cb414e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:32.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.180+0000 7f7cb9838700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7cb40c5760 0x7f7cb40c5bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34958/0 (socket says 172.21.15.45:34958) 2023-12-22T10:01:32.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.180+0000 7f7cb9838700 1 -- 172.21.15.45:0/3923796465 learned_addr learned my addr 172.21.15.45:0/3923796465 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:32.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.180+0000 7f7cb9037700 1 -- 172.21.15.45:0/3923796465 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7cb4158020 msgr2=0x7f7cb414e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:32.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.180+0000 7f7cb9037700 1 --2- 172.21.15.45:0/3923796465 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7cb4158020 0x7f7cb414e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:32.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.180+0000 7f7cb9037700 1 -- 172.21.15.45:0/3923796465 >> v2:172.21.15.45:3300/0 conn(0x7f7cb40c5760 msgr2=0x7f7cb40c5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:32.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.180+0000 7f7cb9037700 1 --2- 172.21.15.45:0/3923796465 >> v2:172.21.15.45:3300/0 conn(0x7f7cb40c5760 0x7f7cb40c5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:32.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.180+0000 7f7cb9037700 1 -- 172.21.15.45:0/3923796465 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cb41584a0 con 0x7f7cb414dca0 2023-12-22T10:01:32.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.184+0000 7f7cb9037700 1 --2- 172.21.15.45:0/3923796465 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7cb414dca0 0x7f7cb4153fe0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f7cb40833d0 tx=0x7f7cb0009060).ready entity=mon.1 client_cookie=c4aa7a3615d44fd4 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:32.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.184+0000 7f7cabfff700 1 -- 172.21.15.45:0/3923796465 <== mon.1 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb000d4a0 con 0x7f7cb414dca0 2023-12-22T10:01:32.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.184+0000 7f7cabfff700 1 -- 172.21.15.45:0/3923796465 <== mon.1 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cb000d600 con 0x7f7cb414dca0 2023-12-22T10:01:32.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.184+0000 7f7cabfff700 1 -- 172.21.15.45:0/3923796465 <== mon.1 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb000d980 con 0x7f7cb414dca0 2023-12-22T10:01:32.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.184+0000 7f7cbb29b700 1 -- 172.21.15.45:0/3923796465 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7cb414dca0 msgr2=0x7f7cb4153fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:32.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.184+0000 7f7cbb29b700 1 --2- 172.21.15.45:0/3923796465 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7cb414dca0 0x7f7cb4153fe0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f7cb40833d0 tx=0x7f7cb0009060).stop 2023-12-22T10:01:32.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.184+0000 7f7cbb29b700 1 -- 172.21.15.45:0/3923796465 shutdown_connections 2023-12-22T10:01:32.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.184+0000 7f7cbb29b700 1 --2- 172.21.15.45:0/3923796465 >> v2:172.21.15.45:3300/0 conn(0x7f7cb40c5760 0x7f7cb40c5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:32.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.184+0000 7f7cbb29b700 1 --2- 172.21.15.45:0/3923796465 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7cb4158020 0x7f7cb414e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:32.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.184+0000 7f7cbb29b700 1 --2- 172.21.15.45:0/3923796465 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7cb414dca0 0x7f7cb4153fe0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:32.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.184+0000 7f7cbb29b700 1 -- 172.21.15.45:0/3923796465 >> 172.21.15.45:0/3923796465 conn(0x7f7cb4066a70 msgr2=0x7f7cb4066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:32.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.184+0000 7f7cbb29b700 1 -- 172.21.15.45:0/3923796465 shutdown_connections 2023-12-22T10:01:32.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.184+0000 7f7cbb29b700 1 -- 172.21.15.45:0/3923796465 wait complete. 2023-12-22T10:01:32.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.188+0000 7f7cbb29b700 1 Processor -- start 2023-12-22T10:01:32.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.188+0000 7f7cbb29b700 1 -- start start 2023-12-22T10:01:32.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.188+0000 7f7cbb29b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7cb40c5760 0x7f7cb40c3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:32.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.188+0000 7f7cbb29b700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7cb414dca0 0x7f7cb414c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:32.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.188+0000 7f7cbb29b700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7cb4158020 0x7f7cb40c3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:32.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.188+0000 7f7cbb29b700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb40c2890 con 0x7f7cb40c5760 2023-12-22T10:01:32.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.188+0000 7f7cbb29b700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb40c2b70 con 0x7f7cb4158020 2023-12-22T10:01:32.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.188+0000 7f7cbb29b700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb40c2e50 con 0x7f7cb414dca0 2023-12-22T10:01:32.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.188+0000 7f7cb9037700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7cb40c5760 0x7f7cb40c3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:32.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.188+0000 7f7cb9037700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7cb40c5760 0x7f7cb40c3930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34960/0 (socket says 172.21.15.45:34960) 2023-12-22T10:01:32.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.188+0000 7f7cb9037700 1 -- 172.21.15.45:0/928740492 learned_addr learned my addr 172.21.15.45:0/928740492 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:32.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.188+0000 7f7cb9838700 1 --2- 172.21.15.45:0/928740492 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7cb4158020 0x7f7cb40c3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:32.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.188+0000 7f7cb8836700 1 --2- 172.21.15.45:0/928740492 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7cb414dca0 0x7f7cb414c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:32.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.188+0000 7f7cb9037700 1 -- 172.21.15.45:0/928740492 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7cb414dca0 msgr2=0x7f7cb414c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:32.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.188+0000 7f7cb9037700 1 --2- 172.21.15.45:0/928740492 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7cb414dca0 0x7f7cb414c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:32.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.188+0000 7f7cb9037700 1 -- 172.21.15.45:0/928740492 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7cb4158020 msgr2=0x7f7cb40c3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:32.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.188+0000 7f7cb9037700 1 --2- 172.21.15.45:0/928740492 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7cb4158020 0x7f7cb40c3f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:32.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.188+0000 7f7cb9037700 1 -- 172.21.15.45:0/928740492 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cb00092a0 con 0x7f7cb40c5760 2023-12-22T10:01:32.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.188+0000 7f7cb9037700 1 --2- 172.21.15.45:0/928740492 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7cb40c5760 0x7f7cb40c3930 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7f7cb0009d20 tx=0x7f7cb0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:32.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.188+0000 7f7ca97fa700 1 -- 172.21.15.45:0/928740492 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb0000c90 con 0x7f7cb40c5760 2023-12-22T10:01:32.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.188+0000 7f7ca97fa700 1 -- 172.21.15.45:0/928740492 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cb000d770 con 0x7f7cb40c5760 2023-12-22T10:01:32.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.188+0000 7f7cbb29b700 1 -- 172.21.15.45:0/928740492 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cb40c3130 con 0x7f7cb40c5760 2023-12-22T10:01:32.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.188+0000 7f7ca97fa700 1 -- 172.21.15.45:0/928740492 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb001d680 con 0x7f7cb40c5760 2023-12-22T10:01:32.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.192+0000 7f7cbb29b700 1 -- 172.21.15.45:0/928740492 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cb40c2490 con 0x7f7cb40c5760 2023-12-22T10:01:32.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.192+0000 7f7cbb29b700 1 -- 172.21.15.45:0/928740492 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cb40c3630 con 0x7f7cb40c5760 2023-12-22T10:01:32.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.192+0000 7f7ca97fa700 1 -- 172.21.15.45:0/928740492 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f7cb00263b0 con 0x7f7cb40c5760 2023-12-22T10:01:32.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.196+0000 7f7ca97fa700 1 --2- 172.21.15.45:0/928740492 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f7c9805a510 0x7f7c9805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:32.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.196+0000 7f7ca97fa700 1 -- 172.21.15.45:0/928740492 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f7cb0075310 con 0x7f7cb40c5760 2023-12-22T10:01:32.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.196+0000 7f7cb8836700 1 --2- 172.21.15.45:0/928740492 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f7c9805a510 0x7f7c9805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:32.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.196+0000 7f7cb8836700 1 --2- 172.21.15.45:0/928740492 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f7c9805a510 0x7f7c9805c9d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f7ca4009bc0 tx=0x7f7ca4008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:32.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.200+0000 7f7ca97fa700 1 -- 172.21.15.45:0/928740492 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f7cb0048e50 con 0x7f7cb40c5760 2023-12-22T10:01:32.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.360+0000 7f7cbb29b700 1 -- 172.21.15.45:0/928740492 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f7cb406c070 con 0x7f7cb40c5760 2023-12-22T10:01:32.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.360+0000 7f7ca97fa700 1 -- 172.21.15.45:0/928740492 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v32) v1 ==== 110+0+10 (secure 0 0 0) 0x7f7cb0022020 con 0x7f7cb40c5760 2023-12-22T10:01:32.360 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-12-22T10:01:32.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.364+0000 7f7cbb29b700 1 -- 172.21.15.45:0/928740492 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f7c9805a510 msgr2=0x7f7c9805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:32.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.364+0000 7f7cbb29b700 1 --2- 172.21.15.45:0/928740492 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f7c9805a510 0x7f7c9805c9d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f7ca4009bc0 tx=0x7f7ca4008040).stop 2023-12-22T10:01:32.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.364+0000 7f7cbb29b700 1 -- 172.21.15.45:0/928740492 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7cb40c5760 msgr2=0x7f7cb40c3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:32.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.364+0000 7f7cbb29b700 1 --2- 172.21.15.45:0/928740492 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7cb40c5760 0x7f7cb40c3930 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7f7cb0009d20 tx=0x7f7cb0016000).stop 2023-12-22T10:01:32.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.364+0000 7f7cbb29b700 1 -- 172.21.15.45:0/928740492 shutdown_connections 2023-12-22T10:01:32.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.364+0000 7f7cbb29b700 1 --2- 172.21.15.45:0/928740492 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7cb4158020 0x7f7cb40c3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:32.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.364+0000 7f7cbb29b700 1 --2- 172.21.15.45:0/928740492 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f7c9805a510 0x7f7c9805c9d0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:32.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.364+0000 7f7cbb29b700 1 --2- 172.21.15.45:0/928740492 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7cb414dca0 0x7f7cb414c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:32.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.364+0000 7f7cbb29b700 1 --2- 172.21.15.45:0/928740492 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7cb40c5760 0x7f7cb40c3930 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:32.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.364+0000 7f7cbb29b700 1 -- 172.21.15.45:0/928740492 >> 172.21.15.45:0/928740492 conn(0x7f7cb4066a70 msgr2=0x7f7cb41563f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:32.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.364+0000 7f7cbb29b700 1 -- 172.21.15.45:0/928740492 shutdown_connections 2023-12-22T10:01:32.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.364+0000 7f7cbb29b700 1 -- 172.21.15.45:0/928740492 wait complete. 2023-12-22T10:01:32.387 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-12-22T10:01:32.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.556+0000 7fe92389b700 1 Processor -- start 2023-12-22T10:01:32.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.556+0000 7fe92389b700 1 -- start start 2023-12-22T10:01:32.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.560+0000 7fe92389b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe91c157d40 0x7fe91c158120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:32.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.560+0000 7fe92389b700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fe91c0a5f20 0x7fe91c0c1b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:32.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.560+0000 7fe92389b700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe91c0c2010 con 0x7fe91c0c1670 2023-12-22T10:01:32.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.560+0000 7fe92389b700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe91c069e00 con 0x7fe91c157d40 2023-12-22T10:01:32.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.560+0000 7fe92389b700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe91c069180 con 0x7fe91c0a5f20 2023-12-22T10:01:32.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.560+0000 7fe921e38700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fe91c0a5f20 0x7fe91c0c1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:32.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.560+0000 7fe921637700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe91c157d40 0x7fe91c158120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:32.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.560+0000 7fe921e38700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fe91c0a5f20 0x7fe91c0c1b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.45:33434/0 (socket says 172.21.15.45:33434) 2023-12-22T10:01:32.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.560+0000 7fe921e38700 1 -- 172.21.15.45:0/2401945184 learned_addr learned my addr 172.21.15.45:0/2401945184 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:32.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.560+0000 7fe921e38700 1 -- 172.21.15.45:0/2401945184 >> v2:172.21.15.45:3300/0 conn(0x7fe91c157d40 msgr2=0x7fe91c158120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:32.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.560+0000 7fe921e38700 1 --2- 172.21.15.45:0/2401945184 >> v2:172.21.15.45:3300/0 conn(0x7fe91c157d40 0x7fe91c158120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:32.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.560+0000 7fe921e38700 1 -- 172.21.15.45:0/2401945184 >> v1:172.21.15.113:6789/0 conn(0x7fe91c0c1670 legacy=0x7fe91c0a5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:32.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.560+0000 7fe921e38700 1 -- 172.21.15.45:0/2401945184 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe91c069460 con 0x7fe91c0a5f20 2023-12-22T10:01:32.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.560+0000 7fe921637700 1 --2- 172.21.15.45:0/2401945184 >> v2:172.21.15.45:3300/0 conn(0x7fe91c157d40 0x7fe91c158120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-12-22T10:01:32.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.560+0000 7fe921e38700 1 --2- 172.21.15.45:0/2401945184 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe91c0a5f20 0x7fe91c0c1b20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7fe91c0c2e10 tx=0x7fe914009840).ready entity=mon.1 client_cookie=c823467ee748bb7e server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:32.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.560+0000 7fe913fff700 1 -- 172.21.15.45:0/2401945184 <== mon.1 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe91400e070 con 0x7fe91c0a5f20 2023-12-22T10:01:32.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.564+0000 7fe913fff700 1 -- 172.21.15.45:0/2401945184 <== mon.1 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe91400ba20 con 0x7fe91c0a5f20 2023-12-22T10:01:32.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.564+0000 7fe913fff700 1 -- 172.21.15.45:0/2401945184 <== mon.1 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe91400bda0 con 0x7fe91c0a5f20 2023-12-22T10:01:32.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.564+0000 7fe92389b700 1 -- 172.21.15.45:0/2401945184 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe91c0a5f20 msgr2=0x7fe91c0c1b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:32.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.564+0000 7fe92389b700 1 --2- 172.21.15.45:0/2401945184 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe91c0a5f20 0x7fe91c0c1b20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7fe91c0c2e10 tx=0x7fe914009840).stop 2023-12-22T10:01:32.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.564+0000 7fe92389b700 1 -- 172.21.15.45:0/2401945184 shutdown_connections 2023-12-22T10:01:32.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.564+0000 7fe92389b700 1 --2- 172.21.15.45:0/2401945184 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe91c0a5f20 0x7fe91c0c1b20 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:32.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.564+0000 7fe92389b700 1 --2- 172.21.15.45:0/2401945184 >> v2:172.21.15.45:3300/0 conn(0x7fe91c157d40 0x7fe91c158120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:32.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.564+0000 7fe92389b700 1 -- 172.21.15.45:0/2401945184 >> 172.21.15.45:0/2401945184 conn(0x7fe91c066a70 msgr2=0x7fe91c066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:32.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.564+0000 7fe92389b700 1 -- 172.21.15.45:0/2401945184 shutdown_connections 2023-12-22T10:01:32.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.564+0000 7fe92389b700 1 -- 172.21.15.45:0/2401945184 wait complete. 2023-12-22T10:01:32.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.564+0000 7fe92389b700 1 Processor -- start 2023-12-22T10:01:32.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.564+0000 7fe92389b700 1 -- start start 2023-12-22T10:01:32.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.568+0000 7fe92389b700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe91c0a5f20 0x7fe91c151680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:32.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.568+0000 7fe92389b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe91c0c1670 0x7fe91c14fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:32.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.568+0000 7fe92389b700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fe91c157d40 0x7fe91c141850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:32.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.568+0000 7fe92389b700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe91c151b70 con 0x7fe91c0c1670 2023-12-22T10:01:32.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.568+0000 7fe92389b700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe91c150170 con 0x7fe91c0a5f20 2023-12-22T10:01:32.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.568+0000 7fe92389b700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe91c150640 con 0x7fe91c157d40 2023-12-22T10:01:32.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.568+0000 7fe920e36700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe91c0c1670 0x7fe91c14fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:32.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.568+0000 7fe920e36700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe91c0c1670 0x7fe91c14fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34980/0 (socket says 172.21.15.45:34980) 2023-12-22T10:01:32.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.568+0000 7fe920e36700 1 -- 172.21.15.45:0/2972788252 learned_addr learned my addr 172.21.15.45:0/2972788252 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:32.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.568+0000 7fe921637700 1 --2- 172.21.15.45:0/2972788252 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe91c0a5f20 0x7fe91c151680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:32.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.568+0000 7fe921e38700 1 --2- 172.21.15.45:0/2972788252 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fe91c157d40 0x7fe91c141850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:32.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.568+0000 7fe920e36700 1 -- 172.21.15.45:0/2972788252 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fe91c157d40 msgr2=0x7fe91c141850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:32.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.568+0000 7fe920e36700 1 --2- 172.21.15.45:0/2972788252 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fe91c157d40 0x7fe91c141850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:32.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.568+0000 7fe920e36700 1 -- 172.21.15.45:0/2972788252 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe91c0a5f20 msgr2=0x7fe91c151680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:32.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.568+0000 7fe920e36700 1 --2- 172.21.15.45:0/2972788252 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe91c0a5f20 0x7fe91c151680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:32.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.568+0000 7fe920e36700 1 -- 172.21.15.45:0/2972788252 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9180092a0 con 0x7fe91c0c1670 2023-12-22T10:01:32.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.568+0000 7fe921637700 1 --2- 172.21.15.45:0/2972788252 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe91c0a5f20 0x7fe91c151680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-12-22T10:01:32.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.568+0000 7fe920e36700 1 --2- 172.21.15.45:0/2972788252 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe91c0c1670 0x7fe91c14fc80 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7fe90c00c4f0 tx=0x7fe90c007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:32.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.568+0000 7fe9117fa700 1 -- 172.21.15.45:0/2972788252 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe90c00ce60 con 0x7fe91c0c1670 2023-12-22T10:01:32.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.568+0000 7fe9117fa700 1 -- 172.21.15.45:0/2972788252 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe90c001e90 con 0x7fe91c0c1670 2023-12-22T10:01:32.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.568+0000 7fe9117fa700 1 -- 172.21.15.45:0/2972788252 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe90c007250 con 0x7fe91c0c1670 2023-12-22T10:01:32.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.568+0000 7fe92389b700 1 -- 172.21.15.45:0/2972788252 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe914009ae0 con 0x7fe91c0c1670 2023-12-22T10:01:32.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.572+0000 7fe92389b700 1 -- 172.21.15.45:0/2972788252 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe91c0a9cb0 con 0x7fe91c0c1670 2023-12-22T10:01:32.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.572+0000 7fe92389b700 1 -- 172.21.15.45:0/2972788252 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe91c0a9b20 con 0x7fe91c0c1670 2023-12-22T10:01:32.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.572+0000 7fe9117fa700 1 -- 172.21.15.45:0/2972788252 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fe90c0066a0 con 0x7fe91c0c1670 2023-12-22T10:01:32.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.576+0000 7fe9117fa700 1 --2- 172.21.15.45:0/2972788252 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fe90005a510 0x7fe90005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:32.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.576+0000 7fe9117fa700 1 -- 172.21.15.45:0/2972788252 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fe90c073bd0 con 0x7fe91c0c1670 2023-12-22T10:01:32.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.576+0000 7fe921637700 1 --2- 172.21.15.45:0/2972788252 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fe90005a510 0x7fe90005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:32.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.576+0000 7fe921637700 1 --2- 172.21.15.45:0/2972788252 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fe90005a510 0x7fe90005c9d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7fe9180113e0 tx=0x7fe918009060).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:32.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.580+0000 7fe9117fa700 1 -- 172.21.15.45:0/2972788252 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fe90c047640 con 0x7fe91c0c1670 2023-12-22T10:01:32.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.748+0000 7fe92389b700 1 -- 172.21.15.45:0/2972788252 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe91c069740 con 0x7fe91c0c1670 2023-12-22T10:01:32.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.752+0000 7fe9117fa700 1 -- 172.21.15.45:0/2972788252 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v32) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe90c04ac60 con 0x7fe91c0c1670 2023-12-22T10:01:32.750 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-12-22T10:01:32.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.756+0000 7fe92389b700 1 -- 172.21.15.45:0/2972788252 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fe90005a510 msgr2=0x7fe90005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:32.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.756+0000 7fe92389b700 1 --2- 172.21.15.45:0/2972788252 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fe90005a510 0x7fe90005c9d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7fe9180113e0 tx=0x7fe918009060).stop 2023-12-22T10:01:32.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.756+0000 7fe92389b700 1 -- 172.21.15.45:0/2972788252 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe91c0c1670 msgr2=0x7fe91c14fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:32.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.756+0000 7fe92389b700 1 --2- 172.21.15.45:0/2972788252 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe91c0c1670 0x7fe91c14fc80 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7fe90c00c4f0 tx=0x7fe90c007e00).stop 2023-12-22T10:01:32.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.756+0000 7fe92389b700 1 -- 172.21.15.45:0/2972788252 shutdown_connections 2023-12-22T10:01:32.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.756+0000 7fe92389b700 1 --2- 172.21.15.45:0/2972788252 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fe90005a510 0x7fe90005c9d0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:32.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.756+0000 7fe92389b700 1 --2- 172.21.15.45:0/2972788252 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fe91c157d40 0x7fe91c141850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:32.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.756+0000 7fe92389b700 1 --2- 172.21.15.45:0/2972788252 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe91c0c1670 0x7fe91c14fc80 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:32.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.756+0000 7fe92389b700 1 --2- 172.21.15.45:0/2972788252 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe91c0a5f20 0x7fe91c151680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:32.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.756+0000 7fe92389b700 1 -- 172.21.15.45:0/2972788252 >> 172.21.15.45:0/2972788252 conn(0x7fe91c066a70 msgr2=0x7fe91c0a8d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:32.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.756+0000 7fe92389b700 1 -- 172.21.15.45:0/2972788252 shutdown_connections 2023-12-22T10:01:32.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.756+0000 7fe92389b700 1 -- 172.21.15.45:0/2972788252 wait complete. 2023-12-22T10:01:32.777 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-22T10:01:32.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.940+0000 7f98c5169700 1 Processor -- start 2023-12-22T10:01:32.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.940+0000 7f98c5169700 1 -- start start 2023-12-22T10:01:32.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.944+0000 7f98c5169700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f98c01518f0 0x7f98c0064890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:32.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.944+0000 7f98c5169700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98c0155740 con 0x7f98c00a7420 2023-12-22T10:01:32.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.944+0000 7f98c5169700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98c00a61b0 con 0x7f98c0151cd0 2023-12-22T10:01:32.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.944+0000 7f98c5169700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98c00c40f0 con 0x7f98c01518f0 2023-12-22T10:01:32.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.944+0000 7f98bf59e700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f98c00a7420 0x7f98c00c3160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:41280/0 (socket says 172.21.15.45:41280) 2023-12-22T10:01:32.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.944+0000 7f98bf59e700 1 -- 172.21.15.45:0/2724415065 learned_addr learned my addr 172.21.15.45:0/2724415065 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:01:32.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.944+0000 7f98bed9d700 1 --2- 172.21.15.45:0/2724415065 >> v2:172.21.15.45:3300/0 conn(0x7f98c01518f0 0x7f98c0064890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:32.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.944+0000 7f98be59c700 1 -- 172.21.15.45:0/2724415065 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1182485485 0 0) 0x7f98c0155740 con 0x7f98c00a7420 2023-12-22T10:01:32.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.944+0000 7f98be59c700 1 -- 172.21.15.45:0/2724415065 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98ac0033f0 con 0x7f98c00a7420 2023-12-22T10:01:32.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.944+0000 7f98be59c700 1 -- 172.21.15.45:0/2724415065 <== mon.1 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3166879757 0 0) 0x7f98c00a61b0 con 0x7f98c0151cd0 2023-12-22T10:01:32.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.944+0000 7f98be59c700 1 -- 172.21.15.45:0/2724415065 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98c0155740 con 0x7f98c0151cd0 2023-12-22T10:01:32.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.944+0000 7f98bed9d700 1 -- 172.21.15.45:0/2724415065 >> v1:172.21.15.113:6789/0 conn(0x7f98c0151cd0 legacy=0x7f98c00a6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:32.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.944+0000 7f98bed9d700 1 -- 172.21.15.45:0/2724415065 >> v1:172.21.15.45:6789/0 conn(0x7f98c00a7420 legacy=0x7f98c00c3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:32.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.944+0000 7f98bed9d700 1 -- 172.21.15.45:0/2724415065 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98c00a5910 con 0x7f98c01518f0 2023-12-22T10:01:32.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.948+0000 7f98bed9d700 1 --2- 172.21.15.45:0/2724415065 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98c01518f0 0x7f98c0064890 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7f98b0009760 tx=0x7f98b0009060).ready entity=mon.0 client_cookie=e761caa8ecfccf54 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:32.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.948+0000 7f98be59c700 1 -- 172.21.15.45:0/2724415065 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b000d4a0 con 0x7f98c01518f0 2023-12-22T10:01:32.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.948+0000 7f98be59c700 1 -- 172.21.15.45:0/2724415065 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98b000d600 con 0x7f98c01518f0 2023-12-22T10:01:32.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.948+0000 7f98be59c700 1 -- 172.21.15.45:0/2724415065 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b000d980 con 0x7f98c01518f0 2023-12-22T10:01:32.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.948+0000 7f98c5169700 1 -- 172.21.15.45:0/2724415065 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98c01518f0 msgr2=0x7f98c0064890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:32.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.948+0000 7f98c5169700 1 --2- 172.21.15.45:0/2724415065 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98c01518f0 0x7f98c0064890 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7f98b0009760 tx=0x7f98b0009060).stop 2023-12-22T10:01:32.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.948+0000 7f98c5169700 1 -- 172.21.15.45:0/2724415065 shutdown_connections 2023-12-22T10:01:32.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.948+0000 7f98c5169700 1 --2- 172.21.15.45:0/2724415065 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98c01518f0 0x7f98c0064890 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:32.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.948+0000 7f98c5169700 1 -- 172.21.15.45:0/2724415065 >> 172.21.15.45:0/2724415065 conn(0x7f98c0066a70 msgr2=0x7f98c0066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:32.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.948+0000 7f98c5169700 1 -- 172.21.15.45:0/2724415065 shutdown_connections 2023-12-22T10:01:32.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.948+0000 7f98c5169700 1 -- 172.21.15.45:0/2724415065 wait complete. 2023-12-22T10:01:32.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.952+0000 7f98c5169700 1 Processor -- start 2023-12-22T10:01:32.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.952+0000 7f98c5169700 1 -- start start 2023-12-22T10:01:32.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.952+0000 7f98c5169700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f98c00a7420 0x7f98c0146430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:32.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.952+0000 7f98c5169700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98c01518f0 0x7f98c0165950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:32.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.952+0000 7f98c5169700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f98c0151cd0 0x7f98c0164740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:32.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.952+0000 7f98c5169700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98c0165700 con 0x7f98c01518f0 2023-12-22T10:01:32.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.952+0000 7f98c5169700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98c0157400 con 0x7f98c0151cd0 2023-12-22T10:01:32.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.952+0000 7f98c5169700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98c0146920 con 0x7f98c00a7420 2023-12-22T10:01:32.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.952+0000 7f98b659c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98c01518f0 0x7f98c0165950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:32.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.952+0000 7f98b659c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98c01518f0 0x7f98c0165950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34990/0 (socket says 172.21.15.45:34990) 2023-12-22T10:01:32.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.952+0000 7f98b659c700 1 -- 172.21.15.45:0/1536549093 learned_addr learned my addr 172.21.15.45:0/1536549093 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:32.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.952+0000 7f98bed9d700 1 --2- 172.21.15.45:0/1536549093 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f98c00a7420 0x7f98c0146430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:32.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.952+0000 7f98bf59e700 1 --2- 172.21.15.45:0/1536549093 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f98c0151cd0 0x7f98c0164740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:32.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.952+0000 7f98b659c700 1 -- 172.21.15.45:0/1536549093 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f98c00a7420 msgr2=0x7f98c0146430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:32.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.952+0000 7f98b659c700 1 --2- 172.21.15.45:0/1536549093 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f98c00a7420 0x7f98c0146430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:32.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.952+0000 7f98b659c700 1 -- 172.21.15.45:0/1536549093 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f98c0151cd0 msgr2=0x7f98c0164740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:32.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.952+0000 7f98b659c700 1 --2- 172.21.15.45:0/1536549093 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f98c0151cd0 0x7f98c0164740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:32.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.952+0000 7f98b659c700 1 -- 172.21.15.45:0/1536549093 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98b00092a0 con 0x7f98c01518f0 2023-12-22T10:01:32.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.956+0000 7f98b659c700 1 --2- 172.21.15.45:0/1536549093 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98c01518f0 0x7f98c0165950 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7f98a800c7f0 tx=0x7f98a8002650).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:32.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.956+0000 7f98b77fe700 1 -- 172.21.15.45:0/1536549093 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a8010510 con 0x7f98c01518f0 2023-12-22T10:01:32.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.956+0000 7f98b77fe700 1 -- 172.21.15.45:0/1536549093 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98a8010670 con 0x7f98c01518f0 2023-12-22T10:01:32.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.956+0000 7f98b77fe700 1 -- 172.21.15.45:0/1536549093 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a8010a30 con 0x7f98c01518f0 2023-12-22T10:01:32.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.956+0000 7f98c5169700 1 -- 172.21.15.45:0/1536549093 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98c0165e40 con 0x7f98c01518f0 2023-12-22T10:01:32.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.956+0000 7f98c5169700 1 -- 172.21.15.45:0/1536549093 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98c0165420 con 0x7f98c01518f0 2023-12-22T10:01:32.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.956+0000 7f98c5169700 1 -- 172.21.15.45:0/1536549093 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98c0157590 con 0x7f98c01518f0 2023-12-22T10:01:32.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.956+0000 7f98b77fe700 1 -- 172.21.15.45:0/1536549093 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f98a801b400 con 0x7f98c01518f0 2023-12-22T10:01:32.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.960+0000 7f98b77fe700 1 --2- 172.21.15.45:0/1536549093 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f98a005a510 0x7f98a005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:32.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.960+0000 7f98b77fe700 1 -- 172.21.15.45:0/1536549093 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f98a8074250 con 0x7f98c01518f0 2023-12-22T10:01:32.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.960+0000 7f98bed9d700 1 --2- 172.21.15.45:0/1536549093 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f98a005a510 0x7f98a005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:32.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.960+0000 7f98bed9d700 1 --2- 172.21.15.45:0/1536549093 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f98a005a510 0x7f98a005c9d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f98b0006d60 tx=0x7f98b0016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:32.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:32.964+0000 7f98b77fe700 1 -- 172.21.15.45:0/1536549093 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f98a8047ca0 con 0x7f98c01518f0 2023-12-22T10:01:33.000 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:01:33.007 DEBUG:teuthology.orchestra.run.smithi113:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:01:33.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.128+0000 7f98c5169700 1 -- 172.21.15.45:0/1536549093 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f98c006c070 con 0x7f98c01518f0 2023-12-22T10:01:33.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.128+0000 7f98b77fe700 1 -- 172.21.15.45:0/1536549093 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v32) v1 ==== 84+0+143 (secure 0 0 0) 0x7f98a804b2c0 con 0x7f98c01518f0 2023-12-22T10:01:33.129 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:01:33.129 INFO:teuthology.orchestra.run.smithi045.stdout:[ 2023-12-22T10:01:33.130 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:33.130 INFO:teuthology.orchestra.run.smithi045.stdout: "poolnum": 1, 2023-12-22T10:01:33.130 INFO:teuthology.orchestra.run.smithi045.stdout: "poolname": "device_health_metrics" 2023-12-22T10:01:33.130 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:33.130 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-22T10:01:33.130 INFO:teuthology.orchestra.run.smithi045.stdout: "poolnum": 2, 2023-12-22T10:01:33.130 INFO:teuthology.orchestra.run.smithi045.stdout: "poolname": "rbd" 2023-12-22T10:01:33.130 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-22T10:01:33.130 INFO:teuthology.orchestra.run.smithi045.stdout:] 2023-12-22T10:01:33.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.132+0000 7f98c5169700 1 -- 172.21.15.45:0/1536549093 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f98a005a510 msgr2=0x7f98a005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:33.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.132+0000 7f98c5169700 1 --2- 172.21.15.45:0/1536549093 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f98a005a510 0x7f98a005c9d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f98b0006d60 tx=0x7f98b0016000).stop 2023-12-22T10:01:33.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.132+0000 7f98c5169700 1 -- 172.21.15.45:0/1536549093 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98c01518f0 msgr2=0x7f98c0165950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:33.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.132+0000 7f98c5169700 1 --2- 172.21.15.45:0/1536549093 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98c01518f0 0x7f98c0165950 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7f98a800c7f0 tx=0x7f98a8002650).stop 2023-12-22T10:01:33.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.132+0000 7f98c5169700 1 -- 172.21.15.45:0/1536549093 shutdown_connections 2023-12-22T10:01:33.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.132+0000 7f98c5169700 1 --2- 172.21.15.45:0/1536549093 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f98c0151cd0 0x7f98c0164740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:33.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.132+0000 7f98c5169700 1 --2- 172.21.15.45:0/1536549093 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98c01518f0 0x7f98c0165950 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:33.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.132+0000 7f98c5169700 1 --2- 172.21.15.45:0/1536549093 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f98a005a510 0x7f98a005c9d0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:33.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.132+0000 7f98c5169700 1 --2- 172.21.15.45:0/1536549093 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f98c00a7420 0x7f98c0146430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:33.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.132+0000 7f98c5169700 1 -- 172.21.15.45:0/1536549093 >> 172.21.15.45:0/1536549093 conn(0x7f98c0066a70 msgr2=0x7f98c00c4540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:33.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.132+0000 7f98c5169700 1 -- 172.21.15.45:0/1536549093 shutdown_connections 2023-12-22T10:01:33.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.132+0000 7f98c5169700 1 -- 172.21.15.45:0/1536549093 wait complete. 2023-12-22T10:01:33.153 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-22T10:01:33.153 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-12-22T10:01:33.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.324+0000 7f43f8b07700 1 Processor -- start 2023-12-22T10:01:33.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.324+0000 7f43f8b07700 1 -- start start 2023-12-22T10:01:33.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.328+0000 7f43f8b07700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f43f414f310 0x7f43f4152c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:33.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.328+0000 7f43f8b07700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f43f40a8ed0 0x7f43f40c4b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:33.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.328+0000 7f43f8b07700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43f4152780 con 0x7f43f414f6f0 2023-12-22T10:01:33.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.328+0000 7f43f8b07700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43f40c5210 con 0x7f43f40a8ed0 2023-12-22T10:01:33.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.328+0000 7f43f8b07700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43f4152130 con 0x7f43f414f310 2023-12-22T10:01:33.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.328+0000 7f43f3fff700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f43f40a8ed0 0x7f43f40c4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:33.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.328+0000 7f43f37fe700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f43f414f310 0x7f43f4152c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:33.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.328+0000 7f43f3fff700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f43f40a8ed0 0x7f43f40c4b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.45:33470/0 (socket says 172.21.15.45:33470) 2023-12-22T10:01:33.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.328+0000 7f43f3fff700 1 -- 172.21.15.45:0/2541255101 learned_addr learned my addr 172.21.15.45:0/2541255101 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:33.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.328+0000 7f43f2ffd700 1 --1- 172.21.15.45:0/2541255101 >> v1:172.21.15.113:6789/0 conn(0x7f43f414f6f0 0x7f43f40a87c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.45:51052/0 (socket says 172.21.15.45:51052) 2023-12-22T10:01:33.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.328+0000 7f43f3fff700 1 -- 172.21.15.45:0/2541255101 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f43f414f310 msgr2=0x7f43f4152c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:33.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.328+0000 7f43f3fff700 1 --2- 172.21.15.45:0/2541255101 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f43f414f310 0x7f43f4152c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:33.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.328+0000 7f43f3fff700 1 -- 172.21.15.45:0/2541255101 >> v1:172.21.15.113:6789/0 conn(0x7f43f414f6f0 legacy=0x7f43f40a87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:33.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.328+0000 7f43f3fff700 1 -- 172.21.15.45:0/2541255101 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43f4152410 con 0x7f43f40a8ed0 2023-12-22T10:01:33.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.328+0000 7f43f37fe700 1 --2- 172.21.15.45:0/2541255101 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f43f414f310 0x7f43f4152c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-12-22T10:01:33.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.328+0000 7f43f3fff700 1 --2- 172.21.15.45:0/2541255101 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f43f40a8ed0 0x7f43f40c4b80 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f43ec009f20 tx=0x7f43ec009840).ready entity=mon.1 client_cookie=5a6902945eae1fc3 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:33.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.328+0000 7f43f27fc700 1 -- 172.21.15.45:0/2541255101 <== mon.1 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43ec00e070 con 0x7f43f40a8ed0 2023-12-22T10:01:33.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.328+0000 7f43f27fc700 1 -- 172.21.15.45:0/2541255101 <== mon.1 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43ec00b9d0 con 0x7f43f40a8ed0 2023-12-22T10:01:33.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.328+0000 7f43f27fc700 1 -- 172.21.15.45:0/2541255101 <== mon.1 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43ec00bd50 con 0x7f43f40a8ed0 2023-12-22T10:01:33.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.332+0000 7f43f8b07700 1 -- 172.21.15.45:0/2541255101 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f43f40a8ed0 msgr2=0x7f43f40c4b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:33.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.332+0000 7f43f8b07700 1 --2- 172.21.15.45:0/2541255101 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f43f40a8ed0 0x7f43f40c4b80 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f43ec009f20 tx=0x7f43ec009840).stop 2023-12-22T10:01:33.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.332+0000 7f43f8b07700 1 -- 172.21.15.45:0/2541255101 shutdown_connections 2023-12-22T10:01:33.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.332+0000 7f43f8b07700 1 --2- 172.21.15.45:0/2541255101 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f43f40a8ed0 0x7f43f40c4b80 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:33.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.332+0000 7f43f8b07700 1 --2- 172.21.15.45:0/2541255101 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f43f414f310 0x7f43f4152c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:33.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.332+0000 7f43f8b07700 1 -- 172.21.15.45:0/2541255101 >> 172.21.15.45:0/2541255101 conn(0x7f43f4067500 msgr2=0x7f43f40c6440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:33.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.332+0000 7f43f8b07700 1 -- 172.21.15.45:0/2541255101 shutdown_connections 2023-12-22T10:01:33.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.332+0000 7f43f8b07700 1 -- 172.21.15.45:0/2541255101 wait complete. 2023-12-22T10:01:33.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.336+0000 7f43f8b07700 1 Processor -- start 2023-12-22T10:01:33.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.336+0000 7f43f8b07700 1 -- start start 2023-12-22T10:01:33.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.336+0000 7f43f8b07700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f43f40a8ed0 0x7f43f40c0f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:33.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.336+0000 7f43f8b07700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43f414f310 0x7f43f40c23a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:33.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.336+0000 7f43f8b07700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f43f414f6f0 0x7f43f40bd8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:33.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.336+0000 7f43f8b07700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43f40c02b0 con 0x7f43f414f310 2023-12-22T10:01:33.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.336+0000 7f43f8b07700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43f40bf460 con 0x7f43f40a8ed0 2023-12-22T10:01:33.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.336+0000 7f43f8b07700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43f40bf6e0 con 0x7f43f414f6f0 2023-12-22T10:01:33.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.336+0000 7f43f37fe700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f43f40a8ed0 0x7f43f40c0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:33.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.336+0000 7f43f2ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43f414f310 0x7f43f40c23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:33.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.336+0000 7f43f3fff700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f43f414f6f0 0x7f43f40bd8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:33.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.336+0000 7f43f37fe700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f43f40a8ed0 0x7f43f40c0f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.45:33486/0 (socket says 172.21.15.45:33486) 2023-12-22T10:01:33.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.336+0000 7f43f3fff700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f43f414f6f0 0x7f43f40bd8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.113:3301/0 says I am v2:172.21.15.45:38482/0 (socket says 172.21.15.45:38482) 2023-12-22T10:01:33.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.336+0000 7f43f37fe700 1 -- 172.21.15.45:0/223468740 learned_addr learned my addr 172.21.15.45:0/223468740 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:33.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.336+0000 7f43f37fe700 1 -- 172.21.15.45:0/223468740 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f43f414f6f0 msgr2=0x7f43f40bd8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:33.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.336+0000 7f43f37fe700 1 --2- 172.21.15.45:0/223468740 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f43f414f6f0 0x7f43f40bd8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:33.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.336+0000 7f43f37fe700 1 -- 172.21.15.45:0/223468740 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43f414f310 msgr2=0x7f43f40c23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:33.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.336+0000 7f43f37fe700 1 --2- 172.21.15.45:0/223468740 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43f414f310 0x7f43f40c23a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:33.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.336+0000 7f43f37fe700 1 -- 172.21.15.45:0/223468740 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43e40092a0 con 0x7f43f40a8ed0 2023-12-22T10:01:33.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.340+0000 7f43f37fe700 1 --2- 172.21.15.45:0/223468740 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f43f40a8ed0 0x7f43f40c0f50 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f43e400e980 tx=0x7f43e4009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:33.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.340+0000 7f43db7fe700 1 -- 172.21.15.45:0/223468740 <== mon.1 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e4009560 con 0x7f43f40a8ed0 2023-12-22T10:01:33.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.340+0000 7f43db7fe700 1 -- 172.21.15.45:0/223468740 <== mon.1 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43e4012600 con 0x7f43f40a8ed0 2023-12-22T10:01:33.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.340+0000 7f43db7fe700 1 -- 172.21.15.45:0/223468740 <== mon.1 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e4012980 con 0x7f43f40a8ed0 2023-12-22T10:01:33.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.340+0000 7f43f8b07700 1 -- 172.21.15.45:0/223468740 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43ec009ae0 con 0x7f43f40a8ed0 2023-12-22T10:01:33.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.340+0000 7f43f8b07700 1 -- 172.21.15.45:0/223468740 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43f40bfc60 con 0x7f43f40a8ed0 2023-12-22T10:01:33.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.340+0000 7f43f8b07700 1 -- 172.21.15.45:0/223468740 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43f4047060 con 0x7f43f40a8ed0 2023-12-22T10:01:33.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.344+0000 7f43db7fe700 1 -- 172.21.15.45:0/223468740 <== mon.1 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f43e4012cf0 con 0x7f43f40a8ed0 2023-12-22T10:01:33.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.344+0000 7f43db7fe700 1 --2- 172.21.15.45:0/223468740 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f43e005a540 0x7f43e005ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:33.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.344+0000 7f43db7fe700 1 -- 172.21.15.45:0/223468740 <== mon.1 v2:172.21.15.113:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f43e40748c0 con 0x7f43f40a8ed0 2023-12-22T10:01:33.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.344+0000 7f43f2ffd700 1 --2- 172.21.15.45:0/223468740 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f43e005a540 0x7f43e005ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:33.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.344+0000 7f43f2ffd700 1 --2- 172.21.15.45:0/223468740 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f43e005a540 0x7f43e005ca00 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f43f40ac6e0 tx=0x7f43e8007d30).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:33.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.352+0000 7f43db7fe700 1 -- 172.21.15.45:0/223468740 <== mon.1 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f43e4048330 con 0x7f43f40a8ed0 2023-12-22T10:01:33.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.516+0000 7f43f8b07700 1 -- 172.21.15.45:0/223468740 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f43f40a9970 con 0x7f43f40a8ed0 2023-12-22T10:01:33.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.648+0000 7f43db7fe700 1 -- 172.21.15.45:0/223468740 <== mon.1 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v33) v1 ==== 152+0+0 (secure 0 0 0) 0x7f43e4016020 con 0x7f43f40a8ed0 2023-12-22T10:01:33.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.656+0000 7f43f8b07700 1 -- 172.21.15.45:0/223468740 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f43e005a540 msgr2=0x7f43e005ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:33.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.656+0000 7f43f8b07700 1 --2- 172.21.15.45:0/223468740 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f43e005a540 0x7f43e005ca00 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f43f40ac6e0 tx=0x7f43e8007d30).stop 2023-12-22T10:01:33.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.656+0000 7f43f8b07700 1 -- 172.21.15.45:0/223468740 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f43f40a8ed0 msgr2=0x7f43f40c0f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:33.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.656+0000 7f43f8b07700 1 --2- 172.21.15.45:0/223468740 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f43f40a8ed0 0x7f43f40c0f50 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f43e400e980 tx=0x7f43e4009060).stop 2023-12-22T10:01:33.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.656+0000 7f43f8b07700 1 -- 172.21.15.45:0/223468740 shutdown_connections 2023-12-22T10:01:33.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.656+0000 7f43f8b07700 1 --2- 172.21.15.45:0/223468740 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f43e005a540 0x7f43e005ca00 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:33.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.656+0000 7f43f8b07700 1 --2- 172.21.15.45:0/223468740 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f43f414f6f0 0x7f43f40bd8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:33.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.656+0000 7f43f8b07700 1 --2- 172.21.15.45:0/223468740 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43f414f310 0x7f43f40c23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:33.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.656+0000 7f43f8b07700 1 --2- 172.21.15.45:0/223468740 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f43f40a8ed0 0x7f43f40c0f50 secure :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0x7f43e400e980 tx=0x7f43e4009060).stop 2023-12-22T10:01:33.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.656+0000 7f43f8b07700 1 -- 172.21.15.45:0/223468740 >> 172.21.15.45:0/223468740 conn(0x7f43f4067500 msgr2=0x7f43f40a87c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:33.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.656+0000 7f43f8b07700 1 -- 172.21.15.45:0/223468740 shutdown_connections 2023-12-22T10:01:33.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.656+0000 7f43f8b07700 1 -- 172.21.15.45:0/223468740 wait complete. 2023-12-22T10:01:33.660 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_metadata' created 2023-12-22T10:01:33.677 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-22T10:01:33.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.864+0000 7ff4d4db9700 1 Processor -- start 2023-12-22T10:01:33.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.864+0000 7ff4d4db9700 1 -- start start 2023-12-22T10:01:33.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.868+0000 7ff4d4db9700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff4d0151940 0x7ff4d00c3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:33.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.868+0000 7ff4d4db9700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7ff4d01563a0 0x7ff4d0151d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:33.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.868+0000 7ff4d4db9700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4d0064f40 con 0x7ff4d00c43b0 2023-12-22T10:01:33.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.868+0000 7ff4d4db9700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4d0065b30 con 0x7ff4d0151940 2023-12-22T10:01:33.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.868+0000 7ff4d4db9700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4d0065190 con 0x7ff4d01563a0 2023-12-22T10:01:33.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.868+0000 7ff4cf7fe700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff4d0151940 0x7ff4d00c3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:33.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.868+0000 7ff4ceffd700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7ff4d00c43b0 0x7ff4d00bbe80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:41296/0 (socket says 172.21.15.45:41296) 2023-12-22T10:01:33.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.868+0000 7ff4cf7fe700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff4d0151940 0x7ff4d00c3ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35010/0 (socket says 172.21.15.45:35010) 2023-12-22T10:01:33.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.868+0000 7ff4ceffd700 1 -- 172.21.15.45:0/2526619724 learned_addr learned my addr 172.21.15.45:0/2526619724 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:01:33.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.868+0000 7ff4cffff700 1 --2- 172.21.15.45:0/2526619724 >> v2:172.21.15.113:3300/0 conn(0x7ff4d01563a0 0x7ff4d0151d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:33.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.868+0000 7ff4ce7fc700 1 -- 172.21.15.45:0/2526619724 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3554041726 0 0) 0x7ff4d0064f40 con 0x7ff4d00c43b0 2023-12-22T10:01:33.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.868+0000 7ff4cf7fe700 1 -- 172.21.15.45:0/2526619724 >> v2:172.21.15.113:3300/0 conn(0x7ff4d01563a0 msgr2=0x7ff4d0151d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:33.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.868+0000 7ff4cf7fe700 1 --2- 172.21.15.45:0/2526619724 >> v2:172.21.15.113:3300/0 conn(0x7ff4d01563a0 0x7ff4d0151d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:33.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.868+0000 7ff4cf7fe700 1 -- 172.21.15.45:0/2526619724 >> v1:172.21.15.45:6789/0 conn(0x7ff4d00c43b0 legacy=0x7ff4d00bbe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:33.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.868+0000 7ff4cf7fe700 1 -- 172.21.15.45:0/2526619724 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4d0065470 con 0x7ff4d0151940 2023-12-22T10:01:33.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.868+0000 7ff4cf7fe700 1 --2- 172.21.15.45:0/2526619724 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4d0151940 0x7ff4d00c3ec0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7ff4d0065a30 tx=0x7ff4c0009060).ready entity=mon.0 client_cookie=5c3f1d96f66437de server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:33.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.872+0000 7ff4ce7fc700 1 -- 172.21.15.45:0/2526619724 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c000f510 con 0x7ff4d0151940 2023-12-22T10:01:33.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.872+0000 7ff4ce7fc700 1 -- 172.21.15.45:0/2526619724 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4c000f670 con 0x7ff4d0151940 2023-12-22T10:01:33.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.872+0000 7ff4ce7fc700 1 -- 172.21.15.45:0/2526619724 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c000f9f0 con 0x7ff4d0151940 2023-12-22T10:01:33.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.872+0000 7ff4d4db9700 1 -- 172.21.15.45:0/2526619724 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4d0151940 msgr2=0x7ff4d00c3ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:33.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.872+0000 7ff4d4db9700 1 --2- 172.21.15.45:0/2526619724 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4d0151940 0x7ff4d00c3ec0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7ff4d0065a30 tx=0x7ff4c0009060).stop 2023-12-22T10:01:33.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.872+0000 7ff4d4db9700 1 -- 172.21.15.45:0/2526619724 shutdown_connections 2023-12-22T10:01:33.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.872+0000 7ff4d4db9700 1 --2- 172.21.15.45:0/2526619724 >> v2:172.21.15.113:3300/0 conn(0x7ff4d01563a0 0x7ff4d0151d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:33.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.872+0000 7ff4d4db9700 1 --2- 172.21.15.45:0/2526619724 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4d0151940 0x7ff4d00c3ec0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:33.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.872+0000 7ff4d4db9700 1 -- 172.21.15.45:0/2526619724 >> 172.21.15.45:0/2526619724 conn(0x7ff4d00c77e0 msgr2=0x7ff4d00c37b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:33.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.872+0000 7ff4d4db9700 1 -- 172.21.15.45:0/2526619724 shutdown_connections 2023-12-22T10:01:33.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.872+0000 7ff4d4db9700 1 -- 172.21.15.45:0/2526619724 wait complete. 2023-12-22T10:01:33.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.872+0000 7ff4d4db9700 1 Processor -- start 2023-12-22T10:01:33.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.872+0000 7ff4d4db9700 1 -- start start 2023-12-22T10:01:33.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.876+0000 7ff4d4db9700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ff4d00c43b0 0x7ff4d00a9510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:33.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.876+0000 7ff4d4db9700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff4d0151940 0x7ff4d01644c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:33.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.876+0000 7ff4d4db9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4d01563a0 0x7ff4d014ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:33.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.876+0000 7ff4d4db9700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d0165a00 con 0x7ff4d01563a0 2023-12-22T10:01:33.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.876+0000 7ff4d4db9700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d0164d80 con 0x7ff4d0151940 2023-12-22T10:01:33.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.876+0000 7ff4d4db9700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d0165060 con 0x7ff4d00c43b0 2023-12-22T10:01:33.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.876+0000 7ff4cffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4d01563a0 0x7ff4d014ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:33.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.876+0000 7ff4cffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4d01563a0 0x7ff4d014ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35022/0 (socket says 172.21.15.45:35022) 2023-12-22T10:01:33.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.876+0000 7ff4cffff700 1 -- 172.21.15.45:0/2279108739 learned_addr learned my addr 172.21.15.45:0/2279108739 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:33.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.876+0000 7ff4cf7fe700 1 --2- 172.21.15.45:0/2279108739 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ff4d00c43b0 0x7ff4d00a9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:33.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.876+0000 7ff4ceffd700 1 --2- 172.21.15.45:0/2279108739 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff4d0151940 0x7ff4d01644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:33.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.876+0000 7ff4cffff700 1 -- 172.21.15.45:0/2279108739 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ff4d00c43b0 msgr2=0x7ff4d00a9510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:33.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.876+0000 7ff4cffff700 1 --2- 172.21.15.45:0/2279108739 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ff4d00c43b0 0x7ff4d00a9510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:33.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.876+0000 7ff4cffff700 1 -- 172.21.15.45:0/2279108739 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff4d0151940 msgr2=0x7ff4d01644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:33.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.876+0000 7ff4cffff700 1 --2- 172.21.15.45:0/2279108739 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff4d0151940 0x7ff4d01644c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:33.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.876+0000 7ff4cffff700 1 -- 172.21.15.45:0/2279108739 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4c00092a0 con 0x7ff4d01563a0 2023-12-22T10:01:33.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.876+0000 7ff4cffff700 1 --2- 172.21.15.45:0/2279108739 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4d01563a0 0x7ff4d014ffb0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7ff4c8009df0 tx=0x7ff4c800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:33.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.876+0000 7ff4b77fe700 1 -- 172.21.15.45:0/2279108739 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c800caa0 con 0x7ff4d01563a0 2023-12-22T10:01:33.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.876+0000 7ff4b77fe700 1 -- 172.21.15.45:0/2279108739 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4c800f040 con 0x7ff4d01563a0 2023-12-22T10:01:33.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.876+0000 7ff4d4db9700 1 -- 172.21.15.45:0/2279108739 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4d0165340 con 0x7ff4d01563a0 2023-12-22T10:01:33.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.876+0000 7ff4b77fe700 1 -- 172.21.15.45:0/2279108739 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c800ce10 con 0x7ff4d01563a0 2023-12-22T10:01:33.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.876+0000 7ff4d4db9700 1 -- 172.21.15.45:0/2279108739 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4d01649b0 con 0x7ff4d01563a0 2023-12-22T10:01:33.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.880+0000 7ff4d4db9700 1 -- 172.21.15.45:0/2279108739 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4d0165bb0 con 0x7ff4d01563a0 2023-12-22T10:01:33.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.880+0000 7ff4b77fe700 1 -- 172.21.15.45:0/2279108739 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7ff4c8013610 con 0x7ff4d01563a0 2023-12-22T10:01:33.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.880+0000 7ff4b77fe700 1 --2- 172.21.15.45:0/2279108739 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7ff4bc05a510 0x7ff4bc05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:33.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.880+0000 7ff4b77fe700 1 -- 172.21.15.45:0/2279108739 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5639+0+0 (secure 0 0 0) 0x7ff4c8074da0 con 0x7ff4d01563a0 2023-12-22T10:01:33.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.880+0000 7ff4cf7fe700 1 --2- 172.21.15.45:0/2279108739 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7ff4bc05a510 0x7ff4bc05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:33.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.884+0000 7ff4cf7fe700 1 --2- 172.21.15.45:0/2279108739 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7ff4bc05a510 0x7ff4bc05c9d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7ff4d0065a30 tx=0x7ff4c0017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:33.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:33.888+0000 7ff4b77fe700 1 -- 172.21.15.45:0/2279108739 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff4d0165bb0 con 0x7ff4d01563a0 2023-12-22T10:01:34.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:34.056+0000 7ff4d4db9700 1 -- 172.21.15.45:0/2279108739 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7ff4d0047060 con 0x7ff4d01563a0 2023-12-22T10:01:34.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:34.660+0000 7ff4b77fe700 1 -- 172.21.15.45:0/2279108739 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v34) v1 ==== 170+0+0 (secure 0 0 0) 0x7ff4c80486a0 con 0x7ff4d01563a0 2023-12-22T10:01:34.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:34.668+0000 7ff4d4db9700 1 -- 172.21.15.45:0/2279108739 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7ff4bc05a510 msgr2=0x7ff4bc05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:34.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:34.668+0000 7ff4d4db9700 1 --2- 172.21.15.45:0/2279108739 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7ff4bc05a510 0x7ff4bc05c9d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7ff4d0065a30 tx=0x7ff4c0017000).stop 2023-12-22T10:01:34.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:34.668+0000 7ff4d4db9700 1 -- 172.21.15.45:0/2279108739 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4d01563a0 msgr2=0x7ff4d014ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:34.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:34.668+0000 7ff4d4db9700 1 --2- 172.21.15.45:0/2279108739 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4d01563a0 0x7ff4d014ffb0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7ff4c8009df0 tx=0x7ff4c800b040).stop 2023-12-22T10:01:34.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:34.668+0000 7ff4d4db9700 1 -- 172.21.15.45:0/2279108739 shutdown_connections 2023-12-22T10:01:34.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:34.668+0000 7ff4d4db9700 1 --2- 172.21.15.45:0/2279108739 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4d01563a0 0x7ff4d014ffb0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:34.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:34.668+0000 7ff4d4db9700 1 --2- 172.21.15.45:0/2279108739 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff4d0151940 0x7ff4d01644c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:34.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:34.668+0000 7ff4d4db9700 1 --2- 172.21.15.45:0/2279108739 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7ff4bc05a510 0x7ff4bc05c9d0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:34.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:34.668+0000 7ff4d4db9700 1 --2- 172.21.15.45:0/2279108739 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ff4d00c43b0 0x7ff4d00a9510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:34.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:34.668+0000 7ff4d4db9700 1 -- 172.21.15.45:0/2279108739 >> 172.21.15.45:0/2279108739 conn(0x7ff4d00c77e0 msgr2=0x7ff4d01526b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:34.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:34.672+0000 7ff4d4db9700 1 -- 172.21.15.45:0/2279108739 shutdown_connections 2023-12-22T10:01:34.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:34.672+0000 7ff4d4db9700 1 -- 172.21.15.45:0/2279108739 wait complete. 2023-12-22T10:01:34.683 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data' created 2023-12-22T10:01:34.705 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-22T10:01:34.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:34.872+0000 7f0d5359e700 1 Processor -- start 2023-12-22T10:01:34.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:34.872+0000 7f0d5359e700 1 -- start start 2023-12-22T10:01:34.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:34.876+0000 7f0d5359e700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f0d54150550 0x7f0d540c5a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:34.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:34.876+0000 7f0d5359e700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f0d54150930 0x7f0d540c5f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:34.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:34.876+0000 7f0d5359e700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d54155130 con 0x7f0d540c21e0 2023-12-22T10:01:34.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:34.876+0000 7f0d5359e700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d54154310 con 0x7f0d54150930 2023-12-22T10:01:34.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:34.876+0000 7f0d5359e700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d54154520 con 0x7f0d54150550 2023-12-22T10:01:34.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:34.876+0000 7f0d52d9d700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f0d540c21e0 0x7f0d540c2690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:41300/0 (socket says 172.21.15.45:41300) 2023-12-22T10:01:34.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:34.876+0000 7f0d52d9d700 1 -- 172.21.15.45:0/3815194454 learned_addr learned my addr 172.21.15.45:0/3815194454 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:01:34.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:34.876+0000 7f0d49d9b700 1 --2- 172.21.15.45:0/3815194454 >> v2:172.21.15.113:3300/0 conn(0x7f0d54150930 0x7f0d540c5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:34.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:34.876+0000 7f0d5259c700 1 --2- 172.21.15.45:0/3815194454 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f0d54150550 0x7f0d540c5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:34.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:34.876+0000 7f0d49d9b700 1 -- 172.21.15.45:0/3815194454 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f0d54150550 msgr2=0x7f0d540c5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:34.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:34.876+0000 7f0d49d9b700 1 --2- 172.21.15.45:0/3815194454 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f0d54150550 0x7f0d540c5a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:34.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:34.876+0000 7f0d49d9b700 1 -- 172.21.15.45:0/3815194454 >> v1:172.21.15.45:6789/0 conn(0x7f0d540c21e0 legacy=0x7f0d540c2690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:34.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:34.876+0000 7f0d49d9b700 1 -- 172.21.15.45:0/3815194454 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d54154800 con 0x7f0d54150930 2023-12-22T10:01:34.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:34.876+0000 7f0d49d9b700 1 --2- 172.21.15.45:0/3815194454 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0d54150930 0x7f0d540c5f30 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f0d3c009760 tx=0x7f0d3c009060).ready entity=mon.1 client_cookie=af2c20e3b798ad22 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:34.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:34.876+0000 7f0d51d9b700 1 -- 172.21.15.45:0/3815194454 <== mon.1 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d3c00f510 con 0x7f0d54150930 2023-12-22T10:01:34.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:34.876+0000 7f0d51d9b700 1 -- 172.21.15.45:0/3815194454 <== mon.1 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d3c00f670 con 0x7f0d54150930 2023-12-22T10:01:34.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:34.876+0000 7f0d51d9b700 1 -- 172.21.15.45:0/3815194454 <== mon.1 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d3c00f9f0 con 0x7f0d54150930 2023-12-22T10:01:34.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:34.880+0000 7f0d5359e700 1 -- 172.21.15.45:0/3815194454 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0d54150930 msgr2=0x7f0d540c5f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:34.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:34.880+0000 7f0d5359e700 1 --2- 172.21.15.45:0/3815194454 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0d54150930 0x7f0d540c5f30 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f0d3c009760 tx=0x7f0d3c009060).stop 2023-12-22T10:01:34.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:34.880+0000 7f0d5359e700 1 -- 172.21.15.45:0/3815194454 shutdown_connections 2023-12-22T10:01:34.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:34.880+0000 7f0d5359e700 1 --2- 172.21.15.45:0/3815194454 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0d54150930 0x7f0d540c5f30 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:34.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:34.880+0000 7f0d5359e700 1 --2- 172.21.15.45:0/3815194454 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f0d54150550 0x7f0d540c5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:34.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:34.880+0000 7f0d5359e700 1 -- 172.21.15.45:0/3815194454 >> 172.21.15.45:0/3815194454 conn(0x7f0d54067500 msgr2=0x7f0d540c6440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:34.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:34.880+0000 7f0d5359e700 1 -- 172.21.15.45:0/3815194454 shutdown_connections 2023-12-22T10:01:34.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:34.880+0000 7f0d5359e700 1 -- 172.21.15.45:0/3815194454 wait complete. 2023-12-22T10:01:34.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:34.884+0000 7f0d5359e700 1 Processor -- start 2023-12-22T10:01:34.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:34.884+0000 7f0d5359e700 1 -- start start 2023-12-22T10:01:34.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:34.884+0000 7f0d5359e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d540c21e0 0x7f0d540a7e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:34.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:34.884+0000 7f0d5359e700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f0d54150550 0x7f0d54069830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:34.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:34.884+0000 7f0d5359e700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0d54150930 0x7f0d54069d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:34.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:34.884+0000 7f0d5359e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d5406a210 con 0x7f0d540c21e0 2023-12-22T10:01:34.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:34.884+0000 7f0d5359e700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d54165540 con 0x7f0d54150930 2023-12-22T10:01:34.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:34.884+0000 7f0d5359e700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d54168360 con 0x7f0d54150550 2023-12-22T10:01:34.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:34.884+0000 7f0d5259c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d540c21e0 0x7f0d540a7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:34.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:34.884+0000 7f0d5259c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d540c21e0 0x7f0d540a7e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35032/0 (socket says 172.21.15.45:35032) 2023-12-22T10:01:34.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:34.884+0000 7f0d5259c700 1 -- 172.21.15.45:0/777682477 learned_addr learned my addr 172.21.15.45:0/777682477 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:34.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:34.884+0000 7f0d52d9d700 1 --2- 172.21.15.45:0/777682477 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0d54150930 0x7f0d54069d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:34.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:34.884+0000 7f0d49d9b700 1 --2- 172.21.15.45:0/777682477 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f0d54150550 0x7f0d54069830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:34.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:34.884+0000 7f0d5259c700 1 -- 172.21.15.45:0/777682477 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f0d54150550 msgr2=0x7f0d54069830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:34.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:34.884+0000 7f0d5259c700 1 --2- 172.21.15.45:0/777682477 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f0d54150550 0x7f0d54069830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:34.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:34.884+0000 7f0d5259c700 1 -- 172.21.15.45:0/777682477 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0d54150930 msgr2=0x7f0d54069d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:34.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:34.884+0000 7f0d5259c700 1 --2- 172.21.15.45:0/777682477 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0d54150930 0x7f0d54069d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:34.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:34.884+0000 7f0d5259c700 1 -- 172.21.15.45:0/777682477 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d3c0092a0 con 0x7f0d540c21e0 2023-12-22T10:01:34.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:34.884+0000 7f0d49d9b700 1 --2- 172.21.15.45:0/777682477 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f0d54150550 0x7f0d54069830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T10:01:34.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:34.884+0000 7f0d52d9d700 1 --2- 172.21.15.45:0/777682477 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0d54150930 0x7f0d54069d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T10:01:34.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:34.884+0000 7f0d5259c700 1 --2- 172.21.15.45:0/777682477 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d540c21e0 0x7f0d540a7e70 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7f0d4400e930 tx=0x7f0d44009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:34.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:34.884+0000 7f0d4affd700 1 -- 172.21.15.45:0/777682477 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d4400eed0 con 0x7f0d540c21e0 2023-12-22T10:01:34.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:34.888+0000 7f0d4affd700 1 -- 172.21.15.45:0/777682477 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d4400c850 con 0x7f0d540c21e0 2023-12-22T10:01:34.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:34.888+0000 7f0d5359e700 1 -- 172.21.15.45:0/777682477 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d5414eee0 con 0x7f0d540c21e0 2023-12-22T10:01:34.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:34.888+0000 7f0d4affd700 1 -- 172.21.15.45:0/777682477 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d4400cbd0 con 0x7f0d540c21e0 2023-12-22T10:01:34.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:34.888+0000 7f0d5359e700 1 -- 172.21.15.45:0/777682477 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d54167d90 con 0x7f0d540c21e0 2023-12-22T10:01:34.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:34.888+0000 7f0d4affd700 1 -- 172.21.15.45:0/777682477 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f0d4401b400 con 0x7f0d540c21e0 2023-12-22T10:01:34.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:34.888+0000 7f0d5359e700 1 -- 172.21.15.45:0/777682477 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d54047060 con 0x7f0d540c21e0 2023-12-22T10:01:34.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:34.888+0000 7f0d4affd700 1 --2- 172.21.15.45:0/777682477 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f0d3405a540 0x7f0d3405ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:34.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:34.888+0000 7f0d4affd700 1 -- 172.21.15.45:0/777682477 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6021+0+0 (secure 0 0 0) 0x7f0d44074d40 con 0x7f0d540c21e0 2023-12-22T10:01:34.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:34.892+0000 7f0d49d9b700 1 --2- 172.21.15.45:0/777682477 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f0d3405a540 0x7f0d3405ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:34.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:34.892+0000 7f0d49d9b700 1 --2- 172.21.15.45:0/777682477 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f0d3405a540 0x7f0d3405ca00 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f0d540c2e40 tx=0x7f0d3c017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:34.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:34.896+0000 7f0d4affd700 1 -- 172.21.15.45:0/777682477 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f0d44048550 con 0x7f0d540c21e0 2023-12-22T10:01:35.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.100+0000 7f0d5359e700 1 -- 172.21.15.45:0/777682477 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f0d541680b0 con 0x7f0d540c21e0 2023-12-22T10:01:35.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.112+0000 7f0d4affd700 1 -- 172.21.15.45:0/777682477 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v12) v1 ==== 172+0+0 (secure 0 0 0) 0x7f0d4404bb30 con 0x7f0d540c21e0 2023-12-22T10:01:35.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.124+0000 7f0d5359e700 1 -- 172.21.15.45:0/777682477 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f0d3405a540 msgr2=0x7f0d3405ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:35.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.124+0000 7f0d5359e700 1 --2- 172.21.15.45:0/777682477 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f0d3405a540 0x7f0d3405ca00 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f0d540c2e40 tx=0x7f0d3c017000).stop 2023-12-22T10:01:35.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.124+0000 7f0d5359e700 1 -- 172.21.15.45:0/777682477 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d540c21e0 msgr2=0x7f0d540a7e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:35.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.124+0000 7f0d5359e700 1 --2- 172.21.15.45:0/777682477 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d540c21e0 0x7f0d540a7e70 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7f0d4400e930 tx=0x7f0d44009060).stop 2023-12-22T10:01:35.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.124+0000 7f0d5359e700 1 -- 172.21.15.45:0/777682477 shutdown_connections 2023-12-22T10:01:35.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.124+0000 7f0d5359e700 1 --2- 172.21.15.45:0/777682477 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0d54150930 0x7f0d54069d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:35.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.124+0000 7f0d5359e700 1 --2- 172.21.15.45:0/777682477 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f0d3405a540 0x7f0d3405ca00 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:35.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.124+0000 7f0d5359e700 1 --2- 172.21.15.45:0/777682477 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f0d54150550 0x7f0d54069830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:35.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.124+0000 7f0d5359e700 1 --2- 172.21.15.45:0/777682477 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d540c21e0 0x7f0d540a7e70 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:35.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.128+0000 7f0d5359e700 1 -- 172.21.15.45:0/777682477 >> 172.21.15.45:0/777682477 conn(0x7f0d54067500 msgr2=0x7f0d540bc780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:35.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.128+0000 7f0d5359e700 1 -- 172.21.15.45:0/777682477 shutdown_connections 2023-12-22T10:01:35.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.128+0000 7f0d5359e700 1 -- 172.21.15.45:0/777682477 wait complete. 2023-12-22T10:01:35.136 INFO:teuthology.orchestra.run.smithi045.stderr:new fs with metadata pool 5 and data pool 6 2023-12-22T10:01:35.158 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T10:01:35.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.328+0000 7f933305b700 1 Processor -- start 2023-12-22T10:01:35.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.328+0000 7f933305b700 1 -- start start 2023-12-22T10:01:35.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.328+0000 7f933305b700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f932c151cd0 0x7f932c0a6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:35.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.328+0000 7f933305b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f932c0a7200 0x7f932c0c3160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:35.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.328+0000 7f933305b700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f932c0a76b0 con 0x7f932c1518f0 2023-12-22T10:01:35.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.328+0000 7f933305b700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f932c0c40f0 con 0x7f932c0a7200 2023-12-22T10:01:35.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.328+0000 7f933305b700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f932c155740 con 0x7f932c151cd0 2023-12-22T10:01:35.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.328+0000 7f9330df7700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f932c1518f0 0x7f932c064890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:41308/0 (socket says 172.21.15.45:41308) 2023-12-22T10:01:35.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.328+0000 7f9330df7700 1 -- 172.21.15.45:0/2977517464 learned_addr learned my addr 172.21.15.45:0/2977517464 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:01:35.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.328+0000 7f93315f8700 1 --2- 172.21.15.45:0/2977517464 >> v2:172.21.15.45:3300/0 conn(0x7f932c0a7200 0x7f932c0c3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:35.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.328+0000 7f932bfff700 1 --2- 172.21.15.45:0/2977517464 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f932c151cd0 0x7f932c0a6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:35.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.332+0000 7f932b7fe700 1 -- 172.21.15.45:0/2977517464 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1749168761 0 0) 0x7f932c0a76b0 con 0x7f932c1518f0 2023-12-22T10:01:35.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.332+0000 7f932b7fe700 1 -- 172.21.15.45:0/2977517464 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f931c0033f0 con 0x7f932c1518f0 2023-12-22T10:01:35.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.332+0000 7f932bfff700 1 -- 172.21.15.45:0/2977517464 >> v2:172.21.15.45:3300/0 conn(0x7f932c0a7200 msgr2=0x7f932c0c3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:35.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.332+0000 7f932bfff700 1 --2- 172.21.15.45:0/2977517464 >> v2:172.21.15.45:3300/0 conn(0x7f932c0a7200 0x7f932c0c3160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:35.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.332+0000 7f932bfff700 1 -- 172.21.15.45:0/2977517464 >> v1:172.21.15.45:6789/0 conn(0x7f932c1518f0 legacy=0x7f932c064890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:35.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.332+0000 7f932bfff700 1 -- 172.21.15.45:0/2977517464 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f932c0a61b0 con 0x7f932c151cd0 2023-12-22T10:01:35.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.332+0000 7f932bfff700 1 --2- 172.21.15.45:0/2977517464 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f932c151cd0 0x7f932c0a6d10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f9318009760 tx=0x7f9318009060).ready entity=mon.2 client_cookie=400bd4d19154015a server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:35.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.332+0000 7f932b7fe700 1 -- 172.21.15.45:0/2977517464 <== mon.2 v2:172.21.15.113:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f931800d4a0 con 0x7f932c151cd0 2023-12-22T10:01:35.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.332+0000 7f932b7fe700 1 -- 172.21.15.45:0/2977517464 <== mon.2 v2:172.21.15.113:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f931800d600 con 0x7f932c151cd0 2023-12-22T10:01:35.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.332+0000 7f932b7fe700 1 -- 172.21.15.45:0/2977517464 <== mon.2 v2:172.21.15.113:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f931800d980 con 0x7f932c151cd0 2023-12-22T10:01:35.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.332+0000 7f933305b700 1 -- 172.21.15.45:0/2977517464 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f932c151cd0 msgr2=0x7f932c0a6d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:35.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.332+0000 7f933305b700 1 --2- 172.21.15.45:0/2977517464 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f932c151cd0 0x7f932c0a6d10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f9318009760 tx=0x7f9318009060).stop 2023-12-22T10:01:35.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.332+0000 7f933305b700 1 -- 172.21.15.45:0/2977517464 shutdown_connections 2023-12-22T10:01:35.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.332+0000 7f933305b700 1 --2- 172.21.15.45:0/2977517464 >> v2:172.21.15.45:3300/0 conn(0x7f932c0a7200 0x7f932c0c3160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:35.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.332+0000 7f933305b700 1 --2- 172.21.15.45:0/2977517464 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f932c151cd0 0x7f932c0a6d10 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:35.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.332+0000 7f933305b700 1 -- 172.21.15.45:0/2977517464 >> 172.21.15.45:0/2977517464 conn(0x7f932c066a70 msgr2=0x7f932c066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:35.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.332+0000 7f933305b700 1 -- 172.21.15.45:0/2977517464 shutdown_connections 2023-12-22T10:01:35.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.332+0000 7f933305b700 1 -- 172.21.15.45:0/2977517464 wait complete. 2023-12-22T10:01:35.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.336+0000 7f933305b700 1 Processor -- start 2023-12-22T10:01:35.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.336+0000 7f933305b700 1 -- start start 2023-12-22T10:01:35.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.340+0000 7f933305b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f932c0a7200 0x7f932c146430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:35.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.340+0000 7f933305b700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f932c1518f0 0x7f932c0c0d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:35.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.340+0000 7f933305b700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f932c151cd0 0x7f932c0c1220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:35.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.340+0000 7f933305b700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f932c156000 con 0x7f932c0a7200 2023-12-22T10:01:35.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.340+0000 7f933305b700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f932c0c1880 con 0x7f932c151cd0 2023-12-22T10:01:35.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.340+0000 7f933305b700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f932c0c1b60 con 0x7f932c1518f0 2023-12-22T10:01:35.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.340+0000 7f9330df7700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f932c0a7200 0x7f932c146430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:35.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.340+0000 7f9330df7700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f932c0a7200 0x7f932c146430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35050/0 (socket says 172.21.15.45:35050) 2023-12-22T10:01:35.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.340+0000 7f9330df7700 1 -- 172.21.15.45:0/3384935770 learned_addr learned my addr 172.21.15.45:0/3384935770 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:35.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.340+0000 7f932bfff700 1 --2- 172.21.15.45:0/3384935770 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f932c1518f0 0x7f932c0c0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:35.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.340+0000 7f93315f8700 1 --2- 172.21.15.45:0/3384935770 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f932c151cd0 0x7f932c0c1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:35.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.340+0000 7f9330df7700 1 -- 172.21.15.45:0/3384935770 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f932c1518f0 msgr2=0x7f932c0c0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:35.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.340+0000 7f9330df7700 1 --2- 172.21.15.45:0/3384935770 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f932c1518f0 0x7f932c0c0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:35.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.340+0000 7f9330df7700 1 -- 172.21.15.45:0/3384935770 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f932c151cd0 msgr2=0x7f932c0c1220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:35.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.340+0000 7f9330df7700 1 --2- 172.21.15.45:0/3384935770 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f932c151cd0 0x7f932c0c1220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:35.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.340+0000 7f9330df7700 1 -- 172.21.15.45:0/3384935770 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93180092a0 con 0x7f932c0a7200 2023-12-22T10:01:35.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.340+0000 7f9330df7700 1 --2- 172.21.15.45:0/3384935770 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f932c0a7200 0x7f932c146430 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7f932000c820 tx=0x7f9320001650).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:35.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.340+0000 7f9328ff9700 1 -- 172.21.15.45:0/3384935770 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9320005d30 con 0x7f932c0a7200 2023-12-22T10:01:35.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.340+0000 7f9328ff9700 1 -- 172.21.15.45:0/3384935770 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9320005e90 con 0x7f932c0a7200 2023-12-22T10:01:35.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.340+0000 7f9328ff9700 1 -- 172.21.15.45:0/3384935770 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9320007340 con 0x7f932c0a7200 2023-12-22T10:01:35.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.340+0000 7f933305b700 1 -- 172.21.15.45:0/3384935770 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f932c0c1e40 con 0x7f932c0a7200 2023-12-22T10:01:35.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.340+0000 7f933305b700 1 -- 172.21.15.45:0/3384935770 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f932c0aab00 con 0x7f932c0a7200 2023-12-22T10:01:35.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.344+0000 7f933305b700 1 -- 172.21.15.45:0/3384935770 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f932c06c070 con 0x7f932c0a7200 2023-12-22T10:01:35.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.344+0000 7f9328ff9700 1 -- 172.21.15.45:0/3384935770 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f9320007730 con 0x7f932c0a7200 2023-12-22T10:01:35.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.344+0000 7f9328ff9700 1 --2- 172.21.15.45:0/3384935770 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f931005a510 0x7f931005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:35.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.344+0000 7f9328ff9700 1 -- 172.21.15.45:0/3384935770 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f9320074750 con 0x7f932c0a7200 2023-12-22T10:01:35.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.344+0000 7f932bfff700 1 --2- 172.21.15.45:0/3384935770 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f931005a510 0x7f931005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:35.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.348+0000 7f932bfff700 1 --2- 172.21.15.45:0/3384935770 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f931005a510 0x7f931005c9d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f932c14cb70 tx=0x7f9318016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:35.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.352+0000 7f9328ff9700 1 -- 172.21.15.45:0/3384935770 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f9320047f30 con 0x7f932c0a7200 2023-12-22T10:01:35.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.516+0000 7f933305b700 1 -- 172.21.15.45:0/3384935770 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f932c064fa0 con 0x7f932c0a7200 2023-12-22T10:01:35.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.520+0000 7f9328ff9700 1 -- 172.21.15.45:0/3384935770 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+16941 (secure 0 0 0) 0x7f932004b550 con 0x7f932c0a7200 2023-12-22T10:01:35.520 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:01:35.520 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":35,"fsid":"98b0837e-5e68-4c8f-a1a0-e9424baaad8f","created":"2023-12-22T10:00:15.010174+0000","modified":"2023-12-22T10:01:35.104691+0000","last_up_change":"2023-12-22T10:00:24.980513+0000","last_in_change":"2023-12-22T10:00:17.887172+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-12-22T10:00:25.069641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-12-22T10:00:26.906399+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-22T10:01:33.592093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-22T10:01:34.130811+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e19943a0-1c6b-47df-b6bb-383472077890","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":33777},{"type":"v1","addr":"172.21.15.45:6819","nonce":33777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":33777},{"type":"v1","addr":"172.21.15.45:6822","nonce":33777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":33777},{"type":"v1","addr":"172.21.15.45:6830","nonce":33777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":33777},{"type":"v1","addr":"172.21.15.45:6826","nonce":33777}]},"public_addr":"172.21.15.45:6819/33777","cluster_addr":"172.21.15.45:6822/33777","heartbeat_back_addr":"172.21.15.45:6830/33777","heartbeat_front_addr":"172.21.15.45:6826/33777","state":["exists","up"]},{"osd":1,"uuid":"69670f34-f082-45a7-8f67-e962acc136e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":33775},{"type":"v1","addr":"172.21.15.45:6809","nonce":33775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":33775},{"type":"v1","addr":"172.21.15.45:6811","nonce":33775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":33775},{"type":"v1","addr":"172.21.15.45:6815","nonce":33775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":33775},{"type":"v1","addr":"172.21.15.45:6813","nonce":33775}]},"public_addr":"172.21.15.45:6809/33775","cluster_addr":"172.21.15.45:6811/33775","heartbeat_back_addr":"172.21.15.45:6815/33775","heartbeat_front_addr":"172.21.15.45:6813/33775","state":["exists","up"]},{"osd":2,"uuid":"d909d49b-82b8-401b-9947-e49dd167bb95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":33776},{"type":"v1","addr":"172.21.15.45:6801","nonce":33776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":33776},{"type":"v1","addr":"172.21.15.45:6803","nonce":33776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":33776},{"type":"v1","addr":"172.21.15.45:6807","nonce":33776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":33776},{"type":"v1","addr":"172.21.15.45:6805","nonce":33776}]},"public_addr":"172.21.15.45:6801/33776","cluster_addr":"172.21.15.45:6803/33776","heartbeat_back_addr":"172.21.15.45:6807/33776","heartbeat_front_addr":"172.21.15.45:6805/33776","state":["exists","up"]},{"osd":3,"uuid":"db104ca9-3a94-4d39-a2be-bd06db888095","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":33782},{"type":"v1","addr":"172.21.15.45:6817","nonce":33782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":33782},{"type":"v1","addr":"172.21.15.45:6823","nonce":33782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":33782},{"type":"v1","addr":"172.21.15.45:6831","nonce":33782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":33782},{"type":"v1","addr":"172.21.15.45:6827","nonce":33782}]},"public_addr":"172.21.15.45:6817/33782","cluster_addr":"172.21.15.45:6823/33782","heartbeat_back_addr":"172.21.15.45:6831/33782","heartbeat_front_addr":"172.21.15.45:6827/33782","state":["exists","up"]},{"osd":4,"uuid":"9f4eaff4-e433-4479-a0d1-ee7a33375ca6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":34099},{"type":"v1","addr":"172.21.15.113:6811","nonce":34099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":34099},{"type":"v1","addr":"172.21.15.113:6815","nonce":34099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":34099},{"type":"v1","addr":"172.21.15.113:6823","nonce":34099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6816","nonce":34099},{"type":"v1","addr":"172.21.15.113:6818","nonce":34099}]},"public_addr":"172.21.15.113:6811/34099","cluster_addr":"172.21.15.113:6815/34099","heartbeat_back_addr":"172.21.15.113:6823/34099","heartbeat_front_addr":"172.21.15.113:6818/34099","state":["exists","up"]},{"osd":5,"uuid":"1efc5591-180b-43af-8611-0068aadc5aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":34100},{"type":"v1","addr":"172.21.15.113:6801","nonce":34100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":34100},{"type":"v1","addr":"172.21.15.113:6803","nonce":34100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":34100},{"type":"v1","addr":"172.21.15.113:6807","nonce":34100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":34100},{"type":"v1","addr":"172.21.15.113:6805","nonce":34100}]},"public_addr":"172.21.15.113:6801/34100","cluster_addr":"172.21.15.113:6803/34100","heartbeat_back_addr":"172.21.15.113:6807/34100","heartbeat_front_addr":"172.21.15.113:6805/34100","state":["exists","up"]},{"osd":6,"uuid":"6c89d9d8-c153-4a48-afa9-97e4c403f1ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":34101},{"type":"v1","addr":"172.21.15.113:6810","nonce":34101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6812","nonce":34101},{"type":"v1","addr":"172.21.15.113:6814","nonce":34101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6822","nonce":34101},{"type":"v1","addr":"172.21.15.113:6824","nonce":34101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":34101},{"type":"v1","addr":"172.21.15.113:6819","nonce":34101}]},"public_addr":"172.21.15.113:6810/34101","cluster_addr":"172.21.15.113:6814/34101","heartbeat_back_addr":"172.21.15.113:6824/34101","heartbeat_front_addr":"172.21.15.113:6819/34101","state":["exists","up"]},{"osd":7,"uuid":"1855e70c-23f6-4c08-ad7f-774c2148235b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6821","nonce":34102},{"type":"v1","addr":"172.21.15.113:6825","nonce":34102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":34102},{"type":"v1","addr":"172.21.15.113:6827","nonce":34102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":34102},{"type":"v1","addr":"172.21.15.113:6831","nonce":34102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6828","nonce":34102},{"type":"v1","addr":"172.21.15.113:6829","nonce":34102}]},"public_addr":"172.21.15.113:6825/34102","cluster_addr":"172.21.15.113:6827/34102","heartbeat_back_addr":"172.21.15.113:6831/34102","heartbeat_front_addr":"172.21.15.113:6829/34102","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.812672+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.825045+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.700105+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.856563+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.954683+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.883234+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.883994+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.821686+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T10:01:35.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.524+0000 7f933305b700 1 -- 172.21.15.45:0/3384935770 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f931005a510 msgr2=0x7f931005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:35.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.524+0000 7f933305b700 1 --2- 172.21.15.45:0/3384935770 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f931005a510 0x7f931005c9d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f932c14cb70 tx=0x7f9318016000).stop 2023-12-22T10:01:35.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.524+0000 7f933305b700 1 -- 172.21.15.45:0/3384935770 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f932c0a7200 msgr2=0x7f932c146430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:35.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.524+0000 7f933305b700 1 --2- 172.21.15.45:0/3384935770 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f932c0a7200 0x7f932c146430 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7f932000c820 tx=0x7f9320001650).stop 2023-12-22T10:01:35.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.524+0000 7f933305b700 1 -- 172.21.15.45:0/3384935770 shutdown_connections 2023-12-22T10:01:35.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.524+0000 7f933305b700 1 --2- 172.21.15.45:0/3384935770 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f932c151cd0 0x7f932c0c1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:35.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.524+0000 7f933305b700 1 --2- 172.21.15.45:0/3384935770 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f931005a510 0x7f931005c9d0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:35.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.524+0000 7f933305b700 1 --2- 172.21.15.45:0/3384935770 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f932c1518f0 0x7f932c0c0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:35.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.524+0000 7f933305b700 1 --2- 172.21.15.45:0/3384935770 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f932c0a7200 0x7f932c146430 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:35.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.524+0000 7f933305b700 1 -- 172.21.15.45:0/3384935770 >> 172.21.15.45:0/3384935770 conn(0x7f932c066a70 msgr2=0x7f932c0693e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:35.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.524+0000 7f933305b700 1 -- 172.21.15.45:0/3384935770 shutdown_connections 2023-12-22T10:01:35.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.524+0000 7f933305b700 1 -- 172.21.15.45:0/3384935770 wait complete. 2023-12-22T10:01:35.544 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T10:01:35.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.704+0000 7f1de7479700 1 Processor -- start 2023-12-22T10:01:35.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.704+0000 7f1de7479700 1 -- start start 2023-12-22T10:01:35.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.708+0000 7f1de7479700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1de00c1400 0x7f1de00c5960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:35.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.708+0000 7f1de7479700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1de00c5e50 0x7f1de00aa940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:35.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.708+0000 7f1de7479700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1de00c0f70 con 0x7f1de00a9ed0 2023-12-22T10:01:35.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.708+0000 7f1de7479700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1de00c1860 con 0x7f1de00c1400 2023-12-22T10:01:35.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.708+0000 7f1de7479700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1de00aa2b0 con 0x7f1de00c5e50 2023-12-22T10:01:35.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.708+0000 7f1de5c76700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1de00c1400 0x7f1de00c5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:35.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.708+0000 7f1de5c76700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1de00c1400 0x7f1de00c5960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35052/0 (socket says 172.21.15.45:35052) 2023-12-22T10:01:35.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.708+0000 7f1de5c76700 1 -- 172.21.15.45:0/1278087349 learned_addr learned my addr 172.21.15.45:0/1278087349 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:35.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.708+0000 7f1de6c78700 1 --2- 172.21.15.45:0/1278087349 >> v2:172.21.15.113:3300/0 conn(0x7f1de00c5e50 0x7f1de00aa940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:35.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.708+0000 7f1de5c76700 1 -- 172.21.15.45:0/1278087349 >> v2:172.21.15.113:3300/0 conn(0x7f1de00c5e50 msgr2=0x7f1de00aa940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:35.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.708+0000 7f1de5c76700 1 --2- 172.21.15.45:0/1278087349 >> v2:172.21.15.113:3300/0 conn(0x7f1de00c5e50 0x7f1de00aa940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:35.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.708+0000 7f1de5c76700 1 -- 172.21.15.45:0/1278087349 >> v1:172.21.15.113:6789/0 conn(0x7f1de00a9ed0 legacy=0x7f1de00bf910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:35.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.708+0000 7f1de5c76700 1 -- 172.21.15.45:0/1278087349 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1de00c0360 con 0x7f1de00c1400 2023-12-22T10:01:35.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.708+0000 7f1de6c78700 1 --2- 172.21.15.45:0/1278087349 >> v2:172.21.15.113:3300/0 conn(0x7f1de00c5e50 0x7f1de00aa940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-12-22T10:01:35.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.708+0000 7f1de5c76700 1 --2- 172.21.15.45:0/1278087349 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1de00c1400 0x7f1de00c5960 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7f1de0068350 tx=0x7f1dd00090f0).ready entity=mon.0 client_cookie=bdc0a13bec331f2c server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:35.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.708+0000 7f1de5475700 1 -- 172.21.15.45:0/1278087349 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd000b5a0 con 0x7f1de00c1400 2023-12-22T10:01:35.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.708+0000 7f1de5475700 1 -- 172.21.15.45:0/1278087349 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dd000b700 con 0x7f1de00c1400 2023-12-22T10:01:35.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.708+0000 7f1de5475700 1 -- 172.21.15.45:0/1278087349 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd000ba80 con 0x7f1de00c1400 2023-12-22T10:01:35.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.708+0000 7f1de7479700 1 -- 172.21.15.45:0/1278087349 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1de00c1400 msgr2=0x7f1de00c5960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:35.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.708+0000 7f1de7479700 1 --2- 172.21.15.45:0/1278087349 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1de00c1400 0x7f1de00c5960 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7f1de0068350 tx=0x7f1dd00090f0).stop 2023-12-22T10:01:35.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.708+0000 7f1de7479700 1 -- 172.21.15.45:0/1278087349 shutdown_connections 2023-12-22T10:01:35.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.708+0000 7f1de7479700 1 --2- 172.21.15.45:0/1278087349 >> v2:172.21.15.113:3300/0 conn(0x7f1de00c5e50 0x7f1de00aa940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:35.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.708+0000 7f1de7479700 1 --2- 172.21.15.45:0/1278087349 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1de00c1400 0x7f1de00c5960 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:35.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.708+0000 7f1de7479700 1 -- 172.21.15.45:0/1278087349 >> 172.21.15.45:0/1278087349 conn(0x7f1de0067500 msgr2=0x7f1de00ca9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:35.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.708+0000 7f1de7479700 1 -- 172.21.15.45:0/1278087349 shutdown_connections 2023-12-22T10:01:35.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.708+0000 7f1de7479700 1 -- 172.21.15.45:0/1278087349 wait complete. 2023-12-22T10:01:35.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.712+0000 7f1de7479700 1 Processor -- start 2023-12-22T10:01:35.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.712+0000 7f1de7479700 1 -- start start 2023-12-22T10:01:35.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.716+0000 7f1de7479700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1de00a9ed0 0x7f1de01540f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:35.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.716+0000 7f1de7479700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1de00c1400 0x7f1de014ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:35.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.716+0000 7f1de7479700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1de00c5e50 0x7f1de00c4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:35.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.716+0000 7f1de7479700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1de014f370 con 0x7f1de00c5e50 2023-12-22T10:01:35.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.716+0000 7f1de7479700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1de01545e0 con 0x7f1de00c1400 2023-12-22T10:01:35.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.716+0000 7f1de7479700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1de00aff20 con 0x7f1de00a9ed0 2023-12-22T10:01:35.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.716+0000 7f1de6c78700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1de00c5e50 0x7f1de00c4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:35.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.716+0000 7f1de6c78700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1de00c5e50 0x7f1de00c4760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35056/0 (socket says 172.21.15.45:35056) 2023-12-22T10:01:35.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.716+0000 7f1de6c78700 1 -- 172.21.15.45:0/2864942861 learned_addr learned my addr 172.21.15.45:0/2864942861 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:35.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.716+0000 7f1de6477700 1 --2- 172.21.15.45:0/2864942861 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1de00a9ed0 0x7f1de01540f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:35.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.716+0000 7f1de5c76700 1 --2- 172.21.15.45:0/2864942861 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1de00c1400 0x7f1de014ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:35.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.716+0000 7f1de6c78700 1 -- 172.21.15.45:0/2864942861 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1de00a9ed0 msgr2=0x7f1de01540f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:35.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.716+0000 7f1de6c78700 1 --2- 172.21.15.45:0/2864942861 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1de00a9ed0 0x7f1de01540f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:35.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.716+0000 7f1de6c78700 1 -- 172.21.15.45:0/2864942861 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1de00c1400 msgr2=0x7f1de014ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:35.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.716+0000 7f1de6c78700 1 --2- 172.21.15.45:0/2864942861 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1de00c1400 0x7f1de014ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:35.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.716+0000 7f1de6c78700 1 -- 172.21.15.45:0/2864942861 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dd0009370 con 0x7f1de00c5e50 2023-12-22T10:01:35.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.716+0000 7f1de6c78700 1 --2- 172.21.15.45:0/2864942861 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1de00c5e50 0x7f1de00c4760 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7f1dd800cef0 tx=0x7f1dd8007860).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:35.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.716+0000 7f1dd67fc700 1 -- 172.21.15.45:0/2864942861 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd800ad20 con 0x7f1de00c5e50 2023-12-22T10:01:35.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.716+0000 7f1dd67fc700 1 -- 172.21.15.45:0/2864942861 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dd800ae80 con 0x7f1de00c5e50 2023-12-22T10:01:35.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.716+0000 7f1de7479700 1 -- 172.21.15.45:0/2864942861 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1de00b0200 con 0x7f1de00c5e50 2023-12-22T10:01:35.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.720+0000 7f1dd67fc700 1 -- 172.21.15.45:0/2864942861 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd8016610 con 0x7f1de00c5e50 2023-12-22T10:01:35.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.720+0000 7f1de7479700 1 -- 172.21.15.45:0/2864942861 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1de014f580 con 0x7f1de00c5e50 2023-12-22T10:01:35.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.720+0000 7f1de7479700 1 -- 172.21.15.45:0/2864942861 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1de0047060 con 0x7f1de00c5e50 2023-12-22T10:01:35.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.720+0000 7f1dd67fc700 1 -- 172.21.15.45:0/2864942861 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f1dd80203f0 con 0x7f1de00c5e50 2023-12-22T10:01:35.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.724+0000 7f1dd67fc700 1 --2- 172.21.15.45:0/2864942861 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f1dc405a510 0x7f1dc405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:35.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.724+0000 7f1dd67fc700 1 -- 172.21.15.45:0/2864942861 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f1dd80751d0 con 0x7f1de00c5e50 2023-12-22T10:01:35.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.724+0000 7f1de6477700 1 --2- 172.21.15.45:0/2864942861 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f1dc405a510 0x7f1dc405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:35.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.724+0000 7f1de6477700 1 --2- 172.21.15.45:0/2864942861 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f1dc405a510 0x7f1dc405c9d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f1ddc00b940 tx=0x7f1ddc006ee0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:35.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.728+0000 7f1dd67fc700 1 -- 172.21.15.45:0/2864942861 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f1dd8048890 con 0x7f1de00c5e50 2023-12-22T10:01:35.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.896+0000 7f1de7479700 1 -- 172.21.15.45:0/2864942861 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1de00c0640 con 0x7f1de00c5e50 2023-12-22T10:01:35.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.900+0000 7f1dd67fc700 1 -- 172.21.15.45:0/2864942861 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+16941 (secure 0 0 0) 0x7f1dd804beb0 con 0x7f1de00c5e50 2023-12-22T10:01:35.899 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:01:35.899 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":35,"fsid":"98b0837e-5e68-4c8f-a1a0-e9424baaad8f","created":"2023-12-22T10:00:15.010174+0000","modified":"2023-12-22T10:01:35.104691+0000","last_up_change":"2023-12-22T10:00:24.980513+0000","last_in_change":"2023-12-22T10:00:17.887172+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-12-22T10:00:25.069641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-12-22T10:00:26.906399+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-22T10:01:33.592093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-22T10:01:34.130811+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e19943a0-1c6b-47df-b6bb-383472077890","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":33777},{"type":"v1","addr":"172.21.15.45:6819","nonce":33777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":33777},{"type":"v1","addr":"172.21.15.45:6822","nonce":33777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":33777},{"type":"v1","addr":"172.21.15.45:6830","nonce":33777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":33777},{"type":"v1","addr":"172.21.15.45:6826","nonce":33777}]},"public_addr":"172.21.15.45:6819/33777","cluster_addr":"172.21.15.45:6822/33777","heartbeat_back_addr":"172.21.15.45:6830/33777","heartbeat_front_addr":"172.21.15.45:6826/33777","state":["exists","up"]},{"osd":1,"uuid":"69670f34-f082-45a7-8f67-e962acc136e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":33775},{"type":"v1","addr":"172.21.15.45:6809","nonce":33775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":33775},{"type":"v1","addr":"172.21.15.45:6811","nonce":33775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":33775},{"type":"v1","addr":"172.21.15.45:6815","nonce":33775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":33775},{"type":"v1","addr":"172.21.15.45:6813","nonce":33775}]},"public_addr":"172.21.15.45:6809/33775","cluster_addr":"172.21.15.45:6811/33775","heartbeat_back_addr":"172.21.15.45:6815/33775","heartbeat_front_addr":"172.21.15.45:6813/33775","state":["exists","up"]},{"osd":2,"uuid":"d909d49b-82b8-401b-9947-e49dd167bb95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":33776},{"type":"v1","addr":"172.21.15.45:6801","nonce":33776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":33776},{"type":"v1","addr":"172.21.15.45:6803","nonce":33776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":33776},{"type":"v1","addr":"172.21.15.45:6807","nonce":33776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":33776},{"type":"v1","addr":"172.21.15.45:6805","nonce":33776}]},"public_addr":"172.21.15.45:6801/33776","cluster_addr":"172.21.15.45:6803/33776","heartbeat_back_addr":"172.21.15.45:6807/33776","heartbeat_front_addr":"172.21.15.45:6805/33776","state":["exists","up"]},{"osd":3,"uuid":"db104ca9-3a94-4d39-a2be-bd06db888095","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":33782},{"type":"v1","addr":"172.21.15.45:6817","nonce":33782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":33782},{"type":"v1","addr":"172.21.15.45:6823","nonce":33782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":33782},{"type":"v1","addr":"172.21.15.45:6831","nonce":33782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":33782},{"type":"v1","addr":"172.21.15.45:6827","nonce":33782}]},"public_addr":"172.21.15.45:6817/33782","cluster_addr":"172.21.15.45:6823/33782","heartbeat_back_addr":"172.21.15.45:6831/33782","heartbeat_front_addr":"172.21.15.45:6827/33782","state":["exists","up"]},{"osd":4,"uuid":"9f4eaff4-e433-4479-a0d1-ee7a33375ca6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":34099},{"type":"v1","addr":"172.21.15.113:6811","nonce":34099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":34099},{"type":"v1","addr":"172.21.15.113:6815","nonce":34099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":34099},{"type":"v1","addr":"172.21.15.113:6823","nonce":34099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6816","nonce":34099},{"type":"v1","addr":"172.21.15.113:6818","nonce":34099}]},"public_addr":"172.21.15.113:6811/34099","cluster_addr":"172.21.15.113:6815/34099","heartbeat_back_addr":"172.21.15.113:6823/34099","heartbeat_front_addr":"172.21.15.113:6818/34099","state":["exists","up"]},{"osd":5,"uuid":"1efc5591-180b-43af-8611-0068aadc5aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":34100},{"type":"v1","addr":"172.21.15.113:6801","nonce":34100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":34100},{"type":"v1","addr":"172.21.15.113:6803","nonce":34100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":34100},{"type":"v1","addr":"172.21.15.113:6807","nonce":34100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":34100},{"type":"v1","addr":"172.21.15.113:6805","nonce":34100}]},"public_addr":"172.21.15.113:6801/34100","cluster_addr":"172.21.15.113:6803/34100","heartbeat_back_addr":"172.21.15.113:6807/34100","heartbeat_front_addr":"172.21.15.113:6805/34100","state":["exists","up"]},{"osd":6,"uuid":"6c89d9d8-c153-4a48-afa9-97e4c403f1ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":34101},{"type":"v1","addr":"172.21.15.113:6810","nonce":34101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6812","nonce":34101},{"type":"v1","addr":"172.21.15.113:6814","nonce":34101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6822","nonce":34101},{"type":"v1","addr":"172.21.15.113:6824","nonce":34101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":34101},{"type":"v1","addr":"172.21.15.113:6819","nonce":34101}]},"public_addr":"172.21.15.113:6810/34101","cluster_addr":"172.21.15.113:6814/34101","heartbeat_back_addr":"172.21.15.113:6824/34101","heartbeat_front_addr":"172.21.15.113:6819/34101","state":["exists","up"]},{"osd":7,"uuid":"1855e70c-23f6-4c08-ad7f-774c2148235b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6821","nonce":34102},{"type":"v1","addr":"172.21.15.113:6825","nonce":34102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":34102},{"type":"v1","addr":"172.21.15.113:6827","nonce":34102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":34102},{"type":"v1","addr":"172.21.15.113:6831","nonce":34102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6828","nonce":34102},{"type":"v1","addr":"172.21.15.113:6829","nonce":34102}]},"public_addr":"172.21.15.113:6825/34102","cluster_addr":"172.21.15.113:6827/34102","heartbeat_back_addr":"172.21.15.113:6831/34102","heartbeat_front_addr":"172.21.15.113:6829/34102","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.812672+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.825045+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.700105+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.856563+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.954683+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.883234+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.883994+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.821686+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T10:01:35.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.904+0000 7f1de7479700 1 -- 172.21.15.45:0/2864942861 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f1dc405a510 msgr2=0x7f1dc405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:35.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.904+0000 7f1de7479700 1 --2- 172.21.15.45:0/2864942861 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f1dc405a510 0x7f1dc405c9d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f1ddc00b940 tx=0x7f1ddc006ee0).stop 2023-12-22T10:01:35.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.904+0000 7f1de7479700 1 -- 172.21.15.45:0/2864942861 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1de00c5e50 msgr2=0x7f1de00c4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:35.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.904+0000 7f1de7479700 1 --2- 172.21.15.45:0/2864942861 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1de00c5e50 0x7f1de00c4760 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7f1dd800cef0 tx=0x7f1dd8007860).stop 2023-12-22T10:01:35.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.904+0000 7f1de7479700 1 -- 172.21.15.45:0/2864942861 shutdown_connections 2023-12-22T10:01:35.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.904+0000 7f1de7479700 1 --2- 172.21.15.45:0/2864942861 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1de00c5e50 0x7f1de00c4760 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:35.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.904+0000 7f1de7479700 1 --2- 172.21.15.45:0/2864942861 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1de00c1400 0x7f1de014ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:35.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.904+0000 7f1de7479700 1 --2- 172.21.15.45:0/2864942861 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f1dc405a510 0x7f1dc405c9d0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:35.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.904+0000 7f1de7479700 1 --2- 172.21.15.45:0/2864942861 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1de00a9ed0 0x7f1de01540f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:35.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.904+0000 7f1de7479700 1 -- 172.21.15.45:0/2864942861 >> 172.21.15.45:0/2864942861 conn(0x7f1de0067500 msgr2=0x7f1de0068a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:35.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.904+0000 7f1de7479700 1 -- 172.21.15.45:0/2864942861 shutdown_connections 2023-12-22T10:01:35.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:35.904+0000 7f1de7479700 1 -- 172.21.15.45:0/2864942861 wait complete. 2023-12-22T10:01:35.922 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-22T10:01:36.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:36.092+0000 7fa7049a8700 1 Processor -- start 2023-12-22T10:01:36.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:36.096+0000 7fa7049a8700 1 -- start start 2023-12-22T10:01:36.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:36.096+0000 7fa7049a8700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fa700152c10 0x7fa70014f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:36.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:36.096+0000 7fa7049a8700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa700152780 con 0x7fa70014f310 2023-12-22T10:01:36.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:36.096+0000 7fa7049a8700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7000c5210 con 0x7fa7000a8ed0 2023-12-22T10:01:36.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:36.096+0000 7fa7049a8700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa700152130 con 0x7fa700152c10 2023-12-22T10:01:36.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:36.096+0000 7fa6fed9d700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fa70014f310 0x7fa7000a87c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:41324/0 (socket says 172.21.15.45:41324) 2023-12-22T10:01:36.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:36.096+0000 7fa6fed9d700 1 -- 172.21.15.45:0/3790211478 learned_addr learned my addr 172.21.15.45:0/3790211478 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:01:36.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:36.096+0000 7fa6ff59e700 1 --2- 172.21.15.45:0/3790211478 >> v2:172.21.15.113:3300/0 conn(0x7fa700152c10 0x7fa70014f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:36.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:36.100+0000 7fa6fdd9b700 1 -- 172.21.15.45:0/3790211478 <== mon.1 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2095021614 0 0) 0x7fa7000c5210 con 0x7fa7000a8ed0 2023-12-22T10:01:36.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:36.100+0000 7fa6fdd9b700 1 -- 172.21.15.45:0/3790211478 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6e80033f0 con 0x7fa7000a8ed0 2023-12-22T10:01:36.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:36.100+0000 7fa6fdd9b700 1 -- 172.21.15.45:0/3790211478 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 444993602 0 0) 0x7fa700152780 con 0x7fa70014f310 2023-12-22T10:01:36.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:36.100+0000 7fa6fdd9b700 1 -- 172.21.15.45:0/3790211478 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7000c5210 con 0x7fa70014f310 2023-12-22T10:01:36.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:36.100+0000 7fa6fdd9b700 1 -- 172.21.15.45:0/3790211478 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3974481622 0 0) 0x7fa7000c5210 con 0x7fa70014f310 2023-12-22T10:01:36.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:36.100+0000 7fa6ff59e700 1 -- 172.21.15.45:0/3790211478 >> v1:172.21.15.113:6789/0 conn(0x7fa7000a8ed0 legacy=0x7fa700068aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:36.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:36.100+0000 7fa6ff59e700 1 -- 172.21.15.45:0/3790211478 >> v1:172.21.15.45:6789/0 conn(0x7fa70014f310 legacy=0x7fa7000a87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:36.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:36.100+0000 7fa6ff59e700 1 -- 172.21.15.45:0/3790211478 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa700152410 con 0x7fa700152c10 2023-12-22T10:01:36.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:36.100+0000 7fa6ff59e700 1 --2- 172.21.15.45:0/3790211478 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa700152c10 0x7fa70014f6f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7fa6f8009e60 tx=0x7fa6f8009780).ready entity=mon.1 client_cookie=b02f0372fc5d9a27 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:36.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:36.100+0000 7fa6fdd9b700 1 -- 172.21.15.45:0/3790211478 <== mon.1 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f800e070 con 0x7fa700152c10 2023-12-22T10:01:36.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:36.100+0000 7fa6fdd9b700 1 -- 172.21.15.45:0/3790211478 <== mon.1 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6f800b7a0 con 0x7fa700152c10 2023-12-22T10:01:36.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:36.100+0000 7fa6fdd9b700 1 -- 172.21.15.45:0/3790211478 <== mon.1 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f0001470 con 0x7fa700152c10 2023-12-22T10:01:36.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:36.100+0000 7fa7049a8700 1 -- 172.21.15.45:0/3790211478 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa700152c10 msgr2=0x7fa70014f6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:36.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:36.100+0000 7fa7049a8700 1 --2- 172.21.15.45:0/3790211478 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa700152c10 0x7fa70014f6f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7fa6f8009e60 tx=0x7fa6f8009780).stop 2023-12-22T10:01:36.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:36.100+0000 7fa7049a8700 1 -- 172.21.15.45:0/3790211478 shutdown_connections 2023-12-22T10:01:36.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:36.100+0000 7fa7049a8700 1 --2- 172.21.15.45:0/3790211478 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa700152c10 0x7fa70014f6f0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:36.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:36.100+0000 7fa7049a8700 1 -- 172.21.15.45:0/3790211478 >> 172.21.15.45:0/3790211478 conn(0x7fa700067500 msgr2=0x7fa7000c6440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:36.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:36.100+0000 7fa7049a8700 1 -- 172.21.15.45:0/3790211478 shutdown_connections 2023-12-22T10:01:36.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:36.100+0000 7fa7049a8700 1 -- 172.21.15.45:0/3790211478 wait complete. 2023-12-22T10:01:36.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:36.104+0000 7fa7049a8700 1 Processor -- start 2023-12-22T10:01:36.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:36.104+0000 7fa7049a8700 1 -- start start 2023-12-22T10:01:36.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:36.104+0000 7fa7049a8700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa7000a8ed0 0x7fa700162c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:36.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:36.104+0000 7fa7049a8700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fa70014f310 0x7fa70015fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:36.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:36.104+0000 7fa7049a8700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa700152c10 0x7fa7001632b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:36.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:36.104+0000 7fa7049a8700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7000aa770 con 0x7fa700152c10 2023-12-22T10:01:36.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:36.104+0000 7fa7049a8700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa70014cf80 con 0x7fa7000a8ed0 2023-12-22T10:01:36.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:36.104+0000 7fa7049a8700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7000a9e80 con 0x7fa70014f310 2023-12-22T10:01:36.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:36.104+0000 7fa6ff59e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa700152c10 0x7fa7001632b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:36.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:36.104+0000 7fa6ff59e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa700152c10 0x7fa7001632b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35058/0 (socket says 172.21.15.45:35058) 2023-12-22T10:01:36.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:36.104+0000 7fa6ff59e700 1 -- 172.21.15.45:0/3768161918 learned_addr learned my addr 172.21.15.45:0/3768161918 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:36.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:36.104+0000 7fa6fed9d700 1 --2- 172.21.15.45:0/3768161918 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa7000a8ed0 0x7fa700162c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:36.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:36.104+0000 7fa6fe59c700 1 --2- 172.21.15.45:0/3768161918 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fa70014f310 0x7fa70015fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:36.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:36.104+0000 7fa6ff59e700 1 -- 172.21.15.45:0/3768161918 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fa70014f310 msgr2=0x7fa70015fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:36.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:36.104+0000 7fa6ff59e700 1 --2- 172.21.15.45:0/3768161918 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fa70014f310 0x7fa70015fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:36.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:36.104+0000 7fa6ff59e700 1 -- 172.21.15.45:0/3768161918 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa7000a8ed0 msgr2=0x7fa700162c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:36.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:36.104+0000 7fa6ff59e700 1 --2- 172.21.15.45:0/3768161918 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa7000a8ed0 0x7fa700162c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:36.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:36.104+0000 7fa6ff59e700 1 -- 172.21.15.45:0/3768161918 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6f8009a20 con 0x7fa700152c10 2023-12-22T10:01:36.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:36.108+0000 7fa6ff59e700 1 --2- 172.21.15.45:0/3768161918 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa700152c10 0x7fa7001632b0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7fa6f800b610 tx=0x7fa6f8009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:36.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:36.108+0000 7fa6e6ffd700 1 -- 172.21.15.45:0/3768161918 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f801d440 con 0x7fa700152c10 2023-12-22T10:01:36.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:36.108+0000 7fa6e6ffd700 1 -- 172.21.15.45:0/3768161918 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6f801d5a0 con 0x7fa700152c10 2023-12-22T10:01:36.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:36.108+0000 7fa7049a8700 1 -- 172.21.15.45:0/3768161918 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa700160260 con 0x7fa700152c10 2023-12-22T10:01:36.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:36.108+0000 7fa6e6ffd700 1 -- 172.21.15.45:0/3768161918 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f801d920 con 0x7fa700152c10 2023-12-22T10:01:36.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:36.108+0000 7fa7049a8700 1 -- 172.21.15.45:0/3768161918 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7000aa400 con 0x7fa700152c10 2023-12-22T10:01:36.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:36.108+0000 7fa7049a8700 1 -- 172.21.15.45:0/3768161918 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7000aa8e0 con 0x7fa700152c10 2023-12-22T10:01:36.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:36.112+0000 7fa6e6ffd700 1 -- 172.21.15.45:0/3768161918 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fa6f801dd10 con 0x7fa700152c10 2023-12-22T10:01:36.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:36.112+0000 7fa6e6ffd700 1 --2- 172.21.15.45:0/3768161918 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fa6ec05a4e0 0x7fa6ec05c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:36.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:36.112+0000 7fa6fed9d700 1 --2- 172.21.15.45:0/3768161918 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fa6ec05a4e0 0x7fa6ec05c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:36.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:36.112+0000 7fa6fed9d700 1 --2- 172.21.15.45:0/3768161918 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fa6ec05a4e0 0x7fa6ec05c9a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7fa6f00011e0 tx=0x7fa6f0001560).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:36.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:36.112+0000 7fa6e6ffd700 1 -- 172.21.15.45:0/3768161918 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fa6f804b700 con 0x7fa700152c10 2023-12-22T10:01:36.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:36.120+0000 7fa6e6ffd700 1 -- 172.21.15.45:0/3768161918 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fa6f8049900 con 0x7fa700152c10 2023-12-22T10:01:36.202 INFO:tasks.ceph.mds.c.smithi045.stderr:2023-12-22T10:01:36.204+0000 7fe4cdcf3700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-22T10:01:36.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:36.320+0000 7fa7049a8700 1 -- 172.21.15.45:0/3768161918 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fa700047060 con 0x7fa700152c10 2023-12-22T10:01:37.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:37.128+0000 7fa6e6ffd700 1 -- 172.21.15.45:0/3768161918 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) v1 ==== 118+0+0 (secure 0 0 0) 0x7fa6f8022030 con 0x7fa700152c10 2023-12-22T10:01:37.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:37.132+0000 7fa7049a8700 1 -- 172.21.15.45:0/3768161918 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fa6ec05a4e0 msgr2=0x7fa6ec05c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:37.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:37.132+0000 7fa7049a8700 1 --2- 172.21.15.45:0/3768161918 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fa6ec05a4e0 0x7fa6ec05c9a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7fa6f00011e0 tx=0x7fa6f0001560).stop 2023-12-22T10:01:37.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:37.132+0000 7fa7049a8700 1 -- 172.21.15.45:0/3768161918 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa700152c10 msgr2=0x7fa7001632b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:37.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:37.132+0000 7fa7049a8700 1 --2- 172.21.15.45:0/3768161918 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa700152c10 0x7fa7001632b0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7fa6f800b610 tx=0x7fa6f8009780).stop 2023-12-22T10:01:37.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:37.132+0000 7fa7049a8700 1 -- 172.21.15.45:0/3768161918 shutdown_connections 2023-12-22T10:01:37.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:37.132+0000 7fa7049a8700 1 --2- 172.21.15.45:0/3768161918 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa700152c10 0x7fa7001632b0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:37.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:37.132+0000 7fa7049a8700 1 --2- 172.21.15.45:0/3768161918 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fa6ec05a4e0 0x7fa6ec05c9a0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:37.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:37.132+0000 7fa7049a8700 1 --2- 172.21.15.45:0/3768161918 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fa70014f310 0x7fa70015fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:37.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:37.132+0000 7fa7049a8700 1 --2- 172.21.15.45:0/3768161918 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa7000a8ed0 0x7fa700162c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:37.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:37.132+0000 7fa7049a8700 1 -- 172.21.15.45:0/3768161918 >> 172.21.15.45:0/3768161918 conn(0x7fa700067500 msgr2=0x7fa700150b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:37.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:37.132+0000 7fa7049a8700 1 -- 172.21.15.45:0/3768161918 shutdown_connections 2023-12-22T10:01:37.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:37.132+0000 7fa7049a8700 1 -- 172.21.15.45:0/3768161918 wait complete. 2023-12-22T10:01:37.155 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-22T10:01:37.156 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-22T10:01:37.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:37.320+0000 7ff035079700 1 Processor -- start 2023-12-22T10:01:37.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:37.320+0000 7ff035079700 1 -- start start 2023-12-22T10:01:37.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:37.324+0000 7ff035079700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff030150930 0x7ff0300c21e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:37.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:37.324+0000 7ff035079700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7ff0300c26d0 0x7ff030068c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:37.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:37.324+0000 7ff035079700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff030155130 con 0x7ff030150550 2023-12-22T10:01:37.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:37.324+0000 7ff035079700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff030154310 con 0x7ff030150930 2023-12-22T10:01:37.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:37.324+0000 7ff035079700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff030154520 con 0x7ff0300c26d0 2023-12-22T10:01:37.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:37.328+0000 7ff0277fe700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff030150930 0x7ff0300c21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:37.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:37.328+0000 7ff02ffff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7ff030150550 0x7ff0300c5a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:41334/0 (socket says 172.21.15.45:41334) 2023-12-22T10:01:37.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:37.328+0000 7ff02ffff700 1 -- 172.21.15.45:0/1423881083 learned_addr learned my addr 172.21.15.45:0/1423881083 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:01:37.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:37.328+0000 7ff034878700 1 --2- 172.21.15.45:0/1423881083 >> v2:172.21.15.113:3300/0 conn(0x7ff0300c26d0 0x7ff030068c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:37.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:37.328+0000 7ff0277fe700 1 -- 172.21.15.45:0/1423881083 >> v2:172.21.15.113:3300/0 conn(0x7ff0300c26d0 msgr2=0x7ff030068c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:37.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:37.328+0000 7ff0277fe700 1 --2- 172.21.15.45:0/1423881083 >> v2:172.21.15.113:3300/0 conn(0x7ff0300c26d0 0x7ff030068c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:37.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:37.328+0000 7ff0277fe700 1 -- 172.21.15.45:0/1423881083 >> v1:172.21.15.45:6789/0 conn(0x7ff030150550 legacy=0x7ff0300c5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:37.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:37.328+0000 7ff0277fe700 1 -- 172.21.15.45:0/1423881083 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff030154800 con 0x7ff030150930 2023-12-22T10:01:37.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:37.328+0000 7ff0277fe700 1 --2- 172.21.15.45:0/1423881083 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff030150930 0x7ff0300c21e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7ff0300c4150 tx=0x7ff018009060).ready entity=mon.0 client_cookie=f91556896b7731e1 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:37.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:37.328+0000 7ff02f7fe700 1 -- 172.21.15.45:0/1423881083 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff01800f6b0 con 0x7ff030150930 2023-12-22T10:01:37.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:37.328+0000 7ff02f7fe700 1 -- 172.21.15.45:0/1423881083 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff01800f810 con 0x7ff030150930 2023-12-22T10:01:37.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:37.328+0000 7ff02f7fe700 1 -- 172.21.15.45:0/1423881083 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff01800fb90 con 0x7ff030150930 2023-12-22T10:01:37.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:37.328+0000 7ff035079700 1 -- 172.21.15.45:0/1423881083 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff030150930 msgr2=0x7ff0300c21e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:37.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:37.328+0000 7ff035079700 1 --2- 172.21.15.45:0/1423881083 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff030150930 0x7ff0300c21e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7ff0300c4150 tx=0x7ff018009060).stop 2023-12-22T10:01:37.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:37.328+0000 7ff035079700 1 -- 172.21.15.45:0/1423881083 shutdown_connections 2023-12-22T10:01:37.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:37.328+0000 7ff035079700 1 --2- 172.21.15.45:0/1423881083 >> v2:172.21.15.113:3300/0 conn(0x7ff0300c26d0 0x7ff030068c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:37.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:37.328+0000 7ff035079700 1 --2- 172.21.15.45:0/1423881083 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff030150930 0x7ff0300c21e0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:37.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:37.328+0000 7ff035079700 1 -- 172.21.15.45:0/1423881083 >> 172.21.15.45:0/1423881083 conn(0x7ff030067500 msgr2=0x7ff0300c6440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:37.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:37.328+0000 7ff035079700 1 -- 172.21.15.45:0/1423881083 shutdown_connections 2023-12-22T10:01:37.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:37.328+0000 7ff035079700 1 -- 172.21.15.45:0/1423881083 wait complete. 2023-12-22T10:01:37.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:37.332+0000 7ff035079700 1 Processor -- start 2023-12-22T10:01:37.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:37.332+0000 7ff035079700 1 -- start start 2023-12-22T10:01:37.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:37.336+0000 7ff035079700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff0300c26d0 0x7ff030149f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:37.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:37.336+0000 7ff035079700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ff030150550 0x7ff030150db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:37.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:37.336+0000 7ff035079700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff030150930 0x7ff0301512a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:37.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:37.336+0000 7ff035079700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff03014d6c0 con 0x7ff030150930 2023-12-22T10:01:37.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:37.336+0000 7ff035079700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff03014d390 con 0x7ff0300c26d0 2023-12-22T10:01:37.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:37.336+0000 7ff035079700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0300aa7b0 con 0x7ff030150550 2023-12-22T10:01:37.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:37.336+0000 7ff034878700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff030150930 0x7ff0301512a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:37.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:37.336+0000 7ff034878700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff030150930 0x7ff0301512a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35072/0 (socket says 172.21.15.45:35072) 2023-12-22T10:01:37.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:37.336+0000 7ff034878700 1 -- 172.21.15.45:0/1952391932 learned_addr learned my addr 172.21.15.45:0/1952391932 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:37.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:37.336+0000 7ff0277fe700 1 --2- 172.21.15.45:0/1952391932 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ff030150550 0x7ff030150db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:37.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:37.336+0000 7ff02ffff700 1 --2- 172.21.15.45:0/1952391932 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff0300c26d0 0x7ff030149f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:37.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:37.336+0000 7ff034878700 1 -- 172.21.15.45:0/1952391932 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ff030150550 msgr2=0x7ff030150db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:37.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:37.336+0000 7ff034878700 1 --2- 172.21.15.45:0/1952391932 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ff030150550 0x7ff030150db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:37.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:37.336+0000 7ff034878700 1 -- 172.21.15.45:0/1952391932 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff0300c26d0 msgr2=0x7ff030149f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:37.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:37.336+0000 7ff034878700 1 --2- 172.21.15.45:0/1952391932 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff0300c26d0 0x7ff030149f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:37.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:37.336+0000 7ff034878700 1 -- 172.21.15.45:0/1952391932 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0180092a0 con 0x7ff030150930 2023-12-22T10:01:37.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:37.336+0000 7ff034878700 1 --2- 172.21.15.45:0/1952391932 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff030150930 0x7ff0301512a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7ff028009e90 tx=0x7ff02800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:37.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:37.336+0000 7ff02cff9700 1 -- 172.21.15.45:0/1952391932 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff02800caa0 con 0x7ff030150930 2023-12-22T10:01:37.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:37.336+0000 7ff02cff9700 1 -- 172.21.15.45:0/1952391932 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff02800f040 con 0x7ff030150930 2023-12-22T10:01:37.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:37.336+0000 7ff035079700 1 -- 172.21.15.45:0/1952391932 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0300aaa90 con 0x7ff030150930 2023-12-22T10:01:37.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:37.336+0000 7ff02cff9700 1 -- 172.21.15.45:0/1952391932 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff02800ce10 con 0x7ff030150930 2023-12-22T10:01:37.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:37.336+0000 7ff035079700 1 -- 172.21.15.45:0/1952391932 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0300aa400 con 0x7ff030150930 2023-12-22T10:01:37.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:37.340+0000 7ff035079700 1 -- 172.21.15.45:0/1952391932 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0300aaf90 con 0x7ff030150930 2023-12-22T10:01:37.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:37.340+0000 7ff02cff9700 1 -- 172.21.15.45:0/1952391932 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7ff028013610 con 0x7ff030150930 2023-12-22T10:01:37.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:37.340+0000 7ff02cff9700 1 --2- 172.21.15.45:0/1952391932 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7ff01005a510 0x7ff01005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:37.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:37.344+0000 7ff02cff9700 1 -- 172.21.15.45:0/1952391932 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ff028075120 con 0x7ff030150930 2023-12-22T10:01:37.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:37.344+0000 7ff02ffff700 1 --2- 172.21.15.45:0/1952391932 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7ff01005a510 0x7ff01005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:37.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:37.344+0000 7ff02ffff700 1 --2- 172.21.15.45:0/1952391932 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7ff01005a510 0x7ff01005c9d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7ff020007fd0 tx=0x7ff020007d30).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:37.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:37.348+0000 7ff02cff9700 1 -- 172.21.15.45:0/1952391932 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff028048840 con 0x7ff030150930 2023-12-22T10:01:37.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:37.552+0000 7ff035079700 1 -- 172.21.15.45:0/1952391932 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7ff030047060 con 0x7ff030150930 2023-12-22T10:01:38.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.136+0000 7ff02cff9700 1 -- 172.21.15.45:0/1952391932 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff02804be60 con 0x7ff030150930 2023-12-22T10:01:38.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.144+0000 7ff035079700 1 -- 172.21.15.45:0/1952391932 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7ff01005a510 msgr2=0x7ff01005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:38.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.144+0000 7ff035079700 1 --2- 172.21.15.45:0/1952391932 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7ff01005a510 0x7ff01005c9d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7ff020007fd0 tx=0x7ff020007d30).stop 2023-12-22T10:01:38.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.144+0000 7ff035079700 1 -- 172.21.15.45:0/1952391932 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff030150930 msgr2=0x7ff0301512a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:38.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.144+0000 7ff035079700 1 --2- 172.21.15.45:0/1952391932 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff030150930 0x7ff0301512a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7ff028009e90 tx=0x7ff02800b040).stop 2023-12-22T10:01:38.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.144+0000 7ff035079700 1 -- 172.21.15.45:0/1952391932 shutdown_connections 2023-12-22T10:01:38.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.144+0000 7ff035079700 1 --2- 172.21.15.45:0/1952391932 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff030150930 0x7ff0301512a0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:38.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.144+0000 7ff035079700 1 --2- 172.21.15.45:0/1952391932 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7ff01005a510 0x7ff01005c9d0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:38.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.144+0000 7ff035079700 1 --2- 172.21.15.45:0/1952391932 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ff030150550 0x7ff030150db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:38.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.144+0000 7ff035079700 1 --2- 172.21.15.45:0/1952391932 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff0300c26d0 0x7ff030149f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:38.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.144+0000 7ff035079700 1 -- 172.21.15.45:0/1952391932 >> 172.21.15.45:0/1952391932 conn(0x7ff030067500 msgr2=0x7ff03014bdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:38.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.144+0000 7ff035079700 1 -- 172.21.15.45:0/1952391932 shutdown_connections 2023-12-22T10:01:38.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.144+0000 7ff035079700 1 -- 172.21.15.45:0/1952391932 wait complete. 2023-12-22T10:01:38.164 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-22T10:01:38.165 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T10:01:38.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.340+0000 7fd53f6f1700 1 Processor -- start 2023-12-22T10:01:38.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.340+0000 7fd53f6f1700 1 -- start start 2023-12-22T10:01:38.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.340+0000 7fd53f6f1700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd5380a8080 0x7fd538162c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:38.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.340+0000 7fd53f6f1700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5380a68b0 con 0x7fd538157e10 2023-12-22T10:01:38.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.340+0000 7fd53f6f1700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd538065610 con 0x7fd5381581f0 2023-12-22T10:01:38.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.340+0000 7fd53f6f1700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5380658f0 con 0x7fd5380a8080 2023-12-22T10:01:38.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.340+0000 7fd53d48d700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fd538157e10 0x7fd5380c1820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:58782/0 (socket says 172.21.15.45:58782) 2023-12-22T10:01:38.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.340+0000 7fd53d48d700 1 -- 172.21.15.45:0/3557460500 learned_addr learned my addr 172.21.15.45:0/3557460500 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:01:38.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.340+0000 7fd53dc8e700 1 --2- 172.21.15.45:0/3557460500 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd5380a8080 0x7fd538162c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:38.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.344+0000 7fd52ffff700 1 -- 172.21.15.45:0/3557460500 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2877391490 0 0) 0x7fd5380a68b0 con 0x7fd538157e10 2023-12-22T10:01:38.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.344+0000 7fd52ffff700 1 -- 172.21.15.45:0/3557460500 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5240033f0 con 0x7fd538157e10 2023-12-22T10:01:38.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.344+0000 7fd52ffff700 1 -- 172.21.15.45:0/3557460500 <== mon.1 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1530611461 0 0) 0x7fd538065610 con 0x7fd5381581f0 2023-12-22T10:01:38.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.344+0000 7fd52ffff700 1 -- 172.21.15.45:0/3557460500 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5380a68b0 con 0x7fd5381581f0 2023-12-22T10:01:38.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.344+0000 7fd53dc8e700 1 -- 172.21.15.45:0/3557460500 >> v1:172.21.15.113:6789/0 conn(0x7fd5381581f0 legacy=0x7fd5380c3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:38.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.344+0000 7fd53dc8e700 1 -- 172.21.15.45:0/3557460500 >> v1:172.21.15.45:6789/0 conn(0x7fd538157e10 legacy=0x7fd5380c1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:38.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.344+0000 7fd53dc8e700 1 -- 172.21.15.45:0/3557460500 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd538065bd0 con 0x7fd5380a8080 2023-12-22T10:01:38.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.344+0000 7fd53dc8e700 1 --2- 172.21.15.45:0/3557460500 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd5380a8080 0x7fd538162c20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fd530009e90 tx=0x7fd530009780).ready entity=mon.2 client_cookie=f68402b4cf8f3652 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:38.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.344+0000 7fd52ffff700 1 -- 172.21.15.45:0/3557460500 <== mon.2 v2:172.21.15.113:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd53000e070 con 0x7fd5380a8080 2023-12-22T10:01:38.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.344+0000 7fd52ffff700 1 -- 172.21.15.45:0/3557460500 <== mon.2 v2:172.21.15.113:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd53000bab0 con 0x7fd5380a8080 2023-12-22T10:01:38.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.344+0000 7fd52ffff700 1 -- 172.21.15.45:0/3557460500 <== mon.2 v2:172.21.15.113:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd53000be30 con 0x7fd5380a8080 2023-12-22T10:01:38.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.344+0000 7fd53f6f1700 1 -- 172.21.15.45:0/3557460500 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd5380a8080 msgr2=0x7fd538162c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:38.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.344+0000 7fd53f6f1700 1 --2- 172.21.15.45:0/3557460500 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd5380a8080 0x7fd538162c20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fd530009e90 tx=0x7fd530009780).stop 2023-12-22T10:01:38.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.344+0000 7fd53f6f1700 1 -- 172.21.15.45:0/3557460500 shutdown_connections 2023-12-22T10:01:38.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.344+0000 7fd53f6f1700 1 --2- 172.21.15.45:0/3557460500 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd5380a8080 0x7fd538162c20 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:38.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.344+0000 7fd53f6f1700 1 -- 172.21.15.45:0/3557460500 >> 172.21.15.45:0/3557460500 conn(0x7fd538066a70 msgr2=0x7fd538066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:38.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.344+0000 7fd53f6f1700 1 -- 172.21.15.45:0/3557460500 shutdown_connections 2023-12-22T10:01:38.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.344+0000 7fd53f6f1700 1 -- 172.21.15.45:0/3557460500 wait complete. 2023-12-22T10:01:38.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.348+0000 7fd53f6f1700 1 Processor -- start 2023-12-22T10:01:38.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.348+0000 7fd53f6f1700 1 -- start start 2023-12-22T10:01:38.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.348+0000 7fd53f6f1700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5380a8080 0x7fd538152bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:38.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.348+0000 7fd53f6f1700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd538157e10 0x7fd5380ac290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:38.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.348+0000 7fd53f6f1700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd5381581f0 0x7fd5380bdce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:38.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.348+0000 7fd53f6f1700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5380ac780 con 0x7fd5380a8080 2023-12-22T10:01:38.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.348+0000 7fd53f6f1700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5380ac990 con 0x7fd538157e10 2023-12-22T10:01:38.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.348+0000 7fd53f6f1700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd538152760 con 0x7fd5381581f0 2023-12-22T10:01:38.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.348+0000 7fd53d48d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5380a8080 0x7fd538152bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:38.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.348+0000 7fd53d48d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5380a8080 0x7fd538152bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37040/0 (socket says 172.21.15.45:37040) 2023-12-22T10:01:38.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.348+0000 7fd53d48d700 1 -- 172.21.15.45:0/4218783538 learned_addr learned my addr 172.21.15.45:0/4218783538 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:38.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.348+0000 7fd53cc8c700 1 --2- 172.21.15.45:0/4218783538 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd538157e10 0x7fd5380ac290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:38.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.348+0000 7fd53dc8e700 1 --2- 172.21.15.45:0/4218783538 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd5381581f0 0x7fd5380bdce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:38.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.352+0000 7fd53d48d700 1 -- 172.21.15.45:0/4218783538 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd5381581f0 msgr2=0x7fd5380bdce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:38.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.352+0000 7fd53d48d700 1 --2- 172.21.15.45:0/4218783538 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd5381581f0 0x7fd5380bdce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:38.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.352+0000 7fd53d48d700 1 -- 172.21.15.45:0/4218783538 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd538157e10 msgr2=0x7fd5380ac290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:38.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.352+0000 7fd53d48d700 1 --2- 172.21.15.45:0/4218783538 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd538157e10 0x7fd5380ac290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:38.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.352+0000 7fd53d48d700 1 -- 172.21.15.45:0/4218783538 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd530009a20 con 0x7fd5380a8080 2023-12-22T10:01:38.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.352+0000 7fd53d48d700 1 --2- 172.21.15.45:0/4218783538 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5380a8080 0x7fd538152bf0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7fd53400c560 tx=0x7fd534007d00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:38.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.352+0000 7fd52d7fa700 1 -- 172.21.15.45:0/4218783538 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd53400ce70 con 0x7fd5380a8080 2023-12-22T10:01:38.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.352+0000 7fd52d7fa700 1 -- 172.21.15.45:0/4218783538 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5340072e0 con 0x7fd5380a8080 2023-12-22T10:01:38.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.352+0000 7fd53f6f1700 1 -- 172.21.15.45:0/4218783538 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5380be1d0 con 0x7fd5380a8080 2023-12-22T10:01:38.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.352+0000 7fd52d7fa700 1 -- 172.21.15.45:0/4218783538 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5340057a0 con 0x7fd5380a8080 2023-12-22T10:01:38.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.352+0000 7fd53f6f1700 1 -- 172.21.15.45:0/4218783538 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd538152110 con 0x7fd5380a8080 2023-12-22T10:01:38.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.352+0000 7fd53f6f1700 1 -- 172.21.15.45:0/4218783538 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd53806c070 con 0x7fd5380a8080 2023-12-22T10:01:38.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.356+0000 7fd52d7fa700 1 -- 172.21.15.45:0/4218783538 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fd534005b90 con 0x7fd5380a8080 2023-12-22T10:01:38.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.356+0000 7fd52d7fa700 1 --2- 172.21.15.45:0/4218783538 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fd51c05a4e0 0x7fd51c05c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:38.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.356+0000 7fd52d7fa700 1 -- 172.21.15.45:0/4218783538 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fd534073e50 con 0x7fd5380a8080 2023-12-22T10:01:38.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.356+0000 7fd53cc8c700 1 --2- 172.21.15.45:0/4218783538 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fd51c05a4e0 0x7fd51c05c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:38.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.360+0000 7fd53cc8c700 1 --2- 172.21.15.45:0/4218783538 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fd51c05a4e0 0x7fd51c05c9a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7fd5380ab8a0 tx=0x7fd528007bd0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:38.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.364+0000 7fd52d7fa700 1 -- 172.21.15.45:0/4218783538 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd534047510 con 0x7fd5380a8080 2023-12-22T10:01:38.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.572+0000 7fd53f6f1700 1 -- 172.21.15.45:0/4218783538 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd538156fb0 con 0x7fd5380a8080 2023-12-22T10:01:38.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.572+0000 7fd52d7fa700 1 -- 172.21.15.45:0/4218783538 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4492 (secure 0 0 0) 0x7fd534018030 con 0x7fd5380a8080 2023-12-22T10:01:38.571 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:01:38.571 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4733,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6833/2948398569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6832","nonce":2948398569},{"type":"v1","addr":"172.21.15.113:6833","nonce":2948398569}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4736,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6835/1576156444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":1576156444},{"type":"v1","addr":"172.21.15.113:6835","nonce":1576156444}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4742,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/249598849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":249598849},{"type":"v1","addr":"172.21.15.45:6837","nonce":249598849}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T10:01:35.105595+0000","modified":"2023-12-22T10:01:38.130062+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4980},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4980":{"gid":4980,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.45:6835/1879154206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1879154206},{"type":"v1","addr":"172.21.15.45:6835","nonce":1879154206}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-12-22T10:01:38.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.576+0000 7fd53f6f1700 1 -- 172.21.15.45:0/4218783538 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fd51c05a4e0 msgr2=0x7fd51c05c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:38.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.576+0000 7fd53f6f1700 1 --2- 172.21.15.45:0/4218783538 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fd51c05a4e0 0x7fd51c05c9a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7fd5380ab8a0 tx=0x7fd528007bd0).stop 2023-12-22T10:01:38.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.576+0000 7fd53f6f1700 1 -- 172.21.15.45:0/4218783538 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5380a8080 msgr2=0x7fd538152bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:38.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.576+0000 7fd53f6f1700 1 --2- 172.21.15.45:0/4218783538 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5380a8080 0x7fd538152bf0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7fd53400c560 tx=0x7fd534007d00).stop 2023-12-22T10:01:38.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.576+0000 7fd53f6f1700 1 -- 172.21.15.45:0/4218783538 shutdown_connections 2023-12-22T10:01:38.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.576+0000 7fd53f6f1700 1 --2- 172.21.15.45:0/4218783538 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fd51c05a4e0 0x7fd51c05c9a0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:38.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.576+0000 7fd53f6f1700 1 --2- 172.21.15.45:0/4218783538 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd5381581f0 0x7fd5380bdce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:38.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.576+0000 7fd53f6f1700 1 --2- 172.21.15.45:0/4218783538 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd538157e10 0x7fd5380ac290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:38.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.576+0000 7fd53f6f1700 1 --2- 172.21.15.45:0/4218783538 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5380a8080 0x7fd538152bf0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:38.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.576+0000 7fd53f6f1700 1 -- 172.21.15.45:0/4218783538 >> 172.21.15.45:0/4218783538 conn(0x7fd538066a70 msgr2=0x7fd5380c1670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:38.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.576+0000 7fd53f6f1700 1 -- 172.21.15.45:0/4218783538 shutdown_connections 2023-12-22T10:01:38.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.576+0000 7fd53f6f1700 1 -- 172.21.15.45:0/4218783538 wait complete. 2023-12-22T10:01:38.577 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 16 2023-12-22T10:01:38.599 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T10:01:38.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.764+0000 7f7c34e79700 1 Processor -- start 2023-12-22T10:01:38.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.764+0000 7f7c34e79700 1 -- start start 2023-12-22T10:01:38.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.768+0000 7f7c34e79700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7c30151a20 0x7f7c30155750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:38.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.768+0000 7f7c34e79700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7c30151e00 0x7f7c30155c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:38.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.768+0000 7f7c34e79700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c30069270 con 0x7f7c300bbe10 2023-12-22T10:01:38.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.768+0000 7f7c34e79700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c300bc660 con 0x7f7c30151e00 2023-12-22T10:01:38.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.768+0000 7f7c34e79700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c30156130 con 0x7f7c30151a20 2023-12-22T10:01:38.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.768+0000 7f7c2effd700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7c30151e00 0x7f7c30155c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:38.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.768+0000 7f7c2f7fe700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7c30151a20 0x7f7c30155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:38.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.768+0000 7f7c2effd700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7c30151e00 0x7f7c30155c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37042/0 (socket says 172.21.15.45:37042) 2023-12-22T10:01:38.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.768+0000 7f7c2effd700 1 -- 172.21.15.45:0/1726785864 learned_addr learned my addr 172.21.15.45:0/1726785864 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:38.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.768+0000 7f7c2effd700 1 -- 172.21.15.45:0/1726785864 >> v2:172.21.15.113:3300/0 conn(0x7f7c30151a20 msgr2=0x7f7c30155750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:38.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.768+0000 7f7c2effd700 1 --2- 172.21.15.45:0/1726785864 >> v2:172.21.15.113:3300/0 conn(0x7f7c30151a20 0x7f7c30155750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:38.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.768+0000 7f7c2effd700 1 -- 172.21.15.45:0/1726785864 >> v1:172.21.15.113:6789/0 conn(0x7f7c300bbe10 legacy=0x7f7c30069700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:38.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.768+0000 7f7c2effd700 1 -- 172.21.15.45:0/1726785864 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c300bc380 con 0x7f7c30151e00 2023-12-22T10:01:38.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.772+0000 7f7c2effd700 1 --2- 172.21.15.45:0/1726785864 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c30151e00 0x7f7c30155c40 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7f7c30062770 tx=0x7f7c240090f0).ready entity=mon.0 client_cookie=8bd0f37cd701b418 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:38.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.772+0000 7f7c2e7fc700 1 -- 172.21.15.45:0/1726785864 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c2400b5b0 con 0x7f7c30151e00 2023-12-22T10:01:38.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.772+0000 7f7c2e7fc700 1 -- 172.21.15.45:0/1726785864 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c2400b710 con 0x7f7c30151e00 2023-12-22T10:01:38.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.772+0000 7f7c2e7fc700 1 -- 172.21.15.45:0/1726785864 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c2400ba90 con 0x7f7c30151e00 2023-12-22T10:01:38.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.772+0000 7f7c34e79700 1 -- 172.21.15.45:0/1726785864 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c30151e00 msgr2=0x7f7c30155c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:38.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.772+0000 7f7c34e79700 1 --2- 172.21.15.45:0/1726785864 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c30151e00 0x7f7c30155c40 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7f7c30062770 tx=0x7f7c240090f0).stop 2023-12-22T10:01:38.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.772+0000 7f7c34e79700 1 -- 172.21.15.45:0/1726785864 shutdown_connections 2023-12-22T10:01:38.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.772+0000 7f7c34e79700 1 --2- 172.21.15.45:0/1726785864 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c30151e00 0x7f7c30155c40 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:38.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.772+0000 7f7c34e79700 1 --2- 172.21.15.45:0/1726785864 >> v2:172.21.15.113:3300/0 conn(0x7f7c30151a20 0x7f7c30155750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:38.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.772+0000 7f7c34e79700 1 -- 172.21.15.45:0/1726785864 >> 172.21.15.45:0/1726785864 conn(0x7f7c30067540 msgr2=0x7f7c300c6460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:38.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.772+0000 7f7c34e79700 1 -- 172.21.15.45:0/1726785864 shutdown_connections 2023-12-22T10:01:38.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.772+0000 7f7c34e79700 1 -- 172.21.15.45:0/1726785864 wait complete. 2023-12-22T10:01:38.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.776+0000 7f7c34e79700 1 Processor -- start 2023-12-22T10:01:38.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.776+0000 7f7c34e79700 1 -- start start 2023-12-22T10:01:38.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.776+0000 7f7c34e79700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7c300bbe10 0x7f7c30145430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:38.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.776+0000 7f7c34e79700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7c30151a20 0x7f7c30169a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:38.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.776+0000 7f7c34e79700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c30151e00 0x7f7c3014cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:38.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.776+0000 7f7c34e79700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3014c770 con 0x7f7c30151e00 2023-12-22T10:01:38.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.776+0000 7f7c34e79700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c300bfd50 con 0x7f7c30151a20 2023-12-22T10:01:38.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.776+0000 7f7c34e79700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c30169460 con 0x7f7c300bbe10 2023-12-22T10:01:38.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.776+0000 7f7c2ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c30151e00 0x7f7c3014cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:38.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.776+0000 7f7c2ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c30151e00 0x7f7c3014cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37050/0 (socket says 172.21.15.45:37050) 2023-12-22T10:01:38.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.776+0000 7f7c2ffff700 1 -- 172.21.15.45:0/3475354788 learned_addr learned my addr 172.21.15.45:0/3475354788 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:38.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.776+0000 7f7c2effd700 1 --2- 172.21.15.45:0/3475354788 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7c30151a20 0x7f7c30169a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:38.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.776+0000 7f7c2f7fe700 1 --2- 172.21.15.45:0/3475354788 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7c300bbe10 0x7f7c30145430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:38.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.776+0000 7f7c2ffff700 1 -- 172.21.15.45:0/3475354788 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7c300bbe10 msgr2=0x7f7c30145430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:38.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.776+0000 7f7c2ffff700 1 --2- 172.21.15.45:0/3475354788 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7c300bbe10 0x7f7c30145430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:38.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.776+0000 7f7c2ffff700 1 -- 172.21.15.45:0/3475354788 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7c30151a20 msgr2=0x7f7c30169a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:38.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.776+0000 7f7c2ffff700 1 --2- 172.21.15.45:0/3475354788 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7c30151a20 0x7f7c30169a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:38.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.776+0000 7f7c2ffff700 1 -- 172.21.15.45:0/3475354788 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c24009370 con 0x7f7c30151e00 2023-12-22T10:01:38.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.776+0000 7f7c2ffff700 1 --2- 172.21.15.45:0/3475354788 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c30151e00 0x7f7c3014cc00 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7f7c28002230 tx=0x7f7c280015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:38.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.780+0000 7f7c177fe700 1 -- 172.21.15.45:0/3475354788 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c2800e4a0 con 0x7f7c30151e00 2023-12-22T10:01:38.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.780+0000 7f7c177fe700 1 -- 172.21.15.45:0/3475354788 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c2800e600 con 0x7f7c30151e00 2023-12-22T10:01:38.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.780+0000 7f7c177fe700 1 -- 172.21.15.45:0/3475354788 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c2800e980 con 0x7f7c30151e00 2023-12-22T10:01:38.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.780+0000 7f7c34e79700 1 -- 172.21.15.45:0/3475354788 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c30169740 con 0x7f7c30151e00 2023-12-22T10:01:38.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.780+0000 7f7c34e79700 1 -- 172.21.15.45:0/3475354788 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c30145920 con 0x7f7c30151e00 2023-12-22T10:01:38.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.780+0000 7f7c34e79700 1 -- 172.21.15.45:0/3475354788 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c3014c8e0 con 0x7f7c30151e00 2023-12-22T10:01:38.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.780+0000 7f7c177fe700 1 -- 172.21.15.45:0/3475354788 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f7c2801b3b0 con 0x7f7c30151e00 2023-12-22T10:01:38.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.784+0000 7f7c177fe700 1 --2- 172.21.15.45:0/3475354788 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f7c1c05a510 0x7f7c1c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:38.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.784+0000 7f7c177fe700 1 -- 172.21.15.45:0/3475354788 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f7c28073f20 con 0x7f7c30151e00 2023-12-22T10:01:38.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.784+0000 7f7c2f7fe700 1 --2- 172.21.15.45:0/3475354788 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f7c1c05a510 0x7f7c1c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:38.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.784+0000 7f7c2f7fe700 1 --2- 172.21.15.45:0/3475354788 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f7c1c05a510 0x7f7c1c05c9d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f7c300a8cf0 tx=0x7f7c20009060).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:38.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.788+0000 7f7c177fe700 1 -- 172.21.15.45:0/3475354788 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f7c28047690 con 0x7f7c30151e00 2023-12-22T10:01:38.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.964+0000 7f7c34e79700 1 -- 172.21.15.45:0/3475354788 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7c30047060 con 0x7f7c30151e00 2023-12-22T10:01:38.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.964+0000 7f7c177fe700 1 -- 172.21.15.45:0/3475354788 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+16928 (secure 0 0 0) 0x7f7c2804acb0 con 0x7f7c30151e00 2023-12-22T10:01:38.965 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:01:38.965 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":36,"fsid":"98b0837e-5e68-4c8f-a1a0-e9424baaad8f","created":"2023-12-22T10:00:15.010174+0000","modified":"2023-12-22T10:01:36.110650+0000","last_up_change":"2023-12-22T10:00:24.980513+0000","last_in_change":"2023-12-22T10:00:17.887172+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-12-22T10:00:25.069641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-12-22T10:00:26.906399+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-22T10:01:33.592093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-22T10:01:34.130811+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e19943a0-1c6b-47df-b6bb-383472077890","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":33777},{"type":"v1","addr":"172.21.15.45:6819","nonce":33777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":33777},{"type":"v1","addr":"172.21.15.45:6822","nonce":33777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":33777},{"type":"v1","addr":"172.21.15.45:6830","nonce":33777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":33777},{"type":"v1","addr":"172.21.15.45:6826","nonce":33777}]},"public_addr":"172.21.15.45:6819/33777","cluster_addr":"172.21.15.45:6822/33777","heartbeat_back_addr":"172.21.15.45:6830/33777","heartbeat_front_addr":"172.21.15.45:6826/33777","state":["exists","up"]},{"osd":1,"uuid":"69670f34-f082-45a7-8f67-e962acc136e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":33775},{"type":"v1","addr":"172.21.15.45:6809","nonce":33775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":33775},{"type":"v1","addr":"172.21.15.45:6811","nonce":33775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":33775},{"type":"v1","addr":"172.21.15.45:6815","nonce":33775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":33775},{"type":"v1","addr":"172.21.15.45:6813","nonce":33775}]},"public_addr":"172.21.15.45:6809/33775","cluster_addr":"172.21.15.45:6811/33775","heartbeat_back_addr":"172.21.15.45:6815/33775","heartbeat_front_addr":"172.21.15.45:6813/33775","state":["exists","up"]},{"osd":2,"uuid":"d909d49b-82b8-401b-9947-e49dd167bb95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":33776},{"type":"v1","addr":"172.21.15.45:6801","nonce":33776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":33776},{"type":"v1","addr":"172.21.15.45:6803","nonce":33776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":33776},{"type":"v1","addr":"172.21.15.45:6807","nonce":33776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":33776},{"type":"v1","addr":"172.21.15.45:6805","nonce":33776}]},"public_addr":"172.21.15.45:6801/33776","cluster_addr":"172.21.15.45:6803/33776","heartbeat_back_addr":"172.21.15.45:6807/33776","heartbeat_front_addr":"172.21.15.45:6805/33776","state":["exists","up"]},{"osd":3,"uuid":"db104ca9-3a94-4d39-a2be-bd06db888095","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":33782},{"type":"v1","addr":"172.21.15.45:6817","nonce":33782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":33782},{"type":"v1","addr":"172.21.15.45:6823","nonce":33782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":33782},{"type":"v1","addr":"172.21.15.45:6831","nonce":33782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":33782},{"type":"v1","addr":"172.21.15.45:6827","nonce":33782}]},"public_addr":"172.21.15.45:6817/33782","cluster_addr":"172.21.15.45:6823/33782","heartbeat_back_addr":"172.21.15.45:6831/33782","heartbeat_front_addr":"172.21.15.45:6827/33782","state":["exists","up"]},{"osd":4,"uuid":"9f4eaff4-e433-4479-a0d1-ee7a33375ca6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":34099},{"type":"v1","addr":"172.21.15.113:6811","nonce":34099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":34099},{"type":"v1","addr":"172.21.15.113:6815","nonce":34099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":34099},{"type":"v1","addr":"172.21.15.113:6823","nonce":34099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6816","nonce":34099},{"type":"v1","addr":"172.21.15.113:6818","nonce":34099}]},"public_addr":"172.21.15.113:6811/34099","cluster_addr":"172.21.15.113:6815/34099","heartbeat_back_addr":"172.21.15.113:6823/34099","heartbeat_front_addr":"172.21.15.113:6818/34099","state":["exists","up"]},{"osd":5,"uuid":"1efc5591-180b-43af-8611-0068aadc5aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":34100},{"type":"v1","addr":"172.21.15.113:6801","nonce":34100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":34100},{"type":"v1","addr":"172.21.15.113:6803","nonce":34100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":34100},{"type":"v1","addr":"172.21.15.113:6807","nonce":34100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":34100},{"type":"v1","addr":"172.21.15.113:6805","nonce":34100}]},"public_addr":"172.21.15.113:6801/34100","cluster_addr":"172.21.15.113:6803/34100","heartbeat_back_addr":"172.21.15.113:6807/34100","heartbeat_front_addr":"172.21.15.113:6805/34100","state":["exists","up"]},{"osd":6,"uuid":"6c89d9d8-c153-4a48-afa9-97e4c403f1ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":34101},{"type":"v1","addr":"172.21.15.113:6810","nonce":34101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6812","nonce":34101},{"type":"v1","addr":"172.21.15.113:6814","nonce":34101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6822","nonce":34101},{"type":"v1","addr":"172.21.15.113:6824","nonce":34101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":34101},{"type":"v1","addr":"172.21.15.113:6819","nonce":34101}]},"public_addr":"172.21.15.113:6810/34101","cluster_addr":"172.21.15.113:6814/34101","heartbeat_back_addr":"172.21.15.113:6824/34101","heartbeat_front_addr":"172.21.15.113:6819/34101","state":["exists","up"]},{"osd":7,"uuid":"1855e70c-23f6-4c08-ad7f-774c2148235b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6821","nonce":34102},{"type":"v1","addr":"172.21.15.113:6825","nonce":34102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":34102},{"type":"v1","addr":"172.21.15.113:6827","nonce":34102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":34102},{"type":"v1","addr":"172.21.15.113:6831","nonce":34102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6828","nonce":34102},{"type":"v1","addr":"172.21.15.113:6829","nonce":34102}]},"public_addr":"172.21.15.113:6825/34102","cluster_addr":"172.21.15.113:6827/34102","heartbeat_back_addr":"172.21.15.113:6831/34102","heartbeat_front_addr":"172.21.15.113:6829/34102","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.812672+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.825045+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.700105+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.856563+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.954683+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.883234+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.883994+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.821686+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T10:01:38.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.968+0000 7f7c34e79700 1 -- 172.21.15.45:0/3475354788 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f7c1c05a510 msgr2=0x7f7c1c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:38.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.968+0000 7f7c34e79700 1 --2- 172.21.15.45:0/3475354788 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f7c1c05a510 0x7f7c1c05c9d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f7c300a8cf0 tx=0x7f7c20009060).stop 2023-12-22T10:01:38.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.968+0000 7f7c34e79700 1 -- 172.21.15.45:0/3475354788 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c30151e00 msgr2=0x7f7c3014cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:38.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.968+0000 7f7c34e79700 1 --2- 172.21.15.45:0/3475354788 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c30151e00 0x7f7c3014cc00 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7f7c28002230 tx=0x7f7c280015e0).stop 2023-12-22T10:01:38.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.968+0000 7f7c34e79700 1 -- 172.21.15.45:0/3475354788 shutdown_connections 2023-12-22T10:01:38.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.968+0000 7f7c34e79700 1 --2- 172.21.15.45:0/3475354788 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c30151e00 0x7f7c3014cc00 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:38.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.968+0000 7f7c34e79700 1 --2- 172.21.15.45:0/3475354788 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7c30151a20 0x7f7c30169a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:38.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.968+0000 7f7c34e79700 1 --2- 172.21.15.45:0/3475354788 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f7c1c05a510 0x7f7c1c05c9d0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:38.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.968+0000 7f7c34e79700 1 --2- 172.21.15.45:0/3475354788 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7c300bbe10 0x7f7c30145430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:38.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.968+0000 7f7c34e79700 1 -- 172.21.15.45:0/3475354788 >> 172.21.15.45:0/3475354788 conn(0x7f7c30067540 msgr2=0x7f7c300650f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:38.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.968+0000 7f7c34e79700 1 -- 172.21.15.45:0/3475354788 shutdown_connections 2023-12-22T10:01:38.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:38.968+0000 7f7c34e79700 1 -- 172.21.15.45:0/3475354788 wait complete. 2023-12-22T10:01:38.986 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-22T10:01:38.987 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-22T10:01:39.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.152+0000 7f4863b69700 1 Processor -- start 2023-12-22T10:01:39.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.156+0000 7f4863b69700 1 -- start start 2023-12-22T10:01:39.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.156+0000 7f4863b69700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f485c0a8080 0x7f485c162c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:39.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.156+0000 7f4863b69700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f485c0a68b0 con 0x7f485c157e10 2023-12-22T10:01:39.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.156+0000 7f4863b69700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f485c065610 con 0x7f485c1581f0 2023-12-22T10:01:39.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.156+0000 7f4863b69700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f485c0658f0 con 0x7f485c0a8080 2023-12-22T10:01:39.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.156+0000 7f4861905700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f485c157e10 0x7f485c0c1820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:58794/0 (socket says 172.21.15.45:58794) 2023-12-22T10:01:39.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.156+0000 7f4861905700 1 -- 172.21.15.45:0/1837523573 learned_addr learned my addr 172.21.15.45:0/1837523573 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:01:39.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.160+0000 7f4862106700 1 --2- 172.21.15.45:0/1837523573 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f485c0a8080 0x7f485c162c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:39.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.160+0000 7f4860903700 1 -- 172.21.15.45:0/1837523573 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1667209805 0 0) 0x7f485c0a68b0 con 0x7f485c157e10 2023-12-22T10:01:39.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.160+0000 7f4860903700 1 -- 172.21.15.45:0/1837523573 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48480033f0 con 0x7f485c157e10 2023-12-22T10:01:39.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.160+0000 7f4860903700 1 -- 172.21.15.45:0/1837523573 <== mon.1 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1798789791 0 0) 0x7f485c065610 con 0x7f485c1581f0 2023-12-22T10:01:39.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.160+0000 7f4860903700 1 -- 172.21.15.45:0/1837523573 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f485c0a68b0 con 0x7f485c1581f0 2023-12-22T10:01:39.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.160+0000 7f4862106700 1 -- 172.21.15.45:0/1837523573 >> v1:172.21.15.113:6789/0 conn(0x7f485c1581f0 legacy=0x7f485c0c3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:39.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.160+0000 7f4862106700 1 -- 172.21.15.45:0/1837523573 >> v1:172.21.15.45:6789/0 conn(0x7f485c157e10 legacy=0x7f485c0c1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:39.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.160+0000 7f4862106700 1 -- 172.21.15.45:0/1837523573 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f485c065bd0 con 0x7f485c0a8080 2023-12-22T10:01:39.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.160+0000 7f4862106700 1 --2- 172.21.15.45:0/1837523573 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f485c0a8080 0x7f485c162c20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f4854009e90 tx=0x7f4854009780).ready entity=mon.2 client_cookie=eb5e91436daf4b94 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:39.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.160+0000 7f4860903700 1 -- 172.21.15.45:0/1837523573 <== mon.2 v2:172.21.15.113:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f485400e070 con 0x7f485c0a8080 2023-12-22T10:01:39.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.160+0000 7f4860903700 1 -- 172.21.15.45:0/1837523573 <== mon.2 v2:172.21.15.113:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f485400bab0 con 0x7f485c0a8080 2023-12-22T10:01:39.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.160+0000 7f4860903700 1 -- 172.21.15.45:0/1837523573 <== mon.2 v2:172.21.15.113:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f485400be30 con 0x7f485c0a8080 2023-12-22T10:01:39.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.160+0000 7f4863b69700 1 -- 172.21.15.45:0/1837523573 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f485c0a8080 msgr2=0x7f485c162c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:39.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.160+0000 7f4863b69700 1 --2- 172.21.15.45:0/1837523573 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f485c0a8080 0x7f485c162c20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f4854009e90 tx=0x7f4854009780).stop 2023-12-22T10:01:39.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.160+0000 7f4863b69700 1 -- 172.21.15.45:0/1837523573 shutdown_connections 2023-12-22T10:01:39.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.160+0000 7f4863b69700 1 --2- 172.21.15.45:0/1837523573 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f485c0a8080 0x7f485c162c20 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:39.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.160+0000 7f4863b69700 1 -- 172.21.15.45:0/1837523573 >> 172.21.15.45:0/1837523573 conn(0x7f485c066a70 msgr2=0x7f485c066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:39.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.160+0000 7f4863b69700 1 -- 172.21.15.45:0/1837523573 shutdown_connections 2023-12-22T10:01:39.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.160+0000 7f4863b69700 1 -- 172.21.15.45:0/1837523573 wait complete. 2023-12-22T10:01:39.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.164+0000 7f4863b69700 1 Processor -- start 2023-12-22T10:01:39.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.164+0000 7f4863b69700 1 -- start start 2023-12-22T10:01:39.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.168+0000 7f4863b69700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f485c0a8080 0x7f485c152bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:39.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.168+0000 7f4863b69700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f485c157e10 0x7f485c0ac290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:39.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.168+0000 7f4863b69700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f485c1581f0 0x7f485c0bdce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:39.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.168+0000 7f4863b69700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f485c0ac780 con 0x7f485c1581f0 2023-12-22T10:01:39.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.168+0000 7f4863b69700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f485c0ac990 con 0x7f485c157e10 2023-12-22T10:01:39.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.168+0000 7f4863b69700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f485c152760 con 0x7f485c0a8080 2023-12-22T10:01:39.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.168+0000 7f4862106700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f485c1581f0 0x7f485c0bdce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:39.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.168+0000 7f4862106700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f485c1581f0 0x7f485c0bdce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37054/0 (socket says 172.21.15.45:37054) 2023-12-22T10:01:39.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.168+0000 7f4862106700 1 -- 172.21.15.45:0/2471362189 learned_addr learned my addr 172.21.15.45:0/2471362189 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:39.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.168+0000 7f4861905700 1 --2- 172.21.15.45:0/2471362189 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f485c0a8080 0x7f485c152bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:39.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.168+0000 7f4861104700 1 --2- 172.21.15.45:0/2471362189 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f485c157e10 0x7f485c0ac290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:39.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.168+0000 7f4862106700 1 -- 172.21.15.45:0/2471362189 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f485c0a8080 msgr2=0x7f485c152bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:39.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.168+0000 7f4862106700 1 --2- 172.21.15.45:0/2471362189 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f485c0a8080 0x7f485c152bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:39.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.168+0000 7f4862106700 1 -- 172.21.15.45:0/2471362189 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f485c157e10 msgr2=0x7f485c0ac290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:39.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.168+0000 7f4862106700 1 --2- 172.21.15.45:0/2471362189 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f485c157e10 0x7f485c0ac290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:39.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.168+0000 7f4862106700 1 -- 172.21.15.45:0/2471362189 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4854009a20 con 0x7f485c1581f0 2023-12-22T10:01:39.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.168+0000 7f4861104700 1 --2- 172.21.15.45:0/2471362189 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f485c157e10 0x7f485c0ac290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T10:01:39.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.168+0000 7f4862106700 1 --2- 172.21.15.45:0/2471362189 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f485c1581f0 0x7f485c0bdce0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7f4854011000 tx=0x7f4854009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:39.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.168+0000 7f4851ffb700 1 -- 172.21.15.45:0/2471362189 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f485401d630 con 0x7f485c1581f0 2023-12-22T10:01:39.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.168+0000 7f4851ffb700 1 -- 172.21.15.45:0/2471362189 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f485401d7b0 con 0x7f485c1581f0 2023-12-22T10:01:39.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.168+0000 7f4851ffb700 1 -- 172.21.15.45:0/2471362189 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f485401db70 con 0x7f485c1581f0 2023-12-22T10:01:39.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.168+0000 7f4863b69700 1 -- 172.21.15.45:0/2471362189 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f485c0be1d0 con 0x7f485c1581f0 2023-12-22T10:01:39.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.168+0000 7f4863b69700 1 -- 172.21.15.45:0/2471362189 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f485c152110 con 0x7f485c1581f0 2023-12-22T10:01:39.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.172+0000 7f4863b69700 1 -- 172.21.15.45:0/2471362189 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f485c1528d0 con 0x7f485c1581f0 2023-12-22T10:01:39.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.172+0000 7f4851ffb700 1 -- 172.21.15.45:0/2471362189 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f4854003040 con 0x7f485c1581f0 2023-12-22T10:01:39.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.172+0000 7f4851ffb700 1 --2- 172.21.15.45:0/2471362189 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f484005a4e0 0x7f484005c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:39.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.172+0000 7f4851ffb700 1 -- 172.21.15.45:0/2471362189 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f4854076520 con 0x7f485c1581f0 2023-12-22T10:01:39.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.172+0000 7f4861905700 1 --2- 172.21.15.45:0/2471362189 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f484005a4e0 0x7f484005c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:39.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.176+0000 7f4861905700 1 --2- 172.21.15.45:0/2471362189 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f484005a4e0 0x7f484005c9a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f4858005750 tx=0x7f4858009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:39.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.180+0000 7f4851ffb700 1 -- 172.21.15.45:0/2471362189 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f4854049d00 con 0x7f485c1581f0 2023-12-22T10:01:39.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.344+0000 7f4863b69700 1 -- 172.21.15.45:0/2471362189 --> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f485c0a6bc0 con 0x7f484005a4e0 2023-12-22T10:01:39.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.368+0000 7f4851ffb700 1 -- 172.21.15.45:0/2471362189 <== mgr.4104 v2:172.21.15.45:6832/33679 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+358309 (secure 0 0 0) 0x7f485c0a6bc0 con 0x7f484005a4e0 2023-12-22T10:01:39.372 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:01:39.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.376+0000 7f4863b69700 1 -- 172.21.15.45:0/2471362189 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f484005a4e0 msgr2=0x7f484005c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:39.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.376+0000 7f4863b69700 1 --2- 172.21.15.45:0/2471362189 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f484005a4e0 0x7f484005c9a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f4858005750 tx=0x7f4858009040).stop 2023-12-22T10:01:39.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.376+0000 7f4863b69700 1 -- 172.21.15.45:0/2471362189 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f485c1581f0 msgr2=0x7f485c0bdce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:39.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.376+0000 7f4863b69700 1 --2- 172.21.15.45:0/2471362189 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f485c1581f0 0x7f485c0bdce0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7f4854011000 tx=0x7f4854009780).stop 2023-12-22T10:01:39.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.376+0000 7f4863b69700 1 -- 172.21.15.45:0/2471362189 shutdown_connections 2023-12-22T10:01:39.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.376+0000 7f4863b69700 1 --2- 172.21.15.45:0/2471362189 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f485c1581f0 0x7f485c0bdce0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:39.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.376+0000 7f4863b69700 1 --2- 172.21.15.45:0/2471362189 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f485c157e10 0x7f485c0ac290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:39.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.376+0000 7f4863b69700 1 --2- 172.21.15.45:0/2471362189 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f484005a4e0 0x7f484005c9a0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:39.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.376+0000 7f4863b69700 1 --2- 172.21.15.45:0/2471362189 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f485c0a8080 0x7f485c152bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:39.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.376+0000 7f4863b69700 1 -- 172.21.15.45:0/2471362189 >> 172.21.15.45:0/2471362189 conn(0x7f485c066a70 msgr2=0x7f485c0c1670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:39.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.376+0000 7f4863b69700 1 -- 172.21.15.45:0/2471362189 shutdown_connections 2023-12-22T10:01:39.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.376+0000 7f4863b69700 1 -- 172.21.15.45:0/2471362189 wait complete. 2023-12-22T10:01:39.378 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-12-22T10:01:39.395 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":65,"stamp":"2023-12-22T10:01:37.972703+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":193,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2379920,"kb_used_data":3152,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752594800,"statfs":{"total":773094113280,"available":770657075200,"internally_reserved":0,"allocated":3227648,"data_stored":1319271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":44,"apply_latency_ms":44,"commit_latency_ns":44000000,"apply_latency_ns":44000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-5393,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-53,"num_write_kb":-21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.198018"},"pg_stats":[{"pgid":"6.3c","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.152281+0000","last_change":"2023-12-22T10:01:35.152281+0000","last_active":"2023-12-22T10:01:35.152281+0000","last_peered":"2023-12-22T10:01:35.152281+0000","last_clean":"2023-12-22T10:01:35.152281+0000","last_became_active":"2023-12-22T10:01:35.151922+0000","last_became_peered":"2023-12-22T10:01:35.151922+0000","last_unstale":"2023-12-22T10:01:35.152281+0000","last_undegraded":"2023-12-22T10:01:35.152281+0000","last_fullsized":"2023-12-22T10:01:35.152281+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3f","version":"35'3","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.161827+0000","last_change":"2023-12-22T10:01:34.692598+0000","last_active":"2023-12-22T10:01:35.161827+0000","last_peered":"2023-12-22T10:01:35.161827+0000","last_clean":"2023-12-22T10:01:35.161827+0000","last_became_active":"2023-12-22T10:01:34.692294+0000","last_became_peered":"2023-12-22T10:01:34.692294+0000","last_unstale":"2023-12-22T10:01:35.161827+0000","last_undegraded":"2023-12-22T10:01:35.161827+0000","last_fullsized":"2023-12-22T10:01:35.161827+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.151608+0000","last_change":"2023-12-22T10:01:35.151608+0000","last_active":"2023-12-22T10:01:35.151608+0000","last_peered":"2023-12-22T10:01:35.151608+0000","last_clean":"2023-12-22T10:01:35.151608+0000","last_became_active":"2023-12-22T10:01:35.151006+0000","last_became_peered":"2023-12-22T10:01:35.151006+0000","last_unstale":"2023-12-22T10:01:35.151608+0000","last_undegraded":"2023-12-22T10:01:35.151608+0000","last_fullsized":"2023-12-22T10:01:35.151608+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.701547+0000","last_change":"2023-12-22T10:01:34.697062+0000","last_active":"2023-12-22T10:01:34.701547+0000","last_peered":"2023-12-22T10:01:34.701547+0000","last_clean":"2023-12-22T10:01:34.701547+0000","last_became_active":"2023-12-22T10:01:34.696760+0000","last_became_peered":"2023-12-22T10:01:34.696760+0000","last_unstale":"2023-12-22T10:01:34.701547+0000","last_undegraded":"2023-12-22T10:01:34.701547+0000","last_fullsized":"2023-12-22T10:01:34.701547+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.134766+0000","last_change":"2023-12-22T10:01:35.134766+0000","last_active":"2023-12-22T10:01:35.134766+0000","last_peered":"2023-12-22T10:01:35.134766+0000","last_clean":"2023-12-22T10:01:35.134766+0000","last_became_active":"2023-12-22T10:01:35.131420+0000","last_became_peered":"2023-12-22T10:01:35.131420+0000","last_unstale":"2023-12-22T10:01:35.134766+0000","last_undegraded":"2023-12-22T10:01:35.134766+0000","last_fullsized":"2023-12-22T10:01:35.134766+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.707070+0000","last_change":"2023-12-22T10:01:34.705273+0000","last_active":"2023-12-22T10:01:34.707070+0000","last_peered":"2023-12-22T10:01:34.707070+0000","last_clean":"2023-12-22T10:01:34.707070+0000","last_became_active":"2023-12-22T10:01:34.704899+0000","last_became_peered":"2023-12-22T10:01:34.704899+0000","last_unstale":"2023-12-22T10:01:34.707070+0000","last_undegraded":"2023-12-22T10:01:34.707070+0000","last_fullsized":"2023-12-22T10:01:34.707070+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3f","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.140720+0000","last_change":"2023-12-22T10:01:35.140720+0000","last_active":"2023-12-22T10:01:35.140720+0000","last_peered":"2023-12-22T10:01:35.140720+0000","last_clean":"2023-12-22T10:01:35.140720+0000","last_became_active":"2023-12-22T10:01:35.137419+0000","last_became_peered":"2023-12-22T10:01:35.137419+0000","last_unstale":"2023-12-22T10:01:35.140720+0000","last_undegraded":"2023-12-22T10:01:35.140720+0000","last_fullsized":"2023-12-22T10:01:35.140720+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3c","version":"35'2","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.146457+0000","last_change":"2023-12-22T10:01:34.698706+0000","last_active":"2023-12-22T10:01:35.146457+0000","last_peered":"2023-12-22T10:01:35.146457+0000","last_clean":"2023-12-22T10:01:35.146457+0000","last_became_active":"2023-12-22T10:01:34.698384+0000","last_became_peered":"2023-12-22T10:01:34.698384+0000","last_unstale":"2023-12-22T10:01:35.146457+0000","last_undegraded":"2023-12-22T10:01:35.146457+0000","last_fullsized":"2023-12-22T10:01:35.146457+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.144798+0000","last_change":"2023-12-22T10:01:35.144798+0000","last_active":"2023-12-22T10:01:35.144798+0000","last_peered":"2023-12-22T10:01:35.144798+0000","last_clean":"2023-12-22T10:01:35.144798+0000","last_became_active":"2023-12-22T10:01:35.143992+0000","last_became_peered":"2023-12-22T10:01:35.143992+0000","last_unstale":"2023-12-22T10:01:35.144798+0000","last_undegraded":"2023-12-22T10:01:35.144798+0000","last_fullsized":"2023-12-22T10:01:35.144798+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"35'1","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.126263+0000","last_change":"2023-12-22T10:01:34.687808+0000","last_active":"2023-12-22T10:01:35.126263+0000","last_peered":"2023-12-22T10:01:35.126263+0000","last_clean":"2023-12-22T10:01:35.126263+0000","last_became_active":"2023-12-22T10:01:34.687419+0000","last_became_peered":"2023-12-22T10:01:34.687419+0000","last_unstale":"2023-12-22T10:01:35.126263+0000","last_undegraded":"2023-12-22T10:01:35.126263+0000","last_fullsized":"2023-12-22T10:01:35.126263+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.135065+0000","last_change":"2023-12-22T10:01:35.135065+0000","last_active":"2023-12-22T10:01:35.135065+0000","last_peered":"2023-12-22T10:01:35.135065+0000","last_clean":"2023-12-22T10:01:35.135065+0000","last_became_active":"2023-12-22T10:01:35.134446+0000","last_became_peered":"2023-12-22T10:01:35.134446+0000","last_unstale":"2023-12-22T10:01:35.135065+0000","last_undegraded":"2023-12-22T10:01:35.135065+0000","last_fullsized":"2023-12-22T10:01:35.135065+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3a","version":"35'1","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.116792+0000","last_change":"2023-12-22T10:01:34.690637+0000","last_active":"2023-12-22T10:01:35.116792+0000","last_peered":"2023-12-22T10:01:35.116792+0000","last_clean":"2023-12-22T10:01:35.116792+0000","last_became_active":"2023-12-22T10:01:34.690359+0000","last_became_peered":"2023-12-22T10:01:34.690359+0000","last_unstale":"2023-12-22T10:01:35.116792+0000","last_undegraded":"2023-12-22T10:01:35.116792+0000","last_fullsized":"2023-12-22T10:01:35.116792+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.136920+0000","last_change":"2023-12-22T10:01:35.136920+0000","last_active":"2023-12-22T10:01:35.136920+0000","last_peered":"2023-12-22T10:01:35.136920+0000","last_clean":"2023-12-22T10:01:35.136920+0000","last_became_active":"2023-12-22T10:01:35.136645+0000","last_became_peered":"2023-12-22T10:01:35.136645+0000","last_unstale":"2023-12-22T10:01:35.136920+0000","last_undegraded":"2023-12-22T10:01:35.136920+0000","last_fullsized":"2023-12-22T10:01:35.136920+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.707387+0000","last_change":"2023-12-22T10:01:34.705207+0000","last_active":"2023-12-22T10:01:34.707387+0000","last_peered":"2023-12-22T10:01:34.707387+0000","last_clean":"2023-12-22T10:01:34.707387+0000","last_became_active":"2023-12-22T10:01:34.704843+0000","last_became_peered":"2023-12-22T10:01:34.704843+0000","last_unstale":"2023-12-22T10:01:34.707387+0000","last_undegraded":"2023-12-22T10:01:34.707387+0000","last_fullsized":"2023-12-22T10:01:34.707387+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.143343+0000","last_change":"2023-12-22T10:01:35.143343+0000","last_active":"2023-12-22T10:01:35.143343+0000","last_peered":"2023-12-22T10:01:35.143343+0000","last_clean":"2023-12-22T10:01:35.143343+0000","last_became_active":"2023-12-22T10:01:35.142969+0000","last_became_peered":"2023-12-22T10:01:35.142969+0000","last_unstale":"2023-12-22T10:01:35.143343+0000","last_undegraded":"2023-12-22T10:01:35.143343+0000","last_fullsized":"2023-12-22T10:01:35.143343+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.703264+0000","last_change":"2023-12-22T10:01:34.694961+0000","last_active":"2023-12-22T10:01:34.703264+0000","last_peered":"2023-12-22T10:01:34.703264+0000","last_clean":"2023-12-22T10:01:34.703264+0000","last_became_active":"2023-12-22T10:01:34.694670+0000","last_became_peered":"2023-12-22T10:01:34.694670+0000","last_unstale":"2023-12-22T10:01:34.703264+0000","last_undegraded":"2023-12-22T10:01:34.703264+0000","last_fullsized":"2023-12-22T10:01:34.703264+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.133665+0000","last_change":"2023-12-22T10:01:35.133665+0000","last_active":"2023-12-22T10:01:35.133665+0000","last_peered":"2023-12-22T10:01:35.133665+0000","last_clean":"2023-12-22T10:01:35.133665+0000","last_became_active":"2023-12-22T10:01:35.133400+0000","last_became_peered":"2023-12-22T10:01:35.133400+0000","last_unstale":"2023-12-22T10:01:35.133665+0000","last_undegraded":"2023-12-22T10:01:35.133665+0000","last_fullsized":"2023-12-22T10:01:35.133665+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.705415+0000","last_change":"2023-12-22T10:01:34.701407+0000","last_active":"2023-12-22T10:01:34.705415+0000","last_peered":"2023-12-22T10:01:34.705415+0000","last_clean":"2023-12-22T10:01:34.705415+0000","last_became_active":"2023-12-22T10:01:34.701143+0000","last_became_peered":"2023-12-22T10:01:34.701143+0000","last_unstale":"2023-12-22T10:01:34.705415+0000","last_undegraded":"2023-12-22T10:01:34.705415+0000","last_fullsized":"2023-12-22T10:01:34.705415+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.148993+0000","last_change":"2023-12-22T10:01:35.148993+0000","last_active":"2023-12-22T10:01:35.148993+0000","last_peered":"2023-12-22T10:01:35.148993+0000","last_clean":"2023-12-22T10:01:35.148993+0000","last_became_active":"2023-12-22T10:01:35.148614+0000","last_became_peered":"2023-12-22T10:01:35.148614+0000","last_unstale":"2023-12-22T10:01:35.148993+0000","last_undegraded":"2023-12-22T10:01:35.148993+0000","last_fullsized":"2023-12-22T10:01:35.148993+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.698450+0000","last_change":"2023-12-22T10:01:34.690874+0000","last_active":"2023-12-22T10:01:34.698450+0000","last_peered":"2023-12-22T10:01:34.698450+0000","last_clean":"2023-12-22T10:01:34.698450+0000","last_became_active":"2023-12-22T10:01:34.690525+0000","last_became_peered":"2023-12-22T10:01:34.690525+0000","last_unstale":"2023-12-22T10:01:34.698450+0000","last_undegraded":"2023-12-22T10:01:34.698450+0000","last_fullsized":"2023-12-22T10:01:34.698450+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.163651+0000","last_change":"2023-12-22T10:01:35.163651+0000","last_active":"2023-12-22T10:01:35.163651+0000","last_peered":"2023-12-22T10:01:35.163651+0000","last_clean":"2023-12-22T10:01:35.163651+0000","last_became_active":"2023-12-22T10:01:35.163305+0000","last_became_peered":"2023-12-22T10:01:35.163305+0000","last_unstale":"2023-12-22T10:01:35.163651+0000","last_undegraded":"2023-12-22T10:01:35.163651+0000","last_fullsized":"2023-12-22T10:01:35.163651+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.700363+0000","last_change":"2023-12-22T10:01:34.691997+0000","last_active":"2023-12-22T10:01:34.700363+0000","last_peered":"2023-12-22T10:01:34.700363+0000","last_clean":"2023-12-22T10:01:34.700363+0000","last_became_active":"2023-12-22T10:01:34.691557+0000","last_became_peered":"2023-12-22T10:01:34.691557+0000","last_unstale":"2023-12-22T10:01:34.700363+0000","last_undegraded":"2023-12-22T10:01:34.700363+0000","last_fullsized":"2023-12-22T10:01:34.700363+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.153014+0000","last_change":"2023-12-22T10:01:35.153014+0000","last_active":"2023-12-22T10:01:35.153014+0000","last_peered":"2023-12-22T10:01:35.153014+0000","last_clean":"2023-12-22T10:01:35.153014+0000","last_became_active":"2023-12-22T10:01:35.152544+0000","last_became_peered":"2023-12-22T10:01:35.152544+0000","last_unstale":"2023-12-22T10:01:35.153014+0000","last_undegraded":"2023-12-22T10:01:35.153014+0000","last_fullsized":"2023-12-22T10:01:35.153014+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"35'4","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.159796+0000","last_change":"2023-12-22T10:01:34.698273+0000","last_active":"2023-12-22T10:01:35.159796+0000","last_peered":"2023-12-22T10:01:35.159796+0000","last_clean":"2023-12-22T10:01:35.159796+0000","last_became_active":"2023-12-22T10:01:34.697971+0000","last_became_peered":"2023-12-22T10:01:34.697971+0000","last_unstale":"2023-12-22T10:01:35.159796+0000","last_undegraded":"2023-12-22T10:01:35.159796+0000","last_fullsized":"2023-12-22T10:01:35.159796+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.157227+0000","last_change":"2023-12-22T10:01:35.157227+0000","last_active":"2023-12-22T10:01:35.157227+0000","last_peered":"2023-12-22T10:01:35.157227+0000","last_clean":"2023-12-22T10:01:35.157227+0000","last_became_active":"2023-12-22T10:01:35.156649+0000","last_became_peered":"2023-12-22T10:01:35.156649+0000","last_unstale":"2023-12-22T10:01:35.157227+0000","last_undegraded":"2023-12-22T10:01:35.157227+0000","last_fullsized":"2023-12-22T10:01:35.157227+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"35'1","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.125166+0000","last_change":"2023-12-22T10:01:34.696594+0000","last_active":"2023-12-22T10:01:35.125166+0000","last_peered":"2023-12-22T10:01:35.125166+0000","last_clean":"2023-12-22T10:01:35.125166+0000","last_became_active":"2023-12-22T10:01:34.696150+0000","last_became_peered":"2023-12-22T10:01:34.696150+0000","last_unstale":"2023-12-22T10:01:35.125166+0000","last_undegraded":"2023-12-22T10:01:35.125166+0000","last_fullsized":"2023-12-22T10:01:35.125166+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.143685+0000","last_change":"2023-12-22T10:01:35.143685+0000","last_active":"2023-12-22T10:01:35.143685+0000","last_peered":"2023-12-22T10:01:35.143685+0000","last_clean":"2023-12-22T10:01:35.143685+0000","last_became_active":"2023-12-22T10:01:35.142366+0000","last_became_peered":"2023-12-22T10:01:35.142366+0000","last_unstale":"2023-12-22T10:01:35.143685+0000","last_undegraded":"2023-12-22T10:01:35.143685+0000","last_fullsized":"2023-12-22T10:01:35.143685+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.699267+0000","last_change":"2023-12-22T10:01:34.691884+0000","last_active":"2023-12-22T10:01:34.699267+0000","last_peered":"2023-12-22T10:01:34.699267+0000","last_clean":"2023-12-22T10:01:34.699267+0000","last_became_active":"2023-12-22T10:01:34.691602+0000","last_became_peered":"2023-12-22T10:01:34.691602+0000","last_unstale":"2023-12-22T10:01:34.699267+0000","last_undegraded":"2023-12-22T10:01:34.699267+0000","last_fullsized":"2023-12-22T10:01:34.699267+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.137981+0000","last_change":"2023-12-22T10:01:35.137981+0000","last_active":"2023-12-22T10:01:35.137981+0000","last_peered":"2023-12-22T10:01:35.137981+0000","last_clean":"2023-12-22T10:01:35.137981+0000","last_became_active":"2023-12-22T10:01:35.137659+0000","last_became_peered":"2023-12-22T10:01:35.137659+0000","last_unstale":"2023-12-22T10:01:35.137981+0000","last_undegraded":"2023-12-22T10:01:35.137981+0000","last_fullsized":"2023-12-22T10:01:35.137981+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.704950+0000","last_change":"2023-12-22T10:01:34.701089+0000","last_active":"2023-12-22T10:01:34.704950+0000","last_peered":"2023-12-22T10:01:34.704950+0000","last_clean":"2023-12-22T10:01:34.704950+0000","last_became_active":"2023-12-22T10:01:34.699878+0000","last_became_peered":"2023-12-22T10:01:34.699878+0000","last_unstale":"2023-12-22T10:01:34.704950+0000","last_undegraded":"2023-12-22T10:01:34.704950+0000","last_fullsized":"2023-12-22T10:01:34.704950+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.143515+0000","last_change":"2023-12-22T10:01:35.143515+0000","last_active":"2023-12-22T10:01:35.143515+0000","last_peered":"2023-12-22T10:01:35.143515+0000","last_clean":"2023-12-22T10:01:35.143515+0000","last_became_active":"2023-12-22T10:01:35.143051+0000","last_became_peered":"2023-12-22T10:01:35.143051+0000","last_unstale":"2023-12-22T10:01:35.143515+0000","last_undegraded":"2023-12-22T10:01:35.143515+0000","last_fullsized":"2023-12-22T10:01:35.143515+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.30","version":"35'4","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.150415+0000","last_change":"2023-12-22T10:01:34.682518+0000","last_active":"2023-12-22T10:01:35.150415+0000","last_peered":"2023-12-22T10:01:35.150415+0000","last_clean":"2023-12-22T10:01:35.150415+0000","last_became_active":"2023-12-22T10:01:34.680968+0000","last_became_peered":"2023-12-22T10:01:34.680968+0000","last_unstale":"2023-12-22T10:01:35.150415+0000","last_undegraded":"2023-12-22T10:01:35.150415+0000","last_fullsized":"2023-12-22T10:01:35.150415+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.156632+0000","last_change":"2023-12-22T10:01:35.156632+0000","last_active":"2023-12-22T10:01:35.156632+0000","last_peered":"2023-12-22T10:01:35.156632+0000","last_clean":"2023-12-22T10:01:35.156632+0000","last_became_active":"2023-12-22T10:01:35.156348+0000","last_became_peered":"2023-12-22T10:01:35.156348+0000","last_unstale":"2023-12-22T10:01:35.156632+0000","last_undegraded":"2023-12-22T10:01:35.156632+0000","last_fullsized":"2023-12-22T10:01:35.156632+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.702954+0000","last_change":"2023-12-22T10:01:34.694956+0000","last_active":"2023-12-22T10:01:34.702954+0000","last_peered":"2023-12-22T10:01:34.702954+0000","last_clean":"2023-12-22T10:01:34.702954+0000","last_became_active":"2023-12-22T10:01:34.694670+0000","last_became_peered":"2023-12-22T10:01:34.694670+0000","last_unstale":"2023-12-22T10:01:34.702954+0000","last_undegraded":"2023-12-22T10:01:34.702954+0000","last_fullsized":"2023-12-22T10:01:34.702954+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.145727+0000","last_change":"2023-12-22T10:01:35.145727+0000","last_active":"2023-12-22T10:01:35.145727+0000","last_peered":"2023-12-22T10:01:35.145727+0000","last_clean":"2023-12-22T10:01:35.145727+0000","last_became_active":"2023-12-22T10:01:35.143309+0000","last_became_peered":"2023-12-22T10:01:35.143309+0000","last_unstale":"2023-12-22T10:01:35.145727+0000","last_undegraded":"2023-12-22T10:01:35.145727+0000","last_fullsized":"2023-12-22T10:01:35.145727+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.699057+0000","last_change":"2023-12-22T10:01:34.693702+0000","last_active":"2023-12-22T10:01:34.699057+0000","last_peered":"2023-12-22T10:01:34.699057+0000","last_clean":"2023-12-22T10:01:34.699057+0000","last_became_active":"2023-12-22T10:01:34.693312+0000","last_became_peered":"2023-12-22T10:01:34.693312+0000","last_unstale":"2023-12-22T10:01:34.699057+0000","last_undegraded":"2023-12-22T10:01:34.699057+0000","last_fullsized":"2023-12-22T10:01:34.699057+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.161551+0000","last_change":"2023-12-22T10:01:35.161551+0000","last_active":"2023-12-22T10:01:35.161551+0000","last_peered":"2023-12-22T10:01:35.161551+0000","last_clean":"2023-12-22T10:01:35.161551+0000","last_became_active":"2023-12-22T10:01:35.161234+0000","last_became_peered":"2023-12-22T10:01:35.161234+0000","last_unstale":"2023-12-22T10:01:35.161551+0000","last_undegraded":"2023-12-22T10:01:35.161551+0000","last_fullsized":"2023-12-22T10:01:35.161551+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"35'1","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.121288+0000","last_change":"2023-12-22T10:01:34.703838+0000","last_active":"2023-12-22T10:01:35.121288+0000","last_peered":"2023-12-22T10:01:35.121288+0000","last_clean":"2023-12-22T10:01:35.121288+0000","last_became_active":"2023-12-22T10:01:34.703546+0000","last_became_peered":"2023-12-22T10:01:34.703546+0000","last_unstale":"2023-12-22T10:01:35.121288+0000","last_undegraded":"2023-12-22T10:01:35.121288+0000","last_fullsized":"2023-12-22T10:01:35.121288+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.162395+0000","last_change":"2023-12-22T10:01:35.162395+0000","last_active":"2023-12-22T10:01:35.162395+0000","last_peered":"2023-12-22T10:01:35.162395+0000","last_clean":"2023-12-22T10:01:35.162395+0000","last_became_active":"2023-12-22T10:01:35.162144+0000","last_became_peered":"2023-12-22T10:01:35.162144+0000","last_unstale":"2023-12-22T10:01:35.162395+0000","last_undegraded":"2023-12-22T10:01:35.162395+0000","last_fullsized":"2023-12-22T10:01:35.162395+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.702351+0000","last_change":"2023-12-22T10:01:34.700164+0000","last_active":"2023-12-22T10:01:34.702351+0000","last_peered":"2023-12-22T10:01:34.702351+0000","last_clean":"2023-12-22T10:01:34.702351+0000","last_became_active":"2023-12-22T10:01:34.699864+0000","last_became_peered":"2023-12-22T10:01:34.699864+0000","last_unstale":"2023-12-22T10:01:34.702351+0000","last_undegraded":"2023-12-22T10:01:34.702351+0000","last_fullsized":"2023-12-22T10:01:34.702351+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.144436+0000","last_change":"2023-12-22T10:01:35.144436+0000","last_active":"2023-12-22T10:01:35.144436+0000","last_peered":"2023-12-22T10:01:35.144436+0000","last_clean":"2023-12-22T10:01:35.144436+0000","last_became_active":"2023-12-22T10:01:35.143672+0000","last_became_peered":"2023-12-22T10:01:35.143672+0000","last_unstale":"2023-12-22T10:01:35.144436+0000","last_undegraded":"2023-12-22T10:01:35.144436+0000","last_fullsized":"2023-12-22T10:01:35.144436+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2b","version":"35'1","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.127752+0000","last_change":"2023-12-22T10:01:34.695729+0000","last_active":"2023-12-22T10:01:35.127752+0000","last_peered":"2023-12-22T10:01:35.127752+0000","last_clean":"2023-12-22T10:01:35.127752+0000","last_became_active":"2023-12-22T10:01:34.695350+0000","last_became_peered":"2023-12-22T10:01:34.695350+0000","last_unstale":"2023-12-22T10:01:35.127752+0000","last_undegraded":"2023-12-22T10:01:35.127752+0000","last_fullsized":"2023-12-22T10:01:35.127752+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.153565+0000","last_change":"2023-12-22T10:01:35.153565+0000","last_active":"2023-12-22T10:01:35.153565+0000","last_peered":"2023-12-22T10:01:35.153565+0000","last_clean":"2023-12-22T10:01:35.153565+0000","last_became_active":"2023-12-22T10:01:35.153282+0000","last_became_peered":"2023-12-22T10:01:35.153282+0000","last_unstale":"2023-12-22T10:01:35.153565+0000","last_undegraded":"2023-12-22T10:01:35.153565+0000","last_fullsized":"2023-12-22T10:01:35.153565+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.703338+0000","last_change":"2023-12-22T10:01:34.698295+0000","last_active":"2023-12-22T10:01:34.703338+0000","last_peered":"2023-12-22T10:01:34.703338+0000","last_clean":"2023-12-22T10:01:34.703338+0000","last_became_active":"2023-12-22T10:01:34.697636+0000","last_became_peered":"2023-12-22T10:01:34.697636+0000","last_unstale":"2023-12-22T10:01:34.703338+0000","last_undegraded":"2023-12-22T10:01:34.703338+0000","last_fullsized":"2023-12-22T10:01:34.703338+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.145659+0000","last_change":"2023-12-22T10:01:35.145659+0000","last_active":"2023-12-22T10:01:35.145659+0000","last_peered":"2023-12-22T10:01:35.145659+0000","last_clean":"2023-12-22T10:01:35.145659+0000","last_became_active":"2023-12-22T10:01:35.145349+0000","last_became_peered":"2023-12-22T10:01:35.145349+0000","last_unstale":"2023-12-22T10:01:35.145659+0000","last_undegraded":"2023-12-22T10:01:35.145659+0000","last_fullsized":"2023-12-22T10:01:35.145659+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.707995+0000","last_change":"2023-12-22T10:01:34.706960+0000","last_active":"2023-12-22T10:01:34.707995+0000","last_peered":"2023-12-22T10:01:34.707995+0000","last_clean":"2023-12-22T10:01:34.707995+0000","last_became_active":"2023-12-22T10:01:34.706683+0000","last_became_peered":"2023-12-22T10:01:34.706683+0000","last_unstale":"2023-12-22T10:01:34.707995+0000","last_undegraded":"2023-12-22T10:01:34.707995+0000","last_fullsized":"2023-12-22T10:01:34.707995+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.149661+0000","last_change":"2023-12-22T10:01:35.149661+0000","last_active":"2023-12-22T10:01:35.149661+0000","last_peered":"2023-12-22T10:01:35.149661+0000","last_clean":"2023-12-22T10:01:35.149661+0000","last_became_active":"2023-12-22T10:01:35.149440+0000","last_became_peered":"2023-12-22T10:01:35.149440+0000","last_unstale":"2023-12-22T10:01:35.149661+0000","last_undegraded":"2023-12-22T10:01:35.149661+0000","last_fullsized":"2023-12-22T10:01:35.149661+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.703708+0000","last_change":"2023-12-22T10:01:34.698945+0000","last_active":"2023-12-22T10:01:34.703708+0000","last_peered":"2023-12-22T10:01:34.703708+0000","last_clean":"2023-12-22T10:01:34.703708+0000","last_became_active":"2023-12-22T10:01:34.698609+0000","last_became_peered":"2023-12-22T10:01:34.698609+0000","last_unstale":"2023-12-22T10:01:34.703708+0000","last_undegraded":"2023-12-22T10:01:34.703708+0000","last_fullsized":"2023-12-22T10:01:34.703708+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.155343+0000","last_change":"2023-12-22T10:01:35.155343+0000","last_active":"2023-12-22T10:01:35.155343+0000","last_peered":"2023-12-22T10:01:35.155343+0000","last_clean":"2023-12-22T10:01:35.155343+0000","last_became_active":"2023-12-22T10:01:35.154943+0000","last_became_peered":"2023-12-22T10:01:35.154943+0000","last_unstale":"2023-12-22T10:01:35.155343+0000","last_undegraded":"2023-12-22T10:01:35.155343+0000","last_fullsized":"2023-12-22T10:01:35.155343+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.696639+0000","last_change":"2023-12-22T10:01:34.689294+0000","last_active":"2023-12-22T10:01:34.696639+0000","last_peered":"2023-12-22T10:01:34.696639+0000","last_clean":"2023-12-22T10:01:34.696639+0000","last_became_active":"2023-12-22T10:01:34.687510+0000","last_became_peered":"2023-12-22T10:01:34.687510+0000","last_unstale":"2023-12-22T10:01:34.696639+0000","last_undegraded":"2023-12-22T10:01:34.696639+0000","last_fullsized":"2023-12-22T10:01:34.696639+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.148843+0000","last_change":"2023-12-22T10:01:35.148843+0000","last_active":"2023-12-22T10:01:35.148843+0000","last_peered":"2023-12-22T10:01:35.148843+0000","last_clean":"2023-12-22T10:01:35.148843+0000","last_became_active":"2023-12-22T10:01:35.148363+0000","last_became_peered":"2023-12-22T10:01:35.148363+0000","last_unstale":"2023-12-22T10:01:35.148843+0000","last_undegraded":"2023-12-22T10:01:35.148843+0000","last_fullsized":"2023-12-22T10:01:35.148843+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.703246+0000","last_change":"2023-12-22T10:01:34.702043+0000","last_active":"2023-12-22T10:01:34.703246+0000","last_peered":"2023-12-22T10:01:34.703246+0000","last_clean":"2023-12-22T10:01:34.703246+0000","last_became_active":"2023-12-22T10:01:34.701318+0000","last_became_peered":"2023-12-22T10:01:34.701318+0000","last_unstale":"2023-12-22T10:01:34.703246+0000","last_undegraded":"2023-12-22T10:01:34.703246+0000","last_fullsized":"2023-12-22T10:01:34.703246+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.134712+0000","last_change":"2023-12-22T10:01:35.134712+0000","last_active":"2023-12-22T10:01:35.134712+0000","last_peered":"2023-12-22T10:01:35.134712+0000","last_clean":"2023-12-22T10:01:35.134712+0000","last_became_active":"2023-12-22T10:01:35.134447+0000","last_became_peered":"2023-12-22T10:01:35.134447+0000","last_unstale":"2023-12-22T10:01:35.134712+0000","last_undegraded":"2023-12-22T10:01:35.134712+0000","last_fullsized":"2023-12-22T10:01:35.134712+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.691730+0000","last_change":"2023-12-22T10:01:34.688497+0000","last_active":"2023-12-22T10:01:34.691730+0000","last_peered":"2023-12-22T10:01:34.691730+0000","last_clean":"2023-12-22T10:01:34.691730+0000","last_became_active":"2023-12-22T10:01:34.688207+0000","last_became_peered":"2023-12-22T10:01:34.688207+0000","last_unstale":"2023-12-22T10:01:34.691730+0000","last_undegraded":"2023-12-22T10:01:34.691730+0000","last_fullsized":"2023-12-22T10:01:34.691730+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.143383+0000","last_change":"2023-12-22T10:01:35.143383+0000","last_active":"2023-12-22T10:01:35.143383+0000","last_peered":"2023-12-22T10:01:35.143383+0000","last_clean":"2023-12-22T10:01:35.143383+0000","last_became_active":"2023-12-22T10:01:35.143073+0000","last_became_peered":"2023-12-22T10:01:35.143073+0000","last_unstale":"2023-12-22T10:01:35.143383+0000","last_undegraded":"2023-12-22T10:01:35.143383+0000","last_fullsized":"2023-12-22T10:01:35.143383+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.703380+0000","last_change":"2023-12-22T10:01:34.695905+0000","last_active":"2023-12-22T10:01:34.703380+0000","last_peered":"2023-12-22T10:01:34.703380+0000","last_clean":"2023-12-22T10:01:34.703380+0000","last_became_active":"2023-12-22T10:01:34.695517+0000","last_became_peered":"2023-12-22T10:01:34.695517+0000","last_unstale":"2023-12-22T10:01:34.703380+0000","last_undegraded":"2023-12-22T10:01:34.703380+0000","last_fullsized":"2023-12-22T10:01:34.703380+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.144625+0000","last_change":"2023-12-22T10:01:35.144625+0000","last_active":"2023-12-22T10:01:35.144625+0000","last_peered":"2023-12-22T10:01:35.144625+0000","last_clean":"2023-12-22T10:01:35.144625+0000","last_became_active":"2023-12-22T10:01:35.142641+0000","last_became_peered":"2023-12-22T10:01:35.142641+0000","last_unstale":"2023-12-22T10:01:35.144625+0000","last_undegraded":"2023-12-22T10:01:35.144625+0000","last_fullsized":"2023-12-22T10:01:35.144625+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.705091+0000","last_change":"2023-12-22T10:01:34.698158+0000","last_active":"2023-12-22T10:01:34.705091+0000","last_peered":"2023-12-22T10:01:34.705091+0000","last_clean":"2023-12-22T10:01:34.705091+0000","last_became_active":"2023-12-22T10:01:34.695554+0000","last_became_peered":"2023-12-22T10:01:34.695554+0000","last_unstale":"2023-12-22T10:01:34.705091+0000","last_undegraded":"2023-12-22T10:01:34.705091+0000","last_fullsized":"2023-12-22T10:01:34.705091+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.134824+0000","last_change":"2023-12-22T10:01:35.134824+0000","last_active":"2023-12-22T10:01:35.134824+0000","last_peered":"2023-12-22T10:01:35.134824+0000","last_clean":"2023-12-22T10:01:35.134824+0000","last_became_active":"2023-12-22T10:01:35.134157+0000","last_became_peered":"2023-12-22T10:01:35.134157+0000","last_unstale":"2023-12-22T10:01:35.134824+0000","last_undegraded":"2023-12-22T10:01:35.134824+0000","last_fullsized":"2023-12-22T10:01:35.134824+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.698480+0000","last_change":"2023-12-22T10:01:34.690897+0000","last_active":"2023-12-22T10:01:34.698480+0000","last_peered":"2023-12-22T10:01:34.698480+0000","last_clean":"2023-12-22T10:01:34.698480+0000","last_became_active":"2023-12-22T10:01:34.689026+0000","last_became_peered":"2023-12-22T10:01:34.689026+0000","last_unstale":"2023-12-22T10:01:34.698480+0000","last_undegraded":"2023-12-22T10:01:34.698480+0000","last_fullsized":"2023-12-22T10:01:34.698480+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.153324+0000","last_change":"2023-12-22T10:01:35.153324+0000","last_active":"2023-12-22T10:01:35.153324+0000","last_peered":"2023-12-22T10:01:35.153324+0000","last_clean":"2023-12-22T10:01:35.153324+0000","last_became_active":"2023-12-22T10:01:35.152234+0000","last_became_peered":"2023-12-22T10:01:35.152234+0000","last_unstale":"2023-12-22T10:01:35.153324+0000","last_undegraded":"2023-12-22T10:01:35.153324+0000","last_fullsized":"2023-12-22T10:01:35.153324+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.693876+0000","last_change":"2023-12-22T10:01:34.684413+0000","last_active":"2023-12-22T10:01:34.693876+0000","last_peered":"2023-12-22T10:01:34.693876+0000","last_clean":"2023-12-22T10:01:34.693876+0000","last_became_active":"2023-12-22T10:01:34.684083+0000","last_became_peered":"2023-12-22T10:01:34.684083+0000","last_unstale":"2023-12-22T10:01:34.693876+0000","last_undegraded":"2023-12-22T10:01:34.693876+0000","last_fullsized":"2023-12-22T10:01:34.693876+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.152474+0000","last_change":"2023-12-22T10:01:35.152474+0000","last_active":"2023-12-22T10:01:35.152474+0000","last_peered":"2023-12-22T10:01:35.152474+0000","last_clean":"2023-12-22T10:01:35.152474+0000","last_became_active":"2023-12-22T10:01:35.152153+0000","last_became_peered":"2023-12-22T10:01:35.152153+0000","last_unstale":"2023-12-22T10:01:35.152474+0000","last_undegraded":"2023-12-22T10:01:35.152474+0000","last_fullsized":"2023-12-22T10:01:35.152474+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.692698+0000","last_change":"2023-12-22T10:01:34.689631+0000","last_active":"2023-12-22T10:01:34.692698+0000","last_peered":"2023-12-22T10:01:34.692698+0000","last_clean":"2023-12-22T10:01:34.692698+0000","last_became_active":"2023-12-22T10:01:34.689296+0000","last_became_peered":"2023-12-22T10:01:34.689296+0000","last_unstale":"2023-12-22T10:01:34.692698+0000","last_undegraded":"2023-12-22T10:01:34.692698+0000","last_fullsized":"2023-12-22T10:01:34.692698+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.158342+0000","last_change":"2023-12-22T10:01:35.158342+0000","last_active":"2023-12-22T10:01:35.158342+0000","last_peered":"2023-12-22T10:01:35.158342+0000","last_clean":"2023-12-22T10:01:35.158342+0000","last_became_active":"2023-12-22T10:01:35.156056+0000","last_became_peered":"2023-12-22T10:01:35.156056+0000","last_unstale":"2023-12-22T10:01:35.158342+0000","last_undegraded":"2023-12-22T10:01:35.158342+0000","last_fullsized":"2023-12-22T10:01:35.158342+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"35'1","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.131519+0000","last_change":"2023-12-22T10:01:34.692535+0000","last_active":"2023-12-22T10:01:35.131519+0000","last_peered":"2023-12-22T10:01:35.131519+0000","last_clean":"2023-12-22T10:01:35.131519+0000","last_became_active":"2023-12-22T10:01:34.692223+0000","last_became_peered":"2023-12-22T10:01:34.692223+0000","last_unstale":"2023-12-22T10:01:35.131519+0000","last_undegraded":"2023-12-22T10:01:35.131519+0000","last_fullsized":"2023-12-22T10:01:35.131519+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.151202+0000","last_change":"2023-12-22T10:01:35.151202+0000","last_active":"2023-12-22T10:01:35.151202+0000","last_peered":"2023-12-22T10:01:35.151202+0000","last_clean":"2023-12-22T10:01:35.151202+0000","last_became_active":"2023-12-22T10:01:35.150961+0000","last_became_peered":"2023-12-22T10:01:35.150961+0000","last_unstale":"2023-12-22T10:01:35.151202+0000","last_undegraded":"2023-12-22T10:01:35.151202+0000","last_fullsized":"2023-12-22T10:01:35.151202+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"35'1","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.125842+0000","last_change":"2023-12-22T10:01:34.689373+0000","last_active":"2023-12-22T10:01:35.125842+0000","last_peered":"2023-12-22T10:01:35.125842+0000","last_clean":"2023-12-22T10:01:35.125842+0000","last_became_active":"2023-12-22T10:01:34.689010+0000","last_became_peered":"2023-12-22T10:01:34.689010+0000","last_unstale":"2023-12-22T10:01:35.125842+0000","last_undegraded":"2023-12-22T10:01:35.125842+0000","last_fullsized":"2023-12-22T10:01:35.125842+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.157214+0000","last_change":"2023-12-22T10:01:35.157214+0000","last_active":"2023-12-22T10:01:35.157214+0000","last_peered":"2023-12-22T10:01:35.157214+0000","last_clean":"2023-12-22T10:01:35.157214+0000","last_became_active":"2023-12-22T10:01:35.156041+0000","last_became_peered":"2023-12-22T10:01:35.156041+0000","last_unstale":"2023-12-22T10:01:35.157214+0000","last_undegraded":"2023-12-22T10:01:35.157214+0000","last_fullsized":"2023-12-22T10:01:35.157214+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"35'2","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.142407+0000","last_change":"2023-12-22T10:01:34.693006+0000","last_active":"2023-12-22T10:01:35.142407+0000","last_peered":"2023-12-22T10:01:35.142407+0000","last_clean":"2023-12-22T10:01:35.142407+0000","last_became_active":"2023-12-22T10:01:34.692460+0000","last_became_peered":"2023-12-22T10:01:34.692460+0000","last_unstale":"2023-12-22T10:01:35.142407+0000","last_undegraded":"2023-12-22T10:01:35.142407+0000","last_fullsized":"2023-12-22T10:01:35.142407+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.145742+0000","last_change":"2023-12-22T10:01:35.145742+0000","last_active":"2023-12-22T10:01:35.145742+0000","last_peered":"2023-12-22T10:01:35.145742+0000","last_clean":"2023-12-22T10:01:35.145742+0000","last_became_active":"2023-12-22T10:01:35.145385+0000","last_became_peered":"2023-12-22T10:01:35.145385+0000","last_unstale":"2023-12-22T10:01:35.145742+0000","last_undegraded":"2023-12-22T10:01:35.145742+0000","last_fullsized":"2023-12-22T10:01:35.145742+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.703400+0000","last_change":"2023-12-22T10:01:34.698319+0000","last_active":"2023-12-22T10:01:34.703400+0000","last_peered":"2023-12-22T10:01:34.703400+0000","last_clean":"2023-12-22T10:01:34.703400+0000","last_became_active":"2023-12-22T10:01:34.698118+0000","last_became_peered":"2023-12-22T10:01:34.698118+0000","last_unstale":"2023-12-22T10:01:34.703400+0000","last_undegraded":"2023-12-22T10:01:34.703400+0000","last_fullsized":"2023-12-22T10:01:34.703400+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.144227+0000","last_change":"2023-12-22T10:01:35.144227+0000","last_active":"2023-12-22T10:01:35.144227+0000","last_peered":"2023-12-22T10:01:35.144227+0000","last_clean":"2023-12-22T10:01:35.144227+0000","last_became_active":"2023-12-22T10:01:35.141822+0000","last_became_peered":"2023-12-22T10:01:35.141822+0000","last_unstale":"2023-12-22T10:01:35.144227+0000","last_undegraded":"2023-12-22T10:01:35.144227+0000","last_fullsized":"2023-12-22T10:01:35.144227+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.695584+0000","last_change":"2023-12-22T10:01:34.687654+0000","last_active":"2023-12-22T10:01:34.695584+0000","last_peered":"2023-12-22T10:01:34.695584+0000","last_clean":"2023-12-22T10:01:34.695584+0000","last_became_active":"2023-12-22T10:01:34.687337+0000","last_became_peered":"2023-12-22T10:01:34.687337+0000","last_unstale":"2023-12-22T10:01:34.695584+0000","last_undegraded":"2023-12-22T10:01:34.695584+0000","last_fullsized":"2023-12-22T10:01:34.695584+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.148573+0000","last_change":"2023-12-22T10:01:35.148573+0000","last_active":"2023-12-22T10:01:35.148573+0000","last_peered":"2023-12-22T10:01:35.148573+0000","last_clean":"2023-12-22T10:01:35.148573+0000","last_became_active":"2023-12-22T10:01:35.148279+0000","last_became_peered":"2023-12-22T10:01:35.148279+0000","last_unstale":"2023-12-22T10:01:35.148573+0000","last_undegraded":"2023-12-22T10:01:35.148573+0000","last_fullsized":"2023-12-22T10:01:35.148573+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.706662+0000","last_change":"2023-12-22T10:01:34.702330+0000","last_active":"2023-12-22T10:01:34.706662+0000","last_peered":"2023-12-22T10:01:34.706662+0000","last_clean":"2023-12-22T10:01:34.706662+0000","last_became_active":"2023-12-22T10:01:34.701937+0000","last_became_peered":"2023-12-22T10:01:34.701937+0000","last_unstale":"2023-12-22T10:01:34.706662+0000","last_undegraded":"2023-12-22T10:01:34.706662+0000","last_fullsized":"2023-12-22T10:01:34.706662+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.161623+0000","last_change":"2023-12-22T10:01:35.161623+0000","last_active":"2023-12-22T10:01:35.161623+0000","last_peered":"2023-12-22T10:01:35.161623+0000","last_clean":"2023-12-22T10:01:35.161623+0000","last_became_active":"2023-12-22T10:01:35.161366+0000","last_became_peered":"2023-12-22T10:01:35.161366+0000","last_unstale":"2023-12-22T10:01:35.161623+0000","last_undegraded":"2023-12-22T10:01:35.161623+0000","last_fullsized":"2023-12-22T10:01:35.161623+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.699760+0000","last_change":"2023-12-22T10:01:34.694683+0000","last_active":"2023-12-22T10:01:34.699760+0000","last_peered":"2023-12-22T10:01:34.699760+0000","last_clean":"2023-12-22T10:01:34.699760+0000","last_became_active":"2023-12-22T10:01:34.693873+0000","last_became_peered":"2023-12-22T10:01:34.693873+0000","last_unstale":"2023-12-22T10:01:34.699760+0000","last_undegraded":"2023-12-22T10:01:34.699760+0000","last_fullsized":"2023-12-22T10:01:34.699760+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.141439+0000","last_change":"2023-12-22T10:01:35.141439+0000","last_active":"2023-12-22T10:01:35.141439+0000","last_peered":"2023-12-22T10:01:35.141439+0000","last_clean":"2023-12-22T10:01:35.141439+0000","last_became_active":"2023-12-22T10:01:35.141140+0000","last_became_peered":"2023-12-22T10:01:35.141140+0000","last_unstale":"2023-12-22T10:01:35.141439+0000","last_undegraded":"2023-12-22T10:01:35.141439+0000","last_fullsized":"2023-12-22T10:01:35.141439+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.705653+0000","last_change":"2023-12-22T10:01:34.701959+0000","last_active":"2023-12-22T10:01:34.705653+0000","last_peered":"2023-12-22T10:01:34.705653+0000","last_clean":"2023-12-22T10:01:34.705653+0000","last_became_active":"2023-12-22T10:01:34.693141+0000","last_became_peered":"2023-12-22T10:01:34.693141+0000","last_unstale":"2023-12-22T10:01:34.705653+0000","last_undegraded":"2023-12-22T10:01:34.705653+0000","last_fullsized":"2023-12-22T10:01:34.705653+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.153160+0000","last_change":"2023-12-22T10:01:35.153160+0000","last_active":"2023-12-22T10:01:35.153160+0000","last_peered":"2023-12-22T10:01:35.153160+0000","last_clean":"2023-12-22T10:01:35.153160+0000","last_became_active":"2023-12-22T10:01:35.152160+0000","last_became_peered":"2023-12-22T10:01:35.152160+0000","last_unstale":"2023-12-22T10:01:35.153160+0000","last_undegraded":"2023-12-22T10:01:35.153160+0000","last_fullsized":"2023-12-22T10:01:35.153160+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.696619+0000","last_change":"2023-12-22T10:01:34.685148+0000","last_active":"2023-12-22T10:01:34.696619+0000","last_peered":"2023-12-22T10:01:34.696619+0000","last_clean":"2023-12-22T10:01:34.696619+0000","last_became_active":"2023-12-22T10:01:34.684840+0000","last_became_peered":"2023-12-22T10:01:34.684840+0000","last_unstale":"2023-12-22T10:01:34.696619+0000","last_undegraded":"2023-12-22T10:01:34.696619+0000","last_fullsized":"2023-12-22T10:01:34.696619+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.152114+0000","last_change":"2023-12-22T10:01:35.152114+0000","last_active":"2023-12-22T10:01:35.152114+0000","last_peered":"2023-12-22T10:01:35.152114+0000","last_clean":"2023-12-22T10:01:35.152114+0000","last_became_active":"2023-12-22T10:01:35.151816+0000","last_became_peered":"2023-12-22T10:01:35.151816+0000","last_unstale":"2023-12-22T10:01:35.152114+0000","last_undegraded":"2023-12-22T10:01:35.152114+0000","last_fullsized":"2023-12-22T10:01:35.152114+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.700497+0000","last_change":"2023-12-22T10:01:34.693683+0000","last_active":"2023-12-22T10:01:34.700497+0000","last_peered":"2023-12-22T10:01:34.700497+0000","last_clean":"2023-12-22T10:01:34.700497+0000","last_became_active":"2023-12-22T10:01:34.693296+0000","last_became_peered":"2023-12-22T10:01:34.693296+0000","last_unstale":"2023-12-22T10:01:34.700497+0000","last_undegraded":"2023-12-22T10:01:34.700497+0000","last_fullsized":"2023-12-22T10:01:34.700497+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.138193+0000","last_change":"2023-12-22T10:01:35.138193+0000","last_active":"2023-12-22T10:01:35.138193+0000","last_peered":"2023-12-22T10:01:35.138193+0000","last_clean":"2023-12-22T10:01:35.138193+0000","last_became_active":"2023-12-22T10:01:35.137926+0000","last_became_peered":"2023-12-22T10:01:35.137926+0000","last_unstale":"2023-12-22T10:01:35.138193+0000","last_undegraded":"2023-12-22T10:01:35.138193+0000","last_fullsized":"2023-12-22T10:01:35.138193+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"35'3","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.159297+0000","last_change":"2023-12-22T10:01:34.696240+0000","last_active":"2023-12-22T10:01:35.159297+0000","last_peered":"2023-12-22T10:01:35.159297+0000","last_clean":"2023-12-22T10:01:35.159297+0000","last_became_active":"2023-12-22T10:01:34.695913+0000","last_became_peered":"2023-12-22T10:01:34.695913+0000","last_unstale":"2023-12-22T10:01:35.159297+0000","last_undegraded":"2023-12-22T10:01:35.159297+0000","last_fullsized":"2023-12-22T10:01:35.159297+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.136369+0000","last_change":"2023-12-22T10:01:35.136369+0000","last_active":"2023-12-22T10:01:35.136369+0000","last_peered":"2023-12-22T10:01:35.136369+0000","last_clean":"2023-12-22T10:01:35.136369+0000","last_became_active":"2023-12-22T10:01:35.136123+0000","last_became_peered":"2023-12-22T10:01:35.136123+0000","last_unstale":"2023-12-22T10:01:35.136369+0000","last_undegraded":"2023-12-22T10:01:35.136369+0000","last_fullsized":"2023-12-22T10:01:35.136369+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"35'2","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.146606+0000","last_change":"2023-12-22T10:01:34.690599+0000","last_active":"2023-12-22T10:01:35.146606+0000","last_peered":"2023-12-22T10:01:35.146606+0000","last_clean":"2023-12-22T10:01:35.146606+0000","last_became_active":"2023-12-22T10:01:34.690313+0000","last_became_peered":"2023-12-22T10:01:34.690313+0000","last_unstale":"2023-12-22T10:01:35.146606+0000","last_undegraded":"2023-12-22T10:01:35.146606+0000","last_fullsized":"2023-12-22T10:01:35.146606+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.141012+0000","last_change":"2023-12-22T10:01:35.141012+0000","last_active":"2023-12-22T10:01:35.141012+0000","last_peered":"2023-12-22T10:01:35.141012+0000","last_clean":"2023-12-22T10:01:35.141012+0000","last_became_active":"2023-12-22T10:01:35.140498+0000","last_became_peered":"2023-12-22T10:01:35.140498+0000","last_unstale":"2023-12-22T10:01:35.141012+0000","last_undegraded":"2023-12-22T10:01:35.141012+0000","last_fullsized":"2023-12-22T10:01:35.141012+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"35'1","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.127844+0000","last_change":"2023-12-22T10:01:34.694064+0000","last_active":"2023-12-22T10:01:35.127844+0000","last_peered":"2023-12-22T10:01:35.127844+0000","last_clean":"2023-12-22T10:01:35.127844+0000","last_became_active":"2023-12-22T10:01:34.693775+0000","last_became_peered":"2023-12-22T10:01:34.693775+0000","last_unstale":"2023-12-22T10:01:35.127844+0000","last_undegraded":"2023-12-22T10:01:35.127844+0000","last_fullsized":"2023-12-22T10:01:35.127844+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.136270+0000","last_change":"2023-12-22T10:01:35.136270+0000","last_active":"2023-12-22T10:01:35.136270+0000","last_peered":"2023-12-22T10:01:35.136270+0000","last_clean":"2023-12-22T10:01:35.136270+0000","last_became_active":"2023-12-22T10:01:35.135729+0000","last_became_peered":"2023-12-22T10:01:35.135729+0000","last_unstale":"2023-12-22T10:01:35.136270+0000","last_undegraded":"2023-12-22T10:01:35.136270+0000","last_fullsized":"2023-12-22T10:01:35.136270+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.707410+0000","last_change":"2023-12-22T10:01:34.705576+0000","last_active":"2023-12-22T10:01:34.707410+0000","last_peered":"2023-12-22T10:01:34.707410+0000","last_clean":"2023-12-22T10:01:34.707410+0000","last_became_active":"2023-12-22T10:01:34.705340+0000","last_became_peered":"2023-12-22T10:01:34.705340+0000","last_unstale":"2023-12-22T10:01:34.707410+0000","last_undegraded":"2023-12-22T10:01:34.707410+0000","last_fullsized":"2023-12-22T10:01:34.707410+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.140150+0000","last_change":"2023-12-22T10:01:35.140150+0000","last_active":"2023-12-22T10:01:35.140150+0000","last_peered":"2023-12-22T10:01:35.140150+0000","last_clean":"2023-12-22T10:01:35.140150+0000","last_became_active":"2023-12-22T10:01:35.139884+0000","last_became_peered":"2023-12-22T10:01:35.139884+0000","last_unstale":"2023-12-22T10:01:35.140150+0000","last_undegraded":"2023-12-22T10:01:35.140150+0000","last_fullsized":"2023-12-22T10:01:35.140150+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.702265+0000","last_change":"2023-12-22T10:01:34.690703+0000","last_active":"2023-12-22T10:01:34.702265+0000","last_peered":"2023-12-22T10:01:34.702265+0000","last_clean":"2023-12-22T10:01:34.702265+0000","last_became_active":"2023-12-22T10:01:34.690369+0000","last_became_peered":"2023-12-22T10:01:34.690369+0000","last_unstale":"2023-12-22T10:01:34.702265+0000","last_undegraded":"2023-12-22T10:01:34.702265+0000","last_fullsized":"2023-12-22T10:01:34.702265+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.128289+0000","last_change":"2023-12-22T10:01:35.128289+0000","last_active":"2023-12-22T10:01:35.128289+0000","last_peered":"2023-12-22T10:01:35.128289+0000","last_clean":"2023-12-22T10:01:35.128289+0000","last_became_active":"2023-12-22T10:01:35.127995+0000","last_became_peered":"2023-12-22T10:01:35.127995+0000","last_unstale":"2023-12-22T10:01:35.128289+0000","last_undegraded":"2023-12-22T10:01:35.128289+0000","last_fullsized":"2023-12-22T10:01:35.128289+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"35'4","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.155293+0000","last_change":"2023-12-22T10:01:34.705549+0000","last_active":"2023-12-22T10:01:35.155293+0000","last_peered":"2023-12-22T10:01:35.155293+0000","last_clean":"2023-12-22T10:01:35.155293+0000","last_became_active":"2023-12-22T10:01:34.704846+0000","last_became_peered":"2023-12-22T10:01:34.704846+0000","last_unstale":"2023-12-22T10:01:35.155293+0000","last_undegraded":"2023-12-22T10:01:35.155293+0000","last_fullsized":"2023-12-22T10:01:35.155293+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.139893+0000","last_change":"2023-12-22T10:01:35.139893+0000","last_active":"2023-12-22T10:01:35.139893+0000","last_peered":"2023-12-22T10:01:35.139893+0000","last_clean":"2023-12-22T10:01:35.139893+0000","last_became_active":"2023-12-22T10:01:35.138934+0000","last_became_peered":"2023-12-22T10:01:35.138934+0000","last_unstale":"2023-12-22T10:01:35.139893+0000","last_undegraded":"2023-12-22T10:01:35.139893+0000","last_fullsized":"2023-12-22T10:01:35.139893+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"35'1","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.139767+0000","last_change":"2023-12-22T10:01:34.687756+0000","last_active":"2023-12-22T10:01:35.139767+0000","last_peered":"2023-12-22T10:01:35.139767+0000","last_clean":"2023-12-22T10:01:35.139767+0000","last_became_active":"2023-12-22T10:01:34.687316+0000","last_became_peered":"2023-12-22T10:01:34.687316+0000","last_unstale":"2023-12-22T10:01:35.139767+0000","last_undegraded":"2023-12-22T10:01:35.139767+0000","last_fullsized":"2023-12-22T10:01:35.139767+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.142614+0000","last_change":"2023-12-22T10:01:35.142614+0000","last_active":"2023-12-22T10:01:35.142614+0000","last_peered":"2023-12-22T10:01:35.142614+0000","last_clean":"2023-12-22T10:01:35.142614+0000","last_became_active":"2023-12-22T10:01:35.139303+0000","last_became_peered":"2023-12-22T10:01:35.139303+0000","last_unstale":"2023-12-22T10:01:35.142614+0000","last_undegraded":"2023-12-22T10:01:35.142614+0000","last_fullsized":"2023-12-22T10:01:35.142614+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"35'2","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.163131+0000","last_change":"2023-12-22T10:01:34.696868+0000","last_active":"2023-12-22T10:01:35.163131+0000","last_peered":"2023-12-22T10:01:35.163131+0000","last_clean":"2023-12-22T10:01:35.163131+0000","last_became_active":"2023-12-22T10:01:34.696571+0000","last_became_peered":"2023-12-22T10:01:34.696571+0000","last_unstale":"2023-12-22T10:01:35.163131+0000","last_undegraded":"2023-12-22T10:01:35.163131+0000","last_fullsized":"2023-12-22T10:01:35.163131+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.141882+0000","last_change":"2023-12-22T10:01:35.141882+0000","last_active":"2023-12-22T10:01:35.141882+0000","last_peered":"2023-12-22T10:01:35.141882+0000","last_clean":"2023-12-22T10:01:35.141882+0000","last_became_active":"2023-12-22T10:01:35.141536+0000","last_became_peered":"2023-12-22T10:01:35.141536+0000","last_unstale":"2023-12-22T10:01:35.141882+0000","last_undegraded":"2023-12-22T10:01:35.141882+0000","last_fullsized":"2023-12-22T10:01:35.141882+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.701982+0000","last_change":"2023-12-22T10:01:34.699249+0000","last_active":"2023-12-22T10:01:34.701982+0000","last_peered":"2023-12-22T10:01:34.701982+0000","last_clean":"2023-12-22T10:01:34.701982+0000","last_became_active":"2023-12-22T10:01:34.698955+0000","last_became_peered":"2023-12-22T10:01:34.698955+0000","last_unstale":"2023-12-22T10:01:34.701982+0000","last_undegraded":"2023-12-22T10:01:34.701982+0000","last_fullsized":"2023-12-22T10:01:34.701982+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.143645+0000","last_change":"2023-12-22T10:01:35.143645+0000","last_active":"2023-12-22T10:01:35.143645+0000","last_peered":"2023-12-22T10:01:35.143645+0000","last_clean":"2023-12-22T10:01:35.143645+0000","last_became_active":"2023-12-22T10:01:35.143327+0000","last_became_peered":"2023-12-22T10:01:35.143327+0000","last_unstale":"2023-12-22T10:01:35.143645+0000","last_undegraded":"2023-12-22T10:01:35.143645+0000","last_fullsized":"2023-12-22T10:01:35.143645+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.701651+0000","last_change":"2023-12-22T10:01:34.697799+0000","last_active":"2023-12-22T10:01:34.701651+0000","last_peered":"2023-12-22T10:01:34.701651+0000","last_clean":"2023-12-22T10:01:34.701651+0000","last_became_active":"2023-12-22T10:01:34.697233+0000","last_became_peered":"2023-12-22T10:01:34.697233+0000","last_unstale":"2023-12-22T10:01:34.701651+0000","last_undegraded":"2023-12-22T10:01:34.701651+0000","last_fullsized":"2023-12-22T10:01:34.701651+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.156435+0000","last_change":"2023-12-22T10:01:35.156435+0000","last_active":"2023-12-22T10:01:35.156435+0000","last_peered":"2023-12-22T10:01:35.156435+0000","last_clean":"2023-12-22T10:01:35.156435+0000","last_became_active":"2023-12-22T10:01:35.156132+0000","last_became_peered":"2023-12-22T10:01:35.156132+0000","last_unstale":"2023-12-22T10:01:35.156435+0000","last_undegraded":"2023-12-22T10:01:35.156435+0000","last_fullsized":"2023-12-22T10:01:35.156435+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"35'1","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.126373+0000","last_change":"2023-12-22T10:01:34.681213+0000","last_active":"2023-12-22T10:01:35.126373+0000","last_peered":"2023-12-22T10:01:35.126373+0000","last_clean":"2023-12-22T10:01:35.126373+0000","last_became_active":"2023-12-22T10:01:34.680928+0000","last_became_peered":"2023-12-22T10:01:34.680928+0000","last_unstale":"2023-12-22T10:01:35.126373+0000","last_undegraded":"2023-12-22T10:01:35.126373+0000","last_fullsized":"2023-12-22T10:01:35.126373+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.140301+0000","last_change":"2023-12-22T10:01:35.140301+0000","last_active":"2023-12-22T10:01:35.140301+0000","last_peered":"2023-12-22T10:01:35.140301+0000","last_clean":"2023-12-22T10:01:35.140301+0000","last_became_active":"2023-12-22T10:01:35.140013+0000","last_became_peered":"2023-12-22T10:01:35.140013+0000","last_unstale":"2023-12-22T10:01:35.140301+0000","last_undegraded":"2023-12-22T10:01:35.140301+0000","last_fullsized":"2023-12-22T10:01:35.140301+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.702381+0000","last_change":"2023-12-22T10:01:34.700554+0000","last_active":"2023-12-22T10:01:34.702381+0000","last_peered":"2023-12-22T10:01:34.702381+0000","last_clean":"2023-12-22T10:01:34.702381+0000","last_became_active":"2023-12-22T10:01:34.700250+0000","last_became_peered":"2023-12-22T10:01:34.700250+0000","last_unstale":"2023-12-22T10:01:34.702381+0000","last_undegraded":"2023-12-22T10:01:34.702381+0000","last_fullsized":"2023-12-22T10:01:34.702381+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.149330+0000","last_change":"2023-12-22T10:01:35.149330+0000","last_active":"2023-12-22T10:01:35.149330+0000","last_peered":"2023-12-22T10:01:35.149330+0000","last_clean":"2023-12-22T10:01:35.149330+0000","last_became_active":"2023-12-22T10:01:35.148997+0000","last_became_peered":"2023-12-22T10:01:35.148997+0000","last_unstale":"2023-12-22T10:01:35.149330+0000","last_undegraded":"2023-12-22T10:01:35.149330+0000","last_fullsized":"2023-12-22T10:01:35.149330+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.708610+0000","last_change":"2023-12-22T10:01:34.706221+0000","last_active":"2023-12-22T10:01:34.708610+0000","last_peered":"2023-12-22T10:01:34.708610+0000","last_clean":"2023-12-22T10:01:34.708610+0000","last_became_active":"2023-12-22T10:01:34.705796+0000","last_became_peered":"2023-12-22T10:01:34.705796+0000","last_unstale":"2023-12-22T10:01:34.708610+0000","last_undegraded":"2023-12-22T10:01:34.708610+0000","last_fullsized":"2023-12-22T10:01:34.708610+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.140317+0000","last_change":"2023-12-22T10:01:35.140317+0000","last_active":"2023-12-22T10:01:35.140317+0000","last_peered":"2023-12-22T10:01:35.140317+0000","last_clean":"2023-12-22T10:01:35.140317+0000","last_became_active":"2023-12-22T10:01:35.140015+0000","last_became_peered":"2023-12-22T10:01:35.140015+0000","last_unstale":"2023-12-22T10:01:35.140317+0000","last_undegraded":"2023-12-22T10:01:35.140317+0000","last_fullsized":"2023-12-22T10:01:35.140317+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.697673+0000","last_change":"2023-12-22T10:01:34.695101+0000","last_active":"2023-12-22T10:01:34.697673+0000","last_peered":"2023-12-22T10:01:34.697673+0000","last_clean":"2023-12-22T10:01:34.697673+0000","last_became_active":"2023-12-22T10:01:34.694803+0000","last_became_peered":"2023-12-22T10:01:34.694803+0000","last_unstale":"2023-12-22T10:01:34.697673+0000","last_undegraded":"2023-12-22T10:01:34.697673+0000","last_fullsized":"2023-12-22T10:01:34.697673+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.148013+0000","last_change":"2023-12-22T10:01:35.148013+0000","last_active":"2023-12-22T10:01:35.148013+0000","last_peered":"2023-12-22T10:01:35.148013+0000","last_clean":"2023-12-22T10:01:35.148013+0000","last_became_active":"2023-12-22T10:01:35.147694+0000","last_became_peered":"2023-12-22T10:01:35.147694+0000","last_unstale":"2023-12-22T10:01:35.148013+0000","last_undegraded":"2023-12-22T10:01:35.148013+0000","last_fullsized":"2023-12-22T10:01:35.148013+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.702610+0000","last_change":"2023-12-22T10:01:34.698883+0000","last_active":"2023-12-22T10:01:34.702610+0000","last_peered":"2023-12-22T10:01:34.702610+0000","last_clean":"2023-12-22T10:01:34.702610+0000","last_became_active":"2023-12-22T10:01:34.698295+0000","last_became_peered":"2023-12-22T10:01:34.698295+0000","last_unstale":"2023-12-22T10:01:34.702610+0000","last_undegraded":"2023-12-22T10:01:34.702610+0000","last_fullsized":"2023-12-22T10:01:34.702610+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.677918+0000","last_change":"2023-12-22T10:00:28.036372+0000","last_active":"2023-12-22T10:01:34.677918+0000","last_peered":"2023-12-22T10:01:34.677918+0000","last_clean":"2023-12-22T10:01:34.677918+0000","last_became_active":"2023-12-22T10:00:28.035974+0000","last_became_peered":"2023-12-22T10:00:28.035974+0000","last_unstale":"2023-12-22T10:01:34.677918+0000","last_undegraded":"2023-12-22T10:01:34.677918+0000","last_fullsized":"2023-12-22T10:01:34.677918+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_clean_scrub_stamp":"2023-12-22T10:00:27.001906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.153601+0000","last_change":"2023-12-22T10:01:35.153601+0000","last_active":"2023-12-22T10:01:35.153601+0000","last_peered":"2023-12-22T10:01:35.153601+0000","last_clean":"2023-12-22T10:01:35.153601+0000","last_became_active":"2023-12-22T10:01:35.152791+0000","last_became_peered":"2023-12-22T10:01:35.152791+0000","last_unstale":"2023-12-22T10:01:35.153601+0000","last_undegraded":"2023-12-22T10:01:35.153601+0000","last_fullsized":"2023-12-22T10:01:35.153601+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.685466+0000","last_change":"2023-12-22T10:01:34.680407+0000","last_active":"2023-12-22T10:01:34.685466+0000","last_peered":"2023-12-22T10:01:34.685466+0000","last_clean":"2023-12-22T10:01:34.685466+0000","last_became_active":"2023-12-22T10:01:34.679458+0000","last_became_peered":"2023-12-22T10:01:34.679458+0000","last_unstale":"2023-12-22T10:01:34.685466+0000","last_undegraded":"2023-12-22T10:01:34.685466+0000","last_fullsized":"2023-12-22T10:01:34.685466+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.679463+0000","last_change":"2023-12-22T10:00:28.035308+0000","last_active":"2023-12-22T10:01:34.679463+0000","last_peered":"2023-12-22T10:01:34.679463+0000","last_clean":"2023-12-22T10:01:34.679463+0000","last_became_active":"2023-12-22T10:00:28.035002+0000","last_became_peered":"2023-12-22T10:00:28.035002+0000","last_unstale":"2023-12-22T10:01:34.679463+0000","last_undegraded":"2023-12-22T10:01:34.679463+0000","last_fullsized":"2023-12-22T10:01:34.679463+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_clean_scrub_stamp":"2023-12-22T10:00:27.001906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.156062+0000","last_change":"2023-12-22T10:01:35.156062+0000","last_active":"2023-12-22T10:01:35.156062+0000","last_peered":"2023-12-22T10:01:35.156062+0000","last_clean":"2023-12-22T10:01:35.156062+0000","last_became_active":"2023-12-22T10:01:35.155705+0000","last_became_peered":"2023-12-22T10:01:35.155705+0000","last_unstale":"2023-12-22T10:01:35.156062+0000","last_undegraded":"2023-12-22T10:01:35.156062+0000","last_fullsized":"2023-12-22T10:01:35.156062+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.698457+0000","last_change":"2023-12-22T10:01:34.684207+0000","last_active":"2023-12-22T10:01:34.698457+0000","last_peered":"2023-12-22T10:01:34.698457+0000","last_clean":"2023-12-22T10:01:34.698457+0000","last_became_active":"2023-12-22T10:01:34.683911+0000","last_became_peered":"2023-12-22T10:01:34.683911+0000","last_unstale":"2023-12-22T10:01:34.698457+0000","last_undegraded":"2023-12-22T10:01:34.698457+0000","last_fullsized":"2023-12-22T10:01:34.698457+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.677767+0000","last_change":"2023-12-22T10:00:28.029892+0000","last_active":"2023-12-22T10:01:34.677767+0000","last_peered":"2023-12-22T10:01:34.677767+0000","last_clean":"2023-12-22T10:01:34.677767+0000","last_became_active":"2023-12-22T10:00:28.029391+0000","last_became_peered":"2023-12-22T10:00:28.029391+0000","last_unstale":"2023-12-22T10:01:34.677767+0000","last_undegraded":"2023-12-22T10:01:34.677767+0000","last_fullsized":"2023-12-22T10:01:34.677767+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_clean_scrub_stamp":"2023-12-22T10:00:27.001906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.130148+0000","last_change":"2023-12-22T10:01:35.130148+0000","last_active":"2023-12-22T10:01:35.130148+0000","last_peered":"2023-12-22T10:01:35.130148+0000","last_clean":"2023-12-22T10:01:35.130148+0000","last_became_active":"2023-12-22T10:01:35.129858+0000","last_became_peered":"2023-12-22T10:01:35.129858+0000","last_unstale":"2023-12-22T10:01:35.130148+0000","last_undegraded":"2023-12-22T10:01:35.130148+0000","last_fullsized":"2023-12-22T10:01:35.130148+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.698590+0000","last_change":"2023-12-22T10:01:34.693923+0000","last_active":"2023-12-22T10:01:34.698590+0000","last_peered":"2023-12-22T10:01:34.698590+0000","last_clean":"2023-12-22T10:01:34.698590+0000","last_became_active":"2023-12-22T10:01:34.693616+0000","last_became_peered":"2023-12-22T10:01:34.693616+0000","last_unstale":"2023-12-22T10:01:34.698590+0000","last_undegraded":"2023-12-22T10:01:34.698590+0000","last_fullsized":"2023-12-22T10:01:34.698590+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.672378+0000","last_change":"2023-12-22T10:00:28.025395+0000","last_active":"2023-12-22T10:01:34.672378+0000","last_peered":"2023-12-22T10:01:34.672378+0000","last_clean":"2023-12-22T10:01:34.672378+0000","last_became_active":"2023-12-22T10:00:28.024588+0000","last_became_peered":"2023-12-22T10:00:28.024588+0000","last_unstale":"2023-12-22T10:01:34.672378+0000","last_undegraded":"2023-12-22T10:01:34.672378+0000","last_fullsized":"2023-12-22T10:01:34.672378+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_clean_scrub_stamp":"2023-12-22T10:00:27.001906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.161679+0000","last_change":"2023-12-22T10:01:35.161679+0000","last_active":"2023-12-22T10:01:35.161679+0000","last_peered":"2023-12-22T10:01:35.161679+0000","last_clean":"2023-12-22T10:01:35.161679+0000","last_became_active":"2023-12-22T10:01:35.161420+0000","last_became_peered":"2023-12-22T10:01:35.161420+0000","last_unstale":"2023-12-22T10:01:35.161679+0000","last_undegraded":"2023-12-22T10:01:35.161679+0000","last_fullsized":"2023-12-22T10:01:35.161679+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.699359+0000","last_change":"2023-12-22T10:01:34.695408+0000","last_active":"2023-12-22T10:01:34.699359+0000","last_peered":"2023-12-22T10:01:34.699359+0000","last_clean":"2023-12-22T10:01:34.699359+0000","last_became_active":"2023-12-22T10:01:34.694999+0000","last_became_peered":"2023-12-22T10:01:34.694999+0000","last_unstale":"2023-12-22T10:01:34.699359+0000","last_undegraded":"2023-12-22T10:01:34.699359+0000","last_fullsized":"2023-12-22T10:01:34.699359+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.672772+0000","last_change":"2023-12-22T10:00:28.029884+0000","last_active":"2023-12-22T10:01:34.672772+0000","last_peered":"2023-12-22T10:01:34.672772+0000","last_clean":"2023-12-22T10:01:34.672772+0000","last_became_active":"2023-12-22T10:00:28.029422+0000","last_became_peered":"2023-12-22T10:00:28.029422+0000","last_unstale":"2023-12-22T10:01:34.672772+0000","last_undegraded":"2023-12-22T10:01:34.672772+0000","last_fullsized":"2023-12-22T10:01:34.672772+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_clean_scrub_stamp":"2023-12-22T10:00:27.001906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.148673+0000","last_change":"2023-12-22T10:01:35.148673+0000","last_active":"2023-12-22T10:01:35.148673+0000","last_peered":"2023-12-22T10:01:35.148673+0000","last_clean":"2023-12-22T10:01:35.148673+0000","last_became_active":"2023-12-22T10:01:35.148293+0000","last_became_peered":"2023-12-22T10:01:35.148293+0000","last_unstale":"2023-12-22T10:01:35.148673+0000","last_undegraded":"2023-12-22T10:01:35.148673+0000","last_fullsized":"2023-12-22T10:01:35.148673+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.701728+0000","last_change":"2023-12-22T10:01:34.698687+0000","last_active":"2023-12-22T10:01:34.701728+0000","last_peered":"2023-12-22T10:01:34.701728+0000","last_clean":"2023-12-22T10:01:34.701728+0000","last_became_active":"2023-12-22T10:01:34.698369+0000","last_became_peered":"2023-12-22T10:01:34.698369+0000","last_unstale":"2023-12-22T10:01:34.701728+0000","last_undegraded":"2023-12-22T10:01:34.701728+0000","last_fullsized":"2023-12-22T10:01:34.701728+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.667511+0000","last_change":"2023-12-22T10:00:28.028621+0000","last_active":"2023-12-22T10:01:34.667511+0000","last_peered":"2023-12-22T10:01:34.667511+0000","last_clean":"2023-12-22T10:01:34.667511+0000","last_became_active":"2023-12-22T10:00:28.028159+0000","last_became_peered":"2023-12-22T10:00:28.028159+0000","last_unstale":"2023-12-22T10:01:34.667511+0000","last_undegraded":"2023-12-22T10:01:34.667511+0000","last_fullsized":"2023-12-22T10:01:34.667511+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_clean_scrub_stamp":"2023-12-22T10:00:27.001906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.139521+0000","last_change":"2023-12-22T10:01:35.139521+0000","last_active":"2023-12-22T10:01:35.139521+0000","last_peered":"2023-12-22T10:01:35.139521+0000","last_clean":"2023-12-22T10:01:35.139521+0000","last_became_active":"2023-12-22T10:01:35.139189+0000","last_became_peered":"2023-12-22T10:01:35.139189+0000","last_unstale":"2023-12-22T10:01:35.139521+0000","last_undegraded":"2023-12-22T10:01:35.139521+0000","last_fullsized":"2023-12-22T10:01:35.139521+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"35'2","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.160687+0000","last_change":"2023-12-22T10:01:34.680088+0000","last_active":"2023-12-22T10:01:35.160687+0000","last_peered":"2023-12-22T10:01:35.160687+0000","last_clean":"2023-12-22T10:01:35.160687+0000","last_became_active":"2023-12-22T10:01:34.679800+0000","last_became_peered":"2023-12-22T10:01:34.679800+0000","last_unstale":"2023-12-22T10:01:35.160687+0000","last_undegraded":"2023-12-22T10:01:35.160687+0000","last_fullsized":"2023-12-22T10:01:35.160687+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.670731+0000","last_change":"2023-12-22T10:00:28.030883+0000","last_active":"2023-12-22T10:01:34.670731+0000","last_peered":"2023-12-22T10:01:34.670731+0000","last_clean":"2023-12-22T10:01:34.670731+0000","last_became_active":"2023-12-22T10:00:28.030284+0000","last_became_peered":"2023-12-22T10:00:28.030284+0000","last_unstale":"2023-12-22T10:01:34.670731+0000","last_undegraded":"2023-12-22T10:01:34.670731+0000","last_fullsized":"2023-12-22T10:01:34.670731+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_clean_scrub_stamp":"2023-12-22T10:00:27.001906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.159707+0000","last_change":"2023-12-22T10:01:35.159707+0000","last_active":"2023-12-22T10:01:35.159707+0000","last_peered":"2023-12-22T10:01:35.159707+0000","last_clean":"2023-12-22T10:01:35.159707+0000","last_became_active":"2023-12-22T10:01:35.159054+0000","last_became_peered":"2023-12-22T10:01:35.159054+0000","last_unstale":"2023-12-22T10:01:35.159707+0000","last_undegraded":"2023-12-22T10:01:35.159707+0000","last_fullsized":"2023-12-22T10:01:35.159707+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.697326+0000","last_change":"2023-12-22T10:01:34.688735+0000","last_active":"2023-12-22T10:01:34.697326+0000","last_peered":"2023-12-22T10:01:34.697326+0000","last_clean":"2023-12-22T10:01:34.697326+0000","last_became_active":"2023-12-22T10:01:34.688216+0000","last_became_peered":"2023-12-22T10:01:34.688216+0000","last_unstale":"2023-12-22T10:01:34.697326+0000","last_undegraded":"2023-12-22T10:01:34.697326+0000","last_fullsized":"2023-12-22T10:01:34.697326+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.676252+0000","last_change":"2023-12-22T10:00:28.031790+0000","last_active":"2023-12-22T10:01:34.676252+0000","last_peered":"2023-12-22T10:01:34.676252+0000","last_clean":"2023-12-22T10:01:34.676252+0000","last_became_active":"2023-12-22T10:00:28.031190+0000","last_became_peered":"2023-12-22T10:00:28.031190+0000","last_unstale":"2023-12-22T10:01:34.676252+0000","last_undegraded":"2023-12-22T10:01:34.676252+0000","last_fullsized":"2023-12-22T10:01:34.676252+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_clean_scrub_stamp":"2023-12-22T10:00:27.001906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.677278+0000","last_change":"2023-12-22T10:00:27.889031+0000","last_active":"2023-12-22T10:01:34.677278+0000","last_peered":"2023-12-22T10:01:34.677278+0000","last_clean":"2023-12-22T10:01:34.677278+0000","last_became_active":"2023-12-22T10:00:27.888164+0000","last_became_peered":"2023-12-22T10:00:27.888164+0000","last_unstale":"2023-12-22T10:01:34.677278+0000","last_undegraded":"2023-12-22T10:01:34.677278+0000","last_fullsized":"2023-12-22T10:01:34.677278+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:25.998963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:25.998963+0000","last_clean_scrub_stamp":"2023-12-22T10:00:25.998963+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297488,"kb_used_data":392,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074352,"statfs":{"total":96636764160,"available":96332136448,"internally_reserved":0,"allocated":401408,"data_stored":165311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 10:01:29 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.143,"15min":1.143},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.677,"5min":1.677,"15min":1.677},"last":1.4419999999999999},{"interface":"front","average":{"1min":1.161,"5min":1.161,"15min":1.161},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":1.409}]},{"osd":1,"last update":"Fri Dec 22 10:01:29 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.25,"15min":1.25},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.8899999999999999,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":0.89000000000000001},{"interface":"front","average":{"1min":1.337,"5min":1.337,"15min":1.337},"min":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":2.6819999999999999,"5min":2.6819999999999999,"15min":2.6819999999999999},"last":0.93000000000000005}]},{"osd":2,"last update":"Fri Dec 22 10:01:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":2.8490000000000002,"5min":2.8490000000000002,"15min":2.8490000000000002},"last":0.98599999999999999},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.774,"5min":1.774,"15min":1.774},"last":1.274}]},{"osd":3,"last update":"Fri Dec 22 10:01:29 2023","interfaces":[{"interface":"back","average":{"1min":1.321,"5min":1.321,"15min":1.321},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":2.3690000000000002,"5min":2.3690000000000002,"15min":2.3690000000000002},"last":1.244},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"min":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"max":{"1min":2.0899999999999999,"5min":2.0899999999999999,"15min":2.0899999999999999},"last":1.379}]},{"osd":4,"last update":"Fri Dec 22 10:01:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.764,"5min":1.764,"15min":1.764},"last":1.3100000000000001},{"interface":"front","average":{"1min":1.278,"5min":1.278,"15min":1.278},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":2.2930000000000001,"5min":2.2930000000000001,"15min":2.2930000000000001},"last":1.329}]},{"osd":5,"last update":"Fri Dec 22 10:01:29 2023","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.228,"15min":1.228},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.786,"5min":1.786,"15min":1.786},"last":1.4850000000000001},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":2.73,"5min":2.73,"15min":2.73},"last":1.526}]},{"osd":6,"last update":"Fri Dec 22 10:01:29 2023","interfaces":[{"interface":"back","average":{"1min":1.476,"5min":1.476,"15min":1.476},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":2.7690000000000001,"5min":2.7690000000000001,"15min":2.7690000000000001},"last":1.5960000000000001},{"interface":"front","average":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":2.8820000000000001,"5min":2.8820000000000001,"15min":2.8820000000000001},"last":1.5640000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297492,"kb_used_data":396,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074348,"statfs":{"total":96636764160,"available":96332132352,"internally_reserved":0,"allocated":405504,"data_stored":166167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.131,"15min":1.131},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":1.091},{"interface":"front","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.617,"5min":1.617,"15min":1.617},"last":1.2909999999999999}]},{"osd":1,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":0.92800000000000005},{"interface":"front","average":{"1min":1.085,"5min":1.085,"15min":1.085},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.657,"5min":1.657,"15min":1.657},"last":1.153}]},{"osd":2,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.077,"15min":1.077},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":0.98399999999999999},{"interface":"front","average":{"1min":1.145,"5min":1.145,"15min":1.145},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.583,"5min":1.583,"15min":1.583},"last":1.181}]},{"osd":3,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.262,"15min":1.262},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":1.3420000000000001},{"interface":"front","average":{"1min":1.252,"5min":1.252,"15min":1.252},"min":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":1.6359999999999999,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":1.4339999999999999}]},{"osd":4,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.282,"15min":1.282},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.7310000000000001,"5min":1.7310000000000001,"15min":1.7310000000000001},"last":1.2430000000000001},{"interface":"front","average":{"1min":1.361,"5min":1.361,"15min":1.361},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":2.2280000000000002,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":1.208}]},{"osd":5,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"min":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":1.907,"5min":1.907,"15min":1.907},"last":1.022},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":2.363,"5min":2.363,"15min":2.363},"last":0.95399999999999996}]},{"osd":7,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"min":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"max":{"1min":2.1459999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.363},{"interface":"front","average":{"1min":1.403,"5min":1.403,"15min":1.403},"min":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"max":{"1min":2.1779999999999999,"5min":2.1779999999999999,"15min":2.1779999999999999},"last":1.129}]}]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297484,"kb_used_data":388,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074356,"statfs":{"total":96636764160,"available":96332140544,"internally_reserved":0,"allocated":397312,"data_stored":165241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":1.2969999999999999},{"interface":"front","average":{"1min":1.123,"5min":1.123,"15min":1.123},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.6559999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":1.2270000000000001}]},{"osd":1,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.88900000000000001},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":2.0070000000000001,"5min":2.0070000000000001,"15min":2.0070000000000001},"last":0.84899999999999998}]},{"osd":2,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.98199999999999998},{"interface":"front","average":{"1min":1.119,"5min":1.119,"15min":1.119},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.607,"5min":1.607,"15min":1.607},"last":1.022}]},{"osd":3,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.133,"15min":1.133},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":1.1639999999999999},{"interface":"front","average":{"1min":1.179,"5min":1.179,"15min":1.179},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.488,"5min":1.488,"15min":1.488},"last":1.0609999999999999}]},{"osd":4,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.145,"15min":1.145},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":1.8779999999999999,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":1.1950000000000001},{"interface":"front","average":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"min":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":1.0840000000000001}]},{"osd":6,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.242,"15min":1.242},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.7749999999999999,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":1.216},{"interface":"front","average":{"1min":1.236,"5min":1.236,"15min":1.236},"min":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":1.369}]},{"osd":7,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.236,"15min":1.236},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":1.516,"5min":1.516,"15min":1.516},"last":1.2629999999999999},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.8620000000000001,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":1.1399999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":413696,"data_stored":166009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.149,"15min":1.149},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":0.80100000000000005},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"min":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.84099999999999997}]},{"osd":1,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":1.012,"15min":1.012},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":1.157},{"interface":"front","average":{"1min":1.077,"5min":1.077,"15min":1.077},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":1.2170000000000001}]},{"osd":2,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.641,"5min":1.641,"15min":1.641},"last":0.96099999999999997},{"interface":"front","average":{"1min":1.272,"5min":1.272,"15min":1.272},"min":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"max":{"1min":1.8340000000000001,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":1.0109999999999999}]},{"osd":3,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.173,"15min":1.173},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":1.7490000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":1.2430000000000001},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"min":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"max":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":1.3600000000000001}]},{"osd":5,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":1.216,"15min":1.216},"min":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"max":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":1.1399999999999999},{"interface":"front","average":{"1min":1.173,"5min":1.173,"15min":1.173},"min":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":1.9350000000000001,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":1.1759999999999999}]},{"osd":6,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":1.869,"5min":1.869,"15min":1.869},"last":1.2549999999999999},{"interface":"front","average":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"min":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"max":{"1min":1.9910000000000001,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":1.395}]},{"osd":7,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"min":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"max":{"1min":2.1960000000000002,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":1.4199999999999999},{"interface":"front","average":{"1min":1.391,"5min":1.391,"15min":1.391},"min":{"1min":1.044,"5min":1.044,"15min":1.044},"max":{"1min":1.8680000000000001,"5min":1.8680000000000001,"15min":1.8680000000000001},"last":1.4330000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297472,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074368,"statfs":{"total":96636764160,"available":96332152832,"internally_reserved":0,"allocated":385024,"data_stored":158062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 10:01:25 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.65400000000000003}]},{"osd":1,"last update":"Fri Dec 22 10:01:25 2023","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":1.034},{"interface":"front","average":{"1min":1.109,"5min":1.109,"15min":1.109},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":0.98399999999999999}]},{"osd":2,"last update":"Fri Dec 22 10:01:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":0.78500000000000003},{"interface":"front","average":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.702,"5min":1.702,"15min":1.702},"last":1.1200000000000001}]},{"osd":4,"last update":"Fri Dec 22 10:01:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.2,"15min":1.2},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":1.292},{"interface":"front","average":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":2.0619999999999998,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":1.222}]},{"osd":5,"last update":"Fri Dec 22 10:01:25 2023","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.333,"15min":1.333},"min":{"1min":0.878,"5min":0.878,"15min":0.878},"max":{"1min":1.9339999999999999,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":1.3260000000000001},{"interface":"front","average":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"min":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"max":{"1min":2.1720000000000002,"5min":2.1720000000000002,"15min":2.1720000000000002},"last":1.3460000000000001}]},{"osd":6,"last update":"Fri Dec 22 10:01:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.8640000000000001,"5min":1.8640000000000001,"15min":1.8640000000000001},"last":1.002},{"interface":"front","average":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":2.2130000000000001,"5min":2.2130000000000001,"15min":2.2130000000000001},"last":1.3939999999999999}]},{"osd":7,"last update":"Fri Dec 22 10:01:25 2023","interfaces":[{"interface":"back","average":{"1min":1.405,"5min":1.405,"15min":1.405},"min":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"max":{"1min":2.1389999999999998,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":1.254},{"interface":"front","average":{"1min":1.431,"5min":1.431,"15min":1.431},"min":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":2.105,"5min":2.105,"15min":2.105},"last":1.1890000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297496,"kb_used_data":400,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074344,"statfs":{"total":96636764160,"available":96332128256,"internally_reserved":0,"allocated":409600,"data_stored":166439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":1.0049999999999999},{"interface":"front","average":{"1min":1.083,"5min":1.083,"15min":1.083},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.83499999999999996}]},{"osd":1,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.52,"5min":1.52,"15min":1.52},"last":1.111},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":2.3809999999999998,"5min":2.3809999999999998,"15min":2.3809999999999998},"last":0.92800000000000005}]},{"osd":3,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.698,"5min":1.698,"15min":1.698},"last":0.71999999999999997},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.788,"5min":1.788,"15min":1.788},"last":0.74099999999999999}]},{"osd":4,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.381,"15min":1.381},"min":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"max":{"1min":2.234,"5min":2.234,"15min":2.234},"last":1.05},{"interface":"front","average":{"1min":1.296,"5min":1.296,"15min":1.296},"min":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"max":{"1min":2.1230000000000002,"5min":2.1230000000000002,"15min":2.1230000000000002},"last":0.95099999999999996}]},{"osd":5,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"min":{"1min":1.109,"5min":1.109,"15min":1.109},"max":{"1min":2.0960000000000001,"5min":2.0960000000000001,"15min":2.0960000000000001},"last":1.208},{"interface":"front","average":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"min":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"max":{"1min":1.9730000000000001,"5min":1.9730000000000001,"15min":1.9730000000000001},"last":1.194}]},{"osd":6,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"min":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"max":{"1min":2.298,"5min":2.298,"15min":2.298},"last":1.385},{"interface":"front","average":{"1min":1.46,"5min":1.46,"15min":1.46},"min":{"1min":1.02,"5min":1.02,"15min":1.02},"max":{"1min":1.899,"5min":1.899,"15min":1.899},"last":1.4099999999999999}]},{"osd":7,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.458,"5min":1.458,"15min":1.458},"min":{"1min":1,"5min":1,"15min":1},"max":{"1min":2.0289999999999999,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":1.4890000000000001},{"interface":"front","average":{"1min":1.415,"5min":1.415,"15min":1.415},"min":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"max":{"1min":2.0179999999999998,"5min":2.0179999999999998,"15min":2.0179999999999998},"last":1.264}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297496,"kb_used_data":400,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074344,"statfs":{"total":96636764160,"available":96332128256,"internally_reserved":0,"allocated":409600,"data_stored":166225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":1.21},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.97699999999999998}]},{"osd":2,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.82299999999999995},{"interface":"front","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":1.3400000000000001}]},{"osd":3,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":1.5760000000000001},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":1.089}]},{"osd":4,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":1.0129999999999999},{"interface":"front","average":{"1min":1.236,"5min":1.236,"15min":1.236},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":2.0710000000000002,"5min":2.0710000000000002,"15min":2.0710000000000002},"last":1.6719999999999999}]},{"osd":5,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"min":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"max":{"1min":1.8129999999999999,"5min":1.8129999999999999,"15min":1.8129999999999999},"last":1.8220000000000001},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"min":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"max":{"1min":1.881,"5min":1.881,"15min":1.881},"last":1.073}]},{"osd":6,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"min":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"max":{"1min":1.8779999999999999,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":1.887},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"min":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":1.946,"5min":1.946,"15min":1.946},"last":1.117}]},{"osd":7,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"min":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"max":{"1min":1.9279999999999999,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":1.899},{"interface":"front","average":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"min":{"1min":1.03,"5min":1.03,"15min":1.03},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":1.919}]}]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297492,"kb_used_data":396,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074348,"statfs":{"total":96636764160,"available":96332132352,"internally_reserved":0,"allocated":405504,"data_stored":165817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":2.7250000000000001,"5min":2.7250000000000001,"15min":2.7250000000000001},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.90700000000000003}]},{"osd":2,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":2.7799999999999998,"5min":2.7799999999999998,"15min":2.7799999999999998},"last":1.0820000000000001},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":1.109}]},{"osd":3,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":2.919,"5min":2.919,"15min":2.919},"last":1.1759999999999999},{"interface":"front","average":{"1min":1.248,"5min":1.248,"15min":1.248},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":2.8959999999999999,"5min":2.8959999999999999,"15min":2.8959999999999999},"last":1.1830000000000001}]},{"osd":4,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":1.74},{"interface":"front","average":{"1min":1.292,"5min":1.292,"15min":1.292},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":3.1280000000000001,"5min":3.1280000000000001,"15min":3.1280000000000001},"last":1.2929999999999999}]},{"osd":5,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"min":{"1min":0.87,"5min":0.87,"15min":0.87},"max":{"1min":3.0760000000000001,"5min":3.0760000000000001,"15min":3.0760000000000001},"last":1.135},{"interface":"front","average":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":2.512,"5min":2.512,"15min":2.512},"last":1.302}]},{"osd":6,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.5,"5min":1.5,"15min":1.5},"min":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"max":{"1min":2.8199999999999998,"5min":2.8199999999999998,"15min":2.8199999999999998},"last":1.3999999999999999},{"interface":"front","average":{"1min":1.51,"5min":1.51,"15min":1.51},"min":{"1min":1.032,"5min":1.032,"15min":1.032},"max":{"1min":4.6029999999999998,"5min":4.6029999999999998,"15min":4.6029999999999998},"last":1.8819999999999999}]},{"osd":7,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.417,"5min":1.417,"15min":1.417},"min":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"max":{"1min":2.0190000000000001,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":1.9830000000000001},{"interface":"front","average":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"min":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"max":{"1min":3.6339999999999999,"5min":3.6339999999999999,"15min":3.6339999999999999},"last":1.224}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-22T10:01:39.402 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-22T10:01:39.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.608+0000 7effc405b700 1 Processor -- start 2023-12-22T10:01:39.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.608+0000 7effc405b700 1 -- start start 2023-12-22T10:01:39.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.608+0000 7effc405b700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7effbc1581f0 0x7effbc0c3080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:39.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.608+0000 7effc405b700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7effbc0c3570 0x7effbc0a7070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:39.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.608+0000 7effc405b700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effbc0a68b0 con 0x7effbc157e10 2023-12-22T10:01:39.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.608+0000 7effc405b700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effbc065610 con 0x7effbc0c3570 2023-12-22T10:01:39.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.608+0000 7effc405b700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effbc0658f0 con 0x7effbc1581f0 2023-12-22T10:01:39.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.612+0000 7effc25f8700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7effbc0c3570 0x7effbc0a7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:39.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.612+0000 7effc15f6700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7effbc1581f0 0x7effbc0c3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:39.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.612+0000 7effc25f8700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7effbc0c3570 0x7effbc0a7070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.45:41354/0 (socket says 172.21.15.45:41354) 2023-12-22T10:01:39.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.612+0000 7effc25f8700 1 -- 172.21.15.45:0/1415168908 learned_addr learned my addr 172.21.15.45:0/1415168908 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:39.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.612+0000 7effc25f8700 1 -- 172.21.15.45:0/1415168908 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7effbc1581f0 msgr2=0x7effbc0c3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:39.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.612+0000 7effc25f8700 1 --2- 172.21.15.45:0/1415168908 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7effbc1581f0 0x7effbc0c3080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:39.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.612+0000 7effc25f8700 1 -- 172.21.15.45:0/1415168908 >> v1:172.21.15.113:6789/0 conn(0x7effbc157e10 legacy=0x7effbc0c1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:39.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.612+0000 7effc0df5700 1 -- 172.21.15.45:0/1415168908 <== mon.1 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 322664154 0 0) 0x7effbc0a68b0 con 0x7effbc157e10 2023-12-22T10:01:39.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.612+0000 7effc25f8700 1 -- 172.21.15.45:0/1415168908 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effbc065bd0 con 0x7effbc0c3570 2023-12-22T10:01:39.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.612+0000 7effc25f8700 1 --2- 172.21.15.45:0/1415168908 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7effbc0c3570 0x7effbc0a7070 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7effb4009f20 tx=0x7effb4009840).ready entity=mon.1 client_cookie=96b941fede54f6dc server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:39.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.612+0000 7effc0df5700 1 -- 172.21.15.45:0/1415168908 <== mon.1 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb400e070 con 0x7effbc0c3570 2023-12-22T10:01:39.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.612+0000 7effc0df5700 1 -- 172.21.15.45:0/1415168908 <== mon.1 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effb400b9d0 con 0x7effbc0c3570 2023-12-22T10:01:39.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.612+0000 7effc0df5700 1 -- 172.21.15.45:0/1415168908 <== mon.1 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb400bd50 con 0x7effbc0c3570 2023-12-22T10:01:39.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.616+0000 7effc405b700 1 -- 172.21.15.45:0/1415168908 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7effbc0c3570 msgr2=0x7effbc0a7070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:39.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.616+0000 7effc405b700 1 --2- 172.21.15.45:0/1415168908 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7effbc0c3570 0x7effbc0a7070 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7effb4009f20 tx=0x7effb4009840).stop 2023-12-22T10:01:39.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.616+0000 7effc405b700 1 -- 172.21.15.45:0/1415168908 shutdown_connections 2023-12-22T10:01:39.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.616+0000 7effc405b700 1 --2- 172.21.15.45:0/1415168908 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7effbc0c3570 0x7effbc0a7070 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:39.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.616+0000 7effc405b700 1 --2- 172.21.15.45:0/1415168908 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7effbc1581f0 0x7effbc0c3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:39.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.616+0000 7effc405b700 1 -- 172.21.15.45:0/1415168908 >> 172.21.15.45:0/1415168908 conn(0x7effbc066a70 msgr2=0x7effbc066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:39.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.616+0000 7effc405b700 1 -- 172.21.15.45:0/1415168908 shutdown_connections 2023-12-22T10:01:39.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.616+0000 7effc405b700 1 -- 172.21.15.45:0/1415168908 wait complete. 2023-12-22T10:01:39.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.616+0000 7effc405b700 1 Processor -- start 2023-12-22T10:01:39.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.616+0000 7effc405b700 1 -- start start 2023-12-22T10:01:39.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.620+0000 7effc405b700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7effbc0c3570 0x7effbc152a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:39.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.620+0000 7effc405b700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7effbc157e10 0x7effbc149b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:39.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.620+0000 7effc405b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effbc1581f0 0x7effbc0bd050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:39.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.620+0000 7effc405b700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effbc0c06c0 con 0x7effbc1581f0 2023-12-22T10:01:39.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.620+0000 7effc405b700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effbc0c0230 con 0x7effbc157e10 2023-12-22T10:01:39.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.620+0000 7effc405b700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effbc0bf620 con 0x7effbc0c3570 2023-12-22T10:01:39.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.620+0000 7effc25f8700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effbc1581f0 0x7effbc0bd050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:39.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.620+0000 7effc25f8700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effbc1581f0 0x7effbc0bd050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37056/0 (socket says 172.21.15.45:37056) 2023-12-22T10:01:39.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.620+0000 7effc25f8700 1 -- 172.21.15.45:0/4153508286 learned_addr learned my addr 172.21.15.45:0/4153508286 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:39.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.620+0000 7effc1df7700 1 --2- 172.21.15.45:0/4153508286 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7effbc0c3570 0x7effbc152a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:39.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.620+0000 7effc15f6700 1 --2- 172.21.15.45:0/4153508286 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7effbc157e10 0x7effbc149b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:39.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.620+0000 7effc15f6700 1 -- 172.21.15.45:0/4153508286 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7effbc0c3570 msgr2=0x7effbc152a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:39.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.620+0000 7effc15f6700 1 --2- 172.21.15.45:0/4153508286 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7effbc0c3570 0x7effbc152a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:39.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.620+0000 7effc15f6700 1 -- 172.21.15.45:0/4153508286 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effbc1581f0 msgr2=0x7effbc0bd050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:39.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.620+0000 7effc15f6700 1 --2- 172.21.15.45:0/4153508286 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effbc1581f0 0x7effbc0bd050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:39.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.620+0000 7effc15f6700 1 -- 172.21.15.45:0/4153508286 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effb4009ae0 con 0x7effbc157e10 2023-12-22T10:01:39.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.620+0000 7effc25f8700 1 --2- 172.21.15.45:0/4153508286 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effbc1581f0 0x7effbc0bd050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-12-22T10:01:39.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.620+0000 7effc1df7700 1 --2- 172.21.15.45:0/4153508286 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7effbc0c3570 0x7effbc152a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-12-22T10:01:39.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.620+0000 7effc15f6700 1 --2- 172.21.15.45:0/4153508286 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7effbc157e10 0x7effbc149b50 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7effac00e6c0 tx=0x7effac009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:39.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.620+0000 7effb1ffb700 1 -- 172.21.15.45:0/4153508286 <== mon.1 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effac012600 con 0x7effbc157e10 2023-12-22T10:01:39.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.620+0000 7effb1ffb700 1 -- 172.21.15.45:0/4153508286 <== mon.1 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effac012760 con 0x7effbc157e10 2023-12-22T10:01:39.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.620+0000 7effc405b700 1 -- 172.21.15.45:0/4153508286 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effbc0bf900 con 0x7effbc157e10 2023-12-22T10:01:39.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.624+0000 7effb1ffb700 1 -- 172.21.15.45:0/4153508286 <== mon.1 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effac012ae0 con 0x7effbc157e10 2023-12-22T10:01:39.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.624+0000 7effc405b700 1 -- 172.21.15.45:0/4153508286 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effbc0bff40 con 0x7effbc157e10 2023-12-22T10:01:39.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.624+0000 7effc405b700 1 -- 172.21.15.45:0/4153508286 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effbc0c03c0 con 0x7effbc157e10 2023-12-22T10:01:39.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.624+0000 7effb1ffb700 1 -- 172.21.15.45:0/4153508286 <== mon.1 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7effac01b400 con 0x7effbc157e10 2023-12-22T10:01:39.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.628+0000 7effb1ffb700 1 --2- 172.21.15.45:0/4153508286 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7effa005a560 0x7effa005ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:39.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.628+0000 7effb1ffb700 1 -- 172.21.15.45:0/4153508286 <== mon.1 v2:172.21.15.113:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6121+0+0 (secure 0 0 0) 0x7effac074a90 con 0x7effbc157e10 2023-12-22T10:01:39.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.628+0000 7effc1df7700 1 --2- 172.21.15.45:0/4153508286 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7effa005a560 0x7effa005ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:39.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.628+0000 7effc1df7700 1 --2- 172.21.15.45:0/4153508286 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7effa005a560 0x7effa005ca20 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7effb8007fd0 tx=0x7effb8009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:39.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.636+0000 7effb1ffb700 1 -- 172.21.15.45:0/4153508286 <== mon.1 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7effac0481d0 con 0x7effbc157e10 2023-12-22T10:01:39.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.800+0000 7effc405b700 1 -- 172.21.15.45:0/4153508286 --> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7effbc0a6b50 con 0x7effa005a560 2023-12-22T10:01:39.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.820+0000 7effb1ffb700 1 -- 172.21.15.45:0/4153508286 <== mgr.4104 v2:172.21.15.45:6832/33679 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+358309 (secure 0 0 0) 0x7effbc0a6b50 con 0x7effa005a560 2023-12-22T10:01:39.822 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:01:39.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.828+0000 7effc405b700 1 -- 172.21.15.45:0/4153508286 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7effa005a560 msgr2=0x7effa005ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:39.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.828+0000 7effc405b700 1 --2- 172.21.15.45:0/4153508286 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7effa005a560 0x7effa005ca20 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7effb8007fd0 tx=0x7effb8009040).stop 2023-12-22T10:01:39.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.828+0000 7effc405b700 1 -- 172.21.15.45:0/4153508286 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7effbc157e10 msgr2=0x7effbc149b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:39.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.828+0000 7effc405b700 1 --2- 172.21.15.45:0/4153508286 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7effbc157e10 0x7effbc149b50 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7effac00e6c0 tx=0x7effac009060).stop 2023-12-22T10:01:39.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.828+0000 7effc405b700 1 -- 172.21.15.45:0/4153508286 shutdown_connections 2023-12-22T10:01:39.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.828+0000 7effc405b700 1 --2- 172.21.15.45:0/4153508286 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effbc1581f0 0x7effbc0bd050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:39.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.828+0000 7effc405b700 1 --2- 172.21.15.45:0/4153508286 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7effbc157e10 0x7effbc149b50 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:39.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.828+0000 7effc405b700 1 --2- 172.21.15.45:0/4153508286 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7effa005a560 0x7effa005ca20 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:39.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.828+0000 7effc405b700 1 --2- 172.21.15.45:0/4153508286 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7effbc0c3570 0x7effbc152a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:39.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.828+0000 7effc405b700 1 -- 172.21.15.45:0/4153508286 >> 172.21.15.45:0/4153508286 conn(0x7effbc066a70 msgr2=0x7effbc1549c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:39.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.828+0000 7effc405b700 1 -- 172.21.15.45:0/4153508286 shutdown_connections 2023-12-22T10:01:39.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:39.832+0000 7effc405b700 1 -- 172.21.15.45:0/4153508286 wait complete. 2023-12-22T10:01:39.832 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-12-22T10:01:39.849 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":65,"stamp":"2023-12-22T10:01:37.972703+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":193,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2379920,"kb_used_data":3152,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752594800,"statfs":{"total":773094113280,"available":770657075200,"internally_reserved":0,"allocated":3227648,"data_stored":1319271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":44,"apply_latency_ms":44,"commit_latency_ns":44000000,"apply_latency_ns":44000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-5393,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-53,"num_write_kb":-21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.198018"},"pg_stats":[{"pgid":"6.3c","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.152281+0000","last_change":"2023-12-22T10:01:35.152281+0000","last_active":"2023-12-22T10:01:35.152281+0000","last_peered":"2023-12-22T10:01:35.152281+0000","last_clean":"2023-12-22T10:01:35.152281+0000","last_became_active":"2023-12-22T10:01:35.151922+0000","last_became_peered":"2023-12-22T10:01:35.151922+0000","last_unstale":"2023-12-22T10:01:35.152281+0000","last_undegraded":"2023-12-22T10:01:35.152281+0000","last_fullsized":"2023-12-22T10:01:35.152281+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3f","version":"35'3","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.161827+0000","last_change":"2023-12-22T10:01:34.692598+0000","last_active":"2023-12-22T10:01:35.161827+0000","last_peered":"2023-12-22T10:01:35.161827+0000","last_clean":"2023-12-22T10:01:35.161827+0000","last_became_active":"2023-12-22T10:01:34.692294+0000","last_became_peered":"2023-12-22T10:01:34.692294+0000","last_unstale":"2023-12-22T10:01:35.161827+0000","last_undegraded":"2023-12-22T10:01:35.161827+0000","last_fullsized":"2023-12-22T10:01:35.161827+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.151608+0000","last_change":"2023-12-22T10:01:35.151608+0000","last_active":"2023-12-22T10:01:35.151608+0000","last_peered":"2023-12-22T10:01:35.151608+0000","last_clean":"2023-12-22T10:01:35.151608+0000","last_became_active":"2023-12-22T10:01:35.151006+0000","last_became_peered":"2023-12-22T10:01:35.151006+0000","last_unstale":"2023-12-22T10:01:35.151608+0000","last_undegraded":"2023-12-22T10:01:35.151608+0000","last_fullsized":"2023-12-22T10:01:35.151608+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.701547+0000","last_change":"2023-12-22T10:01:34.697062+0000","last_active":"2023-12-22T10:01:34.701547+0000","last_peered":"2023-12-22T10:01:34.701547+0000","last_clean":"2023-12-22T10:01:34.701547+0000","last_became_active":"2023-12-22T10:01:34.696760+0000","last_became_peered":"2023-12-22T10:01:34.696760+0000","last_unstale":"2023-12-22T10:01:34.701547+0000","last_undegraded":"2023-12-22T10:01:34.701547+0000","last_fullsized":"2023-12-22T10:01:34.701547+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.134766+0000","last_change":"2023-12-22T10:01:35.134766+0000","last_active":"2023-12-22T10:01:35.134766+0000","last_peered":"2023-12-22T10:01:35.134766+0000","last_clean":"2023-12-22T10:01:35.134766+0000","last_became_active":"2023-12-22T10:01:35.131420+0000","last_became_peered":"2023-12-22T10:01:35.131420+0000","last_unstale":"2023-12-22T10:01:35.134766+0000","last_undegraded":"2023-12-22T10:01:35.134766+0000","last_fullsized":"2023-12-22T10:01:35.134766+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.707070+0000","last_change":"2023-12-22T10:01:34.705273+0000","last_active":"2023-12-22T10:01:34.707070+0000","last_peered":"2023-12-22T10:01:34.707070+0000","last_clean":"2023-12-22T10:01:34.707070+0000","last_became_active":"2023-12-22T10:01:34.704899+0000","last_became_peered":"2023-12-22T10:01:34.704899+0000","last_unstale":"2023-12-22T10:01:34.707070+0000","last_undegraded":"2023-12-22T10:01:34.707070+0000","last_fullsized":"2023-12-22T10:01:34.707070+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3f","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.140720+0000","last_change":"2023-12-22T10:01:35.140720+0000","last_active":"2023-12-22T10:01:35.140720+0000","last_peered":"2023-12-22T10:01:35.140720+0000","last_clean":"2023-12-22T10:01:35.140720+0000","last_became_active":"2023-12-22T10:01:35.137419+0000","last_became_peered":"2023-12-22T10:01:35.137419+0000","last_unstale":"2023-12-22T10:01:35.140720+0000","last_undegraded":"2023-12-22T10:01:35.140720+0000","last_fullsized":"2023-12-22T10:01:35.140720+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3c","version":"35'2","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.146457+0000","last_change":"2023-12-22T10:01:34.698706+0000","last_active":"2023-12-22T10:01:35.146457+0000","last_peered":"2023-12-22T10:01:35.146457+0000","last_clean":"2023-12-22T10:01:35.146457+0000","last_became_active":"2023-12-22T10:01:34.698384+0000","last_became_peered":"2023-12-22T10:01:34.698384+0000","last_unstale":"2023-12-22T10:01:35.146457+0000","last_undegraded":"2023-12-22T10:01:35.146457+0000","last_fullsized":"2023-12-22T10:01:35.146457+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.144798+0000","last_change":"2023-12-22T10:01:35.144798+0000","last_active":"2023-12-22T10:01:35.144798+0000","last_peered":"2023-12-22T10:01:35.144798+0000","last_clean":"2023-12-22T10:01:35.144798+0000","last_became_active":"2023-12-22T10:01:35.143992+0000","last_became_peered":"2023-12-22T10:01:35.143992+0000","last_unstale":"2023-12-22T10:01:35.144798+0000","last_undegraded":"2023-12-22T10:01:35.144798+0000","last_fullsized":"2023-12-22T10:01:35.144798+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"35'1","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.126263+0000","last_change":"2023-12-22T10:01:34.687808+0000","last_active":"2023-12-22T10:01:35.126263+0000","last_peered":"2023-12-22T10:01:35.126263+0000","last_clean":"2023-12-22T10:01:35.126263+0000","last_became_active":"2023-12-22T10:01:34.687419+0000","last_became_peered":"2023-12-22T10:01:34.687419+0000","last_unstale":"2023-12-22T10:01:35.126263+0000","last_undegraded":"2023-12-22T10:01:35.126263+0000","last_fullsized":"2023-12-22T10:01:35.126263+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.135065+0000","last_change":"2023-12-22T10:01:35.135065+0000","last_active":"2023-12-22T10:01:35.135065+0000","last_peered":"2023-12-22T10:01:35.135065+0000","last_clean":"2023-12-22T10:01:35.135065+0000","last_became_active":"2023-12-22T10:01:35.134446+0000","last_became_peered":"2023-12-22T10:01:35.134446+0000","last_unstale":"2023-12-22T10:01:35.135065+0000","last_undegraded":"2023-12-22T10:01:35.135065+0000","last_fullsized":"2023-12-22T10:01:35.135065+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3a","version":"35'1","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.116792+0000","last_change":"2023-12-22T10:01:34.690637+0000","last_active":"2023-12-22T10:01:35.116792+0000","last_peered":"2023-12-22T10:01:35.116792+0000","last_clean":"2023-12-22T10:01:35.116792+0000","last_became_active":"2023-12-22T10:01:34.690359+0000","last_became_peered":"2023-12-22T10:01:34.690359+0000","last_unstale":"2023-12-22T10:01:35.116792+0000","last_undegraded":"2023-12-22T10:01:35.116792+0000","last_fullsized":"2023-12-22T10:01:35.116792+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.136920+0000","last_change":"2023-12-22T10:01:35.136920+0000","last_active":"2023-12-22T10:01:35.136920+0000","last_peered":"2023-12-22T10:01:35.136920+0000","last_clean":"2023-12-22T10:01:35.136920+0000","last_became_active":"2023-12-22T10:01:35.136645+0000","last_became_peered":"2023-12-22T10:01:35.136645+0000","last_unstale":"2023-12-22T10:01:35.136920+0000","last_undegraded":"2023-12-22T10:01:35.136920+0000","last_fullsized":"2023-12-22T10:01:35.136920+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.707387+0000","last_change":"2023-12-22T10:01:34.705207+0000","last_active":"2023-12-22T10:01:34.707387+0000","last_peered":"2023-12-22T10:01:34.707387+0000","last_clean":"2023-12-22T10:01:34.707387+0000","last_became_active":"2023-12-22T10:01:34.704843+0000","last_became_peered":"2023-12-22T10:01:34.704843+0000","last_unstale":"2023-12-22T10:01:34.707387+0000","last_undegraded":"2023-12-22T10:01:34.707387+0000","last_fullsized":"2023-12-22T10:01:34.707387+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.143343+0000","last_change":"2023-12-22T10:01:35.143343+0000","last_active":"2023-12-22T10:01:35.143343+0000","last_peered":"2023-12-22T10:01:35.143343+0000","last_clean":"2023-12-22T10:01:35.143343+0000","last_became_active":"2023-12-22T10:01:35.142969+0000","last_became_peered":"2023-12-22T10:01:35.142969+0000","last_unstale":"2023-12-22T10:01:35.143343+0000","last_undegraded":"2023-12-22T10:01:35.143343+0000","last_fullsized":"2023-12-22T10:01:35.143343+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.703264+0000","last_change":"2023-12-22T10:01:34.694961+0000","last_active":"2023-12-22T10:01:34.703264+0000","last_peered":"2023-12-22T10:01:34.703264+0000","last_clean":"2023-12-22T10:01:34.703264+0000","last_became_active":"2023-12-22T10:01:34.694670+0000","last_became_peered":"2023-12-22T10:01:34.694670+0000","last_unstale":"2023-12-22T10:01:34.703264+0000","last_undegraded":"2023-12-22T10:01:34.703264+0000","last_fullsized":"2023-12-22T10:01:34.703264+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.133665+0000","last_change":"2023-12-22T10:01:35.133665+0000","last_active":"2023-12-22T10:01:35.133665+0000","last_peered":"2023-12-22T10:01:35.133665+0000","last_clean":"2023-12-22T10:01:35.133665+0000","last_became_active":"2023-12-22T10:01:35.133400+0000","last_became_peered":"2023-12-22T10:01:35.133400+0000","last_unstale":"2023-12-22T10:01:35.133665+0000","last_undegraded":"2023-12-22T10:01:35.133665+0000","last_fullsized":"2023-12-22T10:01:35.133665+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.705415+0000","last_change":"2023-12-22T10:01:34.701407+0000","last_active":"2023-12-22T10:01:34.705415+0000","last_peered":"2023-12-22T10:01:34.705415+0000","last_clean":"2023-12-22T10:01:34.705415+0000","last_became_active":"2023-12-22T10:01:34.701143+0000","last_became_peered":"2023-12-22T10:01:34.701143+0000","last_unstale":"2023-12-22T10:01:34.705415+0000","last_undegraded":"2023-12-22T10:01:34.705415+0000","last_fullsized":"2023-12-22T10:01:34.705415+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.148993+0000","last_change":"2023-12-22T10:01:35.148993+0000","last_active":"2023-12-22T10:01:35.148993+0000","last_peered":"2023-12-22T10:01:35.148993+0000","last_clean":"2023-12-22T10:01:35.148993+0000","last_became_active":"2023-12-22T10:01:35.148614+0000","last_became_peered":"2023-12-22T10:01:35.148614+0000","last_unstale":"2023-12-22T10:01:35.148993+0000","last_undegraded":"2023-12-22T10:01:35.148993+0000","last_fullsized":"2023-12-22T10:01:35.148993+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.698450+0000","last_change":"2023-12-22T10:01:34.690874+0000","last_active":"2023-12-22T10:01:34.698450+0000","last_peered":"2023-12-22T10:01:34.698450+0000","last_clean":"2023-12-22T10:01:34.698450+0000","last_became_active":"2023-12-22T10:01:34.690525+0000","last_became_peered":"2023-12-22T10:01:34.690525+0000","last_unstale":"2023-12-22T10:01:34.698450+0000","last_undegraded":"2023-12-22T10:01:34.698450+0000","last_fullsized":"2023-12-22T10:01:34.698450+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.163651+0000","last_change":"2023-12-22T10:01:35.163651+0000","last_active":"2023-12-22T10:01:35.163651+0000","last_peered":"2023-12-22T10:01:35.163651+0000","last_clean":"2023-12-22T10:01:35.163651+0000","last_became_active":"2023-12-22T10:01:35.163305+0000","last_became_peered":"2023-12-22T10:01:35.163305+0000","last_unstale":"2023-12-22T10:01:35.163651+0000","last_undegraded":"2023-12-22T10:01:35.163651+0000","last_fullsized":"2023-12-22T10:01:35.163651+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.700363+0000","last_change":"2023-12-22T10:01:34.691997+0000","last_active":"2023-12-22T10:01:34.700363+0000","last_peered":"2023-12-22T10:01:34.700363+0000","last_clean":"2023-12-22T10:01:34.700363+0000","last_became_active":"2023-12-22T10:01:34.691557+0000","last_became_peered":"2023-12-22T10:01:34.691557+0000","last_unstale":"2023-12-22T10:01:34.700363+0000","last_undegraded":"2023-12-22T10:01:34.700363+0000","last_fullsized":"2023-12-22T10:01:34.700363+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.153014+0000","last_change":"2023-12-22T10:01:35.153014+0000","last_active":"2023-12-22T10:01:35.153014+0000","last_peered":"2023-12-22T10:01:35.153014+0000","last_clean":"2023-12-22T10:01:35.153014+0000","last_became_active":"2023-12-22T10:01:35.152544+0000","last_became_peered":"2023-12-22T10:01:35.152544+0000","last_unstale":"2023-12-22T10:01:35.153014+0000","last_undegraded":"2023-12-22T10:01:35.153014+0000","last_fullsized":"2023-12-22T10:01:35.153014+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"35'4","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.159796+0000","last_change":"2023-12-22T10:01:34.698273+0000","last_active":"2023-12-22T10:01:35.159796+0000","last_peered":"2023-12-22T10:01:35.159796+0000","last_clean":"2023-12-22T10:01:35.159796+0000","last_became_active":"2023-12-22T10:01:34.697971+0000","last_became_peered":"2023-12-22T10:01:34.697971+0000","last_unstale":"2023-12-22T10:01:35.159796+0000","last_undegraded":"2023-12-22T10:01:35.159796+0000","last_fullsized":"2023-12-22T10:01:35.159796+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.157227+0000","last_change":"2023-12-22T10:01:35.157227+0000","last_active":"2023-12-22T10:01:35.157227+0000","last_peered":"2023-12-22T10:01:35.157227+0000","last_clean":"2023-12-22T10:01:35.157227+0000","last_became_active":"2023-12-22T10:01:35.156649+0000","last_became_peered":"2023-12-22T10:01:35.156649+0000","last_unstale":"2023-12-22T10:01:35.157227+0000","last_undegraded":"2023-12-22T10:01:35.157227+0000","last_fullsized":"2023-12-22T10:01:35.157227+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"35'1","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.125166+0000","last_change":"2023-12-22T10:01:34.696594+0000","last_active":"2023-12-22T10:01:35.125166+0000","last_peered":"2023-12-22T10:01:35.125166+0000","last_clean":"2023-12-22T10:01:35.125166+0000","last_became_active":"2023-12-22T10:01:34.696150+0000","last_became_peered":"2023-12-22T10:01:34.696150+0000","last_unstale":"2023-12-22T10:01:35.125166+0000","last_undegraded":"2023-12-22T10:01:35.125166+0000","last_fullsized":"2023-12-22T10:01:35.125166+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.143685+0000","last_change":"2023-12-22T10:01:35.143685+0000","last_active":"2023-12-22T10:01:35.143685+0000","last_peered":"2023-12-22T10:01:35.143685+0000","last_clean":"2023-12-22T10:01:35.143685+0000","last_became_active":"2023-12-22T10:01:35.142366+0000","last_became_peered":"2023-12-22T10:01:35.142366+0000","last_unstale":"2023-12-22T10:01:35.143685+0000","last_undegraded":"2023-12-22T10:01:35.143685+0000","last_fullsized":"2023-12-22T10:01:35.143685+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.699267+0000","last_change":"2023-12-22T10:01:34.691884+0000","last_active":"2023-12-22T10:01:34.699267+0000","last_peered":"2023-12-22T10:01:34.699267+0000","last_clean":"2023-12-22T10:01:34.699267+0000","last_became_active":"2023-12-22T10:01:34.691602+0000","last_became_peered":"2023-12-22T10:01:34.691602+0000","last_unstale":"2023-12-22T10:01:34.699267+0000","last_undegraded":"2023-12-22T10:01:34.699267+0000","last_fullsized":"2023-12-22T10:01:34.699267+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.137981+0000","last_change":"2023-12-22T10:01:35.137981+0000","last_active":"2023-12-22T10:01:35.137981+0000","last_peered":"2023-12-22T10:01:35.137981+0000","last_clean":"2023-12-22T10:01:35.137981+0000","last_became_active":"2023-12-22T10:01:35.137659+0000","last_became_peered":"2023-12-22T10:01:35.137659+0000","last_unstale":"2023-12-22T10:01:35.137981+0000","last_undegraded":"2023-12-22T10:01:35.137981+0000","last_fullsized":"2023-12-22T10:01:35.137981+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.704950+0000","last_change":"2023-12-22T10:01:34.701089+0000","last_active":"2023-12-22T10:01:34.704950+0000","last_peered":"2023-12-22T10:01:34.704950+0000","last_clean":"2023-12-22T10:01:34.704950+0000","last_became_active":"2023-12-22T10:01:34.699878+0000","last_became_peered":"2023-12-22T10:01:34.699878+0000","last_unstale":"2023-12-22T10:01:34.704950+0000","last_undegraded":"2023-12-22T10:01:34.704950+0000","last_fullsized":"2023-12-22T10:01:34.704950+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.143515+0000","last_change":"2023-12-22T10:01:35.143515+0000","last_active":"2023-12-22T10:01:35.143515+0000","last_peered":"2023-12-22T10:01:35.143515+0000","last_clean":"2023-12-22T10:01:35.143515+0000","last_became_active":"2023-12-22T10:01:35.143051+0000","last_became_peered":"2023-12-22T10:01:35.143051+0000","last_unstale":"2023-12-22T10:01:35.143515+0000","last_undegraded":"2023-12-22T10:01:35.143515+0000","last_fullsized":"2023-12-22T10:01:35.143515+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.30","version":"35'4","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.150415+0000","last_change":"2023-12-22T10:01:34.682518+0000","last_active":"2023-12-22T10:01:35.150415+0000","last_peered":"2023-12-22T10:01:35.150415+0000","last_clean":"2023-12-22T10:01:35.150415+0000","last_became_active":"2023-12-22T10:01:34.680968+0000","last_became_peered":"2023-12-22T10:01:34.680968+0000","last_unstale":"2023-12-22T10:01:35.150415+0000","last_undegraded":"2023-12-22T10:01:35.150415+0000","last_fullsized":"2023-12-22T10:01:35.150415+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.156632+0000","last_change":"2023-12-22T10:01:35.156632+0000","last_active":"2023-12-22T10:01:35.156632+0000","last_peered":"2023-12-22T10:01:35.156632+0000","last_clean":"2023-12-22T10:01:35.156632+0000","last_became_active":"2023-12-22T10:01:35.156348+0000","last_became_peered":"2023-12-22T10:01:35.156348+0000","last_unstale":"2023-12-22T10:01:35.156632+0000","last_undegraded":"2023-12-22T10:01:35.156632+0000","last_fullsized":"2023-12-22T10:01:35.156632+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.702954+0000","last_change":"2023-12-22T10:01:34.694956+0000","last_active":"2023-12-22T10:01:34.702954+0000","last_peered":"2023-12-22T10:01:34.702954+0000","last_clean":"2023-12-22T10:01:34.702954+0000","last_became_active":"2023-12-22T10:01:34.694670+0000","last_became_peered":"2023-12-22T10:01:34.694670+0000","last_unstale":"2023-12-22T10:01:34.702954+0000","last_undegraded":"2023-12-22T10:01:34.702954+0000","last_fullsized":"2023-12-22T10:01:34.702954+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.145727+0000","last_change":"2023-12-22T10:01:35.145727+0000","last_active":"2023-12-22T10:01:35.145727+0000","last_peered":"2023-12-22T10:01:35.145727+0000","last_clean":"2023-12-22T10:01:35.145727+0000","last_became_active":"2023-12-22T10:01:35.143309+0000","last_became_peered":"2023-12-22T10:01:35.143309+0000","last_unstale":"2023-12-22T10:01:35.145727+0000","last_undegraded":"2023-12-22T10:01:35.145727+0000","last_fullsized":"2023-12-22T10:01:35.145727+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.699057+0000","last_change":"2023-12-22T10:01:34.693702+0000","last_active":"2023-12-22T10:01:34.699057+0000","last_peered":"2023-12-22T10:01:34.699057+0000","last_clean":"2023-12-22T10:01:34.699057+0000","last_became_active":"2023-12-22T10:01:34.693312+0000","last_became_peered":"2023-12-22T10:01:34.693312+0000","last_unstale":"2023-12-22T10:01:34.699057+0000","last_undegraded":"2023-12-22T10:01:34.699057+0000","last_fullsized":"2023-12-22T10:01:34.699057+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.161551+0000","last_change":"2023-12-22T10:01:35.161551+0000","last_active":"2023-12-22T10:01:35.161551+0000","last_peered":"2023-12-22T10:01:35.161551+0000","last_clean":"2023-12-22T10:01:35.161551+0000","last_became_active":"2023-12-22T10:01:35.161234+0000","last_became_peered":"2023-12-22T10:01:35.161234+0000","last_unstale":"2023-12-22T10:01:35.161551+0000","last_undegraded":"2023-12-22T10:01:35.161551+0000","last_fullsized":"2023-12-22T10:01:35.161551+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"35'1","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.121288+0000","last_change":"2023-12-22T10:01:34.703838+0000","last_active":"2023-12-22T10:01:35.121288+0000","last_peered":"2023-12-22T10:01:35.121288+0000","last_clean":"2023-12-22T10:01:35.121288+0000","last_became_active":"2023-12-22T10:01:34.703546+0000","last_became_peered":"2023-12-22T10:01:34.703546+0000","last_unstale":"2023-12-22T10:01:35.121288+0000","last_undegraded":"2023-12-22T10:01:35.121288+0000","last_fullsized":"2023-12-22T10:01:35.121288+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.162395+0000","last_change":"2023-12-22T10:01:35.162395+0000","last_active":"2023-12-22T10:01:35.162395+0000","last_peered":"2023-12-22T10:01:35.162395+0000","last_clean":"2023-12-22T10:01:35.162395+0000","last_became_active":"2023-12-22T10:01:35.162144+0000","last_became_peered":"2023-12-22T10:01:35.162144+0000","last_unstale":"2023-12-22T10:01:35.162395+0000","last_undegraded":"2023-12-22T10:01:35.162395+0000","last_fullsized":"2023-12-22T10:01:35.162395+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.702351+0000","last_change":"2023-12-22T10:01:34.700164+0000","last_active":"2023-12-22T10:01:34.702351+0000","last_peered":"2023-12-22T10:01:34.702351+0000","last_clean":"2023-12-22T10:01:34.702351+0000","last_became_active":"2023-12-22T10:01:34.699864+0000","last_became_peered":"2023-12-22T10:01:34.699864+0000","last_unstale":"2023-12-22T10:01:34.702351+0000","last_undegraded":"2023-12-22T10:01:34.702351+0000","last_fullsized":"2023-12-22T10:01:34.702351+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.144436+0000","last_change":"2023-12-22T10:01:35.144436+0000","last_active":"2023-12-22T10:01:35.144436+0000","last_peered":"2023-12-22T10:01:35.144436+0000","last_clean":"2023-12-22T10:01:35.144436+0000","last_became_active":"2023-12-22T10:01:35.143672+0000","last_became_peered":"2023-12-22T10:01:35.143672+0000","last_unstale":"2023-12-22T10:01:35.144436+0000","last_undegraded":"2023-12-22T10:01:35.144436+0000","last_fullsized":"2023-12-22T10:01:35.144436+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2b","version":"35'1","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.127752+0000","last_change":"2023-12-22T10:01:34.695729+0000","last_active":"2023-12-22T10:01:35.127752+0000","last_peered":"2023-12-22T10:01:35.127752+0000","last_clean":"2023-12-22T10:01:35.127752+0000","last_became_active":"2023-12-22T10:01:34.695350+0000","last_became_peered":"2023-12-22T10:01:34.695350+0000","last_unstale":"2023-12-22T10:01:35.127752+0000","last_undegraded":"2023-12-22T10:01:35.127752+0000","last_fullsized":"2023-12-22T10:01:35.127752+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.153565+0000","last_change":"2023-12-22T10:01:35.153565+0000","last_active":"2023-12-22T10:01:35.153565+0000","last_peered":"2023-12-22T10:01:35.153565+0000","last_clean":"2023-12-22T10:01:35.153565+0000","last_became_active":"2023-12-22T10:01:35.153282+0000","last_became_peered":"2023-12-22T10:01:35.153282+0000","last_unstale":"2023-12-22T10:01:35.153565+0000","last_undegraded":"2023-12-22T10:01:35.153565+0000","last_fullsized":"2023-12-22T10:01:35.153565+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.703338+0000","last_change":"2023-12-22T10:01:34.698295+0000","last_active":"2023-12-22T10:01:34.703338+0000","last_peered":"2023-12-22T10:01:34.703338+0000","last_clean":"2023-12-22T10:01:34.703338+0000","last_became_active":"2023-12-22T10:01:34.697636+0000","last_became_peered":"2023-12-22T10:01:34.697636+0000","last_unstale":"2023-12-22T10:01:34.703338+0000","last_undegraded":"2023-12-22T10:01:34.703338+0000","last_fullsized":"2023-12-22T10:01:34.703338+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.145659+0000","last_change":"2023-12-22T10:01:35.145659+0000","last_active":"2023-12-22T10:01:35.145659+0000","last_peered":"2023-12-22T10:01:35.145659+0000","last_clean":"2023-12-22T10:01:35.145659+0000","last_became_active":"2023-12-22T10:01:35.145349+0000","last_became_peered":"2023-12-22T10:01:35.145349+0000","last_unstale":"2023-12-22T10:01:35.145659+0000","last_undegraded":"2023-12-22T10:01:35.145659+0000","last_fullsized":"2023-12-22T10:01:35.145659+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.707995+0000","last_change":"2023-12-22T10:01:34.706960+0000","last_active":"2023-12-22T10:01:34.707995+0000","last_peered":"2023-12-22T10:01:34.707995+0000","last_clean":"2023-12-22T10:01:34.707995+0000","last_became_active":"2023-12-22T10:01:34.706683+0000","last_became_peered":"2023-12-22T10:01:34.706683+0000","last_unstale":"2023-12-22T10:01:34.707995+0000","last_undegraded":"2023-12-22T10:01:34.707995+0000","last_fullsized":"2023-12-22T10:01:34.707995+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.149661+0000","last_change":"2023-12-22T10:01:35.149661+0000","last_active":"2023-12-22T10:01:35.149661+0000","last_peered":"2023-12-22T10:01:35.149661+0000","last_clean":"2023-12-22T10:01:35.149661+0000","last_became_active":"2023-12-22T10:01:35.149440+0000","last_became_peered":"2023-12-22T10:01:35.149440+0000","last_unstale":"2023-12-22T10:01:35.149661+0000","last_undegraded":"2023-12-22T10:01:35.149661+0000","last_fullsized":"2023-12-22T10:01:35.149661+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.703708+0000","last_change":"2023-12-22T10:01:34.698945+0000","last_active":"2023-12-22T10:01:34.703708+0000","last_peered":"2023-12-22T10:01:34.703708+0000","last_clean":"2023-12-22T10:01:34.703708+0000","last_became_active":"2023-12-22T10:01:34.698609+0000","last_became_peered":"2023-12-22T10:01:34.698609+0000","last_unstale":"2023-12-22T10:01:34.703708+0000","last_undegraded":"2023-12-22T10:01:34.703708+0000","last_fullsized":"2023-12-22T10:01:34.703708+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.155343+0000","last_change":"2023-12-22T10:01:35.155343+0000","last_active":"2023-12-22T10:01:35.155343+0000","last_peered":"2023-12-22T10:01:35.155343+0000","last_clean":"2023-12-22T10:01:35.155343+0000","last_became_active":"2023-12-22T10:01:35.154943+0000","last_became_peered":"2023-12-22T10:01:35.154943+0000","last_unstale":"2023-12-22T10:01:35.155343+0000","last_undegraded":"2023-12-22T10:01:35.155343+0000","last_fullsized":"2023-12-22T10:01:35.155343+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.696639+0000","last_change":"2023-12-22T10:01:34.689294+0000","last_active":"2023-12-22T10:01:34.696639+0000","last_peered":"2023-12-22T10:01:34.696639+0000","last_clean":"2023-12-22T10:01:34.696639+0000","last_became_active":"2023-12-22T10:01:34.687510+0000","last_became_peered":"2023-12-22T10:01:34.687510+0000","last_unstale":"2023-12-22T10:01:34.696639+0000","last_undegraded":"2023-12-22T10:01:34.696639+0000","last_fullsized":"2023-12-22T10:01:34.696639+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.148843+0000","last_change":"2023-12-22T10:01:35.148843+0000","last_active":"2023-12-22T10:01:35.148843+0000","last_peered":"2023-12-22T10:01:35.148843+0000","last_clean":"2023-12-22T10:01:35.148843+0000","last_became_active":"2023-12-22T10:01:35.148363+0000","last_became_peered":"2023-12-22T10:01:35.148363+0000","last_unstale":"2023-12-22T10:01:35.148843+0000","last_undegraded":"2023-12-22T10:01:35.148843+0000","last_fullsized":"2023-12-22T10:01:35.148843+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.703246+0000","last_change":"2023-12-22T10:01:34.702043+0000","last_active":"2023-12-22T10:01:34.703246+0000","last_peered":"2023-12-22T10:01:34.703246+0000","last_clean":"2023-12-22T10:01:34.703246+0000","last_became_active":"2023-12-22T10:01:34.701318+0000","last_became_peered":"2023-12-22T10:01:34.701318+0000","last_unstale":"2023-12-22T10:01:34.703246+0000","last_undegraded":"2023-12-22T10:01:34.703246+0000","last_fullsized":"2023-12-22T10:01:34.703246+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.134712+0000","last_change":"2023-12-22T10:01:35.134712+0000","last_active":"2023-12-22T10:01:35.134712+0000","last_peered":"2023-12-22T10:01:35.134712+0000","last_clean":"2023-12-22T10:01:35.134712+0000","last_became_active":"2023-12-22T10:01:35.134447+0000","last_became_peered":"2023-12-22T10:01:35.134447+0000","last_unstale":"2023-12-22T10:01:35.134712+0000","last_undegraded":"2023-12-22T10:01:35.134712+0000","last_fullsized":"2023-12-22T10:01:35.134712+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.691730+0000","last_change":"2023-12-22T10:01:34.688497+0000","last_active":"2023-12-22T10:01:34.691730+0000","last_peered":"2023-12-22T10:01:34.691730+0000","last_clean":"2023-12-22T10:01:34.691730+0000","last_became_active":"2023-12-22T10:01:34.688207+0000","last_became_peered":"2023-12-22T10:01:34.688207+0000","last_unstale":"2023-12-22T10:01:34.691730+0000","last_undegraded":"2023-12-22T10:01:34.691730+0000","last_fullsized":"2023-12-22T10:01:34.691730+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.143383+0000","last_change":"2023-12-22T10:01:35.143383+0000","last_active":"2023-12-22T10:01:35.143383+0000","last_peered":"2023-12-22T10:01:35.143383+0000","last_clean":"2023-12-22T10:01:35.143383+0000","last_became_active":"2023-12-22T10:01:35.143073+0000","last_became_peered":"2023-12-22T10:01:35.143073+0000","last_unstale":"2023-12-22T10:01:35.143383+0000","last_undegraded":"2023-12-22T10:01:35.143383+0000","last_fullsized":"2023-12-22T10:01:35.143383+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.703380+0000","last_change":"2023-12-22T10:01:34.695905+0000","last_active":"2023-12-22T10:01:34.703380+0000","last_peered":"2023-12-22T10:01:34.703380+0000","last_clean":"2023-12-22T10:01:34.703380+0000","last_became_active":"2023-12-22T10:01:34.695517+0000","last_became_peered":"2023-12-22T10:01:34.695517+0000","last_unstale":"2023-12-22T10:01:34.703380+0000","last_undegraded":"2023-12-22T10:01:34.703380+0000","last_fullsized":"2023-12-22T10:01:34.703380+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.144625+0000","last_change":"2023-12-22T10:01:35.144625+0000","last_active":"2023-12-22T10:01:35.144625+0000","last_peered":"2023-12-22T10:01:35.144625+0000","last_clean":"2023-12-22T10:01:35.144625+0000","last_became_active":"2023-12-22T10:01:35.142641+0000","last_became_peered":"2023-12-22T10:01:35.142641+0000","last_unstale":"2023-12-22T10:01:35.144625+0000","last_undegraded":"2023-12-22T10:01:35.144625+0000","last_fullsized":"2023-12-22T10:01:35.144625+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.705091+0000","last_change":"2023-12-22T10:01:34.698158+0000","last_active":"2023-12-22T10:01:34.705091+0000","last_peered":"2023-12-22T10:01:34.705091+0000","last_clean":"2023-12-22T10:01:34.705091+0000","last_became_active":"2023-12-22T10:01:34.695554+0000","last_became_peered":"2023-12-22T10:01:34.695554+0000","last_unstale":"2023-12-22T10:01:34.705091+0000","last_undegraded":"2023-12-22T10:01:34.705091+0000","last_fullsized":"2023-12-22T10:01:34.705091+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.134824+0000","last_change":"2023-12-22T10:01:35.134824+0000","last_active":"2023-12-22T10:01:35.134824+0000","last_peered":"2023-12-22T10:01:35.134824+0000","last_clean":"2023-12-22T10:01:35.134824+0000","last_became_active":"2023-12-22T10:01:35.134157+0000","last_became_peered":"2023-12-22T10:01:35.134157+0000","last_unstale":"2023-12-22T10:01:35.134824+0000","last_undegraded":"2023-12-22T10:01:35.134824+0000","last_fullsized":"2023-12-22T10:01:35.134824+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.698480+0000","last_change":"2023-12-22T10:01:34.690897+0000","last_active":"2023-12-22T10:01:34.698480+0000","last_peered":"2023-12-22T10:01:34.698480+0000","last_clean":"2023-12-22T10:01:34.698480+0000","last_became_active":"2023-12-22T10:01:34.689026+0000","last_became_peered":"2023-12-22T10:01:34.689026+0000","last_unstale":"2023-12-22T10:01:34.698480+0000","last_undegraded":"2023-12-22T10:01:34.698480+0000","last_fullsized":"2023-12-22T10:01:34.698480+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.153324+0000","last_change":"2023-12-22T10:01:35.153324+0000","last_active":"2023-12-22T10:01:35.153324+0000","last_peered":"2023-12-22T10:01:35.153324+0000","last_clean":"2023-12-22T10:01:35.153324+0000","last_became_active":"2023-12-22T10:01:35.152234+0000","last_became_peered":"2023-12-22T10:01:35.152234+0000","last_unstale":"2023-12-22T10:01:35.153324+0000","last_undegraded":"2023-12-22T10:01:35.153324+0000","last_fullsized":"2023-12-22T10:01:35.153324+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.693876+0000","last_change":"2023-12-22T10:01:34.684413+0000","last_active":"2023-12-22T10:01:34.693876+0000","last_peered":"2023-12-22T10:01:34.693876+0000","last_clean":"2023-12-22T10:01:34.693876+0000","last_became_active":"2023-12-22T10:01:34.684083+0000","last_became_peered":"2023-12-22T10:01:34.684083+0000","last_unstale":"2023-12-22T10:01:34.693876+0000","last_undegraded":"2023-12-22T10:01:34.693876+0000","last_fullsized":"2023-12-22T10:01:34.693876+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.152474+0000","last_change":"2023-12-22T10:01:35.152474+0000","last_active":"2023-12-22T10:01:35.152474+0000","last_peered":"2023-12-22T10:01:35.152474+0000","last_clean":"2023-12-22T10:01:35.152474+0000","last_became_active":"2023-12-22T10:01:35.152153+0000","last_became_peered":"2023-12-22T10:01:35.152153+0000","last_unstale":"2023-12-22T10:01:35.152474+0000","last_undegraded":"2023-12-22T10:01:35.152474+0000","last_fullsized":"2023-12-22T10:01:35.152474+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.692698+0000","last_change":"2023-12-22T10:01:34.689631+0000","last_active":"2023-12-22T10:01:34.692698+0000","last_peered":"2023-12-22T10:01:34.692698+0000","last_clean":"2023-12-22T10:01:34.692698+0000","last_became_active":"2023-12-22T10:01:34.689296+0000","last_became_peered":"2023-12-22T10:01:34.689296+0000","last_unstale":"2023-12-22T10:01:34.692698+0000","last_undegraded":"2023-12-22T10:01:34.692698+0000","last_fullsized":"2023-12-22T10:01:34.692698+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.158342+0000","last_change":"2023-12-22T10:01:35.158342+0000","last_active":"2023-12-22T10:01:35.158342+0000","last_peered":"2023-12-22T10:01:35.158342+0000","last_clean":"2023-12-22T10:01:35.158342+0000","last_became_active":"2023-12-22T10:01:35.156056+0000","last_became_peered":"2023-12-22T10:01:35.156056+0000","last_unstale":"2023-12-22T10:01:35.158342+0000","last_undegraded":"2023-12-22T10:01:35.158342+0000","last_fullsized":"2023-12-22T10:01:35.158342+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"35'1","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.131519+0000","last_change":"2023-12-22T10:01:34.692535+0000","last_active":"2023-12-22T10:01:35.131519+0000","last_peered":"2023-12-22T10:01:35.131519+0000","last_clean":"2023-12-22T10:01:35.131519+0000","last_became_active":"2023-12-22T10:01:34.692223+0000","last_became_peered":"2023-12-22T10:01:34.692223+0000","last_unstale":"2023-12-22T10:01:35.131519+0000","last_undegraded":"2023-12-22T10:01:35.131519+0000","last_fullsized":"2023-12-22T10:01:35.131519+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.151202+0000","last_change":"2023-12-22T10:01:35.151202+0000","last_active":"2023-12-22T10:01:35.151202+0000","last_peered":"2023-12-22T10:01:35.151202+0000","last_clean":"2023-12-22T10:01:35.151202+0000","last_became_active":"2023-12-22T10:01:35.150961+0000","last_became_peered":"2023-12-22T10:01:35.150961+0000","last_unstale":"2023-12-22T10:01:35.151202+0000","last_undegraded":"2023-12-22T10:01:35.151202+0000","last_fullsized":"2023-12-22T10:01:35.151202+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"35'1","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.125842+0000","last_change":"2023-12-22T10:01:34.689373+0000","last_active":"2023-12-22T10:01:35.125842+0000","last_peered":"2023-12-22T10:01:35.125842+0000","last_clean":"2023-12-22T10:01:35.125842+0000","last_became_active":"2023-12-22T10:01:34.689010+0000","last_became_peered":"2023-12-22T10:01:34.689010+0000","last_unstale":"2023-12-22T10:01:35.125842+0000","last_undegraded":"2023-12-22T10:01:35.125842+0000","last_fullsized":"2023-12-22T10:01:35.125842+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.157214+0000","last_change":"2023-12-22T10:01:35.157214+0000","last_active":"2023-12-22T10:01:35.157214+0000","last_peered":"2023-12-22T10:01:35.157214+0000","last_clean":"2023-12-22T10:01:35.157214+0000","last_became_active":"2023-12-22T10:01:35.156041+0000","last_became_peered":"2023-12-22T10:01:35.156041+0000","last_unstale":"2023-12-22T10:01:35.157214+0000","last_undegraded":"2023-12-22T10:01:35.157214+0000","last_fullsized":"2023-12-22T10:01:35.157214+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"35'2","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.142407+0000","last_change":"2023-12-22T10:01:34.693006+0000","last_active":"2023-12-22T10:01:35.142407+0000","last_peered":"2023-12-22T10:01:35.142407+0000","last_clean":"2023-12-22T10:01:35.142407+0000","last_became_active":"2023-12-22T10:01:34.692460+0000","last_became_peered":"2023-12-22T10:01:34.692460+0000","last_unstale":"2023-12-22T10:01:35.142407+0000","last_undegraded":"2023-12-22T10:01:35.142407+0000","last_fullsized":"2023-12-22T10:01:35.142407+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.145742+0000","last_change":"2023-12-22T10:01:35.145742+0000","last_active":"2023-12-22T10:01:35.145742+0000","last_peered":"2023-12-22T10:01:35.145742+0000","last_clean":"2023-12-22T10:01:35.145742+0000","last_became_active":"2023-12-22T10:01:35.145385+0000","last_became_peered":"2023-12-22T10:01:35.145385+0000","last_unstale":"2023-12-22T10:01:35.145742+0000","last_undegraded":"2023-12-22T10:01:35.145742+0000","last_fullsized":"2023-12-22T10:01:35.145742+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.703400+0000","last_change":"2023-12-22T10:01:34.698319+0000","last_active":"2023-12-22T10:01:34.703400+0000","last_peered":"2023-12-22T10:01:34.703400+0000","last_clean":"2023-12-22T10:01:34.703400+0000","last_became_active":"2023-12-22T10:01:34.698118+0000","last_became_peered":"2023-12-22T10:01:34.698118+0000","last_unstale":"2023-12-22T10:01:34.703400+0000","last_undegraded":"2023-12-22T10:01:34.703400+0000","last_fullsized":"2023-12-22T10:01:34.703400+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.144227+0000","last_change":"2023-12-22T10:01:35.144227+0000","last_active":"2023-12-22T10:01:35.144227+0000","last_peered":"2023-12-22T10:01:35.144227+0000","last_clean":"2023-12-22T10:01:35.144227+0000","last_became_active":"2023-12-22T10:01:35.141822+0000","last_became_peered":"2023-12-22T10:01:35.141822+0000","last_unstale":"2023-12-22T10:01:35.144227+0000","last_undegraded":"2023-12-22T10:01:35.144227+0000","last_fullsized":"2023-12-22T10:01:35.144227+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.695584+0000","last_change":"2023-12-22T10:01:34.687654+0000","last_active":"2023-12-22T10:01:34.695584+0000","last_peered":"2023-12-22T10:01:34.695584+0000","last_clean":"2023-12-22T10:01:34.695584+0000","last_became_active":"2023-12-22T10:01:34.687337+0000","last_became_peered":"2023-12-22T10:01:34.687337+0000","last_unstale":"2023-12-22T10:01:34.695584+0000","last_undegraded":"2023-12-22T10:01:34.695584+0000","last_fullsized":"2023-12-22T10:01:34.695584+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.148573+0000","last_change":"2023-12-22T10:01:35.148573+0000","last_active":"2023-12-22T10:01:35.148573+0000","last_peered":"2023-12-22T10:01:35.148573+0000","last_clean":"2023-12-22T10:01:35.148573+0000","last_became_active":"2023-12-22T10:01:35.148279+0000","last_became_peered":"2023-12-22T10:01:35.148279+0000","last_unstale":"2023-12-22T10:01:35.148573+0000","last_undegraded":"2023-12-22T10:01:35.148573+0000","last_fullsized":"2023-12-22T10:01:35.148573+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.706662+0000","last_change":"2023-12-22T10:01:34.702330+0000","last_active":"2023-12-22T10:01:34.706662+0000","last_peered":"2023-12-22T10:01:34.706662+0000","last_clean":"2023-12-22T10:01:34.706662+0000","last_became_active":"2023-12-22T10:01:34.701937+0000","last_became_peered":"2023-12-22T10:01:34.701937+0000","last_unstale":"2023-12-22T10:01:34.706662+0000","last_undegraded":"2023-12-22T10:01:34.706662+0000","last_fullsized":"2023-12-22T10:01:34.706662+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.161623+0000","last_change":"2023-12-22T10:01:35.161623+0000","last_active":"2023-12-22T10:01:35.161623+0000","last_peered":"2023-12-22T10:01:35.161623+0000","last_clean":"2023-12-22T10:01:35.161623+0000","last_became_active":"2023-12-22T10:01:35.161366+0000","last_became_peered":"2023-12-22T10:01:35.161366+0000","last_unstale":"2023-12-22T10:01:35.161623+0000","last_undegraded":"2023-12-22T10:01:35.161623+0000","last_fullsized":"2023-12-22T10:01:35.161623+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.699760+0000","last_change":"2023-12-22T10:01:34.694683+0000","last_active":"2023-12-22T10:01:34.699760+0000","last_peered":"2023-12-22T10:01:34.699760+0000","last_clean":"2023-12-22T10:01:34.699760+0000","last_became_active":"2023-12-22T10:01:34.693873+0000","last_became_peered":"2023-12-22T10:01:34.693873+0000","last_unstale":"2023-12-22T10:01:34.699760+0000","last_undegraded":"2023-12-22T10:01:34.699760+0000","last_fullsized":"2023-12-22T10:01:34.699760+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.141439+0000","last_change":"2023-12-22T10:01:35.141439+0000","last_active":"2023-12-22T10:01:35.141439+0000","last_peered":"2023-12-22T10:01:35.141439+0000","last_clean":"2023-12-22T10:01:35.141439+0000","last_became_active":"2023-12-22T10:01:35.141140+0000","last_became_peered":"2023-12-22T10:01:35.141140+0000","last_unstale":"2023-12-22T10:01:35.141439+0000","last_undegraded":"2023-12-22T10:01:35.141439+0000","last_fullsized":"2023-12-22T10:01:35.141439+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.705653+0000","last_change":"2023-12-22T10:01:34.701959+0000","last_active":"2023-12-22T10:01:34.705653+0000","last_peered":"2023-12-22T10:01:34.705653+0000","last_clean":"2023-12-22T10:01:34.705653+0000","last_became_active":"2023-12-22T10:01:34.693141+0000","last_became_peered":"2023-12-22T10:01:34.693141+0000","last_unstale":"2023-12-22T10:01:34.705653+0000","last_undegraded":"2023-12-22T10:01:34.705653+0000","last_fullsized":"2023-12-22T10:01:34.705653+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.153160+0000","last_change":"2023-12-22T10:01:35.153160+0000","last_active":"2023-12-22T10:01:35.153160+0000","last_peered":"2023-12-22T10:01:35.153160+0000","last_clean":"2023-12-22T10:01:35.153160+0000","last_became_active":"2023-12-22T10:01:35.152160+0000","last_became_peered":"2023-12-22T10:01:35.152160+0000","last_unstale":"2023-12-22T10:01:35.153160+0000","last_undegraded":"2023-12-22T10:01:35.153160+0000","last_fullsized":"2023-12-22T10:01:35.153160+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.696619+0000","last_change":"2023-12-22T10:01:34.685148+0000","last_active":"2023-12-22T10:01:34.696619+0000","last_peered":"2023-12-22T10:01:34.696619+0000","last_clean":"2023-12-22T10:01:34.696619+0000","last_became_active":"2023-12-22T10:01:34.684840+0000","last_became_peered":"2023-12-22T10:01:34.684840+0000","last_unstale":"2023-12-22T10:01:34.696619+0000","last_undegraded":"2023-12-22T10:01:34.696619+0000","last_fullsized":"2023-12-22T10:01:34.696619+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.152114+0000","last_change":"2023-12-22T10:01:35.152114+0000","last_active":"2023-12-22T10:01:35.152114+0000","last_peered":"2023-12-22T10:01:35.152114+0000","last_clean":"2023-12-22T10:01:35.152114+0000","last_became_active":"2023-12-22T10:01:35.151816+0000","last_became_peered":"2023-12-22T10:01:35.151816+0000","last_unstale":"2023-12-22T10:01:35.152114+0000","last_undegraded":"2023-12-22T10:01:35.152114+0000","last_fullsized":"2023-12-22T10:01:35.152114+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.700497+0000","last_change":"2023-12-22T10:01:34.693683+0000","last_active":"2023-12-22T10:01:34.700497+0000","last_peered":"2023-12-22T10:01:34.700497+0000","last_clean":"2023-12-22T10:01:34.700497+0000","last_became_active":"2023-12-22T10:01:34.693296+0000","last_became_peered":"2023-12-22T10:01:34.693296+0000","last_unstale":"2023-12-22T10:01:34.700497+0000","last_undegraded":"2023-12-22T10:01:34.700497+0000","last_fullsized":"2023-12-22T10:01:34.700497+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.138193+0000","last_change":"2023-12-22T10:01:35.138193+0000","last_active":"2023-12-22T10:01:35.138193+0000","last_peered":"2023-12-22T10:01:35.138193+0000","last_clean":"2023-12-22T10:01:35.138193+0000","last_became_active":"2023-12-22T10:01:35.137926+0000","last_became_peered":"2023-12-22T10:01:35.137926+0000","last_unstale":"2023-12-22T10:01:35.138193+0000","last_undegraded":"2023-12-22T10:01:35.138193+0000","last_fullsized":"2023-12-22T10:01:35.138193+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"35'3","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.159297+0000","last_change":"2023-12-22T10:01:34.696240+0000","last_active":"2023-12-22T10:01:35.159297+0000","last_peered":"2023-12-22T10:01:35.159297+0000","last_clean":"2023-12-22T10:01:35.159297+0000","last_became_active":"2023-12-22T10:01:34.695913+0000","last_became_peered":"2023-12-22T10:01:34.695913+0000","last_unstale":"2023-12-22T10:01:35.159297+0000","last_undegraded":"2023-12-22T10:01:35.159297+0000","last_fullsized":"2023-12-22T10:01:35.159297+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.136369+0000","last_change":"2023-12-22T10:01:35.136369+0000","last_active":"2023-12-22T10:01:35.136369+0000","last_peered":"2023-12-22T10:01:35.136369+0000","last_clean":"2023-12-22T10:01:35.136369+0000","last_became_active":"2023-12-22T10:01:35.136123+0000","last_became_peered":"2023-12-22T10:01:35.136123+0000","last_unstale":"2023-12-22T10:01:35.136369+0000","last_undegraded":"2023-12-22T10:01:35.136369+0000","last_fullsized":"2023-12-22T10:01:35.136369+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"35'2","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.146606+0000","last_change":"2023-12-22T10:01:34.690599+0000","last_active":"2023-12-22T10:01:35.146606+0000","last_peered":"2023-12-22T10:01:35.146606+0000","last_clean":"2023-12-22T10:01:35.146606+0000","last_became_active":"2023-12-22T10:01:34.690313+0000","last_became_peered":"2023-12-22T10:01:34.690313+0000","last_unstale":"2023-12-22T10:01:35.146606+0000","last_undegraded":"2023-12-22T10:01:35.146606+0000","last_fullsized":"2023-12-22T10:01:35.146606+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.141012+0000","last_change":"2023-12-22T10:01:35.141012+0000","last_active":"2023-12-22T10:01:35.141012+0000","last_peered":"2023-12-22T10:01:35.141012+0000","last_clean":"2023-12-22T10:01:35.141012+0000","last_became_active":"2023-12-22T10:01:35.140498+0000","last_became_peered":"2023-12-22T10:01:35.140498+0000","last_unstale":"2023-12-22T10:01:35.141012+0000","last_undegraded":"2023-12-22T10:01:35.141012+0000","last_fullsized":"2023-12-22T10:01:35.141012+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"35'1","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.127844+0000","last_change":"2023-12-22T10:01:34.694064+0000","last_active":"2023-12-22T10:01:35.127844+0000","last_peered":"2023-12-22T10:01:35.127844+0000","last_clean":"2023-12-22T10:01:35.127844+0000","last_became_active":"2023-12-22T10:01:34.693775+0000","last_became_peered":"2023-12-22T10:01:34.693775+0000","last_unstale":"2023-12-22T10:01:35.127844+0000","last_undegraded":"2023-12-22T10:01:35.127844+0000","last_fullsized":"2023-12-22T10:01:35.127844+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.136270+0000","last_change":"2023-12-22T10:01:35.136270+0000","last_active":"2023-12-22T10:01:35.136270+0000","last_peered":"2023-12-22T10:01:35.136270+0000","last_clean":"2023-12-22T10:01:35.136270+0000","last_became_active":"2023-12-22T10:01:35.135729+0000","last_became_peered":"2023-12-22T10:01:35.135729+0000","last_unstale":"2023-12-22T10:01:35.136270+0000","last_undegraded":"2023-12-22T10:01:35.136270+0000","last_fullsized":"2023-12-22T10:01:35.136270+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.707410+0000","last_change":"2023-12-22T10:01:34.705576+0000","last_active":"2023-12-22T10:01:34.707410+0000","last_peered":"2023-12-22T10:01:34.707410+0000","last_clean":"2023-12-22T10:01:34.707410+0000","last_became_active":"2023-12-22T10:01:34.705340+0000","last_became_peered":"2023-12-22T10:01:34.705340+0000","last_unstale":"2023-12-22T10:01:34.707410+0000","last_undegraded":"2023-12-22T10:01:34.707410+0000","last_fullsized":"2023-12-22T10:01:34.707410+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.140150+0000","last_change":"2023-12-22T10:01:35.140150+0000","last_active":"2023-12-22T10:01:35.140150+0000","last_peered":"2023-12-22T10:01:35.140150+0000","last_clean":"2023-12-22T10:01:35.140150+0000","last_became_active":"2023-12-22T10:01:35.139884+0000","last_became_peered":"2023-12-22T10:01:35.139884+0000","last_unstale":"2023-12-22T10:01:35.140150+0000","last_undegraded":"2023-12-22T10:01:35.140150+0000","last_fullsized":"2023-12-22T10:01:35.140150+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.702265+0000","last_change":"2023-12-22T10:01:34.690703+0000","last_active":"2023-12-22T10:01:34.702265+0000","last_peered":"2023-12-22T10:01:34.702265+0000","last_clean":"2023-12-22T10:01:34.702265+0000","last_became_active":"2023-12-22T10:01:34.690369+0000","last_became_peered":"2023-12-22T10:01:34.690369+0000","last_unstale":"2023-12-22T10:01:34.702265+0000","last_undegraded":"2023-12-22T10:01:34.702265+0000","last_fullsized":"2023-12-22T10:01:34.702265+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.128289+0000","last_change":"2023-12-22T10:01:35.128289+0000","last_active":"2023-12-22T10:01:35.128289+0000","last_peered":"2023-12-22T10:01:35.128289+0000","last_clean":"2023-12-22T10:01:35.128289+0000","last_became_active":"2023-12-22T10:01:35.127995+0000","last_became_peered":"2023-12-22T10:01:35.127995+0000","last_unstale":"2023-12-22T10:01:35.128289+0000","last_undegraded":"2023-12-22T10:01:35.128289+0000","last_fullsized":"2023-12-22T10:01:35.128289+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"35'4","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.155293+0000","last_change":"2023-12-22T10:01:34.705549+0000","last_active":"2023-12-22T10:01:35.155293+0000","last_peered":"2023-12-22T10:01:35.155293+0000","last_clean":"2023-12-22T10:01:35.155293+0000","last_became_active":"2023-12-22T10:01:34.704846+0000","last_became_peered":"2023-12-22T10:01:34.704846+0000","last_unstale":"2023-12-22T10:01:35.155293+0000","last_undegraded":"2023-12-22T10:01:35.155293+0000","last_fullsized":"2023-12-22T10:01:35.155293+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.139893+0000","last_change":"2023-12-22T10:01:35.139893+0000","last_active":"2023-12-22T10:01:35.139893+0000","last_peered":"2023-12-22T10:01:35.139893+0000","last_clean":"2023-12-22T10:01:35.139893+0000","last_became_active":"2023-12-22T10:01:35.138934+0000","last_became_peered":"2023-12-22T10:01:35.138934+0000","last_unstale":"2023-12-22T10:01:35.139893+0000","last_undegraded":"2023-12-22T10:01:35.139893+0000","last_fullsized":"2023-12-22T10:01:35.139893+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"35'1","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.139767+0000","last_change":"2023-12-22T10:01:34.687756+0000","last_active":"2023-12-22T10:01:35.139767+0000","last_peered":"2023-12-22T10:01:35.139767+0000","last_clean":"2023-12-22T10:01:35.139767+0000","last_became_active":"2023-12-22T10:01:34.687316+0000","last_became_peered":"2023-12-22T10:01:34.687316+0000","last_unstale":"2023-12-22T10:01:35.139767+0000","last_undegraded":"2023-12-22T10:01:35.139767+0000","last_fullsized":"2023-12-22T10:01:35.139767+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.142614+0000","last_change":"2023-12-22T10:01:35.142614+0000","last_active":"2023-12-22T10:01:35.142614+0000","last_peered":"2023-12-22T10:01:35.142614+0000","last_clean":"2023-12-22T10:01:35.142614+0000","last_became_active":"2023-12-22T10:01:35.139303+0000","last_became_peered":"2023-12-22T10:01:35.139303+0000","last_unstale":"2023-12-22T10:01:35.142614+0000","last_undegraded":"2023-12-22T10:01:35.142614+0000","last_fullsized":"2023-12-22T10:01:35.142614+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"35'2","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.163131+0000","last_change":"2023-12-22T10:01:34.696868+0000","last_active":"2023-12-22T10:01:35.163131+0000","last_peered":"2023-12-22T10:01:35.163131+0000","last_clean":"2023-12-22T10:01:35.163131+0000","last_became_active":"2023-12-22T10:01:34.696571+0000","last_became_peered":"2023-12-22T10:01:34.696571+0000","last_unstale":"2023-12-22T10:01:35.163131+0000","last_undegraded":"2023-12-22T10:01:35.163131+0000","last_fullsized":"2023-12-22T10:01:35.163131+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.141882+0000","last_change":"2023-12-22T10:01:35.141882+0000","last_active":"2023-12-22T10:01:35.141882+0000","last_peered":"2023-12-22T10:01:35.141882+0000","last_clean":"2023-12-22T10:01:35.141882+0000","last_became_active":"2023-12-22T10:01:35.141536+0000","last_became_peered":"2023-12-22T10:01:35.141536+0000","last_unstale":"2023-12-22T10:01:35.141882+0000","last_undegraded":"2023-12-22T10:01:35.141882+0000","last_fullsized":"2023-12-22T10:01:35.141882+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.701982+0000","last_change":"2023-12-22T10:01:34.699249+0000","last_active":"2023-12-22T10:01:34.701982+0000","last_peered":"2023-12-22T10:01:34.701982+0000","last_clean":"2023-12-22T10:01:34.701982+0000","last_became_active":"2023-12-22T10:01:34.698955+0000","last_became_peered":"2023-12-22T10:01:34.698955+0000","last_unstale":"2023-12-22T10:01:34.701982+0000","last_undegraded":"2023-12-22T10:01:34.701982+0000","last_fullsized":"2023-12-22T10:01:34.701982+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.143645+0000","last_change":"2023-12-22T10:01:35.143645+0000","last_active":"2023-12-22T10:01:35.143645+0000","last_peered":"2023-12-22T10:01:35.143645+0000","last_clean":"2023-12-22T10:01:35.143645+0000","last_became_active":"2023-12-22T10:01:35.143327+0000","last_became_peered":"2023-12-22T10:01:35.143327+0000","last_unstale":"2023-12-22T10:01:35.143645+0000","last_undegraded":"2023-12-22T10:01:35.143645+0000","last_fullsized":"2023-12-22T10:01:35.143645+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.701651+0000","last_change":"2023-12-22T10:01:34.697799+0000","last_active":"2023-12-22T10:01:34.701651+0000","last_peered":"2023-12-22T10:01:34.701651+0000","last_clean":"2023-12-22T10:01:34.701651+0000","last_became_active":"2023-12-22T10:01:34.697233+0000","last_became_peered":"2023-12-22T10:01:34.697233+0000","last_unstale":"2023-12-22T10:01:34.701651+0000","last_undegraded":"2023-12-22T10:01:34.701651+0000","last_fullsized":"2023-12-22T10:01:34.701651+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.156435+0000","last_change":"2023-12-22T10:01:35.156435+0000","last_active":"2023-12-22T10:01:35.156435+0000","last_peered":"2023-12-22T10:01:35.156435+0000","last_clean":"2023-12-22T10:01:35.156435+0000","last_became_active":"2023-12-22T10:01:35.156132+0000","last_became_peered":"2023-12-22T10:01:35.156132+0000","last_unstale":"2023-12-22T10:01:35.156435+0000","last_undegraded":"2023-12-22T10:01:35.156435+0000","last_fullsized":"2023-12-22T10:01:35.156435+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"35'1","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.126373+0000","last_change":"2023-12-22T10:01:34.681213+0000","last_active":"2023-12-22T10:01:35.126373+0000","last_peered":"2023-12-22T10:01:35.126373+0000","last_clean":"2023-12-22T10:01:35.126373+0000","last_became_active":"2023-12-22T10:01:34.680928+0000","last_became_peered":"2023-12-22T10:01:34.680928+0000","last_unstale":"2023-12-22T10:01:35.126373+0000","last_undegraded":"2023-12-22T10:01:35.126373+0000","last_fullsized":"2023-12-22T10:01:35.126373+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.140301+0000","last_change":"2023-12-22T10:01:35.140301+0000","last_active":"2023-12-22T10:01:35.140301+0000","last_peered":"2023-12-22T10:01:35.140301+0000","last_clean":"2023-12-22T10:01:35.140301+0000","last_became_active":"2023-12-22T10:01:35.140013+0000","last_became_peered":"2023-12-22T10:01:35.140013+0000","last_unstale":"2023-12-22T10:01:35.140301+0000","last_undegraded":"2023-12-22T10:01:35.140301+0000","last_fullsized":"2023-12-22T10:01:35.140301+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.702381+0000","last_change":"2023-12-22T10:01:34.700554+0000","last_active":"2023-12-22T10:01:34.702381+0000","last_peered":"2023-12-22T10:01:34.702381+0000","last_clean":"2023-12-22T10:01:34.702381+0000","last_became_active":"2023-12-22T10:01:34.700250+0000","last_became_peered":"2023-12-22T10:01:34.700250+0000","last_unstale":"2023-12-22T10:01:34.702381+0000","last_undegraded":"2023-12-22T10:01:34.702381+0000","last_fullsized":"2023-12-22T10:01:34.702381+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.149330+0000","last_change":"2023-12-22T10:01:35.149330+0000","last_active":"2023-12-22T10:01:35.149330+0000","last_peered":"2023-12-22T10:01:35.149330+0000","last_clean":"2023-12-22T10:01:35.149330+0000","last_became_active":"2023-12-22T10:01:35.148997+0000","last_became_peered":"2023-12-22T10:01:35.148997+0000","last_unstale":"2023-12-22T10:01:35.149330+0000","last_undegraded":"2023-12-22T10:01:35.149330+0000","last_fullsized":"2023-12-22T10:01:35.149330+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.708610+0000","last_change":"2023-12-22T10:01:34.706221+0000","last_active":"2023-12-22T10:01:34.708610+0000","last_peered":"2023-12-22T10:01:34.708610+0000","last_clean":"2023-12-22T10:01:34.708610+0000","last_became_active":"2023-12-22T10:01:34.705796+0000","last_became_peered":"2023-12-22T10:01:34.705796+0000","last_unstale":"2023-12-22T10:01:34.708610+0000","last_undegraded":"2023-12-22T10:01:34.708610+0000","last_fullsized":"2023-12-22T10:01:34.708610+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.140317+0000","last_change":"2023-12-22T10:01:35.140317+0000","last_active":"2023-12-22T10:01:35.140317+0000","last_peered":"2023-12-22T10:01:35.140317+0000","last_clean":"2023-12-22T10:01:35.140317+0000","last_became_active":"2023-12-22T10:01:35.140015+0000","last_became_peered":"2023-12-22T10:01:35.140015+0000","last_unstale":"2023-12-22T10:01:35.140317+0000","last_undegraded":"2023-12-22T10:01:35.140317+0000","last_fullsized":"2023-12-22T10:01:35.140317+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.697673+0000","last_change":"2023-12-22T10:01:34.695101+0000","last_active":"2023-12-22T10:01:34.697673+0000","last_peered":"2023-12-22T10:01:34.697673+0000","last_clean":"2023-12-22T10:01:34.697673+0000","last_became_active":"2023-12-22T10:01:34.694803+0000","last_became_peered":"2023-12-22T10:01:34.694803+0000","last_unstale":"2023-12-22T10:01:34.697673+0000","last_undegraded":"2023-12-22T10:01:34.697673+0000","last_fullsized":"2023-12-22T10:01:34.697673+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.148013+0000","last_change":"2023-12-22T10:01:35.148013+0000","last_active":"2023-12-22T10:01:35.148013+0000","last_peered":"2023-12-22T10:01:35.148013+0000","last_clean":"2023-12-22T10:01:35.148013+0000","last_became_active":"2023-12-22T10:01:35.147694+0000","last_became_peered":"2023-12-22T10:01:35.147694+0000","last_unstale":"2023-12-22T10:01:35.148013+0000","last_undegraded":"2023-12-22T10:01:35.148013+0000","last_fullsized":"2023-12-22T10:01:35.148013+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.702610+0000","last_change":"2023-12-22T10:01:34.698883+0000","last_active":"2023-12-22T10:01:34.702610+0000","last_peered":"2023-12-22T10:01:34.702610+0000","last_clean":"2023-12-22T10:01:34.702610+0000","last_became_active":"2023-12-22T10:01:34.698295+0000","last_became_peered":"2023-12-22T10:01:34.698295+0000","last_unstale":"2023-12-22T10:01:34.702610+0000","last_undegraded":"2023-12-22T10:01:34.702610+0000","last_fullsized":"2023-12-22T10:01:34.702610+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.677918+0000","last_change":"2023-12-22T10:00:28.036372+0000","last_active":"2023-12-22T10:01:34.677918+0000","last_peered":"2023-12-22T10:01:34.677918+0000","last_clean":"2023-12-22T10:01:34.677918+0000","last_became_active":"2023-12-22T10:00:28.035974+0000","last_became_peered":"2023-12-22T10:00:28.035974+0000","last_unstale":"2023-12-22T10:01:34.677918+0000","last_undegraded":"2023-12-22T10:01:34.677918+0000","last_fullsized":"2023-12-22T10:01:34.677918+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_clean_scrub_stamp":"2023-12-22T10:00:27.001906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.153601+0000","last_change":"2023-12-22T10:01:35.153601+0000","last_active":"2023-12-22T10:01:35.153601+0000","last_peered":"2023-12-22T10:01:35.153601+0000","last_clean":"2023-12-22T10:01:35.153601+0000","last_became_active":"2023-12-22T10:01:35.152791+0000","last_became_peered":"2023-12-22T10:01:35.152791+0000","last_unstale":"2023-12-22T10:01:35.153601+0000","last_undegraded":"2023-12-22T10:01:35.153601+0000","last_fullsized":"2023-12-22T10:01:35.153601+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.685466+0000","last_change":"2023-12-22T10:01:34.680407+0000","last_active":"2023-12-22T10:01:34.685466+0000","last_peered":"2023-12-22T10:01:34.685466+0000","last_clean":"2023-12-22T10:01:34.685466+0000","last_became_active":"2023-12-22T10:01:34.679458+0000","last_became_peered":"2023-12-22T10:01:34.679458+0000","last_unstale":"2023-12-22T10:01:34.685466+0000","last_undegraded":"2023-12-22T10:01:34.685466+0000","last_fullsized":"2023-12-22T10:01:34.685466+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.679463+0000","last_change":"2023-12-22T10:00:28.035308+0000","last_active":"2023-12-22T10:01:34.679463+0000","last_peered":"2023-12-22T10:01:34.679463+0000","last_clean":"2023-12-22T10:01:34.679463+0000","last_became_active":"2023-12-22T10:00:28.035002+0000","last_became_peered":"2023-12-22T10:00:28.035002+0000","last_unstale":"2023-12-22T10:01:34.679463+0000","last_undegraded":"2023-12-22T10:01:34.679463+0000","last_fullsized":"2023-12-22T10:01:34.679463+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_clean_scrub_stamp":"2023-12-22T10:00:27.001906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.156062+0000","last_change":"2023-12-22T10:01:35.156062+0000","last_active":"2023-12-22T10:01:35.156062+0000","last_peered":"2023-12-22T10:01:35.156062+0000","last_clean":"2023-12-22T10:01:35.156062+0000","last_became_active":"2023-12-22T10:01:35.155705+0000","last_became_peered":"2023-12-22T10:01:35.155705+0000","last_unstale":"2023-12-22T10:01:35.156062+0000","last_undegraded":"2023-12-22T10:01:35.156062+0000","last_fullsized":"2023-12-22T10:01:35.156062+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.698457+0000","last_change":"2023-12-22T10:01:34.684207+0000","last_active":"2023-12-22T10:01:34.698457+0000","last_peered":"2023-12-22T10:01:34.698457+0000","last_clean":"2023-12-22T10:01:34.698457+0000","last_became_active":"2023-12-22T10:01:34.683911+0000","last_became_peered":"2023-12-22T10:01:34.683911+0000","last_unstale":"2023-12-22T10:01:34.698457+0000","last_undegraded":"2023-12-22T10:01:34.698457+0000","last_fullsized":"2023-12-22T10:01:34.698457+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.677767+0000","last_change":"2023-12-22T10:00:28.029892+0000","last_active":"2023-12-22T10:01:34.677767+0000","last_peered":"2023-12-22T10:01:34.677767+0000","last_clean":"2023-12-22T10:01:34.677767+0000","last_became_active":"2023-12-22T10:00:28.029391+0000","last_became_peered":"2023-12-22T10:00:28.029391+0000","last_unstale":"2023-12-22T10:01:34.677767+0000","last_undegraded":"2023-12-22T10:01:34.677767+0000","last_fullsized":"2023-12-22T10:01:34.677767+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_clean_scrub_stamp":"2023-12-22T10:00:27.001906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.130148+0000","last_change":"2023-12-22T10:01:35.130148+0000","last_active":"2023-12-22T10:01:35.130148+0000","last_peered":"2023-12-22T10:01:35.130148+0000","last_clean":"2023-12-22T10:01:35.130148+0000","last_became_active":"2023-12-22T10:01:35.129858+0000","last_became_peered":"2023-12-22T10:01:35.129858+0000","last_unstale":"2023-12-22T10:01:35.130148+0000","last_undegraded":"2023-12-22T10:01:35.130148+0000","last_fullsized":"2023-12-22T10:01:35.130148+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.698590+0000","last_change":"2023-12-22T10:01:34.693923+0000","last_active":"2023-12-22T10:01:34.698590+0000","last_peered":"2023-12-22T10:01:34.698590+0000","last_clean":"2023-12-22T10:01:34.698590+0000","last_became_active":"2023-12-22T10:01:34.693616+0000","last_became_peered":"2023-12-22T10:01:34.693616+0000","last_unstale":"2023-12-22T10:01:34.698590+0000","last_undegraded":"2023-12-22T10:01:34.698590+0000","last_fullsized":"2023-12-22T10:01:34.698590+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.672378+0000","last_change":"2023-12-22T10:00:28.025395+0000","last_active":"2023-12-22T10:01:34.672378+0000","last_peered":"2023-12-22T10:01:34.672378+0000","last_clean":"2023-12-22T10:01:34.672378+0000","last_became_active":"2023-12-22T10:00:28.024588+0000","last_became_peered":"2023-12-22T10:00:28.024588+0000","last_unstale":"2023-12-22T10:01:34.672378+0000","last_undegraded":"2023-12-22T10:01:34.672378+0000","last_fullsized":"2023-12-22T10:01:34.672378+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_clean_scrub_stamp":"2023-12-22T10:00:27.001906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.161679+0000","last_change":"2023-12-22T10:01:35.161679+0000","last_active":"2023-12-22T10:01:35.161679+0000","last_peered":"2023-12-22T10:01:35.161679+0000","last_clean":"2023-12-22T10:01:35.161679+0000","last_became_active":"2023-12-22T10:01:35.161420+0000","last_became_peered":"2023-12-22T10:01:35.161420+0000","last_unstale":"2023-12-22T10:01:35.161679+0000","last_undegraded":"2023-12-22T10:01:35.161679+0000","last_fullsized":"2023-12-22T10:01:35.161679+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.699359+0000","last_change":"2023-12-22T10:01:34.695408+0000","last_active":"2023-12-22T10:01:34.699359+0000","last_peered":"2023-12-22T10:01:34.699359+0000","last_clean":"2023-12-22T10:01:34.699359+0000","last_became_active":"2023-12-22T10:01:34.694999+0000","last_became_peered":"2023-12-22T10:01:34.694999+0000","last_unstale":"2023-12-22T10:01:34.699359+0000","last_undegraded":"2023-12-22T10:01:34.699359+0000","last_fullsized":"2023-12-22T10:01:34.699359+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.672772+0000","last_change":"2023-12-22T10:00:28.029884+0000","last_active":"2023-12-22T10:01:34.672772+0000","last_peered":"2023-12-22T10:01:34.672772+0000","last_clean":"2023-12-22T10:01:34.672772+0000","last_became_active":"2023-12-22T10:00:28.029422+0000","last_became_peered":"2023-12-22T10:00:28.029422+0000","last_unstale":"2023-12-22T10:01:34.672772+0000","last_undegraded":"2023-12-22T10:01:34.672772+0000","last_fullsized":"2023-12-22T10:01:34.672772+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_clean_scrub_stamp":"2023-12-22T10:00:27.001906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.148673+0000","last_change":"2023-12-22T10:01:35.148673+0000","last_active":"2023-12-22T10:01:35.148673+0000","last_peered":"2023-12-22T10:01:35.148673+0000","last_clean":"2023-12-22T10:01:35.148673+0000","last_became_active":"2023-12-22T10:01:35.148293+0000","last_became_peered":"2023-12-22T10:01:35.148293+0000","last_unstale":"2023-12-22T10:01:35.148673+0000","last_undegraded":"2023-12-22T10:01:35.148673+0000","last_fullsized":"2023-12-22T10:01:35.148673+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.701728+0000","last_change":"2023-12-22T10:01:34.698687+0000","last_active":"2023-12-22T10:01:34.701728+0000","last_peered":"2023-12-22T10:01:34.701728+0000","last_clean":"2023-12-22T10:01:34.701728+0000","last_became_active":"2023-12-22T10:01:34.698369+0000","last_became_peered":"2023-12-22T10:01:34.698369+0000","last_unstale":"2023-12-22T10:01:34.701728+0000","last_undegraded":"2023-12-22T10:01:34.701728+0000","last_fullsized":"2023-12-22T10:01:34.701728+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.667511+0000","last_change":"2023-12-22T10:00:28.028621+0000","last_active":"2023-12-22T10:01:34.667511+0000","last_peered":"2023-12-22T10:01:34.667511+0000","last_clean":"2023-12-22T10:01:34.667511+0000","last_became_active":"2023-12-22T10:00:28.028159+0000","last_became_peered":"2023-12-22T10:00:28.028159+0000","last_unstale":"2023-12-22T10:01:34.667511+0000","last_undegraded":"2023-12-22T10:01:34.667511+0000","last_fullsized":"2023-12-22T10:01:34.667511+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_clean_scrub_stamp":"2023-12-22T10:00:27.001906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.139521+0000","last_change":"2023-12-22T10:01:35.139521+0000","last_active":"2023-12-22T10:01:35.139521+0000","last_peered":"2023-12-22T10:01:35.139521+0000","last_clean":"2023-12-22T10:01:35.139521+0000","last_became_active":"2023-12-22T10:01:35.139189+0000","last_became_peered":"2023-12-22T10:01:35.139189+0000","last_unstale":"2023-12-22T10:01:35.139521+0000","last_undegraded":"2023-12-22T10:01:35.139521+0000","last_fullsized":"2023-12-22T10:01:35.139521+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"35'2","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.160687+0000","last_change":"2023-12-22T10:01:34.680088+0000","last_active":"2023-12-22T10:01:35.160687+0000","last_peered":"2023-12-22T10:01:35.160687+0000","last_clean":"2023-12-22T10:01:35.160687+0000","last_became_active":"2023-12-22T10:01:34.679800+0000","last_became_peered":"2023-12-22T10:01:34.679800+0000","last_unstale":"2023-12-22T10:01:35.160687+0000","last_undegraded":"2023-12-22T10:01:35.160687+0000","last_fullsized":"2023-12-22T10:01:35.160687+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.670731+0000","last_change":"2023-12-22T10:00:28.030883+0000","last_active":"2023-12-22T10:01:34.670731+0000","last_peered":"2023-12-22T10:01:34.670731+0000","last_clean":"2023-12-22T10:01:34.670731+0000","last_became_active":"2023-12-22T10:00:28.030284+0000","last_became_peered":"2023-12-22T10:00:28.030284+0000","last_unstale":"2023-12-22T10:01:34.670731+0000","last_undegraded":"2023-12-22T10:01:34.670731+0000","last_fullsized":"2023-12-22T10:01:34.670731+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_clean_scrub_stamp":"2023-12-22T10:00:27.001906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-22T10:01:35.159707+0000","last_change":"2023-12-22T10:01:35.159707+0000","last_active":"2023-12-22T10:01:35.159707+0000","last_peered":"2023-12-22T10:01:35.159707+0000","last_clean":"2023-12-22T10:01:35.159707+0000","last_became_active":"2023-12-22T10:01:35.159054+0000","last_became_peered":"2023-12-22T10:01:35.159054+0000","last_unstale":"2023-12-22T10:01:35.159707+0000","last_undegraded":"2023-12-22T10:01:35.159707+0000","last_fullsized":"2023-12-22T10:01:35.159707+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.697326+0000","last_change":"2023-12-22T10:01:34.688735+0000","last_active":"2023-12-22T10:01:34.697326+0000","last_peered":"2023-12-22T10:01:34.697326+0000","last_clean":"2023-12-22T10:01:34.697326+0000","last_became_active":"2023-12-22T10:01:34.688216+0000","last_became_peered":"2023-12-22T10:01:34.688216+0000","last_unstale":"2023-12-22T10:01:34.697326+0000","last_undegraded":"2023-12-22T10:01:34.697326+0000","last_fullsized":"2023-12-22T10:01:34.697326+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.676252+0000","last_change":"2023-12-22T10:00:28.031790+0000","last_active":"2023-12-22T10:01:34.676252+0000","last_peered":"2023-12-22T10:01:34.676252+0000","last_clean":"2023-12-22T10:01:34.676252+0000","last_became_active":"2023-12-22T10:00:28.031190+0000","last_became_peered":"2023-12-22T10:00:28.031190+0000","last_unstale":"2023-12-22T10:01:34.676252+0000","last_undegraded":"2023-12-22T10:01:34.676252+0000","last_fullsized":"2023-12-22T10:01:34.676252+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_clean_scrub_stamp":"2023-12-22T10:00:27.001906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-22T10:01:34.677278+0000","last_change":"2023-12-22T10:00:27.889031+0000","last_active":"2023-12-22T10:01:34.677278+0000","last_peered":"2023-12-22T10:01:34.677278+0000","last_clean":"2023-12-22T10:01:34.677278+0000","last_became_active":"2023-12-22T10:00:27.888164+0000","last_became_peered":"2023-12-22T10:00:27.888164+0000","last_unstale":"2023-12-22T10:01:34.677278+0000","last_undegraded":"2023-12-22T10:01:34.677278+0000","last_fullsized":"2023-12-22T10:01:34.677278+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:25.998963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:25.998963+0000","last_clean_scrub_stamp":"2023-12-22T10:00:25.998963+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297488,"kb_used_data":392,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074352,"statfs":{"total":96636764160,"available":96332136448,"internally_reserved":0,"allocated":401408,"data_stored":165311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 10:01:29 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.143,"15min":1.143},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.677,"5min":1.677,"15min":1.677},"last":1.4419999999999999},{"interface":"front","average":{"1min":1.161,"5min":1.161,"15min":1.161},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":1.409}]},{"osd":1,"last update":"Fri Dec 22 10:01:29 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.25,"15min":1.25},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.8899999999999999,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":0.89000000000000001},{"interface":"front","average":{"1min":1.337,"5min":1.337,"15min":1.337},"min":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":2.6819999999999999,"5min":2.6819999999999999,"15min":2.6819999999999999},"last":0.93000000000000005}]},{"osd":2,"last update":"Fri Dec 22 10:01:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":2.8490000000000002,"5min":2.8490000000000002,"15min":2.8490000000000002},"last":0.98599999999999999},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.774,"5min":1.774,"15min":1.774},"last":1.274}]},{"osd":3,"last update":"Fri Dec 22 10:01:29 2023","interfaces":[{"interface":"back","average":{"1min":1.321,"5min":1.321,"15min":1.321},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":2.3690000000000002,"5min":2.3690000000000002,"15min":2.3690000000000002},"last":1.244},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"min":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"max":{"1min":2.0899999999999999,"5min":2.0899999999999999,"15min":2.0899999999999999},"last":1.379}]},{"osd":4,"last update":"Fri Dec 22 10:01:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.764,"5min":1.764,"15min":1.764},"last":1.3100000000000001},{"interface":"front","average":{"1min":1.278,"5min":1.278,"15min":1.278},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":2.2930000000000001,"5min":2.2930000000000001,"15min":2.2930000000000001},"last":1.329}]},{"osd":5,"last update":"Fri Dec 22 10:01:29 2023","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.228,"15min":1.228},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.786,"5min":1.786,"15min":1.786},"last":1.4850000000000001},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":2.73,"5min":2.73,"15min":2.73},"last":1.526}]},{"osd":6,"last update":"Fri Dec 22 10:01:29 2023","interfaces":[{"interface":"back","average":{"1min":1.476,"5min":1.476,"15min":1.476},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":2.7690000000000001,"5min":2.7690000000000001,"15min":2.7690000000000001},"last":1.5960000000000001},{"interface":"front","average":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":2.8820000000000001,"5min":2.8820000000000001,"15min":2.8820000000000001},"last":1.5640000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297492,"kb_used_data":396,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074348,"statfs":{"total":96636764160,"available":96332132352,"internally_reserved":0,"allocated":405504,"data_stored":166167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.131,"15min":1.131},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":1.091},{"interface":"front","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.617,"5min":1.617,"15min":1.617},"last":1.2909999999999999}]},{"osd":1,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":0.92800000000000005},{"interface":"front","average":{"1min":1.085,"5min":1.085,"15min":1.085},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.657,"5min":1.657,"15min":1.657},"last":1.153}]},{"osd":2,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.077,"15min":1.077},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":0.98399999999999999},{"interface":"front","average":{"1min":1.145,"5min":1.145,"15min":1.145},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.583,"5min":1.583,"15min":1.583},"last":1.181}]},{"osd":3,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.262,"15min":1.262},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":1.3420000000000001},{"interface":"front","average":{"1min":1.252,"5min":1.252,"15min":1.252},"min":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":1.6359999999999999,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":1.4339999999999999}]},{"osd":4,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.282,"15min":1.282},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.7310000000000001,"5min":1.7310000000000001,"15min":1.7310000000000001},"last":1.2430000000000001},{"interface":"front","average":{"1min":1.361,"5min":1.361,"15min":1.361},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":2.2280000000000002,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":1.208}]},{"osd":5,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"min":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":1.907,"5min":1.907,"15min":1.907},"last":1.022},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":2.363,"5min":2.363,"15min":2.363},"last":0.95399999999999996}]},{"osd":7,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"min":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"max":{"1min":2.1459999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.363},{"interface":"front","average":{"1min":1.403,"5min":1.403,"15min":1.403},"min":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"max":{"1min":2.1779999999999999,"5min":2.1779999999999999,"15min":2.1779999999999999},"last":1.129}]}]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297484,"kb_used_data":388,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074356,"statfs":{"total":96636764160,"available":96332140544,"internally_reserved":0,"allocated":397312,"data_stored":165241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":1.2969999999999999},{"interface":"front","average":{"1min":1.123,"5min":1.123,"15min":1.123},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.6559999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":1.2270000000000001}]},{"osd":1,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.88900000000000001},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":2.0070000000000001,"5min":2.0070000000000001,"15min":2.0070000000000001},"last":0.84899999999999998}]},{"osd":2,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.98199999999999998},{"interface":"front","average":{"1min":1.119,"5min":1.119,"15min":1.119},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.607,"5min":1.607,"15min":1.607},"last":1.022}]},{"osd":3,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.133,"15min":1.133},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":1.1639999999999999},{"interface":"front","average":{"1min":1.179,"5min":1.179,"15min":1.179},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.488,"5min":1.488,"15min":1.488},"last":1.0609999999999999}]},{"osd":4,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.145,"15min":1.145},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":1.8779999999999999,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":1.1950000000000001},{"interface":"front","average":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"min":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":1.0840000000000001}]},{"osd":6,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.242,"15min":1.242},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.7749999999999999,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":1.216},{"interface":"front","average":{"1min":1.236,"5min":1.236,"15min":1.236},"min":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":1.369}]},{"osd":7,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.236,"15min":1.236},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":1.516,"5min":1.516,"15min":1.516},"last":1.2629999999999999},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.8620000000000001,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":1.1399999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":413696,"data_stored":166009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.149,"15min":1.149},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":0.80100000000000005},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"min":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.84099999999999997}]},{"osd":1,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":1.012,"15min":1.012},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":1.157},{"interface":"front","average":{"1min":1.077,"5min":1.077,"15min":1.077},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":1.2170000000000001}]},{"osd":2,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.641,"5min":1.641,"15min":1.641},"last":0.96099999999999997},{"interface":"front","average":{"1min":1.272,"5min":1.272,"15min":1.272},"min":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"max":{"1min":1.8340000000000001,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":1.0109999999999999}]},{"osd":3,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.173,"15min":1.173},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":1.7490000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":1.2430000000000001},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"min":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"max":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":1.3600000000000001}]},{"osd":5,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":1.216,"15min":1.216},"min":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"max":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":1.1399999999999999},{"interface":"front","average":{"1min":1.173,"5min":1.173,"15min":1.173},"min":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":1.9350000000000001,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":1.1759999999999999}]},{"osd":6,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":1.869,"5min":1.869,"15min":1.869},"last":1.2549999999999999},{"interface":"front","average":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"min":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"max":{"1min":1.9910000000000001,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":1.395}]},{"osd":7,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"min":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"max":{"1min":2.1960000000000002,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":1.4199999999999999},{"interface":"front","average":{"1min":1.391,"5min":1.391,"15min":1.391},"min":{"1min":1.044,"5min":1.044,"15min":1.044},"max":{"1min":1.8680000000000001,"5min":1.8680000000000001,"15min":1.8680000000000001},"last":1.4330000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297472,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074368,"statfs":{"total":96636764160,"available":96332152832,"internally_reserved":0,"allocated":385024,"data_stored":158062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 10:01:25 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.65400000000000003}]},{"osd":1,"last update":"Fri Dec 22 10:01:25 2023","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":1.034},{"interface":"front","average":{"1min":1.109,"5min":1.109,"15min":1.109},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":0.98399999999999999}]},{"osd":2,"last update":"Fri Dec 22 10:01:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":0.78500000000000003},{"interface":"front","average":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.702,"5min":1.702,"15min":1.702},"last":1.1200000000000001}]},{"osd":4,"last update":"Fri Dec 22 10:01:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.2,"15min":1.2},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":1.292},{"interface":"front","average":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":2.0619999999999998,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":1.222}]},{"osd":5,"last update":"Fri Dec 22 10:01:25 2023","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.333,"15min":1.333},"min":{"1min":0.878,"5min":0.878,"15min":0.878},"max":{"1min":1.9339999999999999,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":1.3260000000000001},{"interface":"front","average":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"min":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"max":{"1min":2.1720000000000002,"5min":2.1720000000000002,"15min":2.1720000000000002},"last":1.3460000000000001}]},{"osd":6,"last update":"Fri Dec 22 10:01:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.8640000000000001,"5min":1.8640000000000001,"15min":1.8640000000000001},"last":1.002},{"interface":"front","average":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":2.2130000000000001,"5min":2.2130000000000001,"15min":2.2130000000000001},"last":1.3939999999999999}]},{"osd":7,"last update":"Fri Dec 22 10:01:25 2023","interfaces":[{"interface":"back","average":{"1min":1.405,"5min":1.405,"15min":1.405},"min":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"max":{"1min":2.1389999999999998,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":1.254},{"interface":"front","average":{"1min":1.431,"5min":1.431,"15min":1.431},"min":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":2.105,"5min":2.105,"15min":2.105},"last":1.1890000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297496,"kb_used_data":400,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074344,"statfs":{"total":96636764160,"available":96332128256,"internally_reserved":0,"allocated":409600,"data_stored":166439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":1.0049999999999999},{"interface":"front","average":{"1min":1.083,"5min":1.083,"15min":1.083},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.83499999999999996}]},{"osd":1,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.52,"5min":1.52,"15min":1.52},"last":1.111},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":2.3809999999999998,"5min":2.3809999999999998,"15min":2.3809999999999998},"last":0.92800000000000005}]},{"osd":3,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.698,"5min":1.698,"15min":1.698},"last":0.71999999999999997},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.788,"5min":1.788,"15min":1.788},"last":0.74099999999999999}]},{"osd":4,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.381,"15min":1.381},"min":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"max":{"1min":2.234,"5min":2.234,"15min":2.234},"last":1.05},{"interface":"front","average":{"1min":1.296,"5min":1.296,"15min":1.296},"min":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"max":{"1min":2.1230000000000002,"5min":2.1230000000000002,"15min":2.1230000000000002},"last":0.95099999999999996}]},{"osd":5,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"min":{"1min":1.109,"5min":1.109,"15min":1.109},"max":{"1min":2.0960000000000001,"5min":2.0960000000000001,"15min":2.0960000000000001},"last":1.208},{"interface":"front","average":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"min":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"max":{"1min":1.9730000000000001,"5min":1.9730000000000001,"15min":1.9730000000000001},"last":1.194}]},{"osd":6,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"min":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"max":{"1min":2.298,"5min":2.298,"15min":2.298},"last":1.385},{"interface":"front","average":{"1min":1.46,"5min":1.46,"15min":1.46},"min":{"1min":1.02,"5min":1.02,"15min":1.02},"max":{"1min":1.899,"5min":1.899,"15min":1.899},"last":1.4099999999999999}]},{"osd":7,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.458,"5min":1.458,"15min":1.458},"min":{"1min":1,"5min":1,"15min":1},"max":{"1min":2.0289999999999999,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":1.4890000000000001},{"interface":"front","average":{"1min":1.415,"5min":1.415,"15min":1.415},"min":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"max":{"1min":2.0179999999999998,"5min":2.0179999999999998,"15min":2.0179999999999998},"last":1.264}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297496,"kb_used_data":400,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074344,"statfs":{"total":96636764160,"available":96332128256,"internally_reserved":0,"allocated":409600,"data_stored":166225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":1.21},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.97699999999999998}]},{"osd":2,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.82299999999999995},{"interface":"front","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":1.3400000000000001}]},{"osd":3,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":1.5760000000000001},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":1.089}]},{"osd":4,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":1.0129999999999999},{"interface":"front","average":{"1min":1.236,"5min":1.236,"15min":1.236},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":2.0710000000000002,"5min":2.0710000000000002,"15min":2.0710000000000002},"last":1.6719999999999999}]},{"osd":5,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"min":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"max":{"1min":1.8129999999999999,"5min":1.8129999999999999,"15min":1.8129999999999999},"last":1.8220000000000001},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"min":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"max":{"1min":1.881,"5min":1.881,"15min":1.881},"last":1.073}]},{"osd":6,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"min":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"max":{"1min":1.8779999999999999,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":1.887},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"min":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":1.946,"5min":1.946,"15min":1.946},"last":1.117}]},{"osd":7,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"min":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"max":{"1min":1.9279999999999999,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":1.899},{"interface":"front","average":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"min":{"1min":1.03,"5min":1.03,"15min":1.03},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":1.919}]}]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297492,"kb_used_data":396,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074348,"statfs":{"total":96636764160,"available":96332132352,"internally_reserved":0,"allocated":405504,"data_stored":165817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":2.7250000000000001,"5min":2.7250000000000001,"15min":2.7250000000000001},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.90700000000000003}]},{"osd":2,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":2.7799999999999998,"5min":2.7799999999999998,"15min":2.7799999999999998},"last":1.0820000000000001},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":1.109}]},{"osd":3,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":2.919,"5min":2.919,"15min":2.919},"last":1.1759999999999999},{"interface":"front","average":{"1min":1.248,"5min":1.248,"15min":1.248},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":2.8959999999999999,"5min":2.8959999999999999,"15min":2.8959999999999999},"last":1.1830000000000001}]},{"osd":4,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":1.74},{"interface":"front","average":{"1min":1.292,"5min":1.292,"15min":1.292},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":3.1280000000000001,"5min":3.1280000000000001,"15min":3.1280000000000001},"last":1.2929999999999999}]},{"osd":5,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"min":{"1min":0.87,"5min":0.87,"15min":0.87},"max":{"1min":3.0760000000000001,"5min":3.0760000000000001,"15min":3.0760000000000001},"last":1.135},{"interface":"front","average":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":2.512,"5min":2.512,"15min":2.512},"last":1.302}]},{"osd":6,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.5,"5min":1.5,"15min":1.5},"min":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"max":{"1min":2.8199999999999998,"5min":2.8199999999999998,"15min":2.8199999999999998},"last":1.3999999999999999},{"interface":"front","average":{"1min":1.51,"5min":1.51,"15min":1.51},"min":{"1min":1.032,"5min":1.032,"15min":1.032},"max":{"1min":4.6029999999999998,"5min":4.6029999999999998,"15min":4.6029999999999998},"last":1.8819999999999999}]},{"osd":7,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.417,"5min":1.417,"15min":1.417},"min":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"max":{"1min":2.0190000000000001,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":1.9830000000000001},{"interface":"front","average":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"min":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"max":{"1min":3.6339999999999999,"5min":3.6339999999999999,"15min":3.6339999999999999},"last":1.224}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-22T10:01:39.855 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-22T10:01:39.855 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-22T10:01:40.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.080+0000 7f5fb4ff9700 1 Processor -- start 2023-12-22T10:01:40.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.080+0000 7f5fb4ff9700 1 -- start start 2023-12-22T10:01:40.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.084+0000 7f5fb4ff9700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f5fb00691c0 0x7f5fb00ad080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:40.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.084+0000 7f5fb4ff9700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fb00c5810 con 0x7f5fb00acca0 2023-12-22T10:01:40.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.084+0000 7f5fb4ff9700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fb00c8d90 con 0x7f5fb00c9d20 2023-12-22T10:01:40.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.084+0000 7f5fb4ff9700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fb00c9350 con 0x7f5fb00691c0 2023-12-22T10:01:40.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.084+0000 7f5faf7fe700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f5fb00acca0 0x7f5fb0068ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:58796/0 (socket says 172.21.15.45:58796) 2023-12-22T10:01:40.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.088+0000 7f5faf7fe700 1 -- 172.21.15.45:0/4054497704 learned_addr learned my addr 172.21.15.45:0/4054497704 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:01:40.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.088+0000 7f5faeffd700 1 --2- 172.21.15.45:0/4054497704 >> v2:172.21.15.113:3300/0 conn(0x7f5fb00691c0 0x7f5fb00ad080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:40.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.088+0000 7f5fae7fc700 1 -- 172.21.15.45:0/4054497704 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 162351153 0 0) 0x7f5fb00c5810 con 0x7f5fb00acca0 2023-12-22T10:01:40.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.088+0000 7f5fae7fc700 1 -- 172.21.15.45:0/4054497704 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f980033f0 con 0x7f5fb00acca0 2023-12-22T10:01:40.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.088+0000 7f5fae7fc700 1 -- 172.21.15.45:0/4054497704 <== mon.1 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1801414165 0 0) 0x7f5fb00c8d90 con 0x7f5fb00c9d20 2023-12-22T10:01:40.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.088+0000 7f5fae7fc700 1 -- 172.21.15.45:0/4054497704 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fb00c5810 con 0x7f5fb00c9d20 2023-12-22T10:01:40.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.088+0000 7f5fae7fc700 1 -- 172.21.15.45:0/4054497704 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1539889179 0 0) 0x7f5f980033f0 con 0x7f5fb00acca0 2023-12-22T10:01:40.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.088+0000 7f5faeffd700 1 -- 172.21.15.45:0/4054497704 >> v1:172.21.15.113:6789/0 conn(0x7f5fb00c9d20 legacy=0x7f5fb00aa5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:40.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.088+0000 7f5faeffd700 1 -- 172.21.15.45:0/4054497704 >> v1:172.21.15.45:6789/0 conn(0x7f5fb00acca0 legacy=0x7f5fb0068ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:40.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.088+0000 7f5faeffd700 1 -- 172.21.15.45:0/4054497704 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fb0154070 con 0x7f5fb00691c0 2023-12-22T10:01:40.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.088+0000 7f5faeffd700 1 --2- 172.21.15.45:0/4054497704 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5fb00691c0 0x7f5fb00ad080 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f5fa4009760 tx=0x7f5fa4009060).ready entity=mon.1 client_cookie=74e0b426452586c3 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:40.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.088+0000 7f5fae7fc700 1 -- 172.21.15.45:0/4054497704 <== mon.1 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa0001470 con 0x7f5fb00691c0 2023-12-22T10:01:40.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.088+0000 7f5fae7fc700 1 -- 172.21.15.45:0/4054497704 <== mon.1 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fa4011400 con 0x7f5fb00691c0 2023-12-22T10:01:40.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.088+0000 7f5fae7fc700 1 -- 172.21.15.45:0/4054497704 <== mon.1 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa4011780 con 0x7f5fb00691c0 2023-12-22T10:01:40.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.088+0000 7f5fb4ff9700 1 -- 172.21.15.45:0/4054497704 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5fb00691c0 msgr2=0x7f5fb00ad080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:40.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.088+0000 7f5fb4ff9700 1 --2- 172.21.15.45:0/4054497704 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5fb00691c0 0x7f5fb00ad080 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f5fa4009760 tx=0x7f5fa4009060).stop 2023-12-22T10:01:40.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.088+0000 7f5fb4ff9700 1 -- 172.21.15.45:0/4054497704 shutdown_connections 2023-12-22T10:01:40.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.088+0000 7f5fb4ff9700 1 --2- 172.21.15.45:0/4054497704 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5fb00691c0 0x7f5fb00ad080 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:40.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.092+0000 7f5fb4ff9700 1 -- 172.21.15.45:0/4054497704 >> 172.21.15.45:0/4054497704 conn(0x7f5fb00674f0 msgr2=0x7f5fb00ca820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:40.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.092+0000 7f5fb4ff9700 1 -- 172.21.15.45:0/4054497704 shutdown_connections 2023-12-22T10:01:40.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.092+0000 7f5fb4ff9700 1 -- 172.21.15.45:0/4054497704 wait complete. 2023-12-22T10:01:40.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.092+0000 7f5fb4ff9700 1 Processor -- start 2023-12-22T10:01:40.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.092+0000 7f5fb4ff9700 1 -- start start 2023-12-22T10:01:40.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.096+0000 7f5fb4ff9700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f5fb00691c0 0x7f5fb0151ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:40.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.096+0000 7f5fb4ff9700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5fb00acca0 0x7f5fb00c0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:40.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.096+0000 7f5fb4ff9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5fb00c9d20 0x7f5fb00c0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:40.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.096+0000 7f5fb4ff9700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb0168350 con 0x7f5fb00c9d20 2023-12-22T10:01:40.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.096+0000 7f5fb4ff9700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb00c14d0 con 0x7f5fb00acca0 2023-12-22T10:01:40.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.096+0000 7f5fb4ff9700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb00ad990 con 0x7f5fb00691c0 2023-12-22T10:01:40.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.096+0000 7f5faffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5fb00c9d20 0x7f5fb00c0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:40.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.096+0000 7f5faf7fe700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f5fb00691c0 0x7f5fb0151ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:40.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.096+0000 7f5faeffd700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5fb00acca0 0x7f5fb00c0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:40.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.096+0000 7f5faeffd700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5fb00acca0 0x7f5fb00c0af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.45:41368/0 (socket says 172.21.15.45:41368) 2023-12-22T10:01:40.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.096+0000 7f5faeffd700 1 -- 172.21.15.45:0/2696726850 learned_addr learned my addr 172.21.15.45:0/2696726850 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:40.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.096+0000 7f5faffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5fb00c9d20 0x7f5fb00c0fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37066/0 (socket says 172.21.15.45:37066) 2023-12-22T10:01:40.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.096+0000 7f5faf7fe700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f5fb00691c0 0x7f5fb0151ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.113:3301/0 says I am v2:172.21.15.45:45470/0 (socket says 172.21.15.45:45470) 2023-12-22T10:01:40.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.096+0000 7f5faf7fe700 1 -- 172.21.15.45:0/2696726850 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5fb00acca0 msgr2=0x7f5fb00c0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:40.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.096+0000 7f5faf7fe700 1 --2- 172.21.15.45:0/2696726850 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5fb00acca0 0x7f5fb00c0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:40.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.096+0000 7f5faf7fe700 1 -- 172.21.15.45:0/2696726850 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5fb00c9d20 msgr2=0x7f5fb00c0fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:40.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.096+0000 7f5faf7fe700 1 --2- 172.21.15.45:0/2696726850 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5fb00c9d20 0x7f5fb00c0fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:40.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.096+0000 7f5faf7fe700 1 -- 172.21.15.45:0/2696726850 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fa40092a0 con 0x7f5fb00691c0 2023-12-22T10:01:40.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.096+0000 7f5faeffd700 1 --2- 172.21.15.45:0/2696726850 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5fb00acca0 0x7f5fb00c0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-12-22T10:01:40.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.096+0000 7f5faffff700 1 --2- 172.21.15.45:0/2696726850 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5fb00c9d20 0x7f5fb00c0fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-12-22T10:01:40.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.096+0000 7f5faf7fe700 1 --2- 172.21.15.45:0/2696726850 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f5fb00691c0 0x7f5fb0151ae0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f5fa00011e0 tx=0x7f5fa0001ad0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:40.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.096+0000 7f5f977fe700 1 -- 172.21.15.45:0/2696726850 <== mon.2 v2:172.21.15.113:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa0007170 con 0x7f5fb00691c0 2023-12-22T10:01:40.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.096+0000 7f5f977fe700 1 -- 172.21.15.45:0/2696726850 <== mon.2 v2:172.21.15.113:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fa0007310 con 0x7f5fb00691c0 2023-12-22T10:01:40.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.096+0000 7f5fb4ff9700 1 -- 172.21.15.45:0/2696726850 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fb00a1730 con 0x7f5fb00691c0 2023-12-22T10:01:40.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.096+0000 7f5f977fe700 1 -- 172.21.15.45:0/2696726850 <== mon.2 v2:172.21.15.113:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa00048c0 con 0x7f5fb00691c0 2023-12-22T10:01:40.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.096+0000 7f5fb4ff9700 1 -- 172.21.15.45:0/2696726850 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fb00a1cf0 con 0x7f5fb00691c0 2023-12-22T10:01:40.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.100+0000 7f5fb4ff9700 1 -- 172.21.15.45:0/2696726850 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fb0047060 con 0x7f5fb00691c0 2023-12-22T10:01:40.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.100+0000 7f5f977fe700 1 -- 172.21.15.45:0/2696726850 <== mon.2 v2:172.21.15.113:3301/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f5fa0004c30 con 0x7f5fb00691c0 2023-12-22T10:01:40.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.104+0000 7f5f977fe700 1 --2- 172.21.15.45:0/2696726850 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f5f9c05a560 0x7f5f9c05ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:40.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.104+0000 7f5f977fe700 1 -- 172.21.15.45:0/2696726850 <== mon.2 v2:172.21.15.113:3301/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f5fa0073ee0 con 0x7f5fb00691c0 2023-12-22T10:01:40.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.104+0000 7f5faeffd700 1 --2- 172.21.15.45:0/2696726850 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f5f9c05a560 0x7f5f9c05ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:40.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.104+0000 7f5faeffd700 1 --2- 172.21.15.45:0/2696726850 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f5f9c05a560 0x7f5f9c05ca20 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f5fb0156630 tx=0x7f5fa4016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:40.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.112+0000 7f5f977fe700 1 -- 172.21.15.45:0/2696726850 <== mon.2 v2:172.21.15.113:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f5fa0047760 con 0x7f5fb00691c0 2023-12-22T10:01:40.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.332+0000 7f5fb4ff9700 1 -- 172.21.15.45:0/2696726850 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f5fb00c5a60 con 0x7f5fb00691c0 2023-12-22T10:01:40.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.344+0000 7f5f977fe700 1 -- 172.21.15.45:0/2696726850 <== mon.2 v2:172.21.15.113:3301/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+0 (secure 0 0 0) 0x7f5fa0019030 con 0x7f5fb00691c0 2023-12-22T10:01:40.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.348+0000 7f5fb4ff9700 1 -- 172.21.15.45:0/2696726850 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f5f9c05a560 msgr2=0x7f5f9c05ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:40.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.348+0000 7f5fb4ff9700 1 --2- 172.21.15.45:0/2696726850 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f5f9c05a560 0x7f5f9c05ca20 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f5fb0156630 tx=0x7f5fa4016000).stop 2023-12-22T10:01:40.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.348+0000 7f5fb4ff9700 1 -- 172.21.15.45:0/2696726850 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f5fb00691c0 msgr2=0x7f5fb0151ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:40.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.348+0000 7f5fb4ff9700 1 --2- 172.21.15.45:0/2696726850 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f5fb00691c0 0x7f5fb0151ae0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f5fa00011e0 tx=0x7f5fa0001ad0).stop 2023-12-22T10:01:40.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.348+0000 7f5fb4ff9700 1 -- 172.21.15.45:0/2696726850 shutdown_connections 2023-12-22T10:01:40.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.348+0000 7f5fb4ff9700 1 --2- 172.21.15.45:0/2696726850 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5fb00c9d20 0x7f5fb00c0fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:40.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.348+0000 7f5fb4ff9700 1 --2- 172.21.15.45:0/2696726850 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5fb00acca0 0x7f5fb00c0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:40.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.348+0000 7f5fb4ff9700 1 --2- 172.21.15.45:0/2696726850 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f5f9c05a560 0x7f5f9c05ca20 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:40.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.348+0000 7f5fb4ff9700 1 --2- 172.21.15.45:0/2696726850 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f5fb00691c0 0x7f5fb0151ae0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:40.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.348+0000 7f5fb4ff9700 1 -- 172.21.15.45:0/2696726850 >> 172.21.15.45:0/2696726850 conn(0x7f5fb00674f0 msgr2=0x7f5fb00c38d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:40.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.348+0000 7f5fb4ff9700 1 -- 172.21.15.45:0/2696726850 shutdown_connections 2023-12-22T10:01:40.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.348+0000 7f5fb4ff9700 1 -- 172.21.15.45:0/2696726850 wait complete. 2023-12-22T10:01:40.349 INFO:teuthology.orchestra.run.smithi045.stderr:updated caps for client.0 2023-12-22T10:01:40.368 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T10:01:40.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.536+0000 7fc498839700 1 Processor -- start 2023-12-22T10:01:40.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.536+0000 7fc498839700 1 -- start start 2023-12-22T10:01:40.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.540+0000 7fc498839700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc49414fd40 0x7fc494150120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:40.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.540+0000 7fc498839700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc494065890 0x7fc494069490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:40.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.540+0000 7fc498839700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4940c1cc0 con 0x7fc4940645b0 2023-12-22T10:01:40.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.540+0000 7fc498839700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4940c1fa0 con 0x7fc49414fd40 2023-12-22T10:01:40.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.540+0000 7fc498839700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4940c2280 con 0x7fc494065890 2023-12-22T10:01:40.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.540+0000 7fc4937fe700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc49414fd40 0x7fc494150120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:40.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.540+0000 7fc493fff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fc4940645b0 0x7fc494153b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:58812/0 (socket says 172.21.15.45:58812) 2023-12-22T10:01:40.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.540+0000 7fc4937fe700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc49414fd40 0x7fc494150120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37070/0 (socket says 172.21.15.45:37070) 2023-12-22T10:01:40.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.540+0000 7fc493fff700 1 -- 172.21.15.45:0/2835632378 learned_addr learned my addr 172.21.15.45:0/2835632378 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:01:40.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.540+0000 7fc48affd700 1 --2- 172.21.15.45:0/2835632378 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc494065890 0x7fc494069490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:40.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.540+0000 7fc4937fe700 1 -- 172.21.15.45:0/2835632378 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc494065890 msgr2=0x7fc494069490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:40.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.540+0000 7fc4937fe700 1 --2- 172.21.15.45:0/2835632378 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc494065890 0x7fc494069490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:40.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.540+0000 7fc4937fe700 1 -- 172.21.15.45:0/2835632378 >> v1:172.21.15.45:6789/0 conn(0x7fc4940645b0 legacy=0x7fc494153b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:40.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.540+0000 7fc4937fe700 1 -- 172.21.15.45:0/2835632378 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4940c2560 con 0x7fc49414fd40 2023-12-22T10:01:40.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.540+0000 7fc492ffd700 1 -- 172.21.15.45:0/2835632378 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 67567636 0 0) 0x7fc4940c1cc0 con 0x7fc4940645b0 2023-12-22T10:01:40.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.540+0000 7fc4937fe700 1 --2- 172.21.15.45:0/2835632378 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc49414fd40 0x7fc494150120 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7fc484009760 tx=0x7fc484009060).ready entity=mon.0 client_cookie=ecd5b045cefc8b4e server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:40.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.540+0000 7fc492ffd700 1 -- 172.21.15.45:0/2835632378 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc48400f510 con 0x7fc49414fd40 2023-12-22T10:01:40.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.540+0000 7fc492ffd700 1 -- 172.21.15.45:0/2835632378 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc48400f670 con 0x7fc49414fd40 2023-12-22T10:01:40.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.544+0000 7fc492ffd700 1 -- 172.21.15.45:0/2835632378 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc48400f9f0 con 0x7fc49414fd40 2023-12-22T10:01:40.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.544+0000 7fc498839700 1 -- 172.21.15.45:0/2835632378 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc49414fd40 msgr2=0x7fc494150120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:40.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.544+0000 7fc498839700 1 --2- 172.21.15.45:0/2835632378 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc49414fd40 0x7fc494150120 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7fc484009760 tx=0x7fc484009060).stop 2023-12-22T10:01:40.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.544+0000 7fc498839700 1 -- 172.21.15.45:0/2835632378 shutdown_connections 2023-12-22T10:01:40.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.544+0000 7fc498839700 1 --2- 172.21.15.45:0/2835632378 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc494065890 0x7fc494069490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:40.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.544+0000 7fc498839700 1 --2- 172.21.15.45:0/2835632378 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc49414fd40 0x7fc494150120 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:40.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.544+0000 7fc498839700 1 -- 172.21.15.45:0/2835632378 >> 172.21.15.45:0/2835632378 conn(0x7fc494067540 msgr2=0x7fc4940c6460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:40.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.544+0000 7fc498839700 1 -- 172.21.15.45:0/2835632378 shutdown_connections 2023-12-22T10:01:40.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.544+0000 7fc498839700 1 -- 172.21.15.45:0/2835632378 wait complete. 2023-12-22T10:01:40.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.548+0000 7fc498839700 1 Processor -- start 2023-12-22T10:01:40.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.548+0000 7fc498839700 1 -- start start 2023-12-22T10:01:40.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.548+0000 7fc498839700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc4940645b0 0x7fc4941465f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:40.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.548+0000 7fc498839700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc494065890 0x7fc494151dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:40.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.548+0000 7fc498839700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc49414fd40 0x7fc4941522b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:40.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.548+0000 7fc498839700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4941527a0 con 0x7fc4940645b0 2023-12-22T10:01:40.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.548+0000 7fc498839700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc494151080 con 0x7fc49414fd40 2023-12-22T10:01:40.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.548+0000 7fc498839700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc494151510 con 0x7fc494065890 2023-12-22T10:01:40.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.548+0000 7fc4937fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc4940645b0 0x7fc4941465f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:40.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.548+0000 7fc4937fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc4940645b0 0x7fc4941465f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37074/0 (socket says 172.21.15.45:37074) 2023-12-22T10:01:40.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.548+0000 7fc4937fe700 1 -- 172.21.15.45:0/105881751 learned_addr learned my addr 172.21.15.45:0/105881751 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:40.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.548+0000 7fc48affd700 1 --2- 172.21.15.45:0/105881751 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc494065890 0x7fc494151dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:40.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.548+0000 7fc493fff700 1 --2- 172.21.15.45:0/105881751 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc49414fd40 0x7fc4941522b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:40.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.548+0000 7fc4937fe700 1 -- 172.21.15.45:0/105881751 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc494065890 msgr2=0x7fc494151dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:40.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.548+0000 7fc4937fe700 1 --2- 172.21.15.45:0/105881751 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc494065890 0x7fc494151dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:40.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.548+0000 7fc4937fe700 1 -- 172.21.15.45:0/105881751 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc49414fd40 msgr2=0x7fc4941522b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:40.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.548+0000 7fc4937fe700 1 --2- 172.21.15.45:0/105881751 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc49414fd40 0x7fc4941522b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:40.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.548+0000 7fc4937fe700 1 -- 172.21.15.45:0/105881751 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4840092a0 con 0x7fc4940645b0 2023-12-22T10:01:40.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.548+0000 7fc4937fe700 1 --2- 172.21.15.45:0/105881751 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc4940645b0 0x7fc4941465f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7fc494068810 tx=0x7fc484017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:40.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.552+0000 7fc48bfff700 1 -- 172.21.15.45:0/105881751 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc48400f7e0 con 0x7fc4940645b0 2023-12-22T10:01:40.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.552+0000 7fc48bfff700 1 -- 172.21.15.45:0/105881751 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc48400f960 con 0x7fc4940645b0 2023-12-22T10:01:40.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.552+0000 7fc48bfff700 1 -- 172.21.15.45:0/105881751 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc48401b660 con 0x7fc4940645b0 2023-12-22T10:01:40.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.552+0000 7fc498839700 1 -- 172.21.15.45:0/105881751 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc494150470 con 0x7fc4940645b0 2023-12-22T10:01:40.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.552+0000 7fc498839700 1 -- 172.21.15.45:0/105881751 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc494150a30 con 0x7fc4940645b0 2023-12-22T10:01:40.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.552+0000 7fc498839700 1 -- 172.21.15.45:0/105881751 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc49405ed70 con 0x7fc4940645b0 2023-12-22T10:01:40.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.552+0000 7fc48bfff700 1 -- 172.21.15.45:0/105881751 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fc48401b9d0 con 0x7fc4940645b0 2023-12-22T10:01:40.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.556+0000 7fc48bfff700 1 --2- 172.21.15.45:0/105881751 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fc47405a540 0x7fc47405ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:40.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.556+0000 7fc48bfff700 1 -- 172.21.15.45:0/105881751 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fc484076380 con 0x7fc4940645b0 2023-12-22T10:01:40.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.556+0000 7fc48affd700 1 --2- 172.21.15.45:0/105881751 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fc47405a540 0x7fc47405ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:40.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.556+0000 7fc48affd700 1 --2- 172.21.15.45:0/105881751 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fc47405a540 0x7fc47405ca00 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7fc494153630 tx=0x7fc47c008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:40.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.564+0000 7fc48bfff700 1 -- 172.21.15.45:0/105881751 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc49405ed70 con 0x7fc4940645b0 2023-12-22T10:01:40.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.764+0000 7fc498839700 1 -- 172.21.15.45:0/105881751 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc494064f50 con 0x7fc4940645b0 2023-12-22T10:01:40.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.768+0000 7fc48bfff700 1 -- 172.21.15.45:0/105881751 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4492 (secure 0 0 0) 0x7fc494064f50 con 0x7fc4940645b0 2023-12-22T10:01:40.766 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:01:40.766 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4733,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6833/2948398569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6832","nonce":2948398569},{"type":"v1","addr":"172.21.15.113:6833","nonce":2948398569}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4736,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6835/1576156444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":1576156444},{"type":"v1","addr":"172.21.15.113:6835","nonce":1576156444}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4742,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/249598849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":249598849},{"type":"v1","addr":"172.21.15.45:6837","nonce":249598849}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T10:01:35.105595+0000","modified":"2023-12-22T10:01:38.130062+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4980},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4980":{"gid":4980,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.45:6835/1879154206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1879154206},{"type":"v1","addr":"172.21.15.45:6835","nonce":1879154206}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-12-22T10:01:40.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.768+0000 7fc498839700 1 -- 172.21.15.45:0/105881751 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fc47405a540 msgr2=0x7fc47405ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:40.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.768+0000 7fc498839700 1 --2- 172.21.15.45:0/105881751 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fc47405a540 0x7fc47405ca00 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7fc494153630 tx=0x7fc47c008040).stop 2023-12-22T10:01:40.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.768+0000 7fc498839700 1 -- 172.21.15.45:0/105881751 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc4940645b0 msgr2=0x7fc4941465f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:40.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.768+0000 7fc498839700 1 --2- 172.21.15.45:0/105881751 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc4940645b0 0x7fc4941465f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7fc494068810 tx=0x7fc484017000).stop 2023-12-22T10:01:40.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.768+0000 7fc498839700 1 -- 172.21.15.45:0/105881751 shutdown_connections 2023-12-22T10:01:40.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.768+0000 7fc498839700 1 --2- 172.21.15.45:0/105881751 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc49414fd40 0x7fc4941522b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:40.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.768+0000 7fc498839700 1 --2- 172.21.15.45:0/105881751 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fc47405a540 0x7fc47405ca00 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:40.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.768+0000 7fc498839700 1 --2- 172.21.15.45:0/105881751 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc494065890 0x7fc494151dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:40.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.768+0000 7fc498839700 1 --2- 172.21.15.45:0/105881751 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc4940645b0 0x7fc4941465f0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:40.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.768+0000 7fc498839700 1 -- 172.21.15.45:0/105881751 >> 172.21.15.45:0/105881751 conn(0x7fc494067540 msgr2=0x7fc4940ab790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:40.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.768+0000 7fc498839700 1 -- 172.21.15.45:0/105881751 shutdown_connections 2023-12-22T10:01:40.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:40.768+0000 7fc498839700 1 -- 172.21.15.45:0/105881751 wait complete. 2023-12-22T10:01:40.771 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 16 2023-12-22T10:01:41.192 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-22T10:01:35.105595+0000', 'modified': '2023-12-22T10:01:38.130062+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4980}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4980': {'gid': 4980, 'name': 'c', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.45:6835/1879154206', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.45:6834', 'nonce': 1879154206}, {'type': 'v1', 'addr': '172.21.15.45:6835', 'nonce': 1879154206}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-12-22T10:01:41.192 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-22T10:01:41.192 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-12-22T10:01:41.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.372+0000 7f588e21b700 1 Processor -- start 2023-12-22T10:01:41.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.372+0000 7f588e21b700 1 -- start start 2023-12-22T10:01:41.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.376+0000 7f588e21b700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f58880c7b40 0x7f58881580d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:41.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.376+0000 7f588e21b700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58880c9720 con 0x7f58880c5900 2023-12-22T10:01:41.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.376+0000 7f588e21b700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5888153ec0 con 0x7f58880ac5c0 2023-12-22T10:01:41.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.376+0000 7f588e21b700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58881585c0 con 0x7f58880c7b40 2023-12-22T10:01:41.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.376+0000 7f587effd700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f58880c5900 0x7f58880c7430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:58816/0 (socket says 172.21.15.45:58816) 2023-12-22T10:01:41.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.376+0000 7f587effd700 1 -- 172.21.15.45:0/4271608447 learned_addr learned my addr 172.21.15.45:0/4271608447 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:01:41.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.376+0000 7f5887fff700 1 --2- 172.21.15.45:0/4271608447 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f58880c7b40 0x7f58881580d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:41.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.376+0000 7f5886ffd700 1 -- 172.21.15.45:0/4271608447 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 19595438 0 0) 0x7f58880c9720 con 0x7f58880c5900 2023-12-22T10:01:41.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.376+0000 7f5886ffd700 1 -- 172.21.15.45:0/4271608447 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58740033f0 con 0x7f58880c5900 2023-12-22T10:01:41.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.376+0000 7f5886ffd700 1 -- 172.21.15.45:0/4271608447 <== mon.1 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1959524985 0 0) 0x7f5888153ec0 con 0x7f58880ac5c0 2023-12-22T10:01:41.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.376+0000 7f5886ffd700 1 -- 172.21.15.45:0/4271608447 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58880c9720 con 0x7f58880ac5c0 2023-12-22T10:01:41.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.376+0000 7f5887fff700 1 -- 172.21.15.45:0/4271608447 >> v1:172.21.15.113:6789/0 conn(0x7f58880ac5c0 legacy=0x7f58880aa660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:41.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.376+0000 7f5887fff700 1 -- 172.21.15.45:0/4271608447 >> v1:172.21.15.45:6789/0 conn(0x7f58880c5900 legacy=0x7f58880c7430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:41.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.376+0000 7f5886ffd700 1 -- 172.21.15.45:0/4271608447 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3963418219 0 0) 0x7f58740033f0 con 0x7f58880c5900 2023-12-22T10:01:41.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.376+0000 7f5887fff700 1 -- 172.21.15.45:0/4271608447 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58880c5d60 con 0x7f58880c7b40 2023-12-22T10:01:41.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.376+0000 7f5887fff700 1 --2- 172.21.15.45:0/4271608447 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f58880c7b40 0x7f58881580d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f5880009790 tx=0x7f5880009060).ready entity=mon.2 client_cookie=9a47ca0bd526f544 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:41.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.380+0000 7f5886ffd700 1 -- 172.21.15.45:0/4271608447 <== mon.2 v2:172.21.15.113:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5870001470 con 0x7f58880c7b40 2023-12-22T10:01:41.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.380+0000 7f5886ffd700 1 -- 172.21.15.45:0/4271608447 <== mon.2 v2:172.21.15.113:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5880011400 con 0x7f58880c7b40 2023-12-22T10:01:41.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.380+0000 7f5886ffd700 1 -- 172.21.15.45:0/4271608447 <== mon.2 v2:172.21.15.113:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5880011780 con 0x7f58880c7b40 2023-12-22T10:01:41.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.380+0000 7f588e21b700 1 -- 172.21.15.45:0/4271608447 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f58880c7b40 msgr2=0x7f58881580d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:41.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.380+0000 7f588e21b700 1 --2- 172.21.15.45:0/4271608447 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f58880c7b40 0x7f58881580d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f5880009790 tx=0x7f5880009060).stop 2023-12-22T10:01:41.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.380+0000 7f588e21b700 1 -- 172.21.15.45:0/4271608447 shutdown_connections 2023-12-22T10:01:41.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.380+0000 7f588e21b700 1 --2- 172.21.15.45:0/4271608447 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f58880c7b40 0x7f58881580d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:41.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.380+0000 7f588e21b700 1 -- 172.21.15.45:0/4271608447 >> 172.21.15.45:0/4271608447 conn(0x7f5888082a30 msgr2=0x7f5888066a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:41.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.380+0000 7f588e21b700 1 -- 172.21.15.45:0/4271608447 shutdown_connections 2023-12-22T10:01:41.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.380+0000 7f588e21b700 1 -- 172.21.15.45:0/4271608447 wait complete. 2023-12-22T10:01:41.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.384+0000 7f588e21b700 1 Processor -- start 2023-12-22T10:01:41.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.384+0000 7f588e21b700 1 -- start start 2023-12-22T10:01:41.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.384+0000 7f588e21b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58880ac5c0 0x7f5888151850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:41.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.384+0000 7f588e21b700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f58880c5900 0x7f58880c1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:41.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.384+0000 7f588e21b700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f58880c7b40 0x7f58880c21e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:41.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.384+0000 7f588e21b700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58880c26d0 con 0x7f58880ac5c0 2023-12-22T10:01:41.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.384+0000 7f588e21b700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5888154f70 con 0x7f58880c5900 2023-12-22T10:01:41.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.384+0000 7f588e21b700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58880cb530 con 0x7f58880c7b40 2023-12-22T10:01:41.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.384+0000 7f58877fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58880ac5c0 0x7f5888151850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:41.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.384+0000 7f58877fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58880ac5c0 0x7f5888151850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37090/0 (socket says 172.21.15.45:37090) 2023-12-22T10:01:41.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.384+0000 7f58877fe700 1 -- 172.21.15.45:0/3333712142 learned_addr learned my addr 172.21.15.45:0/3333712142 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:41.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.384+0000 7f587effd700 1 --2- 172.21.15.45:0/3333712142 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f58880c5900 0x7f58880c1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:41.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.384+0000 7f5887fff700 1 --2- 172.21.15.45:0/3333712142 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f58880c7b40 0x7f58880c21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:41.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.388+0000 7f58877fe700 1 -- 172.21.15.45:0/3333712142 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f58880c7b40 msgr2=0x7f58880c21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:41.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.388+0000 7f58877fe700 1 --2- 172.21.15.45:0/3333712142 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f58880c7b40 0x7f58880c21e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:41.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.388+0000 7f58877fe700 1 -- 172.21.15.45:0/3333712142 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f58880c5900 msgr2=0x7f58880c1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:41.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.388+0000 7f58877fe700 1 --2- 172.21.15.45:0/3333712142 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f58880c5900 0x7f58880c1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:41.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.388+0000 7f58877fe700 1 -- 172.21.15.45:0/3333712142 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58800092a0 con 0x7f58880ac5c0 2023-12-22T10:01:41.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.388+0000 7f58877fe700 1 --2- 172.21.15.45:0/3333712142 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58880ac5c0 0x7f5888151850 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7f587800c840 tx=0x7f58780026f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:41.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.388+0000 7f587ffff700 1 -- 172.21.15.45:0/3333712142 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5878010510 con 0x7f58880ac5c0 2023-12-22T10:01:41.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.388+0000 7f587ffff700 1 -- 172.21.15.45:0/3333712142 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5878010670 con 0x7f58880ac5c0 2023-12-22T10:01:41.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.388+0000 7f588e21b700 1 -- 172.21.15.45:0/3333712142 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58880ca920 con 0x7f58880ac5c0 2023-12-22T10:01:41.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.388+0000 7f587ffff700 1 -- 172.21.15.45:0/3333712142 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5878010a10 con 0x7f58880ac5c0 2023-12-22T10:01:41.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.388+0000 7f588e21b700 1 -- 172.21.15.45:0/3333712142 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58880caee0 con 0x7f58880ac5c0 2023-12-22T10:01:41.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.392+0000 7f587ffff700 1 -- 172.21.15.45:0/3333712142 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f587801b400 con 0x7f58880ac5c0 2023-12-22T10:01:41.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.392+0000 7f587ffff700 1 --2- 172.21.15.45:0/3333712142 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f586805a510 0x7f586805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:41.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.392+0000 7f587ffff700 1 -- 172.21.15.45:0/3333712142 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f5878074670 con 0x7f58880ac5c0 2023-12-22T10:01:41.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.392+0000 7f587effd700 1 --2- 172.21.15.45:0/3333712142 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f586805a510 0x7f586805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:41.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.392+0000 7f587effd700 1 --2- 172.21.15.45:0/3333712142 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f586805a510 0x7f586805c9d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f58880c3e40 tx=0x7f5870001990).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:41.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.396+0000 7f58985ad740 1 Processor -- start 2023-12-22T10:01:41.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.396+0000 7f58985ad740 1 -- start start 2023-12-22T10:01:41.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.396+0000 7f58985ad740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0xc4b300 0xc925b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:41.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.396+0000 7f58985ad740 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0xc4a510 0xc4b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:41.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.396+0000 7f58985ad740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0xc90ab0 0xc90f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:41.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.396+0000 7f58985ad740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0xbcb410 con 0xc4b300 2023-12-22T10:01:41.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.396+0000 7f58985ad740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0xbcb550 con 0xc90ab0 2023-12-22T10:01:41.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.396+0000 7f58985ad740 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0xbcba00 con 0xc4a510 2023-12-22T10:01:41.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.396+0000 7f58877fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0xc4b300 0xc925b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:41.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.396+0000 7f58877fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0xc4b300 0xc925b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37096/0 (socket says 172.21.15.45:37096) 2023-12-22T10:01:41.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.396+0000 7f58877fe700 1 -- 172.21.15.45:0/80895580 learned_addr learned my addr 172.21.15.45:0/80895580 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:41.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.396+0000 7f587effd700 1 --2- 172.21.15.45:0/80895580 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0xc4a510 0xc4b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:41.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.396+0000 7f5887fff700 1 --2- 172.21.15.45:0/80895580 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0xc90ab0 0xc90f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:41.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.396+0000 7f58877fe700 1 -- 172.21.15.45:0/80895580 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0xc4a510 msgr2=0xc4b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:41.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.396+0000 7f58877fe700 1 --2- 172.21.15.45:0/80895580 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0xc4a510 0xc4b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:41.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.396+0000 7f58877fe700 1 -- 172.21.15.45:0/80895580 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0xc90ab0 msgr2=0xc90f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:41.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.396+0000 7f58877fe700 1 --2- 172.21.15.45:0/80895580 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0xc90ab0 0xc90f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:41.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.396+0000 7f58877fe700 1 -- 172.21.15.45:0/80895580 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xbc4730 con 0xc4b300 2023-12-22T10:01:41.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.400+0000 7f58877fe700 1 --2- 172.21.15.45:0/80895580 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0xc4b300 0xc925b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7f587804b8d0 tx=0x7f587800f000).ready entity=mon.0 client_cookie=8f6b6ee16ecdd057 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:41.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.400+0000 7f587cff9700 1 -- 172.21.15.45:0/80895580 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5878010dc0 con 0xc4b300 2023-12-22T10:01:41.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.400+0000 7f587cff9700 1 -- 172.21.15.45:0/80895580 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5878049d90 con 0xc4b300 2023-12-22T10:01:41.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.400+0000 7f587cff9700 1 -- 172.21.15.45:0/80895580 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5878072700 con 0xc4b300 2023-12-22T10:01:41.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.400+0000 7f58985ad740 1 -- 172.21.15.45:0/80895580 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0xc4b300 msgr2=0xc925b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:41.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.400+0000 7f58985ad740 1 --2- 172.21.15.45:0/80895580 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0xc4b300 0xc925b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7f587804b8d0 tx=0x7f587800f000).stop 2023-12-22T10:01:41.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.400+0000 7f58985ad740 1 -- 172.21.15.45:0/80895580 shutdown_connections 2023-12-22T10:01:41.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.400+0000 7f58985ad740 1 --2- 172.21.15.45:0/80895580 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0xc90ab0 0xc90f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:41.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.400+0000 7f58985ad740 1 --2- 172.21.15.45:0/80895580 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0xc4a510 0xc4b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:41.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.400+0000 7f58985ad740 1 --2- 172.21.15.45:0/80895580 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0xc4b300 0xc925b0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:41.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.400+0000 7f58985ad740 1 -- 172.21.15.45:0/80895580 >> 172.21.15.45:0/80895580 conn(0xa29550 msgr2=0xc91a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:41.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.400+0000 7f58985ad740 1 -- 172.21.15.45:0/80895580 shutdown_connections 2023-12-22T10:01:41.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.400+0000 7f58985ad740 1 -- 172.21.15.45:0/80895580 wait complete. 2023-12-22T10:01:41.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.400+0000 7f58985ad740 1 -- start start 2023-12-22T10:01:41.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.400+0000 7f58985ad740 1 Processor -- start 2023-12-22T10:01:41.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.404+0000 7f58985ad740 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0xc4a510 0xca0c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:41.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.404+0000 7f58985ad740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0xc4b300 0xc90f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:41.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.404+0000 7f58985ad740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0xc90ab0 0xc91420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:41.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.404+0000 7f58985ad740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0xb96650 con 0xc90ab0 2023-12-22T10:01:41.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.404+0000 7f58985ad740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0xca1bb0 con 0xc4b300 2023-12-22T10:01:41.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.404+0000 7f58985ad740 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0xc91910 con 0xc4a510 2023-12-22T10:01:41.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.404+0000 7f58985ad740 10 client.0 ll_register_callbacks cb 0xc03020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-22T10:01:41.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.404+0000 7f5887fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0xc90ab0 0xc91420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:41.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.404+0000 7f5887fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0xc90ab0 0xc91420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37104/0 (socket says 172.21.15.45:37104) 2023-12-22T10:01:41.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.404+0000 7f5887fff700 1 -- 172.21.15.45:0/3457278288 learned_addr learned my addr 172.21.15.45:0/3457278288 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:41.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.404+0000 7f587effd700 1 --2- 172.21.15.45:0/3457278288 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0xc4b300 0xc90f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:41.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.404+0000 7f58877fe700 1 --2- 172.21.15.45:0/3457278288 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0xc4a510 0xca0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:41.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.404+0000 7f5887fff700 1 -- 172.21.15.45:0/3457278288 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0xc4a510 msgr2=0xca0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:41.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.404+0000 7f5887fff700 1 --2- 172.21.15.45:0/3457278288 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0xc4a510 0xca0c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:41.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.404+0000 7f5887fff700 1 -- 172.21.15.45:0/3457278288 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0xc4b300 msgr2=0xc90f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:41.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.404+0000 7f5887fff700 1 --2- 172.21.15.45:0/3457278288 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0xc4b300 0xc90f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:41.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.404+0000 7f5887fff700 1 -- 172.21.15.45:0/3457278288 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58880caee0 con 0xc90ab0 2023-12-22T10:01:41.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.404+0000 7f58877fe700 1 --2- 172.21.15.45:0/3457278288 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0xc4a510 0xca0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T10:01:41.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.404+0000 7f5887fff700 1 --2- 172.21.15.45:0/3457278288 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0xc90ab0 0xc91420 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7f5880006d30 tx=0x7f5880016000).ready entity=mon.0 client_cookie=abcb213e1abd1354 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:41.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.404+0000 7f5865ffb700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-12-22T10:01:41.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.404+0000 7f5865ffb700 1 -- 172.21.15.45:0/3457278288 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5880006ad0 con 0xc90ab0 2023-12-22T10:01:41.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.404+0000 7f5865ffb700 1 -- 172.21.15.45:0/3457278288 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(36..36 src has 1..36) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f588001f800 con 0xc90ab0 2023-12-22T10:01:41.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.404+0000 7f58985ad740 1 -- 172.21.15.45:0/3457278288 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0xbc11a0 con 0xc90ab0 2023-12-22T10:01:41.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.404+0000 7f5865ffb700 1 -- 172.21.15.45:0/3457278288 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f588001fbd0 con 0xc90ab0 2023-12-22T10:01:41.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.404+0000 7f58985ad740 10 client.5181 fetch_fsmap learned FSMap version 16 2023-12-22T10:01:41.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.408+0000 7f58985ad740 1 -- 172.21.15.45:0/3457278288 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0xbbf960 con 0xc90ab0 2023-12-22T10:01:41.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.408+0000 7f5865ffb700 1 -- 172.21.15.45:0/3457278288 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0xbc11a0 con 0xc90ab0 2023-12-22T10:01:41.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.408+0000 7f5865ffb700 1 -- 172.21.15.45:0/3457278288 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 16) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f58800097c0 con 0xc90ab0 2023-12-22T10:01:41.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.408+0000 7f58985ad740 10 client.5181 fetch_fsmap finished waiting for FSMap version 16 2023-12-22T10:01:41.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.408+0000 7f58985ad740 10 client.5181 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-22T10:01:41.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.408+0000 7f58985ad740 20 client.5181 populate_metadata read hostname 'smithi045' 2023-12-22T10:01:41.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.408+0000 7f58985ad740 1 --2- 172.21.15.45:0/3457278288 >> [v2:172.21.15.45:6834/1879154206,v1:172.21.15.45:6835/1879154206] conn(0xc6e650 0xc74dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:41.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.408+0000 7f58985ad740 4 client.5181 mds_command: new command op to 4980 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-22T10:01:41.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.408+0000 7f58985ad740 1 -- 172.21.15.45:0/3457278288 --> [v2:172.21.15.45:6834/1879154206,v1:172.21.15.45:6835/1879154206] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0xbb76f0 con 0xc6e650 2023-12-22T10:01:41.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.408+0000 7f58877fe700 1 --2- 172.21.15.45:0/3457278288 >> [v2:172.21.15.45:6834/1879154206,v1:172.21.15.45:6835/1879154206] conn(0xc6e650 0xc74dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:41.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.408+0000 7f58877fe700 1 --2- 172.21.15.45:0/3457278288 >> [v2:172.21.15.45:6834/1879154206,v1:172.21.15.45:6835/1879154206] conn(0xc6e650 0xc74dd0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=d2a43c86ee75fc94 server_cookie=b36ef8dba76f0731 in_seq=0 out_seq=0 2023-12-22T10:01:41.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.408+0000 7f5865ffb700 10 client.5181 ms_handle_connect on v2:172.21.15.45:6834/1879154206 2023-12-22T10:01:41.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.408+0000 7f5865ffb700 1 -- 172.21.15.45:0/3457278288 <== mds.0 v2:172.21.15.45:6834/1879154206 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0xbb76f0 con 0xc6e650 2023-12-22T10:01:41.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.408+0000 7f5865ffb700 10 client.5181 handle_command_reply: tid=0 2023-12-22T10:01:41.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.408+0000 7f58985ad740 1 client.5181 shutdown 2023-12-22T10:01:41.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.408+0000 7f58985ad740 1 -- 172.21.15.45:0/3457278288 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0xc90ab0 msgr2=0xc91420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:41.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.408+0000 7f58985ad740 1 --2- 172.21.15.45:0/3457278288 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0xc90ab0 0xc91420 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7f5880006d30 tx=0x7f5880016000).stop 2023-12-22T10:01:41.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.412+0000 7f58985ad740 1 -- 172.21.15.45:0/3457278288 shutdown_connections 2023-12-22T10:01:41.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.412+0000 7f58985ad740 1 --2- 172.21.15.45:0/3457278288 >> [v2:172.21.15.45:6834/1879154206,v1:172.21.15.45:6835/1879154206] conn(0xc6e650 0xc74dd0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:41.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.412+0000 7f58985ad740 1 --2- 172.21.15.45:0/3457278288 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0xc90ab0 0xc91420 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:41.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.412+0000 7f58985ad740 1 --2- 172.21.15.45:0/3457278288 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0xc4b300 0xc90f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:41.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.412+0000 7f58985ad740 1 --2- 172.21.15.45:0/3457278288 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0xc4a510 0xca0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:41.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.412+0000 7f58985ad740 1 -- 172.21.15.45:0/3457278288 >> 172.21.15.45:0/3457278288 conn(0xa29550 msgr2=0xc4a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:41.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.412+0000 7f5865ffb700 0 client.5181 ms_handle_reset on v2:172.21.15.45:6834/1879154206 2023-12-22T10:01:41.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.412+0000 7f58985ad740 1 -- 172.21.15.45:0/3457278288 shutdown_connections 2023-12-22T10:01:41.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.412+0000 7f58985ad740 1 -- 172.21.15.45:0/3457278288 wait complete. 2023-12-22T10:01:41.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.412+0000 7f58985ad740 20 client.5181 trim_cache size 0 max 16384 2023-12-22T10:01:41.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.428+0000 7f58985ad740 1 Processor -- start 2023-12-22T10:01:41.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.428+0000 7f58985ad740 1 -- start start 2023-12-22T10:01:41.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.432+0000 7f58985ad740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0xc4a510 0xc465e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:41.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.432+0000 7f58985ad740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0xc4b300 0xc4b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:41.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.432+0000 7f58985ad740 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0xc90ab0 0xc737f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:41.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.432+0000 7f58985ad740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0xc9d5f0 con 0xc4b300 2023-12-22T10:01:41.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.432+0000 7f58985ad740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0xc9dbc0 con 0xc4a510 2023-12-22T10:01:41.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.432+0000 7f58985ad740 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0xc0ee60 con 0xc90ab0 2023-12-22T10:01:41.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.432+0000 7f587effd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0xc4b300 0xc4b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:41.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.432+0000 7f587effd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0xc4b300 0xc4b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37114/0 (socket says 172.21.15.45:37114) 2023-12-22T10:01:41.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.432+0000 7f587effd700 1 -- 172.21.15.45:0/2297006721 learned_addr learned my addr 172.21.15.45:0/2297006721 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:41.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.432+0000 7f5887fff700 1 --2- 172.21.15.45:0/2297006721 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0xc90ab0 0xc737f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:41.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.432+0000 7f58877fe700 1 --2- 172.21.15.45:0/2297006721 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0xc4a510 0xc465e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:41.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.432+0000 7f587effd700 1 -- 172.21.15.45:0/2297006721 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0xc90ab0 msgr2=0xc737f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:41.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.432+0000 7f587effd700 1 --2- 172.21.15.45:0/2297006721 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0xc90ab0 0xc737f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:41.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.432+0000 7f587effd700 1 -- 172.21.15.45:0/2297006721 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0xc4a510 msgr2=0xc465e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:41.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.432+0000 7f587effd700 1 --2- 172.21.15.45:0/2297006721 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0xc4a510 0xc465e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:41.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.432+0000 7f587effd700 1 -- 172.21.15.45:0/2297006721 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58880c0a90 con 0xc4b300 2023-12-22T10:01:41.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.432+0000 7f587effd700 1 --2- 172.21.15.45:0/2297006721 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0xc4b300 0xc4b890 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7f5870001660 tx=0x7f5870019040).ready entity=mon.0 client_cookie=4c994dbe971a49bc server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:41.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.432+0000 7f587d7fa700 1 -- 172.21.15.45:0/2297006721 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f587001c030 con 0xc4b300 2023-12-22T10:01:41.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.432+0000 7f587d7fa700 1 -- 172.21.15.45:0/2297006721 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f587001d040 con 0xc4b300 2023-12-22T10:01:41.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.432+0000 7f587d7fa700 1 -- 172.21.15.45:0/2297006721 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5870012770 con 0xc4b300 2023-12-22T10:01:41.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.436+0000 7f58985ad740 1 -- 172.21.15.45:0/2297006721 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0xc4b300 msgr2=0xc4b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:41.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.436+0000 7f58985ad740 1 --2- 172.21.15.45:0/2297006721 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0xc4b300 0xc4b890 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7f5870001660 tx=0x7f5870019040).stop 2023-12-22T10:01:41.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.436+0000 7f58985ad740 1 -- 172.21.15.45:0/2297006721 shutdown_connections 2023-12-22T10:01:41.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.436+0000 7f58985ad740 1 --2- 172.21.15.45:0/2297006721 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0xc90ab0 0xc737f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:41.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.436+0000 7f58985ad740 1 --2- 172.21.15.45:0/2297006721 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0xc4b300 0xc4b890 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:41.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.436+0000 7f58985ad740 1 --2- 172.21.15.45:0/2297006721 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0xc4a510 0xc465e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:41.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.436+0000 7f58985ad740 1 -- 172.21.15.45:0/2297006721 >> 172.21.15.45:0/2297006721 conn(0xa29550 msgr2=0xc889b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:41.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.436+0000 7f58985ad740 1 -- 172.21.15.45:0/2297006721 shutdown_connections 2023-12-22T10:01:41.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.436+0000 7f58985ad740 1 -- 172.21.15.45:0/2297006721 wait complete. 2023-12-22T10:01:41.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.436+0000 7f58985ad740 1 -- start start 2023-12-22T10:01:41.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.436+0000 7f58985ad740 1 Processor -- start 2023-12-22T10:01:41.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.436+0000 7f58985ad740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0xc4a510 0xc6f050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:41.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.436+0000 7f58985ad740 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0xc4b300 0xc6f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:41.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.436+0000 7f58985ad740 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0xc90ab0 0xc69150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:41.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.436+0000 7f58985ad740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0xc68fe0 con 0xc4a510 2023-12-22T10:01:41.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.436+0000 7f58985ad740 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0xc6fa30 con 0xc90ab0 2023-12-22T10:01:41.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.436+0000 7f58985ad740 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0xcf4460 con 0xc4b300 2023-12-22T10:01:41.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.436+0000 7f58985ad740 10 client.0 ll_register_callbacks cb 0x7f5880011af0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-22T10:01:41.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.436+0000 7f58877fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0xc4a510 0xc6f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:41.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.436+0000 7f58877fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0xc4a510 0xc6f050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37118/0 (socket says 172.21.15.45:37118) 2023-12-22T10:01:41.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.436+0000 7f58877fe700 1 -- 172.21.15.45:0/750057014 learned_addr learned my addr 172.21.15.45:0/750057014 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:41.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.436+0000 7f587effd700 1 --2- 172.21.15.45:0/750057014 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0xc4b300 0xc6f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:41.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.436+0000 7f5887fff700 1 --2- 172.21.15.45:0/750057014 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0xc90ab0 0xc69150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:41.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.440+0000 7f58877fe700 1 -- 172.21.15.45:0/750057014 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0xc4b300 msgr2=0xc6f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:41.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.440+0000 7f58877fe700 1 --2- 172.21.15.45:0/750057014 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0xc4b300 0xc6f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:41.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.440+0000 7f58877fe700 1 -- 172.21.15.45:0/750057014 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0xc90ab0 msgr2=0xc69150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:41.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.440+0000 7f58877fe700 1 --2- 172.21.15.45:0/750057014 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0xc90ab0 0xc69150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:41.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.440+0000 7f58877fe700 1 -- 172.21.15.45:0/750057014 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f587000f970 con 0xc4a510 2023-12-22T10:01:41.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.440+0000 7f58877fe700 1 --2- 172.21.15.45:0/750057014 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0xc4a510 0xc6f050 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7f587804d010 tx=0x7f5878054040).ready entity=mon.0 client_cookie=664721a276c791a1 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:41.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.440+0000 7f5865ffb700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-12-22T10:01:41.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.440+0000 7f5865ffb700 1 -- 172.21.15.45:0/750057014 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f587800ed40 con 0xc4a510 2023-12-22T10:01:41.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.440+0000 7f5865ffb700 1 -- 172.21.15.45:0/750057014 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(36..36 src has 1..36) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f587800eea0 con 0xc4a510 2023-12-22T10:01:41.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.440+0000 7f58985ad740 1 -- 172.21.15.45:0/750057014 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5878049d90 con 0xc4a510 2023-12-22T10:01:41.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.440+0000 7f5865ffb700 1 -- 172.21.15.45:0/750057014 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f587804b0f0 con 0xc4a510 2023-12-22T10:01:41.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.440+0000 7f58985ad740 10 client.5187 fetch_fsmap learned FSMap version 16 2023-12-22T10:01:41.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.440+0000 7f58985ad740 1 -- 172.21.15.45:0/750057014 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0xbbf6b0 con 0xc4a510 2023-12-22T10:01:41.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.440+0000 7f5865ffb700 1 -- 172.21.15.45:0/750057014 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5878049d90 con 0xc4a510 2023-12-22T10:01:41.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.440+0000 7f5865ffb700 1 -- 172.21.15.45:0/750057014 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 16) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f5878010b70 con 0xc4a510 2023-12-22T10:01:41.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.440+0000 7f58985ad740 10 client.5187 fetch_fsmap finished waiting for FSMap version 16 2023-12-22T10:01:41.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.440+0000 7f58985ad740 10 client.5187 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-22T10:01:41.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.440+0000 7f58985ad740 20 client.5187 populate_metadata read hostname 'smithi045' 2023-12-22T10:01:41.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.440+0000 7f58985ad740 1 --2- 172.21.15.45:0/750057014 >> [v2:172.21.15.45:6834/1879154206,v1:172.21.15.45:6835/1879154206] conn(0xc69640 0xc8e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:41.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.440+0000 7f58985ad740 4 client.5187 mds_command: new command op to 4980 tid=0[{"prefix": "status"}] 2023-12-22T10:01:41.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.440+0000 7f58985ad740 1 -- 172.21.15.45:0/750057014 --> [v2:172.21.15.45:6834/1879154206,v1:172.21.15.45:6835/1879154206] -- command(tid 0: {"prefix": "status"}) v1 -- 0xa804e0 con 0xc69640 2023-12-22T10:01:41.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.440+0000 7f587effd700 1 --2- 172.21.15.45:0/750057014 >> [v2:172.21.15.45:6834/1879154206,v1:172.21.15.45:6835/1879154206] conn(0xc69640 0xc8e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:41.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.440+0000 7f587effd700 1 --2- 172.21.15.45:0/750057014 >> [v2:172.21.15.45:6834/1879154206,v1:172.21.15.45:6835/1879154206] conn(0xc69640 0xc8e3d0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=d5434e7c16a18f16 server_cookie=e7a05509ffe0729e in_seq=0 out_seq=0 2023-12-22T10:01:41.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.440+0000 7f5865ffb700 10 client.5187 ms_handle_connect on v2:172.21.15.45:6834/1879154206 2023-12-22T10:01:41.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.440+0000 7f5865ffb700 1 -- 172.21.15.45:0/750057014 <== mds.0 v2:172.21.15.45:6834/1879154206 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0xa804e0 con 0xc69640 2023-12-22T10:01:41.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.440+0000 7f5865ffb700 10 client.5187 handle_command_reply: tid=0 2023-12-22T10:01:41.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.440+0000 7f58985ad740 1 client.5187 shutdown 2023-12-22T10:01:41.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.444+0000 7f58985ad740 1 -- 172.21.15.45:0/750057014 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0xc4a510 msgr2=0xc6f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:41.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.444+0000 7f58985ad740 1 --2- 172.21.15.45:0/750057014 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0xc4a510 0xc6f050 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7f587804d010 tx=0x7f5878054040).stop 2023-12-22T10:01:41.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.444+0000 7f58985ad740 1 -- 172.21.15.45:0/750057014 shutdown_connections 2023-12-22T10:01:41.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.444+0000 7f58985ad740 1 --2- 172.21.15.45:0/750057014 >> [v2:172.21.15.45:6834/1879154206,v1:172.21.15.45:6835/1879154206] conn(0xc69640 0xc8e3d0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:41.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.444+0000 7f58985ad740 1 --2- 172.21.15.45:0/750057014 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0xc90ab0 0xc69150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:41.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.444+0000 7f58985ad740 1 --2- 172.21.15.45:0/750057014 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0xc4b300 0xc6f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:41.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.444+0000 7f5865ffb700 0 client.5187 ms_handle_reset on v2:172.21.15.45:6834/1879154206 2023-12-22T10:01:41.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.444+0000 7f58985ad740 1 --2- 172.21.15.45:0/750057014 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0xc4a510 0xc6f050 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:41.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.444+0000 7f58985ad740 1 -- 172.21.15.45:0/750057014 >> 172.21.15.45:0/750057014 conn(0xa29550 msgr2=0xc90e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:41.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.444+0000 7f58985ad740 1 -- 172.21.15.45:0/750057014 shutdown_connections 2023-12-22T10:01:41.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.444+0000 7f58985ad740 1 -- 172.21.15.45:0/750057014 wait complete. 2023-12-22T10:01:41.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.444+0000 7f58985ad740 20 client.5187 trim_cache size 0 max 16384 2023-12-22T10:01:41.443 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-22T10:01:41.445 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_fsid": "98b0837e-5e68-4c8f-a1a0-e9424baaad8f", 2023-12-22T10:01:41.445 INFO:teuthology.orchestra.run.smithi045.stdout: "whoami": 0, 2023-12-22T10:01:41.445 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 4980, 2023-12-22T10:01:41.445 INFO:teuthology.orchestra.run.smithi045.stdout: "want_state": "up:active", 2023-12-22T10:01:41.445 INFO:teuthology.orchestra.run.smithi045.stdout: "state": "up:active", 2023-12-22T10:01:41.445 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs", 2023-12-22T10:01:41.445 INFO:teuthology.orchestra.run.smithi045.stdout: "rank_uptime": 6.335065459, 2023-12-22T10:01:41.445 INFO:teuthology.orchestra.run.smithi045.stdout: "mdsmap_epoch": 16, 2023-12-22T10:01:41.445 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch": 36, 2023-12-22T10:01:41.445 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch_barrier": 36, 2023-12-22T10:01:41.445 INFO:teuthology.orchestra.run.smithi045.stdout: "uptime": 16.047284983000001 2023-12-22T10:01:41.445 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-22T10:01:41.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.444+0000 7f588e21b700 1 -- 172.21.15.45:0/3333712142 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f586805a510 msgr2=0x7f586805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:41.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.444+0000 7f588e21b700 1 --2- 172.21.15.45:0/3333712142 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f586805a510 0x7f586805c9d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f58880c3e40 tx=0x7f5870001990).stop 2023-12-22T10:01:41.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.444+0000 7f588e21b700 1 -- 172.21.15.45:0/3333712142 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58880ac5c0 msgr2=0x7f5888151850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:41.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.444+0000 7f588e21b700 1 --2- 172.21.15.45:0/3333712142 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58880ac5c0 0x7f5888151850 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7f587800c840 tx=0x7f58780026f0).stop 2023-12-22T10:01:41.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.444+0000 7f588e21b700 1 -- 172.21.15.45:0/3333712142 shutdown_connections 2023-12-22T10:01:41.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.444+0000 7f588e21b700 1 --2- 172.21.15.45:0/3333712142 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f586805a510 0x7f586805c9d0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:41.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.444+0000 7f588e21b700 1 --2- 172.21.15.45:0/3333712142 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f58880c7b40 0x7f58880c21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:41.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.444+0000 7f588e21b700 1 --2- 172.21.15.45:0/3333712142 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f58880c5900 0x7f58880c1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:41.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.444+0000 7f588e21b700 1 --2- 172.21.15.45:0/3333712142 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58880ac5c0 0x7f5888151850 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:41.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.444+0000 7f588e21b700 1 -- 172.21.15.45:0/3333712142 >> 172.21.15.45:0/3333712142 conn(0x7f5888082a30 msgr2=0x7f58880bfb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:41.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.444+0000 7f588e21b700 1 -- 172.21.15.45:0/3333712142 shutdown_connections 2023-12-22T10:01:41.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.444+0000 7f588e21b700 1 -- 172.21.15.45:0/3333712142 wait complete. 2023-12-22T10:01:41.467 DEBUG:teuthology.orchestra.run.smithi045:> ceph fs ls 2023-12-22T10:01:41.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.624+0000 7f699bfdb700 1 Processor -- start 2023-12-22T10:01:41.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.624+0000 7f699bfdb700 1 -- start start 2023-12-22T10:01:41.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.624+0000 7f699bfdb700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f6994147a90 0x7f69940c6620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:41.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.624+0000 7f699bfdb700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f69940c3f70 0x7f69940c43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:41.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.624+0000 7f699bfdb700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69940c6b10 con 0x7f69940bdae0 2023-12-22T10:01:41.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.624+0000 7f699bfdb700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69940c5580 con 0x7f6994147a90 2023-12-22T10:01:41.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.624+0000 7f699bfdb700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69940c5860 con 0x7f69940c3f70 2023-12-22T10:01:41.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.628+0000 7f6999d77700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f6994147a90 0x7f69940c6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:41.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.628+0000 7f699a578700 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f69940bdae0 0x7f69940bdf70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.45:49742/0 (socket says 172.21.15.45:49742) 2023-12-22T10:01:41.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.628+0000 7f699a578700 1 -- 172.21.15.45:0/3057371314 learned_addr learned my addr 172.21.15.45:0/3057371314 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:01:41.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.628+0000 7f6999d77700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f6994147a90 0x7f69940c6620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.45:41400/0 (socket says 172.21.15.45:41400) 2023-12-22T10:01:41.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.628+0000 7f6999576700 1 --2- 172.21.15.45:0/3057371314 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f69940c3f70 0x7f69940c43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:41.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.628+0000 7f6998d75700 1 -- 172.21.15.45:0/3057371314 <== mon.1 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 39651517 0 0) 0x7f69940c6b10 con 0x7f69940bdae0 2023-12-22T10:01:41.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.628+0000 7f6998d75700 1 -- 172.21.15.45:0/3057371314 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69800033f0 con 0x7f69940bdae0 2023-12-22T10:01:41.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.628+0000 7f6999d77700 1 -- 172.21.15.45:0/3057371314 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f69940c3f70 msgr2=0x7f69940c43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:41.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.628+0000 7f6999d77700 1 --2- 172.21.15.45:0/3057371314 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f69940c3f70 0x7f69940c43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:41.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.628+0000 7f6999d77700 1 -- 172.21.15.45:0/3057371314 >> v1:172.21.15.113:6789/0 conn(0x7f69940bdae0 legacy=0x7f69940bdf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:41.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.628+0000 7f6999d77700 1 -- 172.21.15.45:0/3057371314 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69940c5b40 con 0x7f6994147a90 2023-12-22T10:01:41.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.628+0000 7f6999576700 1 --2- 172.21.15.45:0/3057371314 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f69940c3f70 0x7f69940c43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-12-22T10:01:41.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.628+0000 7f6999d77700 1 --2- 172.21.15.45:0/3057371314 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6994147a90 0x7f69940c6620 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f6990009760 tx=0x7f6990009060).ready entity=mon.1 client_cookie=ac19b5516739dbc8 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:41.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.628+0000 7f6998d75700 1 -- 172.21.15.45:0/3057371314 <== mon.1 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f699000d4a0 con 0x7f6994147a90 2023-12-22T10:01:41.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.628+0000 7f6998d75700 1 -- 172.21.15.45:0/3057371314 <== mon.1 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f699000d600 con 0x7f6994147a90 2023-12-22T10:01:41.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.628+0000 7f6998d75700 1 -- 172.21.15.45:0/3057371314 <== mon.1 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f699000d980 con 0x7f6994147a90 2023-12-22T10:01:41.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.628+0000 7f699bfdb700 1 -- 172.21.15.45:0/3057371314 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6994147a90 msgr2=0x7f69940c6620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:41.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.628+0000 7f699bfdb700 1 --2- 172.21.15.45:0/3057371314 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6994147a90 0x7f69940c6620 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f6990009760 tx=0x7f6990009060).stop 2023-12-22T10:01:41.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.632+0000 7f699bfdb700 1 -- 172.21.15.45:0/3057371314 shutdown_connections 2023-12-22T10:01:41.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.632+0000 7f699bfdb700 1 --2- 172.21.15.45:0/3057371314 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f69940c3f70 0x7f69940c43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:41.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.632+0000 7f699bfdb700 1 --2- 172.21.15.45:0/3057371314 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f6994147a90 0x7f69940c6620 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:41.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.632+0000 7f699bfdb700 1 -- 172.21.15.45:0/3057371314 >> 172.21.15.45:0/3057371314 conn(0x7f69940669a0 msgr2=0x7f6994066d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:41.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.632+0000 7f699bfdb700 1 -- 172.21.15.45:0/3057371314 shutdown_connections 2023-12-22T10:01:41.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.632+0000 7f699bfdb700 1 -- 172.21.15.45:0/3057371314 wait complete. 2023-12-22T10:01:41.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.632+0000 7f699bfdb700 1 Processor -- start 2023-12-22T10:01:41.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.632+0000 7f699bfdb700 1 -- start start 2023-12-22T10:01:41.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.636+0000 7f699bfdb700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f69940bdae0 0x7f69941451c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:41.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.636+0000 7f699bfdb700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f69940c3f70 0x7f6994148380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:41.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.636+0000 7f699bfdb700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f6994147a90 0x7f6994145970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:41.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.636+0000 7f699bfdb700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69940ac3a0 con 0x7f69940c3f70 2023-12-22T10:01:41.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.636+0000 7f699bfdb700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69940ab7b0 con 0x7f69940bdae0 2023-12-22T10:01:41.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.636+0000 7f699bfdb700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69940aba70 con 0x7f6994147a90 2023-12-22T10:01:41.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.636+0000 7f6999576700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f69940c3f70 0x7f6994148380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:41.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.636+0000 7f6999576700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f69940c3f70 0x7f6994148380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37124/0 (socket says 172.21.15.45:37124) 2023-12-22T10:01:41.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.636+0000 7f6999576700 1 -- 172.21.15.45:0/1527902860 learned_addr learned my addr 172.21.15.45:0/1527902860 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:41.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.636+0000 7f699a578700 1 --2- 172.21.15.45:0/1527902860 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f6994147a90 0x7f6994145970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:41.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.636+0000 7f6999d77700 1 --2- 172.21.15.45:0/1527902860 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f69940bdae0 0x7f69941451c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:41.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.636+0000 7f6999576700 1 -- 172.21.15.45:0/1527902860 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f6994147a90 msgr2=0x7f6994145970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:41.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.636+0000 7f6999576700 1 --2- 172.21.15.45:0/1527902860 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f6994147a90 0x7f6994145970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:41.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.636+0000 7f6999576700 1 -- 172.21.15.45:0/1527902860 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f69940bdae0 msgr2=0x7f69941451c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:41.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.636+0000 7f6999576700 1 --2- 172.21.15.45:0/1527902860 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f69940bdae0 0x7f69941451c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:41.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.636+0000 7f6999576700 1 -- 172.21.15.45:0/1527902860 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69840092a0 con 0x7f69940c3f70 2023-12-22T10:01:41.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.636+0000 7f6999d77700 1 --2- 172.21.15.45:0/1527902860 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f69940bdae0 0x7f69941451c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T10:01:41.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.636+0000 7f6999576700 1 --2- 172.21.15.45:0/1527902860 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f69940c3f70 0x7f6994148380 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7f698400ea20 tx=0x7f6984009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:41.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.636+0000 7f6989ffb700 1 -- 172.21.15.45:0/1527902860 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6984009600 con 0x7f69940c3f70 2023-12-22T10:01:41.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.636+0000 7f6989ffb700 1 -- 172.21.15.45:0/1527902860 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f698400c850 con 0x7f69940c3f70 2023-12-22T10:01:41.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.636+0000 7f6989ffb700 1 -- 172.21.15.45:0/1527902860 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f698400cbd0 con 0x7f69940c3f70 2023-12-22T10:01:41.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.636+0000 7f699bfdb700 1 -- 172.21.15.45:0/1527902860 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69900092a0 con 0x7f69940c3f70 2023-12-22T10:01:41.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.636+0000 7f699bfdb700 1 -- 172.21.15.45:0/1527902860 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69940ac030 con 0x7f69940c3f70 2023-12-22T10:01:41.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.640+0000 7f699bfdb700 1 -- 172.21.15.45:0/1527902860 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69940ac550 con 0x7f69940c3f70 2023-12-22T10:01:41.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.640+0000 7f6989ffb700 1 -- 172.21.15.45:0/1527902860 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f698401b400 con 0x7f69940c3f70 2023-12-22T10:01:41.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.640+0000 7f6989ffb700 1 --2- 172.21.15.45:0/1527902860 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f697805a510 0x7f697805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:41.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.640+0000 7f6989ffb700 1 -- 172.21.15.45:0/1527902860 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f6984074c70 con 0x7f69940c3f70 2023-12-22T10:01:41.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.640+0000 7f6999d77700 1 --2- 172.21.15.45:0/1527902860 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f697805a510 0x7f697805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:41.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.644+0000 7f6999d77700 1 --2- 172.21.15.45:0/1527902860 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f697805a510 0x7f697805c9d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f699000d260 tx=0x7f6990016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:41.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.648+0000 7f6989ffb700 1 -- 172.21.15.45:0/1527902860 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f69940ac550 con 0x7f69940c3f70 2023-12-22T10:01:41.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.852+0000 7f699bfdb700 1 -- 172.21.15.45:0/1527902860 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f699406bb80 con 0x7f69940c3f70 2023-12-22T10:01:41.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.852+0000 7f6989ffb700 1 -- 172.21.15.45:0/1527902860 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7f6984016070 con 0x7f69940c3f70 2023-12-22T10:01:41.853 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-22T10:01:41.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.856+0000 7f699bfdb700 1 -- 172.21.15.45:0/1527902860 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f697805a510 msgr2=0x7f697805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:41.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.856+0000 7f699bfdb700 1 --2- 172.21.15.45:0/1527902860 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f697805a510 0x7f697805c9d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f699000d260 tx=0x7f6990016000).stop 2023-12-22T10:01:41.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.856+0000 7f699bfdb700 1 -- 172.21.15.45:0/1527902860 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f69940c3f70 msgr2=0x7f6994148380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:41.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.856+0000 7f699bfdb700 1 --2- 172.21.15.45:0/1527902860 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f69940c3f70 0x7f6994148380 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7f698400ea20 tx=0x7f6984009060).stop 2023-12-22T10:01:41.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.860+0000 7f699bfdb700 1 -- 172.21.15.45:0/1527902860 shutdown_connections 2023-12-22T10:01:41.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.860+0000 7f699bfdb700 1 --2- 172.21.15.45:0/1527902860 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f697805a510 0x7f697805c9d0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:41.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.860+0000 7f699bfdb700 1 --2- 172.21.15.45:0/1527902860 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f6994147a90 0x7f6994145970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:41.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.860+0000 7f699bfdb700 1 --2- 172.21.15.45:0/1527902860 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f69940c3f70 0x7f6994148380 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:41.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.860+0000 7f699bfdb700 1 --2- 172.21.15.45:0/1527902860 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f69940bdae0 0x7f69941451c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:41.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.860+0000 7f699bfdb700 1 -- 172.21.15.45:0/1527902860 >> 172.21.15.45:0/1527902860 conn(0x7f69940669a0 msgr2=0x7f69940bdf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:41.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.860+0000 7f699bfdb700 1 -- 172.21.15.45:0/1527902860 shutdown_connections 2023-12-22T10:01:41.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:41.860+0000 7f699bfdb700 1 -- 172.21.15.45:0/1527902860 wait complete. 2023-12-22T10:01:41.875 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-22T10:01:41.875 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-22T10:01:41.875 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi045.front.sepia.ceph.com 2023-12-22T10:01:41.875 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-22T10:01:41.875 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-22T10:01:41.875 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-22T10:01:41.875 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-22T10:01:41.875 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-22T10:01:41.875 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-22T10:01:41.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T10:01:41.876 DEBUG:teuthology.orchestra.run.smithi045:> ip addr 2023-12-22T10:01:41.891 INFO:teuthology.orchestra.run.smithi045.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-22T10:01:41.891 INFO:teuthology.orchestra.run.smithi045.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-22T10:01:41.891 INFO:teuthology.orchestra.run.smithi045.stdout: inet 127.0.0.1/8 scope host lo 2023-12-22T10:01:41.891 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-22T10:01:41.891 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 ::1/128 scope host 2023-12-22T10:01:41.891 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-22T10:01:41.892 INFO:teuthology.orchestra.run.smithi045.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-22T10:01:41.892 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a6 brd ff:ff:ff:ff:ff:ff 2023-12-22T10:01:41.892 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f0 2023-12-22T10:01:41.892 INFO:teuthology.orchestra.run.smithi045.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-22T10:01:41.892 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a7 brd ff:ff:ff:ff:ff:ff 2023-12-22T10:01:41.892 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f1 2023-12-22T10:01:41.892 INFO:teuthology.orchestra.run.smithi045.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-22T10:01:41.892 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:be brd ff:ff:ff:ff:ff:ff 2023-12-22T10:01:41.892 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f0 2023-12-22T10:01:41.892 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.21.15.45/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-12-22T10:01:41.892 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft 42348sec preferred_lft 42348sec 2023-12-22T10:01:41.892 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::ec4:7aff:febd:12be/64 scope link 2023-12-22T10:01:41.892 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-22T10:01:41.892 INFO:teuthology.orchestra.run.smithi045.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-22T10:01:41.893 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:bf brd ff:ff:ff:ff:ff:ff 2023-12-22T10:01:41.893 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f1 2023-12-22T10:01:41.893 INFO:teuthology.orchestra.run.smithi045.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-22T10:01:41.893 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 02:42:88:ee:73:7d brd ff:ff:ff:ff:ff:ff 2023-12-22T10:01:41.893 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-22T10:01:41.893 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-22T10:01:41.893 INFO:teuthology.orchestra.run.smithi045.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-22T10:01:41.893 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether be:09:4b:53:de:10 brd ff:ff:ff:ff:ff:ff 2023-12-22T10:01:41.893 INFO:teuthology.orchestra.run.smithi045.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-22T10:01:41.893 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-22T10:01:41.893 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::1c22:c2ff:fec2:a6b8/64 scope link 2023-12-22T10:01:41.893 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-22T10:01:41.893 INFO:teuthology.orchestra.run.smithi045.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-22T10:01:41.893 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether be:09:4b:53:de:10 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-22T10:01:41.894 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::bc09:4bff:fe53:de10/64 scope link 2023-12-22T10:01:41.894 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-22T10:01:41.894 INFO:teuthology.orchestra.run.smithi045.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-22T10:01:41.894 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether ca:48:30:5b:58:95 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-22T10:01:41.894 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::c848:30ff:fe5b:5895/64 scope link 2023-12-22T10:01:41.894 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-22T10:01:41.895 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T10:01:41.895 DEBUG:teuthology.orchestra.run.smithi045:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-22T10:01:41.974 INFO:teuthology.orchestra.run.smithi045.stdout:1 2023-12-22T10:01:41.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T10:01:41.977 DEBUG:teuthology.orchestra.run.smithi045:> route 2023-12-22T10:01:42.047 INFO:teuthology.orchestra.run.smithi045.stdout:Kernel IP routing table 2023-12-22T10:01:42.047 INFO:teuthology.orchestra.run.smithi045.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-22T10:01:42.048 INFO:teuthology.orchestra.run.smithi045.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-12-22T10:01:42.048 INFO:teuthology.orchestra.run.smithi045.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-22T10:01:42.048 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-12-22T10:01:42.048 INFO:teuthology.orchestra.run.smithi045.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-22T10:01:42.049 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T10:01:42.049 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-12-22T10:01:42.049 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-12-22T10:01:42.049 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-22T10:01:42.049 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-22T10:01:42.049 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-22T10:01:42.049 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-12-22T10:01:42.186 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T10:01:42.186 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2023-12-22T10:01:42.207 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-22T10:01:42.207 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-22T10:01:42.208 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-22T10:01:42.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T10:01:42.208 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set brx.0 up 2023-12-22T10:01:42.289 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-12-22T10:01:42.290 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-22T10:01:42.290 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -m 0000 -p -v /home/ubuntu/cephtest/mnt.0 2023-12-22T10:01:42.352 INFO:teuthology.orchestra.run.smithi045.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-22T10:01:42.353 DEBUG:teuthology.orchestra.run.smithi045:> sudo modprobe fuse 2023-12-22T10:01:42.438 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-22T10:01:42.438 DEBUG:teuthology.orchestra.run.smithi045:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-22T10:01:42.517 INFO:teuthology.orchestra.run.smithi045.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-22T10:01:42.521 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-22T10:01:42.521 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-22T10:01:42.521 DEBUG:teuthology.orchestra.run.smithi045:> ls /sys/fs/fuse/connections 2023-12-22T10:01:42.587 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-22T10:01:42.587 DEBUG:teuthology.orchestra.run.smithi045:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' --id 0 /home/ubuntu/cephtest/mnt.0 2023-12-22T10:01:42.636 DEBUG:teuthology.orchestra.run.smithi045:> sudo modprobe fuse 2023-12-22T10:01:42.668 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-22T10:01:42.668 DEBUG:teuthology.orchestra.run.smithi045:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-22T10:01:42.747 INFO:teuthology.orchestra.run.smithi045.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-22T10:01:42.750 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-22T10:01:42.751 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-22T10:01:42.751 DEBUG:teuthology.orchestra.run.smithi045:> ls /sys/fs/fuse/connections 2023-12-22T10:01:42.775 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi045.stderr:2023-12-22T10:01:42.776+0000 7fbd4c92e200 -1 init, newargv = 0x55e1f3ba43e0 newargc=15 2023-12-22T10:01:42.775 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi045.stderr:ceph-fuse[41319]: starting ceph client 2023-12-22T10:01:42.788 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi045.stderr:ceph-fuse[41319]: starting fuse 2023-12-22T10:01:42.790 INFO:teuthology.orchestra.run.smithi045.stdout:49 2023-12-22T10:01:42.790 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2023-12-22T10:01:42.791 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-22T10:01:42.791 DEBUG:teuthology.orchestra.run.smithi045:> import glob 2023-12-22T10:01:42.791 DEBUG:teuthology.orchestra.run.smithi045:> import re 2023-12-22T10:01:42.791 DEBUG:teuthology.orchestra.run.smithi045:> import os 2023-12-22T10:01:42.791 DEBUG:teuthology.orchestra.run.smithi045:> import subprocess 2023-12-22T10:01:42.791 DEBUG:teuthology.orchestra.run.smithi045:> 2023-12-22T10:01:42.791 DEBUG:teuthology.orchestra.run.smithi045:> def _find_admin_socket(client_name): 2023-12-22T10:01:42.791 DEBUG:teuthology.orchestra.run.smithi045:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-12-22T10:01:42.791 DEBUG:teuthology.orchestra.run.smithi045:> files = glob.glob(asok_path) 2023-12-22T10:01:42.791 DEBUG:teuthology.orchestra.run.smithi045:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-12-22T10:01:42.791 DEBUG:teuthology.orchestra.run.smithi045:> 2023-12-22T10:01:42.791 DEBUG:teuthology.orchestra.run.smithi045:> # Given a non-glob path, it better be there 2023-12-22T10:01:42.791 DEBUG:teuthology.orchestra.run.smithi045:> if "*" not in asok_path: 2023-12-22T10:01:42.791 DEBUG:teuthology.orchestra.run.smithi045:> assert(len(files) == 1) 2023-12-22T10:01:42.791 DEBUG:teuthology.orchestra.run.smithi045:> return files[0] 2023-12-22T10:01:42.791 DEBUG:teuthology.orchestra.run.smithi045:> 2023-12-22T10:01:42.792 DEBUG:teuthology.orchestra.run.smithi045:> for f in files: 2023-12-22T10:01:42.792 DEBUG:teuthology.orchestra.run.smithi045:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-22T10:01:42.792 DEBUG:teuthology.orchestra.run.smithi045:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-22T10:01:42.792 DEBUG:teuthology.orchestra.run.smithi045:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-22T10:01:42.792 DEBUG:teuthology.orchestra.run.smithi045:> contents = proc_f.read() 2023-12-22T10:01:42.792 DEBUG:teuthology.orchestra.run.smithi045:> if mountpoint in contents: 2023-12-22T10:01:42.792 DEBUG:teuthology.orchestra.run.smithi045:> return f 2023-12-22T10:01:42.792 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-22T10:01:42.792 DEBUG:teuthology.orchestra.run.smithi045:> 2023-12-22T10:01:42.792 DEBUG:teuthology.orchestra.run.smithi045:> print(_find_admin_socket("client.0")) 2023-12-22T10:01:42.792 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-22T10:01:42.962 INFO:teuthology.orchestra.run.smithi045.stdout:/var/run/ceph/ceph-client.0.41319.asok 2023-12-22T10:01:43.145 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.41319.asok 2023-12-22T10:01:43.145 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-22T10:01:43.145 DEBUG:teuthology.orchestra.run.smithi045:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.41319.asok status 2023-12-22T10:01:43.327 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-22T10:01:43.327 INFO:teuthology.orchestra.run.smithi045.stdout: "metadata": { 2023-12-22T10:01:43.327 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_sha1": "4ab91a455dc86ea102fdfa1407dbcce323929634", 2023-12-22T10:01:43.327 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_version": "ceph version 16.2.14-395-g4ab91a45 (4ab91a455dc86ea102fdfa1407dbcce323929634) pacific (stable)", 2023-12-22T10:01:43.327 INFO:teuthology.orchestra.run.smithi045.stdout: "entity_id": "0", 2023-12-22T10:01:43.328 INFO:teuthology.orchestra.run.smithi045.stdout: "hostname": "smithi045", 2023-12-22T10:01:43.328 INFO:teuthology.orchestra.run.smithi045.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-12-22T10:01:43.328 INFO:teuthology.orchestra.run.smithi045.stdout: "pid": "41319", 2023-12-22T10:01:43.328 INFO:teuthology.orchestra.run.smithi045.stdout: "root": "/" 2023-12-22T10:01:43.328 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:43.328 INFO:teuthology.orchestra.run.smithi045.stdout: "dentry_count": 0, 2023-12-22T10:01:43.328 INFO:teuthology.orchestra.run.smithi045.stdout: "dentry_pinned_count": 0, 2023-12-22T10:01:43.328 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 5248, 2023-12-22T10:01:43.328 INFO:teuthology.orchestra.run.smithi045.stdout: "inst": { 2023-12-22T10:01:43.328 INFO:teuthology.orchestra.run.smithi045.stdout: "name": { 2023-12-22T10:01:43.328 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "client", 2023-12-22T10:01:43.328 INFO:teuthology.orchestra.run.smithi045.stdout: "num": 5248 2023-12-22T10:01:43.328 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:43.328 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": { 2023-12-22T10:01:43.328 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-12-22T10:01:43.328 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:0", 2023-12-22T10:01:43.329 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1744266103 2023-12-22T10:01:43.329 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-22T10:01:43.329 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:43.329 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": { 2023-12-22T10:01:43.329 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-12-22T10:01:43.329 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:0", 2023-12-22T10:01:43.329 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1744266103 2023-12-22T10:01:43.329 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-22T10:01:43.329 INFO:teuthology.orchestra.run.smithi045.stdout: "inst_str": "client.5248 172.21.15.45:0/1744266103", 2023-12-22T10:01:43.329 INFO:teuthology.orchestra.run.smithi045.stdout: "addr_str": "172.21.15.45:0/1744266103", 2023-12-22T10:01:43.329 INFO:teuthology.orchestra.run.smithi045.stdout: "inode_count": 1, 2023-12-22T10:01:43.329 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_epoch": 16, 2023-12-22T10:01:43.329 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_epoch": 36, 2023-12-22T10:01:43.329 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_epoch_barrier": 0, 2023-12-22T10:01:43.329 INFO:teuthology.orchestra.run.smithi045.stdout: "blocklisted": false, 2023-12-22T10:01:43.330 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs" 2023-12-22T10:01:43.330 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-22T10:01:43.340 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-22T10:01:43.340 DEBUG:teuthology.orchestra.run.smithi045:> stat --file-system '--printf=%T 2023-12-22T10:01:43.340 DEBUG:teuthology.orchestra.run.smithi045:> ' -- /home/ubuntu/cephtest/mnt.0 2023-12-22T10:01:43.360 INFO:teuthology.orchestra.run.smithi045.stdout:fuseblk 2023-12-22T10:01:43.360 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-12-22T10:01:43.360 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-22T10:01:43.360 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-22T10:01:43.445 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-22T10:01:43.445 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir subdir) 2023-12-22T10:01:43.522 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-22T10:01:43.523 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=subdir/sixmegs bs=1M conv=fdatasync count=6 seek=0) 2023-12-22T10:01:43.721 INFO:teuthology.orchestra.run.smithi045.stderr:6+0 records in 2023-12-22T10:01:43.721 INFO:teuthology.orchestra.run.smithi045.stderr:6+0 records out 2023-12-22T10:01:43.721 INFO:teuthology.orchestra.run.smithi045.stderr:6291456 bytes (6.3 MB, 6.0 MiB) copied, 0.129927 s, 48.4 MB/s 2023-12-22T10:01:43.723 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-22T10:01:43.723 DEBUG:teuthology.orchestra.run.smithi045:> import os 2023-12-22T10:01:43.723 DEBUG:teuthology.orchestra.run.smithi045:> import stat 2023-12-22T10:01:43.723 DEBUG:teuthology.orchestra.run.smithi045:> import json 2023-12-22T10:01:43.723 DEBUG:teuthology.orchestra.run.smithi045:> import sys 2023-12-22T10:01:43.723 DEBUG:teuthology.orchestra.run.smithi045:> 2023-12-22T10:01:43.723 DEBUG:teuthology.orchestra.run.smithi045:> try: 2023-12-22T10:01:43.723 DEBUG:teuthology.orchestra.run.smithi045:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/subdir/sixmegs'"'"') 2023-12-22T10:01:43.723 DEBUG:teuthology.orchestra.run.smithi045:> except OSError as e: 2023-12-22T10:01:43.723 DEBUG:teuthology.orchestra.run.smithi045:> sys.exit(e.errno) 2023-12-22T10:01:43.723 DEBUG:teuthology.orchestra.run.smithi045:> 2023-12-22T10:01:43.723 DEBUG:teuthology.orchestra.run.smithi045:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2023-12-22T10:01:43.724 DEBUG:teuthology.orchestra.run.smithi045:> print(json.dumps( 2023-12-22T10:01:43.724 DEBUG:teuthology.orchestra.run.smithi045:> dict([(a, getattr(s, a)) for a in attrs]), 2023-12-22T10:01:43.724 DEBUG:teuthology.orchestra.run.smithi045:> indent=2)) 2023-12-22T10:01:43.724 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-22T10:01:43.832 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-22T10:01:43.832 INFO:teuthology.orchestra.run.smithi045.stdout: "st_mode": 33204, 2023-12-22T10:01:43.832 INFO:teuthology.orchestra.run.smithi045.stdout: "st_ino": 1099511627777, 2023-12-22T10:01:43.832 INFO:teuthology.orchestra.run.smithi045.stdout: "st_dev": 49, 2023-12-22T10:01:43.832 INFO:teuthology.orchestra.run.smithi045.stdout: "st_nlink": 1, 2023-12-22T10:01:43.832 INFO:teuthology.orchestra.run.smithi045.stdout: "st_uid": 1000, 2023-12-22T10:01:43.832 INFO:teuthology.orchestra.run.smithi045.stdout: "st_gid": 1267, 2023-12-22T10:01:43.832 INFO:teuthology.orchestra.run.smithi045.stdout: "st_size": 6291456, 2023-12-22T10:01:43.832 INFO:teuthology.orchestra.run.smithi045.stdout: "st_atime": 1703239303.5935974, 2023-12-22T10:01:43.832 INFO:teuthology.orchestra.run.smithi045.stdout: "st_mtime": 1703239303.6861317, 2023-12-22T10:01:43.832 INFO:teuthology.orchestra.run.smithi045.stdout: "st_ctime": 1703239303.6861317 2023-12-22T10:01:43.832 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-22T10:01:44.013 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi045.front.sepia.ceph.com... 2023-12-22T10:01:44.013 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-12-22T10:01:44.013 DEBUG:teuthology.orchestra.run.smithi045:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-12-22T10:01:44.090 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi045.stderr:ceph-fuse[41319]: fuse finished with error 0 and tester_r 0 2023-12-22T10:01:44.099 INFO:teuthology.orchestra.run:waiting for 900 2023-12-22T10:01:44.160 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi045.front.sepia.ceph.com 2023-12-22T10:01:44.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T10:01:44.160 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-22T10:01:44.176 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T10:01:44.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:44.392+0000 7f19cc946700 1 Processor -- start 2023-12-22T10:01:44.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:44.392+0000 7f19cc946700 1 -- start start 2023-12-22T10:01:44.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:44.396+0000 7f19cc946700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f19c81518f0 0x7f19c8064890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:44.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:44.396+0000 7f19cc946700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f19c8151cd0 0x7f19c80a6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:44.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:44.396+0000 7f19cc946700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19c8155740 con 0x7f19c8064d80 2023-12-22T10:01:44.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:44.396+0000 7f19cc946700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19c80c40f0 con 0x7f19c81518f0 2023-12-22T10:01:44.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:44.396+0000 7f19cc946700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19c80a61b0 con 0x7f19c8151cd0 2023-12-22T10:01:44.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:44.396+0000 7f19c6d9d700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f19c8064d80 0x7f19c80c3160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:58828/0 (socket says 172.21.15.45:58828) 2023-12-22T10:01:44.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:44.396+0000 7f19c6d9d700 1 -- 172.21.15.45:0/4013998588 learned_addr learned my addr 172.21.15.45:0/4013998588 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:01:44.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:44.396+0000 7f19c659c700 1 --2- 172.21.15.45:0/4013998588 >> v2:172.21.15.45:3300/0 conn(0x7f19c81518f0 0x7f19c8064890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:44.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:44.396+0000 7f19bffff700 1 --2- 172.21.15.45:0/4013998588 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f19c8151cd0 0x7f19c80a6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:44.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:44.396+0000 7f19c5d9b700 1 -- 172.21.15.45:0/4013998588 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1782442496 0 0) 0x7f19c8155740 con 0x7f19c8064d80 2023-12-22T10:01:44.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:44.396+0000 7f19c659c700 1 -- 172.21.15.45:0/4013998588 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f19c8151cd0 msgr2=0x7f19c80a6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:44.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:44.396+0000 7f19c659c700 1 --2- 172.21.15.45:0/4013998588 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f19c8151cd0 0x7f19c80a6d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:44.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:44.396+0000 7f19c659c700 1 -- 172.21.15.45:0/4013998588 >> v1:172.21.15.45:6789/0 conn(0x7f19c8064d80 legacy=0x7f19c80c3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:44.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:44.396+0000 7f19c659c700 1 -- 172.21.15.45:0/4013998588 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19c80a5910 con 0x7f19c81518f0 2023-12-22T10:01:44.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:44.400+0000 7f19c659c700 1 --2- 172.21.15.45:0/4013998588 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19c81518f0 0x7f19c8064890 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7f19b8009760 tx=0x7f19b8009060).ready entity=mon.0 client_cookie=4001988dd187c9a7 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:44.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:44.400+0000 7f19c5d9b700 1 -- 172.21.15.45:0/4013998588 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b800f510 con 0x7f19c81518f0 2023-12-22T10:01:44.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:44.400+0000 7f19c5d9b700 1 -- 172.21.15.45:0/4013998588 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19b800f670 con 0x7f19c81518f0 2023-12-22T10:01:44.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:44.400+0000 7f19c5d9b700 1 -- 172.21.15.45:0/4013998588 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b800f9f0 con 0x7f19c81518f0 2023-12-22T10:01:44.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:44.400+0000 7f19cc946700 1 -- 172.21.15.45:0/4013998588 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19c81518f0 msgr2=0x7f19c8064890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:44.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:44.400+0000 7f19cc946700 1 --2- 172.21.15.45:0/4013998588 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19c81518f0 0x7f19c8064890 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7f19b8009760 tx=0x7f19b8009060).stop 2023-12-22T10:01:44.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:44.400+0000 7f19cc946700 1 -- 172.21.15.45:0/4013998588 shutdown_connections 2023-12-22T10:01:44.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:44.400+0000 7f19cc946700 1 --2- 172.21.15.45:0/4013998588 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f19c8151cd0 0x7f19c80a6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:44.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:44.400+0000 7f19cc946700 1 --2- 172.21.15.45:0/4013998588 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19c81518f0 0x7f19c8064890 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:44.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:44.400+0000 7f19cc946700 1 -- 172.21.15.45:0/4013998588 >> 172.21.15.45:0/4013998588 conn(0x7f19c8066a70 msgr2=0x7f19c8066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:44.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:44.400+0000 7f19cc946700 1 -- 172.21.15.45:0/4013998588 shutdown_connections 2023-12-22T10:01:44.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:44.400+0000 7f19cc946700 1 -- 172.21.15.45:0/4013998588 wait complete. 2023-12-22T10:01:44.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:44.404+0000 7f19cc946700 1 Processor -- start 2023-12-22T10:01:44.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:44.404+0000 7f19cc946700 1 -- start start 2023-12-22T10:01:44.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:44.404+0000 7f19cc946700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f19c8064d80 0x7f19c814dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:44.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:44.404+0000 7f19cc946700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19c81518f0 0x7f19c814e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:44.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:44.404+0000 7f19cc946700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f19c8151cd0 0x7f19c814b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:44.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:44.404+0000 7f19cc946700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19c814e290 con 0x7f19c81518f0 2023-12-22T10:01:44.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:44.404+0000 7f19cc946700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19c80aa6a0 con 0x7f19c8151cd0 2023-12-22T10:01:44.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:44.404+0000 7f19cc946700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19c80aa980 con 0x7f19c8064d80 2023-12-22T10:01:44.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:44.404+0000 7f19bffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19c81518f0 0x7f19c814e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:44.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:44.404+0000 7f19bffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19c81518f0 0x7f19c814e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37132/0 (socket says 172.21.15.45:37132) 2023-12-22T10:01:44.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:44.404+0000 7f19bffff700 1 -- 172.21.15.45:0/3520957398 learned_addr learned my addr 172.21.15.45:0/3520957398 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:44.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:44.404+0000 7f19c659c700 1 --2- 172.21.15.45:0/3520957398 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f19c8064d80 0x7f19c814dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:44.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:44.404+0000 7f19c6d9d700 1 --2- 172.21.15.45:0/3520957398 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f19c8151cd0 0x7f19c814b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:44.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:44.408+0000 7f19bffff700 1 -- 172.21.15.45:0/3520957398 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f19c8064d80 msgr2=0x7f19c814dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:44.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:44.408+0000 7f19bffff700 1 --2- 172.21.15.45:0/3520957398 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f19c8064d80 0x7f19c814dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:44.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:44.408+0000 7f19bffff700 1 -- 172.21.15.45:0/3520957398 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f19c8151cd0 msgr2=0x7f19c814b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:44.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:44.408+0000 7f19bffff700 1 --2- 172.21.15.45:0/3520957398 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f19c8151cd0 0x7f19c814b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:44.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:44.408+0000 7f19bffff700 1 -- 172.21.15.45:0/3520957398 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19b80092a0 con 0x7f19c81518f0 2023-12-22T10:01:44.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:44.408+0000 7f19bffff700 1 --2- 172.21.15.45:0/3520957398 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19c81518f0 0x7f19c814e690 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7f19b000e900 tx=0x7f19b0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:44.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:44.408+0000 7f19be7fc700 1 -- 172.21.15.45:0/3520957398 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b0012600 con 0x7f19c81518f0 2023-12-22T10:01:44.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:44.408+0000 7f19be7fc700 1 -- 172.21.15.45:0/3520957398 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19b0012760 con 0x7f19c81518f0 2023-12-22T10:01:44.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:44.408+0000 7f19be7fc700 1 -- 172.21.15.45:0/3520957398 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b0012ae0 con 0x7f19c81518f0 2023-12-22T10:01:44.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:44.408+0000 7f19cc946700 1 -- 172.21.15.45:0/3520957398 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19c80aaf00 con 0x7f19c81518f0 2023-12-22T10:01:44.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:44.408+0000 7f19cc946700 1 -- 172.21.15.45:0/3520957398 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19c814bd80 con 0x7f19c81518f0 2023-12-22T10:01:44.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:44.408+0000 7f19cc946700 1 -- 172.21.15.45:0/3520957398 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19c806c070 con 0x7f19c81518f0 2023-12-22T10:01:44.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:44.412+0000 7f19be7fc700 1 -- 172.21.15.45:0/3520957398 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f19b001b400 con 0x7f19c81518f0 2023-12-22T10:01:44.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:44.412+0000 7f19be7fc700 1 --2- 172.21.15.45:0/3520957398 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f19a805a510 0x7f19a805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:44.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:44.412+0000 7f19be7fc700 1 -- 172.21.15.45:0/3520957398 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f19b0074b70 con 0x7f19c81518f0 2023-12-22T10:01:44.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:44.412+0000 7f19c659c700 1 --2- 172.21.15.45:0/3520957398 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f19a805a510 0x7f19a805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:44.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:44.412+0000 7f19c659c700 1 --2- 172.21.15.45:0/3520957398 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f19a805a510 0x7f19a805c9d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f19b8009fd0 tx=0x7f19b8017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:44.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:44.420+0000 7f19be7fc700 1 -- 172.21.15.45:0/3520957398 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f19b0048230 con 0x7f19c81518f0 2023-12-22T10:01:44.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:44.624+0000 7f19cc946700 1 -- 172.21.15.45:0/3520957398 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f19c80a5bf0 con 0x7f19c81518f0 2023-12-22T10:01:44.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:44.628+0000 7f19be7fc700 1 -- 172.21.15.45:0/3520957398 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4492 (secure 0 0 0) 0x7f19b004b850 con 0x7f19c81518f0 2023-12-22T10:01:44.626 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:01:44.626 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4733,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6833/2948398569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6832","nonce":2948398569},{"type":"v1","addr":"172.21.15.113:6833","nonce":2948398569}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4736,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6835/1576156444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":1576156444},{"type":"v1","addr":"172.21.15.113:6835","nonce":1576156444}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4742,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/249598849","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":249598849},{"type":"v1","addr":"172.21.15.45:6837","nonce":249598849}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T10:01:35.105595+0000","modified":"2023-12-22T10:01:38.130062+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4980},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4980":{"gid":4980,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.45:6835/1879154206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1879154206},{"type":"v1","addr":"172.21.15.45:6835","nonce":1879154206}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-12-22T10:01:44.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:44.628+0000 7f19cc946700 1 -- 172.21.15.45:0/3520957398 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f19a805a510 msgr2=0x7f19a805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:44.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:44.628+0000 7f19cc946700 1 --2- 172.21.15.45:0/3520957398 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f19a805a510 0x7f19a805c9d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f19b8009fd0 tx=0x7f19b8017000).stop 2023-12-22T10:01:44.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:44.628+0000 7f19cc946700 1 -- 172.21.15.45:0/3520957398 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19c81518f0 msgr2=0x7f19c814e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:44.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:44.628+0000 7f19cc946700 1 --2- 172.21.15.45:0/3520957398 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19c81518f0 0x7f19c814e690 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7f19b000e900 tx=0x7f19b0009060).stop 2023-12-22T10:01:44.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:44.628+0000 7f19cc946700 1 -- 172.21.15.45:0/3520957398 shutdown_connections 2023-12-22T10:01:44.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:44.628+0000 7f19cc946700 1 --2- 172.21.15.45:0/3520957398 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f19c8151cd0 0x7f19c814b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:44.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:44.628+0000 7f19cc946700 1 --2- 172.21.15.45:0/3520957398 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19c81518f0 0x7f19c814e690 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:44.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:44.628+0000 7f19cc946700 1 --2- 172.21.15.45:0/3520957398 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f19a805a510 0x7f19a805c9d0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:44.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:44.628+0000 7f19cc946700 1 --2- 172.21.15.45:0/3520957398 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f19c8064d80 0x7f19c814dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:44.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:44.628+0000 7f19cc946700 1 -- 172.21.15.45:0/3520957398 >> 172.21.15.45:0/3520957398 conn(0x7f19c8066a70 msgr2=0x7f19c80a8ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:44.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:44.628+0000 7f19cc946700 1 -- 172.21.15.45:0/3520957398 shutdown_connections 2023-12-22T10:01:44.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:44.628+0000 7f19cc946700 1 -- 172.21.15.45:0/3520957398 wait complete. 2023-12-22T10:01:44.631 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 16 2023-12-22T10:01:44.647 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2023-12-22T10:01:44.840 INFO:teuthology.orchestra.run.smithi045.stdout:{"message":"","return_code":0} 2023-12-22T10:01:44.841 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2023-12-22T10:01:44.841 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-22T10:01:45.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:45.004+0000 7fafb5f69700 1 Processor -- start 2023-12-22T10:01:45.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:45.004+0000 7fafb5f69700 1 -- start start 2023-12-22T10:01:45.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:45.008+0000 7fafb5f69700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fafb00c02e0 0x7fafb0153e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:45.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:45.008+0000 7fafb5f69700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafb00c3c70 con 0x7fafb0067590 2023-12-22T10:01:45.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:45.008+0000 7fafb5f69700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafb00c27d0 con 0x7fafb0153aa0 2023-12-22T10:01:45.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:45.008+0000 7fafb5f69700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafb0065870 con 0x7fafb00c02e0 2023-12-22T10:01:45.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:45.008+0000 7fafaffff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fafb0067590 0x7fafb0154370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:58840/0 (socket says 172.21.15.45:58840) 2023-12-22T10:01:45.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:45.008+0000 7fafaffff700 1 -- 172.21.15.45:0/3151542668 learned_addr learned my addr 172.21.15.45:0/3151542668 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:01:45.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:45.008+0000 7fafa7fff700 1 --2- 172.21.15.45:0/3151542668 >> v2:172.21.15.113:3300/0 conn(0x7fafb00c02e0 0x7fafb0153e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:45.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:45.008+0000 7fafaeffd700 1 -- 172.21.15.45:0/3151542668 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4237997194 0 0) 0x7fafb00c3c70 con 0x7fafb0067590 2023-12-22T10:01:45.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:45.008+0000 7fafaeffd700 1 -- 172.21.15.45:0/3151542668 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf9c0033f0 con 0x7fafb0067590 2023-12-22T10:01:45.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:45.008+0000 7fafa7fff700 1 -- 172.21.15.45:0/3151542668 >> v1:172.21.15.113:6789/0 conn(0x7fafb0153aa0 legacy=0x7fafb00bfbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:45.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:45.008+0000 7fafa7fff700 1 -- 172.21.15.45:0/3151542668 >> v1:172.21.15.45:6789/0 conn(0x7fafb0067590 legacy=0x7fafb0154370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:45.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:45.008+0000 7fafa7fff700 1 -- 172.21.15.45:0/3151542668 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafb0065b50 con 0x7fafb00c02e0 2023-12-22T10:01:45.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:45.012+0000 7fafa7fff700 1 --2- 172.21.15.45:0/3151542668 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fafb00c02e0 0x7fafb0153e80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7faf98009760 tx=0x7faf98009060).ready entity=mon.1 client_cookie=87dec77ac67bafd2 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:45.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:45.012+0000 7fafaeffd700 1 -- 172.21.15.45:0/3151542668 <== mon.1 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf9800f510 con 0x7fafb00c02e0 2023-12-22T10:01:45.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:45.012+0000 7fafaeffd700 1 -- 172.21.15.45:0/3151542668 <== mon.1 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf9800f670 con 0x7fafb00c02e0 2023-12-22T10:01:45.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:45.012+0000 7fafaeffd700 1 -- 172.21.15.45:0/3151542668 <== mon.1 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf9800f9f0 con 0x7fafb00c02e0 2023-12-22T10:01:45.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:45.012+0000 7fafb5f69700 1 -- 172.21.15.45:0/3151542668 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fafb00c02e0 msgr2=0x7fafb0153e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:45.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:45.012+0000 7fafb5f69700 1 --2- 172.21.15.45:0/3151542668 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fafb00c02e0 0x7fafb0153e80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7faf98009760 tx=0x7faf98009060).stop 2023-12-22T10:01:45.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:45.012+0000 7fafb5f69700 1 -- 172.21.15.45:0/3151542668 shutdown_connections 2023-12-22T10:01:45.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:45.012+0000 7fafb5f69700 1 --2- 172.21.15.45:0/3151542668 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fafb00c02e0 0x7fafb0153e80 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:45.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:45.012+0000 7fafb5f69700 1 -- 172.21.15.45:0/3151542668 >> 172.21.15.45:0/3151542668 conn(0x7fafb0066a70 msgr2=0x7fafb0066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:45.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:45.012+0000 7fafb5f69700 1 -- 172.21.15.45:0/3151542668 shutdown_connections 2023-12-22T10:01:45.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:45.012+0000 7fafb5f69700 1 -- 172.21.15.45:0/3151542668 wait complete. 2023-12-22T10:01:45.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:45.016+0000 7fafb5f69700 1 Processor -- start 2023-12-22T10:01:45.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:45.016+0000 7fafb5f69700 1 -- start start 2023-12-22T10:01:45.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:45.016+0000 7fafb5f69700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafb0067590 0x7fafb00a77c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:45.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:45.016+0000 7fafb5f69700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fafb00c02e0 0x7fafb00a8f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:45.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:45.016+0000 7fafb5f69700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fafb0153aa0 0x7fafb014f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:45.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:45.016+0000 7fafb5f69700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafb00a8a70 con 0x7fafb0067590 2023-12-22T10:01:45.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:45.016+0000 7fafb5f69700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafb00a93f0 con 0x7fafb00c02e0 2023-12-22T10:01:45.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:45.016+0000 7fafb5f69700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafb00a7e60 con 0x7fafb0153aa0 2023-12-22T10:01:45.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:45.020+0000 7fafaf7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafb0067590 0x7fafb00a77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:45.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:45.020+0000 7fafaf7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafb0067590 0x7fafb00a77c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37146/0 (socket says 172.21.15.45:37146) 2023-12-22T10:01:45.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:45.020+0000 7fafa7fff700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fafb00c02e0 0x7fafb00a8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:45.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:45.020+0000 7fafaf7fe700 1 -- 172.21.15.45:0/1142252361 learned_addr learned my addr 172.21.15.45:0/1142252361 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:45.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:45.020+0000 7fafaffff700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fafb0153aa0 0x7fafb014f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:45.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:45.020+0000 7fafaf7fe700 1 -- 172.21.15.45:0/1142252361 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fafb0153aa0 msgr2=0x7fafb014f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:45.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:45.020+0000 7fafaf7fe700 1 --2- 172.21.15.45:0/1142252361 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fafb0153aa0 0x7fafb014f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:45.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:45.020+0000 7fafaf7fe700 1 -- 172.21.15.45:0/1142252361 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fafb00c02e0 msgr2=0x7fafb00a8f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:45.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:45.020+0000 7fafaf7fe700 1 --2- 172.21.15.45:0/1142252361 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fafb00c02e0 0x7fafb00a8f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:45.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:45.020+0000 7fafaf7fe700 1 -- 172.21.15.45:0/1142252361 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf980092a0 con 0x7fafb0067590 2023-12-22T10:01:45.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:45.020+0000 7fafa7fff700 1 --2- 172.21.15.45:0/1142252361 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fafb00c02e0 0x7fafb00a8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-12-22T10:01:45.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:45.020+0000 7fafaf7fe700 1 --2- 172.21.15.45:0/1142252361 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafb0067590 0x7fafb00a77c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7fafa000c470 tx=0x7fafa0007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:45.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:45.020+0000 7fafa77fe700 1 -- 172.21.15.45:0/1142252361 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa0007020 con 0x7fafb0067590 2023-12-22T10:01:45.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:45.020+0000 7fafa77fe700 1 -- 172.21.15.45:0/1142252361 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafa0007180 con 0x7fafb0067590 2023-12-22T10:01:45.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:45.020+0000 7fafb5f69700 1 -- 172.21.15.45:0/1142252361 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafb00a8140 con 0x7fafb0067590 2023-12-22T10:01:45.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:45.020+0000 7fafa77fe700 1 -- 172.21.15.45:0/1142252361 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa0007520 con 0x7fafb0067590 2023-12-22T10:01:45.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:45.020+0000 7fafb5f69700 1 -- 172.21.15.45:0/1142252361 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafb00a8700 con 0x7fafb0067590 2023-12-22T10:01:45.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:45.024+0000 7fafb5f69700 1 -- 172.21.15.45:0/1142252361 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafb00671b0 con 0x7fafb0067590 2023-12-22T10:01:45.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:45.024+0000 7fafa77fe700 1 -- 172.21.15.45:0/1142252361 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fafa00068b0 con 0x7fafb0067590 2023-12-22T10:01:45.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:45.024+0000 7fafa77fe700 1 --2- 172.21.15.45:0/1142252361 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7faf9005a4e0 0x7faf9005c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:45.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:45.024+0000 7fafa77fe700 1 -- 172.21.15.45:0/1142252361 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fafa0073a10 con 0x7fafb0067590 2023-12-22T10:01:45.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:45.024+0000 7fafa7fff700 1 --2- 172.21.15.45:0/1142252361 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7faf9005a4e0 0x7faf9005c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:45.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:45.028+0000 7fafa7fff700 1 --2- 172.21.15.45:0/1142252361 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7faf9005a4e0 0x7faf9005c9a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7fafb00c06e0 tx=0x7faf98017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:45.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:45.032+0000 7fafa77fe700 1 -- 172.21.15.45:0/1142252361 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fafa00471f0 con 0x7fafb0067590 2023-12-22T10:01:45.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:45.236+0000 7fafb5f69700 1 -- 172.21.15.45:0/1142252361 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fafb006c070 con 0x7fafb0067590 2023-12-22T10:01:46.036 INFO:tasks.ceph.mon.a.smithi045.stderr:2023-12-22T10:01:46.036+0000 7fd344a42700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-22T10:01:46.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.048+0000 7fafa77fe700 1 -- 172.21.15.45:0/1142252361 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v17) v1 ==== 161+0+0 (secure 0 0 0) 0x7fafa004a810 con 0x7fafb0067590 2023-12-22T10:01:46.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.052+0000 7fafb5f69700 1 -- 172.21.15.45:0/1142252361 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7faf9005a4e0 msgr2=0x7faf9005c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:46.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.052+0000 7fafb5f69700 1 --2- 172.21.15.45:0/1142252361 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7faf9005a4e0 0x7faf9005c9a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7fafb00c06e0 tx=0x7faf98017000).stop 2023-12-22T10:01:46.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.052+0000 7fafb5f69700 1 -- 172.21.15.45:0/1142252361 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafb0067590 msgr2=0x7fafb00a77c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:46.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.052+0000 7fafb5f69700 1 --2- 172.21.15.45:0/1142252361 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafb0067590 0x7fafb00a77c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7fafa000c470 tx=0x7fafa0007e00).stop 2023-12-22T10:01:46.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.052+0000 7fafb5f69700 1 -- 172.21.15.45:0/1142252361 shutdown_connections 2023-12-22T10:01:46.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.052+0000 7fafb5f69700 1 --2- 172.21.15.45:0/1142252361 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7faf9005a4e0 0x7faf9005c9a0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:46.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.052+0000 7fafb5f69700 1 --2- 172.21.15.45:0/1142252361 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fafb0153aa0 0x7fafb014f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:46.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.052+0000 7fafb5f69700 1 --2- 172.21.15.45:0/1142252361 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fafb00c02e0 0x7fafb00a8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:46.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.052+0000 7fafb5f69700 1 --2- 172.21.15.45:0/1142252361 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafb0067590 0x7fafb00a77c0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:46.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.052+0000 7fafb5f69700 1 -- 172.21.15.45:0/1142252361 >> 172.21.15.45:0/1142252361 conn(0x7fafb0066a70 msgr2=0x7fafb0151410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:46.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.052+0000 7fafb5f69700 1 -- 172.21.15.45:0/1142252361 shutdown_connections 2023-12-22T10:01:46.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.052+0000 7fafb5f69700 1 -- 172.21.15.45:0/1142252361 wait complete. 2023-12-22T10:01:46.055 INFO:teuthology.orchestra.run.smithi045.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-22T10:01:46.062 INFO:tasks.ceph.mds.c.smithi045.stderr: -3042> 2023-12-22T10:01:36.204+0000 7fe4cdcf3700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-22T10:01:46.073 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-22T10:01:46.078 DEBUG:teuthology.orchestra.run.smithi113:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-22T10:01:46.108 INFO:tasks.ceph.mds.c.smithi045.stdout:starting mds.c at 2023-12-22T10:01:46.140 INFO:teuthology.orchestra.run.smithi045.stdout:[global] 2023-12-22T10:01:46.140 INFO:teuthology.orchestra.run.smithi045.stdout: chdir = "" 2023-12-22T10:01:46.140 INFO:teuthology.orchestra.run.smithi045.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-22T10:01:46.140 INFO:teuthology.orchestra.run.smithi045.stdout: auth supported = cephx 2023-12-22T10:01:46.141 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:01:46.141 INFO:teuthology.orchestra.run.smithi045.stdout: filestore xattr use omap = true 2023-12-22T10:01:46.141 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:01:46.141 INFO:teuthology.orchestra.run.smithi045.stdout: mon clock drift allowed = 1.000 2023-12-22T10:01:46.141 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:01:46.141 INFO:teuthology.orchestra.run.smithi045.stdout: osd crush chooseleaf type = 0 2023-12-22T10:01:46.141 INFO:teuthology.orchestra.run.smithi045.stdout: auth debug = true 2023-12-22T10:01:46.141 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:01:46.141 INFO:teuthology.orchestra.run.smithi045.stdout: ms die on old message = true 2023-12-22T10:01:46.141 INFO:teuthology.orchestra.run.smithi045.stdout: ms die on bug = true 2023-12-22T10:01:46.141 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:01:46.141 INFO:teuthology.orchestra.run.smithi045.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-22T10:01:46.141 INFO:teuthology.orchestra.run.smithi045.stdout: mon pg warn max object skew = 0 2023-12-22T10:01:46.141 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:01:46.142 INFO:teuthology.orchestra.run.smithi045.stdout: # disable pg_autoscaler by default for new pools 2023-12-22T10:01:46.142 INFO:teuthology.orchestra.run.smithi045.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-22T10:01:46.142 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:01:46.142 INFO:teuthology.orchestra.run.smithi045.stdout: osd pool default size = 2 2023-12-22T10:01:46.142 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:01:46.142 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd allow primary affinity = true 2023-12-22T10:01:46.142 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd allow pg remap = true 2023-12-22T10:01:46.142 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on legacy crush tunables = false 2023-12-22T10:01:46.142 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on crush straw calc version zero = false 2023-12-22T10:01:46.142 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on no sortbitwise = false 2023-12-22T10:01:46.142 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on osd down out interval zero = false 2023-12-22T10:01:46.142 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on too few osds = false 2023-12-22T10:01:46.142 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-22T10:01:46.142 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-22T10:01:46.142 INFO:teuthology.orchestra.run.smithi045.stdout: mon_allow_pool_size_one = true 2023-12-22T10:01:46.142 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:01:46.143 INFO:teuthology.orchestra.run.smithi045.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2023-12-22T10:01:46.143 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:01:46.143 INFO:teuthology.orchestra.run.smithi045.stdout: osd default data pool replay window = 5 2023-12-22T10:01:46.143 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:01:46.143 INFO:teuthology.orchestra.run.smithi045.stdout: mon allow pool delete = true 2023-12-22T10:01:46.143 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:01:46.143 INFO:teuthology.orchestra.run.smithi045.stdout: mon cluster log file level = debug 2023-12-22T10:01:46.143 INFO:teuthology.orchestra.run.smithi045.stdout: debug asserts on shutdown = true 2023-12-22T10:01:46.143 INFO:teuthology.orchestra.run.smithi045.stdout: mon health detail to clog = false 2023-12-22T10:01:46.143 INFO:teuthology.orchestra.run.smithi045.stdout: mon host = "172.21.15.45,172.21.15.113,[v2:172.21.15.113:3301,v1:172.21.15.113:6790]" 2023-12-22T10:01:46.143 INFO:teuthology.orchestra.run.smithi045.stdout: fsid = 98b0837e-5e68-4c8f-a1a0-e9424baaad8f 2023-12-22T10:01:46.143 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:01:46.143 INFO:teuthology.orchestra.run.smithi045.stdout:[osd] 2023-12-22T10:01:46.143 INFO:teuthology.orchestra.run.smithi045.stdout: osd journal size = 100 2023-12-22T10:01:46.143 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:01:46.144 INFO:teuthology.orchestra.run.smithi045.stdout: osd scrub load threshold = 5.0 2023-12-22T10:01:46.144 INFO:teuthology.orchestra.run.smithi045.stdout: osd scrub max interval = 600 2023-12-22T10:01:46.144 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:01:46.144 INFO:teuthology.orchestra.run.smithi045.stdout: osd recover clone overlap = true 2023-12-22T10:01:46.144 INFO:teuthology.orchestra.run.smithi045.stdout: osd recovery max chunk = 1048576 2023-12-22T10:01:46.144 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:01:46.144 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug shutdown = true 2023-12-22T10:01:46.144 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug op order = true 2023-12-22T10:01:46.144 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug verify stray on activate = true 2023-12-22T10:01:46.144 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:01:46.144 INFO:teuthology.orchestra.run.smithi045.stdout: osd open classes on start = true 2023-12-22T10:01:46.144 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug pg log writeout = true 2023-12-22T10:01:46.144 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:01:46.144 INFO:teuthology.orchestra.run.smithi045.stdout: osd deep scrub update digest min age = 30 2023-12-22T10:01:46.144 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:01:46.144 INFO:teuthology.orchestra.run.smithi045.stdout: osd map max advance = 10 2023-12-22T10:01:46.145 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:01:46.145 INFO:teuthology.orchestra.run.smithi045.stdout: journal zero on create = true 2023-12-22T10:01:46.145 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:01:46.145 INFO:teuthology.orchestra.run.smithi045.stdout: filestore ondisk finisher threads = 3 2023-12-22T10:01:46.145 INFO:teuthology.orchestra.run.smithi045.stdout: filestore apply finisher threads = 3 2023-12-22T10:01:46.145 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:01:46.145 INFO:teuthology.orchestra.run.smithi045.stdout: bdev debug aio = true 2023-12-22T10:01:46.145 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug misdirected ops = true 2023-12-22T10:01:46.145 INFO:teuthology.orchestra.run.smithi045.stdout: bdev async discard = True 2023-12-22T10:01:46.145 INFO:teuthology.orchestra.run.smithi045.stdout: bdev enable discard = True 2023-12-22T10:01:46.145 INFO:teuthology.orchestra.run.smithi045.stdout: bluestore allocator = bitmap 2023-12-22T10:01:46.145 INFO:teuthology.orchestra.run.smithi045.stdout: bluestore block size = 96636764160 2023-12-22T10:01:46.145 INFO:teuthology.orchestra.run.smithi045.stdout: bluestore fsck on mount = True 2023-12-22T10:01:46.145 INFO:teuthology.orchestra.run.smithi045.stdout: debug bluefs = 1/20 2023-12-22T10:01:46.146 INFO:teuthology.orchestra.run.smithi045.stdout: debug bluestore = 1/20 2023-12-22T10:01:46.146 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-12-22T10:01:46.146 INFO:teuthology.orchestra.run.smithi045.stdout: debug osd = 20 2023-12-22T10:01:46.146 INFO:teuthology.orchestra.run.smithi045.stdout: debug rocksdb = 4/10 2023-12-22T10:01:46.146 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd backfillfull_ratio = 0.85 2023-12-22T10:01:46.146 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd full ratio = 0.9 2023-12-22T10:01:46.146 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd nearfull ratio = 0.8 2023-12-22T10:01:46.146 INFO:teuthology.orchestra.run.smithi045.stdout: osd failsafe full ratio = 0.95 2023-12-22T10:01:46.146 INFO:teuthology.orchestra.run.smithi045.stdout: osd objectstore = bluestore 2023-12-22T10:01:46.146 INFO:teuthology.orchestra.run.smithi045.stdout: osd op complaint time = 180 2023-12-22T10:01:46.146 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:01:46.146 INFO:teuthology.orchestra.run.smithi045.stdout:[mgr] 2023-12-22T10:01:46.146 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-12-22T10:01:46.146 INFO:teuthology.orchestra.run.smithi045.stdout: debug mgr = 20 2023-12-22T10:01:46.146 INFO:teuthology.orchestra.run.smithi045.stdout: debug mon = 20 2023-12-22T10:01:46.147 INFO:teuthology.orchestra.run.smithi045.stdout: debug auth = 20 2023-12-22T10:01:46.147 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min pgs per osd = 4 2023-12-22T10:01:46.147 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min bytes per osd = 10 2023-12-22T10:01:46.147 INFO:teuthology.orchestra.run.smithi045.stdout: mgr/telemetry/nag = false 2023-12-22T10:01:46.147 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:01:46.147 INFO:teuthology.orchestra.run.smithi045.stdout:[mon] 2023-12-22T10:01:46.147 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-12-22T10:01:46.147 INFO:teuthology.orchestra.run.smithi045.stdout: debug mon = 20 2023-12-22T10:01:46.147 INFO:teuthology.orchestra.run.smithi045.stdout: debug paxos = 20 2023-12-22T10:01:46.147 INFO:teuthology.orchestra.run.smithi045.stdout: debug auth = 20 2023-12-22T10:01:46.147 INFO:teuthology.orchestra.run.smithi045.stdout: mon data avail warn = 5 2023-12-22T10:01:46.147 INFO:teuthology.orchestra.run.smithi045.stdout: mon mgr mkfs grace = 240 2023-12-22T10:01:46.147 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min pgs per osd = 4 2023-12-22T10:01:46.147 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd reporter subtree level = osd 2023-12-22T10:01:46.147 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd prime pg temp = true 2023-12-22T10:01:46.148 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min bytes per osd = 10 2023-12-22T10:01:46.148 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:01:46.148 INFO:teuthology.orchestra.run.smithi045.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-22T10:01:46.148 INFO:teuthology.orchestra.run.smithi045.stdout: auth mon ticket ttl = 660 # 11m 2023-12-22T10:01:46.148 INFO:teuthology.orchestra.run.smithi045.stdout: auth service ticket ttl = 240 # 4m 2023-12-22T10:01:46.148 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:01:46.148 INFO:teuthology.orchestra.run.smithi045.stdout: # don't complain about insecure global_id in the test suite 2023-12-22T10:01:46.148 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-22T10:01:46.148 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-22T10:01:46.148 INFO:teuthology.orchestra.run.smithi045.stdout: mon op complaint time = 120 2023-12-22T10:01:46.148 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:01:46.148 INFO:teuthology.orchestra.run.smithi045.stdout:[client] 2023-12-22T10:01:46.148 INFO:teuthology.orchestra.run.smithi045.stdout: rgw cache enabled = true 2023-12-22T10:01:46.148 INFO:teuthology.orchestra.run.smithi045.stdout: rgw enable ops log = true 2023-12-22T10:01:46.148 INFO:teuthology.orchestra.run.smithi045.stdout: rgw enable usage log = true 2023-12-22T10:01:46.148 INFO:teuthology.orchestra.run.smithi045.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-22T10:01:46.149 INFO:teuthology.orchestra.run.smithi045.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-22T10:01:46.149 INFO:teuthology.orchestra.run.smithi045.stdout: client mount timeout = 600 2023-12-22T10:01:46.149 INFO:teuthology.orchestra.run.smithi045.stdout: debug client = 20 2023-12-22T10:01:46.149 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-12-22T10:01:46.149 INFO:teuthology.orchestra.run.smithi045.stdout: pid file = "" 2023-12-22T10:01:46.149 INFO:teuthology.orchestra.run.smithi045.stdout: rados mon op timeout = 900 2023-12-22T10:01:46.149 INFO:teuthology.orchestra.run.smithi045.stdout: rados osd op timeout = 900 2023-12-22T10:01:46.149 INFO:teuthology.orchestra.run.smithi045.stdout:[mon.a] 2023-12-22T10:01:46.149 INFO:teuthology.orchestra.run.smithi045.stdout:[mon.b] 2023-12-22T10:01:46.149 INFO:teuthology.orchestra.run.smithi045.stdout:[mon.c] 2023-12-22T10:01:46.149 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.a] 2023-12-22T10:01:46.149 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.c] 2023-12-22T10:01:46.149 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.b] 2023-12-22T10:01:46.149 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.d] 2023-12-22T10:01:46.149 INFO:teuthology.orchestra.run.smithi045.stdout:[mds] 2023-12-22T10:01:46.150 INFO:teuthology.orchestra.run.smithi045.stdout: debug mds = 20 2023-12-22T10:01:46.150 INFO:teuthology.orchestra.run.smithi045.stdout: debug mds balancer = 20 2023-12-22T10:01:46.150 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-12-22T10:01:46.150 INFO:teuthology.orchestra.run.smithi045.stdout: mds debug frag = True 2023-12-22T10:01:46.150 INFO:teuthology.orchestra.run.smithi045.stdout: mds debug scatterstat = True 2023-12-22T10:01:46.150 INFO:teuthology.orchestra.run.smithi045.stdout: mds op complaint time = 180 2023-12-22T10:01:46.150 INFO:teuthology.orchestra.run.smithi045.stdout: mds verify scatter = False 2023-12-22T10:01:46.150 INFO:teuthology.orchestra.run.smithi045.stdout: osd op complaint time = 180 2023-12-22T10:01:46.150 INFO:teuthology.orchestra.run.smithi045.stdout: rados mon op timeout = 900 2023-12-22T10:01:46.150 INFO:teuthology.orchestra.run.smithi045.stdout: rados osd op timeout = 900 2023-12-22T10:01:46.160 INFO:teuthology.orchestra.run.smithi113.stdout:[global] 2023-12-22T10:01:46.160 INFO:teuthology.orchestra.run.smithi113.stdout: chdir = "" 2023-12-22T10:01:46.161 INFO:teuthology.orchestra.run.smithi113.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-22T10:01:46.161 INFO:teuthology.orchestra.run.smithi113.stdout: auth supported = cephx 2023-12-22T10:01:46.161 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-22T10:01:46.161 INFO:teuthology.orchestra.run.smithi113.stdout: filestore xattr use omap = true 2023-12-22T10:01:46.161 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-22T10:01:46.161 INFO:teuthology.orchestra.run.smithi113.stdout: mon clock drift allowed = 1.000 2023-12-22T10:01:46.161 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-22T10:01:46.161 INFO:teuthology.orchestra.run.smithi113.stdout: osd crush chooseleaf type = 0 2023-12-22T10:01:46.161 INFO:teuthology.orchestra.run.smithi113.stdout: auth debug = true 2023-12-22T10:01:46.161 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-22T10:01:46.161 INFO:teuthology.orchestra.run.smithi113.stdout: ms die on old message = true 2023-12-22T10:01:46.161 INFO:teuthology.orchestra.run.smithi113.stdout: ms die on bug = true 2023-12-22T10:01:46.162 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-22T10:01:46.162 INFO:teuthology.orchestra.run.smithi113.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-22T10:01:46.162 INFO:teuthology.orchestra.run.smithi113.stdout: mon pg warn max object skew = 0 2023-12-22T10:01:46.163 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-22T10:01:46.163 INFO:teuthology.orchestra.run.smithi113.stdout: # disable pg_autoscaler by default for new pools 2023-12-22T10:01:46.164 INFO:teuthology.orchestra.run.smithi113.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-22T10:01:46.164 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-22T10:01:46.164 INFO:teuthology.orchestra.run.smithi113.stdout: osd pool default size = 2 2023-12-22T10:01:46.164 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-22T10:01:46.165 INFO:teuthology.orchestra.run.smithi113.stdout: mon osd allow primary affinity = true 2023-12-22T10:01:46.165 INFO:teuthology.orchestra.run.smithi113.stdout: mon osd allow pg remap = true 2023-12-22T10:01:46.165 INFO:teuthology.orchestra.run.smithi113.stdout: mon warn on legacy crush tunables = false 2023-12-22T10:01:46.165 INFO:teuthology.orchestra.run.smithi113.stdout: mon warn on crush straw calc version zero = false 2023-12-22T10:01:46.165 INFO:teuthology.orchestra.run.smithi113.stdout: mon warn on no sortbitwise = false 2023-12-22T10:01:46.165 INFO:teuthology.orchestra.run.smithi113.stdout: mon warn on osd down out interval zero = false 2023-12-22T10:01:46.165 INFO:teuthology.orchestra.run.smithi113.stdout: mon warn on too few osds = false 2023-12-22T10:01:46.165 INFO:teuthology.orchestra.run.smithi113.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-22T10:01:46.165 INFO:teuthology.orchestra.run.smithi113.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-22T10:01:46.165 INFO:teuthology.orchestra.run.smithi113.stdout: mon_allow_pool_size_one = true 2023-12-22T10:01:46.165 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-22T10:01:46.165 INFO:teuthology.orchestra.run.smithi113.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2023-12-22T10:01:46.165 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-22T10:01:46.166 INFO:teuthology.orchestra.run.smithi113.stdout: osd default data pool replay window = 5 2023-12-22T10:01:46.166 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-22T10:01:46.166 INFO:teuthology.orchestra.run.smithi113.stdout: mon allow pool delete = true 2023-12-22T10:01:46.166 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-22T10:01:46.166 INFO:teuthology.orchestra.run.smithi113.stdout: mon cluster log file level = debug 2023-12-22T10:01:46.166 INFO:teuthology.orchestra.run.smithi113.stdout: debug asserts on shutdown = true 2023-12-22T10:01:46.166 INFO:teuthology.orchestra.run.smithi113.stdout: mon health detail to clog = false 2023-12-22T10:01:46.166 INFO:teuthology.orchestra.run.smithi113.stdout: mon host = "172.21.15.45,172.21.15.113,[v2:172.21.15.113:3301,v1:172.21.15.113:6790]" 2023-12-22T10:01:46.166 INFO:teuthology.orchestra.run.smithi113.stdout: fsid = 98b0837e-5e68-4c8f-a1a0-e9424baaad8f 2023-12-22T10:01:46.166 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-22T10:01:46.166 INFO:teuthology.orchestra.run.smithi113.stdout:[osd] 2023-12-22T10:01:46.166 INFO:teuthology.orchestra.run.smithi113.stdout: osd journal size = 100 2023-12-22T10:01:46.166 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-22T10:01:46.166 INFO:teuthology.orchestra.run.smithi113.stdout: osd scrub load threshold = 5.0 2023-12-22T10:01:46.166 INFO:teuthology.orchestra.run.smithi113.stdout: osd scrub max interval = 600 2023-12-22T10:01:46.167 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-22T10:01:46.167 INFO:teuthology.orchestra.run.smithi113.stdout: osd recover clone overlap = true 2023-12-22T10:01:46.167 INFO:teuthology.orchestra.run.smithi113.stdout: osd recovery max chunk = 1048576 2023-12-22T10:01:46.167 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-22T10:01:46.167 INFO:teuthology.orchestra.run.smithi113.stdout: osd debug shutdown = true 2023-12-22T10:01:46.167 INFO:teuthology.orchestra.run.smithi113.stdout: osd debug op order = true 2023-12-22T10:01:46.167 INFO:teuthology.orchestra.run.smithi113.stdout: osd debug verify stray on activate = true 2023-12-22T10:01:46.168 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-22T10:01:46.168 INFO:teuthology.orchestra.run.smithi113.stdout: osd open classes on start = true 2023-12-22T10:01:46.168 INFO:teuthology.orchestra.run.smithi113.stdout: osd debug pg log writeout = true 2023-12-22T10:01:46.168 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-22T10:01:46.168 INFO:teuthology.orchestra.run.smithi113.stdout: osd deep scrub update digest min age = 30 2023-12-22T10:01:46.168 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-22T10:01:46.168 INFO:teuthology.orchestra.run.smithi113.stdout: osd map max advance = 10 2023-12-22T10:01:46.168 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-22T10:01:46.168 INFO:teuthology.orchestra.run.smithi113.stdout: journal zero on create = true 2023-12-22T10:01:46.168 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-22T10:01:46.168 INFO:teuthology.orchestra.run.smithi113.stdout: filestore ondisk finisher threads = 3 2023-12-22T10:01:46.168 INFO:teuthology.orchestra.run.smithi113.stdout: filestore apply finisher threads = 3 2023-12-22T10:01:46.168 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-22T10:01:46.168 INFO:teuthology.orchestra.run.smithi113.stdout: bdev debug aio = true 2023-12-22T10:01:46.169 INFO:teuthology.orchestra.run.smithi113.stdout: osd debug misdirected ops = true 2023-12-22T10:01:46.169 INFO:teuthology.orchestra.run.smithi113.stdout: bdev async discard = True 2023-12-22T10:01:46.169 INFO:teuthology.orchestra.run.smithi113.stdout: bdev enable discard = True 2023-12-22T10:01:46.169 INFO:teuthology.orchestra.run.smithi113.stdout: bluestore allocator = bitmap 2023-12-22T10:01:46.169 INFO:teuthology.orchestra.run.smithi113.stdout: bluestore block size = 96636764160 2023-12-22T10:01:46.169 INFO:teuthology.orchestra.run.smithi113.stdout: bluestore fsck on mount = True 2023-12-22T10:01:46.169 INFO:teuthology.orchestra.run.smithi113.stdout: debug bluefs = 1/20 2023-12-22T10:01:46.169 INFO:teuthology.orchestra.run.smithi113.stdout: debug bluestore = 1/20 2023-12-22T10:01:46.169 INFO:teuthology.orchestra.run.smithi113.stdout: debug ms = 1 2023-12-22T10:01:46.169 INFO:teuthology.orchestra.run.smithi113.stdout: debug osd = 20 2023-12-22T10:01:46.169 INFO:teuthology.orchestra.run.smithi113.stdout: debug rocksdb = 4/10 2023-12-22T10:01:46.169 INFO:teuthology.orchestra.run.smithi113.stdout: mon osd backfillfull_ratio = 0.85 2023-12-22T10:01:46.169 INFO:teuthology.orchestra.run.smithi113.stdout: mon osd full ratio = 0.9 2023-12-22T10:01:46.169 INFO:teuthology.orchestra.run.smithi113.stdout: mon osd nearfull ratio = 0.8 2023-12-22T10:01:46.169 INFO:teuthology.orchestra.run.smithi113.stdout: osd failsafe full ratio = 0.95 2023-12-22T10:01:46.170 INFO:teuthology.orchestra.run.smithi113.stdout: osd objectstore = bluestore 2023-12-22T10:01:46.170 INFO:teuthology.orchestra.run.smithi113.stdout: osd op complaint time = 180 2023-12-22T10:01:46.170 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-22T10:01:46.170 INFO:teuthology.orchestra.run.smithi113.stdout:[mgr] 2023-12-22T10:01:46.170 INFO:teuthology.orchestra.run.smithi113.stdout: debug ms = 1 2023-12-22T10:01:46.170 INFO:teuthology.orchestra.run.smithi113.stdout: debug mgr = 20 2023-12-22T10:01:46.170 INFO:teuthology.orchestra.run.smithi113.stdout: debug mon = 20 2023-12-22T10:01:46.170 INFO:teuthology.orchestra.run.smithi113.stdout: debug auth = 20 2023-12-22T10:01:46.170 INFO:teuthology.orchestra.run.smithi113.stdout: mon reweight min pgs per osd = 4 2023-12-22T10:01:46.170 INFO:teuthology.orchestra.run.smithi113.stdout: mon reweight min bytes per osd = 10 2023-12-22T10:01:46.170 INFO:teuthology.orchestra.run.smithi113.stdout: mgr/telemetry/nag = false 2023-12-22T10:01:46.170 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-22T10:01:46.171 INFO:teuthology.orchestra.run.smithi113.stdout:[mon] 2023-12-22T10:01:46.171 INFO:teuthology.orchestra.run.smithi113.stdout: debug ms = 1 2023-12-22T10:01:46.171 INFO:teuthology.orchestra.run.smithi113.stdout: debug mon = 20 2023-12-22T10:01:46.171 INFO:teuthology.orchestra.run.smithi113.stdout: debug paxos = 20 2023-12-22T10:01:46.171 INFO:teuthology.orchestra.run.smithi113.stdout: debug auth = 20 2023-12-22T10:01:46.172 INFO:teuthology.orchestra.run.smithi113.stdout: mon data avail warn = 5 2023-12-22T10:01:46.172 INFO:teuthology.orchestra.run.smithi113.stdout: mon mgr mkfs grace = 240 2023-12-22T10:01:46.172 INFO:teuthology.orchestra.run.smithi113.stdout: mon reweight min pgs per osd = 4 2023-12-22T10:01:46.172 INFO:teuthology.orchestra.run.smithi113.stdout: mon osd reporter subtree level = osd 2023-12-22T10:01:46.172 INFO:teuthology.orchestra.run.smithi113.stdout: mon osd prime pg temp = true 2023-12-22T10:01:46.172 INFO:teuthology.orchestra.run.smithi113.stdout: mon reweight min bytes per osd = 10 2023-12-22T10:01:46.173 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-22T10:01:46.173 INFO:teuthology.orchestra.run.smithi113.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-22T10:01:46.173 INFO:teuthology.orchestra.run.smithi113.stdout: auth mon ticket ttl = 660 # 11m 2023-12-22T10:01:46.173 INFO:teuthology.orchestra.run.smithi113.stdout: auth service ticket ttl = 240 # 4m 2023-12-22T10:01:46.173 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-22T10:01:46.173 INFO:teuthology.orchestra.run.smithi113.stdout: # don't complain about insecure global_id in the test suite 2023-12-22T10:01:46.173 INFO:teuthology.orchestra.run.smithi113.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-22T10:01:46.173 INFO:teuthology.orchestra.run.smithi113.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-22T10:01:46.173 INFO:teuthology.orchestra.run.smithi113.stdout: mon op complaint time = 120 2023-12-22T10:01:46.173 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-22T10:01:46.174 INFO:teuthology.orchestra.run.smithi113.stdout:[client] 2023-12-22T10:01:46.174 INFO:teuthology.orchestra.run.smithi113.stdout: rgw cache enabled = true 2023-12-22T10:01:46.174 INFO:teuthology.orchestra.run.smithi113.stdout: rgw enable ops log = true 2023-12-22T10:01:46.174 INFO:teuthology.orchestra.run.smithi113.stdout: rgw enable usage log = true 2023-12-22T10:01:46.174 INFO:teuthology.orchestra.run.smithi113.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-22T10:01:46.174 INFO:teuthology.orchestra.run.smithi113.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-22T10:01:46.174 INFO:teuthology.orchestra.run.smithi113.stdout: client mount timeout = 600 2023-12-22T10:01:46.174 INFO:teuthology.orchestra.run.smithi113.stdout: debug client = 20 2023-12-22T10:01:46.174 INFO:teuthology.orchestra.run.smithi113.stdout: debug ms = 1 2023-12-22T10:01:46.174 INFO:teuthology.orchestra.run.smithi113.stdout: pid file = "" 2023-12-22T10:01:46.174 INFO:teuthology.orchestra.run.smithi113.stdout: rados mon op timeout = 900 2023-12-22T10:01:46.174 INFO:teuthology.orchestra.run.smithi113.stdout: rados osd op timeout = 900 2023-12-22T10:01:46.174 INFO:teuthology.orchestra.run.smithi113.stdout:[mon.a] 2023-12-22T10:01:46.174 INFO:teuthology.orchestra.run.smithi113.stdout:[mon.b] 2023-12-22T10:01:46.174 INFO:teuthology.orchestra.run.smithi113.stdout:[mon.c] 2023-12-22T10:01:46.175 INFO:teuthology.orchestra.run.smithi113.stdout:[mds.a] 2023-12-22T10:01:46.175 INFO:teuthology.orchestra.run.smithi113.stdout:[mds.c] 2023-12-22T10:01:46.175 INFO:teuthology.orchestra.run.smithi113.stdout:[mds.b] 2023-12-22T10:01:46.175 INFO:teuthology.orchestra.run.smithi113.stdout:[mds.d] 2023-12-22T10:01:46.175 INFO:teuthology.orchestra.run.smithi113.stdout:[mds] 2023-12-22T10:01:46.175 INFO:teuthology.orchestra.run.smithi113.stdout: debug mds = 20 2023-12-22T10:01:46.175 INFO:teuthology.orchestra.run.smithi113.stdout: debug mds balancer = 20 2023-12-22T10:01:46.175 INFO:teuthology.orchestra.run.smithi113.stdout: debug ms = 1 2023-12-22T10:01:46.175 INFO:teuthology.orchestra.run.smithi113.stdout: mds debug frag = True 2023-12-22T10:01:46.175 INFO:teuthology.orchestra.run.smithi113.stdout: mds debug scatterstat = True 2023-12-22T10:01:46.175 INFO:teuthology.orchestra.run.smithi113.stdout: mds op complaint time = 180 2023-12-22T10:01:46.175 INFO:teuthology.orchestra.run.smithi113.stdout: mds verify scatter = False 2023-12-22T10:01:46.175 INFO:teuthology.orchestra.run.smithi113.stdout: osd op complaint time = 180 2023-12-22T10:01:46.175 INFO:teuthology.orchestra.run.smithi113.stdout: rados mon op timeout = 900 2023-12-22T10:01:46.175 INFO:teuthology.orchestra.run.smithi113.stdout: rados osd op timeout = 900 2023-12-22T10:01:46.183 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-22T10:01:46.225 DEBUG:teuthology.orchestra.run.smithi113:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-22T10:01:46.300 INFO:teuthology.orchestra.run.smithi045.stdout:[global] 2023-12-22T10:01:46.300 INFO:teuthology.orchestra.run.smithi045.stdout: chdir = "" 2023-12-22T10:01:46.301 INFO:teuthology.orchestra.run.smithi045.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-22T10:01:46.301 INFO:teuthology.orchestra.run.smithi045.stdout: auth supported = cephx 2023-12-22T10:01:46.301 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:01:46.301 INFO:teuthology.orchestra.run.smithi045.stdout: filestore xattr use omap = true 2023-12-22T10:01:46.301 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:01:46.301 INFO:teuthology.orchestra.run.smithi045.stdout: mon clock drift allowed = 1.000 2023-12-22T10:01:46.301 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:01:46.301 INFO:teuthology.orchestra.run.smithi045.stdout: osd crush chooseleaf type = 0 2023-12-22T10:01:46.301 INFO:teuthology.orchestra.run.smithi045.stdout: auth debug = true 2023-12-22T10:01:46.301 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:01:46.301 INFO:teuthology.orchestra.run.smithi045.stdout: ms die on old message = true 2023-12-22T10:01:46.301 INFO:teuthology.orchestra.run.smithi045.stdout: ms die on bug = true 2023-12-22T10:01:46.301 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:01:46.302 INFO:teuthology.orchestra.run.smithi045.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-22T10:01:46.302 INFO:teuthology.orchestra.run.smithi045.stdout: mon pg warn max object skew = 0 2023-12-22T10:01:46.302 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:01:46.302 INFO:teuthology.orchestra.run.smithi045.stdout: # disable pg_autoscaler by default for new pools 2023-12-22T10:01:46.302 INFO:teuthology.orchestra.run.smithi045.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-22T10:01:46.302 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:01:46.302 INFO:teuthology.orchestra.run.smithi045.stdout: osd pool default size = 2 2023-12-22T10:01:46.302 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:01:46.302 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd allow primary affinity = true 2023-12-22T10:01:46.302 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd allow pg remap = true 2023-12-22T10:01:46.302 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on legacy crush tunables = false 2023-12-22T10:01:46.302 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on crush straw calc version zero = false 2023-12-22T10:01:46.302 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on no sortbitwise = false 2023-12-22T10:01:46.302 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on osd down out interval zero = false 2023-12-22T10:01:46.303 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on too few osds = false 2023-12-22T10:01:46.303 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-22T10:01:46.303 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-22T10:01:46.303 INFO:teuthology.orchestra.run.smithi045.stdout: mon_allow_pool_size_one = true 2023-12-22T10:01:46.303 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:01:46.303 INFO:teuthology.orchestra.run.smithi045.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2023-12-22T10:01:46.303 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:01:46.303 INFO:teuthology.orchestra.run.smithi045.stdout: osd default data pool replay window = 5 2023-12-22T10:01:46.303 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:01:46.303 INFO:teuthology.orchestra.run.smithi045.stdout: mon allow pool delete = true 2023-12-22T10:01:46.303 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:01:46.303 INFO:teuthology.orchestra.run.smithi045.stdout: mon cluster log file level = debug 2023-12-22T10:01:46.303 INFO:teuthology.orchestra.run.smithi045.stdout: debug asserts on shutdown = true 2023-12-22T10:01:46.303 INFO:teuthology.orchestra.run.smithi045.stdout: mon health detail to clog = false 2023-12-22T10:01:46.303 INFO:teuthology.orchestra.run.smithi045.stdout: mon host = "172.21.15.45,172.21.15.113,[v2:172.21.15.113:3301,v1:172.21.15.113:6790]" 2023-12-22T10:01:46.304 INFO:teuthology.orchestra.run.smithi045.stdout: fsid = 98b0837e-5e68-4c8f-a1a0-e9424baaad8f 2023-12-22T10:01:46.304 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:01:46.304 INFO:teuthology.orchestra.run.smithi045.stdout:[osd] 2023-12-22T10:01:46.304 INFO:teuthology.orchestra.run.smithi045.stdout: osd journal size = 100 2023-12-22T10:01:46.304 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:01:46.304 INFO:teuthology.orchestra.run.smithi045.stdout: osd scrub load threshold = 5.0 2023-12-22T10:01:46.304 INFO:teuthology.orchestra.run.smithi045.stdout: osd scrub max interval = 600 2023-12-22T10:01:46.304 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:01:46.304 INFO:teuthology.orchestra.run.smithi045.stdout: osd recover clone overlap = true 2023-12-22T10:01:46.304 INFO:teuthology.orchestra.run.smithi045.stdout: osd recovery max chunk = 1048576 2023-12-22T10:01:46.304 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:01:46.304 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug shutdown = true 2023-12-22T10:01:46.304 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug op order = true 2023-12-22T10:01:46.304 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug verify stray on activate = true 2023-12-22T10:01:46.304 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:01:46.305 INFO:teuthology.orchestra.run.smithi045.stdout: osd open classes on start = true 2023-12-22T10:01:46.305 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug pg log writeout = true 2023-12-22T10:01:46.305 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:01:46.305 INFO:teuthology.orchestra.run.smithi045.stdout: osd deep scrub update digest min age = 30 2023-12-22T10:01:46.305 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:01:46.305 INFO:teuthology.orchestra.run.smithi045.stdout: osd map max advance = 10 2023-12-22T10:01:46.305 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:01:46.305 INFO:teuthology.orchestra.run.smithi045.stdout: journal zero on create = true 2023-12-22T10:01:46.305 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:01:46.305 INFO:teuthology.orchestra.run.smithi045.stdout: filestore ondisk finisher threads = 3 2023-12-22T10:01:46.305 INFO:teuthology.orchestra.run.smithi045.stdout: filestore apply finisher threads = 3 2023-12-22T10:01:46.305 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:01:46.306 INFO:teuthology.orchestra.run.smithi045.stdout: bdev debug aio = true 2023-12-22T10:01:46.306 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug misdirected ops = true 2023-12-22T10:01:46.306 INFO:teuthology.orchestra.run.smithi045.stdout: bdev async discard = True 2023-12-22T10:01:46.306 INFO:teuthology.orchestra.run.smithi045.stdout: bdev enable discard = True 2023-12-22T10:01:46.306 INFO:teuthology.orchestra.run.smithi045.stdout: bluestore allocator = bitmap 2023-12-22T10:01:46.306 INFO:teuthology.orchestra.run.smithi045.stdout: bluestore block size = 96636764160 2023-12-22T10:01:46.306 INFO:teuthology.orchestra.run.smithi045.stdout: bluestore fsck on mount = True 2023-12-22T10:01:46.306 INFO:teuthology.orchestra.run.smithi045.stdout: debug bluefs = 1/20 2023-12-22T10:01:46.306 INFO:teuthology.orchestra.run.smithi045.stdout: debug bluestore = 1/20 2023-12-22T10:01:46.306 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-12-22T10:01:46.306 INFO:teuthology.orchestra.run.smithi045.stdout: debug osd = 20 2023-12-22T10:01:46.306 INFO:teuthology.orchestra.run.smithi045.stdout: debug rocksdb = 4/10 2023-12-22T10:01:46.306 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd backfillfull_ratio = 0.85 2023-12-22T10:01:46.306 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd full ratio = 0.9 2023-12-22T10:01:46.306 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd nearfull ratio = 0.8 2023-12-22T10:01:46.307 INFO:teuthology.orchestra.run.smithi045.stdout: osd failsafe full ratio = 0.95 2023-12-22T10:01:46.307 INFO:teuthology.orchestra.run.smithi045.stdout: osd objectstore = bluestore 2023-12-22T10:01:46.307 INFO:teuthology.orchestra.run.smithi045.stdout: osd op complaint time = 180 2023-12-22T10:01:46.307 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:01:46.307 INFO:teuthology.orchestra.run.smithi045.stdout:[mgr] 2023-12-22T10:01:46.307 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-12-22T10:01:46.307 INFO:teuthology.orchestra.run.smithi045.stdout: debug mgr = 20 2023-12-22T10:01:46.307 INFO:teuthology.orchestra.run.smithi045.stdout: debug mon = 20 2023-12-22T10:01:46.307 INFO:teuthology.orchestra.run.smithi045.stdout: debug auth = 20 2023-12-22T10:01:46.307 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min pgs per osd = 4 2023-12-22T10:01:46.307 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min bytes per osd = 10 2023-12-22T10:01:46.307 INFO:teuthology.orchestra.run.smithi045.stdout: mgr/telemetry/nag = false 2023-12-22T10:01:46.307 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:01:46.307 INFO:teuthology.orchestra.run.smithi045.stdout:[mon] 2023-12-22T10:01:46.307 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-12-22T10:01:46.308 INFO:teuthology.orchestra.run.smithi045.stdout: debug mon = 20 2023-12-22T10:01:46.308 INFO:teuthology.orchestra.run.smithi045.stdout: debug paxos = 20 2023-12-22T10:01:46.308 INFO:teuthology.orchestra.run.smithi045.stdout: debug auth = 20 2023-12-22T10:01:46.308 INFO:teuthology.orchestra.run.smithi045.stdout: mon data avail warn = 5 2023-12-22T10:01:46.308 INFO:teuthology.orchestra.run.smithi045.stdout: mon mgr mkfs grace = 240 2023-12-22T10:01:46.308 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min pgs per osd = 4 2023-12-22T10:01:46.308 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd reporter subtree level = osd 2023-12-22T10:01:46.308 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd prime pg temp = true 2023-12-22T10:01:46.308 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min bytes per osd = 10 2023-12-22T10:01:46.308 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:01:46.308 INFO:teuthology.orchestra.run.smithi045.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-22T10:01:46.308 INFO:teuthology.orchestra.run.smithi045.stdout: auth mon ticket ttl = 660 # 11m 2023-12-22T10:01:46.308 INFO:teuthology.orchestra.run.smithi045.stdout: auth service ticket ttl = 240 # 4m 2023-12-22T10:01:46.308 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:01:46.309 INFO:teuthology.orchestra.run.smithi045.stdout: # don't complain about insecure global_id in the test suite 2023-12-22T10:01:46.309 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-22T10:01:46.309 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-22T10:01:46.309 INFO:teuthology.orchestra.run.smithi045.stdout: mon op complaint time = 120 2023-12-22T10:01:46.309 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:01:46.309 INFO:teuthology.orchestra.run.smithi045.stdout:[client] 2023-12-22T10:01:46.309 INFO:teuthology.orchestra.run.smithi045.stdout: rgw cache enabled = true 2023-12-22T10:01:46.309 INFO:teuthology.orchestra.run.smithi045.stdout: rgw enable ops log = true 2023-12-22T10:01:46.309 INFO:teuthology.orchestra.run.smithi045.stdout: rgw enable usage log = true 2023-12-22T10:01:46.309 INFO:teuthology.orchestra.run.smithi045.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-22T10:01:46.309 INFO:teuthology.orchestra.run.smithi045.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-22T10:01:46.309 INFO:teuthology.orchestra.run.smithi045.stdout: client mount timeout = 600 2023-12-22T10:01:46.309 INFO:teuthology.orchestra.run.smithi045.stdout: debug client = 20 2023-12-22T10:01:46.309 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-12-22T10:01:46.310 INFO:teuthology.orchestra.run.smithi045.stdout: pid file = "" 2023-12-22T10:01:46.310 INFO:teuthology.orchestra.run.smithi045.stdout: rados mon op timeout = 900 2023-12-22T10:01:46.310 INFO:teuthology.orchestra.run.smithi045.stdout: rados osd op timeout = 900 2023-12-22T10:01:46.310 INFO:teuthology.orchestra.run.smithi045.stdout:[mon.a] 2023-12-22T10:01:46.310 INFO:teuthology.orchestra.run.smithi045.stdout:[mon.b] 2023-12-22T10:01:46.310 INFO:teuthology.orchestra.run.smithi045.stdout:[mon.c] 2023-12-22T10:01:46.310 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.a] 2023-12-22T10:01:46.310 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.c] 2023-12-22T10:01:46.310 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.b] 2023-12-22T10:01:46.310 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.d] 2023-12-22T10:01:46.310 INFO:teuthology.orchestra.run.smithi045.stdout:[mds] 2023-12-22T10:01:46.310 INFO:teuthology.orchestra.run.smithi045.stdout: debug mds = 20 2023-12-22T10:01:46.310 INFO:teuthology.orchestra.run.smithi045.stdout: debug mds balancer = 20 2023-12-22T10:01:46.310 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-12-22T10:01:46.310 INFO:teuthology.orchestra.run.smithi045.stdout: mds debug frag = True 2023-12-22T10:01:46.311 INFO:teuthology.orchestra.run.smithi045.stdout: mds debug scatterstat = False 2023-12-22T10:01:46.311 INFO:teuthology.orchestra.run.smithi045.stdout: mds op complaint time = 180 2023-12-22T10:01:46.311 INFO:teuthology.orchestra.run.smithi045.stdout: mds verify scatter = False 2023-12-22T10:01:46.311 INFO:teuthology.orchestra.run.smithi045.stdout: osd op complaint time = 180 2023-12-22T10:01:46.311 INFO:teuthology.orchestra.run.smithi045.stdout: rados mon op timeout = 900 2023-12-22T10:01:46.311 INFO:teuthology.orchestra.run.smithi045.stdout: rados osd op timeout = 900 2023-12-22T10:01:46.311 INFO:teuthology.orchestra.run.smithi113.stdout:[global] 2023-12-22T10:01:46.312 INFO:teuthology.orchestra.run.smithi113.stdout: chdir = "" 2023-12-22T10:01:46.312 INFO:teuthology.orchestra.run.smithi113.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-22T10:01:46.312 INFO:teuthology.orchestra.run.smithi113.stdout: auth supported = cephx 2023-12-22T10:01:46.312 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-22T10:01:46.312 INFO:teuthology.orchestra.run.smithi113.stdout: filestore xattr use omap = true 2023-12-22T10:01:46.312 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-22T10:01:46.312 INFO:teuthology.orchestra.run.smithi113.stdout: mon clock drift allowed = 1.000 2023-12-22T10:01:46.312 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-22T10:01:46.312 INFO:teuthology.orchestra.run.smithi113.stdout: osd crush chooseleaf type = 0 2023-12-22T10:01:46.312 INFO:teuthology.orchestra.run.smithi113.stdout: auth debug = true 2023-12-22T10:01:46.312 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-22T10:01:46.312 INFO:teuthology.orchestra.run.smithi113.stdout: ms die on old message = true 2023-12-22T10:01:46.312 INFO:teuthology.orchestra.run.smithi113.stdout: ms die on bug = true 2023-12-22T10:01:46.312 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-22T10:01:46.313 INFO:teuthology.orchestra.run.smithi113.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-22T10:01:46.313 INFO:teuthology.orchestra.run.smithi113.stdout: mon pg warn max object skew = 0 2023-12-22T10:01:46.313 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-22T10:01:46.313 INFO:teuthology.orchestra.run.smithi113.stdout: # disable pg_autoscaler by default for new pools 2023-12-22T10:01:46.313 INFO:teuthology.orchestra.run.smithi113.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-22T10:01:46.313 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-22T10:01:46.313 INFO:teuthology.orchestra.run.smithi113.stdout: osd pool default size = 2 2023-12-22T10:01:46.313 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-22T10:01:46.313 INFO:teuthology.orchestra.run.smithi113.stdout: mon osd allow primary affinity = true 2023-12-22T10:01:46.313 INFO:teuthology.orchestra.run.smithi113.stdout: mon osd allow pg remap = true 2023-12-22T10:01:46.313 INFO:teuthology.orchestra.run.smithi113.stdout: mon warn on legacy crush tunables = false 2023-12-22T10:01:46.313 INFO:teuthology.orchestra.run.smithi113.stdout: mon warn on crush straw calc version zero = false 2023-12-22T10:01:46.313 INFO:teuthology.orchestra.run.smithi113.stdout: mon warn on no sortbitwise = false 2023-12-22T10:01:46.313 INFO:teuthology.orchestra.run.smithi113.stdout: mon warn on osd down out interval zero = false 2023-12-22T10:01:46.313 INFO:teuthology.orchestra.run.smithi113.stdout: mon warn on too few osds = false 2023-12-22T10:01:46.314 INFO:teuthology.orchestra.run.smithi113.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-22T10:01:46.314 INFO:teuthology.orchestra.run.smithi113.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-22T10:01:46.314 INFO:teuthology.orchestra.run.smithi113.stdout: mon_allow_pool_size_one = true 2023-12-22T10:01:46.314 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-22T10:01:46.314 INFO:teuthology.orchestra.run.smithi113.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2023-12-22T10:01:46.314 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-22T10:01:46.314 INFO:teuthology.orchestra.run.smithi113.stdout: osd default data pool replay window = 5 2023-12-22T10:01:46.314 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-22T10:01:46.314 INFO:teuthology.orchestra.run.smithi113.stdout: mon allow pool delete = true 2023-12-22T10:01:46.314 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-22T10:01:46.314 INFO:teuthology.orchestra.run.smithi113.stdout: mon cluster log file level = debug 2023-12-22T10:01:46.314 INFO:teuthology.orchestra.run.smithi113.stdout: debug asserts on shutdown = true 2023-12-22T10:01:46.314 INFO:teuthology.orchestra.run.smithi113.stdout: mon health detail to clog = false 2023-12-22T10:01:46.315 INFO:teuthology.orchestra.run.smithi113.stdout: mon host = "172.21.15.45,172.21.15.113,[v2:172.21.15.113:3301,v1:172.21.15.113:6790]" 2023-12-22T10:01:46.315 INFO:teuthology.orchestra.run.smithi113.stdout: fsid = 98b0837e-5e68-4c8f-a1a0-e9424baaad8f 2023-12-22T10:01:46.315 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-22T10:01:46.315 INFO:teuthology.orchestra.run.smithi113.stdout:[osd] 2023-12-22T10:01:46.315 INFO:teuthology.orchestra.run.smithi113.stdout: osd journal size = 100 2023-12-22T10:01:46.315 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-22T10:01:46.315 INFO:teuthology.orchestra.run.smithi113.stdout: osd scrub load threshold = 5.0 2023-12-22T10:01:46.315 INFO:teuthology.orchestra.run.smithi113.stdout: osd scrub max interval = 600 2023-12-22T10:01:46.315 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-22T10:01:46.315 INFO:teuthology.orchestra.run.smithi113.stdout: osd recover clone overlap = true 2023-12-22T10:01:46.315 INFO:teuthology.orchestra.run.smithi113.stdout: osd recovery max chunk = 1048576 2023-12-22T10:01:46.315 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-22T10:01:46.315 INFO:teuthology.orchestra.run.smithi113.stdout: osd debug shutdown = true 2023-12-22T10:01:46.315 INFO:teuthology.orchestra.run.smithi113.stdout: osd debug op order = true 2023-12-22T10:01:46.315 INFO:teuthology.orchestra.run.smithi113.stdout: osd debug verify stray on activate = true 2023-12-22T10:01:46.316 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-22T10:01:46.316 INFO:teuthology.orchestra.run.smithi113.stdout: osd open classes on start = true 2023-12-22T10:01:46.316 INFO:teuthology.orchestra.run.smithi113.stdout: osd debug pg log writeout = true 2023-12-22T10:01:46.316 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-22T10:01:46.316 INFO:teuthology.orchestra.run.smithi113.stdout: osd deep scrub update digest min age = 30 2023-12-22T10:01:46.316 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-22T10:01:46.316 INFO:teuthology.orchestra.run.smithi113.stdout: osd map max advance = 10 2023-12-22T10:01:46.316 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-22T10:01:46.316 INFO:teuthology.orchestra.run.smithi113.stdout: journal zero on create = true 2023-12-22T10:01:46.316 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-22T10:01:46.316 INFO:teuthology.orchestra.run.smithi113.stdout: filestore ondisk finisher threads = 3 2023-12-22T10:01:46.316 INFO:teuthology.orchestra.run.smithi113.stdout: filestore apply finisher threads = 3 2023-12-22T10:01:46.316 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-22T10:01:46.316 INFO:teuthology.orchestra.run.smithi113.stdout: bdev debug aio = true 2023-12-22T10:01:46.316 INFO:teuthology.orchestra.run.smithi113.stdout: osd debug misdirected ops = true 2023-12-22T10:01:46.317 INFO:teuthology.orchestra.run.smithi113.stdout: bdev async discard = True 2023-12-22T10:01:46.317 INFO:teuthology.orchestra.run.smithi113.stdout: bdev enable discard = True 2023-12-22T10:01:46.317 INFO:teuthology.orchestra.run.smithi113.stdout: bluestore allocator = bitmap 2023-12-22T10:01:46.317 INFO:teuthology.orchestra.run.smithi113.stdout: bluestore block size = 96636764160 2023-12-22T10:01:46.317 INFO:teuthology.orchestra.run.smithi113.stdout: bluestore fsck on mount = True 2023-12-22T10:01:46.317 INFO:teuthology.orchestra.run.smithi113.stdout: debug bluefs = 1/20 2023-12-22T10:01:46.317 INFO:teuthology.orchestra.run.smithi113.stdout: debug bluestore = 1/20 2023-12-22T10:01:46.317 INFO:teuthology.orchestra.run.smithi113.stdout: debug ms = 1 2023-12-22T10:01:46.317 INFO:teuthology.orchestra.run.smithi113.stdout: debug osd = 20 2023-12-22T10:01:46.317 INFO:teuthology.orchestra.run.smithi113.stdout: debug rocksdb = 4/10 2023-12-22T10:01:46.317 INFO:teuthology.orchestra.run.smithi113.stdout: mon osd backfillfull_ratio = 0.85 2023-12-22T10:01:46.317 INFO:teuthology.orchestra.run.smithi113.stdout: mon osd full ratio = 0.9 2023-12-22T10:01:46.317 INFO:teuthology.orchestra.run.smithi113.stdout: mon osd nearfull ratio = 0.8 2023-12-22T10:01:46.317 INFO:teuthology.orchestra.run.smithi113.stdout: osd failsafe full ratio = 0.95 2023-12-22T10:01:46.318 INFO:teuthology.orchestra.run.smithi113.stdout: osd objectstore = bluestore 2023-12-22T10:01:46.318 INFO:teuthology.orchestra.run.smithi113.stdout: osd op complaint time = 180 2023-12-22T10:01:46.318 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-22T10:01:46.318 INFO:teuthology.orchestra.run.smithi113.stdout:[mgr] 2023-12-22T10:01:46.318 INFO:teuthology.orchestra.run.smithi113.stdout: debug ms = 1 2023-12-22T10:01:46.318 INFO:teuthology.orchestra.run.smithi113.stdout: debug mgr = 20 2023-12-22T10:01:46.318 INFO:teuthology.orchestra.run.smithi113.stdout: debug mon = 20 2023-12-22T10:01:46.318 INFO:teuthology.orchestra.run.smithi113.stdout: debug auth = 20 2023-12-22T10:01:46.318 INFO:teuthology.orchestra.run.smithi113.stdout: mon reweight min pgs per osd = 4 2023-12-22T10:01:46.318 INFO:teuthology.orchestra.run.smithi113.stdout: mon reweight min bytes per osd = 10 2023-12-22T10:01:46.318 INFO:teuthology.orchestra.run.smithi113.stdout: mgr/telemetry/nag = false 2023-12-22T10:01:46.318 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-22T10:01:46.318 INFO:teuthology.orchestra.run.smithi113.stdout:[mon] 2023-12-22T10:01:46.318 INFO:teuthology.orchestra.run.smithi113.stdout: debug ms = 1 2023-12-22T10:01:46.318 INFO:teuthology.orchestra.run.smithi113.stdout: debug mon = 20 2023-12-22T10:01:46.319 INFO:teuthology.orchestra.run.smithi113.stdout: debug paxos = 20 2023-12-22T10:01:46.319 INFO:teuthology.orchestra.run.smithi113.stdout: debug auth = 20 2023-12-22T10:01:46.319 INFO:teuthology.orchestra.run.smithi113.stdout: mon data avail warn = 5 2023-12-22T10:01:46.319 INFO:teuthology.orchestra.run.smithi113.stdout: mon mgr mkfs grace = 240 2023-12-22T10:01:46.319 INFO:teuthology.orchestra.run.smithi113.stdout: mon reweight min pgs per osd = 4 2023-12-22T10:01:46.319 INFO:teuthology.orchestra.run.smithi113.stdout: mon osd reporter subtree level = osd 2023-12-22T10:01:46.319 INFO:teuthology.orchestra.run.smithi113.stdout: mon osd prime pg temp = true 2023-12-22T10:01:46.319 INFO:teuthology.orchestra.run.smithi113.stdout: mon reweight min bytes per osd = 10 2023-12-22T10:01:46.319 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-22T10:01:46.319 INFO:teuthology.orchestra.run.smithi113.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-22T10:01:46.319 INFO:teuthology.orchestra.run.smithi113.stdout: auth mon ticket ttl = 660 # 11m 2023-12-22T10:01:46.319 INFO:teuthology.orchestra.run.smithi113.stdout: auth service ticket ttl = 240 # 4m 2023-12-22T10:01:46.319 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-22T10:01:46.319 INFO:teuthology.orchestra.run.smithi113.stdout: # don't complain about insecure global_id in the test suite 2023-12-22T10:01:46.320 INFO:teuthology.orchestra.run.smithi113.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-22T10:01:46.320 INFO:teuthology.orchestra.run.smithi113.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-22T10:01:46.320 INFO:teuthology.orchestra.run.smithi113.stdout: mon op complaint time = 120 2023-12-22T10:01:46.320 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-22T10:01:46.320 INFO:teuthology.orchestra.run.smithi113.stdout:[client] 2023-12-22T10:01:46.320 INFO:teuthology.orchestra.run.smithi113.stdout: rgw cache enabled = true 2023-12-22T10:01:46.320 INFO:teuthology.orchestra.run.smithi113.stdout: rgw enable ops log = true 2023-12-22T10:01:46.320 INFO:teuthology.orchestra.run.smithi113.stdout: rgw enable usage log = true 2023-12-22T10:01:46.320 INFO:teuthology.orchestra.run.smithi113.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-22T10:01:46.320 INFO:teuthology.orchestra.run.smithi113.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-22T10:01:46.320 INFO:teuthology.orchestra.run.smithi113.stdout: client mount timeout = 600 2023-12-22T10:01:46.320 INFO:teuthology.orchestra.run.smithi113.stdout: debug client = 20 2023-12-22T10:01:46.320 INFO:teuthology.orchestra.run.smithi113.stdout: debug ms = 1 2023-12-22T10:01:46.320 INFO:teuthology.orchestra.run.smithi113.stdout: pid file = "" 2023-12-22T10:01:46.320 INFO:teuthology.orchestra.run.smithi113.stdout: rados mon op timeout = 900 2023-12-22T10:01:46.321 INFO:teuthology.orchestra.run.smithi113.stdout: rados osd op timeout = 900 2023-12-22T10:01:46.321 INFO:teuthology.orchestra.run.smithi113.stdout:[mon.a] 2023-12-22T10:01:46.321 INFO:teuthology.orchestra.run.smithi113.stdout:[mon.b] 2023-12-22T10:01:46.321 INFO:teuthology.orchestra.run.smithi113.stdout:[mon.c] 2023-12-22T10:01:46.321 INFO:teuthology.orchestra.run.smithi113.stdout:[mds.a] 2023-12-22T10:01:46.321 INFO:teuthology.orchestra.run.smithi113.stdout:[mds.c] 2023-12-22T10:01:46.321 INFO:teuthology.orchestra.run.smithi113.stdout:[mds.b] 2023-12-22T10:01:46.321 INFO:teuthology.orchestra.run.smithi113.stdout:[mds.d] 2023-12-22T10:01:46.321 INFO:teuthology.orchestra.run.smithi113.stdout:[mds] 2023-12-22T10:01:46.321 INFO:teuthology.orchestra.run.smithi113.stdout: debug mds = 20 2023-12-22T10:01:46.321 INFO:teuthology.orchestra.run.smithi113.stdout: debug mds balancer = 20 2023-12-22T10:01:46.321 INFO:teuthology.orchestra.run.smithi113.stdout: debug ms = 1 2023-12-22T10:01:46.321 INFO:teuthology.orchestra.run.smithi113.stdout: mds debug frag = True 2023-12-22T10:01:46.321 INFO:teuthology.orchestra.run.smithi113.stdout: mds debug scatterstat = False 2023-12-22T10:01:46.321 INFO:teuthology.orchestra.run.smithi113.stdout: mds op complaint time = 180 2023-12-22T10:01:46.322 INFO:teuthology.orchestra.run.smithi113.stdout: mds verify scatter = False 2023-12-22T10:01:46.322 INFO:teuthology.orchestra.run.smithi113.stdout: osd op complaint time = 180 2023-12-22T10:01:46.322 INFO:teuthology.orchestra.run.smithi113.stdout: rados mon op timeout = 900 2023-12-22T10:01:46.322 INFO:teuthology.orchestra.run.smithi113.stdout: rados osd op timeout = 900 2023-12-22T10:01:46.325 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-22T10:01:46.325 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-22T10:01:46.325 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-22T10:01:46.325 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T10:01:46.326 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-22T10:01:46.326 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-22T10:01:46.326 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-22T10:01:46.326 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T10:01:46.326 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-22T10:01:46.326 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-22T10:01:46.326 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-22T10:01:46.327 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T10:01:46.327 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-22T10:01:46.327 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-22T10:01:46.327 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-22T10:01:46.327 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T10:01:46.348 INFO:tasks.ceph.mds.d:Stopped 2023-12-22T10:01:46.348 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-22T10:01:46.351 INFO:tasks.ceph.mds.b:Stopped 2023-12-22T10:01:46.351 DEBUG:teuthology.orchestra.run.smithi113:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-22T10:01:46.395 INFO:tasks.ceph.mds.c:Stopped 2023-12-22T10:01:46.395 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-22T10:01:46.397 INFO:tasks.ceph.mds.a:Stopped 2023-12-22T10:01:46.397 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-22T10:01:46.401 INFO:tasks.ceph.mds.d:Started 2023-12-22T10:01:46.401 DEBUG:teuthology.parallel:result is None 2023-12-22T10:01:46.407 INFO:tasks.ceph.mds.b:Started 2023-12-22T10:01:46.407 DEBUG:teuthology.parallel:result is None 2023-12-22T10:01:46.448 INFO:tasks.ceph.mds.c:Started 2023-12-22T10:01:46.448 DEBUG:teuthology.parallel:result is None 2023-12-22T10:01:46.453 INFO:tasks.ceph.mds.a:Started 2023-12-22T10:01:46.453 DEBUG:teuthology.parallel:result is None 2023-12-22T10:01:46.457 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph purge cephfs_metadata --yes-i-really-really-mean-it 2023-12-22T10:01:46.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.512+0000 7f5c1f4d8d00 1 Processor -- start 2023-12-22T10:01:46.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.512+0000 7f5c1f4d8d00 1 -- start start 2023-12-22T10:01:46.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.512+0000 7f5c1f4d8d00 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x556243e37a70 0x556243de9b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:46.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.512+0000 7f5c1f4d8d00 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x556243ec22a0 0x556243ed3410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:46.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.512+0000 7f5c1f4d8d00 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556243e1c8f0 0x556243ed3900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:46.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.512+0000 7f5c1f4d8d00 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x556243d62220 con 0x556243e1c8f0 2023-12-22T10:01:46.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.512+0000 7f5c1f4d8d00 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x556243e19350 con 0x556243ec22a0 2023-12-22T10:01:46.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.512+0000 7f5c1f4d8d00 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x556243ebe680 con 0x556243e37a70 2023-12-22T10:01:46.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.512+0000 7f5c1d53e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556243e1c8f0 0x556243ed3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:46.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.512+0000 7f5c1cd3d700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x556243e37a70 0x556243de9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:46.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.512+0000 7f5c1d53e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556243e1c8f0 0x556243ed3900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37180/0 (socket says 172.21.15.45:37180) 2023-12-22T10:01:46.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.512+0000 7f5c1d53e700 1 -- 172.21.15.45:0/2286554379 learned_addr learned my addr 172.21.15.45:0/2286554379 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:46.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.512+0000 7f5c17fff700 1 --2- 172.21.15.45:0/2286554379 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x556243ec22a0 0x556243ed3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:46.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.512+0000 7f5c1d53e700 1 -- 172.21.15.45:0/2286554379 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x556243e37a70 msgr2=0x556243de9b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:46.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.512+0000 7f5c1d53e700 1 --2- 172.21.15.45:0/2286554379 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x556243e37a70 0x556243de9b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:46.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.512+0000 7f5c1d53e700 1 -- 172.21.15.45:0/2286554379 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x556243ec22a0 msgr2=0x556243ed3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:46.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.512+0000 7f5c1d53e700 1 --2- 172.21.15.45:0/2286554379 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x556243ec22a0 0x556243ed3410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:46.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.512+0000 7f5c1d53e700 1 -- 172.21.15.45:0/2286554379 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c10005db0 con 0x556243e1c8f0 2023-12-22T10:01:46.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.512+0000 7f5c1d53e700 1 --2- 172.21.15.45:0/2286554379 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556243e1c8f0 0x556243ed3900 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7f5c180016e0 tx=0x7f5c18006930).ready entity=mon.0 client_cookie=97c2767960d8d2d5 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:46.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.512+0000 7f5c16ffd700 1 -- 172.21.15.45:0/2286554379 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c18003090 con 0x556243e1c8f0 2023-12-22T10:01:46.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.512+0000 7f5c16ffd700 1 -- 172.21.15.45:0/2286554379 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c18012450 con 0x556243e1c8f0 2023-12-22T10:01:46.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.512+0000 7f5c16ffd700 1 -- 172.21.15.45:0/2286554379 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c18012810 con 0x556243e1c8f0 2023-12-22T10:01:46.515 INFO:tasks.ceph.mds.d.smithi113.stdout:starting mds.d at 2023-12-22T10:01:46.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.516+0000 7f5c1f4d8d00 1 -- 172.21.15.45:0/2286554379 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556243e1c8f0 msgr2=0x556243ed3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:46.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.516+0000 7f5c1f4d8d00 1 --2- 172.21.15.45:0/2286554379 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556243e1c8f0 0x556243ed3900 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7f5c180016e0 tx=0x7f5c18006930).stop 2023-12-22T10:01:46.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.516+0000 7f5c1f4d8d00 1 -- 172.21.15.45:0/2286554379 shutdown_connections 2023-12-22T10:01:46.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.516+0000 7f5c1f4d8d00 1 --2- 172.21.15.45:0/2286554379 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556243e1c8f0 0x556243ed3900 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:46.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.516+0000 7f5c1f4d8d00 1 --2- 172.21.15.45:0/2286554379 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x556243ec22a0 0x556243ed3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:46.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.516+0000 7f5c1f4d8d00 1 --2- 172.21.15.45:0/2286554379 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x556243e37a70 0x556243de9b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:46.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.516+0000 7f5c1f4d8d00 1 -- 172.21.15.45:0/2286554379 >> 172.21.15.45:0/2286554379 conn(0x556243e38f30 msgr2=0x556243e2f5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:46.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.516+0000 7f5c1f4d8d00 1 -- 172.21.15.45:0/2286554379 shutdown_connections 2023-12-22T10:01:46.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.516+0000 7f5c1f4d8d00 1 -- 172.21.15.45:0/2286554379 wait complete. 2023-12-22T10:01:46.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.516+0000 7f5c1f4d8d00 1 Processor -- start 2023-12-22T10:01:46.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.516+0000 7f5c1f4d8d00 1 -- start start 2023-12-22T10:01:46.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.516+0000 7f5c1f4d8d00 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556243e1c8f0 0x556243e30050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:46.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.516+0000 7f5c1f4d8d00 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x556243e37a70 0x556243e33190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:46.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.516+0000 7f5c1f4d8d00 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x556243ec22a0 0x556243e2e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:46.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.516+0000 7f5c1f4d8d00 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x556243e30540 con 0x556243e1c8f0 2023-12-22T10:01:46.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.516+0000 7f5c1f4d8d00 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x556243e33680 con 0x556243e37a70 2023-12-22T10:01:46.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.516+0000 7f5c1f4d8d00 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x556243e30750 con 0x556243ec22a0 2023-12-22T10:01:46.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.516+0000 7f5c1cd3d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556243e1c8f0 0x556243e30050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:46.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.520+0000 7f5c1cd3d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556243e1c8f0 0x556243e30050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37186/0 (socket says 172.21.15.45:37186) 2023-12-22T10:01:46.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.520+0000 7f5c1cd3d700 1 -- 172.21.15.45:0/2649537063 learned_addr learned my addr 172.21.15.45:0/2649537063 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:46.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.520+0000 7f5c17fff700 1 --2- 172.21.15.45:0/2649537063 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x556243e37a70 0x556243e33190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:46.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.520+0000 7f5c1d53e700 1 --2- 172.21.15.45:0/2649537063 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x556243ec22a0 0x556243e2e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:46.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.520+0000 7f5c1cd3d700 1 -- 172.21.15.45:0/2649537063 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x556243ec22a0 msgr2=0x556243e2e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:46.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.520+0000 7f5c1cd3d700 1 --2- 172.21.15.45:0/2649537063 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x556243ec22a0 0x556243e2e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:46.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.520+0000 7f5c1cd3d700 1 -- 172.21.15.45:0/2649537063 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x556243e37a70 msgr2=0x556243e33190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:46.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.520+0000 7f5c1cd3d700 1 --2- 172.21.15.45:0/2649537063 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x556243e37a70 0x556243e33190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:46.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.520+0000 7f5c1cd3d700 1 -- 172.21.15.45:0/2649537063 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c18006bf0 con 0x556243e1c8f0 2023-12-22T10:01:46.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.520+0000 7f5c1cd3d700 1 --2- 172.21.15.45:0/2649537063 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556243e1c8f0 0x556243e30050 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7f5c1000a5a0 tx=0x7f5c10016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:46.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.520+0000 7f5c157fa700 1 -- 172.21.15.45:0/2649537063 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c10013540 con 0x556243e1c8f0 2023-12-22T10:01:46.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.520+0000 7f5c157fa700 1 -- 172.21.15.45:0/2649537063 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c100136a0 con 0x556243e1c8f0 2023-12-22T10:01:46.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.520+0000 7f5c1f4d8d00 1 -- 172.21.15.45:0/2649537063 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556243d8b770 con 0x556243e1c8f0 2023-12-22T10:01:46.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.520+0000 7f5c157fa700 1 -- 172.21.15.45:0/2649537063 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c10013a20 con 0x556243e1c8f0 2023-12-22T10:01:46.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.520+0000 7f5c1f4d8d00 1 -- 172.21.15.45:0/2649537063 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556243d5aa70 con 0x556243e1c8f0 2023-12-22T10:01:46.522 INFO:tasks.ceph.mds.b.smithi113.stdout:starting mds.b at 2023-12-22T10:01:46.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.524+0000 7f5c157fa700 1 -- 172.21.15.45:0/2649537063 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f5c1001e480 con 0x556243e1c8f0 2023-12-22T10:01:46.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.524+0000 7f5c157fa700 1 --2- 172.21.15.45:0/2649537063 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f5c00059020 0x7f5c0005b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:46.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.524+0000 7f5c157fa700 1 -- 172.21.15.45:0/2649537063 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f5c10074730 con 0x556243e1c8f0 2023-12-22T10:01:46.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.524+0000 7f5c17fff700 1 --2- 172.21.15.45:0/2649537063 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f5c00059020 0x7f5c0005b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:46.524 INFO:teuthology.orchestra.run.smithi045.stdout:Warning: using slow linear search 2023-12-22T10:01:46.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.524+0000 7f5c1f4d8d00 1 --2- 172.21.15.45:0/2649537063 >> [v2:172.21.15.113:6809/34099,v1:172.21.15.113:6811/34099] conn(0x556243e2e530 0x556243ec96c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:46.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.524+0000 7f5c1f4d8d00 1 -- 172.21.15.45:0/2649537063 --> [v2:172.21.15.113:6809/34099,v1:172.21.15.113:6811/34099] -- osd_op(unknown.0.0:1 5.0 5:00000000:%01:::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e37) v8 -- 0x556243ec9bb0 con 0x556243e2e530 2023-12-22T10:01:46.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.524+0000 7f5c17fff700 1 --2- 172.21.15.45:0/2649537063 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f5c00059020 0x7f5c0005b4e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x556243e1ebc0 tx=0x7f5c0800c040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:46.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.524+0000 7f5c1d53e700 1 --2- 172.21.15.45:0/2649537063 >> [v2:172.21.15.113:6809/34099,v1:172.21.15.113:6811/34099] conn(0x556243e2e530 0x556243ec96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:46.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.528+0000 7f5c1d53e700 1 --2- 172.21.15.45:0/2649537063 >> [v2:172.21.15.113:6809/34099,v1:172.21.15.113:6811/34099] conn(0x556243e2e530 0x556243ec96c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:46.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.528+0000 7f5c1d53e700 1 -- 172.21.15.45:0/2649537063 <== osd.4 v2:172.21.15.113:6809/34099 1 ==== osd_op_reply(1 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c180125c0 con 0x556243e2e530 2023-12-22T10:01:46.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.528+0000 7f5c1d53e700 1 --2- 172.21.15.45:0/2649537063 >> [v2:172.21.15.45:6816/33782,v1:172.21.15.45:6817/33782] conn(0x7f5c18012070 0x7f5c180113b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:46.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.528+0000 7f5c1d53e700 1 -- 172.21.15.45:0/2649537063 --> [v2:172.21.15.45:6816/33782,v1:172.21.15.45:6817/33782] -- osd_op(unknown.0.0:2 5.20 5:04000000:%01:::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e37) v8 -- 0x556243ec9bb0 con 0x7f5c18012070 2023-12-22T10:01:46.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.528+0000 7f5c1cd3d700 1 --2- 172.21.15.45:0/2649537063 >> [v2:172.21.15.45:6816/33782,v1:172.21.15.45:6817/33782] conn(0x7f5c18012070 0x7f5c180113b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:46.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.528+0000 7f5c1cd3d700 1 --2- 172.21.15.45:0/2649537063 >> [v2:172.21.15.45:6816/33782,v1:172.21.15.45:6817/33782] conn(0x7f5c18012070 0x7f5c180113b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:46.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.528+0000 7f5c1cd3d700 1 -- 172.21.15.45:0/2649537063 <== osd.3 v2:172.21.15.45:6816/33782 1 ==== osd_op_reply(2 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c10013d90 con 0x7f5c18012070 2023-12-22T10:01:46.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.528+0000 7f5c1cd3d700 1 --2- 172.21.15.45:0/2649537063 >> [v2:172.21.15.45:6800/33776,v1:172.21.15.45:6801/33776] conn(0x7f5c10028060 0x7f5c100740b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:46.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.528+0000 7f5c1cd3d700 1 -- 172.21.15.45:0/2649537063 --> [v2:172.21.15.45:6800/33776,v1:172.21.15.45:6801/33776] -- osd_op(unknown.0.0:3 5.10 5:08000000:%01:::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e37) v8 -- 0x556243ec9bb0 con 0x7f5c10028060 2023-12-22T10:01:46.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.528+0000 7f5c17fff700 1 --2- 172.21.15.45:0/2649537063 >> [v2:172.21.15.45:6800/33776,v1:172.21.15.45:6801/33776] conn(0x7f5c10028060 0x7f5c100740b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:46.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.532+0000 7f5c17fff700 1 --2- 172.21.15.45:0/2649537063 >> [v2:172.21.15.45:6800/33776,v1:172.21.15.45:6801/33776] conn(0x7f5c10028060 0x7f5c100740b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:46.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.532+0000 7f5c17fff700 1 -- 172.21.15.45:0/2649537063 <== osd.2 v2:172.21.15.45:6800/33776 1 ==== osd_op_reply(3 [pgnls start_epoch 37 out=97b] v35'4 uv4 ondisk = 1) v8 ==== 144+0+97 (crc 0 0 0) 0x7f5c08012040 con 0x7f5c10028060 2023-12-22T10:01:46.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.532+0000 7f5c17fff700 1 --2- 172.21.15.45:0/2649537063 >> [v2:172.21.15.45:6818/33777,v1:172.21.15.45:6819/33777] conn(0x7f5c08015380 0x7f5c080157a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:46.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.532+0000 7f5c17fff700 1 -- 172.21.15.45:0/2649537063 --> [v2:172.21.15.45:6818/33777,v1:172.21.15.45:6819/33777] -- osd_op(unknown.0.0:4 5.30 5:0c000000:%01:::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e37) v8 -- 0x556243ec9bb0 con 0x7f5c08015380 2023-12-22T10:01:46.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.532+0000 7f5c1d53e700 1 --2- 172.21.15.45:0/2649537063 >> [v2:172.21.15.45:6818/33777,v1:172.21.15.45:6819/33777] conn(0x7f5c08015380 0x7f5c080157a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:46.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.532+0000 7f5c1d53e700 1 --2- 172.21.15.45:0/2649537063 >> [v2:172.21.15.45:6818/33777,v1:172.21.15.45:6819/33777] conn(0x7f5c08015380 0x7f5c080157a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:46.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.532+0000 7f5c1d53e700 1 -- 172.21.15.45:0/2649537063 <== osd.0 v2:172.21.15.45:6818/33777 1 ==== osd_op_reply(4 [pgnls start_epoch 37 out=129b] v36'6 uv6 ondisk = 1) v8 ==== 144+0+129 (crc 0 0 0) 0x7f5c180125c0 con 0x7f5c08015380 2023-12-22T10:01:46.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.532+0000 7f5c1d53e700 1 --2- 172.21.15.45:0/2649537063 >> [v2:172.21.15.113:6808/34101,v1:172.21.15.113:6810/34101] conn(0x7f5c180263f0 0x7f5c180267f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:46.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.532+0000 7f5c1d53e700 1 -- 172.21.15.45:0/2649537063 --> [v2:172.21.15.113:6808/34101,v1:172.21.15.113:6810/34101] -- osd_op(unknown.0.0:5 5.8 5:10000000:%01:::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e37) v8 -- 0x556243ec9bb0 con 0x7f5c180263f0 2023-12-22T10:01:46.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.532+0000 7f5c1cd3d700 1 --2- 172.21.15.45:0/2649537063 >> [v2:172.21.15.113:6808/34101,v1:172.21.15.113:6810/34101] conn(0x7f5c180263f0 0x7f5c180267f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:46.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.536+0000 7f5c1cd3d700 1 --2- 172.21.15.45:0/2649537063 >> [v2:172.21.15.113:6808/34101,v1:172.21.15.113:6810/34101] conn(0x7f5c180263f0 0x7f5c180267f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:46.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.536+0000 7f5c157fa700 1 -- 172.21.15.45:0/2649537063 <== osd.6 v2:172.21.15.113:6808/34101 1 ==== osd_map(38..38 src has 1..38) v4 ==== 280+0+0 (crc 0 0 0) 0x7f5c10049f70 con 0x7f5c180263f0 2023-12-22T10:01:46.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.536+0000 7f5c1cd3d700 1 -- 172.21.15.45:0/2649537063 <== osd.6 v2:172.21.15.113:6808/34101 2 ==== osd_op_reply(5 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c10013d90 con 0x7f5c180263f0 2023-12-22T10:01:46.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.536+0000 7f5c1cd3d700 1 -- 172.21.15.45:0/2649537063 --> [v2:172.21.15.45:6800/33776,v1:172.21.15.45:6801/33776] -- osd_op(unknown.0.0:6 5.28 5:14000000:%01:::head [pgnls start_epoch 38 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e38) v8 -- 0x556243ec9bb0 con 0x7f5c10028060 2023-12-22T10:01:46.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.540+0000 7f5c17fff700 1 -- 172.21.15.45:0/2649537063 <== osd.2 v2:172.21.15.45:6800/33776 2 ==== osd_op_reply(6 [pgnls start_epoch 38 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c08012040 con 0x7f5c10028060 2023-12-22T10:01:46.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.540+0000 7f5c17fff700 1 --2- 172.21.15.45:0/2649537063 >> [v2:172.21.15.45:6808/33775,v1:172.21.15.45:6809/33775] conn(0x7f5c08022910 0x7f5c0801f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:46.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.540+0000 7f5c17fff700 1 -- 172.21.15.45:0/2649537063 --> [v2:172.21.15.45:6808/33775,v1:172.21.15.45:6809/33775] -- osd_op(unknown.0.0:7 5.18 5:18000000:%01:::head [pgnls start_epoch 38 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e38) v8 -- 0x556243ec9bb0 con 0x7f5c08022910 2023-12-22T10:01:46.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.540+0000 7f5c17fff700 1 --2- 172.21.15.45:0/2649537063 >> [v2:172.21.15.45:6808/33775,v1:172.21.15.45:6809/33775] conn(0x7f5c08022910 0x7f5c0801f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:46.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.544+0000 7f5c17fff700 1 --2- 172.21.15.45:0/2649537063 >> [v2:172.21.15.45:6808/33775,v1:172.21.15.45:6809/33775] conn(0x7f5c08022910 0x7f5c0801f350 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:46.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.548+0000 7f5c157fa700 1 -- 172.21.15.45:0/2649537063 <== osd.1 v2:172.21.15.45:6808/33775 1 ==== osd_map(39..39 src has 1..39) v4 ==== 280+0+0 (crc 0 0 0) 0x7f5c0801fa30 con 0x7f5c08022910 2023-12-22T10:01:46.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.548+0000 7f5c17fff700 1 -- 172.21.15.45:0/2649537063 <== osd.1 v2:172.21.15.45:6808/33775 2 ==== osd_op_reply(7 [pgnls start_epoch 38 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c08012040 con 0x7f5c08022910 2023-12-22T10:01:46.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.548+0000 7f5c17fff700 1 -- 172.21.15.45:0/2649537063 --> [v2:172.21.15.45:6800/33776,v1:172.21.15.45:6801/33776] -- osd_op(unknown.0.0:8 5.38 5:1c000000:%01:::head [pgnls start_epoch 39 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e39) v8 -- 0x556243ec9bb0 con 0x7f5c10028060 2023-12-22T10:01:46.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.552+0000 7f5c17fff700 1 -- 172.21.15.45:0/2649537063 <== osd.2 v2:172.21.15.45:6800/33776 3 ==== osd_op_reply(8 [pgnls start_epoch 39 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c08012040 con 0x7f5c10028060 2023-12-22T10:01:46.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.552+0000 7f5c17fff700 1 -- 172.21.15.45:0/2649537063 --> [v2:172.21.15.45:6818/33777,v1:172.21.15.45:6819/33777] -- osd_op(unknown.0.0:9 5.4 5:20000000:%01:::head [pgnls start_epoch 39 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e39) v8 -- 0x556243ec9bb0 con 0x7f5c08015380 2023-12-22T10:01:46.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.560+0000 7f5c1d53e700 1 -- 172.21.15.45:0/2649537063 <== osd.0 v2:172.21.15.45:6818/33777 2 ==== osd_op_reply(9 [pgnls start_epoch 39 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c180125c0 con 0x7f5c08015380 2023-12-22T10:01:46.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.560+0000 7f5c1d53e700 1 -- 172.21.15.45:0/2649537063 --> [v2:172.21.15.45:6800/33776,v1:172.21.15.45:6801/33776] -- osd_op(unknown.0.0:10 5.24 5:24000000:%01:::head [pgnls start_epoch 39 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e39) v8 -- 0x556243ec9bb0 con 0x7f5c10028060 2023-12-22T10:01:46.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.560+0000 7f5c17fff700 1 -- 172.21.15.45:0/2649537063 <== osd.2 v2:172.21.15.45:6800/33776 4 ==== osd_op_reply(10 [pgnls start_epoch 39 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c08012040 con 0x7f5c10028060 2023-12-22T10:01:46.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.560+0000 7f5c17fff700 1 -- 172.21.15.45:0/2649537063 --> [v2:172.21.15.113:6809/34099,v1:172.21.15.113:6811/34099] -- osd_op(unknown.0.0:11 5.14 5:28000000:%01:::head [pgnls start_epoch 39 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e39) v8 -- 0x556243ec9bb0 con 0x556243e2e530 2023-12-22T10:01:46.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.560+0000 7f5c1d53e700 1 -- 172.21.15.45:0/2649537063 <== osd.4 v2:172.21.15.113:6809/34099 2 ==== osd_op_reply(11 [pgnls start_epoch 39 out=101b] v36'5 uv5 ondisk = 1) v8 ==== 144+0+101 (crc 0 0 0) 0x7f5c180125c0 con 0x556243e2e530 2023-12-22T10:01:46.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.560+0000 7f5c1d53e700 1 -- 172.21.15.45:0/2649537063 --> [v2:172.21.15.45:6808/33775,v1:172.21.15.45:6809/33775] -- osd_op(unknown.0.0:12 5.34 5:2c000000:%01:::head [pgnls start_epoch 39 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e39) v8 -- 0x556243ec9bb0 con 0x7f5c08022910 2023-12-22T10:01:46.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.560+0000 7f5c17fff700 1 -- 172.21.15.45:0/2649537063 <== osd.1 v2:172.21.15.45:6808/33775 3 ==== osd_op_reply(12 [pgnls start_epoch 39 out=97b] v36'13 uv13 ondisk = 1) v8 ==== 144+0+97 (crc 0 0 0) 0x7f5c08012040 con 0x7f5c08022910 2023-12-22T10:01:46.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.560+0000 7f5c17fff700 1 --2- 172.21.15.45:0/2649537063 >> [v2:172.21.15.113:6800/34100,v1:172.21.15.113:6801/34100] conn(0x7f5c08033940 0x7f5c080323c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:46.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.560+0000 7f5c17fff700 1 -- 172.21.15.45:0/2649537063 --> [v2:172.21.15.113:6800/34100,v1:172.21.15.113:6801/34100] -- osd_op(unknown.0.0:13 5.c 5:30000000:%01:::head [pgnls start_epoch 39 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e39) v8 -- 0x556243ec9bb0 con 0x7f5c08033940 2023-12-22T10:01:46.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.564+0000 7f5c1d53e700 1 --2- 172.21.15.45:0/2649537063 >> [v2:172.21.15.113:6800/34100,v1:172.21.15.113:6801/34100] conn(0x7f5c08033940 0x7f5c080323c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:46.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.564+0000 7f5c1d53e700 1 --2- 172.21.15.45:0/2649537063 >> [v2:172.21.15.113:6800/34100,v1:172.21.15.113:6801/34100] conn(0x7f5c08033940 0x7f5c080323c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:46.568 INFO:tasks.ceph.mds.c.smithi045.stdout:starting mds.c at 2023-12-22T10:01:46.568 INFO:tasks.ceph.mds.a.smithi045.stdout:starting mds.a at 2023-12-22T10:01:46.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.572+0000 7f5c1d53e700 1 -- 172.21.15.45:0/2649537063 <== osd.5 v2:172.21.15.113:6800/34100 1 ==== osd_op_reply(13 [pgnls start_epoch 39 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c180125c0 con 0x7f5c08033940 2023-12-22T10:01:46.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.572+0000 7f5c1d53e700 1 -- 172.21.15.45:0/2649537063 --> [v2:172.21.15.113:6808/34101,v1:172.21.15.113:6810/34101] -- osd_op(unknown.0.0:14 5.2c 5:34000000:%01:::head [pgnls start_epoch 39 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e39) v8 -- 0x556243ec9bb0 con 0x7f5c180263f0 2023-12-22T10:01:46.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.572+0000 7f5c1cd3d700 1 -- 172.21.15.45:0/2649537063 <== osd.6 v2:172.21.15.113:6808/34101 3 ==== osd_op_reply(14 [pgnls start_epoch 39 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c10013d90 con 0x7f5c180263f0 2023-12-22T10:01:46.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.572+0000 7f5c1cd3d700 1 -- 172.21.15.45:0/2649537063 --> [v2:172.21.15.45:6800/33776,v1:172.21.15.45:6801/33776] -- osd_op(unknown.0.0:15 5.1c 5:38000000:%01:::head [pgnls start_epoch 39 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e39) v8 -- 0x556243ec9bb0 con 0x7f5c10028060 2023-12-22T10:01:46.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.572+0000 7f5c17fff700 1 -- 172.21.15.45:0/2649537063 <== osd.2 v2:172.21.15.45:6800/33776 5 ==== osd_op_reply(15 [pgnls start_epoch 39 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c08012040 con 0x7f5c10028060 2023-12-22T10:01:46.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.572+0000 7f5c17fff700 1 -- 172.21.15.45:0/2649537063 --> [v2:172.21.15.113:6809/34099,v1:172.21.15.113:6811/34099] -- osd_op(unknown.0.0:16 5.3c 5:3c000000:%01:::head [pgnls start_epoch 39 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e39) v8 -- 0x556243ec9bb0 con 0x556243e2e530 2023-12-22T10:01:46.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.572+0000 7f5c1d53e700 1 -- 172.21.15.45:0/2649537063 <== osd.4 v2:172.21.15.113:6809/34099 3 ==== osd_op_reply(16 [pgnls start_epoch 39 out=73b] v35'2 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x7f5c180125c0 con 0x556243e2e530 2023-12-22T10:01:46.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.572+0000 7f5c1d53e700 1 -- 172.21.15.45:0/2649537063 --> [v2:172.21.15.45:6818/33777,v1:172.21.15.45:6819/33777] -- osd_op(unknown.0.0:17 5.2 5:40000000:%01:::head [pgnls start_epoch 39 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e39) v8 -- 0x556243ec9bb0 con 0x7f5c08015380 2023-12-22T10:01:46.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.572+0000 7f5c1d53e700 1 -- 172.21.15.45:0/2649537063 <== osd.0 v2:172.21.15.45:6818/33777 3 ==== osd_op_reply(17 [pgnls start_epoch 39 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c180125c0 con 0x7f5c08015380 2023-12-22T10:01:46.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.572+0000 7f5c1d53e700 1 -- 172.21.15.45:0/2649537063 --> [v2:172.21.15.45:6818/33777,v1:172.21.15.45:6819/33777] -- osd_op(unknown.0.0:18 5.22 5:44000000:%01:::head [pgnls start_epoch 39 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e39) v8 -- 0x556243ec9bb0 con 0x7f5c08015380 2023-12-22T10:01:46.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.576+0000 7f5c1d53e700 1 -- 172.21.15.45:0/2649537063 <== osd.0 v2:172.21.15.45:6818/33777 4 ==== osd_op_reply(18 [pgnls start_epoch 39 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c180125c0 con 0x7f5c08015380 2023-12-22T10:01:46.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.576+0000 7f5c1d53e700 1 -- 172.21.15.45:0/2649537063 --> [v2:172.21.15.113:6808/34101,v1:172.21.15.113:6810/34101] -- osd_op(unknown.0.0:19 5.12 5:48000000:%01:::head [pgnls start_epoch 39 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e39) v8 -- 0x556243ec9bb0 con 0x7f5c180263f0 2023-12-22T10:01:46.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.576+0000 7f5c1cd3d700 1 -- 172.21.15.45:0/2649537063 <== osd.6 v2:172.21.15.113:6808/34101 4 ==== osd_op_reply(19 [pgnls start_epoch 39 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c10013d90 con 0x7f5c180263f0 2023-12-22T10:01:46.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.576+0000 7f5c1cd3d700 1 -- 172.21.15.45:0/2649537063 --> [v2:172.21.15.113:6809/34099,v1:172.21.15.113:6811/34099] -- osd_op(unknown.0.0:20 5.32 5:4c000000:%01:::head [pgnls start_epoch 39 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e39) v8 -- 0x556243ec9bb0 con 0x556243e2e530 2023-12-22T10:01:46.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.576+0000 7f5c1d53e700 1 -- 172.21.15.45:0/2649537063 <== osd.4 v2:172.21.15.113:6809/34099 4 ==== osd_op_reply(20 [pgnls start_epoch 39 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c180125c0 con 0x556243e2e530 2023-12-22T10:01:46.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.576+0000 7f5c1d53e700 1 -- 172.21.15.45:0/2649537063 --> [v2:172.21.15.113:6808/34101,v1:172.21.15.113:6810/34101] -- osd_op(unknown.0.0:21 5.a 5:50000000:%01:::head [pgnls start_epoch 39 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e39) v8 -- 0x556243ec9bb0 con 0x7f5c180263f0 2023-12-22T10:01:46.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.576+0000 7f5c1cd3d700 1 -- 172.21.15.45:0/2649537063 <== osd.6 v2:172.21.15.113:6808/34101 5 ==== osd_op_reply(21 [pgnls start_epoch 39 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c10013d90 con 0x7f5c180263f0 2023-12-22T10:01:46.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.576+0000 7f5c1cd3d700 1 -- 172.21.15.45:0/2649537063 --> [v2:172.21.15.45:6800/33776,v1:172.21.15.45:6801/33776] -- osd_op(unknown.0.0:22 5.2a 5:54000000:%01:::head [pgnls start_epoch 39 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e39) v8 -- 0x556243ec9bb0 con 0x7f5c10028060 2023-12-22T10:01:46.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.576+0000 7f5c17fff700 1 -- 172.21.15.45:0/2649537063 <== osd.2 v2:172.21.15.45:6800/33776 6 ==== osd_op_reply(22 [pgnls start_epoch 39 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c08012040 con 0x7f5c10028060 2023-12-22T10:01:46.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.576+0000 7f5c17fff700 1 -- 172.21.15.45:0/2649537063 --> [v2:172.21.15.45:6808/33775,v1:172.21.15.45:6809/33775] -- osd_op(unknown.0.0:23 5.1a 5:58000000:%01:::head [pgnls start_epoch 39 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e39) v8 -- 0x556243ec9bb0 con 0x7f5c08022910 2023-12-22T10:01:46.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.576+0000 7f5c17fff700 1 -- 172.21.15.45:0/2649537063 <== osd.1 v2:172.21.15.45:6808/33775 4 ==== osd_op_reply(23 [pgnls start_epoch 39 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c08012040 con 0x7f5c08022910 2023-12-22T10:01:46.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.580+0000 7f5c17fff700 1 --2- 172.21.15.45:0/2649537063 >> [v2:172.21.15.113:6821/34102,v1:172.21.15.113:6825/34102] conn(0x7f5c08031350 0x7f5c08031790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:46.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.580+0000 7f5c17fff700 1 -- 172.21.15.45:0/2649537063 --> [v2:172.21.15.113:6821/34102,v1:172.21.15.113:6825/34102] -- osd_op(unknown.0.0:24 5.3a 5:5c000000:%01:::head [pgnls start_epoch 39 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e39) v8 -- 0x556243ec9bb0 con 0x7f5c08031350 2023-12-22T10:01:46.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.580+0000 7f5c1cd3d700 1 --2- 172.21.15.45:0/2649537063 >> [v2:172.21.15.113:6821/34102,v1:172.21.15.113:6825/34102] conn(0x7f5c08031350 0x7f5c08031790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:46.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.580+0000 7f5c1cd3d700 1 --2- 172.21.15.45:0/2649537063 >> [v2:172.21.15.113:6821/34102,v1:172.21.15.113:6825/34102] conn(0x7f5c08031350 0x7f5c08031790 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:46.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.584+0000 7f5c1cd3d700 1 -- 172.21.15.45:0/2649537063 <== osd.7 v2:172.21.15.113:6821/34102 1 ==== osd_op_reply(24 [pgnls start_epoch 39 out=49b] v35'1 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c1003a040 con 0x7f5c08031350 2023-12-22T10:01:46.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.584+0000 7f5c1cd3d700 1 -- 172.21.15.45:0/2649537063 --> [v2:172.21.15.113:6821/34102,v1:172.21.15.113:6825/34102] -- osd_op(unknown.0.0:25 5.6 5:60000000:%01:::head [pgnls start_epoch 39 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e39) v8 -- 0x556243ec9bb0 con 0x7f5c08031350 2023-12-22T10:01:46.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.584+0000 7f5c1cd3d700 1 -- 172.21.15.45:0/2649537063 <== osd.7 v2:172.21.15.113:6821/34102 2 ==== osd_op_reply(25 [pgnls start_epoch 39 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c1003a040 con 0x7f5c08031350 2023-12-22T10:01:46.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.584+0000 7f5c1cd3d700 1 -- 172.21.15.45:0/2649537063 --> [v2:172.21.15.113:6809/34099,v1:172.21.15.113:6811/34099] -- osd_op(unknown.0.0:26 5.26 5:64000000:%01:::head [pgnls start_epoch 39 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e39) v8 -- 0x556243ec9bb0 con 0x556243e2e530 2023-12-22T10:01:46.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.588+0000 7f5c1d53e700 1 -- 172.21.15.45:0/2649537063 <== osd.4 v2:172.21.15.113:6809/34099 5 ==== osd_op_reply(26 [pgnls start_epoch 39 out=77b] v36'2 uv2 ondisk = 1) v8 ==== 144+0+77 (crc 0 0 0) 0x7f5c180125c0 con 0x556243e2e530 2023-12-22T10:01:46.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.588+0000 7f5c1d53e700 1 -- 172.21.15.45:0/2649537063 --> [v2:172.21.15.45:6816/33782,v1:172.21.15.45:6817/33782] -- osd_op(unknown.0.0:27 5.16 5:68000000:%01:::head [pgnls start_epoch 39 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e39) v8 -- 0x556243ec9bb0 con 0x7f5c18012070 2023-12-22T10:01:46.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.588+0000 7f5c1cd3d700 1 -- 172.21.15.45:0/2649537063 <== osd.3 v2:172.21.15.45:6816/33782 2 ==== osd_op_reply(27 [pgnls start_epoch 39 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c1003a040 con 0x7f5c18012070 2023-12-22T10:01:46.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.588+0000 7f5c1cd3d700 1 -- 172.21.15.45:0/2649537063 --> [v2:172.21.15.113:6809/34099,v1:172.21.15.113:6811/34099] -- osd_op(unknown.0.0:28 5.36 5:6c000000:%01:::head [pgnls start_epoch 39 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e39) v8 -- 0x556243ec9bb0 con 0x556243e2e530 2023-12-22T10:01:46.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.588+0000 7f5c1d53e700 1 -- 172.21.15.45:0/2649537063 <== osd.4 v2:172.21.15.113:6809/34099 6 ==== osd_op_reply(28 [pgnls start_epoch 39 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c180125c0 con 0x556243e2e530 2023-12-22T10:01:46.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.588+0000 7f5c1d53e700 1 -- 172.21.15.45:0/2649537063 --> [v2:172.21.15.45:6816/33782,v1:172.21.15.45:6817/33782] -- osd_op(unknown.0.0:29 5.e 5:70000000:%01:::head [pgnls start_epoch 39 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e39) v8 -- 0x556243ec9bb0 con 0x7f5c18012070 2023-12-22T10:01:46.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.588+0000 7f5c157fa700 1 -- 172.21.15.45:0/2649537063 <== osd.3 v2:172.21.15.45:6816/33782 3 ==== osd_map(40..40 src has 1..40) v4 ==== 280+0+0 (crc 0 0 0) 0x7f5c100482e0 con 0x7f5c18012070 2023-12-22T10:01:46.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.588+0000 7f5c1cd3d700 1 -- 172.21.15.45:0/2649537063 <== osd.3 v2:172.21.15.45:6816/33782 4 ==== osd_op_reply(29 [pgnls start_epoch 39 out=73b] v35'2 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x7f5c1003a040 con 0x7f5c18012070 2023-12-22T10:01:46.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.588+0000 7f5c1cd3d700 1 -- 172.21.15.45:0/2649537063 --> [v2:172.21.15.113:6821/34102,v1:172.21.15.113:6825/34102] -- osd_op(unknown.0.0:30 5.2e 5:74000000:%01:::head [pgnls start_epoch 40 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e40) v8 -- 0x556243ec9bb0 con 0x7f5c08031350 2023-12-22T10:01:46.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.596+0000 7f5c1cd3d700 1 -- 172.21.15.45:0/2649537063 <== osd.7 v2:172.21.15.113:6821/34102 3 ==== osd_op_reply(30 [pgnls start_epoch 40 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c1003a040 con 0x7f5c08031350 2023-12-22T10:01:46.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.596+0000 7f5c1cd3d700 1 -- 172.21.15.45:0/2649537063 --> [v2:172.21.15.113:6808/34101,v1:172.21.15.113:6810/34101] -- osd_op(unknown.0.0:31 5.1e 5:78000000:%01:::head [pgnls start_epoch 40 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e40) v8 -- 0x556243ec9bb0 con 0x7f5c180263f0 2023-12-22T10:01:46.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.596+0000 7f5c1cd3d700 1 -- 172.21.15.45:0/2649537063 <== osd.6 v2:172.21.15.113:6808/34101 6 ==== osd_op_reply(31 [pgnls start_epoch 40 out=49b] v35'1 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c1003a040 con 0x7f5c180263f0 2023-12-22T10:01:46.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.596+0000 7f5c1cd3d700 1 -- 172.21.15.45:0/2649537063 --> [v2:172.21.15.113:6800/34100,v1:172.21.15.113:6801/34100] -- osd_op(unknown.0.0:32 5.3e 5:7c000000:%01:::head [pgnls start_epoch 40 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e40) v8 -- 0x556243ec9bb0 con 0x7f5c08033940 2023-12-22T10:01:46.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.600+0000 7f5c157fa700 1 -- 172.21.15.45:0/2649537063 <== osd.5 v2:172.21.15.113:6800/34100 2 ==== osd_map(41..41 src has 1..41) v4 ==== 280+0+0 (crc 0 0 0) 0x7f5c1800d4a0 con 0x7f5c08033940 2023-12-22T10:01:46.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.600+0000 7f5c1d53e700 1 -- 172.21.15.45:0/2649537063 <== osd.5 v2:172.21.15.113:6800/34100 3 ==== osd_op_reply(32 [pgnls start_epoch 40 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c180125c0 con 0x7f5c08033940 2023-12-22T10:01:46.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.600+0000 7f5c1d53e700 1 -- 172.21.15.45:0/2649537063 --> [v2:172.21.15.45:6816/33782,v1:172.21.15.45:6817/33782] -- osd_op(unknown.0.0:33 5.1 5:80000000:%01:::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e41) v8 -- 0x556243ec9bb0 con 0x7f5c18012070 2023-12-22T10:01:46.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.608+0000 7f5c1cd3d700 1 -- 172.21.15.45:0/2649537063 <== osd.3 v2:172.21.15.45:6816/33782 5 ==== osd_op_reply(33 [pgnls start_epoch 41 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c1003a040 con 0x7f5c18012070 2023-12-22T10:01:46.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.608+0000 7f5c1cd3d700 1 -- 172.21.15.45:0/2649537063 --> [v2:172.21.15.45:6800/33776,v1:172.21.15.45:6801/33776] -- osd_op(unknown.0.0:34 5.21 5:84000000:%01:::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e41) v8 -- 0x556243ec9bb0 con 0x7f5c10028060 2023-12-22T10:01:46.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.612+0000 7f5c17fff700 1 -- 172.21.15.45:0/2649537063 <== osd.2 v2:172.21.15.45:6800/33776 7 ==== osd_op_reply(34 [pgnls start_epoch 41 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c08012040 con 0x7f5c10028060 2023-12-22T10:01:46.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.612+0000 7f5c17fff700 1 -- 172.21.15.45:0/2649537063 --> [v2:172.21.15.45:6816/33782,v1:172.21.15.45:6817/33782] -- osd_op(unknown.0.0:35 5.11 5:88000000:%01:::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e41) v8 -- 0x556243ec9bb0 con 0x7f5c18012070 2023-12-22T10:01:46.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.616+0000 7f5c1cd3d700 1 -- 172.21.15.45:0/2649537063 <== osd.3 v2:172.21.15.45:6816/33782 6 ==== osd_op_reply(35 [pgnls start_epoch 41 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c1003a040 con 0x7f5c18012070 2023-12-22T10:01:46.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.616+0000 7f5c1cd3d700 1 -- 172.21.15.45:0/2649537063 --> [v2:172.21.15.45:6818/33777,v1:172.21.15.45:6819/33777] -- osd_op(unknown.0.0:36 5.31 5:8c000000:%01:::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e41) v8 -- 0x556243ec9bb0 con 0x7f5c08015380 2023-12-22T10:01:46.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.620+0000 7f5c1d53e700 1 -- 172.21.15.45:0/2649537063 <== osd.0 v2:172.21.15.45:6818/33777 5 ==== osd_op_reply(36 [pgnls start_epoch 41 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c18042040 con 0x7f5c08015380 2023-12-22T10:01:46.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.620+0000 7f5c1d53e700 1 -- 172.21.15.45:0/2649537063 --> [v2:172.21.15.45:6808/33775,v1:172.21.15.45:6809/33775] -- osd_op(unknown.0.0:37 5.9 5:90000000:%01:::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e41) v8 -- 0x556243ec9bb0 con 0x7f5c08022910 2023-12-22T10:01:46.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.624+0000 7f5c17fff700 1 -- 172.21.15.45:0/2649537063 <== osd.1 v2:172.21.15.45:6808/33775 5 ==== osd_op_reply(37 [pgnls start_epoch 41 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c08012040 con 0x7f5c08022910 2023-12-22T10:01:46.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.624+0000 7f5c17fff700 1 -- 172.21.15.45:0/2649537063 --> [v2:172.21.15.113:6808/34101,v1:172.21.15.113:6810/34101] -- osd_op(unknown.0.0:38 5.29 5:94000000:%01:::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e41) v8 -- 0x556243ec9bb0 con 0x7f5c180263f0 2023-12-22T10:01:46.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.628+0000 7f5c1cd3d700 1 -- 172.21.15.45:0/2649537063 <== osd.6 v2:172.21.15.113:6808/34101 7 ==== osd_op_reply(38 [pgnls start_epoch 41 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c1003a040 con 0x7f5c180263f0 2023-12-22T10:01:46.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.628+0000 7f5c1cd3d700 1 -- 172.21.15.45:0/2649537063 --> [v2:172.21.15.113:6809/34099,v1:172.21.15.113:6811/34099] -- osd_op(unknown.0.0:39 5.19 5:98000000:%01:::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e41) v8 -- 0x556243ec9bb0 con 0x556243e2e530 2023-12-22T10:01:46.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.628+0000 7f5c1d53e700 1 -- 172.21.15.45:0/2649537063 <== osd.4 v2:172.21.15.113:6809/34099 7 ==== osd_op_reply(39 [pgnls start_epoch 41 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c18042040 con 0x556243e2e530 2023-12-22T10:01:46.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.628+0000 7f5c1d53e700 1 -- 172.21.15.45:0/2649537063 --> [v2:172.21.15.45:6800/33776,v1:172.21.15.45:6801/33776] -- osd_op(unknown.0.0:40 5.39 5:9c000000:%01:::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e41) v8 -- 0x556243ec9bb0 con 0x7f5c10028060 2023-12-22T10:01:46.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.628+0000 7f5c17fff700 1 -- 172.21.15.45:0/2649537063 <== osd.2 v2:172.21.15.45:6800/33776 8 ==== osd_op_reply(40 [pgnls start_epoch 41 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c08012040 con 0x7f5c10028060 2023-12-22T10:01:46.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.628+0000 7f5c17fff700 1 -- 172.21.15.45:0/2649537063 --> [v2:172.21.15.113:6821/34102,v1:172.21.15.113:6825/34102] -- osd_op(unknown.0.0:41 5.5 5:a0000000:%01:::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e41) v8 -- 0x556243ec9bb0 con 0x7f5c08031350 2023-12-22T10:01:46.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.628+0000 7f5c1cd3d700 1 -- 172.21.15.45:0/2649537063 <== osd.7 v2:172.21.15.113:6821/34102 4 ==== osd_op_reply(41 [pgnls start_epoch 41 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c1003a040 con 0x7f5c08031350 2023-12-22T10:01:46.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.628+0000 7f5c1cd3d700 1 -- 172.21.15.45:0/2649537063 --> [v2:172.21.15.113:6800/34100,v1:172.21.15.113:6801/34100] -- osd_op(unknown.0.0:42 5.25 5:a4000000:%01:::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e41) v8 -- 0x556243ec9bb0 con 0x7f5c08033940 2023-12-22T10:01:46.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.628+0000 7f5c1d53e700 1 -- 172.21.15.45:0/2649537063 <== osd.5 v2:172.21.15.113:6800/34100 4 ==== osd_op_reply(42 [pgnls start_epoch 41 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c18042040 con 0x7f5c08033940 2023-12-22T10:01:46.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.628+0000 7f5c1d53e700 1 -- 172.21.15.45:0/2649537063 --> [v2:172.21.15.45:6816/33782,v1:172.21.15.45:6817/33782] -- osd_op(unknown.0.0:43 5.15 5:a8000000:%01:::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e41) v8 -- 0x556243ec9bb0 con 0x7f5c18012070 2023-12-22T10:01:46.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.632+0000 7f5c1cd3d700 1 -- 172.21.15.45:0/2649537063 <== osd.3 v2:172.21.15.45:6816/33782 7 ==== osd_op_reply(43 [pgnls start_epoch 41 out=97b] v35'3 uv3 ondisk = 1) v8 ==== 144+0+97 (crc 0 0 0) 0x7f5c1003a040 con 0x7f5c18012070 2023-12-22T10:01:46.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.632+0000 7f5c1cd3d700 1 -- 172.21.15.45:0/2649537063 --> [v2:172.21.15.45:6816/33782,v1:172.21.15.45:6817/33782] -- osd_op(unknown.0.0:44 5.35 5:ac000000:%01:::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e41) v8 -- 0x556243ec9bb0 con 0x7f5c18012070 2023-12-22T10:01:46.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.632+0000 7f5c1cd3d700 1 -- 172.21.15.45:0/2649537063 <== osd.3 v2:172.21.15.45:6816/33782 8 ==== osd_op_reply(44 [pgnls start_epoch 41 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c1003a040 con 0x7f5c18012070 2023-12-22T10:01:46.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.632+0000 7f5c1cd3d700 1 -- 172.21.15.45:0/2649537063 --> [v2:172.21.15.113:6821/34102,v1:172.21.15.113:6825/34102] -- osd_op(unknown.0.0:45 5.d 5:b0000000:%01:::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e41) v8 -- 0x556243ec9bb0 con 0x7f5c08031350 2023-12-22T10:01:46.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.632+0000 7f5c1cd3d700 1 -- 172.21.15.45:0/2649537063 <== osd.7 v2:172.21.15.113:6821/34102 5 ==== osd_op_reply(45 [pgnls start_epoch 41 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c1003a040 con 0x7f5c08031350 2023-12-22T10:01:46.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.632+0000 7f5c1cd3d700 1 -- 172.21.15.45:0/2649537063 --> [v2:172.21.15.113:6821/34102,v1:172.21.15.113:6825/34102] -- osd_op(unknown.0.0:46 5.2d 5:b4000000:%01:::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e41) v8 -- 0x556243ec9bb0 con 0x7f5c08031350 2023-12-22T10:01:46.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.632+0000 7f5c1cd3d700 1 -- 172.21.15.45:0/2649537063 <== osd.7 v2:172.21.15.113:6821/34102 6 ==== osd_op_reply(46 [pgnls start_epoch 41 out=74b] v35'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f5c1003a040 con 0x7f5c08031350 2023-12-22T10:01:46.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.632+0000 7f5c1cd3d700 1 -- 172.21.15.45:0/2649537063 --> [v2:172.21.15.113:6809/34099,v1:172.21.15.113:6811/34099] -- osd_op(unknown.0.0:47 5.1d 5:b8000000:%01:::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e41) v8 -- 0x556243ec9bb0 con 0x556243e2e530 2023-12-22T10:01:46.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.632+0000 7f5c1d53e700 1 -- 172.21.15.45:0/2649537063 <== osd.4 v2:172.21.15.113:6809/34099 8 ==== osd_op_reply(47 [pgnls start_epoch 41 out=73b] v35'2 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x7f5c18042040 con 0x556243e2e530 2023-12-22T10:01:46.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.632+0000 7f5c1d53e700 1 -- 172.21.15.45:0/2649537063 --> [v2:172.21.15.45:6808/33775,v1:172.21.15.45:6809/33775] -- osd_op(unknown.0.0:48 5.3d 5:bc000000:%01:::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e41) v8 -- 0x556243ec9bb0 con 0x7f5c08022910 2023-12-22T10:01:46.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.636+0000 7f5c17fff700 1 -- 172.21.15.45:0/2649537063 <== osd.1 v2:172.21.15.45:6808/33775 6 ==== osd_op_reply(48 [pgnls start_epoch 41 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c08012040 con 0x7f5c08022910 2023-12-22T10:01:46.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.636+0000 7f5c17fff700 1 -- 172.21.15.45:0/2649537063 --> [v2:172.21.15.113:6809/34099,v1:172.21.15.113:6811/34099] -- osd_op(unknown.0.0:49 5.3 5:c0000000:%01:::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e41) v8 -- 0x556243ec9bb0 con 0x556243e2e530 2023-12-22T10:01:46.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.636+0000 7f5c1d53e700 1 -- 172.21.15.45:0/2649537063 <== osd.4 v2:172.21.15.113:6809/34099 9 ==== osd_op_reply(49 [pgnls start_epoch 41 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c18042040 con 0x556243e2e530 2023-12-22T10:01:46.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.636+0000 7f5c1d53e700 1 -- 172.21.15.45:0/2649537063 --> [v2:172.21.15.45:6818/33777,v1:172.21.15.45:6819/33777] -- osd_op(unknown.0.0:50 5.23 5:c4000000:%01:::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e41) v8 -- 0x556243ec9bb0 con 0x7f5c08015380 2023-12-22T10:01:46.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.636+0000 7f5c1d53e700 1 -- 172.21.15.45:0/2649537063 <== osd.0 v2:172.21.15.45:6818/33777 6 ==== osd_op_reply(50 [pgnls start_epoch 41 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c18042040 con 0x7f5c08015380 2023-12-22T10:01:46.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.636+0000 7f5c1d53e700 1 -- 172.21.15.45:0/2649537063 --> [v2:172.21.15.113:6809/34099,v1:172.21.15.113:6811/34099] -- osd_op(unknown.0.0:51 5.13 5:c8000000:%01:::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e41) v8 -- 0x556243ec9bb0 con 0x556243e2e530 2023-12-22T10:01:46.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.636+0000 7f5c1d53e700 1 -- 172.21.15.45:0/2649537063 <== osd.4 v2:172.21.15.113:6809/34099 10 ==== osd_op_reply(51 [pgnls start_epoch 41 out=74b] v36'2 uv2 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f5c18042040 con 0x556243e2e530 2023-12-22T10:01:46.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.636+0000 7f5c1d53e700 1 -- 172.21.15.45:0/2649537063 --> [v2:172.21.15.113:6808/34101,v1:172.21.15.113:6810/34101] -- osd_op(unknown.0.0:52 5.33 5:cc000000:%01:::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e41) v8 -- 0x556243ec9bb0 con 0x7f5c180263f0 2023-12-22T10:01:46.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.636+0000 7f5c1cd3d700 1 -- 172.21.15.45:0/2649537063 <== osd.6 v2:172.21.15.113:6808/34101 8 ==== osd_op_reply(52 [pgnls start_epoch 41 out=73b] v35'1 uv1 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x7f5c1003a040 con 0x7f5c180263f0 2023-12-22T10:01:46.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.636+0000 7f5c1cd3d700 1 -- 172.21.15.45:0/2649537063 --> [v2:172.21.15.113:6800/34100,v1:172.21.15.113:6801/34100] -- osd_op(unknown.0.0:53 5.b 5:d0000000:%01:::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e41) v8 -- 0x556243ec9bb0 con 0x7f5c08033940 2023-12-22T10:01:46.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.640+0000 7f5c1d53e700 1 -- 172.21.15.45:0/2649537063 <== osd.5 v2:172.21.15.113:6800/34100 5 ==== osd_op_reply(53 [pgnls start_epoch 41 out=76b] v36'2 uv2 ondisk = 1) v8 ==== 144+0+76 (crc 0 0 0) 0x7f5c18042040 con 0x7f5c08033940 2023-12-22T10:01:46.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.640+0000 7f5c1d53e700 1 -- 172.21.15.45:0/2649537063 --> [v2:172.21.15.45:6818/33777,v1:172.21.15.45:6819/33777] -- osd_op(unknown.0.0:54 5.2b 5:d4000000:%01:::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e41) v8 -- 0x556243ec9bb0 con 0x7f5c08015380 2023-12-22T10:01:46.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.640+0000 7f5c1d53e700 1 -- 172.21.15.45:0/2649537063 <== osd.0 v2:172.21.15.45:6818/33777 7 ==== osd_op_reply(54 [pgnls start_epoch 41 out=49b] v35'1 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c18042040 con 0x7f5c08015380 2023-12-22T10:01:46.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.640+0000 7f5c1d53e700 1 -- 172.21.15.45:0/2649537063 --> [v2:172.21.15.45:6800/33776,v1:172.21.15.45:6801/33776] -- osd_op(unknown.0.0:55 5.1b 5:d8000000:%01:::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e41) v8 -- 0x556243ec9bb0 con 0x7f5c10028060 2023-12-22T10:01:46.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.640+0000 7f5c17fff700 1 -- 172.21.15.45:0/2649537063 <== osd.2 v2:172.21.15.45:6800/33776 9 ==== osd_op_reply(55 [pgnls start_epoch 41 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c08012040 con 0x7f5c10028060 2023-12-22T10:01:46.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.640+0000 7f5c17fff700 1 -- 172.21.15.45:0/2649537063 --> [v2:172.21.15.113:6800/34100,v1:172.21.15.113:6801/34100] -- osd_op(unknown.0.0:56 5.3b 5:dc000000:%01:::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e41) v8 -- 0x556243ec9bb0 con 0x7f5c08033940 2023-12-22T10:01:46.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.640+0000 7f5c1d53e700 1 -- 172.21.15.45:0/2649537063 <== osd.5 v2:172.21.15.113:6800/34100 6 ==== osd_op_reply(56 [pgnls start_epoch 41 out=49b] v35'1 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c18042040 con 0x7f5c08033940 2023-12-22T10:01:46.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.640+0000 7f5c1d53e700 1 -- 172.21.15.45:0/2649537063 --> [v2:172.21.15.45:6816/33782,v1:172.21.15.45:6817/33782] -- osd_op(unknown.0.0:57 5.7 5:e0000000:%01:::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e41) v8 -- 0x556243ec9bb0 con 0x7f5c18012070 2023-12-22T10:01:46.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.644+0000 7f5c1cd3d700 1 -- 172.21.15.45:0/2649537063 <== osd.3 v2:172.21.15.45:6816/33782 9 ==== osd_op_reply(57 [pgnls start_epoch 41 out=73b] v35'2 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x7f5c1003a040 con 0x7f5c18012070 2023-12-22T10:01:46.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.644+0000 7f5c1cd3d700 1 -- 172.21.15.45:0/2649537063 --> [v2:172.21.15.113:6809/34099,v1:172.21.15.113:6811/34099] -- osd_op(unknown.0.0:58 5.27 5:e4000000:%01:::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e41) v8 -- 0x556243ec9bb0 con 0x556243e2e530 2023-12-22T10:01:46.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.644+0000 7f5c1d53e700 1 -- 172.21.15.45:0/2649537063 <== osd.4 v2:172.21.15.113:6809/34099 11 ==== osd_op_reply(58 [pgnls start_epoch 41 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c18042040 con 0x556243e2e530 2023-12-22T10:01:46.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.644+0000 7f5c1d53e700 1 -- 172.21.15.45:0/2649537063 --> [v2:172.21.15.113:6809/34099,v1:172.21.15.113:6811/34099] -- osd_op(unknown.0.0:59 5.17 5:e8000000:%01:::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e41) v8 -- 0x556243ec9bb0 con 0x556243e2e530 2023-12-22T10:01:46.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.644+0000 7f5c1d53e700 1 -- 172.21.15.45:0/2649537063 <== osd.4 v2:172.21.15.113:6809/34099 12 ==== osd_op_reply(59 [pgnls start_epoch 41 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c18042040 con 0x556243e2e530 2023-12-22T10:01:46.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.644+0000 7f5c1d53e700 1 -- 172.21.15.45:0/2649537063 --> [v2:172.21.15.45:6808/33775,v1:172.21.15.45:6809/33775] -- osd_op(unknown.0.0:60 5.37 5:ec000000:%01:::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e41) v8 -- 0x556243ec9bb0 con 0x7f5c08022910 2023-12-22T10:01:46.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.644+0000 7f5c17fff700 1 -- 172.21.15.45:0/2649537063 <== osd.1 v2:172.21.15.45:6808/33775 7 ==== osd_op_reply(60 [pgnls start_epoch 41 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c08012040 con 0x7f5c08022910 2023-12-22T10:01:46.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.644+0000 7f5c17fff700 1 -- 172.21.15.45:0/2649537063 --> [v2:172.21.15.45:6808/33775,v1:172.21.15.45:6809/33775] -- osd_op(unknown.0.0:61 5.f 5:f0000000:%01:::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e41) v8 -- 0x556243ec9bb0 con 0x7f5c08022910 2023-12-22T10:01:46.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.648+0000 7f5c17fff700 1 -- 172.21.15.45:0/2649537063 <== osd.1 v2:172.21.15.45:6808/33775 8 ==== osd_op_reply(61 [pgnls start_epoch 41 out=73b] v35'1 uv1 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x7f5c08012040 con 0x7f5c08022910 2023-12-22T10:01:46.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.648+0000 7f5c17fff700 1 -- 172.21.15.45:0/2649537063 --> [v2:172.21.15.45:6816/33782,v1:172.21.15.45:6817/33782] -- osd_op(unknown.0.0:62 5.2f 5:f4000000:%01:::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e41) v8 -- 0x556243ec9bb0 con 0x7f5c18012070 2023-12-22T10:01:46.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.648+0000 7f5c1cd3d700 1 -- 172.21.15.45:0/2649537063 <== osd.3 v2:172.21.15.45:6816/33782 10 ==== osd_op_reply(62 [pgnls start_epoch 41 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c1003a040 con 0x7f5c18012070 2023-12-22T10:01:46.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.648+0000 7f5c1cd3d700 1 -- 172.21.15.45:0/2649537063 --> [v2:172.21.15.45:6800/33776,v1:172.21.15.45:6801/33776] -- osd_op(unknown.0.0:63 5.1f 5:f8000000:%01:::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e41) v8 -- 0x556243ec9bb0 con 0x7f5c10028060 2023-12-22T10:01:46.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.648+0000 7f5c17fff700 1 -- 172.21.15.45:0/2649537063 <== osd.2 v2:172.21.15.45:6800/33776 10 ==== osd_op_reply(63 [pgnls start_epoch 41 out=49b] v35'1 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5c08012040 con 0x7f5c10028060 2023-12-22T10:01:46.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.648+0000 7f5c17fff700 1 -- 172.21.15.45:0/2649537063 --> [v2:172.21.15.45:6800/33776,v1:172.21.15.45:6801/33776] -- osd_op(unknown.0.0:64 5.3f 5:fc000000:%01:::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected e41) v8 -- 0x556243ec9bb0 con 0x7f5c10028060 2023-12-22T10:01:46.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.648+0000 7f5c17fff700 1 -- 172.21.15.45:0/2649537063 <== osd.2 v2:172.21.15.45:6800/33776 11 ==== osd_op_reply(64 [pgnls start_epoch 41 out=101b] v36'5 uv5 ondisk = 1) v8 ==== 144+0+101 (crc 0 0 0) 0x7f5c08012040 con 0x7f5c10028060 2023-12-22T10:01:46.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.648+0000 7f5c1f4d8d00 1 -- 172.21.15.45:0/2649537063 --> [v2:172.21.15.45:6800/33776,v1:172.21.15.45:6801/33776] -- osd_op(unknown.0.0:65 5.10 5:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try e41) v8 -- 0x556243e31da0 con 0x7f5c10028060 2023-12-22T10:01:46.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.648+0000 7f5c1f4d8d00 1 -- 172.21.15.45:0/2649537063 --> [v2:172.21.15.45:6800/33776,v1:172.21.15.45:6801/33776] -- osd_op(unknown.0.0:66 5.10 5:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try e41) v8 -- 0x556243ee40c0 con 0x7f5c10028060 2023-12-22T10:01:46.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.648+0000 7f5c1f4d8d00 1 -- 172.21.15.45:0/2649537063 --> [v2:172.21.15.45:6818/33777,v1:172.21.15.45:6819/33777] -- osd_op(unknown.0.0:67 5.30 5:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try e41) v8 -- 0x556243ee4960 con 0x7f5c08015380 2023-12-22T10:01:46.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.648+0000 7f5c1f4d8d00 1 -- 172.21.15.45:0/2649537063 --> [v2:172.21.15.45:6818/33777,v1:172.21.15.45:6819/33777] -- osd_op(unknown.0.0:68 5.30 5:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try e41) v8 -- 0x556243ee5200 con 0x7f5c08015380 2023-12-22T10:01:46.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.648+0000 7f5c1f4d8d00 1 -- 172.21.15.45:0/2649537063 --> [v2:172.21.15.45:6818/33777,v1:172.21.15.45:6819/33777] -- osd_op(unknown.0.0:69 5.30 5:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try e41) v8 -- 0x556243ee5aa0 con 0x7f5c08015380 2023-12-22T10:01:46.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.648+0000 7f5c1f4d8d00 1 -- 172.21.15.45:0/2649537063 --> [v2:172.21.15.113:6809/34099,v1:172.21.15.113:6811/34099] -- osd_op(unknown.0.0:70 5.14 5:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try e41) v8 -- 0x556243ee6340 con 0x556243e2e530 2023-12-22T10:01:46.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.648+0000 7f5c1f4d8d00 1 -- 172.21.15.45:0/2649537063 --> [v2:172.21.15.113:6809/34099,v1:172.21.15.113:6811/34099] -- osd_op(unknown.0.0:71 5.14 5:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try e41) v8 -- 0x556243ee6be0 con 0x556243e2e530 2023-12-22T10:01:46.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.648+0000 7f5c1f4d8d00 1 -- 172.21.15.45:0/2649537063 --> [v2:172.21.15.45:6808/33775,v1:172.21.15.45:6809/33775] -- osd_op(unknown.0.0:72 5.34 5:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try e41) v8 -- 0x556243ee7480 con 0x7f5c08022910 2023-12-22T10:01:46.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.648+0000 7f5c1f4d8d00 1 -- 172.21.15.45:0/2649537063 --> [v2:172.21.15.45:6808/33775,v1:172.21.15.45:6809/33775] -- osd_op(unknown.0.0:73 5.34 5:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try e41) v8 -- 0x556243ee7d20 con 0x7f5c08022910 2023-12-22T10:01:46.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.648+0000 7f5c1f4d8d00 1 -- 172.21.15.45:0/2649537063 --> [v2:172.21.15.113:6809/34099,v1:172.21.15.113:6811/34099] -- osd_op(unknown.0.0:74 5.3c 5:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try e41) v8 -- 0x556243ee8840 con 0x556243e2e530 2023-12-22T10:01:46.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.648+0000 7f5c1f4d8d00 1 -- 172.21.15.45:0/2649537063 --> [v2:172.21.15.113:6809/34099,v1:172.21.15.113:6811/34099] -- osd_op(unknown.0.0:75 5.26 5:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try e41) v8 -- 0x556243ee9390 con 0x556243e2e530 2023-12-22T10:01:46.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.648+0000 7f5c1f4d8d00 1 -- 172.21.15.45:0/2649537063 --> [v2:172.21.15.45:6816/33782,v1:172.21.15.45:6817/33782] -- osd_op(unknown.0.0:76 5.e 5:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try e41) v8 -- 0x556243ee9f10 con 0x7f5c18012070 2023-12-22T10:01:46.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.648+0000 7f5c1f4d8d00 1 -- 172.21.15.45:0/2649537063 --> [v2:172.21.15.45:6816/33782,v1:172.21.15.45:6817/33782] -- osd_op(unknown.0.0:77 5.15 5:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try e41) v8 -- 0x556243eea800 con 0x7f5c18012070 2023-12-22T10:01:46.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.648+0000 7f5c1f4d8d00 1 -- 172.21.15.45:0/2649537063 --> [v2:172.21.15.45:6816/33782,v1:172.21.15.45:6817/33782] -- osd_op(unknown.0.0:78 5.15 5:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try e41) v8 -- 0x556243eeb200 con 0x7f5c18012070 2023-12-22T10:01:46.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.648+0000 7f5c1f4d8d00 1 -- 172.21.15.45:0/2649537063 --> [v2:172.21.15.113:6821/34102,v1:172.21.15.113:6825/34102] -- osd_op(unknown.0.0:79 5.2d 5:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try e41) v8 -- 0x556243eebd40 con 0x7f5c08031350 2023-12-22T10:01:46.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.648+0000 7f5c1f4d8d00 1 -- 172.21.15.45:0/2649537063 --> [v2:172.21.15.113:6809/34099,v1:172.21.15.113:6811/34099] -- osd_op(unknown.0.0:80 5.1d 5:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try e41) v8 -- 0x556243eec880 con 0x556243e2e530 2023-12-22T10:01:46.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.656+0000 7f5c17fff700 1 -- 172.21.15.45:0/2649537063 <== osd.1 v2:172.21.15.45:6808/33775 9 ==== osd_op_reply(72 200.00000001 [delete] v41'14 uv14 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5c08012040 con 0x7f5c08022910 2023-12-22T10:01:46.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.656+0000 7f5c1f4d8d00 1 -- 172.21.15.45:0/2649537063 --> [v2:172.21.15.113:6809/34099,v1:172.21.15.113:6811/34099] -- osd_op(unknown.0.0:81 5.13 5:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try e41) v8 -- 0x556243eeccb0 con 0x556243e2e530 2023-12-22T10:01:46.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.656+0000 7f5c1d53e700 1 -- 172.21.15.45:0/2649537063 <== osd.4 v2:172.21.15.113:6809/34099 13 ==== osd_op_reply(70 1.00000000.inode [delete] v41'6 uv6 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f5c18042040 con 0x556243e2e530 2023-12-22T10:01:46.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.656+0000 7f5c1f4d8d00 1 -- 172.21.15.45:0/2649537063 --> [v2:172.21.15.113:6808/34101,v1:172.21.15.113:6810/34101] -- osd_op(unknown.0.0:82 5.33 5:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try e41) v8 -- 0x556243eeccb0 con 0x7f5c180263f0 2023-12-22T10:01:46.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.656+0000 7f5c17fff700 1 -- 172.21.15.45:0/2649537063 <== osd.2 v2:172.21.15.45:6800/33776 12 ==== osd_op_reply(65 601.00000000 [delete] v41'5 uv5 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5c08012040 con 0x7f5c10028060 2023-12-22T10:01:46.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.656+0000 7f5c1d53e700 1 -- 172.21.15.45:0/2649537063 <== osd.4 v2:172.21.15.113:6809/34099 14 ==== osd_op_reply(75 mds0_openfiles.0 [delete] v41'3 uv3 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f5c18042040 con 0x556243e2e530 2023-12-22T10:01:46.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.656+0000 7f5c1f4d8d00 1 -- 172.21.15.45:0/2649537063 --> [v2:172.21.15.113:6800/34100,v1:172.21.15.113:6801/34100] -- osd_op(unknown.0.0:83 5.b 5:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try e41) v8 -- 0x556243eed060 con 0x7f5c08033940 2023-12-22T10:01:46.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.656+0000 7f5c17fff700 1 -- 172.21.15.45:0/2649537063 <== osd.2 v2:172.21.15.45:6800/33776 13 ==== osd_op_reply(66 602.00000000 [delete] v41'6 uv6 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5c08012040 con 0x7f5c10028060 2023-12-22T10:01:46.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.656+0000 7f5c1d53e700 1 -- 172.21.15.45:0/2649537063 <== osd.4 v2:172.21.15.113:6809/34099 15 ==== osd_op_reply(80 605.00000000 [delete] v41'3 uv3 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5c18042040 con 0x556243e2e530 2023-12-22T10:01:46.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.656+0000 7f5c1f4d8d00 1 -- 172.21.15.45:0/2649537063 --> [v2:172.21.15.45:6816/33782,v1:172.21.15.45:6817/33782] -- osd_op(unknown.0.0:84 5.7 5:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try e41) v8 -- 0x556243e32180 con 0x7f5c18012070 2023-12-22T10:01:46.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.656+0000 7f5c1f4d8d00 1 -- 172.21.15.45:0/2649537063 --> [v2:172.21.15.45:6808/33775,v1:172.21.15.45:6809/33775] -- osd_op(unknown.0.0:85 5.f 5:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try e41) v8 -- 0x556243eed410 con 0x7f5c08022910 2023-12-22T10:01:46.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.656+0000 7f5c1d53e700 1 -- 172.21.15.45:0/2649537063 <== osd.0 v2:172.21.15.45:6818/33777 8 ==== osd_op_reply(67 10000000000.00000000 [delete] v41'7 uv7 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f5c18042040 con 0x7f5c08015380 2023-12-22T10:01:46.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.656+0000 7f5c1f4d8d00 1 -- 172.21.15.45:0/2649537063 --> [v2:172.21.15.45:6800/33776,v1:172.21.15.45:6801/33776] -- osd_op(unknown.0.0:86 5.3f 5:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try e41) v8 -- 0x556243eedcb0 con 0x7f5c10028060 2023-12-22T10:01:46.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.656+0000 7f5c1f4d8d00 1 -- 172.21.15.45:0/2649537063 --> [v2:172.21.15.45:6800/33776,v1:172.21.15.45:6801/33776] -- osd_op(unknown.0.0:87 5.3f 5:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try e41) v8 -- 0x556243eee060 con 0x7f5c10028060 2023-12-22T10:01:46.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.656+0000 7f5c1cd3d700 1 -- 172.21.15.45:0/2649537063 <== osd.7 v2:172.21.15.113:6821/34102 7 ==== osd_op_reply(79 mds_snaptable [delete] v41'2 uv2 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5c1003a040 con 0x7f5c08031350 2023-12-22T10:01:46.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.656+0000 7f5c1d53e700 1 -- 172.21.15.45:0/2649537063 <== osd.4 v2:172.21.15.113:6809/34099 16 ==== osd_op_reply(74 607.00000000 [delete] v41'3 uv3 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5c18042040 con 0x556243e2e530 2023-12-22T10:01:46.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.656+0000 7f5c1d53e700 1 -- 172.21.15.45:0/2649537063 <== osd.4 v2:172.21.15.113:6809/34099 17 ==== osd_op_reply(71 200.00000000 [delete] v41'7 uv7 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5c18042040 con 0x556243e2e530 2023-12-22T10:01:46.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.660+0000 7f5c1cd3d700 1 -- 172.21.15.45:0/2649537063 <== osd.3 v2:172.21.15.45:6816/33782 11 ==== osd_op_reply(77 604.00000000 [delete] v41'4 uv4 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5c1003a040 con 0x7f5c18012070 2023-12-22T10:01:46.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.660+0000 7f5c1cd3d700 1 -- 172.21.15.45:0/2649537063 <== osd.3 v2:172.21.15.45:6816/33782 12 ==== osd_op_reply(78 500.00000000 [delete] v41'5 uv5 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5c1003a040 con 0x7f5c18012070 2023-12-22T10:01:46.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.660+0000 7f5c1d53e700 1 -- 172.21.15.45:0/2649537063 <== osd.0 v2:172.21.15.45:6818/33777 9 ==== osd_op_reply(68 600.00000000 [delete] v41'8 uv8 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5c18042040 con 0x7f5c08015380 2023-12-22T10:01:46.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.660+0000 7f5c1d53e700 1 -- 172.21.15.45:0/2649537063 <== osd.0 v2:172.21.15.45:6818/33777 10 ==== osd_op_reply(69 603.00000000 [delete] v41'9 uv9 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5c18042040 con 0x7f5c08015380 2023-12-22T10:01:46.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.660+0000 7f5c1cd3d700 1 -- 172.21.15.45:0/2649537063 <== osd.3 v2:172.21.15.45:6816/33782 13 ==== osd_op_reply(76 608.00000000 [delete] v41'3 uv3 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5c1003a040 con 0x7f5c18012070 2023-12-22T10:01:46.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.660+0000 7f5c17fff700 1 -- 172.21.15.45:0/2649537063 <== osd.1 v2:172.21.15.45:6808/33775 10 ==== osd_op_reply(73 606.00000000 [delete] v41'15 uv15 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5c08012040 con 0x7f5c08022910 2023-12-22T10:01:46.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.660+0000 7f5c1d53e700 1 -- 172.21.15.45:0/2649537063 <== osd.4 v2:172.21.15.113:6809/34099 18 ==== osd_op_reply(81 mds0_inotable [delete] v41'3 uv3 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5c18042040 con 0x556243e2e530 2023-12-22T10:01:46.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.660+0000 7f5c1cd3d700 1 -- 172.21.15.45:0/2649537063 <== osd.3 v2:172.21.15.45:6816/33782 14 ==== osd_op_reply(84 609.00000000 [delete] v41'3 uv3 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5c1003a040 con 0x7f5c18012070 2023-12-22T10:01:46.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.660+0000 7f5c17fff700 1 -- 172.21.15.45:0/2649537063 <== osd.1 v2:172.21.15.45:6808/33775 11 ==== osd_op_reply(85 400.00000000 [delete] v41'2 uv2 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5c08012040 con 0x7f5c08022910 2023-12-22T10:01:46.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.660+0000 7f5c17fff700 1 -- 172.21.15.45:0/2649537063 <== osd.2 v2:172.21.15.45:6800/33776 14 ==== osd_op_reply(86 100.00000000.inode [delete] v41'6 uv6 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f5c08012040 con 0x7f5c10028060 2023-12-22T10:01:46.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.660+0000 7f5c17fff700 1 -- 172.21.15.45:0/2649537063 <== osd.2 v2:172.21.15.45:6800/33776 15 ==== osd_op_reply(87 1.00000000 [delete] v41'7 uv7 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f5c08012040 con 0x7f5c10028060 2023-12-22T10:01:46.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.660+0000 7f5c1d53e700 1 -- 172.21.15.45:0/2649537063 <== osd.5 v2:172.21.15.113:6800/34100 7 ==== osd_op_reply(83 mds0_sessionmap [delete] v41'3 uv3 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7f5c18042040 con 0x7f5c08033940 2023-12-22T10:01:46.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.660+0000 7f5c1cd3d700 1 -- 172.21.15.45:0/2649537063 <== osd.6 v2:172.21.15.113:6808/34101 9 ==== osd_op_reply(82 100.00000000 [delete] v41'2 uv2 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f5c1003a040 con 0x7f5c180263f0 2023-12-22T10:01:46.664 INFO:teuthology.orchestra.run.smithi045.stdout:Removed 23 objects 2023-12-22T10:01:46.664 INFO:teuthology.orchestra.run.smithi045.stdout:successfully purged pool cephfs_metadata 2023-12-22T10:01:46.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.660+0000 7f5c1f4d8d00 1 -- 172.21.15.45:0/2649537063 >> [v2:172.21.15.45:6818/33777,v1:172.21.15.45:6819/33777] conn(0x7f5c08015380 msgr2=0x7f5c080157a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:46.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.660+0000 7f5c1f4d8d00 1 --2- 172.21.15.45:0/2649537063 >> [v2:172.21.15.45:6818/33777,v1:172.21.15.45:6819/33777] conn(0x7f5c08015380 0x7f5c080157a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:46.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.660+0000 7f5c1f4d8d00 1 -- 172.21.15.45:0/2649537063 >> [v2:172.21.15.45:6808/33775,v1:172.21.15.45:6809/33775] conn(0x7f5c08022910 msgr2=0x7f5c0801f350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:46.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.660+0000 7f5c1f4d8d00 1 --2- 172.21.15.45:0/2649537063 >> [v2:172.21.15.45:6808/33775,v1:172.21.15.45:6809/33775] conn(0x7f5c08022910 0x7f5c0801f350 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:46.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.660+0000 7f5c1f4d8d00 1 -- 172.21.15.45:0/2649537063 >> [v2:172.21.15.45:6800/33776,v1:172.21.15.45:6801/33776] conn(0x7f5c10028060 msgr2=0x7f5c100740b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:46.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.660+0000 7f5c1f4d8d00 1 --2- 172.21.15.45:0/2649537063 >> [v2:172.21.15.45:6800/33776,v1:172.21.15.45:6801/33776] conn(0x7f5c10028060 0x7f5c100740b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:46.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.660+0000 7f5c1f4d8d00 1 -- 172.21.15.45:0/2649537063 >> [v2:172.21.15.45:6816/33782,v1:172.21.15.45:6817/33782] conn(0x7f5c18012070 msgr2=0x7f5c180113b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:46.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.660+0000 7f5c1f4d8d00 1 --2- 172.21.15.45:0/2649537063 >> [v2:172.21.15.45:6816/33782,v1:172.21.15.45:6817/33782] conn(0x7f5c18012070 0x7f5c180113b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:46.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.660+0000 7f5c1d53e700 1 -- 172.21.15.45:0/2649537063 reap_dead start 2023-12-22T10:01:46.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.660+0000 7f5c1f4d8d00 1 -- 172.21.15.45:0/2649537063 >> [v2:172.21.15.113:6809/34099,v1:172.21.15.113:6811/34099] conn(0x556243e2e530 msgr2=0x556243ec96c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:46.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.660+0000 7f5c1f4d8d00 1 --2- 172.21.15.45:0/2649537063 >> [v2:172.21.15.113:6809/34099,v1:172.21.15.113:6811/34099] conn(0x556243e2e530 0x556243ec96c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:46.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.660+0000 7f5c1f4d8d00 1 -- 172.21.15.45:0/2649537063 >> [v2:172.21.15.113:6800/34100,v1:172.21.15.113:6801/34100] conn(0x7f5c08033940 msgr2=0x7f5c080323c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:46.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.660+0000 7f5c1f4d8d00 1 --2- 172.21.15.45:0/2649537063 >> [v2:172.21.15.113:6800/34100,v1:172.21.15.113:6801/34100] conn(0x7f5c08033940 0x7f5c080323c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:46.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.660+0000 7f5c1f4d8d00 1 -- 172.21.15.45:0/2649537063 >> [v2:172.21.15.113:6808/34101,v1:172.21.15.113:6810/34101] conn(0x7f5c180263f0 msgr2=0x7f5c180267f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:46.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.660+0000 7f5c1f4d8d00 1 --2- 172.21.15.45:0/2649537063 >> [v2:172.21.15.113:6808/34101,v1:172.21.15.113:6810/34101] conn(0x7f5c180263f0 0x7f5c180267f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:46.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.660+0000 7f5c1f4d8d00 1 -- 172.21.15.45:0/2649537063 >> [v2:172.21.15.113:6821/34102,v1:172.21.15.113:6825/34102] conn(0x7f5c08031350 msgr2=0x7f5c08031790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:46.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.660+0000 7f5c1f4d8d00 1 --2- 172.21.15.45:0/2649537063 >> [v2:172.21.15.113:6821/34102,v1:172.21.15.113:6825/34102] conn(0x7f5c08031350 0x7f5c08031790 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:46.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.664+0000 7f5c1f4d8d00 1 -- 172.21.15.45:0/2649537063 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f5c00059020 msgr2=0x7f5c0005b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:46.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.664+0000 7f5c1f4d8d00 1 --2- 172.21.15.45:0/2649537063 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f5c00059020 0x7f5c0005b4e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x556243e1ebc0 tx=0x7f5c0800c040).stop 2023-12-22T10:01:46.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.664+0000 7f5c1f4d8d00 1 -- 172.21.15.45:0/2649537063 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556243e1c8f0 msgr2=0x556243e30050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:46.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.664+0000 7f5c1f4d8d00 1 --2- 172.21.15.45:0/2649537063 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556243e1c8f0 0x556243e30050 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7f5c1000a5a0 tx=0x7f5c10016000).stop 2023-12-22T10:01:46.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.664+0000 7f5c1d53e700 1 -- 172.21.15.45:0/2649537063 reap_dead start 2023-12-22T10:01:46.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.664+0000 7f5c1d53e700 1 -- 172.21.15.45:0/2649537063 reap_dead start 2023-12-22T10:01:46.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.664+0000 7f5c1f4d8d00 1 -- 172.21.15.45:0/2649537063 shutdown_connections 2023-12-22T10:01:46.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.664+0000 7f5c1f4d8d00 1 -- 172.21.15.45:0/2649537063 >> 172.21.15.45:0/2649537063 conn(0x556243e38f30 msgr2=0x556243e1b120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:46.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.664+0000 7f5c1f4d8d00 1 -- 172.21.15.45:0/2649537063 shutdown_connections 2023-12-22T10:01:46.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.664+0000 7f5c1f4d8d00 1 -- 172.21.15.45:0/2649537063 wait complete. 2023-12-22T10:01:46.669 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T10:01:46.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.840+0000 7fe730b07700 1 Processor -- start 2023-12-22T10:01:46.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.840+0000 7fe730b07700 1 -- start start 2023-12-22T10:01:46.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.840+0000 7fe730b07700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fe72c0a9c60 0x7fe72c1575a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:46.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.840+0000 7fe730b07700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fe72c0c5fa0 0x7fe72c0c0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:46.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.840+0000 7fe730b07700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe72c158520 con 0x7fe72c157a90 2023-12-22T10:01:46.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.840+0000 7fe730b07700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe72c0bfdb0 con 0x7fe72c0c5fa0 2023-12-22T10:01:46.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.840+0000 7fe730b07700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe72c157f60 con 0x7fe72c0a9c60 2023-12-22T10:01:46.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.840+0000 7fe723fff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fe72c157a90 0x7fe72c0c5890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:58870/0 (socket says 172.21.15.45:58870) 2023-12-22T10:01:46.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.840+0000 7fe723fff700 1 -- 172.21.15.45:0/1860370219 learned_addr learned my addr 172.21.15.45:0/1860370219 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:01:46.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.840+0000 7fe72b7fe700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fe72c0a9c60 0x7fe72c1575a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:46.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.844+0000 7fe72bfff700 1 --2- 172.21.15.45:0/1860370219 >> v2:172.21.15.113:3300/0 conn(0x7fe72c0c5fa0 0x7fe72c0c0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:46.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.844+0000 7fe72affd700 1 -- 172.21.15.45:0/1860370219 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2277348910 0 0) 0x7fe72c158520 con 0x7fe72c157a90 2023-12-22T10:01:46.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.844+0000 7fe72affd700 1 -- 172.21.15.45:0/1860370219 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7180033f0 con 0x7fe72c157a90 2023-12-22T10:01:46.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.844+0000 7fe72b7fe700 1 -- 172.21.15.45:0/1860370219 >> v2:172.21.15.113:3300/0 conn(0x7fe72c0c5fa0 msgr2=0x7fe72c0c0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:46.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.844+0000 7fe72b7fe700 1 --2- 172.21.15.45:0/1860370219 >> v2:172.21.15.113:3300/0 conn(0x7fe72c0c5fa0 0x7fe72c0c0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:46.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.844+0000 7fe72b7fe700 1 -- 172.21.15.45:0/1860370219 >> v1:172.21.15.45:6789/0 conn(0x7fe72c157a90 legacy=0x7fe72c0c5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:46.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.844+0000 7fe72affd700 1 -- 172.21.15.45:0/1860370219 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1602661662 0 0) 0x7fe7180033f0 con 0x7fe72c157a90 2023-12-22T10:01:46.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.844+0000 7fe72b7fe700 1 -- 172.21.15.45:0/1860370219 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe72c158240 con 0x7fe72c0a9c60 2023-12-22T10:01:46.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.844+0000 7fe72bfff700 1 --2- 172.21.15.45:0/1860370219 >> v2:172.21.15.113:3300/0 conn(0x7fe72c0c5fa0 0x7fe72c0c0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-12-22T10:01:46.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.844+0000 7fe72b7fe700 1 --2- 172.21.15.45:0/1860370219 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fe72c0a9c60 0x7fe72c1575a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7fe71c009760 tx=0x7fe71c009060).ready entity=mon.2 client_cookie=f93c9b240eec1632 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:46.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.844+0000 7fe72affd700 1 -- 172.21.15.45:0/1860370219 <== mon.2 v2:172.21.15.113:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe714001470 con 0x7fe72c0a9c60 2023-12-22T10:01:46.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.844+0000 7fe72affd700 1 -- 172.21.15.45:0/1860370219 <== mon.2 v2:172.21.15.113:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe71c011400 con 0x7fe72c0a9c60 2023-12-22T10:01:46.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.844+0000 7fe72affd700 1 -- 172.21.15.45:0/1860370219 <== mon.2 v2:172.21.15.113:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe71c011780 con 0x7fe72c0a9c60 2023-12-22T10:01:46.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.844+0000 7fe730b07700 1 -- 172.21.15.45:0/1860370219 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fe72c0a9c60 msgr2=0x7fe72c1575a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:46.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.844+0000 7fe730b07700 1 --2- 172.21.15.45:0/1860370219 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fe72c0a9c60 0x7fe72c1575a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7fe71c009760 tx=0x7fe71c009060).stop 2023-12-22T10:01:46.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.844+0000 7fe730b07700 1 -- 172.21.15.45:0/1860370219 shutdown_connections 2023-12-22T10:01:46.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.844+0000 7fe730b07700 1 --2- 172.21.15.45:0/1860370219 >> v2:172.21.15.113:3300/0 conn(0x7fe72c0c5fa0 0x7fe72c0c0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:46.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.844+0000 7fe730b07700 1 --2- 172.21.15.45:0/1860370219 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fe72c0a9c60 0x7fe72c1575a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:46.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.844+0000 7fe730b07700 1 -- 172.21.15.45:0/1860370219 >> 172.21.15.45:0/1860370219 conn(0x7fe72c067500 msgr2=0x7fe72c0ca9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:46.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.844+0000 7fe730b07700 1 -- 172.21.15.45:0/1860370219 shutdown_connections 2023-12-22T10:01:46.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.844+0000 7fe730b07700 1 -- 172.21.15.45:0/1860370219 wait complete. 2023-12-22T10:01:46.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.848+0000 7fe730b07700 1 Processor -- start 2023-12-22T10:01:46.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.848+0000 7fe730b07700 1 -- start start 2023-12-22T10:01:46.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.848+0000 7fe730b07700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe72c0a9c60 0x7fe72c0ae610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:46.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.848+0000 7fe730b07700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fe72c0c5fa0 0x7fe72c0af110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:46.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.848+0000 7fe730b07700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe72c157a90 0x7fe72c164430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:46.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.848+0000 7fe730b07700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe72c0c1a50 con 0x7fe72c157a90 2023-12-22T10:01:46.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.848+0000 7fe730b07700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe72c0c1ca0 con 0x7fe72c0a9c60 2023-12-22T10:01:46.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.848+0000 7fe730b07700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe72c0c1f80 con 0x7fe72c0c5fa0 2023-12-22T10:01:46.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.848+0000 7fe72bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe72c157a90 0x7fe72c164430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:46.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.848+0000 7fe72bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe72c157a90 0x7fe72c164430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37230/0 (socket says 172.21.15.45:37230) 2023-12-22T10:01:46.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.848+0000 7fe72bfff700 1 -- 172.21.15.45:0/468857711 learned_addr learned my addr 172.21.15.45:0/468857711 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:46.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.848+0000 7fe723fff700 1 --2- 172.21.15.45:0/468857711 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fe72c0c5fa0 0x7fe72c0af110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:46.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.852+0000 7fe72b7fe700 1 --2- 172.21.15.45:0/468857711 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe72c0a9c60 0x7fe72c0ae610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:46.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.852+0000 7fe72bfff700 1 -- 172.21.15.45:0/468857711 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fe72c0c5fa0 msgr2=0x7fe72c0af110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:46.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.852+0000 7fe72bfff700 1 --2- 172.21.15.45:0/468857711 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fe72c0c5fa0 0x7fe72c0af110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:46.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.852+0000 7fe72bfff700 1 -- 172.21.15.45:0/468857711 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe72c0a9c60 msgr2=0x7fe72c0ae610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:46.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.852+0000 7fe72bfff700 1 --2- 172.21.15.45:0/468857711 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe72c0a9c60 0x7fe72c0ae610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:46.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.852+0000 7fe72bfff700 1 -- 172.21.15.45:0/468857711 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe724009a20 con 0x7fe72c157a90 2023-12-22T10:01:46.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.852+0000 7fe723fff700 1 --2- 172.21.15.45:0/468857711 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fe72c0c5fa0 0x7fe72c0af110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-12-22T10:01:46.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.852+0000 7fe72bfff700 1 --2- 172.21.15.45:0/468857711 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe72c157a90 0x7fe72c164430 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7fe72400ef90 tx=0x7fe72400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:46.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.852+0000 7fe7237fe700 1 -- 172.21.15.45:0/468857711 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe72400cbd0 con 0x7fe72c157a90 2023-12-22T10:01:46.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.852+0000 7fe7237fe700 1 -- 172.21.15.45:0/468857711 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe72400f040 con 0x7fe72c157a90 2023-12-22T10:01:46.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.852+0000 7fe730b07700 1 -- 172.21.15.45:0/468857711 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe71c0092a0 con 0x7fe72c157a90 2023-12-22T10:01:46.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.852+0000 7fe7237fe700 1 -- 172.21.15.45:0/468857711 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe724013400 con 0x7fe72c157a90 2023-12-22T10:01:46.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.852+0000 7fe730b07700 1 -- 172.21.15.45:0/468857711 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe72c0af600 con 0x7fe72c157a90 2023-12-22T10:01:46.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.852+0000 7fe730b07700 1 -- 172.21.15.45:0/468857711 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe72c0c2370 con 0x7fe72c157a90 2023-12-22T10:01:46.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.856+0000 7fe7237fe700 1 -- 172.21.15.45:0/468857711 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fe724013830 con 0x7fe72c157a90 2023-12-22T10:01:46.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.856+0000 7fe7237fe700 1 --2- 172.21.15.45:0/468857711 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fe70c05a4e0 0x7fe70c05c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:46.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.856+0000 7fe7237fe700 1 -- 172.21.15.45:0/468857711 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6207+0+0 (secure 0 0 0) 0x7fe724075160 con 0x7fe72c157a90 2023-12-22T10:01:46.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.856+0000 7fe72b7fe700 1 --2- 172.21.15.45:0/468857711 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fe70c05a4e0 0x7fe70c05c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:46.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.856+0000 7fe72b7fe700 1 --2- 172.21.15.45:0/468857711 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fe70c05a4e0 0x7fe70c05c9a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7fe71c009760 tx=0x7fe71c016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:46.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:46.864+0000 7fe7237fe700 1 -- 172.21.15.45:0/468857711 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fe724048830 con 0x7fe72c157a90 2023-12-22T10:01:47.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.032+0000 7fe730b07700 1 -- 172.21.15.45:0/468857711 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe72c0bfa40 con 0x7fe72c157a90 2023-12-22T10:01:47.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.032+0000 7fe7237fe700 1 -- 172.21.15.45:0/468857711 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+17057 (secure 0 0 0) 0x7fe72404be50 con 0x7fe72c157a90 2023-12-22T10:01:47.033 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:01:47.034 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":41,"fsid":"98b0837e-5e68-4c8f-a1a0-e9424baaad8f","created":"2023-12-22T10:00:15.010174+0000","modified":"2023-12-22T10:01:46.592069+0000","last_up_change":"2023-12-22T10:00:24.980513+0000","last_in_change":"2023-12-22T10:00:17.887172+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-12-22T10:00:25.069641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-12-22T10:00:26.906399+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-22T10:01:33.592093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-22T10:01:34.130811+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e19943a0-1c6b-47df-b6bb-383472077890","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":33777},{"type":"v1","addr":"172.21.15.45:6819","nonce":33777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":33777},{"type":"v1","addr":"172.21.15.45:6822","nonce":33777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":33777},{"type":"v1","addr":"172.21.15.45:6830","nonce":33777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":33777},{"type":"v1","addr":"172.21.15.45:6826","nonce":33777}]},"public_addr":"172.21.15.45:6819/33777","cluster_addr":"172.21.15.45:6822/33777","heartbeat_back_addr":"172.21.15.45:6830/33777","heartbeat_front_addr":"172.21.15.45:6826/33777","state":["exists","up"]},{"osd":1,"uuid":"69670f34-f082-45a7-8f67-e962acc136e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":33775},{"type":"v1","addr":"172.21.15.45:6809","nonce":33775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":33775},{"type":"v1","addr":"172.21.15.45:6811","nonce":33775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":33775},{"type":"v1","addr":"172.21.15.45:6815","nonce":33775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":33775},{"type":"v1","addr":"172.21.15.45:6813","nonce":33775}]},"public_addr":"172.21.15.45:6809/33775","cluster_addr":"172.21.15.45:6811/33775","heartbeat_back_addr":"172.21.15.45:6815/33775","heartbeat_front_addr":"172.21.15.45:6813/33775","state":["exists","up"]},{"osd":2,"uuid":"d909d49b-82b8-401b-9947-e49dd167bb95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":33776},{"type":"v1","addr":"172.21.15.45:6801","nonce":33776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":33776},{"type":"v1","addr":"172.21.15.45:6803","nonce":33776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":33776},{"type":"v1","addr":"172.21.15.45:6807","nonce":33776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":33776},{"type":"v1","addr":"172.21.15.45:6805","nonce":33776}]},"public_addr":"172.21.15.45:6801/33776","cluster_addr":"172.21.15.45:6803/33776","heartbeat_back_addr":"172.21.15.45:6807/33776","heartbeat_front_addr":"172.21.15.45:6805/33776","state":["exists","up"]},{"osd":3,"uuid":"db104ca9-3a94-4d39-a2be-bd06db888095","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":33782},{"type":"v1","addr":"172.21.15.45:6817","nonce":33782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":33782},{"type":"v1","addr":"172.21.15.45:6823","nonce":33782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":33782},{"type":"v1","addr":"172.21.15.45:6831","nonce":33782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":33782},{"type":"v1","addr":"172.21.15.45:6827","nonce":33782}]},"public_addr":"172.21.15.45:6817/33782","cluster_addr":"172.21.15.45:6823/33782","heartbeat_back_addr":"172.21.15.45:6831/33782","heartbeat_front_addr":"172.21.15.45:6827/33782","state":["exists","up"]},{"osd":4,"uuid":"9f4eaff4-e433-4479-a0d1-ee7a33375ca6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":34099},{"type":"v1","addr":"172.21.15.113:6811","nonce":34099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":34099},{"type":"v1","addr":"172.21.15.113:6815","nonce":34099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":34099},{"type":"v1","addr":"172.21.15.113:6823","nonce":34099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6816","nonce":34099},{"type":"v1","addr":"172.21.15.113:6818","nonce":34099}]},"public_addr":"172.21.15.113:6811/34099","cluster_addr":"172.21.15.113:6815/34099","heartbeat_back_addr":"172.21.15.113:6823/34099","heartbeat_front_addr":"172.21.15.113:6818/34099","state":["exists","up"]},{"osd":5,"uuid":"1efc5591-180b-43af-8611-0068aadc5aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":34100},{"type":"v1","addr":"172.21.15.113:6801","nonce":34100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":34100},{"type":"v1","addr":"172.21.15.113:6803","nonce":34100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":34100},{"type":"v1","addr":"172.21.15.113:6807","nonce":34100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":34100},{"type":"v1","addr":"172.21.15.113:6805","nonce":34100}]},"public_addr":"172.21.15.113:6801/34100","cluster_addr":"172.21.15.113:6803/34100","heartbeat_back_addr":"172.21.15.113:6807/34100","heartbeat_front_addr":"172.21.15.113:6805/34100","state":["exists","up"]},{"osd":6,"uuid":"6c89d9d8-c153-4a48-afa9-97e4c403f1ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":34101},{"type":"v1","addr":"172.21.15.113:6810","nonce":34101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6812","nonce":34101},{"type":"v1","addr":"172.21.15.113:6814","nonce":34101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6822","nonce":34101},{"type":"v1","addr":"172.21.15.113:6824","nonce":34101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":34101},{"type":"v1","addr":"172.21.15.113:6819","nonce":34101}]},"public_addr":"172.21.15.113:6810/34101","cluster_addr":"172.21.15.113:6814/34101","heartbeat_back_addr":"172.21.15.113:6824/34101","heartbeat_front_addr":"172.21.15.113:6819/34101","state":["exists","up"]},{"osd":7,"uuid":"1855e70c-23f6-4c08-ad7f-774c2148235b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6821","nonce":34102},{"type":"v1","addr":"172.21.15.113:6825","nonce":34102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":34102},{"type":"v1","addr":"172.21.15.113:6827","nonce":34102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":34102},{"type":"v1","addr":"172.21.15.113:6831","nonce":34102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6828","nonce":34102},{"type":"v1","addr":"172.21.15.113:6829","nonce":34102}]},"public_addr":"172.21.15.113:6825/34102","cluster_addr":"172.21.15.113:6827/34102","heartbeat_back_addr":"172.21.15.113:6831/34102","heartbeat_front_addr":"172.21.15.113:6829/34102","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.812672+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.825045+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.700105+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.856563+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.954683+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.883234+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.883994+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.821686+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.45:6835/1879154206":"2023-12-23T10:01:45.243059+0000","172.21.15.45:6834/1879154206":"2023-12-23T10:01:45.243059+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T10:01:47.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.036+0000 7fe730b07700 1 -- 172.21.15.45:0/468857711 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fe70c05a4e0 msgr2=0x7fe70c05c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:47.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.036+0000 7fe730b07700 1 --2- 172.21.15.45:0/468857711 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fe70c05a4e0 0x7fe70c05c9a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7fe71c009760 tx=0x7fe71c016000).stop 2023-12-22T10:01:47.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.036+0000 7fe730b07700 1 -- 172.21.15.45:0/468857711 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe72c157a90 msgr2=0x7fe72c164430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:47.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.036+0000 7fe730b07700 1 --2- 172.21.15.45:0/468857711 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe72c157a90 0x7fe72c164430 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7fe72400ef90 tx=0x7fe72400b040).stop 2023-12-22T10:01:47.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.036+0000 7fe730b07700 1 -- 172.21.15.45:0/468857711 shutdown_connections 2023-12-22T10:01:47.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.036+0000 7fe730b07700 1 --2- 172.21.15.45:0/468857711 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe72c157a90 0x7fe72c164430 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:47.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.036+0000 7fe730b07700 1 --2- 172.21.15.45:0/468857711 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fe70c05a4e0 0x7fe70c05c9a0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:47.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.036+0000 7fe730b07700 1 --2- 172.21.15.45:0/468857711 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fe72c0c5fa0 0x7fe72c0af110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:47.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.036+0000 7fe730b07700 1 --2- 172.21.15.45:0/468857711 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe72c0a9c60 0x7fe72c0ae610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:47.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.036+0000 7fe730b07700 1 -- 172.21.15.45:0/468857711 >> 172.21.15.45:0/468857711 conn(0x7fe72c067500 msgr2=0x7fe72c151d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:47.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.036+0000 7fe730b07700 1 -- 172.21.15.45:0/468857711 shutdown_connections 2023-12-22T10:01:47.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.036+0000 7fe730b07700 1 -- 172.21.15.45:0/468857711 wait complete. 2023-12-22T10:01:47.058 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-12-22T10:00:25.069641+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-12-22T10:00:26.906399+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-22T10:01:33.592093+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-12-22T10:01:34.130811+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-22T10:01:47.059 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-12-22T10:01:47.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.232+0000 7ffaf1e9b700 1 Processor -- start 2023-12-22T10:01:47.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.232+0000 7ffaf1e9b700 1 -- start start 2023-12-22T10:01:47.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.236+0000 7ffaf1e9b700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ffaec0c1d80 0x7ffaec158120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:47.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.236+0000 7ffaf1e9b700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7ffaec065930 0x7ffaec0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:47.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.236+0000 7ffaf1e9b700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffaec069180 con 0x7ffaec157d40 2023-12-22T10:01:47.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.236+0000 7ffaf1e9b700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaec069e00 con 0x7ffaec065930 2023-12-22T10:01:47.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.236+0000 7ffaf1e9b700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaec069460 con 0x7ffaec0c1d80 2023-12-22T10:01:47.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.236+0000 7ffae3fff700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ffaec0c1d80 0x7ffaec158120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:47.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.236+0000 7ffae3fff700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ffaec0c1d80 0x7ffaec158120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.113:3301/0 says I am v2:172.21.15.45:45664/0 (socket says 172.21.15.45:45664) 2023-12-22T10:01:47.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.236+0000 7ffae3fff700 1 -- 172.21.15.45:0/4017143272 learned_addr learned my addr 172.21.15.45:0/4017143272 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:47.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.236+0000 7ffaeb7fe700 1 --1- 172.21.15.45:0/4017143272 >> v1:172.21.15.113:6789/0 conn(0x7ffaec157d40 0x7ffaec0c1670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.45:49766/0 (socket says 172.21.15.45:49766) 2023-12-22T10:01:47.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.236+0000 7ffaebfff700 1 --2- 172.21.15.45:0/4017143272 >> v2:172.21.15.113:3300/0 conn(0x7ffaec065930 0x7ffaec0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:47.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.236+0000 7ffae3fff700 1 -- 172.21.15.45:0/4017143272 >> v2:172.21.15.113:3300/0 conn(0x7ffaec065930 msgr2=0x7ffaec0a5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:47.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.236+0000 7ffae3fff700 1 --2- 172.21.15.45:0/4017143272 >> v2:172.21.15.113:3300/0 conn(0x7ffaec065930 0x7ffaec0a5810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:47.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.236+0000 7ffae3fff700 1 -- 172.21.15.45:0/4017143272 >> v1:172.21.15.113:6789/0 conn(0x7ffaec157d40 legacy=0x7ffaec0c1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:47.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.236+0000 7ffae3fff700 1 -- 172.21.15.45:0/4017143272 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaec069740 con 0x7ffaec0c1d80 2023-12-22T10:01:47.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.236+0000 7ffaeaffd700 1 -- 172.21.15.45:0/4017143272 <== mon.1 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 598401237 0 0) 0x7ffaec069180 con 0x7ffaec157d40 2023-12-22T10:01:47.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.236+0000 7ffae3fff700 1 --2- 172.21.15.45:0/4017143272 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ffaec0c1d80 0x7ffaec158120 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7ffad4006fd0 tx=0x7ffad40090f0).ready entity=mon.2 client_cookie=e496139adf6d76d server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:47.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.236+0000 7ffaeaffd700 1 -- 172.21.15.45:0/4017143272 <== mon.2 v2:172.21.15.113:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffad400b580 con 0x7ffaec0c1d80 2023-12-22T10:01:47.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.236+0000 7ffaeaffd700 1 -- 172.21.15.45:0/4017143272 <== mon.2 v2:172.21.15.113:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffad400b6e0 con 0x7ffaec0c1d80 2023-12-22T10:01:47.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.236+0000 7ffaeaffd700 1 -- 172.21.15.45:0/4017143272 <== mon.2 v2:172.21.15.113:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffad400ba80 con 0x7ffaec0c1d80 2023-12-22T10:01:47.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.240+0000 7ffaf1e9b700 1 -- 172.21.15.45:0/4017143272 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ffaec0c1d80 msgr2=0x7ffaec158120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:47.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.240+0000 7ffaf1e9b700 1 --2- 172.21.15.45:0/4017143272 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ffaec0c1d80 0x7ffaec158120 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7ffad4006fd0 tx=0x7ffad40090f0).stop 2023-12-22T10:01:47.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.240+0000 7ffaf1e9b700 1 -- 172.21.15.45:0/4017143272 shutdown_connections 2023-12-22T10:01:47.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.240+0000 7ffaf1e9b700 1 --2- 172.21.15.45:0/4017143272 >> v2:172.21.15.113:3300/0 conn(0x7ffaec065930 0x7ffaec0a5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:47.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.240+0000 7ffaf1e9b700 1 --2- 172.21.15.45:0/4017143272 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ffaec0c1d80 0x7ffaec158120 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:47.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.240+0000 7ffaf1e9b700 1 -- 172.21.15.45:0/4017143272 >> 172.21.15.45:0/4017143272 conn(0x7ffaec066a70 msgr2=0x7ffaec066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:47.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.240+0000 7ffaf1e9b700 1 -- 172.21.15.45:0/4017143272 shutdown_connections 2023-12-22T10:01:47.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.240+0000 7ffaf1e9b700 1 -- 172.21.15.45:0/4017143272 wait complete. 2023-12-22T10:01:47.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.244+0000 7ffaf1e9b700 1 Processor -- start 2023-12-22T10:01:47.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.244+0000 7ffaf1e9b700 1 -- start start 2023-12-22T10:01:47.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.244+0000 7ffaf1e9b700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ffaec065930 0x7ffaec168b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:47.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.244+0000 7ffaf1e9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffaec0c1d80 0x7ffaec0a4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:47.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.244+0000 7ffaf1e9b700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffaec157d40 0x7ffaec16c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:47.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.244+0000 7ffaf1e9b700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaec0bd6e0 con 0x7ffaec0c1d80 2023-12-22T10:01:47.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.244+0000 7ffaf1e9b700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaec169020 con 0x7ffaec157d40 2023-12-22T10:01:47.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.244+0000 7ffaf1e9b700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaec0c5f70 con 0x7ffaec065930 2023-12-22T10:01:47.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.244+0000 7ffae3fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffaec0c1d80 0x7ffaec0a4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:47.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.244+0000 7ffae3fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffaec0c1d80 0x7ffaec0a4d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37244/0 (socket says 172.21.15.45:37244) 2023-12-22T10:01:47.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.244+0000 7ffae3fff700 1 -- 172.21.15.45:0/2167004639 learned_addr learned my addr 172.21.15.45:0/2167004639 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:47.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.244+0000 7ffaebfff700 1 --2- 172.21.15.45:0/2167004639 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffaec157d40 0x7ffaec16c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:47.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.244+0000 7ffaeb7fe700 1 --2- 172.21.15.45:0/2167004639 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ffaec065930 0x7ffaec168b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:47.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.244+0000 7ffaebfff700 1 -- 172.21.15.45:0/2167004639 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ffaec065930 msgr2=0x7ffaec168b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:47.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.244+0000 7ffaebfff700 1 --2- 172.21.15.45:0/2167004639 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ffaec065930 0x7ffaec168b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:47.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.244+0000 7ffaebfff700 1 -- 172.21.15.45:0/2167004639 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffaec0c1d80 msgr2=0x7ffaec0a4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:47.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.244+0000 7ffaebfff700 1 --2- 172.21.15.45:0/2167004639 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffaec0c1d80 0x7ffaec0a4d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:47.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.244+0000 7ffaebfff700 1 -- 172.21.15.45:0/2167004639 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffad4009370 con 0x7ffaec157d40 2023-12-22T10:01:47.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.244+0000 7ffae3fff700 1 --2- 172.21.15.45:0/2167004639 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffaec0c1d80 0x7ffaec0a4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-12-22T10:01:47.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.244+0000 7ffaebfff700 1 --2- 172.21.15.45:0/2167004639 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffaec157d40 0x7ffaec16c0f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7ffae4009e20 tx=0x7ffae400b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:47.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.248+0000 7ffae37fe700 1 -- 172.21.15.45:0/2167004639 <== mon.1 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae4009bb0 con 0x7ffaec157d40 2023-12-22T10:01:47.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.248+0000 7ffae37fe700 1 -- 172.21.15.45:0/2167004639 <== mon.1 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffae400f040 con 0x7ffaec157d40 2023-12-22T10:01:47.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.248+0000 7ffaf1e9b700 1 -- 172.21.15.45:0/2167004639 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaec0a51f0 con 0x7ffaec157d40 2023-12-22T10:01:47.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.248+0000 7ffae37fe700 1 -- 172.21.15.45:0/2167004639 <== mon.1 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae400ccd0 con 0x7ffaec157d40 2023-12-22T10:01:47.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.248+0000 7ffaf1e9b700 1 -- 172.21.15.45:0/2167004639 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaec0c5920 con 0x7ffaec157d40 2023-12-22T10:01:47.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.248+0000 7ffaf1e9b700 1 -- 172.21.15.45:0/2167004639 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaec067680 con 0x7ffaec157d40 2023-12-22T10:01:47.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.248+0000 7ffae37fe700 1 -- 172.21.15.45:0/2167004639 <== mon.1 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7ffae4013610 con 0x7ffaec157d40 2023-12-22T10:01:47.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.252+0000 7ffae37fe700 1 --2- 172.21.15.45:0/2167004639 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7ffacc05a540 0x7ffacc05ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:47.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.252+0000 7ffae37fe700 1 -- 172.21.15.45:0/2167004639 <== mon.1 v2:172.21.15.113:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6207+0+0 (secure 0 0 0) 0x7ffae4074fb0 con 0x7ffaec157d40 2023-12-22T10:01:47.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.252+0000 7ffaeb7fe700 1 --2- 172.21.15.45:0/2167004639 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7ffacc05a540 0x7ffacc05ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:47.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.252+0000 7ffaeb7fe700 1 --2- 172.21.15.45:0/2167004639 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7ffacc05a540 0x7ffacc05ca00 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7ffadc007fd0 tx=0x7ffadc007d70).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:47.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.256+0000 7ffae37fe700 1 -- 172.21.15.45:0/2167004639 <== mon.1 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ffae4048680 con 0x7ffaec157d40 2023-12-22T10:01:47.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.424+0000 7ffaf1e9b700 1 -- 172.21.15.45:0/2167004639 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7ffaec0c60e0 con 0x7ffaec157d40 2023-12-22T10:01:47.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.428+0000 7ffae37fe700 1 -- 172.21.15.45:0/2167004639 <== mon.1 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v41) v1 ==== 110+0+10 (secure 0 0 0) 0x7ffae404bca0 con 0x7ffaec157d40 2023-12-22T10:01:47.426 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-12-22T10:01:47.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.432+0000 7ffaf1e9b700 1 -- 172.21.15.45:0/2167004639 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7ffacc05a540 msgr2=0x7ffacc05ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:47.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.432+0000 7ffaf1e9b700 1 --2- 172.21.15.45:0/2167004639 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7ffacc05a540 0x7ffacc05ca00 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7ffadc007fd0 tx=0x7ffadc007d70).stop 2023-12-22T10:01:47.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.432+0000 7ffaf1e9b700 1 -- 172.21.15.45:0/2167004639 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffaec157d40 msgr2=0x7ffaec16c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:47.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.432+0000 7ffaf1e9b700 1 --2- 172.21.15.45:0/2167004639 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffaec157d40 0x7ffaec16c0f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7ffae4009e20 tx=0x7ffae400b040).stop 2023-12-22T10:01:47.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.432+0000 7ffaf1e9b700 1 -- 172.21.15.45:0/2167004639 shutdown_connections 2023-12-22T10:01:47.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.432+0000 7ffaf1e9b700 1 --2- 172.21.15.45:0/2167004639 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffaec157d40 0x7ffaec16c0f0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:47.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.432+0000 7ffaf1e9b700 1 --2- 172.21.15.45:0/2167004639 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffaec0c1d80 0x7ffaec0a4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:47.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.432+0000 7ffaf1e9b700 1 --2- 172.21.15.45:0/2167004639 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7ffacc05a540 0x7ffacc05ca00 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:47.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.432+0000 7ffaf1e9b700 1 --2- 172.21.15.45:0/2167004639 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ffaec065930 0x7ffaec168b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:47.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.432+0000 7ffaf1e9b700 1 -- 172.21.15.45:0/2167004639 >> 172.21.15.45:0/2167004639 conn(0x7ffaec066a70 msgr2=0x7ffaec0a5c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:47.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.432+0000 7ffaf1e9b700 1 -- 172.21.15.45:0/2167004639 shutdown_connections 2023-12-22T10:01:47.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.432+0000 7ffaf1e9b700 1 -- 172.21.15.45:0/2167004639 wait complete. 2023-12-22T10:01:47.454 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-12-22T10:01:47.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.624+0000 7f2da3edb700 1 Processor -- start 2023-12-22T10:01:47.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.624+0000 7f2da3edb700 1 -- start start 2023-12-22T10:01:47.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.624+0000 7f2da3edb700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f2d9c0c1d80 0x7f2d9c158120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:47.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.624+0000 7f2da3edb700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2d9c065930 0x7f2d9c0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:47.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.624+0000 7f2da3edb700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d9c069180 con 0x7f2d9c157d40 2023-12-22T10:01:47.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.624+0000 7f2da3edb700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d9c069e00 con 0x7f2d9c065930 2023-12-22T10:01:47.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.624+0000 7f2da3edb700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d9c069460 con 0x7f2d9c0c1d80 2023-12-22T10:01:47.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.628+0000 7f2da1c77700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f2d9c157d40 0x7f2d9c0c1670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:58876/0 (socket says 172.21.15.45:58876) 2023-12-22T10:01:47.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.628+0000 7f2da1c77700 1 -- 172.21.15.45:0/531839716 learned_addr learned my addr 172.21.15.45:0/531839716 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:01:47.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.628+0000 7f2da2478700 1 --2- 172.21.15.45:0/531839716 >> v2:172.21.15.45:3300/0 conn(0x7f2d9c065930 0x7f2d9c0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:47.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.628+0000 7f2da1476700 1 --2- 172.21.15.45:0/531839716 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f2d9c0c1d80 0x7f2d9c158120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:47.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.628+0000 7f2da2478700 1 -- 172.21.15.45:0/531839716 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f2d9c0c1d80 msgr2=0x7f2d9c158120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:47.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.628+0000 7f2da2478700 1 --2- 172.21.15.45:0/531839716 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f2d9c0c1d80 0x7f2d9c158120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:47.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.628+0000 7f2da2478700 1 -- 172.21.15.45:0/531839716 >> v1:172.21.15.45:6789/0 conn(0x7f2d9c157d40 legacy=0x7f2d9c0c1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:47.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.628+0000 7f2da2478700 1 -- 172.21.15.45:0/531839716 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d9c069740 con 0x7f2d9c065930 2023-12-22T10:01:47.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.628+0000 7f2da0c75700 1 -- 172.21.15.45:0/531839716 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 222692191 0 0) 0x7f2d9c069180 con 0x7f2d9c157d40 2023-12-22T10:01:47.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.628+0000 7f2da2478700 1 --2- 172.21.15.45:0/531839716 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d9c065930 0x7f2d9c0a5810 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7f2d94009e60 tx=0x7f2d94009780).ready entity=mon.0 client_cookie=578f1ee80c310779 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:47.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.628+0000 7f2da0c75700 1 -- 172.21.15.45:0/531839716 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d9400e070 con 0x7f2d9c065930 2023-12-22T10:01:47.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.628+0000 7f2da0c75700 1 -- 172.21.15.45:0/531839716 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d9400bc30 con 0x7f2d9c065930 2023-12-22T10:01:47.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.628+0000 7f2da0c75700 1 -- 172.21.15.45:0/531839716 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d94012410 con 0x7f2d9c065930 2023-12-22T10:01:47.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.628+0000 7f2da3edb700 1 -- 172.21.15.45:0/531839716 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d9c065930 msgr2=0x7f2d9c0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:47.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.628+0000 7f2da3edb700 1 --2- 172.21.15.45:0/531839716 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d9c065930 0x7f2d9c0a5810 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7f2d94009e60 tx=0x7f2d94009780).stop 2023-12-22T10:01:47.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.628+0000 7f2da3edb700 1 -- 172.21.15.45:0/531839716 shutdown_connections 2023-12-22T10:01:47.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.628+0000 7f2da3edb700 1 --2- 172.21.15.45:0/531839716 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d9c065930 0x7f2d9c0a5810 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:47.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.628+0000 7f2da3edb700 1 --2- 172.21.15.45:0/531839716 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f2d9c0c1d80 0x7f2d9c158120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:47.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.628+0000 7f2da3edb700 1 -- 172.21.15.45:0/531839716 >> 172.21.15.45:0/531839716 conn(0x7f2d9c066a70 msgr2=0x7f2d9c066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:47.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.628+0000 7f2da3edb700 1 -- 172.21.15.45:0/531839716 shutdown_connections 2023-12-22T10:01:47.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.628+0000 7f2da3edb700 1 -- 172.21.15.45:0/531839716 wait complete. 2023-12-22T10:01:47.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.632+0000 7f2da3edb700 1 Processor -- start 2023-12-22T10:01:47.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.632+0000 7f2da3edb700 1 -- start start 2023-12-22T10:01:47.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.636+0000 7f2da3edb700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f2d9c065930 0x7f2d9c15a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:47.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.636+0000 7f2da3edb700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2d9c0c1d80 0x7f2d9c0c61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:47.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.636+0000 7f2da3edb700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d9c157d40 0x7f2d9c158b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:47.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.636+0000 7f2da3edb700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d9c15bc60 con 0x7f2d9c157d40 2023-12-22T10:01:47.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.636+0000 7f2da3edb700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d9c15adb0 con 0x7f2d9c0c1d80 2023-12-22T10:01:47.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.636+0000 7f2da3edb700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d9c0c66c0 con 0x7f2d9c065930 2023-12-22T10:01:47.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.636+0000 7f2da2478700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d9c157d40 0x7f2d9c158b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:47.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.636+0000 7f2da2478700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d9c157d40 0x7f2d9c158b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37252/0 (socket says 172.21.15.45:37252) 2023-12-22T10:01:47.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.636+0000 7f2da2478700 1 -- 172.21.15.45:0/3597159058 learned_addr learned my addr 172.21.15.45:0/3597159058 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:47.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.636+0000 7f2da1c77700 1 --2- 172.21.15.45:0/3597159058 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f2d9c065930 0x7f2d9c15a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:47.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.636+0000 7f2da1476700 1 --2- 172.21.15.45:0/3597159058 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2d9c0c1d80 0x7f2d9c0c61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:47.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.636+0000 7f2da2478700 1 -- 172.21.15.45:0/3597159058 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f2d9c065930 msgr2=0x7f2d9c15a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:47.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.636+0000 7f2da2478700 1 --2- 172.21.15.45:0/3597159058 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f2d9c065930 0x7f2d9c15a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:47.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.636+0000 7f2da2478700 1 -- 172.21.15.45:0/3597159058 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2d9c0c1d80 msgr2=0x7f2d9c0c61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:47.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.636+0000 7f2da2478700 1 --2- 172.21.15.45:0/3597159058 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2d9c0c1d80 0x7f2d9c0c61d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:47.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.636+0000 7f2da2478700 1 -- 172.21.15.45:0/3597159058 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d94009a20 con 0x7f2d9c157d40 2023-12-22T10:01:47.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.636+0000 7f2da2478700 1 --2- 172.21.15.45:0/3597159058 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d9c157d40 0x7f2d9c158b90 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7f2d9c0a6560 tx=0x7f2d94009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:47.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.636+0000 7f2d91ffb700 1 -- 172.21.15.45:0/3597159058 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d940116d0 con 0x7f2d9c157d40 2023-12-22T10:01:47.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.636+0000 7f2d91ffb700 1 -- 172.21.15.45:0/3597159058 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d94011830 con 0x7f2d9c157d40 2023-12-22T10:01:47.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.636+0000 7f2d91ffb700 1 -- 172.21.15.45:0/3597159058 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d94011bf0 con 0x7f2d9c157d40 2023-12-22T10:01:47.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.636+0000 7f2da3edb700 1 -- 172.21.15.45:0/3597159058 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d9c15b050 con 0x7f2d9c157d40 2023-12-22T10:01:47.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.636+0000 7f2da3edb700 1 -- 172.21.15.45:0/3597159058 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d9c15b610 con 0x7f2d9c157d40 2023-12-22T10:01:47.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.640+0000 7f2da3edb700 1 -- 172.21.15.45:0/3597159058 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d9c06c070 con 0x7f2d9c157d40 2023-12-22T10:01:47.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.640+0000 7f2d91ffb700 1 -- 172.21.15.45:0/3597159058 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f2d94003040 con 0x7f2d9c157d40 2023-12-22T10:01:47.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.640+0000 7f2d91ffb700 1 --2- 172.21.15.45:0/3597159058 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f2d8005a510 0x7f2d8005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:47.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.640+0000 7f2d91ffb700 1 -- 172.21.15.45:0/3597159058 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f2d940766d0 con 0x7f2d9c157d40 2023-12-22T10:01:47.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.640+0000 7f2da1c77700 1 --2- 172.21.15.45:0/3597159058 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f2d8005a510 0x7f2d8005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:47.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.644+0000 7f2da1c77700 1 --2- 172.21.15.45:0/3597159058 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f2d8005a510 0x7f2d8005c9d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f2d98007fd0 tx=0x7f2d98007dd0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:47.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.648+0000 7f2d91ffb700 1 -- 172.21.15.45:0/3597159058 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f2d94049da0 con 0x7f2d9c157d40 2023-12-22T10:01:47.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.812+0000 7f2da3edb700 1 -- 172.21.15.45:0/3597159058 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2d9c0c0af0 con 0x7f2d9c157d40 2023-12-22T10:01:47.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.812+0000 7f2d91ffb700 1 -- 172.21.15.45:0/3597159058 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v41) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2d9404d3c0 con 0x7f2d9c157d40 2023-12-22T10:01:47.813 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-12-22T10:01:47.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.820+0000 7f2da3edb700 1 -- 172.21.15.45:0/3597159058 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f2d8005a510 msgr2=0x7f2d8005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:47.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.820+0000 7f2da3edb700 1 --2- 172.21.15.45:0/3597159058 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f2d8005a510 0x7f2d8005c9d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f2d98007fd0 tx=0x7f2d98007dd0).stop 2023-12-22T10:01:47.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.820+0000 7f2da3edb700 1 -- 172.21.15.45:0/3597159058 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d9c157d40 msgr2=0x7f2d9c158b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:47.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.820+0000 7f2da3edb700 1 --2- 172.21.15.45:0/3597159058 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d9c157d40 0x7f2d9c158b90 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7f2d9c0a6560 tx=0x7f2d94009780).stop 2023-12-22T10:01:47.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.820+0000 7f2da3edb700 1 -- 172.21.15.45:0/3597159058 shutdown_connections 2023-12-22T10:01:47.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.820+0000 7f2da3edb700 1 --2- 172.21.15.45:0/3597159058 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d9c157d40 0x7f2d9c158b90 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:47.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.820+0000 7f2da3edb700 1 --2- 172.21.15.45:0/3597159058 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2d9c0c1d80 0x7f2d9c0c61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:47.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.820+0000 7f2da3edb700 1 --2- 172.21.15.45:0/3597159058 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f2d8005a510 0x7f2d8005c9d0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:47.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.820+0000 7f2da3edb700 1 --2- 172.21.15.45:0/3597159058 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f2d9c065930 0x7f2d9c15a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:47.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.820+0000 7f2da3edb700 1 -- 172.21.15.45:0/3597159058 >> 172.21.15.45:0/3597159058 conn(0x7f2d9c066a70 msgr2=0x7f2d9c0a7430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:47.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.820+0000 7f2da3edb700 1 -- 172.21.15.45:0/3597159058 shutdown_connections 2023-12-22T10:01:47.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:47.820+0000 7f2da3edb700 1 -- 172.21.15.45:0/3597159058 wait complete. 2023-12-22T10:01:47.838 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-22T10:01:48.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.016+0000 7f2e6f59e700 1 Processor -- start 2023-12-22T10:01:48.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.016+0000 7f2e6f59e700 1 -- start start 2023-12-22T10:01:48.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.020+0000 7f2e6f59e700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2e70152c10 0x7f2e7014f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:48.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.020+0000 7f2e6f59e700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e70152780 con 0x7f2e7014f310 2023-12-22T10:01:48.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.020+0000 7f2e6f59e700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e700c5210 con 0x7f2e700a8ed0 2023-12-22T10:01:48.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.020+0000 7f2e6f59e700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e70152130 con 0x7f2e70152c10 2023-12-22T10:01:48.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.020+0000 7f2e6ed9d700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2e70152c10 0x7f2e7014f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:48.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.020+0000 7f2e6e59c700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f2e7014f310 0x7f2e700a87c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:45008/0 (socket says 172.21.15.45:45008) 2023-12-22T10:01:48.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.020+0000 7f2e6dd9b700 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f2e700a8ed0 0x7f2e70068aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.45:60630/0 (socket says 172.21.15.45:60630) 2023-12-22T10:01:48.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.020+0000 7f2e6e59c700 1 -- 172.21.15.45:0/2770551567 learned_addr learned my addr 172.21.15.45:0/2770551567 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:01:48.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.020+0000 7f2e6ed9d700 1 -- 172.21.15.45:0/2770551567 >> v1:172.21.15.113:6789/0 conn(0x7f2e700a8ed0 legacy=0x7f2e70068aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:48.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.020+0000 7f2e6ed9d700 1 -- 172.21.15.45:0/2770551567 >> v1:172.21.15.45:6789/0 conn(0x7f2e7014f310 legacy=0x7f2e700a87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:48.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.020+0000 7f2e6d59a700 1 -- 172.21.15.45:0/2770551567 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 485153321 0 0) 0x7f2e70152780 con 0x7f2e7014f310 2023-12-22T10:01:48.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.020+0000 7f2e6ed9d700 1 -- 172.21.15.45:0/2770551567 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e70152410 con 0x7f2e70152c10 2023-12-22T10:01:48.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.020+0000 7f2e6ed9d700 1 --2- 172.21.15.45:0/2770551567 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e70152c10 0x7f2e7014f6f0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0x7f2e68009e60 tx=0x7f2e68009780).ready entity=mon.0 client_cookie=3b8646f8eb22af55 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:48.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.020+0000 7f2e6d59a700 1 -- 172.21.15.45:0/2770551567 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e6800e070 con 0x7f2e70152c10 2023-12-22T10:01:48.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.020+0000 7f2e6d59a700 1 -- 172.21.15.45:0/2770551567 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e6800bc30 con 0x7f2e70152c10 2023-12-22T10:01:48.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.020+0000 7f2e6d59a700 1 -- 172.21.15.45:0/2770551567 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e68012410 con 0x7f2e70152c10 2023-12-22T10:01:48.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.024+0000 7f2e6f59e700 1 -- 172.21.15.45:0/2770551567 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e70152c10 msgr2=0x7f2e7014f6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:48.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.024+0000 7f2e6f59e700 1 --2- 172.21.15.45:0/2770551567 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e70152c10 0x7f2e7014f6f0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0x7f2e68009e60 tx=0x7f2e68009780).stop 2023-12-22T10:01:48.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.024+0000 7f2e6f59e700 1 -- 172.21.15.45:0/2770551567 shutdown_connections 2023-12-22T10:01:48.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.024+0000 7f2e6f59e700 1 --2- 172.21.15.45:0/2770551567 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e70152c10 0x7f2e7014f6f0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:48.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.024+0000 7f2e6f59e700 1 -- 172.21.15.45:0/2770551567 >> 172.21.15.45:0/2770551567 conn(0x7f2e70067500 msgr2=0x7f2e700c6440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:48.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.024+0000 7f2e6f59e700 1 -- 172.21.15.45:0/2770551567 shutdown_connections 2023-12-22T10:01:48.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.024+0000 7f2e6f59e700 1 -- 172.21.15.45:0/2770551567 wait complete. 2023-12-22T10:01:48.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.024+0000 7f2e6f59e700 1 Processor -- start 2023-12-22T10:01:48.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.024+0000 7f2e6f59e700 1 -- start start 2023-12-22T10:01:48.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.028+0000 7f2e6f59e700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f2e700a8ed0 0x7f2e701649c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:48.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.028+0000 7f2e6f59e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e7014f310 0x7f2e700ab280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:48.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.028+0000 7f2e6f59e700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2e70152c10 0x7f2e7014cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:48.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.028+0000 7f2e6f59e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e70164eb0 con 0x7f2e7014f310 2023-12-22T10:01:48.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.028+0000 7f2e6f59e700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e700abd30 con 0x7f2e70152c10 2023-12-22T10:01:48.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.028+0000 7f2e6f59e700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e700aa1e0 con 0x7f2e700a8ed0 2023-12-22T10:01:48.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.028+0000 7f2e6dd9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e7014f310 0x7f2e700ab280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:48.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.028+0000 7f2e6e59c700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f2e700a8ed0 0x7f2e701649c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:48.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.028+0000 7f2e6dd9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e7014f310 0x7f2e700ab280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48194/0 (socket says 172.21.15.45:48194) 2023-12-22T10:01:48.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.028+0000 7f2e6dd9b700 1 -- 172.21.15.45:0/2901903326 learned_addr learned my addr 172.21.15.45:0/2901903326 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:48.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.028+0000 7f2e6ed9d700 1 --2- 172.21.15.45:0/2901903326 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2e70152c10 0x7f2e7014cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:48.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.028+0000 7f2e6dd9b700 1 -- 172.21.15.45:0/2901903326 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f2e700a8ed0 msgr2=0x7f2e701649c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:48.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.028+0000 7f2e6dd9b700 1 --2- 172.21.15.45:0/2901903326 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f2e700a8ed0 0x7f2e701649c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:48.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.028+0000 7f2e6dd9b700 1 -- 172.21.15.45:0/2901903326 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2e70152c10 msgr2=0x7f2e7014cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:48.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.028+0000 7f2e6dd9b700 1 --2- 172.21.15.45:0/2901903326 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2e70152c10 0x7f2e7014cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:48.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.028+0000 7f2e6dd9b700 1 -- 172.21.15.45:0/2901903326 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e68009a20 con 0x7f2e7014f310 2023-12-22T10:01:48.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.028+0000 7f2e6dd9b700 1 --2- 172.21.15.45:0/2901903326 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e7014f310 0x7f2e700ab280 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7f2e64007fd0 tx=0x7f2e64007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:48.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.028+0000 7f2e6ed9d700 1 --2- 172.21.15.45:0/2901903326 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2e70152c10 0x7f2e7014cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T10:01:48.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.028+0000 7f2e5e7fc700 1 -- 172.21.15.45:0/2901903326 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e640072e0 con 0x7f2e7014f310 2023-12-22T10:01:48.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.028+0000 7f2e5e7fc700 1 -- 172.21.15.45:0/2901903326 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e64007440 con 0x7f2e7014f310 2023-12-22T10:01:48.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.028+0000 7f2e5e7fc700 1 -- 172.21.15.45:0/2901903326 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e640058f0 con 0x7f2e7014f310 2023-12-22T10:01:48.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.028+0000 7f2e6f59e700 1 -- 172.21.15.45:0/2901903326 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e700aa4c0 con 0x7f2e7014f310 2023-12-22T10:01:48.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.028+0000 7f2e6f59e700 1 -- 172.21.15.45:0/2901903326 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e700aaa80 con 0x7f2e7014f310 2023-12-22T10:01:48.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.032+0000 7f2e6f59e700 1 -- 172.21.15.45:0/2901903326 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e70047060 con 0x7f2e7014f310 2023-12-22T10:01:48.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.032+0000 7f2e5e7fc700 1 -- 172.21.15.45:0/2901903326 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f2e64005ce0 con 0x7f2e7014f310 2023-12-22T10:01:48.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.032+0000 7f2e5e7fc700 1 --2- 172.21.15.45:0/2901903326 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f2e5005a540 0x7f2e5005ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:48.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.032+0000 7f2e5e7fc700 1 -- 172.21.15.45:0/2901903326 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f2e64073f10 con 0x7f2e7014f310 2023-12-22T10:01:48.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.036+0000 7f2e6e59c700 1 --2- 172.21.15.45:0/2901903326 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f2e5005a540 0x7f2e5005ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:48.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.036+0000 7f2e6e59c700 1 --2- 172.21.15.45:0/2901903326 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f2e5005a540 0x7f2e5005ca00 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f2e600011e0 tx=0x7f2e60007bb0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:48.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.040+0000 7f2e5e7fc700 1 -- 172.21.15.45:0/2901903326 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f2e640476a0 con 0x7f2e7014f310 2023-12-22T10:01:48.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.208+0000 7f2e6f59e700 1 -- 172.21.15.45:0/2901903326 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2e700c54f0 con 0x7f2e7014f310 2023-12-22T10:01:48.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.212+0000 7f2e5e7fc700 1 -- 172.21.15.45:0/2901903326 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v41) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2e6404acc0 con 0x7f2e7014f310 2023-12-22T10:01:48.210 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-22T10:01:48.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.212+0000 7f2e6f59e700 1 -- 172.21.15.45:0/2901903326 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f2e5005a540 msgr2=0x7f2e5005ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:48.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.212+0000 7f2e6f59e700 1 --2- 172.21.15.45:0/2901903326 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f2e5005a540 0x7f2e5005ca00 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f2e600011e0 tx=0x7f2e60007bb0).stop 2023-12-22T10:01:48.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.212+0000 7f2e6f59e700 1 -- 172.21.15.45:0/2901903326 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e7014f310 msgr2=0x7f2e700ab280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:48.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.212+0000 7f2e6f59e700 1 --2- 172.21.15.45:0/2901903326 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e7014f310 0x7f2e700ab280 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7f2e64007fd0 tx=0x7f2e64007df0).stop 2023-12-22T10:01:48.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.212+0000 7f2e6f59e700 1 -- 172.21.15.45:0/2901903326 shutdown_connections 2023-12-22T10:01:48.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.212+0000 7f2e6f59e700 1 --2- 172.21.15.45:0/2901903326 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2e70152c10 0x7f2e7014cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:48.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.212+0000 7f2e6f59e700 1 --2- 172.21.15.45:0/2901903326 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e7014f310 0x7f2e700ab280 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:48.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.212+0000 7f2e6f59e700 1 --2- 172.21.15.45:0/2901903326 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f2e5005a540 0x7f2e5005ca00 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:48.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.212+0000 7f2e6f59e700 1 --2- 172.21.15.45:0/2901903326 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f2e700a8ed0 0x7f2e701649c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:48.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.212+0000 7f2e6f59e700 1 -- 172.21.15.45:0/2901903326 >> 172.21.15.45:0/2901903326 conn(0x7f2e70067500 msgr2=0x7f2e70064620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:48.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.216+0000 7f2e6f59e700 1 -- 172.21.15.45:0/2901903326 shutdown_connections 2023-12-22T10:01:48.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.216+0000 7f2e6f59e700 1 -- 172.21.15.45:0/2901903326 wait complete. 2023-12-22T10:01:48.232 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-22T10:01:48.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.396+0000 7f9c5a879700 1 Processor -- start 2023-12-22T10:01:48.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.400+0000 7f9c5a879700 1 -- start start 2023-12-22T10:01:48.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.400+0000 7f9c5a879700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9c540a8ba0 0x7f9c541584a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:48.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.400+0000 7f9c5a879700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9c540c5330 0x7f9c540c1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:48.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.400+0000 7f9c5a879700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c541594c0 con 0x7f9c54065890 2023-12-22T10:01:48.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.400+0000 7f9c5a879700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c540c11e0 con 0x7f9c540c5330 2023-12-22T10:01:48.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.400+0000 7f9c5a879700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c54068aa0 con 0x7f9c540a8ba0 2023-12-22T10:01:48.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.400+0000 7f9c5a078700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9c540c5330 0x7f9c540c1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:48.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.400+0000 7f9c5a078700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9c540c5330 0x7f9c540c1bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48196/0 (socket says 172.21.15.45:48196) 2023-12-22T10:01:48.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.400+0000 7f9c5a078700 1 -- 172.21.15.45:0/2653765455 learned_addr learned my addr 172.21.15.45:0/2653765455 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:48.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.400+0000 7f9c59877700 1 --2- 172.21.15.45:0/2653765455 >> v2:172.21.15.113:3300/0 conn(0x7f9c540a8ba0 0x7f9c541584a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:48.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.400+0000 7f9c5a078700 1 -- 172.21.15.45:0/2653765455 >> v2:172.21.15.113:3300/0 conn(0x7f9c540a8ba0 msgr2=0x7f9c541584a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:48.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.400+0000 7f9c5a078700 1 --2- 172.21.15.45:0/2653765455 >> v2:172.21.15.113:3300/0 conn(0x7f9c540a8ba0 0x7f9c541584a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:48.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.400+0000 7f9c58875700 1 -- 172.21.15.45:0/2653765455 <== mon.1 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3804534069 0 0) 0x7f9c541594c0 con 0x7f9c54065890 2023-12-22T10:01:48.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.400+0000 7f9c5a078700 1 -- 172.21.15.45:0/2653765455 >> v1:172.21.15.113:6789/0 conn(0x7f9c54065890 legacy=0x7f9c540c4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:48.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.400+0000 7f9c5a078700 1 -- 172.21.15.45:0/2653765455 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c54158f00 con 0x7f9c540c5330 2023-12-22T10:01:48.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.404+0000 7f9c5a078700 1 --2- 172.21.15.45:0/2653765455 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c540c5330 0x7f9c540c1bf0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7f9c540c3ef0 tx=0x7f9c4c009840).ready entity=mon.0 client_cookie=eb2c345899942e72 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:48.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.404+0000 7f9c58875700 1 -- 172.21.15.45:0/2653765455 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c4c00e070 con 0x7f9c540c5330 2023-12-22T10:01:48.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.404+0000 7f9c58875700 1 -- 172.21.15.45:0/2653765455 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c4c00ba20 con 0x7f9c540c5330 2023-12-22T10:01:48.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.404+0000 7f9c58875700 1 -- 172.21.15.45:0/2653765455 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c4c00bda0 con 0x7f9c540c5330 2023-12-22T10:01:48.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.404+0000 7f9c5a879700 1 -- 172.21.15.45:0/2653765455 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c540c5330 msgr2=0x7f9c540c1bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:48.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.404+0000 7f9c5a879700 1 --2- 172.21.15.45:0/2653765455 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c540c5330 0x7f9c540c1bf0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7f9c540c3ef0 tx=0x7f9c4c009840).stop 2023-12-22T10:01:48.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.404+0000 7f9c5a879700 1 -- 172.21.15.45:0/2653765455 shutdown_connections 2023-12-22T10:01:48.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.404+0000 7f9c5a879700 1 --2- 172.21.15.45:0/2653765455 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c540c5330 0x7f9c540c1bf0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:48.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.404+0000 7f9c5a879700 1 --2- 172.21.15.45:0/2653765455 >> v2:172.21.15.113:3300/0 conn(0x7f9c540a8ba0 0x7f9c541584a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:48.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.404+0000 7f9c5a879700 1 -- 172.21.15.45:0/2653765455 >> 172.21.15.45:0/2653765455 conn(0x7f9c54067500 msgr2=0x7f9c540c6440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:48.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.404+0000 7f9c5a879700 1 -- 172.21.15.45:0/2653765455 shutdown_connections 2023-12-22T10:01:48.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.404+0000 7f9c5a879700 1 -- 172.21.15.45:0/2653765455 wait complete. 2023-12-22T10:01:48.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.408+0000 7f9c5a879700 1 Processor -- start 2023-12-22T10:01:48.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.408+0000 7f9c5a879700 1 -- start start 2023-12-22T10:01:48.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.408+0000 7f9c5a879700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9c54065890 0x7f9c5416c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:48.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.408+0000 7f9c5a879700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f9c540a8ba0 0x7f9c540aba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:48.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.408+0000 7f9c5a879700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c540c5330 0x7f9c54141490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:48.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.408+0000 7f9c5a879700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c5416ce80 con 0x7f9c540c5330 2023-12-22T10:01:48.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.408+0000 7f9c5a879700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c540ab570 con 0x7f9c54065890 2023-12-22T10:01:48.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.408+0000 7f9c5a879700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c540aa960 con 0x7f9c540a8ba0 2023-12-22T10:01:48.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.408+0000 7f9c5a078700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c540c5330 0x7f9c54141490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:48.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.408+0000 7f9c5a078700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c540c5330 0x7f9c54141490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48204/0 (socket says 172.21.15.45:48204) 2023-12-22T10:01:48.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.408+0000 7f9c5a078700 1 -- 172.21.15.45:0/2408815276 learned_addr learned my addr 172.21.15.45:0/2408815276 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:48.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.408+0000 7f9c59877700 1 --2- 172.21.15.45:0/2408815276 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9c54065890 0x7f9c5416c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:48.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.412+0000 7f9c59076700 1 --2- 172.21.15.45:0/2408815276 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f9c540a8ba0 0x7f9c540aba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:48.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.412+0000 7f9c5a078700 1 -- 172.21.15.45:0/2408815276 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f9c540a8ba0 msgr2=0x7f9c540aba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:48.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.412+0000 7f9c5a078700 1 --2- 172.21.15.45:0/2408815276 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f9c540a8ba0 0x7f9c540aba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:48.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.412+0000 7f9c5a078700 1 -- 172.21.15.45:0/2408815276 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9c54065890 msgr2=0x7f9c5416c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:48.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.412+0000 7f9c5a078700 1 --2- 172.21.15.45:0/2408815276 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9c54065890 0x7f9c5416c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:48.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.412+0000 7f9c5a078700 1 -- 172.21.15.45:0/2408815276 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c4c009ae0 con 0x7f9c540c5330 2023-12-22T10:01:48.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.412+0000 7f9c5a078700 1 --2- 172.21.15.45:0/2408815276 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c540c5330 0x7f9c54141490 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7f9c4c00b6c0 tx=0x7f9c4c009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:48.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.412+0000 7f9c49ffb700 1 -- 172.21.15.45:0/2408815276 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c4c00bda0 con 0x7f9c540c5330 2023-12-22T10:01:48.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.412+0000 7f9c49ffb700 1 -- 172.21.15.45:0/2408815276 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c4c009500 con 0x7f9c540c5330 2023-12-22T10:01:48.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.412+0000 7f9c49ffb700 1 -- 172.21.15.45:0/2408815276 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c4c01d6b0 con 0x7f9c540c5330 2023-12-22T10:01:48.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.412+0000 7f9c5a879700 1 -- 172.21.15.45:0/2408815276 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c540aac40 con 0x7f9c540c5330 2023-12-22T10:01:48.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.412+0000 7f9c5a879700 1 -- 172.21.15.45:0/2408815276 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c540ab200 con 0x7f9c540c5330 2023-12-22T10:01:48.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.412+0000 7f9c5a879700 1 -- 172.21.15.45:0/2408815276 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c540ab700 con 0x7f9c540c5330 2023-12-22T10:01:48.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.416+0000 7f9c49ffb700 1 -- 172.21.15.45:0/2408815276 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f9c4c003040 con 0x7f9c540c5330 2023-12-22T10:01:48.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.416+0000 7f9c49ffb700 1 --2- 172.21.15.45:0/2408815276 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f9c3805a510 0x7f9c3805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:48.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.416+0000 7f9c49ffb700 1 -- 172.21.15.45:0/2408815276 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f9c4c075c90 con 0x7f9c540c5330 2023-12-22T10:01:48.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.416+0000 7f9c59877700 1 --2- 172.21.15.45:0/2408815276 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f9c3805a510 0x7f9c3805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:48.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.416+0000 7f9c59877700 1 --2- 172.21.15.45:0/2408815276 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f9c3805a510 0x7f9c3805c9d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f9c50009c30 tx=0x7f9c50009060).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:48.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.424+0000 7f9c49ffb700 1 -- 172.21.15.45:0/2408815276 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f9c4c049360 con 0x7f9c540c5330 2023-12-22T10:01:48.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.588+0000 7f9c5a879700 1 -- 172.21.15.45:0/2408815276 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9c54047060 con 0x7f9c540c5330 2023-12-22T10:01:48.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.588+0000 7f9c49ffb700 1 -- 172.21.15.45:0/2408815276 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v41) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9c4c022030 con 0x7f9c540c5330 2023-12-22T10:01:48.588 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-22T10:01:48.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.592+0000 7f9c5a879700 1 -- 172.21.15.45:0/2408815276 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f9c3805a510 msgr2=0x7f9c3805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:48.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.592+0000 7f9c5a879700 1 --2- 172.21.15.45:0/2408815276 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f9c3805a510 0x7f9c3805c9d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f9c50009c30 tx=0x7f9c50009060).stop 2023-12-22T10:01:48.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.592+0000 7f9c5a879700 1 -- 172.21.15.45:0/2408815276 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c540c5330 msgr2=0x7f9c54141490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:48.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.592+0000 7f9c5a879700 1 --2- 172.21.15.45:0/2408815276 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c540c5330 0x7f9c54141490 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7f9c4c00b6c0 tx=0x7f9c4c009840).stop 2023-12-22T10:01:48.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.592+0000 7f9c5a879700 1 -- 172.21.15.45:0/2408815276 shutdown_connections 2023-12-22T10:01:48.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.592+0000 7f9c5a879700 1 --2- 172.21.15.45:0/2408815276 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c540c5330 0x7f9c54141490 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:48.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.592+0000 7f9c5a879700 1 --2- 172.21.15.45:0/2408815276 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f9c3805a510 0x7f9c3805c9d0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:48.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.592+0000 7f9c5a879700 1 --2- 172.21.15.45:0/2408815276 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f9c540a8ba0 0x7f9c540aba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:48.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.592+0000 7f9c5a879700 1 --2- 172.21.15.45:0/2408815276 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9c54065890 0x7f9c5416c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:48.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.592+0000 7f9c5a879700 1 -- 172.21.15.45:0/2408815276 >> 172.21.15.45:0/2408815276 conn(0x7f9c54067500 msgr2=0x7f9c540bca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:48.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.592+0000 7f9c5a879700 1 -- 172.21.15.45:0/2408815276 shutdown_connections 2023-12-22T10:01:48.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.592+0000 7f9c5a879700 1 -- 172.21.15.45:0/2408815276 wait complete. 2023-12-22T10:01:48.620 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'recovery_fs' 2023-12-22T10:01:48.620 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create recovery_fs_metadata 64 --pg_num_min 64 2023-12-22T10:01:48.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.800+0000 7f1a0dbb9700 1 Processor -- start 2023-12-22T10:01:48.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.800+0000 7f1a0dbb9700 1 -- start start 2023-12-22T10:01:48.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.804+0000 7f1a0dbb9700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1a080acca0 0x7f1a080ad080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:48.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.804+0000 7f1a0dbb9700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1a080c9d20 0x7f1a080c97e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:48.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.804+0000 7f1a0dbb9700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a080c5810 con 0x7f1a080ca230 2023-12-22T10:01:48.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.804+0000 7f1a0dbb9700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a080c8d90 con 0x7f1a080c9d20 2023-12-22T10:01:48.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.804+0000 7f1a0dbb9700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a080c9350 con 0x7f1a080acca0 2023-12-22T10:01:48.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.804+0000 7f1a0d3b8700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f1a080ca230 0x7f1a08068ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:45016/0 (socket says 172.21.15.45:45016) 2023-12-22T10:01:48.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.804+0000 7f1a0d3b8700 1 -- 172.21.15.45:0/2804708126 learned_addr learned my addr 172.21.15.45:0/2804708126 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:01:48.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.804+0000 7f1a07fff700 1 --2- 172.21.15.45:0/2804708126 >> v2:172.21.15.113:3300/0 conn(0x7f1a080c9d20 0x7f1a080c97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:48.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.804+0000 7f1a0cbb7700 1 --2- 172.21.15.45:0/2804708126 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1a080acca0 0x7f1a080ad080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:48.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.804+0000 7f1a077fe700 1 -- 172.21.15.45:0/2804708126 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3918090322 0 0) 0x7f1a080c5810 con 0x7f1a080ca230 2023-12-22T10:01:48.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.804+0000 7f1a077fe700 1 -- 172.21.15.45:0/2804708126 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19f80033f0 con 0x7f1a080ca230 2023-12-22T10:01:48.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.804+0000 7f1a077fe700 1 -- 172.21.15.45:0/2804708126 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4249598500 0 0) 0x7f19f80033f0 con 0x7f1a080ca230 2023-12-22T10:01:48.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.804+0000 7f1a077fe700 1 -- 172.21.15.45:0/2804708126 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1a080acca0 msgr2=0x7f1a080ad080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:48.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.804+0000 7f1a077fe700 1 --2- 172.21.15.45:0/2804708126 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1a080acca0 0x7f1a080ad080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:48.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.804+0000 7f1a077fe700 1 -- 172.21.15.45:0/2804708126 >> v2:172.21.15.113:3300/0 conn(0x7f1a080c9d20 msgr2=0x7f1a080c97e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:48.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.804+0000 7f1a077fe700 1 --2- 172.21.15.45:0/2804708126 >> v2:172.21.15.113:3300/0 conn(0x7f1a080c9d20 0x7f1a080c97e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:48.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.804+0000 7f1a077fe700 1 -- 172.21.15.45:0/2804708126 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a08154070 con 0x7f1a080ca230 2023-12-22T10:01:48.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.804+0000 7f1a077fe700 1 -- 172.21.15.45:0/2804708126 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2619163070 0 0) 0x7f1a000017f0 con 0x7f1a080ca230 2023-12-22T10:01:48.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.804+0000 7f1a077fe700 1 -- 172.21.15.45:0/2804708126 >> v1:172.21.15.45:6789/0 conn(0x7f1a080ca230 legacy=0x7f1a08068ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:48.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.804+0000 7f1a077fe700 1 --2- 172.21.15.45:0/2804708126 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19f80038e0 0x7f19f8003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:48.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.804+0000 7f1a077fe700 1 --2- 172.21.15.45:0/2804708126 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f19f8004690 0x7f19f8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:48.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.804+0000 7f1a077fe700 1 --2- 172.21.15.45:0/2804708126 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1a080acca0 0x7f19f8005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:48.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.804+0000 7f1a077fe700 1 -- 172.21.15.45:0/2804708126 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a080c8d90 con 0x7f19f80038e0 2023-12-22T10:01:48.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.804+0000 7f1a077fe700 1 -- 172.21.15.45:0/2804708126 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a080c9350 con 0x7f19f8004690 2023-12-22T10:01:48.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.804+0000 7f1a077fe700 1 -- 172.21.15.45:0/2804708126 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19f80044e0 con 0x7f1a080acca0 2023-12-22T10:01:48.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.804+0000 7f1a07fff700 1 --2- 172.21.15.45:0/2804708126 >> v2:172.21.15.113:3300/0 conn(0x7f1a080c9d20 0x7f1a080c97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-12-22T10:01:48.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.804+0000 7f1a0cbb7700 1 --2- 172.21.15.45:0/2804708126 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19f80038e0 0x7f19f8003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:48.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.808+0000 7f1a0d3b8700 1 --2- 172.21.15.45:0/2804708126 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1a080acca0 0x7f19f8005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:48.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.808+0000 7f1a07fff700 1 --2- 172.21.15.45:0/2804708126 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f19f8004690 0x7f19f8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:48.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.808+0000 7f1a0cbb7700 1 -- 172.21.15.45:0/2804708126 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1a080acca0 msgr2=0x7f19f8005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:48.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.808+0000 7f1a0cbb7700 1 --2- 172.21.15.45:0/2804708126 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1a080acca0 0x7f19f8005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:48.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.808+0000 7f1a0cbb7700 1 -- 172.21.15.45:0/2804708126 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f19f8004690 msgr2=0x7f19f8004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:48.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.808+0000 7f1a0cbb7700 1 --2- 172.21.15.45:0/2804708126 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f19f8004690 0x7f19f8004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:48.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.808+0000 7f1a0cbb7700 1 -- 172.21.15.45:0/2804708126 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a08154070 con 0x7f19f80038e0 2023-12-22T10:01:48.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.808+0000 7f1a0cbb7700 1 --2- 172.21.15.45:0/2804708126 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19f80038e0 0x7f19f8003d00 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7f19fc009a80 tx=0x7f19fc009060).ready entity=mon.0 client_cookie=478557e3e88663de server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:48.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.808+0000 7f1a077fe700 1 -- 172.21.15.45:0/2804708126 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19fc009430 con 0x7f19f80038e0 2023-12-22T10:01:48.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.808+0000 7f1a077fe700 1 -- 172.21.15.45:0/2804708126 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19fc00e640 con 0x7f19f80038e0 2023-12-22T10:01:48.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.808+0000 7f1a077fe700 1 -- 172.21.15.45:0/2804708126 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19fc00e9c0 con 0x7f19f80038e0 2023-12-22T10:01:48.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.808+0000 7f1a0dbb9700 1 -- 172.21.15.45:0/2804708126 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19f80038e0 msgr2=0x7f19f8003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:48.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.808+0000 7f1a0dbb9700 1 --2- 172.21.15.45:0/2804708126 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19f80038e0 0x7f19f8003d00 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7f19fc009a80 tx=0x7f19fc009060).stop 2023-12-22T10:01:48.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.808+0000 7f1a0d3b8700 1 -- 172.21.15.45:0/2804708126 reap_dead start 2023-12-22T10:01:48.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.808+0000 7f1a0dbb9700 1 -- 172.21.15.45:0/2804708126 shutdown_connections 2023-12-22T10:01:48.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.808+0000 7f1a0dbb9700 1 -- 172.21.15.45:0/2804708126 >> 172.21.15.45:0/2804708126 conn(0x7f1a080674f0 msgr2=0x7f1a080ca820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:48.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.808+0000 7f1a0dbb9700 1 -- 172.21.15.45:0/2804708126 shutdown_connections 2023-12-22T10:01:48.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.808+0000 7f1a0dbb9700 1 -- 172.21.15.45:0/2804708126 wait complete. 2023-12-22T10:01:48.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.812+0000 7f1a0dbb9700 1 Processor -- start 2023-12-22T10:01:48.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.812+0000 7f1a0dbb9700 1 -- start start 2023-12-22T10:01:48.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.812+0000 7f1a0dbb9700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f19f80038e0 0x7f1a08146ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:48.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.812+0000 7f1a0dbb9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a080c18c0 0x7f1a080c1d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:48.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.812+0000 7f1a0dbb9700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1a080aad10 0x7f1a080ab190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:48.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.816+0000 7f1a0dbb9700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a080ab680 con 0x7f1a080c18c0 2023-12-22T10:01:48.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.816+0000 7f1a0dbb9700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a080c25e0 con 0x7f19f80038e0 2023-12-22T10:01:48.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.816+0000 7f1a0dbb9700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a080c2320 con 0x7f1a080aad10 2023-12-22T10:01:48.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.816+0000 7f1a07fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a080c18c0 0x7f1a080c1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:48.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.816+0000 7f1a07fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a080c18c0 0x7f1a080c1d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48212/0 (socket says 172.21.15.45:48212) 2023-12-22T10:01:48.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.816+0000 7f1a07fff700 1 -- 172.21.15.45:0/1402746261 learned_addr learned my addr 172.21.15.45:0/1402746261 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:48.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.816+0000 7f1a0d3b8700 1 --2- 172.21.15.45:0/1402746261 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1a080aad10 0x7f1a080ab190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:48.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.816+0000 7f1a0cbb7700 1 --2- 172.21.15.45:0/1402746261 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f19f80038e0 0x7f1a08146ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:48.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.816+0000 7f1a07fff700 1 -- 172.21.15.45:0/1402746261 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1a080aad10 msgr2=0x7f1a080ab190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:48.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.816+0000 7f1a07fff700 1 --2- 172.21.15.45:0/1402746261 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1a080aad10 0x7f1a080ab190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:48.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.816+0000 7f1a07fff700 1 -- 172.21.15.45:0/1402746261 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f19f80038e0 msgr2=0x7f1a08146ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:48.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.816+0000 7f1a07fff700 1 --2- 172.21.15.45:0/1402746261 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f19f80038e0 0x7f1a08146ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:48.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.816+0000 7f1a07fff700 1 -- 172.21.15.45:0/1402746261 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a08146fa0 con 0x7f1a080c18c0 2023-12-22T10:01:48.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.816+0000 7f1a0cbb7700 1 --2- 172.21.15.45:0/1402746261 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f19f80038e0 0x7f1a08146ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T10:01:48.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.816+0000 7f1a07fff700 1 --2- 172.21.15.45:0/1402746261 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a080c18c0 0x7f1a080c1d20 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7f19f40119c0 tx=0x7f19f4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:48.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.816+0000 7f1a04ff9700 1 -- 172.21.15.45:0/1402746261 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f400f6d0 con 0x7f1a080c18c0 2023-12-22T10:01:48.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.816+0000 7f1a04ff9700 1 -- 172.21.15.45:0/1402746261 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19f400f830 con 0x7f1a080c18c0 2023-12-22T10:01:48.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.816+0000 7f1a0dbb9700 1 -- 172.21.15.45:0/1402746261 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a080ae820 con 0x7f1a080c18c0 2023-12-22T10:01:48.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.816+0000 7f1a04ff9700 1 -- 172.21.15.45:0/1402746261 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f400fbf0 con 0x7f1a080c18c0 2023-12-22T10:01:48.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.816+0000 7f1a0dbb9700 1 -- 172.21.15.45:0/1402746261 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a080aede0 con 0x7f1a080c18c0 2023-12-22T10:01:48.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.820+0000 7f1a0dbb9700 1 -- 172.21.15.45:0/1402746261 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a080ae680 con 0x7f1a080c18c0 2023-12-22T10:01:48.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.820+0000 7f1a04ff9700 1 -- 172.21.15.45:0/1402746261 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f19f4015480 con 0x7f1a080c18c0 2023-12-22T10:01:48.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.820+0000 7f1a04ff9700 1 --2- 172.21.15.45:0/1402746261 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f19ec05a510 0x7f19ec05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:48.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.820+0000 7f1a04ff9700 1 -- 172.21.15.45:0/1402746261 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f19f40752c0 con 0x7f1a080c18c0 2023-12-22T10:01:48.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.820+0000 7f1a0cbb7700 1 --2- 172.21.15.45:0/1402746261 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f19ec05a510 0x7f19ec05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:48.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.824+0000 7f1a0cbb7700 1 --2- 172.21.15.45:0/1402746261 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f19ec05a510 0x7f19ec05c9d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7f19fc006d50 tx=0x7f19fc01a000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:48.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.828+0000 7f1a04ff9700 1 -- 172.21.15.45:0/1402746261 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f1a080ae680 con 0x7f1a080c18c0 2023-12-22T10:01:48.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:48.996+0000 7f1a0dbb9700 1 -- 172.21.15.45:0/1402746261 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "recovery_fs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f1a080ae680 con 0x7f1a080c18c0 2023-12-22T10:01:49.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.128+0000 7f1a04ff9700 1 -- 172.21.15.45:0/1402746261 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "recovery_fs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'recovery_fs_metadata' created v42) v1 ==== 162+0+0 (secure 0 0 0) 0x7f1a080ae680 con 0x7f1a080c18c0 2023-12-22T10:01:49.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.136+0000 7f1a0dbb9700 1 -- 172.21.15.45:0/1402746261 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f19ec05a510 msgr2=0x7f19ec05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:49.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.136+0000 7f1a0dbb9700 1 --2- 172.21.15.45:0/1402746261 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f19ec05a510 0x7f19ec05c9d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7f19fc006d50 tx=0x7f19fc01a000).stop 2023-12-22T10:01:49.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.136+0000 7f1a0dbb9700 1 -- 172.21.15.45:0/1402746261 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a080c18c0 msgr2=0x7f1a080c1d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:49.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.136+0000 7f1a0dbb9700 1 --2- 172.21.15.45:0/1402746261 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a080c18c0 0x7f1a080c1d20 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7f19f40119c0 tx=0x7f19f4008040).stop 2023-12-22T10:01:49.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.136+0000 7f1a0dbb9700 1 -- 172.21.15.45:0/1402746261 shutdown_connections 2023-12-22T10:01:49.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.136+0000 7f1a0dbb9700 1 --2- 172.21.15.45:0/1402746261 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f19ec05a510 0x7f19ec05c9d0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:49.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.136+0000 7f1a0dbb9700 1 --2- 172.21.15.45:0/1402746261 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1a080aad10 0x7f1a080ab190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:49.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.136+0000 7f1a0dbb9700 1 --2- 172.21.15.45:0/1402746261 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a080c18c0 0x7f1a080c1d20 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:49.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.136+0000 7f1a0dbb9700 1 --2- 172.21.15.45:0/1402746261 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f19f80038e0 0x7f1a08146ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:49.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.136+0000 7f1a0dbb9700 1 -- 172.21.15.45:0/1402746261 >> 172.21.15.45:0/1402746261 conn(0x7f1a080674f0 msgr2=0x7f1a08153320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:49.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.136+0000 7f1a0dbb9700 1 -- 172.21.15.45:0/1402746261 shutdown_connections 2023-12-22T10:01:49.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.136+0000 7f1a0dbb9700 1 -- 172.21.15.45:0/1402746261 wait complete. 2023-12-22T10:01:49.145 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'recovery_fs_metadata' created 2023-12-22T10:01:49.158 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-22T10:01:49.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.340+0000 7ff10025b700 1 Processor -- start 2023-12-22T10:01:49.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.340+0000 7ff10025b700 1 -- start start 2023-12-22T10:01:49.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.344+0000 7ff10025b700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ff0f80c5900 0x7ff0f80ac6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:49.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.344+0000 7ff10025b700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0f80c8d50 con 0x7ff0f80aa660 2023-12-22T10:01:49.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.344+0000 7ff10025b700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0f80c95f0 con 0x7ff0f80ac2d0 2023-12-22T10:01:49.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.344+0000 7ff10025b700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f80aaaf0 con 0x7ff0f80c5900 2023-12-22T10:01:49.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.344+0000 7ff0fdff7700 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7ff0f80ac2d0 0x7ff0f8158050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.45:60650/0 (socket says 172.21.15.45:60650) 2023-12-22T10:01:49.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.344+0000 7ff0fe7f8700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7ff0f80aa660 0x7ff0f80c7430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:45018/0 (socket says 172.21.15.45:45018) 2023-12-22T10:01:49.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.344+0000 7ff0fd7f6700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ff0f80c5900 0x7ff0f80ac6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:49.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.344+0000 7ff0fdff7700 1 -- 172.21.15.45:0/1184129455 learned_addr learned my addr 172.21.15.45:0/1184129455 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:01:49.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.344+0000 7ff0fcff5700 1 -- 172.21.15.45:0/1184129455 <== mon.1 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2514409435 0 0) 0x7ff0f80c95f0 con 0x7ff0f80ac2d0 2023-12-22T10:01:49.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.344+0000 7ff0fcff5700 1 -- 172.21.15.45:0/1184129455 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0e40033f0 con 0x7ff0f80ac2d0 2023-12-22T10:01:49.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.344+0000 7ff0fcff5700 1 -- 172.21.15.45:0/1184129455 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 694860178 0 0) 0x7ff0f80c8d50 con 0x7ff0f80aa660 2023-12-22T10:01:49.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.344+0000 7ff0fcff5700 1 -- 172.21.15.45:0/1184129455 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0f80c95f0 con 0x7ff0f80aa660 2023-12-22T10:01:49.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.344+0000 7ff0fd7f6700 1 -- 172.21.15.45:0/1184129455 >> v1:172.21.15.113:6789/0 conn(0x7ff0f80ac2d0 legacy=0x7ff0f8158050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:49.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.344+0000 7ff0fd7f6700 1 -- 172.21.15.45:0/1184129455 >> v1:172.21.15.45:6789/0 conn(0x7ff0f80aa660 legacy=0x7ff0f80c7430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:49.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.344+0000 7ff0fd7f6700 1 -- 172.21.15.45:0/1184129455 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0f80c5ee0 con 0x7ff0f80c5900 2023-12-22T10:01:49.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.344+0000 7ff0fd7f6700 1 --2- 172.21.15.45:0/1184129455 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ff0f80c5900 0x7ff0f80ac6b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7ff0e8009790 tx=0x7ff0e8009060).ready entity=mon.2 client_cookie=ab63eafb2c231a8c server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:49.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.348+0000 7ff0fcff5700 1 -- 172.21.15.45:0/1184129455 <== mon.2 v2:172.21.15.113:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e800f510 con 0x7ff0f80c5900 2023-12-22T10:01:49.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.348+0000 7ff0fcff5700 1 -- 172.21.15.45:0/1184129455 <== mon.2 v2:172.21.15.113:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0e800f670 con 0x7ff0f80c5900 2023-12-22T10:01:49.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.348+0000 7ff0fcff5700 1 -- 172.21.15.45:0/1184129455 <== mon.2 v2:172.21.15.113:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e800f9f0 con 0x7ff0f80c5900 2023-12-22T10:01:49.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.348+0000 7ff10025b700 1 -- 172.21.15.45:0/1184129455 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ff0f80c5900 msgr2=0x7ff0f80ac6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:49.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.348+0000 7ff10025b700 1 --2- 172.21.15.45:0/1184129455 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ff0f80c5900 0x7ff0f80ac6b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7ff0e8009790 tx=0x7ff0e8009060).stop 2023-12-22T10:01:49.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.348+0000 7ff10025b700 1 -- 172.21.15.45:0/1184129455 shutdown_connections 2023-12-22T10:01:49.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.348+0000 7ff10025b700 1 --2- 172.21.15.45:0/1184129455 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ff0f80c5900 0x7ff0f80ac6b0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:49.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.348+0000 7ff10025b700 1 -- 172.21.15.45:0/1184129455 >> 172.21.15.45:0/1184129455 conn(0x7ff0f8082a50 msgr2=0x7ff0f8066a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:49.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.348+0000 7ff10025b700 1 -- 172.21.15.45:0/1184129455 shutdown_connections 2023-12-22T10:01:49.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.348+0000 7ff10025b700 1 -- 172.21.15.45:0/1184129455 wait complete. 2023-12-22T10:01:49.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.348+0000 7ff10025b700 1 Processor -- start 2023-12-22T10:01:49.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.348+0000 7ff10025b700 1 -- start start 2023-12-22T10:01:49.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.352+0000 7ff10025b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0f80aa660 0x7ff0f8159e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:49.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.352+0000 7ff10025b700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff0f80ac2d0 0x7ff0f80c23f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:49.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.352+0000 7ff10025b700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ff0f80c5900 0x7ff0f81515d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:49.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.352+0000 7ff10025b700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f815a410 con 0x7ff0f80aa660 2023-12-22T10:01:49.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.352+0000 7ff10025b700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f80ada70 con 0x7ff0f80ac2d0 2023-12-22T10:01:49.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.352+0000 7ff10025b700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f80add50 con 0x7ff0f80c5900 2023-12-22T10:01:49.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.352+0000 7ff0fdff7700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0f80aa660 0x7ff0f8159e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:49.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.352+0000 7ff0fdff7700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0f80aa660 0x7ff0f8159e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48228/0 (socket says 172.21.15.45:48228) 2023-12-22T10:01:49.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.352+0000 7ff0fdff7700 1 -- 172.21.15.45:0/1214307943 learned_addr learned my addr 172.21.15.45:0/1214307943 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:49.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.352+0000 7ff0fd7f6700 1 --2- 172.21.15.45:0/1214307943 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff0f80ac2d0 0x7ff0f80c23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:49.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.352+0000 7ff0fe7f8700 1 --2- 172.21.15.45:0/1214307943 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ff0f80c5900 0x7ff0f81515d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:49.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.352+0000 7ff0fdff7700 1 -- 172.21.15.45:0/1214307943 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ff0f80c5900 msgr2=0x7ff0f81515d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:49.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.352+0000 7ff0fdff7700 1 --2- 172.21.15.45:0/1214307943 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ff0f80c5900 0x7ff0f81515d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:49.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.352+0000 7ff0fdff7700 1 -- 172.21.15.45:0/1214307943 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff0f80ac2d0 msgr2=0x7ff0f80c23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:49.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.352+0000 7ff0fdff7700 1 --2- 172.21.15.45:0/1214307943 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff0f80ac2d0 0x7ff0f80c23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:49.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.352+0000 7ff0fdff7700 1 -- 172.21.15.45:0/1214307943 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0e80092a0 con 0x7ff0f80aa660 2023-12-22T10:01:49.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.352+0000 7ff0fdff7700 1 --2- 172.21.15.45:0/1214307943 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0f80aa660 0x7ff0f8159e30 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7ff0f400c560 tx=0x7ff0f4007d20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:49.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.352+0000 7ff0edffb700 1 -- 172.21.15.45:0/1214307943 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f400ce70 con 0x7ff0f80aa660 2023-12-22T10:01:49.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.352+0000 7ff0edffb700 1 -- 172.21.15.45:0/1214307943 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0f40072e0 con 0x7ff0f80aa660 2023-12-22T10:01:49.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.352+0000 7ff0edffb700 1 -- 172.21.15.45:0/1214307943 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f4007660 con 0x7ff0f80aa660 2023-12-22T10:01:49.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.352+0000 7ff10025b700 1 -- 172.21.15.45:0/1214307943 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0f80ae030 con 0x7ff0f80aa660 2023-12-22T10:01:49.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.352+0000 7ff10025b700 1 -- 172.21.15.45:0/1214307943 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0f80c28e0 con 0x7ff0f80aa660 2023-12-22T10:01:49.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.356+0000 7ff10025b700 1 -- 172.21.15.45:0/1214307943 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0f806c070 con 0x7ff0f80aa660 2023-12-22T10:01:49.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.356+0000 7ff0edffb700 1 -- 172.21.15.45:0/1214307943 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7ff0f40059b0 con 0x7ff0f80aa660 2023-12-22T10:01:49.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.360+0000 7ff0edffb700 1 --2- 172.21.15.45:0/1214307943 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7ff0dc05a510 0x7ff0dc05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:49.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.360+0000 7ff0edffb700 1 -- 172.21.15.45:0/1214307943 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6582+0+0 (secure 0 0 0) 0x7ff0f4073fe0 con 0x7ff0f80aa660 2023-12-22T10:01:49.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.360+0000 7ff0fd7f6700 1 --2- 172.21.15.45:0/1214307943 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7ff0dc05a510 0x7ff0dc05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:49.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.360+0000 7ff0fd7f6700 1 --2- 172.21.15.45:0/1214307943 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7ff0dc05a510 0x7ff0dc05c9d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7ff0e8009fd0 tx=0x7ff0e8017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:49.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.368+0000 7ff0edffb700 1 -- 172.21.15.45:0/1214307943 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff0f4047570 con 0x7ff0f80aa660 2023-12-22T10:01:49.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.536+0000 7ff10025b700 1 -- 172.21.15.45:0/1214307943 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7ff0f80cad60 con 0x7ff0f80aa660 2023-12-22T10:01:49.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.536+0000 7ff0edffb700 1 -- 172.21.15.45:0/1214307943 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' already exists v42) v1 ==== 177+0+0 (secure 0 0 0) 0x7ff0f4007e60 con 0x7ff0f80aa660 2023-12-22T10:01:49.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.540+0000 7ff10025b700 1 -- 172.21.15.45:0/1214307943 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7ff0dc05a510 msgr2=0x7ff0dc05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:49.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.540+0000 7ff10025b700 1 --2- 172.21.15.45:0/1214307943 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7ff0dc05a510 0x7ff0dc05c9d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7ff0e8009fd0 tx=0x7ff0e8017000).stop 2023-12-22T10:01:49.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.540+0000 7ff10025b700 1 -- 172.21.15.45:0/1214307943 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0f80aa660 msgr2=0x7ff0f8159e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:49.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.540+0000 7ff10025b700 1 --2- 172.21.15.45:0/1214307943 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0f80aa660 0x7ff0f8159e30 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7ff0f400c560 tx=0x7ff0f4007d20).stop 2023-12-22T10:01:49.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.540+0000 7ff10025b700 1 -- 172.21.15.45:0/1214307943 shutdown_connections 2023-12-22T10:01:49.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.540+0000 7ff10025b700 1 --2- 172.21.15.45:0/1214307943 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7ff0dc05a510 0x7ff0dc05c9d0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:49.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.540+0000 7ff10025b700 1 --2- 172.21.15.45:0/1214307943 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ff0f80c5900 0x7ff0f81515d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:49.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.540+0000 7ff10025b700 1 --2- 172.21.15.45:0/1214307943 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff0f80ac2d0 0x7ff0f80c23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:49.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.540+0000 7ff10025b700 1 --2- 172.21.15.45:0/1214307943 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0f80aa660 0x7ff0f8159e30 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:49.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.540+0000 7ff10025b700 1 -- 172.21.15.45:0/1214307943 >> 172.21.15.45:0/1214307943 conn(0x7ff0f8082a50 msgr2=0x7ff0f80bfa30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:49.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.540+0000 7ff10025b700 1 -- 172.21.15.45:0/1214307943 shutdown_connections 2023-12-22T10:01:49.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.540+0000 7ff10025b700 1 -- 172.21.15.45:0/1214307943 wait complete. 2023-12-22T10:01:49.544 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data' already exists 2023-12-22T10:01:49.562 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new recovery_fs recovery_fs_metadata cephfs_data --recover --allow-dangerous-metadata-overlay 2023-12-22T10:01:49.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.740+0000 7fa58521b700 1 Processor -- start 2023-12-22T10:01:49.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.744+0000 7fa58521b700 1 -- start start 2023-12-22T10:01:49.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.744+0000 7fa58521b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa5800ac880 0x7fa5800c5000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:49.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.744+0000 7fa58521b700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5800c55c0 con 0x7fa580158020 2023-12-22T10:01:49.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.744+0000 7fa58521b700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5800c8c60 con 0x7fa5800ac4a0 2023-12-22T10:01:49.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.744+0000 7fa58521b700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5800c8f40 con 0x7fa5800ac880 2023-12-22T10:01:49.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.744+0000 7fa57f59e700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fa580158020 0x7fa5800c73f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:45028/0 (socket says 172.21.15.45:45028) 2023-12-22T10:01:49.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.744+0000 7fa57f59e700 1 -- 172.21.15.45:0/406191943 learned_addr learned my addr 172.21.15.45:0/406191943 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:01:49.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.744+0000 7fa57e59c700 1 --2- 172.21.15.45:0/406191943 >> v2:172.21.15.45:3300/0 conn(0x7fa5800ac880 0x7fa5800c5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:49.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.744+0000 7fa57dd9b700 1 -- 172.21.15.45:0/406191943 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 98118527 0 0) 0x7fa5800c55c0 con 0x7fa580158020 2023-12-22T10:01:49.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.744+0000 7fa57dd9b700 1 -- 172.21.15.45:0/406191943 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5680033f0 con 0x7fa580158020 2023-12-22T10:01:49.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.744+0000 7fa57e59c700 1 -- 172.21.15.45:0/406191943 >> v1:172.21.15.113:6789/0 conn(0x7fa5800ac4a0 legacy=0x7fa5800aa620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:49.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.744+0000 7fa57dd9b700 1 -- 172.21.15.45:0/406191943 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3598810430 0 0) 0x7fa5680033f0 con 0x7fa580158020 2023-12-22T10:01:49.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.744+0000 7fa57e59c700 1 -- 172.21.15.45:0/406191943 >> v1:172.21.15.45:6789/0 conn(0x7fa580158020 legacy=0x7fa5800c73f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:49.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.744+0000 7fa57e59c700 1 -- 172.21.15.45:0/406191943 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5800c9220 con 0x7fa5800ac880 2023-12-22T10:01:49.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.748+0000 7fa57e59c700 1 --2- 172.21.15.45:0/406191943 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa5800ac880 0x7fa5800c5000 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7fa574009760 tx=0x7fa574009060).ready entity=mon.0 client_cookie=c11aa21c72aa86a8 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:49.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.748+0000 7fa57dd9b700 1 -- 172.21.15.45:0/406191943 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5780017f0 con 0x7fa5800ac880 2023-12-22T10:01:49.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.748+0000 7fa57dd9b700 1 -- 172.21.15.45:0/406191943 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa574011400 con 0x7fa5800ac880 2023-12-22T10:01:49.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.748+0000 7fa57dd9b700 1 -- 172.21.15.45:0/406191943 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa574011780 con 0x7fa5800ac880 2023-12-22T10:01:49.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.748+0000 7fa58521b700 1 -- 172.21.15.45:0/406191943 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa5800ac880 msgr2=0x7fa5800c5000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:49.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.748+0000 7fa58521b700 1 --2- 172.21.15.45:0/406191943 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa5800ac880 0x7fa5800c5000 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7fa574009760 tx=0x7fa574009060).stop 2023-12-22T10:01:49.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.748+0000 7fa58521b700 1 -- 172.21.15.45:0/406191943 shutdown_connections 2023-12-22T10:01:49.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.748+0000 7fa58521b700 1 --2- 172.21.15.45:0/406191943 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa5800ac880 0x7fa5800c5000 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:49.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.748+0000 7fa58521b700 1 -- 172.21.15.45:0/406191943 >> 172.21.15.45:0/406191943 conn(0x7fa580066a70 msgr2=0x7fa580066e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:49.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.748+0000 7fa58521b700 1 -- 172.21.15.45:0/406191943 shutdown_connections 2023-12-22T10:01:49.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.748+0000 7fa58521b700 1 -- 172.21.15.45:0/406191943 wait complete. 2023-12-22T10:01:49.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.752+0000 7fa58521b700 1 Processor -- start 2023-12-22T10:01:49.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.752+0000 7fa58521b700 1 -- start start 2023-12-22T10:01:49.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.752+0000 7fa58521b700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa5800ac4a0 0x7fa580164f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:49.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.752+0000 7fa58521b700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fa5800ac880 0x7fa5800c47e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:49.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.752+0000 7fa58521b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa580158020 0x7fa580151470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:49.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.752+0000 7fa58521b700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5800c45e0 con 0x7fa580158020 2023-12-22T10:01:49.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.752+0000 7fa58521b700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa580164ac0 con 0x7fa5800ac4a0 2023-12-22T10:01:49.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.752+0000 7fa58521b700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5800c4300 con 0x7fa5800ac880 2023-12-22T10:01:49.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.752+0000 7fa57f59e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa580158020 0x7fa580151470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:49.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.752+0000 7fa57f59e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa580158020 0x7fa580151470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48250/0 (socket says 172.21.15.45:48250) 2023-12-22T10:01:49.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.752+0000 7fa57f59e700 1 -- 172.21.15.45:0/826925227 learned_addr learned my addr 172.21.15.45:0/826925227 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:49.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.752+0000 7fa57ed9d700 1 --2- 172.21.15.45:0/826925227 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa5800ac4a0 0x7fa580164f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:49.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.752+0000 7fa57e59c700 1 --2- 172.21.15.45:0/826925227 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fa5800ac880 0x7fa5800c47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:49.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.752+0000 7fa57f59e700 1 -- 172.21.15.45:0/826925227 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fa5800ac880 msgr2=0x7fa5800c47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:49.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.752+0000 7fa57f59e700 1 --2- 172.21.15.45:0/826925227 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fa5800ac880 0x7fa5800c47e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:49.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.752+0000 7fa57f59e700 1 -- 172.21.15.45:0/826925227 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa5800ac4a0 msgr2=0x7fa580164f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:49.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.752+0000 7fa57f59e700 1 --2- 172.21.15.45:0/826925227 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa5800ac4a0 0x7fa580164f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:49.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.752+0000 7fa57f59e700 1 -- 172.21.15.45:0/826925227 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5740092a0 con 0x7fa580158020 2023-12-22T10:01:49.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.752+0000 7fa57f59e700 1 --2- 172.21.15.45:0/826925227 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa580158020 0x7fa580151470 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 rx=0x7fa57800cbc0 tx=0x7fa578001d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:49.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.756+0000 7fa566ffd700 1 -- 172.21.15.45:0/826925227 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa578004c40 con 0x7fa580158020 2023-12-22T10:01:49.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.756+0000 7fa566ffd700 1 -- 172.21.15.45:0/826925227 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa578004da0 con 0x7fa580158020 2023-12-22T10:01:49.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.756+0000 7fa58521b700 1 -- 172.21.15.45:0/826925227 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa580164470 con 0x7fa580158020 2023-12-22T10:01:49.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.756+0000 7fa566ffd700 1 -- 172.21.15.45:0/826925227 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa578007380 con 0x7fa580158020 2023-12-22T10:01:49.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.756+0000 7fa58521b700 1 -- 172.21.15.45:0/826925227 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5800c4cd0 con 0x7fa580158020 2023-12-22T10:01:49.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.756+0000 7fa58521b700 1 -- 172.21.15.45:0/826925227 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5801642d0 con 0x7fa580158020 2023-12-22T10:01:49.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.756+0000 7fa566ffd700 1 -- 172.21.15.45:0/826925227 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fa578007770 con 0x7fa580158020 2023-12-22T10:01:49.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.760+0000 7fa566ffd700 1 --2- 172.21.15.45:0/826925227 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fa56c05a510 0x7fa56c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:49.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.760+0000 7fa566ffd700 1 -- 172.21.15.45:0/826925227 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fa578074910 con 0x7fa580158020 2023-12-22T10:01:49.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.760+0000 7fa57ed9d700 1 --2- 172.21.15.45:0/826925227 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fa56c05a510 0x7fa56c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:49.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.760+0000 7fa57ed9d700 1 --2- 172.21.15.45:0/826925227 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fa56c05a510 0x7fa56c05c9d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7fa580167800 tx=0x7fa570009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:49.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.764+0000 7fa566ffd700 1 -- 172.21.15.45:0/826925227 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fa5801642d0 con 0x7fa580158020 2023-12-22T10:01:49.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.968+0000 7fa58521b700 1 -- 172.21.15.45:0/826925227 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "recovery_fs", "metadata": "recovery_fs_metadata", "data": "cephfs_data", "recover": true, "allow_dangerous_metadata_overlay": true} v 0) v1 -- 0x7fa5801642d0 con 0x7fa580158020 2023-12-22T10:01:49.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.980+0000 7fa566ffd700 1 -- 172.21.15.45:0/826925227 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "recovery_fs", "metadata": "recovery_fs_metadata", "data": "cephfs_data", "recover": true, "allow_dangerous_metadata_overlay": true}]=0 new fs with metadata pool 7 and data pool 6 v19) v1 ==== 241+0+0 (secure 0 0 0) 0x7fa5801642d0 con 0x7fa580158020 2023-12-22T10:01:49.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.984+0000 7fa58521b700 1 -- 172.21.15.45:0/826925227 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fa56c05a510 msgr2=0x7fa56c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:49.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.984+0000 7fa58521b700 1 --2- 172.21.15.45:0/826925227 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fa56c05a510 0x7fa56c05c9d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7fa580167800 tx=0x7fa570009040).stop 2023-12-22T10:01:49.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.984+0000 7fa58521b700 1 -- 172.21.15.45:0/826925227 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa580158020 msgr2=0x7fa580151470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:49.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.984+0000 7fa58521b700 1 --2- 172.21.15.45:0/826925227 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa580158020 0x7fa580151470 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 rx=0x7fa57800cbc0 tx=0x7fa578001d80).stop 2023-12-22T10:01:49.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.992+0000 7fa58521b700 1 -- 172.21.15.45:0/826925227 shutdown_connections 2023-12-22T10:01:49.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.992+0000 7fa58521b700 1 --2- 172.21.15.45:0/826925227 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa580158020 0x7fa580151470 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:49.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.992+0000 7fa58521b700 1 --2- 172.21.15.45:0/826925227 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fa56c05a510 0x7fa56c05c9d0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:49.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.992+0000 7fa58521b700 1 --2- 172.21.15.45:0/826925227 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fa5800ac880 0x7fa5800c47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:49.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.992+0000 7fa58521b700 1 --2- 172.21.15.45:0/826925227 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fa5800ac4a0 0x7fa580164f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:49.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.992+0000 7fa58521b700 1 -- 172.21.15.45:0/826925227 >> 172.21.15.45:0/826925227 conn(0x7fa580066a70 msgr2=0x7fa5800c0650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:49.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.992+0000 7fa58521b700 1 -- 172.21.15.45:0/826925227 shutdown_connections 2023-12-22T10:01:49.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:49.992+0000 7fa58521b700 1 -- 172.21.15.45:0/826925227 wait complete. 2023-12-22T10:01:50.001 INFO:teuthology.orchestra.run.smithi045.stderr:new fs with metadata pool 7 and data pool 6 2023-12-22T10:01:50.021 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T10:01:50.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.180+0000 7f4b78f07700 1 Processor -- start 2023-12-22T10:01:50.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.180+0000 7f4b78f07700 1 -- start start 2023-12-22T10:01:50.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.184+0000 7f4b78f07700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f4b740a9ed0 0x7f4b740c1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:50.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.184+0000 7f4b78f07700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4b740bf910 0x7f4b740bfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:50.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.184+0000 7f4b78f07700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b740c0f70 con 0x7f4b740c5960 2023-12-22T10:01:50.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.184+0000 7f4b78f07700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b740aa2b0 con 0x7f4b740bf910 2023-12-22T10:01:50.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.184+0000 7f4b78f07700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b740c0360 con 0x7f4b740a9ed0 2023-12-22T10:01:50.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.184+0000 7f4b72ffd700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4b740bf910 0x7f4b740bfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:50.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.184+0000 7f4b737fe700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f4b740a9ed0 0x7f4b740c1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:50.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.184+0000 7f4b72ffd700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4b740bf910 0x7f4b740bfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48258/0 (socket says 172.21.15.45:48258) 2023-12-22T10:01:50.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.184+0000 7f4b72ffd700 1 -- 172.21.15.45:0/1001933077 learned_addr learned my addr 172.21.15.45:0/1001933077 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:50.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.184+0000 7f4b73fff700 1 --1- 172.21.15.45:0/1001933077 >> v1:172.21.15.113:6789/0 conn(0x7f4b740c5960 0x7f4b740c5dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.45:60664/0 (socket says 172.21.15.45:60664) 2023-12-22T10:01:50.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.184+0000 7f4b737fe700 1 -- 172.21.15.45:0/1001933077 >> v2:172.21.15.45:3300/0 conn(0x7f4b740bf910 msgr2=0x7f4b740bfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:50.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.184+0000 7f4b737fe700 1 --2- 172.21.15.45:0/1001933077 >> v2:172.21.15.45:3300/0 conn(0x7f4b740bf910 0x7f4b740bfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:50.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.184+0000 7f4b737fe700 1 -- 172.21.15.45:0/1001933077 >> v1:172.21.15.113:6789/0 conn(0x7f4b740c5960 legacy=0x7f4b740c5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:50.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.184+0000 7f4b727fc700 1 -- 172.21.15.45:0/1001933077 <== mon.1 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 90704475 0 0) 0x7f4b740c0f70 con 0x7f4b740c5960 2023-12-22T10:01:50.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.184+0000 7f4b737fe700 1 -- 172.21.15.45:0/1001933077 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b740c0640 con 0x7f4b740a9ed0 2023-12-22T10:01:50.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.184+0000 7f4b737fe700 1 --2- 172.21.15.45:0/1001933077 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4b740a9ed0 0x7f4b740c1400 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f4b74046db0 tx=0x7f4b64009060).ready entity=mon.1 client_cookie=e84aaee05d16ed28 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:50.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.188+0000 7f4b727fc700 1 -- 172.21.15.45:0/1001933077 <== mon.1 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b6400f510 con 0x7f4b740a9ed0 2023-12-22T10:01:50.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.188+0000 7f4b727fc700 1 -- 172.21.15.45:0/1001933077 <== mon.1 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b6400f670 con 0x7f4b740a9ed0 2023-12-22T10:01:50.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.188+0000 7f4b727fc700 1 -- 172.21.15.45:0/1001933077 <== mon.1 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b6400f9f0 con 0x7f4b740a9ed0 2023-12-22T10:01:50.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.188+0000 7f4b78f07700 1 -- 172.21.15.45:0/1001933077 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4b740a9ed0 msgr2=0x7f4b740c1400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:50.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.188+0000 7f4b78f07700 1 --2- 172.21.15.45:0/1001933077 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4b740a9ed0 0x7f4b740c1400 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f4b74046db0 tx=0x7f4b64009060).stop 2023-12-22T10:01:50.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.188+0000 7f4b78f07700 1 -- 172.21.15.45:0/1001933077 shutdown_connections 2023-12-22T10:01:50.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.188+0000 7f4b78f07700 1 --2- 172.21.15.45:0/1001933077 >> v2:172.21.15.45:3300/0 conn(0x7f4b740bf910 0x7f4b740bfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:50.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.188+0000 7f4b78f07700 1 --2- 172.21.15.45:0/1001933077 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4b740a9ed0 0x7f4b740c1400 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:50.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.188+0000 7f4b78f07700 1 -- 172.21.15.45:0/1001933077 >> 172.21.15.45:0/1001933077 conn(0x7f4b74067500 msgr2=0x7f4b740ca9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:50.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.188+0000 7f4b78f07700 1 -- 172.21.15.45:0/1001933077 shutdown_connections 2023-12-22T10:01:50.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.188+0000 7f4b78f07700 1 -- 172.21.15.45:0/1001933077 wait complete. 2023-12-22T10:01:50.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.188+0000 7f4b78f07700 1 Processor -- start 2023-12-22T10:01:50.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.192+0000 7f4b78f07700 1 -- start start 2023-12-22T10:01:50.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.192+0000 7f4b78f07700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f4b740a9ed0 0x7f4b740ae320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:50.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.192+0000 7f4b78f07700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4b740bf910 0x7f4b7414c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:50.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.192+0000 7f4b78f07700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b740c5960 0x7f4b7414ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:50.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.192+0000 7f4b78f07700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b740c4960 con 0x7f4b740c5960 2023-12-22T10:01:50.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.192+0000 7f4b78f07700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b740af550 con 0x7f4b740bf910 2023-12-22T10:01:50.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.192+0000 7f4b78f07700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b740af830 con 0x7f4b740a9ed0 2023-12-22T10:01:50.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.192+0000 7f4b73fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b740c5960 0x7f4b7414ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:50.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.192+0000 7f4b73fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b740c5960 0x7f4b7414ee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48270/0 (socket says 172.21.15.45:48270) 2023-12-22T10:01:50.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.192+0000 7f4b73fff700 1 -- 172.21.15.45:0/4194541073 learned_addr learned my addr 172.21.15.45:0/4194541073 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:50.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.192+0000 7f4b72ffd700 1 --2- 172.21.15.45:0/4194541073 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4b740bf910 0x7f4b7414c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:50.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.192+0000 7f4b737fe700 1 --2- 172.21.15.45:0/4194541073 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f4b740a9ed0 0x7f4b740ae320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:50.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.192+0000 7f4b73fff700 1 -- 172.21.15.45:0/4194541073 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f4b740a9ed0 msgr2=0x7f4b740ae320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:50.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.192+0000 7f4b73fff700 1 --2- 172.21.15.45:0/4194541073 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f4b740a9ed0 0x7f4b740ae320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:50.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.192+0000 7f4b73fff700 1 -- 172.21.15.45:0/4194541073 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4b740bf910 msgr2=0x7f4b7414c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:50.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.192+0000 7f4b73fff700 1 --2- 172.21.15.45:0/4194541073 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4b740bf910 0x7f4b7414c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:50.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.192+0000 7f4b73fff700 1 -- 172.21.15.45:0/4194541073 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b640092a0 con 0x7f4b740c5960 2023-12-22T10:01:50.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.192+0000 7f4b73fff700 1 --2- 172.21.15.45:0/4194541073 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b740c5960 0x7f4b7414ee70 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7f4b6c00c730 tx=0x7f4b6c001520).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:50.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.192+0000 7f4b5b7fe700 1 -- 172.21.15.45:0/4194541073 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b6c005c70 con 0x7f4b740c5960 2023-12-22T10:01:50.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.192+0000 7f4b5b7fe700 1 -- 172.21.15.45:0/4194541073 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b6c005dd0 con 0x7f4b740c5960 2023-12-22T10:01:50.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.192+0000 7f4b5b7fe700 1 -- 172.21.15.45:0/4194541073 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b6c007300 con 0x7f4b740c5960 2023-12-22T10:01:50.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.192+0000 7f4b78f07700 1 -- 172.21.15.45:0/4194541073 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b740afb10 con 0x7f4b740c5960 2023-12-22T10:01:50.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.192+0000 7f4b78f07700 1 -- 172.21.15.45:0/4194541073 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b740b00d0 con 0x7f4b740c5960 2023-12-22T10:01:50.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.196+0000 7f4b78f07700 1 -- 172.21.15.45:0/4194541073 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b740b02f0 con 0x7f4b740c5960 2023-12-22T10:01:50.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.196+0000 7f4b5b7fe700 1 -- 172.21.15.45:0/4194541073 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f4b6c0076b0 con 0x7f4b740c5960 2023-12-22T10:01:50.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.196+0000 7f4b5b7fe700 1 --2- 172.21.15.45:0/4194541073 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f4b6005a4e0 0x7f4b6005c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:50.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.196+0000 7f4b5b7fe700 1 -- 172.21.15.45:0/4194541073 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6660+0+0 (secure 0 0 0) 0x7f4b6c0742f0 con 0x7f4b740c5960 2023-12-22T10:01:50.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.196+0000 7f4b737fe700 1 --2- 172.21.15.45:0/4194541073 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f4b6005a4e0 0x7f4b6005c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:50.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.200+0000 7f4b737fe700 1 --2- 172.21.15.45:0/4194541073 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f4b6005a4e0 0x7f4b6005c9a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f4b74046db0 tx=0x7f4b64017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:50.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.204+0000 7f4b5b7fe700 1 -- 172.21.15.45:0/4194541073 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f4b6c0478b0 con 0x7f4b740c5960 2023-12-22T10:01:50.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.372+0000 7f4b78f07700 1 -- 172.21.15.45:0/4194541073 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4b740c0920 con 0x7f4b740c5960 2023-12-22T10:01:50.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.376+0000 7f4b5b7fe700 1 -- 172.21.15.45:0/4194541073 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+18699 (secure 0 0 0) 0x7f4b6c04aed0 con 0x7f4b740c5960 2023-12-22T10:01:50.375 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:01:50.375 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":43,"fsid":"98b0837e-5e68-4c8f-a1a0-e9424baaad8f","created":"2023-12-22T10:00:15.010174+0000","modified":"2023-12-22T10:01:49.976130+0000","last_up_change":"2023-12-22T10:00:24.980513+0000","last_in_change":"2023-12-22T10:00:17.887172+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-12-22T10:00:25.069641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-12-22T10:00:26.906399+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-22T10:01:33.592093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-22T10:01:34.130811+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"recovery_fs"}}},{"pool":7,"pool_name":"recovery_fs_metadata","create_time":"2023-12-22T10:01:49.073877+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"recovery_fs"}}}],"osds":[{"osd":0,"uuid":"e19943a0-1c6b-47df-b6bb-383472077890","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":33777},{"type":"v1","addr":"172.21.15.45:6819","nonce":33777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":33777},{"type":"v1","addr":"172.21.15.45:6822","nonce":33777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":33777},{"type":"v1","addr":"172.21.15.45:6830","nonce":33777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":33777},{"type":"v1","addr":"172.21.15.45:6826","nonce":33777}]},"public_addr":"172.21.15.45:6819/33777","cluster_addr":"172.21.15.45:6822/33777","heartbeat_back_addr":"172.21.15.45:6830/33777","heartbeat_front_addr":"172.21.15.45:6826/33777","state":["exists","up"]},{"osd":1,"uuid":"69670f34-f082-45a7-8f67-e962acc136e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":33775},{"type":"v1","addr":"172.21.15.45:6809","nonce":33775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":33775},{"type":"v1","addr":"172.21.15.45:6811","nonce":33775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":33775},{"type":"v1","addr":"172.21.15.45:6815","nonce":33775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":33775},{"type":"v1","addr":"172.21.15.45:6813","nonce":33775}]},"public_addr":"172.21.15.45:6809/33775","cluster_addr":"172.21.15.45:6811/33775","heartbeat_back_addr":"172.21.15.45:6815/33775","heartbeat_front_addr":"172.21.15.45:6813/33775","state":["exists","up"]},{"osd":2,"uuid":"d909d49b-82b8-401b-9947-e49dd167bb95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":33776},{"type":"v1","addr":"172.21.15.45:6801","nonce":33776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":33776},{"type":"v1","addr":"172.21.15.45:6803","nonce":33776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":33776},{"type":"v1","addr":"172.21.15.45:6807","nonce":33776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":33776},{"type":"v1","addr":"172.21.15.45:6805","nonce":33776}]},"public_addr":"172.21.15.45:6801/33776","cluster_addr":"172.21.15.45:6803/33776","heartbeat_back_addr":"172.21.15.45:6807/33776","heartbeat_front_addr":"172.21.15.45:6805/33776","state":["exists","up"]},{"osd":3,"uuid":"db104ca9-3a94-4d39-a2be-bd06db888095","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":33782},{"type":"v1","addr":"172.21.15.45:6817","nonce":33782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":33782},{"type":"v1","addr":"172.21.15.45:6823","nonce":33782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":33782},{"type":"v1","addr":"172.21.15.45:6831","nonce":33782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":33782},{"type":"v1","addr":"172.21.15.45:6827","nonce":33782}]},"public_addr":"172.21.15.45:6817/33782","cluster_addr":"172.21.15.45:6823/33782","heartbeat_back_addr":"172.21.15.45:6831/33782","heartbeat_front_addr":"172.21.15.45:6827/33782","state":["exists","up"]},{"osd":4,"uuid":"9f4eaff4-e433-4479-a0d1-ee7a33375ca6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":34099},{"type":"v1","addr":"172.21.15.113:6811","nonce":34099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":34099},{"type":"v1","addr":"172.21.15.113:6815","nonce":34099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":34099},{"type":"v1","addr":"172.21.15.113:6823","nonce":34099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6816","nonce":34099},{"type":"v1","addr":"172.21.15.113:6818","nonce":34099}]},"public_addr":"172.21.15.113:6811/34099","cluster_addr":"172.21.15.113:6815/34099","heartbeat_back_addr":"172.21.15.113:6823/34099","heartbeat_front_addr":"172.21.15.113:6818/34099","state":["exists","up"]},{"osd":5,"uuid":"1efc5591-180b-43af-8611-0068aadc5aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":34100},{"type":"v1","addr":"172.21.15.113:6801","nonce":34100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":34100},{"type":"v1","addr":"172.21.15.113:6803","nonce":34100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":34100},{"type":"v1","addr":"172.21.15.113:6807","nonce":34100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":34100},{"type":"v1","addr":"172.21.15.113:6805","nonce":34100}]},"public_addr":"172.21.15.113:6801/34100","cluster_addr":"172.21.15.113:6803/34100","heartbeat_back_addr":"172.21.15.113:6807/34100","heartbeat_front_addr":"172.21.15.113:6805/34100","state":["exists","up"]},{"osd":6,"uuid":"6c89d9d8-c153-4a48-afa9-97e4c403f1ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":34101},{"type":"v1","addr":"172.21.15.113:6810","nonce":34101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6812","nonce":34101},{"type":"v1","addr":"172.21.15.113:6814","nonce":34101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6822","nonce":34101},{"type":"v1","addr":"172.21.15.113:6824","nonce":34101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":34101},{"type":"v1","addr":"172.21.15.113:6819","nonce":34101}]},"public_addr":"172.21.15.113:6810/34101","cluster_addr":"172.21.15.113:6814/34101","heartbeat_back_addr":"172.21.15.113:6824/34101","heartbeat_front_addr":"172.21.15.113:6819/34101","state":["exists","up"]},{"osd":7,"uuid":"1855e70c-23f6-4c08-ad7f-774c2148235b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6821","nonce":34102},{"type":"v1","addr":"172.21.15.113:6825","nonce":34102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":34102},{"type":"v1","addr":"172.21.15.113:6827","nonce":34102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":34102},{"type":"v1","addr":"172.21.15.113:6831","nonce":34102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6828","nonce":34102},{"type":"v1","addr":"172.21.15.113:6829","nonce":34102}]},"public_addr":"172.21.15.113:6825/34102","cluster_addr":"172.21.15.113:6827/34102","heartbeat_back_addr":"172.21.15.113:6831/34102","heartbeat_front_addr":"172.21.15.113:6829/34102","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.812672+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.825045+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.700105+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.856563+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.954683+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.883234+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.883994+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.821686+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.45:6835/1879154206":"2023-12-23T10:01:45.243059+0000","172.21.15.45:6834/1879154206":"2023-12-23T10:01:45.243059+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T10:01:50.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.380+0000 7f4b78f07700 1 -- 172.21.15.45:0/4194541073 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f4b6005a4e0 msgr2=0x7f4b6005c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:50.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.380+0000 7f4b78f07700 1 --2- 172.21.15.45:0/4194541073 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f4b6005a4e0 0x7f4b6005c9a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f4b74046db0 tx=0x7f4b64017000).stop 2023-12-22T10:01:50.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.380+0000 7f4b78f07700 1 -- 172.21.15.45:0/4194541073 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b740c5960 msgr2=0x7f4b7414ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:50.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.380+0000 7f4b78f07700 1 --2- 172.21.15.45:0/4194541073 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b740c5960 0x7f4b7414ee70 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7f4b6c00c730 tx=0x7f4b6c001520).stop 2023-12-22T10:01:50.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.380+0000 7f4b78f07700 1 -- 172.21.15.45:0/4194541073 shutdown_connections 2023-12-22T10:01:50.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.380+0000 7f4b78f07700 1 --2- 172.21.15.45:0/4194541073 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b740c5960 0x7f4b7414ee70 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:50.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.380+0000 7f4b78f07700 1 --2- 172.21.15.45:0/4194541073 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4b740bf910 0x7f4b7414c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:50.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.380+0000 7f4b78f07700 1 --2- 172.21.15.45:0/4194541073 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f4b6005a4e0 0x7f4b6005c9a0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:50.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.380+0000 7f4b78f07700 1 --2- 172.21.15.45:0/4194541073 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f4b740a9ed0 0x7f4b740ae320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:50.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.380+0000 7f4b78f07700 1 -- 172.21.15.45:0/4194541073 >> 172.21.15.45:0/4194541073 conn(0x7f4b74067500 msgr2=0x7f4b740ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:50.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.380+0000 7f4b78f07700 1 -- 172.21.15.45:0/4194541073 shutdown_connections 2023-12-22T10:01:50.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.380+0000 7f4b78f07700 1 -- 172.21.15.45:0/4194541073 wait complete. 2023-12-22T10:01:50.404 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T10:01:50.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.564+0000 7f982a0e4700 1 Processor -- start 2023-12-22T10:01:50.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.564+0000 7f982a0e4700 1 -- start start 2023-12-22T10:01:50.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.568+0000 7f982a0e4700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f98240a8eb0 0x7f9824065860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:50.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.568+0000 7f982a0e4700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f982415bb60 0x7f982415c010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:50.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.568+0000 7f982a0e4700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98240c17e0 con 0x7f98240a8ad0 2023-12-22T10:01:50.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.568+0000 7f982a0e4700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f982415c500 con 0x7f98240a8eb0 2023-12-22T10:01:50.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.568+0000 7f982a0e4700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98240c2630 con 0x7f982415bb60 2023-12-22T10:01:50.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.568+0000 7f98290e2700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f98240a8ad0 0x7f98240c10d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:45032/0 (socket says 172.21.15.45:45032) 2023-12-22T10:01:50.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.568+0000 7f98290e2700 1 -- 172.21.15.45:0/2188633174 learned_addr learned my addr 172.21.15.45:0/2188633174 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:01:50.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.568+0000 7f98288e1700 1 --2- 172.21.15.45:0/2188633174 >> v2:172.21.15.45:3300/0 conn(0x7f98240a8eb0 0x7f9824065860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:50.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.568+0000 7f98298e3700 1 --2- 172.21.15.45:0/2188633174 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f982415bb60 0x7f982415c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:50.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.568+0000 7f98288e1700 1 -- 172.21.15.45:0/2188633174 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f982415bb60 msgr2=0x7f982415c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:50.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.568+0000 7f98288e1700 1 --2- 172.21.15.45:0/2188633174 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f982415bb60 0x7f982415c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:50.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.568+0000 7f98288e1700 1 -- 172.21.15.45:0/2188633174 >> v1:172.21.15.45:6789/0 conn(0x7f98240a8ad0 legacy=0x7f98240c10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:50.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.568+0000 7f98288e1700 1 -- 172.21.15.45:0/2188633174 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98241584c0 con 0x7f98240a8eb0 2023-12-22T10:01:50.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.568+0000 7f981bfff700 1 -- 172.21.15.45:0/2188633174 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4045764664 0 0) 0x7f9820001490 con 0x7f98240a8ad0 2023-12-22T10:01:50.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.568+0000 7f98298e3700 1 --2- 172.21.15.45:0/2188633174 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f982415bb60 0x7f982415c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T10:01:50.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.568+0000 7f98288e1700 1 --2- 172.21.15.45:0/2188633174 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98240a8eb0 0x7f9824065860 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7f9814009760 tx=0x7f9814009060).ready entity=mon.0 client_cookie=2a9e6113dd75facc server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:50.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.568+0000 7f981bfff700 1 -- 172.21.15.45:0/2188633174 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981400b580 con 0x7f98240a8eb0 2023-12-22T10:01:50.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.572+0000 7f981bfff700 1 -- 172.21.15.45:0/2188633174 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f981400b6e0 con 0x7f98240a8eb0 2023-12-22T10:01:50.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.572+0000 7f981bfff700 1 -- 172.21.15.45:0/2188633174 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981400ba60 con 0x7f98240a8eb0 2023-12-22T10:01:50.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.572+0000 7f982a0e4700 1 -- 172.21.15.45:0/2188633174 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98240a8eb0 msgr2=0x7f9824065860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:50.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.572+0000 7f982a0e4700 1 --2- 172.21.15.45:0/2188633174 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98240a8eb0 0x7f9824065860 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7f9814009760 tx=0x7f9814009060).stop 2023-12-22T10:01:50.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.572+0000 7f982a0e4700 1 -- 172.21.15.45:0/2188633174 shutdown_connections 2023-12-22T10:01:50.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.572+0000 7f982a0e4700 1 --2- 172.21.15.45:0/2188633174 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f982415bb60 0x7f982415c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:50.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.572+0000 7f982a0e4700 1 --2- 172.21.15.45:0/2188633174 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98240a8eb0 0x7f9824065860 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:50.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.572+0000 7f982a0e4700 1 -- 172.21.15.45:0/2188633174 >> 172.21.15.45:0/2188633174 conn(0x7f9824067540 msgr2=0x7f98240c6460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:50.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.572+0000 7f982a0e4700 1 -- 172.21.15.45:0/2188633174 shutdown_connections 2023-12-22T10:01:50.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.572+0000 7f982a0e4700 1 -- 172.21.15.45:0/2188633174 wait complete. 2023-12-22T10:01:50.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.572+0000 7f982a0e4700 1 Processor -- start 2023-12-22T10:01:50.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.572+0000 7f982a0e4700 1 -- start start 2023-12-22T10:01:50.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.576+0000 7f982a0e4700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98240a8ad0 0x7f9824064750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:50.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.576+0000 7f982a0e4700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f982415bb60 0x7f9824159c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:50.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.576+0000 7f982a0e4700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f9824064c40 0x7f982415a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:50.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.576+0000 7f982a0e4700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f982414fe70 con 0x7f98240a8ad0 2023-12-22T10:01:50.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.576+0000 7f982a0e4700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f982415b560 con 0x7f982415bb60 2023-12-22T10:01:50.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.576+0000 7f982a0e4700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f982415a9e0 con 0x7f9824064c40 2023-12-22T10:01:50.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.576+0000 7f98290e2700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98240a8ad0 0x7f9824064750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:50.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.576+0000 7f98290e2700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98240a8ad0 0x7f9824064750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48292/0 (socket says 172.21.15.45:48292) 2023-12-22T10:01:50.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.576+0000 7f98290e2700 1 -- 172.21.15.45:0/205723734 learned_addr learned my addr 172.21.15.45:0/205723734 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:50.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.576+0000 7f98288e1700 1 --2- 172.21.15.45:0/205723734 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f982415bb60 0x7f9824159c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:50.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.576+0000 7f98298e3700 1 --2- 172.21.15.45:0/205723734 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f9824064c40 0x7f982415a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:50.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.576+0000 7f98290e2700 1 -- 172.21.15.45:0/205723734 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f9824064c40 msgr2=0x7f982415a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:50.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.576+0000 7f98290e2700 1 --2- 172.21.15.45:0/205723734 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f9824064c40 0x7f982415a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:50.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.576+0000 7f98290e2700 1 -- 172.21.15.45:0/205723734 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f982415bb60 msgr2=0x7f9824159c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:50.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.576+0000 7f98290e2700 1 --2- 172.21.15.45:0/205723734 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f982415bb60 0x7f9824159c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:50.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.576+0000 7f98290e2700 1 -- 172.21.15.45:0/205723734 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98140092a0 con 0x7f98240a8ad0 2023-12-22T10:01:50.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.576+0000 7f98298e3700 1 --2- 172.21.15.45:0/205723734 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f9824064c40 0x7f982415a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-12-22T10:01:50.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.576+0000 7f98290e2700 1 --2- 172.21.15.45:0/205723734 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98240a8ad0 0x7f9824064750 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7f982000c880 tx=0x7f9820007e50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:50.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.576+0000 7f98197fa700 1 -- 172.21.15.45:0/205723734 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9820005d30 con 0x7f98240a8ad0 2023-12-22T10:01:50.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.576+0000 7f98197fa700 1 -- 172.21.15.45:0/205723734 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9820005e90 con 0x7f98240a8ad0 2023-12-22T10:01:50.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.576+0000 7f982a0e4700 1 -- 172.21.15.45:0/205723734 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f982415acc0 con 0x7f98240a8ad0 2023-12-22T10:01:50.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.576+0000 7f98197fa700 1 -- 172.21.15.45:0/205723734 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9820007320 con 0x7f98240a8ad0 2023-12-22T10:01:50.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.576+0000 7f982a0e4700 1 -- 172.21.15.45:0/205723734 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f982415b280 con 0x7f98240a8ad0 2023-12-22T10:01:50.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.580+0000 7f982a0e4700 1 -- 172.21.15.45:0/205723734 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9824047060 con 0x7f98240a8ad0 2023-12-22T10:01:50.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.580+0000 7f98197fa700 1 -- 172.21.15.45:0/205723734 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f98200076d0 con 0x7f98240a8ad0 2023-12-22T10:01:50.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.584+0000 7f98197fa700 1 --2- 172.21.15.45:0/205723734 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f980805a4e0 0x7f980805c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:50.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.584+0000 7f98197fa700 1 -- 172.21.15.45:0/205723734 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6660+0+0 (secure 0 0 0) 0x7f9820074a50 con 0x7f98240a8ad0 2023-12-22T10:01:50.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.584+0000 7f98288e1700 1 --2- 172.21.15.45:0/205723734 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f980805a4e0 0x7f980805c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:50.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.584+0000 7f98288e1700 1 --2- 172.21.15.45:0/205723734 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f980805a4e0 0x7f980805c9a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f9814009760 tx=0x7f9814017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:50.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.588+0000 7f98197fa700 1 -- 172.21.15.45:0/205723734 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f9820047f50 con 0x7f98240a8ad0 2023-12-22T10:01:50.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.764+0000 7f982a0e4700 1 -- 172.21.15.45:0/205723734 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f98240c17e0 con 0x7f98240a8ad0 2023-12-22T10:01:50.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.764+0000 7f98197fa700 1 -- 172.21.15.45:0/205723734 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+18699 (secure 0 0 0) 0x7f98240c17e0 con 0x7f98240a8ad0 2023-12-22T10:01:50.765 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:01:50.765 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":43,"fsid":"98b0837e-5e68-4c8f-a1a0-e9424baaad8f","created":"2023-12-22T10:00:15.010174+0000","modified":"2023-12-22T10:01:49.976130+0000","last_up_change":"2023-12-22T10:00:24.980513+0000","last_in_change":"2023-12-22T10:00:17.887172+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-12-22T10:00:25.069641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-12-22T10:00:26.906399+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-22T10:01:33.592093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-22T10:01:34.130811+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"recovery_fs"}}},{"pool":7,"pool_name":"recovery_fs_metadata","create_time":"2023-12-22T10:01:49.073877+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"recovery_fs"}}}],"osds":[{"osd":0,"uuid":"e19943a0-1c6b-47df-b6bb-383472077890","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":33777},{"type":"v1","addr":"172.21.15.45:6819","nonce":33777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":33777},{"type":"v1","addr":"172.21.15.45:6822","nonce":33777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":33777},{"type":"v1","addr":"172.21.15.45:6830","nonce":33777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":33777},{"type":"v1","addr":"172.21.15.45:6826","nonce":33777}]},"public_addr":"172.21.15.45:6819/33777","cluster_addr":"172.21.15.45:6822/33777","heartbeat_back_addr":"172.21.15.45:6830/33777","heartbeat_front_addr":"172.21.15.45:6826/33777","state":["exists","up"]},{"osd":1,"uuid":"69670f34-f082-45a7-8f67-e962acc136e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":33775},{"type":"v1","addr":"172.21.15.45:6809","nonce":33775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":33775},{"type":"v1","addr":"172.21.15.45:6811","nonce":33775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":33775},{"type":"v1","addr":"172.21.15.45:6815","nonce":33775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":33775},{"type":"v1","addr":"172.21.15.45:6813","nonce":33775}]},"public_addr":"172.21.15.45:6809/33775","cluster_addr":"172.21.15.45:6811/33775","heartbeat_back_addr":"172.21.15.45:6815/33775","heartbeat_front_addr":"172.21.15.45:6813/33775","state":["exists","up"]},{"osd":2,"uuid":"d909d49b-82b8-401b-9947-e49dd167bb95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":33776},{"type":"v1","addr":"172.21.15.45:6801","nonce":33776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":33776},{"type":"v1","addr":"172.21.15.45:6803","nonce":33776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":33776},{"type":"v1","addr":"172.21.15.45:6807","nonce":33776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":33776},{"type":"v1","addr":"172.21.15.45:6805","nonce":33776}]},"public_addr":"172.21.15.45:6801/33776","cluster_addr":"172.21.15.45:6803/33776","heartbeat_back_addr":"172.21.15.45:6807/33776","heartbeat_front_addr":"172.21.15.45:6805/33776","state":["exists","up"]},{"osd":3,"uuid":"db104ca9-3a94-4d39-a2be-bd06db888095","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":33782},{"type":"v1","addr":"172.21.15.45:6817","nonce":33782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":33782},{"type":"v1","addr":"172.21.15.45:6823","nonce":33782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":33782},{"type":"v1","addr":"172.21.15.45:6831","nonce":33782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":33782},{"type":"v1","addr":"172.21.15.45:6827","nonce":33782}]},"public_addr":"172.21.15.45:6817/33782","cluster_addr":"172.21.15.45:6823/33782","heartbeat_back_addr":"172.21.15.45:6831/33782","heartbeat_front_addr":"172.21.15.45:6827/33782","state":["exists","up"]},{"osd":4,"uuid":"9f4eaff4-e433-4479-a0d1-ee7a33375ca6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":34099},{"type":"v1","addr":"172.21.15.113:6811","nonce":34099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":34099},{"type":"v1","addr":"172.21.15.113:6815","nonce":34099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":34099},{"type":"v1","addr":"172.21.15.113:6823","nonce":34099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6816","nonce":34099},{"type":"v1","addr":"172.21.15.113:6818","nonce":34099}]},"public_addr":"172.21.15.113:6811/34099","cluster_addr":"172.21.15.113:6815/34099","heartbeat_back_addr":"172.21.15.113:6823/34099","heartbeat_front_addr":"172.21.15.113:6818/34099","state":["exists","up"]},{"osd":5,"uuid":"1efc5591-180b-43af-8611-0068aadc5aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":34100},{"type":"v1","addr":"172.21.15.113:6801","nonce":34100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":34100},{"type":"v1","addr":"172.21.15.113:6803","nonce":34100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":34100},{"type":"v1","addr":"172.21.15.113:6807","nonce":34100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":34100},{"type":"v1","addr":"172.21.15.113:6805","nonce":34100}]},"public_addr":"172.21.15.113:6801/34100","cluster_addr":"172.21.15.113:6803/34100","heartbeat_back_addr":"172.21.15.113:6807/34100","heartbeat_front_addr":"172.21.15.113:6805/34100","state":["exists","up"]},{"osd":6,"uuid":"6c89d9d8-c153-4a48-afa9-97e4c403f1ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":34101},{"type":"v1","addr":"172.21.15.113:6810","nonce":34101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6812","nonce":34101},{"type":"v1","addr":"172.21.15.113:6814","nonce":34101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6822","nonce":34101},{"type":"v1","addr":"172.21.15.113:6824","nonce":34101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":34101},{"type":"v1","addr":"172.21.15.113:6819","nonce":34101}]},"public_addr":"172.21.15.113:6810/34101","cluster_addr":"172.21.15.113:6814/34101","heartbeat_back_addr":"172.21.15.113:6824/34101","heartbeat_front_addr":"172.21.15.113:6819/34101","state":["exists","up"]},{"osd":7,"uuid":"1855e70c-23f6-4c08-ad7f-774c2148235b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6821","nonce":34102},{"type":"v1","addr":"172.21.15.113:6825","nonce":34102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":34102},{"type":"v1","addr":"172.21.15.113:6827","nonce":34102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":34102},{"type":"v1","addr":"172.21.15.113:6831","nonce":34102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6828","nonce":34102},{"type":"v1","addr":"172.21.15.113:6829","nonce":34102}]},"public_addr":"172.21.15.113:6825/34102","cluster_addr":"172.21.15.113:6827/34102","heartbeat_back_addr":"172.21.15.113:6831/34102","heartbeat_front_addr":"172.21.15.113:6829/34102","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.812672+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.825045+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.700105+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.856563+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.954683+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.883234+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.883994+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.821686+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.45:6835/1879154206":"2023-12-23T10:01:45.243059+0000","172.21.15.45:6834/1879154206":"2023-12-23T10:01:45.243059+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T10:01:50.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.768+0000 7f982a0e4700 1 -- 172.21.15.45:0/205723734 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f980805a4e0 msgr2=0x7f980805c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:50.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.768+0000 7f982a0e4700 1 --2- 172.21.15.45:0/205723734 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f980805a4e0 0x7f980805c9a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f9814009760 tx=0x7f9814017000).stop 2023-12-22T10:01:50.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.768+0000 7f982a0e4700 1 -- 172.21.15.45:0/205723734 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98240a8ad0 msgr2=0x7f9824064750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:50.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.768+0000 7f982a0e4700 1 --2- 172.21.15.45:0/205723734 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98240a8ad0 0x7f9824064750 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7f982000c880 tx=0x7f9820007e50).stop 2023-12-22T10:01:50.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.768+0000 7f982a0e4700 1 -- 172.21.15.45:0/205723734 shutdown_connections 2023-12-22T10:01:50.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.768+0000 7f982a0e4700 1 --2- 172.21.15.45:0/205723734 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f980805a4e0 0x7f980805c9a0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:50.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.768+0000 7f982a0e4700 1 --2- 172.21.15.45:0/205723734 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f9824064c40 0x7f982415a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:50.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.768+0000 7f982a0e4700 1 --2- 172.21.15.45:0/205723734 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f982415bb60 0x7f9824159c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:50.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.768+0000 7f982a0e4700 1 --2- 172.21.15.45:0/205723734 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98240a8ad0 0x7f9824064750 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:50.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.768+0000 7f982a0e4700 1 -- 172.21.15.45:0/205723734 >> 172.21.15.45:0/205723734 conn(0x7f9824067540 msgr2=0x7f9824069a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:50.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.768+0000 7f982a0e4700 1 -- 172.21.15.45:0/205723734 shutdown_connections 2023-12-22T10:01:50.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.768+0000 7f982a0e4700 1 -- 172.21.15.45:0/205723734 wait complete. 2023-12-22T10:01:50.787 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set recovery_fs standby_count_wanted 0 2023-12-22T10:01:50.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.956+0000 7fd91dbb9700 1 Processor -- start 2023-12-22T10:01:50.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.956+0000 7fd91dbb9700 1 -- start start 2023-12-22T10:01:50.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.960+0000 7fd91dbb9700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd9180c9d20 0x7fd9180ad080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:50.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.960+0000 7fd91dbb9700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9180c5810 con 0x7fd9180acca0 2023-12-22T10:01:50.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.960+0000 7fd91dbb9700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9180c8d90 con 0x7fd9180691c0 2023-12-22T10:01:50.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.960+0000 7fd91dbb9700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9180c9350 con 0x7fd9180c9d20 2023-12-22T10:01:50.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.960+0000 7fd91cbb7700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fd9180acca0 0x7fd918068ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:45034/0 (socket says 172.21.15.45:45034) 2023-12-22T10:01:50.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.960+0000 7fd91cbb7700 1 -- 172.21.15.45:0/3875562361 learned_addr learned my addr 172.21.15.45:0/3875562361 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:01:50.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.960+0000 7fd91d3b8700 1 --2- 172.21.15.45:0/3875562361 >> v2:172.21.15.45:3300/0 conn(0x7fd9180c9d20 0x7fd9180ad080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:50.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.960+0000 7fd9177fe700 1 -- 172.21.15.45:0/3875562361 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4270056527 0 0) 0x7fd9180c5810 con 0x7fd9180acca0 2023-12-22T10:01:50.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.960+0000 7fd9177fe700 1 -- 172.21.15.45:0/3875562361 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9080033f0 con 0x7fd9180acca0 2023-12-22T10:01:50.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.960+0000 7fd9177fe700 1 -- 172.21.15.45:0/3875562361 <== mon.1 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3775999913 0 0) 0x7fd9180c8d90 con 0x7fd9180691c0 2023-12-22T10:01:50.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.960+0000 7fd91d3b8700 1 -- 172.21.15.45:0/3875562361 >> v1:172.21.15.113:6789/0 conn(0x7fd9180691c0 legacy=0x7fd9180aa5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:50.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.960+0000 7fd91d3b8700 1 -- 172.21.15.45:0/3875562361 >> v1:172.21.15.45:6789/0 conn(0x7fd9180acca0 legacy=0x7fd918068ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:50.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.960+0000 7fd91d3b8700 1 -- 172.21.15.45:0/3875562361 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd918154070 con 0x7fd9180c9d20 2023-12-22T10:01:50.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.964+0000 7fd91d3b8700 1 --2- 172.21.15.45:0/3875562361 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9180c9d20 0x7fd9180ad080 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 rx=0x7fd910009e60 tx=0x7fd910009780).ready entity=mon.0 client_cookie=396f787fa4e31337 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:50.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.964+0000 7fd9177fe700 1 -- 172.21.15.45:0/3875562361 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd91000e070 con 0x7fd9180c9d20 2023-12-22T10:01:50.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.964+0000 7fd9177fe700 1 -- 172.21.15.45:0/3875562361 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd91000bb60 con 0x7fd9180c9d20 2023-12-22T10:01:50.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.964+0000 7fd9177fe700 1 -- 172.21.15.45:0/3875562361 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd91000bee0 con 0x7fd9180c9d20 2023-12-22T10:01:50.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.964+0000 7fd91dbb9700 1 -- 172.21.15.45:0/3875562361 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9180c9d20 msgr2=0x7fd9180ad080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:50.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.964+0000 7fd91dbb9700 1 --2- 172.21.15.45:0/3875562361 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9180c9d20 0x7fd9180ad080 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 rx=0x7fd910009e60 tx=0x7fd910009780).stop 2023-12-22T10:01:50.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.964+0000 7fd91dbb9700 1 -- 172.21.15.45:0/3875562361 shutdown_connections 2023-12-22T10:01:50.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.964+0000 7fd91dbb9700 1 --2- 172.21.15.45:0/3875562361 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9180c9d20 0x7fd9180ad080 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:50.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.964+0000 7fd91dbb9700 1 -- 172.21.15.45:0/3875562361 >> 172.21.15.45:0/3875562361 conn(0x7fd9180674f0 msgr2=0x7fd9180ca820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:50.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.964+0000 7fd91dbb9700 1 -- 172.21.15.45:0/3875562361 shutdown_connections 2023-12-22T10:01:50.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.964+0000 7fd91dbb9700 1 -- 172.21.15.45:0/3875562361 wait complete. 2023-12-22T10:01:50.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.968+0000 7fd91dbb9700 1 Processor -- start 2023-12-22T10:01:50.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.968+0000 7fd91dbb9700 1 -- start start 2023-12-22T10:01:50.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.968+0000 7fd91dbb9700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd9180691c0 0x7fd9181532a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:50.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.968+0000 7fd91dbb9700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd9180acca0 0x7fd918155710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:50.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.968+0000 7fd91dbb9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9180c9d20 0x7fd918155c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:50.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.968+0000 7fd91dbb9700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9181560f0 con 0x7fd9180c9d20 2023-12-22T10:01:50.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.968+0000 7fd91dbb9700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9180c34b0 con 0x7fd9180acca0 2023-12-22T10:01:50.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.968+0000 7fd91dbb9700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9180c3790 con 0x7fd9180691c0 2023-12-22T10:01:50.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.968+0000 7fd91d3b8700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9180c9d20 0x7fd918155c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:50.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.968+0000 7fd91d3b8700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9180c9d20 0x7fd918155c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48312/0 (socket says 172.21.15.45:48312) 2023-12-22T10:01:50.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.968+0000 7fd91d3b8700 1 -- 172.21.15.45:0/4110918195 learned_addr learned my addr 172.21.15.45:0/4110918195 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:50.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.968+0000 7fd91cbb7700 1 --2- 172.21.15.45:0/4110918195 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd9180691c0 0x7fd9181532a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:50.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.968+0000 7fd917fff700 1 --2- 172.21.15.45:0/4110918195 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd9180acca0 0x7fd918155710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:50.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.968+0000 7fd91d3b8700 1 -- 172.21.15.45:0/4110918195 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd9180691c0 msgr2=0x7fd9181532a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:50.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.968+0000 7fd91d3b8700 1 --2- 172.21.15.45:0/4110918195 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd9180691c0 0x7fd9181532a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:50.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.968+0000 7fd91d3b8700 1 -- 172.21.15.45:0/4110918195 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd9180acca0 msgr2=0x7fd918155710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:50.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.968+0000 7fd91d3b8700 1 --2- 172.21.15.45:0/4110918195 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd9180acca0 0x7fd918155710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:50.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.968+0000 7fd91d3b8700 1 -- 172.21.15.45:0/4110918195 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd910009a20 con 0x7fd9180c9d20 2023-12-22T10:01:50.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.968+0000 7fd917fff700 1 --2- 172.21.15.45:0/4110918195 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd9180acca0 0x7fd918155710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T10:01:50.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.972+0000 7fd91d3b8700 1 --2- 172.21.15.45:0/4110918195 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9180c9d20 0x7fd918155c00 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7fd91000b6c0 tx=0x7fd910009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:50.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.972+0000 7fd914ff9700 1 -- 172.21.15.45:0/4110918195 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd91001d630 con 0x7fd9180c9d20 2023-12-22T10:01:50.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.972+0000 7fd914ff9700 1 -- 172.21.15.45:0/4110918195 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd91001d790 con 0x7fd9180c9d20 2023-12-22T10:01:50.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.972+0000 7fd914ff9700 1 -- 172.21.15.45:0/4110918195 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd91001db10 con 0x7fd9180c9d20 2023-12-22T10:01:50.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.972+0000 7fd91dbb9700 1 -- 172.21.15.45:0/4110918195 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9180c3a70 con 0x7fd9180c9d20 2023-12-22T10:01:50.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.972+0000 7fd91dbb9700 1 -- 172.21.15.45:0/4110918195 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9180c4030 con 0x7fd9180c9d20 2023-12-22T10:01:50.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.972+0000 7fd91dbb9700 1 -- 172.21.15.45:0/4110918195 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9180c4250 con 0x7fd9180c9d20 2023-12-22T10:01:50.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.972+0000 7fd914ff9700 1 -- 172.21.15.45:0/4110918195 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fd910026410 con 0x7fd9180c9d20 2023-12-22T10:01:50.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.976+0000 7fd914ff9700 1 --2- 172.21.15.45:0/4110918195 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fd8fc05a510 0x7fd8fc05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:50.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.976+0000 7fd914ff9700 1 -- 172.21.15.45:0/4110918195 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6660+0+0 (secure 0 0 0) 0x7fd9100768e0 con 0x7fd9180c9d20 2023-12-22T10:01:50.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.976+0000 7fd91cbb7700 1 --2- 172.21.15.45:0/4110918195 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fd8fc05a510 0x7fd8fc05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:50.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.976+0000 7fd91cbb7700 1 --2- 172.21.15.45:0/4110918195 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fd8fc05a510 0x7fd8fc05c9d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7fd90c005750 tx=0x7fd90c009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:50.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:50.980+0000 7fd914ff9700 1 -- 172.21.15.45:0/4110918195 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd910049d80 con 0x7fd9180c9d20 2023-12-22T10:01:51.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:51.192+0000 7fd91dbb9700 1 -- 172.21.15.45:0/4110918195 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "recovery_fs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fd918047060 con 0x7fd9180c9d20 2023-12-22T10:01:52.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:52.148+0000 7fd914ff9700 1 -- 172.21.15.45:0/4110918195 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "recovery_fs", "var": "standby_count_wanted", "val": "0"}]=0 v20) v1 ==== 123+0+0 (secure 0 0 0) 0x7fd91004d3a0 con 0x7fd9180c9d20 2023-12-22T10:01:52.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:52.152+0000 7fd91dbb9700 1 -- 172.21.15.45:0/4110918195 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fd8fc05a510 msgr2=0x7fd8fc05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:52.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:52.152+0000 7fd91dbb9700 1 --2- 172.21.15.45:0/4110918195 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fd8fc05a510 0x7fd8fc05c9d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7fd90c005750 tx=0x7fd90c009040).stop 2023-12-22T10:01:52.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:52.152+0000 7fd91dbb9700 1 -- 172.21.15.45:0/4110918195 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9180c9d20 msgr2=0x7fd918155c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:52.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:52.152+0000 7fd91dbb9700 1 --2- 172.21.15.45:0/4110918195 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9180c9d20 0x7fd918155c00 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7fd91000b6c0 tx=0x7fd910009780).stop 2023-12-22T10:01:52.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:52.152+0000 7fd91dbb9700 1 -- 172.21.15.45:0/4110918195 shutdown_connections 2023-12-22T10:01:52.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:52.152+0000 7fd91dbb9700 1 --2- 172.21.15.45:0/4110918195 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9180c9d20 0x7fd918155c00 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:52.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:52.152+0000 7fd91dbb9700 1 --2- 172.21.15.45:0/4110918195 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd9180acca0 0x7fd918155710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:52.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:52.152+0000 7fd91dbb9700 1 --2- 172.21.15.45:0/4110918195 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fd8fc05a510 0x7fd8fc05c9d0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:52.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:52.152+0000 7fd91dbb9700 1 --2- 172.21.15.45:0/4110918195 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd9180691c0 0x7fd9181532a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:52.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:52.152+0000 7fd91dbb9700 1 -- 172.21.15.45:0/4110918195 >> 172.21.15.45:0/4110918195 conn(0x7fd9180674f0 msgr2=0x7fd9181574e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:52.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:52.152+0000 7fd91dbb9700 1 -- 172.21.15.45:0/4110918195 shutdown_connections 2023-12-22T10:01:52.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:52.152+0000 7fd91dbb9700 1 -- 172.21.15.45:0/4110918195 wait complete. 2023-12-22T10:01:52.175 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-22T10:01:52.175 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set recovery_fs allow_standby_replay false 2023-12-22T10:01:52.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:52.352+0000 7f2e15f47700 1 Processor -- start 2023-12-22T10:01:52.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:52.352+0000 7f2e15f47700 1 -- start start 2023-12-22T10:01:52.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:52.356+0000 7f2e15f47700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f2e10153b30 0x7f2e10158020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:52.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:52.356+0000 7f2e15f47700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2e10064d30 0x7f2e100c13e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:52.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:52.356+0000 7f2e15f47700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e100657b0 con 0x7f2e100c4340 2023-12-22T10:01:52.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:52.356+0000 7f2e15f47700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e1006a860 con 0x7f2e10064d30 2023-12-22T10:01:52.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:52.356+0000 7f2e15f47700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e100c53e0 con 0x7f2e10153b30 2023-12-22T10:01:52.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:52.356+0000 7f2e15746700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2e10064d30 0x7f2e100c13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:52.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:52.356+0000 7f2e15746700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2e10064d30 0x7f2e100c13e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48314/0 (socket says 172.21.15.45:48314) 2023-12-22T10:01:52.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:52.356+0000 7f2e15746700 1 -- 172.21.15.45:0/1694657722 learned_addr learned my addr 172.21.15.45:0/1694657722 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:52.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:52.356+0000 7f2e14f45700 1 --2- 172.21.15.45:0/1694657722 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f2e10153b30 0x7f2e10158020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:52.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:52.356+0000 7f2e15746700 1 -- 172.21.15.45:0/1694657722 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f2e10153b30 msgr2=0x7f2e10158020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:52.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:52.356+0000 7f2e15746700 1 --2- 172.21.15.45:0/1694657722 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f2e10153b30 0x7f2e10158020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:52.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:52.356+0000 7f2e15746700 1 -- 172.21.15.45:0/1694657722 >> v1:172.21.15.45:6789/0 conn(0x7f2e100c4340 legacy=0x7f2e10064620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:52.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:52.356+0000 7f2e15746700 1 -- 172.21.15.45:0/1694657722 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e10154f20 con 0x7f2e10064d30 2023-12-22T10:01:52.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:52.356+0000 7f2e15746700 1 --2- 172.21.15.45:0/1694657722 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e10064d30 0x7f2e100c13e0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7f2e08009f20 tx=0x7f2e08009840).ready entity=mon.0 client_cookie=9c8d026e6903ab91 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:52.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:52.356+0000 7f2e0f7fe700 1 -- 172.21.15.45:0/1694657722 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e0800e070 con 0x7f2e10064d30 2023-12-22T10:01:52.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:52.356+0000 7f2e0f7fe700 1 -- 172.21.15.45:0/1694657722 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e0800b9d0 con 0x7f2e10064d30 2023-12-22T10:01:52.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:52.356+0000 7f2e0f7fe700 1 -- 172.21.15.45:0/1694657722 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e0800bd50 con 0x7f2e10064d30 2023-12-22T10:01:52.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:52.356+0000 7f2e15f47700 1 -- 172.21.15.45:0/1694657722 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e10064d30 msgr2=0x7f2e100c13e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:52.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:52.356+0000 7f2e15f47700 1 --2- 172.21.15.45:0/1694657722 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e10064d30 0x7f2e100c13e0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7f2e08009f20 tx=0x7f2e08009840).stop 2023-12-22T10:01:52.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:52.356+0000 7f2e15f47700 1 -- 172.21.15.45:0/1694657722 shutdown_connections 2023-12-22T10:01:52.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:52.356+0000 7f2e15f47700 1 --2- 172.21.15.45:0/1694657722 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e10064d30 0x7f2e100c13e0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:52.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:52.356+0000 7f2e15f47700 1 --2- 172.21.15.45:0/1694657722 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f2e10153b30 0x7f2e10158020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:52.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:52.356+0000 7f2e15f47700 1 -- 172.21.15.45:0/1694657722 >> 172.21.15.45:0/1694657722 conn(0x7f2e10067500 msgr2=0x7f2e100c6440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:52.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:52.356+0000 7f2e15f47700 1 -- 172.21.15.45:0/1694657722 shutdown_connections 2023-12-22T10:01:52.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:52.356+0000 7f2e15f47700 1 -- 172.21.15.45:0/1694657722 wait complete. 2023-12-22T10:01:52.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:52.360+0000 7f2e15f47700 1 Processor -- start 2023-12-22T10:01:52.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:52.364+0000 7f2e15f47700 1 -- start start 2023-12-22T10:01:52.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:52.364+0000 7f2e15f47700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e10064d30 0x7f2e10143320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:52.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:52.364+0000 7f2e15f47700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2e10153b30 0x7f2e100aa4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:52.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:52.364+0000 7f2e15f47700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f2e100aa9e0 0x7f2e100bf720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:52.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:52.364+0000 7f2e15f47700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e100abbc0 con 0x7f2e10064d30 2023-12-22T10:01:52.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:52.364+0000 7f2e15f47700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e100ac380 con 0x7f2e10153b30 2023-12-22T10:01:52.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:52.364+0000 7f2e15f47700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e100aafb0 con 0x7f2e100aa9e0 2023-12-22T10:01:52.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:52.364+0000 7f2e14f45700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e10064d30 0x7f2e10143320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:52.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:52.364+0000 7f2e14f45700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e10064d30 0x7f2e10143320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48322/0 (socket says 172.21.15.45:48322) 2023-12-22T10:01:52.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:52.364+0000 7f2e14f45700 1 -- 172.21.15.45:0/3143135541 learned_addr learned my addr 172.21.15.45:0/3143135541 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:52.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:52.364+0000 7f2e0ffff700 1 --2- 172.21.15.45:0/3143135541 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2e10153b30 0x7f2e100aa4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:52.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:52.364+0000 7f2e15746700 1 --2- 172.21.15.45:0/3143135541 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f2e100aa9e0 0x7f2e100bf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:52.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:52.364+0000 7f2e14f45700 1 -- 172.21.15.45:0/3143135541 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f2e100aa9e0 msgr2=0x7f2e100bf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:52.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:52.364+0000 7f2e14f45700 1 --2- 172.21.15.45:0/3143135541 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f2e100aa9e0 0x7f2e100bf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:52.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:52.364+0000 7f2e14f45700 1 -- 172.21.15.45:0/3143135541 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2e10153b30 msgr2=0x7f2e100aa4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:52.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:52.364+0000 7f2e14f45700 1 --2- 172.21.15.45:0/3143135541 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2e10153b30 0x7f2e100aa4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:52.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:52.364+0000 7f2e14f45700 1 -- 172.21.15.45:0/3143135541 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e08009ae0 con 0x7f2e10064d30 2023-12-22T10:01:52.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:52.364+0000 7f2e0ffff700 1 --2- 172.21.15.45:0/3143135541 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2e10153b30 0x7f2e100aa4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T10:01:52.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:52.364+0000 7f2e15746700 1 --2- 172.21.15.45:0/3143135541 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f2e100aa9e0 0x7f2e100bf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T10:01:52.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:52.364+0000 7f2e14f45700 1 --2- 172.21.15.45:0/3143135541 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e10064d30 0x7f2e10143320 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7f2e0400e900 tx=0x7f2e04009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:52.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:52.368+0000 7f2e0cff9700 1 -- 172.21.15.45:0/3143135541 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e0400c640 con 0x7f2e10064d30 2023-12-22T10:01:52.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:52.368+0000 7f2e0cff9700 1 -- 172.21.15.45:0/3143135541 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e0400c7a0 con 0x7f2e10064d30 2023-12-22T10:01:52.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:52.368+0000 7f2e15f47700 1 -- 172.21.15.45:0/3143135541 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e100ab290 con 0x7f2e10064d30 2023-12-22T10:01:52.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:52.368+0000 7f2e0cff9700 1 -- 172.21.15.45:0/3143135541 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e0400cb20 con 0x7f2e10064d30 2023-12-22T10:01:52.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:52.368+0000 7f2e15f47700 1 -- 172.21.15.45:0/3143135541 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e100ab850 con 0x7f2e10064d30 2023-12-22T10:01:52.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:52.368+0000 7f2e15f47700 1 -- 172.21.15.45:0/3143135541 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e100aba10 con 0x7f2e10064d30 2023-12-22T10:01:52.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:52.372+0000 7f2e0cff9700 1 -- 172.21.15.45:0/3143135541 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f2e0401b400 con 0x7f2e10064d30 2023-12-22T10:01:52.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:52.372+0000 7f2e0cff9700 1 --2- 172.21.15.45:0/3143135541 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f2df405a510 0x7f2df405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:52.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:52.372+0000 7f2e0cff9700 1 -- 172.21.15.45:0/3143135541 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6660+0+0 (secure 0 0 0) 0x7f2e04074dc0 con 0x7f2e10064d30 2023-12-22T10:01:52.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:52.372+0000 7f2e0ffff700 1 --2- 172.21.15.45:0/3143135541 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f2df405a510 0x7f2df405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:52.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:52.372+0000 7f2e0ffff700 1 --2- 172.21.15.45:0/3143135541 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f2df405a510 0x7f2df405c9d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f2e10168750 tx=0x7f2dfc009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:52.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:52.376+0000 7f2e0cff9700 1 -- 172.21.15.45:0/3143135541 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f2e04048320 con 0x7f2e10064d30 2023-12-22T10:01:52.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:52.580+0000 7f2e15f47700 1 -- 172.21.15.45:0/3143135541 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "recovery_fs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f2e10047060 con 0x7f2e10064d30 2023-12-22T10:01:53.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.152+0000 7f2e0cff9700 1 -- 172.21.15.45:0/3143135541 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "recovery_fs", "var": "allow_standby_replay", "val": "false"}]=0 v21) v1 ==== 127+0+0 (secure 0 0 0) 0x7f2e04016030 con 0x7f2e10064d30 2023-12-22T10:01:53.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.156+0000 7f2e15f47700 1 -- 172.21.15.45:0/3143135541 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f2df405a510 msgr2=0x7f2df405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:53.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.156+0000 7f2e15f47700 1 --2- 172.21.15.45:0/3143135541 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f2df405a510 0x7f2df405c9d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f2e10168750 tx=0x7f2dfc009040).stop 2023-12-22T10:01:53.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.156+0000 7f2e15f47700 1 -- 172.21.15.45:0/3143135541 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e10064d30 msgr2=0x7f2e10143320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:53.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.156+0000 7f2e15f47700 1 --2- 172.21.15.45:0/3143135541 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e10064d30 0x7f2e10143320 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7f2e0400e900 tx=0x7f2e04009060).stop 2023-12-22T10:01:53.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.160+0000 7f2e15f47700 1 -- 172.21.15.45:0/3143135541 shutdown_connections 2023-12-22T10:01:53.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.160+0000 7f2e15f47700 1 --2- 172.21.15.45:0/3143135541 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f2df405a510 0x7f2df405c9d0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:53.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.160+0000 7f2e15f47700 1 --2- 172.21.15.45:0/3143135541 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f2e100aa9e0 0x7f2e100bf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:53.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.160+0000 7f2e15f47700 1 --2- 172.21.15.45:0/3143135541 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2e10153b30 0x7f2e100aa4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:53.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.160+0000 7f2e15f47700 1 --2- 172.21.15.45:0/3143135541 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e10064d30 0x7f2e10143320 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:53.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.160+0000 7f2e15f47700 1 -- 172.21.15.45:0/3143135541 >> 172.21.15.45:0/3143135541 conn(0x7f2e10067500 msgr2=0x7f2e100bbdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:53.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.160+0000 7f2e15f47700 1 -- 172.21.15.45:0/3143135541 shutdown_connections 2023-12-22T10:01:53.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.160+0000 7f2e15f47700 1 -- 172.21.15.45:0/3143135541 wait complete. 2023-12-22T10:01:53.180 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'recovery_fs' 2023-12-22T10:01:53.181 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T10:01:53.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.344+0000 7ff06601b700 1 Processor -- start 2023-12-22T10:01:53.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.344+0000 7ff06601b700 1 -- start start 2023-12-22T10:01:53.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.344+0000 7ff06601b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff0601581f0 0x7ff0600c3080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:53.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.344+0000 7ff06601b700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0600a68b0 con 0x7ff0600c3570 2023-12-22T10:01:53.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.344+0000 7ff06601b700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff060065610 con 0x7ff060157e10 2023-12-22T10:01:53.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.344+0000 7ff06601b700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0600658f0 con 0x7ff0601581f0 2023-12-22T10:01:53.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.344+0000 7ff05effd700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff0601581f0 0x7ff0600c3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:53.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.348+0000 7ff05effd700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff0601581f0 0x7ff0600c3080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48330/0 (socket says 172.21.15.45:48330) 2023-12-22T10:01:53.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.348+0000 7ff05effd700 1 -- 172.21.15.45:0/1609822063 learned_addr learned my addr 172.21.15.45:0/1609822063 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:53.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.348+0000 7ff05effd700 1 -- 172.21.15.45:0/1609822063 >> v1:172.21.15.113:6789/0 conn(0x7ff060157e10 legacy=0x7ff0600c1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:53.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.348+0000 7ff05effd700 1 -- 172.21.15.45:0/1609822063 >> v1:172.21.15.45:6789/0 conn(0x7ff0600c3570 legacy=0x7ff0600a7070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:53.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.348+0000 7ff05effd700 1 -- 172.21.15.45:0/1609822063 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff060065bd0 con 0x7ff0601581f0 2023-12-22T10:01:53.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.348+0000 7ff05effd700 1 --2- 172.21.15.45:0/1609822063 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0601581f0 0x7ff0600c3080 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7ff054006fd0 tx=0x7ff0540090f0).ready entity=mon.0 client_cookie=47570f29abedee45 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:53.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.348+0000 7ff05e7fc700 1 -- 172.21.15.45:0/1609822063 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff05400b600 con 0x7ff0601581f0 2023-12-22T10:01:53.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.348+0000 7ff05e7fc700 1 -- 172.21.15.45:0/1609822063 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff05400b760 con 0x7ff0601581f0 2023-12-22T10:01:53.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.348+0000 7ff05e7fc700 1 -- 172.21.15.45:0/1609822063 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff05400bae0 con 0x7ff0601581f0 2023-12-22T10:01:53.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.348+0000 7ff06601b700 1 -- 172.21.15.45:0/1609822063 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0601581f0 msgr2=0x7ff0600c3080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:53.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.348+0000 7ff06601b700 1 --2- 172.21.15.45:0/1609822063 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0601581f0 0x7ff0600c3080 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7ff054006fd0 tx=0x7ff0540090f0).stop 2023-12-22T10:01:53.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.348+0000 7ff06601b700 1 -- 172.21.15.45:0/1609822063 shutdown_connections 2023-12-22T10:01:53.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.348+0000 7ff06601b700 1 --2- 172.21.15.45:0/1609822063 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0601581f0 0x7ff0600c3080 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:53.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.348+0000 7ff06601b700 1 -- 172.21.15.45:0/1609822063 >> 172.21.15.45:0/1609822063 conn(0x7ff060066a70 msgr2=0x7ff060066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:53.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.348+0000 7ff06601b700 1 -- 172.21.15.45:0/1609822063 shutdown_connections 2023-12-22T10:01:53.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.348+0000 7ff06601b700 1 -- 172.21.15.45:0/1609822063 wait complete. 2023-12-22T10:01:53.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.352+0000 7ff06601b700 1 Processor -- start 2023-12-22T10:01:53.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.352+0000 7ff06601b700 1 -- start start 2023-12-22T10:01:53.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.356+0000 7ff06601b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0600c3570 0x7ff0600a8f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:53.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.356+0000 7ff06601b700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff060157e10 0x7ff0600aaf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:53.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.356+0000 7ff06601b700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ff0601581f0 0x7ff0601538f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:53.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.356+0000 7ff06601b700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0600a7e80 con 0x7ff0600c3570 2023-12-22T10:01:53.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.356+0000 7ff06601b700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0600a8160 con 0x7ff060157e10 2023-12-22T10:01:53.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.356+0000 7ff06601b700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0600a8440 con 0x7ff0601581f0 2023-12-22T10:01:53.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.356+0000 7ff05f7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0600c3570 0x7ff0600a8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:53.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.356+0000 7ff05f7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0600c3570 0x7ff0600a8f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48344/0 (socket says 172.21.15.45:48344) 2023-12-22T10:01:53.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.356+0000 7ff05f7fe700 1 -- 172.21.15.45:0/120594413 learned_addr learned my addr 172.21.15.45:0/120594413 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:53.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.356+0000 7ff05effd700 1 --2- 172.21.15.45:0/120594413 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff060157e10 0x7ff0600aaf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:53.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.356+0000 7ff05ffff700 1 --2- 172.21.15.45:0/120594413 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ff0601581f0 0x7ff0601538f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:53.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.356+0000 7ff05f7fe700 1 -- 172.21.15.45:0/120594413 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ff0601581f0 msgr2=0x7ff0601538f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:53.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.356+0000 7ff05f7fe700 1 --2- 172.21.15.45:0/120594413 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ff0601581f0 0x7ff0601538f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:53.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.356+0000 7ff05f7fe700 1 -- 172.21.15.45:0/120594413 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff060157e10 msgr2=0x7ff0600aaf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:53.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.356+0000 7ff05f7fe700 1 --2- 172.21.15.45:0/120594413 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff060157e10 0x7ff0600aaf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:53.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.356+0000 7ff05f7fe700 1 -- 172.21.15.45:0/120594413 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff054009370 con 0x7ff0600c3570 2023-12-22T10:01:53.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.356+0000 7ff05f7fe700 1 --2- 172.21.15.45:0/120594413 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0600c3570 0x7ff0600a8f20 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 rx=0x7ff05000c4c0 tx=0x7ff050007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:53.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.356+0000 7ff0477fe700 1 -- 172.21.15.45:0/120594413 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff050007020 con 0x7ff0600c3570 2023-12-22T10:01:53.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.356+0000 7ff0477fe700 1 -- 172.21.15.45:0/120594413 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff050001e90 con 0x7ff0600c3570 2023-12-22T10:01:53.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.356+0000 7ff06601b700 1 -- 172.21.15.45:0/120594413 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0600a8720 con 0x7ff0600c3570 2023-12-22T10:01:53.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.356+0000 7ff0477fe700 1 -- 172.21.15.45:0/120594413 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0500073b0 con 0x7ff0600c3570 2023-12-22T10:01:53.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.356+0000 7ff06601b700 1 -- 172.21.15.45:0/120594413 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0600ab440 con 0x7ff0600c3570 2023-12-22T10:01:53.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.360+0000 7ff06601b700 1 -- 172.21.15.45:0/120594413 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff06006c070 con 0x7ff0600c3570 2023-12-22T10:01:53.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.360+0000 7ff0477fe700 1 -- 172.21.15.45:0/120594413 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7ff0500068b0 con 0x7ff0600c3570 2023-12-22T10:01:53.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.364+0000 7ff0477fe700 1 --2- 172.21.15.45:0/120594413 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7ff04c05a510 0x7ff04c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:53.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.364+0000 7ff0477fe700 1 -- 172.21.15.45:0/120594413 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6660+0+0 (secure 0 0 0) 0x7ff0500743e0 con 0x7ff0600c3570 2023-12-22T10:01:53.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.364+0000 7ff05effd700 1 --2- 172.21.15.45:0/120594413 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7ff04c05a510 0x7ff04c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:53.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.364+0000 7ff05effd700 1 --2- 172.21.15.45:0/120594413 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7ff04c05a510 0x7ff04c05c9d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7ff054006fd0 tx=0x7ff054017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:53.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.368+0000 7ff0477fe700 1 -- 172.21.15.45:0/120594413 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff0500478e0 con 0x7ff0600c3570 2023-12-22T10:01:53.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.564+0000 7ff06601b700 1 -- 172.21.15.45:0/120594413 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff0600a6b50 con 0x7ff0600c3570 2023-12-22T10:01:53.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.568+0000 7ff0477fe700 1 -- 172.21.15.45:0/120594413 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+5445 (secure 0 0 0) 0x7ff05004af00 con 0x7ff0600c3570 2023-12-22T10:01:53.566 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:01:53.566 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":21,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4925,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6836/1120392063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1120392063},{"type":"v1","addr":"172.21.15.45:6836","nonce":1120392063}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6835/2332598072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":2332598072},{"type":"v1","addr":"172.21.15.113:6835","nonce":2332598072}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5253,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/2884671415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6835","nonce":2884671415},{"type":"v1","addr":"172.21.15.45:6837","nonce":2884671415}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5284,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6833/2223286979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6832","nonce":2223286979},{"type":"v1","addr":"172.21.15.113:6833","nonce":2223286979}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":17,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T10:01:35.105595+0000","modified":"2023-12-22T10:01:46.041463+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":37,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":21,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T10:01:49.976984+0000","modified":"2023-12-22T10:01:53.149442+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[6],"metadata_pool":7,"enabled":true,"fs_name":"recovery_fs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-12-22T10:01:53.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.568+0000 7ff06601b700 1 -- 172.21.15.45:0/120594413 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7ff04c05a510 msgr2=0x7ff04c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:53.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.568+0000 7ff06601b700 1 --2- 172.21.15.45:0/120594413 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7ff04c05a510 0x7ff04c05c9d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7ff054006fd0 tx=0x7ff054017000).stop 2023-12-22T10:01:53.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.568+0000 7ff06601b700 1 -- 172.21.15.45:0/120594413 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0600c3570 msgr2=0x7ff0600a8f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:53.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.568+0000 7ff06601b700 1 --2- 172.21.15.45:0/120594413 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0600c3570 0x7ff0600a8f20 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 rx=0x7ff05000c4c0 tx=0x7ff050007e00).stop 2023-12-22T10:01:53.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.568+0000 7ff06601b700 1 -- 172.21.15.45:0/120594413 shutdown_connections 2023-12-22T10:01:53.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.568+0000 7ff06601b700 1 --2- 172.21.15.45:0/120594413 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7ff04c05a510 0x7ff04c05c9d0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:53.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.568+0000 7ff06601b700 1 --2- 172.21.15.45:0/120594413 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ff0601581f0 0x7ff0601538f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:53.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.568+0000 7ff06601b700 1 --2- 172.21.15.45:0/120594413 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff060157e10 0x7ff0600aaf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:53.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.568+0000 7ff06601b700 1 --2- 172.21.15.45:0/120594413 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0600c3570 0x7ff0600a8f20 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:53.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.568+0000 7ff06601b700 1 -- 172.21.15.45:0/120594413 >> 172.21.15.45:0/120594413 conn(0x7ff060066a70 msgr2=0x7ff060154e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:53.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.568+0000 7ff06601b700 1 -- 172.21.15.45:0/120594413 shutdown_connections 2023-12-22T10:01:53.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.568+0000 7ff06601b700 1 -- 172.21.15.45:0/120594413 wait complete. 2023-12-22T10:01:53.571 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 21 2023-12-22T10:01:53.587 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T10:01:53.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.764+0000 7ff5c281b700 1 Processor -- start 2023-12-22T10:01:53.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.764+0000 7ff5c281b700 1 -- start start 2023-12-22T10:01:53.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.764+0000 7ff5c281b700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ff5bc157e10 0x7ff5bc0c1820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:53.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.764+0000 7ff5c281b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff5bc1581f0 0x7ff5bc0c1d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:53.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.764+0000 7ff5c281b700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5bc0a68b0 con 0x7ff5bc0c3080 2023-12-22T10:01:53.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.764+0000 7ff5c281b700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5bc065610 con 0x7ff5bc1581f0 2023-12-22T10:01:53.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.764+0000 7ff5c281b700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5bc0658f0 con 0x7ff5bc157e10 2023-12-22T10:01:53.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.764+0000 7ff5b3fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff5bc1581f0 0x7ff5bc0c1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:53.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.764+0000 7ff5b3fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff5bc1581f0 0x7ff5bc0c1d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48346/0 (socket says 172.21.15.45:48346) 2023-12-22T10:01:53.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.764+0000 7ff5b3fff700 1 -- 172.21.15.45:0/1540872554 learned_addr learned my addr 172.21.15.45:0/1540872554 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:53.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.768+0000 7ff5bbfff700 1 --2- 172.21.15.45:0/1540872554 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ff5bc157e10 0x7ff5bc0c1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:53.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.768+0000 7ff5b3fff700 1 -- 172.21.15.45:0/1540872554 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ff5bc157e10 msgr2=0x7ff5bc0c1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:53.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.768+0000 7ff5b3fff700 1 --2- 172.21.15.45:0/1540872554 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ff5bc157e10 0x7ff5bc0c1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:53.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.768+0000 7ff5b3fff700 1 -- 172.21.15.45:0/1540872554 >> v1:172.21.15.45:6789/0 conn(0x7ff5bc0c3080 legacy=0x7ff5bc0c3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:53.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.768+0000 7ff5b3fff700 1 -- 172.21.15.45:0/1540872554 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5bc065bd0 con 0x7ff5bc1581f0 2023-12-22T10:01:53.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.768+0000 7ff5b3fff700 1 --2- 172.21.15.45:0/1540872554 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5bc1581f0 0x7ff5bc0c1d10 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7ff5a4006fd0 tx=0x7ff5a40090f0).ready entity=mon.0 client_cookie=3a4912403d77073b server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:53.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.768+0000 7ff5bb7fe700 1 -- 172.21.15.45:0/1540872554 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a400b600 con 0x7ff5bc1581f0 2023-12-22T10:01:53.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.768+0000 7ff5bb7fe700 1 -- 172.21.15.45:0/1540872554 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5a400b760 con 0x7ff5bc1581f0 2023-12-22T10:01:53.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.768+0000 7ff5bb7fe700 1 -- 172.21.15.45:0/1540872554 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a400bae0 con 0x7ff5bc1581f0 2023-12-22T10:01:53.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.768+0000 7ff5c281b700 1 -- 172.21.15.45:0/1540872554 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5bc1581f0 msgr2=0x7ff5bc0c1d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:53.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.768+0000 7ff5c281b700 1 --2- 172.21.15.45:0/1540872554 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5bc1581f0 0x7ff5bc0c1d10 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7ff5a4006fd0 tx=0x7ff5a40090f0).stop 2023-12-22T10:01:53.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.768+0000 7ff5c281b700 1 -- 172.21.15.45:0/1540872554 shutdown_connections 2023-12-22T10:01:53.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.768+0000 7ff5c281b700 1 --2- 172.21.15.45:0/1540872554 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5bc1581f0 0x7ff5bc0c1d10 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:53.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.768+0000 7ff5c281b700 1 --2- 172.21.15.45:0/1540872554 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ff5bc157e10 0x7ff5bc0c1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:53.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.768+0000 7ff5c281b700 1 -- 172.21.15.45:0/1540872554 >> 172.21.15.45:0/1540872554 conn(0x7ff5bc066a70 msgr2=0x7ff5bc066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:53.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.768+0000 7ff5c281b700 1 -- 172.21.15.45:0/1540872554 shutdown_connections 2023-12-22T10:01:53.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.768+0000 7ff5c281b700 1 -- 172.21.15.45:0/1540872554 wait complete. 2023-12-22T10:01:53.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.772+0000 7ff5c281b700 1 Processor -- start 2023-12-22T10:01:53.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.772+0000 7ff5c281b700 1 -- start start 2023-12-22T10:01:53.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.772+0000 7ff5c281b700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff5bc0c3080 0x7ff5bc0a7c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:53.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.772+0000 7ff5c281b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5bc157e10 0x7ff5bc0ac4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:53.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.772+0000 7ff5c281b700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ff5bc1581f0 0x7ff5bc0aab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:53.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.772+0000 7ff5c281b700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5bc0ab400 con 0x7ff5bc157e10 2023-12-22T10:01:53.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.772+0000 7ff5c281b700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5bc0ab6e0 con 0x7ff5bc0c3080 2023-12-22T10:01:53.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.772+0000 7ff5c281b700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5bc0ab9c0 con 0x7ff5bc1581f0 2023-12-22T10:01:53.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.772+0000 7ff5b3fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5bc157e10 0x7ff5bc0ac4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:53.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.772+0000 7ff5b3fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5bc157e10 0x7ff5bc0ac4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48356/0 (socket says 172.21.15.45:48356) 2023-12-22T10:01:53.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.772+0000 7ff5b3fff700 1 -- 172.21.15.45:0/247912159 learned_addr learned my addr 172.21.15.45:0/247912159 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:53.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.772+0000 7ff5bbfff700 1 --2- 172.21.15.45:0/247912159 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff5bc0c3080 0x7ff5bc0a7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:53.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.772+0000 7ff5c0db8700 1 --2- 172.21.15.45:0/247912159 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ff5bc1581f0 0x7ff5bc0aab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:53.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.772+0000 7ff5b3fff700 1 -- 172.21.15.45:0/247912159 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ff5bc1581f0 msgr2=0x7ff5bc0aab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:53.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.772+0000 7ff5b3fff700 1 --2- 172.21.15.45:0/247912159 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ff5bc1581f0 0x7ff5bc0aab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:53.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.772+0000 7ff5b3fff700 1 -- 172.21.15.45:0/247912159 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff5bc0c3080 msgr2=0x7ff5bc0a7c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:53.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.772+0000 7ff5b3fff700 1 --2- 172.21.15.45:0/247912159 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff5bc0c3080 0x7ff5bc0a7c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:53.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.772+0000 7ff5b3fff700 1 -- 172.21.15.45:0/247912159 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5a4009370 con 0x7ff5bc157e10 2023-12-22T10:01:53.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.772+0000 7ff5c0db8700 1 --2- 172.21.15.45:0/247912159 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ff5bc1581f0 0x7ff5bc0aab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-12-22T10:01:53.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.776+0000 7ff5b3fff700 1 --2- 172.21.15.45:0/247912159 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5bc157e10 0x7ff5bc0ac4a0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7ff5a4011000 tx=0x7ff5a4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:53.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.776+0000 7ff5b8ff9700 1 -- 172.21.15.45:0/247912159 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a400bea0 con 0x7ff5bc157e10 2023-12-22T10:01:53.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.776+0000 7ff5b8ff9700 1 -- 172.21.15.45:0/247912159 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5a400b8d0 con 0x7ff5bc157e10 2023-12-22T10:01:53.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.776+0000 7ff5b8ff9700 1 -- 172.21.15.45:0/247912159 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a401c670 con 0x7ff5bc157e10 2023-12-22T10:01:53.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.776+0000 7ff5c281b700 1 -- 172.21.15.45:0/247912159 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5bc0abca0 con 0x7ff5bc157e10 2023-12-22T10:01:53.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.776+0000 7ff5c281b700 1 -- 172.21.15.45:0/247912159 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5bc0ab080 con 0x7ff5bc157e10 2023-12-22T10:01:53.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.776+0000 7ff5c281b700 1 -- 172.21.15.45:0/247912159 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5bc06c070 con 0x7ff5bc157e10 2023-12-22T10:01:53.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.776+0000 7ff5b8ff9700 1 -- 172.21.15.45:0/247912159 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7ff5a401c9e0 con 0x7ff5bc157e10 2023-12-22T10:01:53.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.780+0000 7ff5b8ff9700 1 --2- 172.21.15.45:0/247912159 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7ff59c05a510 0x7ff59c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:53.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.780+0000 7ff5b8ff9700 1 -- 172.21.15.45:0/247912159 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6660+0+0 (secure 0 0 0) 0x7ff5a4076310 con 0x7ff5bc157e10 2023-12-22T10:01:53.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.780+0000 7ff5bbfff700 1 --2- 172.21.15.45:0/247912159 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7ff59c05a510 0x7ff59c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:53.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.780+0000 7ff5bbfff700 1 --2- 172.21.15.45:0/247912159 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7ff59c05a510 0x7ff59c05c9d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7ff5ac00bbc0 tx=0x7ff5ac008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:53.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.784+0000 7ff5b8ff9700 1 -- 172.21.15.45:0/247912159 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff5a4049810 con 0x7ff5bc157e10 2023-12-22T10:01:53.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.948+0000 7ff5c281b700 1 -- 172.21.15.45:0/247912159 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff5bc069750 con 0x7ff5bc157e10 2023-12-22T10:01:53.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.948+0000 7ff5b8ff9700 1 -- 172.21.15.45:0/247912159 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+18686 (secure 0 0 0) 0x7ff5a4020020 con 0x7ff5bc157e10 2023-12-22T10:01:53.949 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:01:53.949 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":44,"fsid":"98b0837e-5e68-4c8f-a1a0-e9424baaad8f","created":"2023-12-22T10:00:15.010174+0000","modified":"2023-12-22T10:01:50.986605+0000","last_up_change":"2023-12-22T10:00:24.980513+0000","last_in_change":"2023-12-22T10:00:17.887172+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-12-22T10:00:25.069641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-12-22T10:00:26.906399+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-22T10:01:33.592093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-22T10:01:34.130811+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"recovery_fs"}}},{"pool":7,"pool_name":"recovery_fs_metadata","create_time":"2023-12-22T10:01:49.073877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"recovery_fs"}}}],"osds":[{"osd":0,"uuid":"e19943a0-1c6b-47df-b6bb-383472077890","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":33777},{"type":"v1","addr":"172.21.15.45:6819","nonce":33777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":33777},{"type":"v1","addr":"172.21.15.45:6822","nonce":33777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":33777},{"type":"v1","addr":"172.21.15.45:6830","nonce":33777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":33777},{"type":"v1","addr":"172.21.15.45:6826","nonce":33777}]},"public_addr":"172.21.15.45:6819/33777","cluster_addr":"172.21.15.45:6822/33777","heartbeat_back_addr":"172.21.15.45:6830/33777","heartbeat_front_addr":"172.21.15.45:6826/33777","state":["exists","up"]},{"osd":1,"uuid":"69670f34-f082-45a7-8f67-e962acc136e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":33775},{"type":"v1","addr":"172.21.15.45:6809","nonce":33775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":33775},{"type":"v1","addr":"172.21.15.45:6811","nonce":33775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":33775},{"type":"v1","addr":"172.21.15.45:6815","nonce":33775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":33775},{"type":"v1","addr":"172.21.15.45:6813","nonce":33775}]},"public_addr":"172.21.15.45:6809/33775","cluster_addr":"172.21.15.45:6811/33775","heartbeat_back_addr":"172.21.15.45:6815/33775","heartbeat_front_addr":"172.21.15.45:6813/33775","state":["exists","up"]},{"osd":2,"uuid":"d909d49b-82b8-401b-9947-e49dd167bb95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":33776},{"type":"v1","addr":"172.21.15.45:6801","nonce":33776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":33776},{"type":"v1","addr":"172.21.15.45:6803","nonce":33776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":33776},{"type":"v1","addr":"172.21.15.45:6807","nonce":33776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":33776},{"type":"v1","addr":"172.21.15.45:6805","nonce":33776}]},"public_addr":"172.21.15.45:6801/33776","cluster_addr":"172.21.15.45:6803/33776","heartbeat_back_addr":"172.21.15.45:6807/33776","heartbeat_front_addr":"172.21.15.45:6805/33776","state":["exists","up"]},{"osd":3,"uuid":"db104ca9-3a94-4d39-a2be-bd06db888095","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":33782},{"type":"v1","addr":"172.21.15.45:6817","nonce":33782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":33782},{"type":"v1","addr":"172.21.15.45:6823","nonce":33782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":33782},{"type":"v1","addr":"172.21.15.45:6831","nonce":33782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":33782},{"type":"v1","addr":"172.21.15.45:6827","nonce":33782}]},"public_addr":"172.21.15.45:6817/33782","cluster_addr":"172.21.15.45:6823/33782","heartbeat_back_addr":"172.21.15.45:6831/33782","heartbeat_front_addr":"172.21.15.45:6827/33782","state":["exists","up"]},{"osd":4,"uuid":"9f4eaff4-e433-4479-a0d1-ee7a33375ca6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":34099},{"type":"v1","addr":"172.21.15.113:6811","nonce":34099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":34099},{"type":"v1","addr":"172.21.15.113:6815","nonce":34099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":34099},{"type":"v1","addr":"172.21.15.113:6823","nonce":34099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6816","nonce":34099},{"type":"v1","addr":"172.21.15.113:6818","nonce":34099}]},"public_addr":"172.21.15.113:6811/34099","cluster_addr":"172.21.15.113:6815/34099","heartbeat_back_addr":"172.21.15.113:6823/34099","heartbeat_front_addr":"172.21.15.113:6818/34099","state":["exists","up"]},{"osd":5,"uuid":"1efc5591-180b-43af-8611-0068aadc5aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":34100},{"type":"v1","addr":"172.21.15.113:6801","nonce":34100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":34100},{"type":"v1","addr":"172.21.15.113:6803","nonce":34100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":34100},{"type":"v1","addr":"172.21.15.113:6807","nonce":34100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":34100},{"type":"v1","addr":"172.21.15.113:6805","nonce":34100}]},"public_addr":"172.21.15.113:6801/34100","cluster_addr":"172.21.15.113:6803/34100","heartbeat_back_addr":"172.21.15.113:6807/34100","heartbeat_front_addr":"172.21.15.113:6805/34100","state":["exists","up"]},{"osd":6,"uuid":"6c89d9d8-c153-4a48-afa9-97e4c403f1ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":34101},{"type":"v1","addr":"172.21.15.113:6810","nonce":34101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6812","nonce":34101},{"type":"v1","addr":"172.21.15.113:6814","nonce":34101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6822","nonce":34101},{"type":"v1","addr":"172.21.15.113:6824","nonce":34101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":34101},{"type":"v1","addr":"172.21.15.113:6819","nonce":34101}]},"public_addr":"172.21.15.113:6810/34101","cluster_addr":"172.21.15.113:6814/34101","heartbeat_back_addr":"172.21.15.113:6824/34101","heartbeat_front_addr":"172.21.15.113:6819/34101","state":["exists","up"]},{"osd":7,"uuid":"1855e70c-23f6-4c08-ad7f-774c2148235b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6821","nonce":34102},{"type":"v1","addr":"172.21.15.113:6825","nonce":34102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":34102},{"type":"v1","addr":"172.21.15.113:6827","nonce":34102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":34102},{"type":"v1","addr":"172.21.15.113:6831","nonce":34102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6828","nonce":34102},{"type":"v1","addr":"172.21.15.113:6829","nonce":34102}]},"public_addr":"172.21.15.113:6825/34102","cluster_addr":"172.21.15.113:6827/34102","heartbeat_back_addr":"172.21.15.113:6831/34102","heartbeat_front_addr":"172.21.15.113:6829/34102","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.812672+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.825045+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.700105+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.856563+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.954683+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.883234+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.883994+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.821686+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.45:6835/1879154206":"2023-12-23T10:01:45.243059+0000","172.21.15.45:6834/1879154206":"2023-12-23T10:01:45.243059+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T10:01:53.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.952+0000 7ff5c281b700 1 -- 172.21.15.45:0/247912159 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7ff59c05a510 msgr2=0x7ff59c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:53.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.952+0000 7ff5c281b700 1 --2- 172.21.15.45:0/247912159 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7ff59c05a510 0x7ff59c05c9d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7ff5ac00bbc0 tx=0x7ff5ac008040).stop 2023-12-22T10:01:53.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.952+0000 7ff5c281b700 1 -- 172.21.15.45:0/247912159 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5bc157e10 msgr2=0x7ff5bc0ac4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:53.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.952+0000 7ff5c281b700 1 --2- 172.21.15.45:0/247912159 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5bc157e10 0x7ff5bc0ac4a0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7ff5a4011000 tx=0x7ff5a4017000).stop 2023-12-22T10:01:53.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.952+0000 7ff5c281b700 1 -- 172.21.15.45:0/247912159 shutdown_connections 2023-12-22T10:01:53.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.952+0000 7ff5c281b700 1 --2- 172.21.15.45:0/247912159 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7ff59c05a510 0x7ff59c05c9d0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:53.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.952+0000 7ff5c281b700 1 --2- 172.21.15.45:0/247912159 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ff5bc1581f0 0x7ff5bc0aab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:53.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.952+0000 7ff5c281b700 1 --2- 172.21.15.45:0/247912159 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5bc157e10 0x7ff5bc0ac4a0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:53.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.952+0000 7ff5c281b700 1 --2- 172.21.15.45:0/247912159 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff5bc0c3080 0x7ff5bc0a7c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:53.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.952+0000 7ff5c281b700 1 -- 172.21.15.45:0/247912159 >> 172.21.15.45:0/247912159 conn(0x7ff5bc066a70 msgr2=0x7ff5bc15e430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:53.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.952+0000 7ff5c281b700 1 -- 172.21.15.45:0/247912159 shutdown_connections 2023-12-22T10:01:53.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:53.952+0000 7ff5c281b700 1 -- 172.21.15.45:0/247912159 wait complete. 2023-12-22T10:01:53.972 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-22T10:01:53.972 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-22T10:01:54.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.136+0000 7f06edfb9700 1 Processor -- start 2023-12-22T10:01:54.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.136+0000 7f06edfb9700 1 -- start start 2023-12-22T10:01:54.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.136+0000 7f06edfb9700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f06e8155e60 0x7f06e80645b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:54.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.136+0000 7f06edfb9700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06e8069270 con 0x7f06e8151e00 2023-12-22T10:01:54.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.136+0000 7f06edfb9700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06e80bc380 con 0x7f06e8151a20 2023-12-22T10:01:54.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.136+0000 7f06edfb9700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06e80bc660 con 0x7f06e8155e60 2023-12-22T10:01:54.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.140+0000 7f06ed7b8700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f06e8151e00 0x7f06e8064aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:45068/0 (socket says 172.21.15.45:45068) 2023-12-22T10:01:54.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.140+0000 7f06ed7b8700 1 -- 172.21.15.45:0/1585490727 learned_addr learned my addr 172.21.15.45:0/1585490727 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:01:54.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.140+0000 7f06e7fff700 1 --2- 172.21.15.45:0/1585490727 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f06e8155e60 0x7f06e80645b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:54.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.140+0000 7f06e7fff700 1 -- 172.21.15.45:0/1585490727 >> v1:172.21.15.113:6789/0 conn(0x7f06e8151a20 legacy=0x7f06e8155750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:54.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.140+0000 7f06e7fff700 1 -- 172.21.15.45:0/1585490727 >> v1:172.21.15.45:6789/0 conn(0x7f06e8151e00 legacy=0x7f06e8064aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:54.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.140+0000 7f06e7fff700 1 -- 172.21.15.45:0/1585490727 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06e8068c20 con 0x7f06e8155e60 2023-12-22T10:01:54.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.140+0000 7f06e7fff700 1 --2- 172.21.15.45:0/1585490727 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f06e8155e60 0x7f06e80645b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f06d8009790 tx=0x7f06d8009060).ready entity=mon.2 client_cookie=76ea4b1cc42b4f9b server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:54.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.140+0000 7f06e77fe700 1 -- 172.21.15.45:0/1585490727 <== mon.2 v2:172.21.15.113:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d800b630 con 0x7f06e8155e60 2023-12-22T10:01:54.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.140+0000 7f06e77fe700 1 -- 172.21.15.45:0/1585490727 <== mon.2 v2:172.21.15.113:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06d800b790 con 0x7f06e8155e60 2023-12-22T10:01:54.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.140+0000 7f06e77fe700 1 -- 172.21.15.45:0/1585490727 <== mon.2 v2:172.21.15.113:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d800bb10 con 0x7f06e8155e60 2023-12-22T10:01:54.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.140+0000 7f06edfb9700 1 -- 172.21.15.45:0/1585490727 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f06e8155e60 msgr2=0x7f06e80645b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:54.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.140+0000 7f06edfb9700 1 --2- 172.21.15.45:0/1585490727 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f06e8155e60 0x7f06e80645b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f06d8009790 tx=0x7f06d8009060).stop 2023-12-22T10:01:54.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.140+0000 7f06edfb9700 1 -- 172.21.15.45:0/1585490727 shutdown_connections 2023-12-22T10:01:54.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.140+0000 7f06edfb9700 1 --2- 172.21.15.45:0/1585490727 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f06e8155e60 0x7f06e80645b0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:54.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.140+0000 7f06edfb9700 1 -- 172.21.15.45:0/1585490727 >> 172.21.15.45:0/1585490727 conn(0x7f06e8067540 msgr2=0x7f06e80c6460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:54.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.140+0000 7f06edfb9700 1 -- 172.21.15.45:0/1585490727 shutdown_connections 2023-12-22T10:01:54.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.140+0000 7f06edfb9700 1 -- 172.21.15.45:0/1585490727 wait complete. 2023-12-22T10:01:54.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.144+0000 7f06edfb9700 1 Processor -- start 2023-12-22T10:01:54.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.144+0000 7f06edfb9700 1 -- start start 2023-12-22T10:01:54.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.144+0000 7f06edfb9700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f06e8151a20 0x7f06e80bd500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:54.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.144+0000 7f06edfb9700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f06e8151e00 0x7f06e80a8280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:54.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.148+0000 7f06edfb9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06e8155e60 0x7f06e814ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:54.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.148+0000 7f06edfb9700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06e80c00c0 con 0x7f06e8155e60 2023-12-22T10:01:54.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.148+0000 7f06edfb9700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06e80bd9f0 con 0x7f06e8151a20 2023-12-22T10:01:54.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.148+0000 7f06edfb9700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06e80bf8b0 con 0x7f06e8151e00 2023-12-22T10:01:54.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.148+0000 7f06ed7b8700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06e8155e60 0x7f06e814ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:54.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.148+0000 7f06e7fff700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f06e8151e00 0x7f06e80a8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:54.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.148+0000 7f06ed7b8700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06e8155e60 0x7f06e814ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48364/0 (socket says 172.21.15.45:48364) 2023-12-22T10:01:54.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.148+0000 7f06ed7b8700 1 -- 172.21.15.45:0/2378682719 learned_addr learned my addr 172.21.15.45:0/2378682719 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:54.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.148+0000 7f06ecfb7700 1 --2- 172.21.15.45:0/2378682719 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f06e8151a20 0x7f06e80bd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:54.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.148+0000 7f06ed7b8700 1 -- 172.21.15.45:0/2378682719 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f06e8151e00 msgr2=0x7f06e80a8280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:54.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.148+0000 7f06ed7b8700 1 --2- 172.21.15.45:0/2378682719 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f06e8151e00 0x7f06e80a8280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:54.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.148+0000 7f06ed7b8700 1 -- 172.21.15.45:0/2378682719 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f06e8151a20 msgr2=0x7f06e80bd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:54.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.148+0000 7f06ed7b8700 1 --2- 172.21.15.45:0/2378682719 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f06e8151a20 0x7f06e80bd500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:54.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.148+0000 7f06ed7b8700 1 -- 172.21.15.45:0/2378682719 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06d80092a0 con 0x7f06e8155e60 2023-12-22T10:01:54.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.148+0000 7f06ed7b8700 1 --2- 172.21.15.45:0/2378682719 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06e8155e60 0x7f06e814ba50 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7f06e000c790 tx=0x7f06e00015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:54.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.148+0000 7f06e4ff9700 1 -- 172.21.15.45:0/2378682719 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e0005d30 con 0x7f06e8155e60 2023-12-22T10:01:54.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.148+0000 7f06e4ff9700 1 -- 172.21.15.45:0/2378682719 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06e0005e90 con 0x7f06e8155e60 2023-12-22T10:01:54.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.148+0000 7f06e4ff9700 1 -- 172.21.15.45:0/2378682719 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e0007320 con 0x7f06e8155e60 2023-12-22T10:01:54.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.148+0000 7f06edfb9700 1 -- 172.21.15.45:0/2378682719 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06e80bfb00 con 0x7f06e8155e60 2023-12-22T10:01:54.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.148+0000 7f06edfb9700 1 -- 172.21.15.45:0/2378682719 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06e814db40 con 0x7f06e8155e60 2023-12-22T10:01:54.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.152+0000 7f06edfb9700 1 -- 172.21.15.45:0/2378682719 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06e8047060 con 0x7f06e8155e60 2023-12-22T10:01:54.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.152+0000 7f06e4ff9700 1 -- 172.21.15.45:0/2378682719 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f06e00076d0 con 0x7f06e8155e60 2023-12-22T10:01:54.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.152+0000 7f06e4ff9700 1 --2- 172.21.15.45:0/2378682719 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f06d405a510 0x7f06d405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:54.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.152+0000 7f06e4ff9700 1 -- 172.21.15.45:0/2378682719 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6660+0+0 (secure 0 0 0) 0x7f06e0074980 con 0x7f06e8155e60 2023-12-22T10:01:54.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.152+0000 7f06ecfb7700 1 --2- 172.21.15.45:0/2378682719 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f06d405a510 0x7f06d405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:54.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.156+0000 7f06ecfb7700 1 --2- 172.21.15.45:0/2378682719 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f06d405a510 0x7f06d405c9d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f06dc003900 tx=0x7f06dc007d40).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:54.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.160+0000 7f06e4ff9700 1 -- 172.21.15.45:0/2378682719 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f06e0047e80 con 0x7f06e8155e60 2023-12-22T10:01:54.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.324+0000 7f06edfb9700 1 -- 172.21.15.45:0/2378682719 --> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f06e8068f00 con 0x7f06d405a510 2023-12-22T10:01:54.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.348+0000 7f06e4ff9700 1 -- 172.21.15.45:0/2378682719 <== mgr.4104 v2:172.21.15.45:6832/33679 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+503622 (secure 0 0 0) 0x7f06e8068f00 con 0x7f06d405a510 2023-12-22T10:01:54.360 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:01:54.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.360+0000 7f06edfb9700 1 -- 172.21.15.45:0/2378682719 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f06d405a510 msgr2=0x7f06d405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:54.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.360+0000 7f06edfb9700 1 --2- 172.21.15.45:0/2378682719 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f06d405a510 0x7f06d405c9d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f06dc003900 tx=0x7f06dc007d40).stop 2023-12-22T10:01:54.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.360+0000 7f06edfb9700 1 -- 172.21.15.45:0/2378682719 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06e8155e60 msgr2=0x7f06e814ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:54.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.360+0000 7f06edfb9700 1 --2- 172.21.15.45:0/2378682719 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06e8155e60 0x7f06e814ba50 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7f06e000c790 tx=0x7f06e00015e0).stop 2023-12-22T10:01:54.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.360+0000 7f06edfb9700 1 -- 172.21.15.45:0/2378682719 shutdown_connections 2023-12-22T10:01:54.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.360+0000 7f06edfb9700 1 --2- 172.21.15.45:0/2378682719 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06e8155e60 0x7f06e814ba50 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:54.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.360+0000 7f06edfb9700 1 --2- 172.21.15.45:0/2378682719 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f06d405a510 0x7f06d405c9d0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:54.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.360+0000 7f06edfb9700 1 --2- 172.21.15.45:0/2378682719 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f06e8151e00 0x7f06e80a8280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:54.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.360+0000 7f06edfb9700 1 --2- 172.21.15.45:0/2378682719 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f06e8151a20 0x7f06e80bd500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:54.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.360+0000 7f06edfb9700 1 -- 172.21.15.45:0/2378682719 >> 172.21.15.45:0/2378682719 conn(0x7f06e8067540 msgr2=0x7f06e80a9e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:54.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.360+0000 7f06edfb9700 1 -- 172.21.15.45:0/2378682719 shutdown_connections 2023-12-22T10:01:54.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.360+0000 7f06edfb9700 1 -- 172.21.15.45:0/2378682719 wait complete. 2023-12-22T10:01:54.366 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-12-22T10:01:54.382 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":81,"stamp":"2023-12-22T10:01:53.978102+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6291456,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":96,"num_write_kb":6180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":585,"ondisk_log_size":585,"up":402,"acting":402,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":316,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2392928,"kb_used_data":16160,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752581792,"statfs":{"total":773094113280,"available":770643755008,"internally_reserved":0,"allocated":16547840,"data_stored":14334296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-15489,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002053"},"pg_stats":[{"pgid":"7.3d","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.005787+0000","last_change":"2023-12-22T10:01:50.005787+0000","last_active":"2023-12-22T10:01:50.005787+0000","last_peered":"2023-12-22T10:01:50.005787+0000","last_clean":"2023-12-22T10:01:50.005787+0000","last_became_active":"2023-12-22T10:01:50.005246+0000","last_became_peered":"2023-12-22T10:01:50.005246+0000","last_unstale":"2023-12-22T10:01:50.005787+0000","last_undegraded":"2023-12-22T10:01:50.005787+0000","last_fullsized":"2023-12-22T10:01:50.005787+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3c","version":"36'8","reported_seq":25,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.994132+0000","last_change":"2023-12-22T10:01:35.152281+0000","last_active":"2023-12-22T10:01:49.994132+0000","last_peered":"2023-12-22T10:01:49.994132+0000","last_clean":"2023-12-22T10:01:49.994132+0000","last_became_active":"2023-12-22T10:01:35.151922+0000","last_became_peered":"2023-12-22T10:01:35.151922+0000","last_unstale":"2023-12-22T10:01:49.994132+0000","last_undegraded":"2023-12-22T10:01:49.994132+0000","last_fullsized":"2023-12-22T10:01:49.994132+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3f","version":"41'7","reported_seq":23,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.151522+0000","last_change":"2023-12-22T10:01:34.692598+0000","last_active":"2023-12-22T10:01:49.151522+0000","last_peered":"2023-12-22T10:01:49.151522+0000","last_clean":"2023-12-22T10:01:49.151522+0000","last_became_active":"2023-12-22T10:01:34.692294+0000","last_became_peered":"2023-12-22T10:01:34.692294+0000","last_unstale":"2023-12-22T10:01:49.151522+0000","last_undegraded":"2023-12-22T10:01:49.151522+0000","last_fullsized":"2023-12-22T10:01:49.151522+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.017559+0000","last_change":"2023-12-22T10:01:50.017559+0000","last_active":"2023-12-22T10:01:50.017559+0000","last_peered":"2023-12-22T10:01:50.017559+0000","last_clean":"2023-12-22T10:01:50.017559+0000","last_became_active":"2023-12-22T10:01:50.017261+0000","last_became_peered":"2023-12-22T10:01:50.017261+0000","last_unstale":"2023-12-22T10:01:50.017559+0000","last_undegraded":"2023-12-22T10:01:50.017559+0000","last_fullsized":"2023-12-22T10:01:50.017559+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.3d","version":"36'7","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.992771+0000","last_change":"2023-12-22T10:01:35.151608+0000","last_active":"2023-12-22T10:01:49.992771+0000","last_peered":"2023-12-22T10:01:49.992771+0000","last_clean":"2023-12-22T10:01:49.992771+0000","last_became_active":"2023-12-22T10:01:35.151006+0000","last_became_peered":"2023-12-22T10:01:35.151006+0000","last_unstale":"2023-12-22T10:01:49.992771+0000","last_undegraded":"2023-12-22T10:01:49.992771+0000","last_fullsized":"2023-12-22T10:01:49.992771+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.142291+0000","last_change":"2023-12-22T10:01:34.697062+0000","last_active":"2023-12-22T10:01:49.142291+0000","last_peered":"2023-12-22T10:01:49.142291+0000","last_clean":"2023-12-22T10:01:49.142291+0000","last_became_active":"2023-12-22T10:01:34.696760+0000","last_became_peered":"2023-12-22T10:01:34.696760+0000","last_unstale":"2023-12-22T10:01:49.142291+0000","last_undegraded":"2023-12-22T10:01:49.142291+0000","last_fullsized":"2023-12-22T10:01:49.142291+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3f","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.009220+0000","last_change":"2023-12-22T10:01:50.009220+0000","last_active":"2023-12-22T10:01:50.009220+0000","last_peered":"2023-12-22T10:01:50.009220+0000","last_clean":"2023-12-22T10:01:50.009220+0000","last_became_active":"2023-12-22T10:01:50.008919+0000","last_became_peered":"2023-12-22T10:01:50.008919+0000","last_unstale":"2023-12-22T10:01:50.009220+0000","last_undegraded":"2023-12-22T10:01:50.009220+0000","last_fullsized":"2023-12-22T10:01:50.009220+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3e","version":"36'4","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.993460+0000","last_change":"2023-12-22T10:01:35.134766+0000","last_active":"2023-12-22T10:01:49.993460+0000","last_peered":"2023-12-22T10:01:49.993460+0000","last_clean":"2023-12-22T10:01:49.993460+0000","last_became_active":"2023-12-22T10:01:35.131420+0000","last_became_peered":"2023-12-22T10:01:35.131420+0000","last_unstale":"2023-12-22T10:01:49.993460+0000","last_undegraded":"2023-12-22T10:01:49.993460+0000","last_fullsized":"2023-12-22T10:01:49.993460+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.136464+0000","last_change":"2023-12-22T10:01:34.705273+0000","last_active":"2023-12-22T10:01:49.136464+0000","last_peered":"2023-12-22T10:01:49.136464+0000","last_clean":"2023-12-22T10:01:49.136464+0000","last_became_active":"2023-12-22T10:01:34.704899+0000","last_became_peered":"2023-12-22T10:01:34.704899+0000","last_unstale":"2023-12-22T10:01:49.136464+0000","last_undegraded":"2023-12-22T10:01:49.136464+0000","last_fullsized":"2023-12-22T10:01:49.136464+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.009318+0000","last_change":"2023-12-22T10:01:50.009318+0000","last_active":"2023-12-22T10:01:50.009318+0000","last_peered":"2023-12-22T10:01:50.009318+0000","last_clean":"2023-12-22T10:01:50.009318+0000","last_became_active":"2023-12-22T10:01:50.008957+0000","last_became_peered":"2023-12-22T10:01:50.008957+0000","last_unstale":"2023-12-22T10:01:50.009318+0000","last_undegraded":"2023-12-22T10:01:50.009318+0000","last_fullsized":"2023-12-22T10:01:50.009318+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3f","version":"36'8","reported_seq":25,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.992818+0000","last_change":"2023-12-22T10:01:35.140720+0000","last_active":"2023-12-22T10:01:49.992818+0000","last_peered":"2023-12-22T10:01:49.992818+0000","last_clean":"2023-12-22T10:01:49.992818+0000","last_became_active":"2023-12-22T10:01:35.137419+0000","last_became_peered":"2023-12-22T10:01:35.137419+0000","last_unstale":"2023-12-22T10:01:49.992818+0000","last_undegraded":"2023-12-22T10:01:49.992818+0000","last_fullsized":"2023-12-22T10:01:49.992818+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3c","version":"41'3","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.994346+0000","last_change":"2023-12-22T10:01:34.698706+0000","last_active":"2023-12-22T10:01:49.994346+0000","last_peered":"2023-12-22T10:01:49.994346+0000","last_clean":"2023-12-22T10:01:49.994346+0000","last_became_active":"2023-12-22T10:01:34.698384+0000","last_became_peered":"2023-12-22T10:01:34.698384+0000","last_unstale":"2023-12-22T10:01:49.994346+0000","last_undegraded":"2023-12-22T10:01:49.994346+0000","last_fullsized":"2023-12-22T10:01:49.994346+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.024528+0000","last_change":"2023-12-22T10:01:50.024528+0000","last_active":"2023-12-22T10:01:50.024528+0000","last_peered":"2023-12-22T10:01:50.024528+0000","last_clean":"2023-12-22T10:01:50.024528+0000","last_became_active":"2023-12-22T10:01:50.024170+0000","last_became_peered":"2023-12-22T10:01:50.024170+0000","last_unstale":"2023-12-22T10:01:50.024528+0000","last_undegraded":"2023-12-22T10:01:50.024528+0000","last_fullsized":"2023-12-22T10:01:50.024528+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.38","version":"36'9","reported_seq":26,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.994803+0000","last_change":"2023-12-22T10:01:35.144798+0000","last_active":"2023-12-22T10:01:49.994803+0000","last_peered":"2023-12-22T10:01:49.994803+0000","last_clean":"2023-12-22T10:01:49.994803+0000","last_became_active":"2023-12-22T10:01:35.143992+0000","last_became_peered":"2023-12-22T10:01:35.143992+0000","last_unstale":"2023-12-22T10:01:49.994803+0000","last_undegraded":"2023-12-22T10:01:49.994803+0000","last_fullsized":"2023-12-22T10:01:49.994803+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"35'1","reported_seq":16,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.142110+0000","last_change":"2023-12-22T10:01:34.687808+0000","last_active":"2023-12-22T10:01:49.142110+0000","last_peered":"2023-12-22T10:01:49.142110+0000","last_clean":"2023-12-22T10:01:49.142110+0000","last_became_active":"2023-12-22T10:01:34.687419+0000","last_became_peered":"2023-12-22T10:01:34.687419+0000","last_unstale":"2023-12-22T10:01:49.142110+0000","last_undegraded":"2023-12-22T10:01:49.142110+0000","last_fullsized":"2023-12-22T10:01:49.142110+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.016819+0000","last_change":"2023-12-22T10:01:50.016819+0000","last_active":"2023-12-22T10:01:50.016819+0000","last_peered":"2023-12-22T10:01:50.016819+0000","last_clean":"2023-12-22T10:01:50.016819+0000","last_became_active":"2023-12-22T10:01:50.015901+0000","last_became_peered":"2023-12-22T10:01:50.015901+0000","last_unstale":"2023-12-22T10:01:50.016819+0000","last_undegraded":"2023-12-22T10:01:50.016819+0000","last_fullsized":"2023-12-22T10:01:50.016819+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.39","version":"36'5","reported_seq":19,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.135394+0000","last_change":"2023-12-22T10:01:35.135065+0000","last_active":"2023-12-22T10:01:49.135394+0000","last_peered":"2023-12-22T10:01:49.135394+0000","last_clean":"2023-12-22T10:01:49.135394+0000","last_became_active":"2023-12-22T10:01:35.134446+0000","last_became_peered":"2023-12-22T10:01:35.134446+0000","last_unstale":"2023-12-22T10:01:49.135394+0000","last_undegraded":"2023-12-22T10:01:49.135394+0000","last_fullsized":"2023-12-22T10:01:49.135394+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3a","version":"35'1","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.993340+0000","last_change":"2023-12-22T10:01:34.690637+0000","last_active":"2023-12-22T10:01:49.993340+0000","last_peered":"2023-12-22T10:01:49.993340+0000","last_clean":"2023-12-22T10:01:49.993340+0000","last_became_active":"2023-12-22T10:01:34.690359+0000","last_became_peered":"2023-12-22T10:01:34.690359+0000","last_unstale":"2023-12-22T10:01:49.993340+0000","last_undegraded":"2023-12-22T10:01:49.993340+0000","last_fullsized":"2023-12-22T10:01:49.993340+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.005696+0000","last_change":"2023-12-22T10:01:50.005696+0000","last_active":"2023-12-22T10:01:50.005696+0000","last_peered":"2023-12-22T10:01:50.005696+0000","last_clean":"2023-12-22T10:01:50.005696+0000","last_became_active":"2023-12-22T10:01:50.005382+0000","last_became_peered":"2023-12-22T10:01:50.005382+0000","last_unstale":"2023-12-22T10:01:50.005696+0000","last_undegraded":"2023-12-22T10:01:50.005696+0000","last_fullsized":"2023-12-22T10:01:50.005696+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3a","version":"36'6","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.990283+0000","last_change":"2023-12-22T10:01:35.136920+0000","last_active":"2023-12-22T10:01:49.990283+0000","last_peered":"2023-12-22T10:01:49.990283+0000","last_clean":"2023-12-22T10:01:49.990283+0000","last_became_active":"2023-12-22T10:01:35.136645+0000","last_became_peered":"2023-12-22T10:01:35.136645+0000","last_unstale":"2023-12-22T10:01:49.990283+0000","last_undegraded":"2023-12-22T10:01:49.990283+0000","last_fullsized":"2023-12-22T10:01:49.990283+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":16,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.149740+0000","last_change":"2023-12-22T10:01:34.705207+0000","last_active":"2023-12-22T10:01:49.149740+0000","last_peered":"2023-12-22T10:01:49.149740+0000","last_clean":"2023-12-22T10:01:49.149740+0000","last_became_active":"2023-12-22T10:01:34.704843+0000","last_became_peered":"2023-12-22T10:01:34.704843+0000","last_unstale":"2023-12-22T10:01:49.149740+0000","last_undegraded":"2023-12-22T10:01:49.149740+0000","last_fullsized":"2023-12-22T10:01:49.149740+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.023194+0000","last_change":"2023-12-22T10:01:50.021048+0000","last_active":"2023-12-22T10:01:50.023194+0000","last_peered":"2023-12-22T10:01:50.023194+0000","last_clean":"2023-12-22T10:01:50.023194+0000","last_became_active":"2023-12-22T10:01:50.020746+0000","last_became_peered":"2023-12-22T10:01:50.020746+0000","last_unstale":"2023-12-22T10:01:50.023194+0000","last_undegraded":"2023-12-22T10:01:50.023194+0000","last_fullsized":"2023-12-22T10:01:50.023194+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3b","version":"36'4","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.994792+0000","last_change":"2023-12-22T10:01:35.143343+0000","last_active":"2023-12-22T10:01:49.994792+0000","last_peered":"2023-12-22T10:01:49.994792+0000","last_clean":"2023-12-22T10:01:49.994792+0000","last_became_active":"2023-12-22T10:01:35.142969+0000","last_became_peered":"2023-12-22T10:01:35.142969+0000","last_unstale":"2023-12-22T10:01:49.994792+0000","last_undegraded":"2023-12-22T10:01:49.994792+0000","last_fullsized":"2023-12-22T10:01:49.994792+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":16,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.149096+0000","last_change":"2023-12-22T10:01:34.694961+0000","last_active":"2023-12-22T10:01:49.149096+0000","last_peered":"2023-12-22T10:01:49.149096+0000","last_clean":"2023-12-22T10:01:49.149096+0000","last_became_active":"2023-12-22T10:01:34.694670+0000","last_became_peered":"2023-12-22T10:01:34.694670+0000","last_unstale":"2023-12-22T10:01:49.149096+0000","last_undegraded":"2023-12-22T10:01:49.149096+0000","last_fullsized":"2023-12-22T10:01:49.149096+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.018904+0000","last_change":"2023-12-22T10:01:50.018904+0000","last_active":"2023-12-22T10:01:50.018904+0000","last_peered":"2023-12-22T10:01:50.018904+0000","last_clean":"2023-12-22T10:01:50.018904+0000","last_became_active":"2023-12-22T10:01:50.018699+0000","last_became_peered":"2023-12-22T10:01:50.018699+0000","last_unstale":"2023-12-22T10:01:50.018904+0000","last_undegraded":"2023-12-22T10:01:50.018904+0000","last_fullsized":"2023-12-22T10:01:50.018904+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"36'7","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.994663+0000","last_change":"2023-12-22T10:01:35.133665+0000","last_active":"2023-12-22T10:01:49.994663+0000","last_peered":"2023-12-22T10:01:49.994663+0000","last_clean":"2023-12-22T10:01:49.994663+0000","last_became_active":"2023-12-22T10:01:35.133400+0000","last_became_peered":"2023-12-22T10:01:35.133400+0000","last_unstale":"2023-12-22T10:01:49.994663+0000","last_undegraded":"2023-12-22T10:01:49.994663+0000","last_fullsized":"2023-12-22T10:01:49.994663+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.137020+0000","last_change":"2023-12-22T10:01:34.701407+0000","last_active":"2023-12-22T10:01:49.137020+0000","last_peered":"2023-12-22T10:01:49.137020+0000","last_clean":"2023-12-22T10:01:49.137020+0000","last_became_active":"2023-12-22T10:01:34.701143+0000","last_became_peered":"2023-12-22T10:01:34.701143+0000","last_unstale":"2023-12-22T10:01:49.137020+0000","last_undegraded":"2023-12-22T10:01:49.137020+0000","last_fullsized":"2023-12-22T10:01:49.137020+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.999874+0000","last_change":"2023-12-22T10:01:49.999874+0000","last_active":"2023-12-22T10:01:49.999874+0000","last_peered":"2023-12-22T10:01:49.999874+0000","last_clean":"2023-12-22T10:01:49.999874+0000","last_became_active":"2023-12-22T10:01:49.999389+0000","last_became_peered":"2023-12-22T10:01:49.999389+0000","last_unstale":"2023-12-22T10:01:49.999874+0000","last_undegraded":"2023-12-22T10:01:49.999874+0000","last_fullsized":"2023-12-22T10:01:49.999874+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.35","version":"36'6","reported_seq":20,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.150313+0000","last_change":"2023-12-22T10:01:35.148993+0000","last_active":"2023-12-22T10:01:49.150313+0000","last_peered":"2023-12-22T10:01:49.150313+0000","last_clean":"2023-12-22T10:01:49.150313+0000","last_became_active":"2023-12-22T10:01:35.148614+0000","last_became_peered":"2023-12-22T10:01:35.148614+0000","last_unstale":"2023-12-22T10:01:49.150313+0000","last_undegraded":"2023-12-22T10:01:49.150313+0000","last_fullsized":"2023-12-22T10:01:49.150313+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":18,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.993998+0000","last_change":"2023-12-22T10:01:34.690874+0000","last_active":"2023-12-22T10:01:49.993998+0000","last_peered":"2023-12-22T10:01:49.993998+0000","last_clean":"2023-12-22T10:01:49.993998+0000","last_became_active":"2023-12-22T10:01:34.690525+0000","last_became_peered":"2023-12-22T10:01:34.690525+0000","last_unstale":"2023-12-22T10:01:49.993998+0000","last_undegraded":"2023-12-22T10:01:49.993998+0000","last_fullsized":"2023-12-22T10:01:49.993998+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.010250+0000","last_change":"2023-12-22T10:01:50.006314+0000","last_active":"2023-12-22T10:01:50.010250+0000","last_peered":"2023-12-22T10:01:50.010250+0000","last_clean":"2023-12-22T10:01:50.010250+0000","last_became_active":"2023-12-22T10:01:50.005950+0000","last_became_peered":"2023-12-22T10:01:50.005950+0000","last_unstale":"2023-12-22T10:01:50.010250+0000","last_undegraded":"2023-12-22T10:01:50.010250+0000","last_fullsized":"2023-12-22T10:01:50.010250+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.36","version":"36'15","reported_seq":29,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.136193+0000","last_change":"2023-12-22T10:01:35.163651+0000","last_active":"2023-12-22T10:01:49.136193+0000","last_peered":"2023-12-22T10:01:49.136193+0000","last_clean":"2023-12-22T10:01:49.136193+0000","last_became_active":"2023-12-22T10:01:35.163305+0000","last_became_peered":"2023-12-22T10:01:35.163305+0000","last_unstale":"2023-12-22T10:01:49.136193+0000","last_undegraded":"2023-12-22T10:01:49.136193+0000","last_fullsized":"2023-12-22T10:01:49.136193+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":16,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.150201+0000","last_change":"2023-12-22T10:01:34.691997+0000","last_active":"2023-12-22T10:01:49.150201+0000","last_peered":"2023-12-22T10:01:49.150201+0000","last_clean":"2023-12-22T10:01:49.150201+0000","last_became_active":"2023-12-22T10:01:34.691557+0000","last_became_peered":"2023-12-22T10:01:34.691557+0000","last_unstale":"2023-12-22T10:01:49.150201+0000","last_undegraded":"2023-12-22T10:01:49.150201+0000","last_fullsized":"2023-12-22T10:01:49.150201+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.013954+0000","last_change":"2023-12-22T10:01:50.008491+0000","last_active":"2023-12-22T10:01:50.013954+0000","last_peered":"2023-12-22T10:01:50.013954+0000","last_clean":"2023-12-22T10:01:50.013954+0000","last_became_active":"2023-12-22T10:01:50.008177+0000","last_became_peered":"2023-12-22T10:01:50.008177+0000","last_unstale":"2023-12-22T10:01:50.013954+0000","last_undegraded":"2023-12-22T10:01:50.013954+0000","last_fullsized":"2023-12-22T10:01:50.013954+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.37","version":"36'11","reported_seq":28,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.993914+0000","last_change":"2023-12-22T10:01:35.153014+0000","last_active":"2023-12-22T10:01:49.993914+0000","last_peered":"2023-12-22T10:01:49.993914+0000","last_clean":"2023-12-22T10:01:49.993914+0000","last_became_active":"2023-12-22T10:01:35.152544+0000","last_became_peered":"2023-12-22T10:01:35.152544+0000","last_unstale":"2023-12-22T10:01:49.993914+0000","last_undegraded":"2023-12-22T10:01:49.993914+0000","last_fullsized":"2023-12-22T10:01:49.993914+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"41'15","reported_seq":30,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.136185+0000","last_change":"2023-12-22T10:01:34.698273+0000","last_active":"2023-12-22T10:01:49.136185+0000","last_peered":"2023-12-22T10:01:49.136185+0000","last_clean":"2023-12-22T10:01:49.136185+0000","last_became_active":"2023-12-22T10:01:34.697971+0000","last_became_peered":"2023-12-22T10:01:34.697971+0000","last_unstale":"2023-12-22T10:01:49.136185+0000","last_undegraded":"2023-12-22T10:01:49.136185+0000","last_fullsized":"2023-12-22T10:01:49.136185+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.015859+0000","last_change":"2023-12-22T10:01:50.015859+0000","last_active":"2023-12-22T10:01:50.015859+0000","last_peered":"2023-12-22T10:01:50.015859+0000","last_clean":"2023-12-22T10:01:50.015859+0000","last_became_active":"2023-12-22T10:01:50.015573+0000","last_became_peered":"2023-12-22T10:01:50.015573+0000","last_unstale":"2023-12-22T10:01:50.015859+0000","last_undegraded":"2023-12-22T10:01:50.015859+0000","last_fullsized":"2023-12-22T10:01:50.015859+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"36'9","reported_seq":23,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.134966+0000","last_change":"2023-12-22T10:01:35.157227+0000","last_active":"2023-12-22T10:01:49.134966+0000","last_peered":"2023-12-22T10:01:49.134966+0000","last_clean":"2023-12-22T10:01:49.134966+0000","last_became_active":"2023-12-22T10:01:35.156649+0000","last_became_peered":"2023-12-22T10:01:35.156649+0000","last_unstale":"2023-12-22T10:01:49.134966+0000","last_undegraded":"2023-12-22T10:01:49.134966+0000","last_fullsized":"2023-12-22T10:01:49.134966+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"41'2","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.991555+0000","last_change":"2023-12-22T10:01:34.696594+0000","last_active":"2023-12-22T10:01:49.991555+0000","last_peered":"2023-12-22T10:01:49.991555+0000","last_clean":"2023-12-22T10:01:49.991555+0000","last_became_active":"2023-12-22T10:01:34.696150+0000","last_became_peered":"2023-12-22T10:01:34.696150+0000","last_unstale":"2023-12-22T10:01:49.991555+0000","last_undegraded":"2023-12-22T10:01:49.991555+0000","last_fullsized":"2023-12-22T10:01:49.991555+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.022052+0000","last_change":"2023-12-22T10:01:50.022052+0000","last_active":"2023-12-22T10:01:50.022052+0000","last_peered":"2023-12-22T10:01:50.022052+0000","last_clean":"2023-12-22T10:01:50.022052+0000","last_became_active":"2023-12-22T10:01:50.021777+0000","last_became_peered":"2023-12-22T10:01:50.021777+0000","last_unstale":"2023-12-22T10:01:50.022052+0000","last_undegraded":"2023-12-22T10:01:50.022052+0000","last_fullsized":"2023-12-22T10:01:50.022052+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.31","version":"36'7","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.146998+0000","last_change":"2023-12-22T10:01:35.143685+0000","last_active":"2023-12-22T10:01:49.146998+0000","last_peered":"2023-12-22T10:01:49.146998+0000","last_clean":"2023-12-22T10:01:49.146998+0000","last_became_active":"2023-12-22T10:01:35.142366+0000","last_became_peered":"2023-12-22T10:01:35.142366+0000","last_unstale":"2023-12-22T10:01:49.146998+0000","last_undegraded":"2023-12-22T10:01:49.146998+0000","last_fullsized":"2023-12-22T10:01:49.146998+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":18,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.994049+0000","last_change":"2023-12-22T10:01:34.691884+0000","last_active":"2023-12-22T10:01:49.994049+0000","last_peered":"2023-12-22T10:01:49.994049+0000","last_clean":"2023-12-22T10:01:49.994049+0000","last_became_active":"2023-12-22T10:01:34.691602+0000","last_became_peered":"2023-12-22T10:01:34.691602+0000","last_unstale":"2023-12-22T10:01:49.994049+0000","last_undegraded":"2023-12-22T10:01:49.994049+0000","last_fullsized":"2023-12-22T10:01:49.994049+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.023189+0000","last_change":"2023-12-22T10:01:50.020971+0000","last_active":"2023-12-22T10:01:50.023189+0000","last_peered":"2023-12-22T10:01:50.023189+0000","last_clean":"2023-12-22T10:01:50.023189+0000","last_became_active":"2023-12-22T10:01:50.020655+0000","last_became_peered":"2023-12-22T10:01:50.020655+0000","last_unstale":"2023-12-22T10:01:50.023189+0000","last_undegraded":"2023-12-22T10:01:50.023189+0000","last_fullsized":"2023-12-22T10:01:50.023189+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.32","version":"36'8","reported_seq":23,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.150762+0000","last_change":"2023-12-22T10:01:35.137981+0000","last_active":"2023-12-22T10:01:49.150762+0000","last_peered":"2023-12-22T10:01:49.150762+0000","last_clean":"2023-12-22T10:01:49.150762+0000","last_became_active":"2023-12-22T10:01:35.137659+0000","last_became_peered":"2023-12-22T10:01:35.137659+0000","last_unstale":"2023-12-22T10:01:49.150762+0000","last_undegraded":"2023-12-22T10:01:49.150762+0000","last_fullsized":"2023-12-22T10:01:49.150762+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.149796+0000","last_change":"2023-12-22T10:01:34.701089+0000","last_active":"2023-12-22T10:01:49.149796+0000","last_peered":"2023-12-22T10:01:49.149796+0000","last_clean":"2023-12-22T10:01:49.149796+0000","last_became_active":"2023-12-22T10:01:34.699878+0000","last_became_peered":"2023-12-22T10:01:34.699878+0000","last_unstale":"2023-12-22T10:01:49.149796+0000","last_undegraded":"2023-12-22T10:01:49.149796+0000","last_fullsized":"2023-12-22T10:01:49.149796+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.016195+0000","last_change":"2023-12-22T10:01:50.016195+0000","last_active":"2023-12-22T10:01:50.016195+0000","last_peered":"2023-12-22T10:01:50.016195+0000","last_clean":"2023-12-22T10:01:50.016195+0000","last_became_active":"2023-12-22T10:01:50.015294+0000","last_became_peered":"2023-12-22T10:01:50.015294+0000","last_unstale":"2023-12-22T10:01:50.016195+0000","last_undegraded":"2023-12-22T10:01:50.016195+0000","last_fullsized":"2023-12-22T10:01:50.016195+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.33","version":"36'10","reported_seq":24,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.135793+0000","last_change":"2023-12-22T10:01:35.143515+0000","last_active":"2023-12-22T10:01:49.135793+0000","last_peered":"2023-12-22T10:01:49.135793+0000","last_clean":"2023-12-22T10:01:49.135793+0000","last_became_active":"2023-12-22T10:01:35.143051+0000","last_became_peered":"2023-12-22T10:01:35.143051+0000","last_unstale":"2023-12-22T10:01:49.135793+0000","last_undegraded":"2023-12-22T10:01:49.135793+0000","last_fullsized":"2023-12-22T10:01:49.135793+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.30","version":"41'9","reported_seq":24,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.150579+0000","last_change":"2023-12-22T10:01:34.682518+0000","last_active":"2023-12-22T10:01:49.150579+0000","last_peered":"2023-12-22T10:01:49.150579+0000","last_clean":"2023-12-22T10:01:49.150579+0000","last_became_active":"2023-12-22T10:01:34.680968+0000","last_became_peered":"2023-12-22T10:01:34.680968+0000","last_unstale":"2023-12-22T10:01:49.150579+0000","last_undegraded":"2023-12-22T10:01:49.150579+0000","last_fullsized":"2023-12-22T10:01:49.150579+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.003440+0000","last_change":"2023-12-22T10:01:50.003440+0000","last_active":"2023-12-22T10:01:50.003440+0000","last_peered":"2023-12-22T10:01:50.003440+0000","last_clean":"2023-12-22T10:01:50.003440+0000","last_became_active":"2023-12-22T10:01:50.003142+0000","last_became_peered":"2023-12-22T10:01:50.003142+0000","last_unstale":"2023-12-22T10:01:50.003440+0000","last_undegraded":"2023-12-22T10:01:50.003440+0000","last_fullsized":"2023-12-22T10:01:50.003440+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2c","version":"36'8","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.150156+0000","last_change":"2023-12-22T10:01:35.156632+0000","last_active":"2023-12-22T10:01:49.150156+0000","last_peered":"2023-12-22T10:01:49.150156+0000","last_clean":"2023-12-22T10:01:49.150156+0000","last_became_active":"2023-12-22T10:01:35.156348+0000","last_became_peered":"2023-12-22T10:01:35.156348+0000","last_unstale":"2023-12-22T10:01:49.150156+0000","last_undegraded":"2023-12-22T10:01:49.150156+0000","last_fullsized":"2023-12-22T10:01:49.150156+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":16,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.149719+0000","last_change":"2023-12-22T10:01:34.694956+0000","last_active":"2023-12-22T10:01:49.149719+0000","last_peered":"2023-12-22T10:01:49.149719+0000","last_clean":"2023-12-22T10:01:49.149719+0000","last_became_active":"2023-12-22T10:01:34.694670+0000","last_became_peered":"2023-12-22T10:01:34.694670+0000","last_unstale":"2023-12-22T10:01:49.149719+0000","last_undegraded":"2023-12-22T10:01:49.149719+0000","last_fullsized":"2023-12-22T10:01:49.149719+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.014674+0000","last_change":"2023-12-22T10:01:50.012069+0000","last_active":"2023-12-22T10:01:50.014674+0000","last_peered":"2023-12-22T10:01:50.014674+0000","last_clean":"2023-12-22T10:01:50.014674+0000","last_became_active":"2023-12-22T10:01:50.011441+0000","last_became_peered":"2023-12-22T10:01:50.011441+0000","last_unstale":"2023-12-22T10:01:50.014674+0000","last_undegraded":"2023-12-22T10:01:50.014674+0000","last_fullsized":"2023-12-22T10:01:50.014674+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2d","version":"36'7","reported_seq":21,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.143060+0000","last_change":"2023-12-22T10:01:35.145727+0000","last_active":"2023-12-22T10:01:49.143060+0000","last_peered":"2023-12-22T10:01:49.143060+0000","last_clean":"2023-12-22T10:01:49.143060+0000","last_became_active":"2023-12-22T10:01:35.143309+0000","last_became_peered":"2023-12-22T10:01:35.143309+0000","last_unstale":"2023-12-22T10:01:49.143060+0000","last_undegraded":"2023-12-22T10:01:49.143060+0000","last_fullsized":"2023-12-22T10:01:49.143060+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":18,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.995962+0000","last_change":"2023-12-22T10:01:34.693702+0000","last_active":"2023-12-22T10:01:49.995962+0000","last_peered":"2023-12-22T10:01:49.995962+0000","last_clean":"2023-12-22T10:01:49.995962+0000","last_became_active":"2023-12-22T10:01:34.693312+0000","last_became_peered":"2023-12-22T10:01:34.693312+0000","last_unstale":"2023-12-22T10:01:49.995962+0000","last_undegraded":"2023-12-22T10:01:49.995962+0000","last_fullsized":"2023-12-22T10:01:49.995962+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.999975+0000","last_change":"2023-12-22T10:01:49.999975+0000","last_active":"2023-12-22T10:01:49.999975+0000","last_peered":"2023-12-22T10:01:49.999975+0000","last_clean":"2023-12-22T10:01:49.999975+0000","last_became_active":"2023-12-22T10:01:49.999687+0000","last_became_peered":"2023-12-22T10:01:49.999687+0000","last_unstale":"2023-12-22T10:01:49.999975+0000","last_undegraded":"2023-12-22T10:01:49.999975+0000","last_fullsized":"2023-12-22T10:01:49.999975+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2e","version":"36'10","reported_seq":25,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.150058+0000","last_change":"2023-12-22T10:01:35.161551+0000","last_active":"2023-12-22T10:01:49.150058+0000","last_peered":"2023-12-22T10:01:49.150058+0000","last_clean":"2023-12-22T10:01:49.150058+0000","last_became_active":"2023-12-22T10:01:35.161234+0000","last_became_peered":"2023-12-22T10:01:35.161234+0000","last_unstale":"2023-12-22T10:01:49.150058+0000","last_undegraded":"2023-12-22T10:01:49.150058+0000","last_fullsized":"2023-12-22T10:01:49.150058+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"41'2","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.994295+0000","last_change":"2023-12-22T10:01:34.703838+0000","last_active":"2023-12-22T10:01:49.994295+0000","last_peered":"2023-12-22T10:01:49.994295+0000","last_clean":"2023-12-22T10:01:49.994295+0000","last_became_active":"2023-12-22T10:01:34.703546+0000","last_became_peered":"2023-12-22T10:01:34.703546+0000","last_unstale":"2023-12-22T10:01:49.994295+0000","last_undegraded":"2023-12-22T10:01:49.994295+0000","last_fullsized":"2023-12-22T10:01:49.994295+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.016291+0000","last_change":"2023-12-22T10:01:50.016291+0000","last_active":"2023-12-22T10:01:50.016291+0000","last_peered":"2023-12-22T10:01:50.016291+0000","last_clean":"2023-12-22T10:01:50.016291+0000","last_became_active":"2023-12-22T10:01:50.015984+0000","last_became_peered":"2023-12-22T10:01:50.015984+0000","last_unstale":"2023-12-22T10:01:50.016291+0000","last_undegraded":"2023-12-22T10:01:50.016291+0000","last_fullsized":"2023-12-22T10:01:50.016291+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2f","version":"36'9","reported_seq":24,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.149806+0000","last_change":"2023-12-22T10:01:35.162395+0000","last_active":"2023-12-22T10:01:49.149806+0000","last_peered":"2023-12-22T10:01:49.149806+0000","last_clean":"2023-12-22T10:01:49.149806+0000","last_became_active":"2023-12-22T10:01:35.162144+0000","last_became_peered":"2023-12-22T10:01:35.162144+0000","last_unstale":"2023-12-22T10:01:49.149806+0000","last_undegraded":"2023-12-22T10:01:49.149806+0000","last_fullsized":"2023-12-22T10:01:49.149806+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2097152,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":18,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.990577+0000","last_change":"2023-12-22T10:01:34.700164+0000","last_active":"2023-12-22T10:01:49.990577+0000","last_peered":"2023-12-22T10:01:49.990577+0000","last_clean":"2023-12-22T10:01:49.990577+0000","last_became_active":"2023-12-22T10:01:34.699864+0000","last_became_peered":"2023-12-22T10:01:34.699864+0000","last_unstale":"2023-12-22T10:01:49.990577+0000","last_undegraded":"2023-12-22T10:01:49.990577+0000","last_fullsized":"2023-12-22T10:01:49.990577+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.017039+0000","last_change":"2023-12-22T10:01:50.017039+0000","last_active":"2023-12-22T10:01:50.017039+0000","last_peered":"2023-12-22T10:01:50.017039+0000","last_clean":"2023-12-22T10:01:50.017039+0000","last_became_active":"2023-12-22T10:01:50.016152+0000","last_became_peered":"2023-12-22T10:01:50.016152+0000","last_unstale":"2023-12-22T10:01:50.017039+0000","last_undegraded":"2023-12-22T10:01:50.017039+0000","last_fullsized":"2023-12-22T10:01:50.017039+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.28","version":"36'6","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.994938+0000","last_change":"2023-12-22T10:01:35.144436+0000","last_active":"2023-12-22T10:01:49.994938+0000","last_peered":"2023-12-22T10:01:49.994938+0000","last_clean":"2023-12-22T10:01:49.994938+0000","last_became_active":"2023-12-22T10:01:35.143672+0000","last_became_peered":"2023-12-22T10:01:35.143672+0000","last_unstale":"2023-12-22T10:01:49.994938+0000","last_undegraded":"2023-12-22T10:01:49.994938+0000","last_fullsized":"2023-12-22T10:01:49.994938+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2b","version":"35'1","reported_seq":16,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.150866+0000","last_change":"2023-12-22T10:01:34.695729+0000","last_active":"2023-12-22T10:01:49.150866+0000","last_peered":"2023-12-22T10:01:49.150866+0000","last_clean":"2023-12-22T10:01:49.150866+0000","last_became_active":"2023-12-22T10:01:34.695350+0000","last_became_peered":"2023-12-22T10:01:34.695350+0000","last_unstale":"2023-12-22T10:01:49.150866+0000","last_undegraded":"2023-12-22T10:01:49.150866+0000","last_fullsized":"2023-12-22T10:01:49.150866+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.023520+0000","last_change":"2023-12-22T10:01:50.023520+0000","last_active":"2023-12-22T10:01:50.023520+0000","last_peered":"2023-12-22T10:01:50.023520+0000","last_clean":"2023-12-22T10:01:50.023520+0000","last_became_active":"2023-12-22T10:01:50.023053+0000","last_became_peered":"2023-12-22T10:01:50.023053+0000","last_unstale":"2023-12-22T10:01:50.023520+0000","last_undegraded":"2023-12-22T10:01:50.023520+0000","last_fullsized":"2023-12-22T10:01:50.023520+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.29","version":"36'8","reported_seq":23,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.147084+0000","last_change":"2023-12-22T10:01:35.153565+0000","last_active":"2023-12-22T10:01:49.147084+0000","last_peered":"2023-12-22T10:01:49.147084+0000","last_clean":"2023-12-22T10:01:49.147084+0000","last_became_active":"2023-12-22T10:01:35.153282+0000","last_became_peered":"2023-12-22T10:01:35.153282+0000","last_unstale":"2023-12-22T10:01:49.147084+0000","last_undegraded":"2023-12-22T10:01:49.147084+0000","last_fullsized":"2023-12-22T10:01:49.147084+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":16,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.150852+0000","last_change":"2023-12-22T10:01:34.698295+0000","last_active":"2023-12-22T10:01:49.150852+0000","last_peered":"2023-12-22T10:01:49.150852+0000","last_clean":"2023-12-22T10:01:49.150852+0000","last_became_active":"2023-12-22T10:01:34.697636+0000","last_became_peered":"2023-12-22T10:01:34.697636+0000","last_unstale":"2023-12-22T10:01:49.150852+0000","last_undegraded":"2023-12-22T10:01:49.150852+0000","last_fullsized":"2023-12-22T10:01:49.150852+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.018818+0000","last_change":"2023-12-22T10:01:50.018818+0000","last_active":"2023-12-22T10:01:50.018818+0000","last_peered":"2023-12-22T10:01:50.018818+0000","last_clean":"2023-12-22T10:01:50.018818+0000","last_became_active":"2023-12-22T10:01:50.018529+0000","last_became_peered":"2023-12-22T10:01:50.018529+0000","last_unstale":"2023-12-22T10:01:50.018818+0000","last_undegraded":"2023-12-22T10:01:50.018818+0000","last_fullsized":"2023-12-22T10:01:50.018818+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"36'9","reported_seq":23,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.149450+0000","last_change":"2023-12-22T10:01:35.145659+0000","last_active":"2023-12-22T10:01:49.149450+0000","last_peered":"2023-12-22T10:01:49.149450+0000","last_clean":"2023-12-22T10:01:49.149450+0000","last_became_active":"2023-12-22T10:01:35.145349+0000","last_became_peered":"2023-12-22T10:01:35.145349+0000","last_unstale":"2023-12-22T10:01:49.149450+0000","last_undegraded":"2023-12-22T10:01:49.149450+0000","last_fullsized":"2023-12-22T10:01:49.149450+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":18,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.989750+0000","last_change":"2023-12-22T10:01:34.706960+0000","last_active":"2023-12-22T10:01:49.989750+0000","last_peered":"2023-12-22T10:01:49.989750+0000","last_clean":"2023-12-22T10:01:49.989750+0000","last_became_active":"2023-12-22T10:01:34.706683+0000","last_became_peered":"2023-12-22T10:01:34.706683+0000","last_unstale":"2023-12-22T10:01:49.989750+0000","last_undegraded":"2023-12-22T10:01:49.989750+0000","last_fullsized":"2023-12-22T10:01:49.989750+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.009744+0000","last_change":"2023-12-22T10:01:50.002604+0000","last_active":"2023-12-22T10:01:50.009744+0000","last_peered":"2023-12-22T10:01:50.009744+0000","last_clean":"2023-12-22T10:01:50.009744+0000","last_became_active":"2023-12-22T10:01:50.002000+0000","last_became_peered":"2023-12-22T10:01:50.002000+0000","last_unstale":"2023-12-22T10:01:50.009744+0000","last_undegraded":"2023-12-22T10:01:50.009744+0000","last_fullsized":"2023-12-22T10:01:50.009744+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2b","version":"36'11","reported_seq":25,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.150743+0000","last_change":"2023-12-22T10:01:35.149661+0000","last_active":"2023-12-22T10:01:49.150743+0000","last_peered":"2023-12-22T10:01:49.150743+0000","last_clean":"2023-12-22T10:01:49.150743+0000","last_became_active":"2023-12-22T10:01:35.149440+0000","last_became_peered":"2023-12-22T10:01:35.149440+0000","last_unstale":"2023-12-22T10:01:49.150743+0000","last_undegraded":"2023-12-22T10:01:49.150743+0000","last_fullsized":"2023-12-22T10:01:49.150743+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":16,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.148876+0000","last_change":"2023-12-22T10:01:34.698945+0000","last_active":"2023-12-22T10:01:49.148876+0000","last_peered":"2023-12-22T10:01:49.148876+0000","last_clean":"2023-12-22T10:01:49.148876+0000","last_became_active":"2023-12-22T10:01:34.698609+0000","last_became_peered":"2023-12-22T10:01:34.698609+0000","last_unstale":"2023-12-22T10:01:49.148876+0000","last_undegraded":"2023-12-22T10:01:49.148876+0000","last_fullsized":"2023-12-22T10:01:49.148876+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.008012+0000","last_change":"2023-12-22T10:01:50.008012+0000","last_active":"2023-12-22T10:01:50.008012+0000","last_peered":"2023-12-22T10:01:50.008012+0000","last_clean":"2023-12-22T10:01:50.008012+0000","last_became_active":"2023-12-22T10:01:50.007756+0000","last_became_peered":"2023-12-22T10:01:50.007756+0000","last_unstale":"2023-12-22T10:01:50.008012+0000","last_undegraded":"2023-12-22T10:01:50.008012+0000","last_fullsized":"2023-12-22T10:01:50.008012+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.24","version":"36'4","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.135840+0000","last_change":"2023-12-22T10:01:35.155343+0000","last_active":"2023-12-22T10:01:49.135840+0000","last_peered":"2023-12-22T10:01:49.135840+0000","last_clean":"2023-12-22T10:01:49.135840+0000","last_became_active":"2023-12-22T10:01:35.154943+0000","last_became_peered":"2023-12-22T10:01:35.154943+0000","last_unstale":"2023-12-22T10:01:49.135840+0000","last_undegraded":"2023-12-22T10:01:49.135840+0000","last_fullsized":"2023-12-22T10:01:49.135840+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":18,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.992683+0000","last_change":"2023-12-22T10:01:34.689294+0000","last_active":"2023-12-22T10:01:49.992683+0000","last_peered":"2023-12-22T10:01:49.992683+0000","last_clean":"2023-12-22T10:01:49.992683+0000","last_became_active":"2023-12-22T10:01:34.687510+0000","last_became_peered":"2023-12-22T10:01:34.687510+0000","last_unstale":"2023-12-22T10:01:49.992683+0000","last_undegraded":"2023-12-22T10:01:49.992683+0000","last_fullsized":"2023-12-22T10:01:49.992683+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.013215+0000","last_change":"2023-12-22T10:01:50.013215+0000","last_active":"2023-12-22T10:01:50.013215+0000","last_peered":"2023-12-22T10:01:50.013215+0000","last_clean":"2023-12-22T10:01:50.013215+0000","last_became_active":"2023-12-22T10:01:50.012570+0000","last_became_peered":"2023-12-22T10:01:50.012570+0000","last_unstale":"2023-12-22T10:01:50.013215+0000","last_undegraded":"2023-12-22T10:01:50.013215+0000","last_fullsized":"2023-12-22T10:01:50.013215+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.25","version":"36'6","reported_seq":20,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.150401+0000","last_change":"2023-12-22T10:01:35.148843+0000","last_active":"2023-12-22T10:01:49.150401+0000","last_peered":"2023-12-22T10:01:49.150401+0000","last_clean":"2023-12-22T10:01:49.150401+0000","last_became_active":"2023-12-22T10:01:35.148363+0000","last_became_peered":"2023-12-22T10:01:35.148363+0000","last_unstale":"2023-12-22T10:01:49.150401+0000","last_undegraded":"2023-12-22T10:01:49.150401+0000","last_fullsized":"2023-12-22T10:01:49.150401+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.26","version":"41'3","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.994095+0000","last_change":"2023-12-22T10:01:34.702043+0000","last_active":"2023-12-22T10:01:49.994095+0000","last_peered":"2023-12-22T10:01:49.994095+0000","last_clean":"2023-12-22T10:01:49.994095+0000","last_became_active":"2023-12-22T10:01:34.701318+0000","last_became_peered":"2023-12-22T10:01:34.701318+0000","last_unstale":"2023-12-22T10:01:49.994095+0000","last_undegraded":"2023-12-22T10:01:49.994095+0000","last_fullsized":"2023-12-22T10:01:49.994095+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.009260+0000","last_change":"2023-12-22T10:01:50.009260+0000","last_active":"2023-12-22T10:01:50.009260+0000","last_peered":"2023-12-22T10:01:50.009260+0000","last_clean":"2023-12-22T10:01:50.009260+0000","last_became_active":"2023-12-22T10:01:50.008997+0000","last_became_peered":"2023-12-22T10:01:50.008997+0000","last_unstale":"2023-12-22T10:01:50.009260+0000","last_undegraded":"2023-12-22T10:01:50.009260+0000","last_fullsized":"2023-12-22T10:01:50.009260+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.26","version":"36'15","reported_seq":32,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.993891+0000","last_change":"2023-12-22T10:01:35.134712+0000","last_active":"2023-12-22T10:01:49.993891+0000","last_peered":"2023-12-22T10:01:49.993891+0000","last_clean":"2023-12-22T10:01:49.993891+0000","last_became_active":"2023-12-22T10:01:35.134447+0000","last_became_peered":"2023-12-22T10:01:35.134447+0000","last_unstale":"2023-12-22T10:01:49.993891+0000","last_undegraded":"2023-12-22T10:01:49.993891+0000","last_fullsized":"2023-12-22T10:01:49.993891+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.143146+0000","last_change":"2023-12-22T10:01:34.688497+0000","last_active":"2023-12-22T10:01:49.143146+0000","last_peered":"2023-12-22T10:01:49.143146+0000","last_clean":"2023-12-22T10:01:49.143146+0000","last_became_active":"2023-12-22T10:01:34.688207+0000","last_became_peered":"2023-12-22T10:01:34.688207+0000","last_unstale":"2023-12-22T10:01:49.143146+0000","last_undegraded":"2023-12-22T10:01:49.143146+0000","last_fullsized":"2023-12-22T10:01:49.143146+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.017463+0000","last_change":"2023-12-22T10:01:50.017463+0000","last_active":"2023-12-22T10:01:50.017463+0000","last_peered":"2023-12-22T10:01:50.017463+0000","last_clean":"2023-12-22T10:01:50.017463+0000","last_became_active":"2023-12-22T10:01:50.014988+0000","last_became_peered":"2023-12-22T10:01:50.014988+0000","last_unstale":"2023-12-22T10:01:50.017463+0000","last_undegraded":"2023-12-22T10:01:50.017463+0000","last_fullsized":"2023-12-22T10:01:50.017463+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.27","version":"36'2","reported_seq":17,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.151336+0000","last_change":"2023-12-22T10:01:35.143383+0000","last_active":"2023-12-22T10:01:49.151336+0000","last_peered":"2023-12-22T10:01:49.151336+0000","last_clean":"2023-12-22T10:01:49.151336+0000","last_became_active":"2023-12-22T10:01:35.143073+0000","last_became_peered":"2023-12-22T10:01:35.143073+0000","last_unstale":"2023-12-22T10:01:49.151336+0000","last_undegraded":"2023-12-22T10:01:49.151336+0000","last_fullsized":"2023-12-22T10:01:49.151336+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":16,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.152419+0000","last_change":"2023-12-22T10:01:34.695905+0000","last_active":"2023-12-22T10:01:49.152419+0000","last_peered":"2023-12-22T10:01:49.152419+0000","last_clean":"2023-12-22T10:01:49.152419+0000","last_became_active":"2023-12-22T10:01:34.695517+0000","last_became_peered":"2023-12-22T10:01:34.695517+0000","last_unstale":"2023-12-22T10:01:49.152419+0000","last_undegraded":"2023-12-22T10:01:49.152419+0000","last_fullsized":"2023-12-22T10:01:49.152419+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.001887+0000","last_change":"2023-12-22T10:01:49.999817+0000","last_active":"2023-12-22T10:01:50.001887+0000","last_peered":"2023-12-22T10:01:50.001887+0000","last_clean":"2023-12-22T10:01:50.001887+0000","last_became_active":"2023-12-22T10:01:49.999543+0000","last_became_peered":"2023-12-22T10:01:49.999543+0000","last_unstale":"2023-12-22T10:01:50.001887+0000","last_undegraded":"2023-12-22T10:01:50.001887+0000","last_fullsized":"2023-12-22T10:01:50.001887+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.20","version":"36'9","reported_seq":26,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.995067+0000","last_change":"2023-12-22T10:01:35.144625+0000","last_active":"2023-12-22T10:01:49.995067+0000","last_peered":"2023-12-22T10:01:49.995067+0000","last_clean":"2023-12-22T10:01:49.995067+0000","last_became_active":"2023-12-22T10:01:35.142641+0000","last_became_peered":"2023-12-22T10:01:35.142641+0000","last_unstale":"2023-12-22T10:01:49.995067+0000","last_undegraded":"2023-12-22T10:01:49.995067+0000","last_fullsized":"2023-12-22T10:01:49.995067+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.150932+0000","last_change":"2023-12-22T10:01:34.698158+0000","last_active":"2023-12-22T10:01:49.150932+0000","last_peered":"2023-12-22T10:01:49.150932+0000","last_clean":"2023-12-22T10:01:49.150932+0000","last_became_active":"2023-12-22T10:01:34.695554+0000","last_became_peered":"2023-12-22T10:01:34.695554+0000","last_unstale":"2023-12-22T10:01:49.150932+0000","last_undegraded":"2023-12-22T10:01:49.150932+0000","last_fullsized":"2023-12-22T10:01:49.150932+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.012039+0000","last_change":"2023-12-22T10:01:50.012039+0000","last_active":"2023-12-22T10:01:50.012039+0000","last_peered":"2023-12-22T10:01:50.012039+0000","last_clean":"2023-12-22T10:01:50.012039+0000","last_became_active":"2023-12-22T10:01:50.011753+0000","last_became_peered":"2023-12-22T10:01:50.011753+0000","last_unstale":"2023-12-22T10:01:50.012039+0000","last_undegraded":"2023-12-22T10:01:50.012039+0000","last_fullsized":"2023-12-22T10:01:50.012039+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.21","version":"36'12","reported_seq":26,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.135244+0000","last_change":"2023-12-22T10:01:35.134824+0000","last_active":"2023-12-22T10:01:49.135244+0000","last_peered":"2023-12-22T10:01:49.135244+0000","last_clean":"2023-12-22T10:01:49.135244+0000","last_became_active":"2023-12-22T10:01:35.134157+0000","last_became_peered":"2023-12-22T10:01:35.134157+0000","last_unstale":"2023-12-22T10:01:49.135244+0000","last_undegraded":"2023-12-22T10:01:49.135244+0000","last_fullsized":"2023-12-22T10:01:49.135244+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.149789+0000","last_change":"2023-12-22T10:01:34.690897+0000","last_active":"2023-12-22T10:01:49.149789+0000","last_peered":"2023-12-22T10:01:49.149789+0000","last_clean":"2023-12-22T10:01:49.149789+0000","last_became_active":"2023-12-22T10:01:34.689026+0000","last_became_peered":"2023-12-22T10:01:34.689026+0000","last_unstale":"2023-12-22T10:01:49.149789+0000","last_undegraded":"2023-12-22T10:01:49.149789+0000","last_fullsized":"2023-12-22T10:01:49.149789+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.007764+0000","last_change":"2023-12-22T10:01:50.007764+0000","last_active":"2023-12-22T10:01:50.007764+0000","last_peered":"2023-12-22T10:01:50.007764+0000","last_clean":"2023-12-22T10:01:50.007764+0000","last_became_active":"2023-12-22T10:01:50.006037+0000","last_became_peered":"2023-12-22T10:01:50.006037+0000","last_unstale":"2023-12-22T10:01:50.007764+0000","last_undegraded":"2023-12-22T10:01:50.007764+0000","last_fullsized":"2023-12-22T10:01:50.007764+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.22","version":"36'8","reported_seq":23,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.148945+0000","last_change":"2023-12-22T10:01:35.153324+0000","last_active":"2023-12-22T10:01:49.148945+0000","last_peered":"2023-12-22T10:01:49.148945+0000","last_clean":"2023-12-22T10:01:49.148945+0000","last_became_active":"2023-12-22T10:01:35.152234+0000","last_became_peered":"2023-12-22T10:01:35.152234+0000","last_unstale":"2023-12-22T10:01:49.148945+0000","last_undegraded":"2023-12-22T10:01:49.148945+0000","last_fullsized":"2023-12-22T10:01:49.148945+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":16,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.149814+0000","last_change":"2023-12-22T10:01:34.684413+0000","last_active":"2023-12-22T10:01:49.149814+0000","last_peered":"2023-12-22T10:01:49.149814+0000","last_clean":"2023-12-22T10:01:49.149814+0000","last_became_active":"2023-12-22T10:01:34.684083+0000","last_became_peered":"2023-12-22T10:01:34.684083+0000","last_unstale":"2023-12-22T10:01:49.149814+0000","last_undegraded":"2023-12-22T10:01:49.149814+0000","last_fullsized":"2023-12-22T10:01:49.149814+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.009675+0000","last_change":"2023-12-22T10:01:50.009675+0000","last_active":"2023-12-22T10:01:50.009675+0000","last_peered":"2023-12-22T10:01:50.009675+0000","last_clean":"2023-12-22T10:01:50.009675+0000","last_became_active":"2023-12-22T10:01:50.009187+0000","last_became_peered":"2023-12-22T10:01:50.009187+0000","last_unstale":"2023-12-22T10:01:50.009675+0000","last_undegraded":"2023-12-22T10:01:50.009675+0000","last_fullsized":"2023-12-22T10:01:50.009675+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.23","version":"36'7","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.149897+0000","last_change":"2023-12-22T10:01:35.152474+0000","last_active":"2023-12-22T10:01:49.149897+0000","last_peered":"2023-12-22T10:01:49.149897+0000","last_clean":"2023-12-22T10:01:49.149897+0000","last_became_active":"2023-12-22T10:01:35.152153+0000","last_became_peered":"2023-12-22T10:01:35.152153+0000","last_unstale":"2023-12-22T10:01:49.149897+0000","last_undegraded":"2023-12-22T10:01:49.149897+0000","last_fullsized":"2023-12-22T10:01:49.149897+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":16,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.146971+0000","last_change":"2023-12-22T10:01:34.689631+0000","last_active":"2023-12-22T10:01:49.146971+0000","last_peered":"2023-12-22T10:01:49.146971+0000","last_clean":"2023-12-22T10:01:49.146971+0000","last_became_active":"2023-12-22T10:01:34.689296+0000","last_became_peered":"2023-12-22T10:01:34.689296+0000","last_unstale":"2023-12-22T10:01:49.146971+0000","last_undegraded":"2023-12-22T10:01:49.146971+0000","last_fullsized":"2023-12-22T10:01:49.146971+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.016591+0000","last_change":"2023-12-22T10:01:50.016591+0000","last_active":"2023-12-22T10:01:50.016591+0000","last_peered":"2023-12-22T10:01:50.016591+0000","last_clean":"2023-12-22T10:01:50.016591+0000","last_became_active":"2023-12-22T10:01:50.016237+0000","last_became_peered":"2023-12-22T10:01:50.016237+0000","last_unstale":"2023-12-22T10:01:50.016591+0000","last_undegraded":"2023-12-22T10:01:50.016591+0000","last_fullsized":"2023-12-22T10:01:50.016591+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1c","version":"36'9","reported_seq":24,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.150431+0000","last_change":"2023-12-22T10:01:35.158342+0000","last_active":"2023-12-22T10:01:49.150431+0000","last_peered":"2023-12-22T10:01:49.150431+0000","last_clean":"2023-12-22T10:01:49.150431+0000","last_became_active":"2023-12-22T10:01:35.156056+0000","last_became_peered":"2023-12-22T10:01:35.156056+0000","last_unstale":"2023-12-22T10:01:49.150431+0000","last_undegraded":"2023-12-22T10:01:49.150431+0000","last_fullsized":"2023-12-22T10:01:49.150431+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"35'1","reported_seq":17,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.151627+0000","last_change":"2023-12-22T10:01:34.692535+0000","last_active":"2023-12-22T10:01:49.151627+0000","last_peered":"2023-12-22T10:01:49.151627+0000","last_clean":"2023-12-22T10:01:49.151627+0000","last_became_active":"2023-12-22T10:01:34.692223+0000","last_became_peered":"2023-12-22T10:01:34.692223+0000","last_unstale":"2023-12-22T10:01:49.151627+0000","last_undegraded":"2023-12-22T10:01:49.151627+0000","last_fullsized":"2023-12-22T10:01:49.151627+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.014041+0000","last_change":"2023-12-22T10:01:50.014041+0000","last_active":"2023-12-22T10:01:50.014041+0000","last_peered":"2023-12-22T10:01:50.014041+0000","last_clean":"2023-12-22T10:01:50.014041+0000","last_became_active":"2023-12-22T10:01:50.013539+0000","last_became_peered":"2023-12-22T10:01:50.013539+0000","last_unstale":"2023-12-22T10:01:50.014041+0000","last_undegraded":"2023-12-22T10:01:50.014041+0000","last_fullsized":"2023-12-22T10:01:50.014041+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"36'15","reported_seq":32,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.990687+0000","last_change":"2023-12-22T10:01:35.151202+0000","last_active":"2023-12-22T10:01:49.990687+0000","last_peered":"2023-12-22T10:01:49.990687+0000","last_clean":"2023-12-22T10:01:49.990687+0000","last_became_active":"2023-12-22T10:01:35.150961+0000","last_became_peered":"2023-12-22T10:01:35.150961+0000","last_unstale":"2023-12-22T10:01:49.990687+0000","last_undegraded":"2023-12-22T10:01:49.990687+0000","last_fullsized":"2023-12-22T10:01:49.990687+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"35'1","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.993689+0000","last_change":"2023-12-22T10:01:34.689373+0000","last_active":"2023-12-22T10:01:49.993689+0000","last_peered":"2023-12-22T10:01:49.993689+0000","last_clean":"2023-12-22T10:01:49.993689+0000","last_became_active":"2023-12-22T10:01:34.689010+0000","last_became_peered":"2023-12-22T10:01:34.689010+0000","last_unstale":"2023-12-22T10:01:49.993689+0000","last_undegraded":"2023-12-22T10:01:49.993689+0000","last_fullsized":"2023-12-22T10:01:49.993689+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.004786+0000","last_change":"2023-12-22T10:01:50.004786+0000","last_active":"2023-12-22T10:01:50.004786+0000","last_peered":"2023-12-22T10:01:50.004786+0000","last_clean":"2023-12-22T10:01:50.004786+0000","last_became_active":"2023-12-22T10:01:50.004548+0000","last_became_peered":"2023-12-22T10:01:50.004548+0000","last_unstale":"2023-12-22T10:01:50.004786+0000","last_undegraded":"2023-12-22T10:01:50.004786+0000","last_fullsized":"2023-12-22T10:01:50.004786+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"36'5","reported_seq":20,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.150262+0000","last_change":"2023-12-22T10:01:35.157214+0000","last_active":"2023-12-22T10:01:49.150262+0000","last_peered":"2023-12-22T10:01:49.150262+0000","last_clean":"2023-12-22T10:01:49.150262+0000","last_became_active":"2023-12-22T10:01:35.156041+0000","last_became_peered":"2023-12-22T10:01:35.156041+0000","last_unstale":"2023-12-22T10:01:49.150262+0000","last_undegraded":"2023-12-22T10:01:49.150262+0000","last_fullsized":"2023-12-22T10:01:49.150262+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"41'3","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.992599+0000","last_change":"2023-12-22T10:01:34.693006+0000","last_active":"2023-12-22T10:01:49.992599+0000","last_peered":"2023-12-22T10:01:49.992599+0000","last_clean":"2023-12-22T10:01:49.992599+0000","last_became_active":"2023-12-22T10:01:34.692460+0000","last_became_peered":"2023-12-22T10:01:34.692460+0000","last_unstale":"2023-12-22T10:01:49.992599+0000","last_undegraded":"2023-12-22T10:01:49.992599+0000","last_fullsized":"2023-12-22T10:01:49.992599+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.013042+0000","last_change":"2023-12-22T10:01:50.010840+0000","last_active":"2023-12-22T10:01:50.013042+0000","last_peered":"2023-12-22T10:01:50.013042+0000","last_clean":"2023-12-22T10:01:50.013042+0000","last_became_active":"2023-12-22T10:01:50.010285+0000","last_became_peered":"2023-12-22T10:01:50.010285+0000","last_unstale":"2023-12-22T10:01:50.013042+0000","last_undegraded":"2023-12-22T10:01:50.013042+0000","last_fullsized":"2023-12-22T10:01:50.013042+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1f","version":"36'6","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.993987+0000","last_change":"2023-12-22T10:01:35.145742+0000","last_active":"2023-12-22T10:01:49.993987+0000","last_peered":"2023-12-22T10:01:49.993987+0000","last_clean":"2023-12-22T10:01:49.993987+0000","last_became_active":"2023-12-22T10:01:35.145385+0000","last_became_peered":"2023-12-22T10:01:35.145385+0000","last_unstale":"2023-12-22T10:01:49.993987+0000","last_undegraded":"2023-12-22T10:01:49.993987+0000","last_fullsized":"2023-12-22T10:01:49.993987+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":16,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.152829+0000","last_change":"2023-12-22T10:01:34.698319+0000","last_active":"2023-12-22T10:01:49.152829+0000","last_peered":"2023-12-22T10:01:49.152829+0000","last_clean":"2023-12-22T10:01:49.152829+0000","last_became_active":"2023-12-22T10:01:34.698118+0000","last_became_peered":"2023-12-22T10:01:34.698118+0000","last_unstale":"2023-12-22T10:01:49.152829+0000","last_undegraded":"2023-12-22T10:01:49.152829+0000","last_fullsized":"2023-12-22T10:01:49.152829+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.008343+0000","last_change":"2023-12-22T10:01:50.008343+0000","last_active":"2023-12-22T10:01:50.008343+0000","last_peered":"2023-12-22T10:01:50.008343+0000","last_clean":"2023-12-22T10:01:50.008343+0000","last_became_active":"2023-12-22T10:01:50.007973+0000","last_became_peered":"2023-12-22T10:01:50.007973+0000","last_unstale":"2023-12-22T10:01:50.008343+0000","last_undegraded":"2023-12-22T10:01:50.008343+0000","last_fullsized":"2023-12-22T10:01:50.008343+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.18","version":"36'8","reported_seq":25,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.995148+0000","last_change":"2023-12-22T10:01:35.144227+0000","last_active":"2023-12-22T10:01:49.995148+0000","last_peered":"2023-12-22T10:01:49.995148+0000","last_clean":"2023-12-22T10:01:49.995148+0000","last_became_active":"2023-12-22T10:01:35.141822+0000","last_became_peered":"2023-12-22T10:01:35.141822+0000","last_unstale":"2023-12-22T10:01:49.995148+0000","last_undegraded":"2023-12-22T10:01:49.995148+0000","last_fullsized":"2023-12-22T10:01:49.995148+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":16,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.153014+0000","last_change":"2023-12-22T10:01:34.687654+0000","last_active":"2023-12-22T10:01:49.153014+0000","last_peered":"2023-12-22T10:01:49.153014+0000","last_clean":"2023-12-22T10:01:49.153014+0000","last_became_active":"2023-12-22T10:01:34.687337+0000","last_became_peered":"2023-12-22T10:01:34.687337+0000","last_unstale":"2023-12-22T10:01:49.153014+0000","last_undegraded":"2023-12-22T10:01:49.153014+0000","last_fullsized":"2023-12-22T10:01:49.153014+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.018656+0000","last_change":"2023-12-22T10:01:50.015643+0000","last_active":"2023-12-22T10:01:50.018656+0000","last_peered":"2023-12-22T10:01:50.018656+0000","last_clean":"2023-12-22T10:01:50.018656+0000","last_became_active":"2023-12-22T10:01:50.015323+0000","last_became_peered":"2023-12-22T10:01:50.015323+0000","last_unstale":"2023-12-22T10:01:50.018656+0000","last_undegraded":"2023-12-22T10:01:50.018656+0000","last_fullsized":"2023-12-22T10:01:50.018656+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"36'10","reported_seq":24,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.149700+0000","last_change":"2023-12-22T10:01:35.148573+0000","last_active":"2023-12-22T10:01:49.149700+0000","last_peered":"2023-12-22T10:01:49.149700+0000","last_clean":"2023-12-22T10:01:49.149700+0000","last_became_active":"2023-12-22T10:01:35.148279+0000","last_became_peered":"2023-12-22T10:01:35.148279+0000","last_unstale":"2023-12-22T10:01:49.149700+0000","last_undegraded":"2023-12-22T10:01:49.149700+0000","last_fullsized":"2023-12-22T10:01:49.149700+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.135728+0000","last_change":"2023-12-22T10:01:34.702330+0000","last_active":"2023-12-22T10:01:49.135728+0000","last_peered":"2023-12-22T10:01:49.135728+0000","last_clean":"2023-12-22T10:01:49.135728+0000","last_became_active":"2023-12-22T10:01:34.701937+0000","last_became_peered":"2023-12-22T10:01:34.701937+0000","last_unstale":"2023-12-22T10:01:49.135728+0000","last_undegraded":"2023-12-22T10:01:49.135728+0000","last_fullsized":"2023-12-22T10:01:49.135728+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.022969+0000","last_change":"2023-12-22T10:01:50.019611+0000","last_active":"2023-12-22T10:01:50.022969+0000","last_peered":"2023-12-22T10:01:50.022969+0000","last_clean":"2023-12-22T10:01:50.022969+0000","last_became_active":"2023-12-22T10:01:50.019383+0000","last_became_peered":"2023-12-22T10:01:50.019383+0000","last_unstale":"2023-12-22T10:01:50.022969+0000","last_undegraded":"2023-12-22T10:01:50.022969+0000","last_fullsized":"2023-12-22T10:01:50.022969+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"36'7","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.149051+0000","last_change":"2023-12-22T10:01:35.161623+0000","last_active":"2023-12-22T10:01:49.149051+0000","last_peered":"2023-12-22T10:01:49.149051+0000","last_clean":"2023-12-22T10:01:49.149051+0000","last_became_active":"2023-12-22T10:01:35.161366+0000","last_became_peered":"2023-12-22T10:01:35.161366+0000","last_unstale":"2023-12-22T10:01:49.149051+0000","last_undegraded":"2023-12-22T10:01:49.149051+0000","last_fullsized":"2023-12-22T10:01:49.149051+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":18,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.991145+0000","last_change":"2023-12-22T10:01:34.694683+0000","last_active":"2023-12-22T10:01:49.991145+0000","last_peered":"2023-12-22T10:01:49.991145+0000","last_clean":"2023-12-22T10:01:49.991145+0000","last_became_active":"2023-12-22T10:01:34.693873+0000","last_became_peered":"2023-12-22T10:01:34.693873+0000","last_unstale":"2023-12-22T10:01:49.991145+0000","last_undegraded":"2023-12-22T10:01:49.991145+0000","last_fullsized":"2023-12-22T10:01:49.991145+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.004492+0000","last_change":"2023-12-22T10:01:50.004492+0000","last_active":"2023-12-22T10:01:50.004492+0000","last_peered":"2023-12-22T10:01:50.004492+0000","last_clean":"2023-12-22T10:01:50.004492+0000","last_became_active":"2023-12-22T10:01:50.004195+0000","last_became_peered":"2023-12-22T10:01:50.004195+0000","last_unstale":"2023-12-22T10:01:50.004492+0000","last_undegraded":"2023-12-22T10:01:50.004492+0000","last_fullsized":"2023-12-22T10:01:50.004492+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1b","version":"36'8","reported_seq":25,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.991423+0000","last_change":"2023-12-22T10:01:35.141439+0000","last_active":"2023-12-22T10:01:49.991423+0000","last_peered":"2023-12-22T10:01:49.991423+0000","last_clean":"2023-12-22T10:01:49.991423+0000","last_became_active":"2023-12-22T10:01:35.141140+0000","last_became_peered":"2023-12-22T10:01:35.141140+0000","last_unstale":"2023-12-22T10:01:49.991423+0000","last_undegraded":"2023-12-22T10:01:49.991423+0000","last_fullsized":"2023-12-22T10:01:49.991423+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.135032+0000","last_change":"2023-12-22T10:01:34.701959+0000","last_active":"2023-12-22T10:01:49.135032+0000","last_peered":"2023-12-22T10:01:49.135032+0000","last_clean":"2023-12-22T10:01:49.135032+0000","last_became_active":"2023-12-22T10:01:34.693141+0000","last_became_peered":"2023-12-22T10:01:34.693141+0000","last_unstale":"2023-12-22T10:01:49.135032+0000","last_undegraded":"2023-12-22T10:01:49.135032+0000","last_fullsized":"2023-12-22T10:01:49.135032+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.022436+0000","last_change":"2023-12-22T10:01:50.022436+0000","last_active":"2023-12-22T10:01:50.022436+0000","last_peered":"2023-12-22T10:01:50.022436+0000","last_clean":"2023-12-22T10:01:50.022436+0000","last_became_active":"2023-12-22T10:01:50.021995+0000","last_became_peered":"2023-12-22T10:01:50.021995+0000","last_unstale":"2023-12-22T10:01:50.022436+0000","last_undegraded":"2023-12-22T10:01:50.022436+0000","last_fullsized":"2023-12-22T10:01:50.022436+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"36'11","reported_seq":28,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.994241+0000","last_change":"2023-12-22T10:01:35.153160+0000","last_active":"2023-12-22T10:01:49.994241+0000","last_peered":"2023-12-22T10:01:49.994241+0000","last_clean":"2023-12-22T10:01:49.994241+0000","last_became_active":"2023-12-22T10:01:35.152160+0000","last_became_peered":"2023-12-22T10:01:35.152160+0000","last_unstale":"2023-12-22T10:01:49.994241+0000","last_undegraded":"2023-12-22T10:01:49.994241+0000","last_fullsized":"2023-12-22T10:01:49.994241+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":18,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.992913+0000","last_change":"2023-12-22T10:01:34.685148+0000","last_active":"2023-12-22T10:01:49.992913+0000","last_peered":"2023-12-22T10:01:49.992913+0000","last_clean":"2023-12-22T10:01:49.992913+0000","last_became_active":"2023-12-22T10:01:34.684840+0000","last_became_peered":"2023-12-22T10:01:34.684840+0000","last_unstale":"2023-12-22T10:01:49.992913+0000","last_undegraded":"2023-12-22T10:01:49.992913+0000","last_fullsized":"2023-12-22T10:01:49.992913+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.019852+0000","last_change":"2023-12-22T10:01:50.019852+0000","last_active":"2023-12-22T10:01:50.019852+0000","last_peered":"2023-12-22T10:01:50.019852+0000","last_clean":"2023-12-22T10:01:50.019852+0000","last_became_active":"2023-12-22T10:01:50.019485+0000","last_became_peered":"2023-12-22T10:01:50.019485+0000","last_unstale":"2023-12-22T10:01:50.019852+0000","last_undegraded":"2023-12-22T10:01:50.019852+0000","last_fullsized":"2023-12-22T10:01:50.019852+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"36'6","reported_seq":21,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.153270+0000","last_change":"2023-12-22T10:01:35.152114+0000","last_active":"2023-12-22T10:01:49.153270+0000","last_peered":"2023-12-22T10:01:49.153270+0000","last_clean":"2023-12-22T10:01:49.153270+0000","last_became_active":"2023-12-22T10:01:35.151816+0000","last_became_peered":"2023-12-22T10:01:35.151816+0000","last_unstale":"2023-12-22T10:01:49.153270+0000","last_undegraded":"2023-12-22T10:01:49.153270+0000","last_fullsized":"2023-12-22T10:01:49.153270+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":16,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.150153+0000","last_change":"2023-12-22T10:01:34.693683+0000","last_active":"2023-12-22T10:01:49.150153+0000","last_peered":"2023-12-22T10:01:49.150153+0000","last_clean":"2023-12-22T10:01:49.150153+0000","last_became_active":"2023-12-22T10:01:34.693296+0000","last_became_peered":"2023-12-22T10:01:34.693296+0000","last_unstale":"2023-12-22T10:01:49.150153+0000","last_undegraded":"2023-12-22T10:01:49.150153+0000","last_fullsized":"2023-12-22T10:01:49.150153+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.998354+0000","last_change":"2023-12-22T10:01:49.998354+0000","last_active":"2023-12-22T10:01:49.998354+0000","last_peered":"2023-12-22T10:01:49.998354+0000","last_clean":"2023-12-22T10:01:49.998354+0000","last_became_active":"2023-12-22T10:01:49.997935+0000","last_became_peered":"2023-12-22T10:01:49.997935+0000","last_unstale":"2023-12-22T10:01:49.998354+0000","last_undegraded":"2023-12-22T10:01:49.998354+0000","last_fullsized":"2023-12-22T10:01:49.998354+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.16","version":"36'10","reported_seq":27,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.994016+0000","last_change":"2023-12-22T10:01:35.138193+0000","last_active":"2023-12-22T10:01:49.994016+0000","last_peered":"2023-12-22T10:01:49.994016+0000","last_clean":"2023-12-22T10:01:49.994016+0000","last_became_active":"2023-12-22T10:01:35.137926+0000","last_became_peered":"2023-12-22T10:01:35.137926+0000","last_unstale":"2023-12-22T10:01:49.994016+0000","last_undegraded":"2023-12-22T10:01:49.994016+0000","last_fullsized":"2023-12-22T10:01:49.994016+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"41'5","reported_seq":21,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.150109+0000","last_change":"2023-12-22T10:01:34.696240+0000","last_active":"2023-12-22T10:01:49.150109+0000","last_peered":"2023-12-22T10:01:49.150109+0000","last_clean":"2023-12-22T10:01:49.150109+0000","last_became_active":"2023-12-22T10:01:34.695913+0000","last_became_peered":"2023-12-22T10:01:34.695913+0000","last_unstale":"2023-12-22T10:01:49.150109+0000","last_undegraded":"2023-12-22T10:01:49.150109+0000","last_fullsized":"2023-12-22T10:01:49.150109+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.006651+0000","last_change":"2023-12-22T10:01:50.006651+0000","last_active":"2023-12-22T10:01:50.006651+0000","last_peered":"2023-12-22T10:01:50.006651+0000","last_clean":"2023-12-22T10:01:50.006651+0000","last_became_active":"2023-12-22T10:01:50.006361+0000","last_became_peered":"2023-12-22T10:01:50.006361+0000","last_unstale":"2023-12-22T10:01:50.006651+0000","last_undegraded":"2023-12-22T10:01:50.006651+0000","last_fullsized":"2023-12-22T10:01:50.006651+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"36'9","reported_seq":23,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.136870+0000","last_change":"2023-12-22T10:01:35.136369+0000","last_active":"2023-12-22T10:01:49.136870+0000","last_peered":"2023-12-22T10:01:49.136870+0000","last_clean":"2023-12-22T10:01:49.136870+0000","last_became_active":"2023-12-22T10:01:35.136123+0000","last_became_peered":"2023-12-22T10:01:35.136123+0000","last_unstale":"2023-12-22T10:01:49.136870+0000","last_undegraded":"2023-12-22T10:01:49.136870+0000","last_fullsized":"2023-12-22T10:01:49.136870+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"41'7","reported_seq":25,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.994471+0000","last_change":"2023-12-22T10:01:34.690599+0000","last_active":"2023-12-22T10:01:49.994471+0000","last_peered":"2023-12-22T10:01:49.994471+0000","last_clean":"2023-12-22T10:01:49.994471+0000","last_became_active":"2023-12-22T10:01:34.690313+0000","last_became_peered":"2023-12-22T10:01:34.690313+0000","last_unstale":"2023-12-22T10:01:49.994471+0000","last_undegraded":"2023-12-22T10:01:49.994471+0000","last_fullsized":"2023-12-22T10:01:49.994471+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.996941+0000","last_change":"2023-12-22T10:01:49.996941+0000","last_active":"2023-12-22T10:01:49.996941+0000","last_peered":"2023-12-22T10:01:49.996941+0000","last_clean":"2023-12-22T10:01:49.996941+0000","last_became_active":"2023-12-22T10:01:49.996479+0000","last_became_peered":"2023-12-22T10:01:49.996479+0000","last_unstale":"2023-12-22T10:01:49.996941+0000","last_undegraded":"2023-12-22T10:01:49.996941+0000","last_fullsized":"2023-12-22T10:01:49.996941+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.10","version":"36'6","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.995221+0000","last_change":"2023-12-22T10:01:35.141012+0000","last_active":"2023-12-22T10:01:49.995221+0000","last_peered":"2023-12-22T10:01:49.995221+0000","last_clean":"2023-12-22T10:01:49.995221+0000","last_became_active":"2023-12-22T10:01:35.140498+0000","last_became_peered":"2023-12-22T10:01:35.140498+0000","last_unstale":"2023-12-22T10:01:49.995221+0000","last_undegraded":"2023-12-22T10:01:49.995221+0000","last_fullsized":"2023-12-22T10:01:49.995221+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"41'3","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.992683+0000","last_change":"2023-12-22T10:01:34.694064+0000","last_active":"2023-12-22T10:01:49.992683+0000","last_peered":"2023-12-22T10:01:49.992683+0000","last_clean":"2023-12-22T10:01:49.992683+0000","last_became_active":"2023-12-22T10:01:34.693775+0000","last_became_peered":"2023-12-22T10:01:34.693775+0000","last_unstale":"2023-12-22T10:01:49.992683+0000","last_undegraded":"2023-12-22T10:01:49.992683+0000","last_fullsized":"2023-12-22T10:01:49.992683+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.012883+0000","last_change":"2023-12-22T10:01:50.008873+0000","last_active":"2023-12-22T10:01:50.012883+0000","last_peered":"2023-12-22T10:01:50.012883+0000","last_clean":"2023-12-22T10:01:50.012883+0000","last_became_active":"2023-12-22T10:01:50.004656+0000","last_became_peered":"2023-12-22T10:01:50.004656+0000","last_unstale":"2023-12-22T10:01:50.012883+0000","last_undegraded":"2023-12-22T10:01:50.012883+0000","last_fullsized":"2023-12-22T10:01:50.012883+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.11","version":"36'6","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.989406+0000","last_change":"2023-12-22T10:01:35.136270+0000","last_active":"2023-12-22T10:01:49.989406+0000","last_peered":"2023-12-22T10:01:49.989406+0000","last_clean":"2023-12-22T10:01:49.989406+0000","last_became_active":"2023-12-22T10:01:35.135729+0000","last_became_peered":"2023-12-22T10:01:35.135729+0000","last_unstale":"2023-12-22T10:01:49.989406+0000","last_undegraded":"2023-12-22T10:01:49.989406+0000","last_fullsized":"2023-12-22T10:01:49.989406+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":18,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.990547+0000","last_change":"2023-12-22T10:01:34.705576+0000","last_active":"2023-12-22T10:01:49.990547+0000","last_peered":"2023-12-22T10:01:49.990547+0000","last_clean":"2023-12-22T10:01:49.990547+0000","last_became_active":"2023-12-22T10:01:34.705340+0000","last_became_peered":"2023-12-22T10:01:34.705340+0000","last_unstale":"2023-12-22T10:01:49.990547+0000","last_undegraded":"2023-12-22T10:01:49.990547+0000","last_fullsized":"2023-12-22T10:01:49.990547+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.012982+0000","last_change":"2023-12-22T10:01:50.009454+0000","last_active":"2023-12-22T10:01:50.012982+0000","last_peered":"2023-12-22T10:01:50.012982+0000","last_clean":"2023-12-22T10:01:50.012982+0000","last_became_active":"2023-12-22T10:01:50.009154+0000","last_became_peered":"2023-12-22T10:01:50.009154+0000","last_unstale":"2023-12-22T10:01:50.012982+0000","last_undegraded":"2023-12-22T10:01:50.012982+0000","last_fullsized":"2023-12-22T10:01:50.012982+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.12","version":"36'10","reported_seq":24,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.149885+0000","last_change":"2023-12-22T10:01:35.140150+0000","last_active":"2023-12-22T10:01:49.149885+0000","last_peered":"2023-12-22T10:01:49.149885+0000","last_clean":"2023-12-22T10:01:49.149885+0000","last_became_active":"2023-12-22T10:01:35.139884+0000","last_became_peered":"2023-12-22T10:01:35.139884+0000","last_unstale":"2023-12-22T10:01:49.149885+0000","last_undegraded":"2023-12-22T10:01:49.149885+0000","last_fullsized":"2023-12-22T10:01:49.149885+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":16,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.147196+0000","last_change":"2023-12-22T10:01:34.690703+0000","last_active":"2023-12-22T10:01:49.147196+0000","last_peered":"2023-12-22T10:01:49.147196+0000","last_clean":"2023-12-22T10:01:49.147196+0000","last_became_active":"2023-12-22T10:01:34.690369+0000","last_became_peered":"2023-12-22T10:01:34.690369+0000","last_unstale":"2023-12-22T10:01:49.147196+0000","last_undegraded":"2023-12-22T10:01:49.147196+0000","last_fullsized":"2023-12-22T10:01:49.147196+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.020970+0000","last_change":"2023-12-22T10:01:50.020970+0000","last_active":"2023-12-22T10:01:50.020970+0000","last_peered":"2023-12-22T10:01:50.020970+0000","last_clean":"2023-12-22T10:01:50.020970+0000","last_became_active":"2023-12-22T10:01:50.016890+0000","last_became_peered":"2023-12-22T10:01:50.016890+0000","last_unstale":"2023-12-22T10:01:50.020970+0000","last_undegraded":"2023-12-22T10:01:50.020970+0000","last_fullsized":"2023-12-22T10:01:50.020970+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.13","version":"36'15","reported_seq":32,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.992398+0000","last_change":"2023-12-22T10:01:35.128289+0000","last_active":"2023-12-22T10:01:49.992398+0000","last_peered":"2023-12-22T10:01:49.992398+0000","last_clean":"2023-12-22T10:01:49.992398+0000","last_became_active":"2023-12-22T10:01:35.127995+0000","last_became_peered":"2023-12-22T10:01:35.127995+0000","last_unstale":"2023-12-22T10:01:49.992398+0000","last_undegraded":"2023-12-22T10:01:49.992398+0000","last_fullsized":"2023-12-22T10:01:49.992398+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"41'6","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.148958+0000","last_change":"2023-12-22T10:01:34.705549+0000","last_active":"2023-12-22T10:01:49.148958+0000","last_peered":"2023-12-22T10:01:49.148958+0000","last_clean":"2023-12-22T10:01:49.148958+0000","last_became_active":"2023-12-22T10:01:34.704846+0000","last_became_peered":"2023-12-22T10:01:34.704846+0000","last_unstale":"2023-12-22T10:01:49.148958+0000","last_undegraded":"2023-12-22T10:01:49.148958+0000","last_fullsized":"2023-12-22T10:01:49.148958+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.005509+0000","last_change":"2023-12-22T10:01:50.005509+0000","last_active":"2023-12-22T10:01:50.005509+0000","last_peered":"2023-12-22T10:01:50.005509+0000","last_clean":"2023-12-22T10:01:50.005509+0000","last_became_active":"2023-12-22T10:01:50.005190+0000","last_became_peered":"2023-12-22T10:01:50.005190+0000","last_unstale":"2023-12-22T10:01:50.005509+0000","last_undegraded":"2023-12-22T10:01:50.005509+0000","last_fullsized":"2023-12-22T10:01:50.005509+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"36'6","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.990458+0000","last_change":"2023-12-22T10:01:35.139893+0000","last_active":"2023-12-22T10:01:49.990458+0000","last_peered":"2023-12-22T10:01:49.990458+0000","last_clean":"2023-12-22T10:01:49.990458+0000","last_became_active":"2023-12-22T10:01:35.138934+0000","last_became_peered":"2023-12-22T10:01:35.138934+0000","last_unstale":"2023-12-22T10:01:49.990458+0000","last_undegraded":"2023-12-22T10:01:49.990458+0000","last_fullsized":"2023-12-22T10:01:49.990458+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"41'2","reported_seq":17,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.137290+0000","last_change":"2023-12-22T10:01:34.687756+0000","last_active":"2023-12-22T10:01:49.137290+0000","last_peered":"2023-12-22T10:01:49.137290+0000","last_clean":"2023-12-22T10:01:49.137290+0000","last_became_active":"2023-12-22T10:01:34.687316+0000","last_became_peered":"2023-12-22T10:01:34.687316+0000","last_unstale":"2023-12-22T10:01:49.137290+0000","last_undegraded":"2023-12-22T10:01:49.137290+0000","last_fullsized":"2023-12-22T10:01:49.137290+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.023706+0000","last_change":"2023-12-22T10:01:50.023706+0000","last_active":"2023-12-22T10:01:50.023706+0000","last_peered":"2023-12-22T10:01:50.023706+0000","last_clean":"2023-12-22T10:01:50.023706+0000","last_became_active":"2023-12-22T10:01:50.023361+0000","last_became_peered":"2023-12-22T10:01:50.023361+0000","last_unstale":"2023-12-22T10:01:50.023706+0000","last_undegraded":"2023-12-22T10:01:50.023706+0000","last_fullsized":"2023-12-22T10:01:50.023706+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"36'7","reported_seq":21,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.136304+0000","last_change":"2023-12-22T10:01:35.142614+0000","last_active":"2023-12-22T10:01:49.136304+0000","last_peered":"2023-12-22T10:01:49.136304+0000","last_clean":"2023-12-22T10:01:49.136304+0000","last_became_active":"2023-12-22T10:01:35.139303+0000","last_became_peered":"2023-12-22T10:01:35.139303+0000","last_unstale":"2023-12-22T10:01:49.136304+0000","last_undegraded":"2023-12-22T10:01:49.136304+0000","last_fullsized":"2023-12-22T10:01:49.136304+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"41'3","reported_seq":19,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.150366+0000","last_change":"2023-12-22T10:01:34.696868+0000","last_active":"2023-12-22T10:01:49.150366+0000","last_peered":"2023-12-22T10:01:49.150366+0000","last_clean":"2023-12-22T10:01:49.150366+0000","last_became_active":"2023-12-22T10:01:34.696571+0000","last_became_peered":"2023-12-22T10:01:34.696571+0000","last_unstale":"2023-12-22T10:01:49.150366+0000","last_undegraded":"2023-12-22T10:01:49.150366+0000","last_fullsized":"2023-12-22T10:01:49.150366+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.009970+0000","last_change":"2023-12-22T10:01:50.005005+0000","last_active":"2023-12-22T10:01:50.009970+0000","last_peered":"2023-12-22T10:01:50.009970+0000","last_clean":"2023-12-22T10:01:50.009970+0000","last_became_active":"2023-12-22T10:01:50.004641+0000","last_became_peered":"2023-12-22T10:01:50.004641+0000","last_unstale":"2023-12-22T10:01:50.009970+0000","last_undegraded":"2023-12-22T10:01:50.009970+0000","last_fullsized":"2023-12-22T10:01:50.009970+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"36'5","reported_seq":19,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.136135+0000","last_change":"2023-12-22T10:01:35.141882+0000","last_active":"2023-12-22T10:01:49.136135+0000","last_peered":"2023-12-22T10:01:49.136135+0000","last_clean":"2023-12-22T10:01:49.136135+0000","last_became_active":"2023-12-22T10:01:35.141536+0000","last_became_peered":"2023-12-22T10:01:35.141536+0000","last_unstale":"2023-12-22T10:01:49.136135+0000","last_undegraded":"2023-12-22T10:01:49.136135+0000","last_fullsized":"2023-12-22T10:01:49.136135+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":18,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.993061+0000","last_change":"2023-12-22T10:01:34.699249+0000","last_active":"2023-12-22T10:01:49.993061+0000","last_peered":"2023-12-22T10:01:49.993061+0000","last_clean":"2023-12-22T10:01:49.993061+0000","last_became_active":"2023-12-22T10:01:34.698955+0000","last_became_peered":"2023-12-22T10:01:34.698955+0000","last_unstale":"2023-12-22T10:01:49.993061+0000","last_undegraded":"2023-12-22T10:01:49.993061+0000","last_fullsized":"2023-12-22T10:01:49.993061+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.007279+0000","last_change":"2023-12-22T10:01:50.006101+0000","last_active":"2023-12-22T10:01:50.007279+0000","last_peered":"2023-12-22T10:01:50.007279+0000","last_clean":"2023-12-22T10:01:50.007279+0000","last_became_active":"2023-12-22T10:01:50.005369+0000","last_became_peered":"2023-12-22T10:01:50.005369+0000","last_unstale":"2023-12-22T10:01:50.007279+0000","last_undegraded":"2023-12-22T10:01:50.007279+0000","last_fullsized":"2023-12-22T10:01:50.007279+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"36'9","reported_seq":23,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.142181+0000","last_change":"2023-12-22T10:01:35.143645+0000","last_active":"2023-12-22T10:01:49.142181+0000","last_peered":"2023-12-22T10:01:49.142181+0000","last_clean":"2023-12-22T10:01:49.142181+0000","last_became_active":"2023-12-22T10:01:35.143327+0000","last_became_peered":"2023-12-22T10:01:35.143327+0000","last_unstale":"2023-12-22T10:01:49.142181+0000","last_undegraded":"2023-12-22T10:01:49.142181+0000","last_fullsized":"2023-12-22T10:01:49.142181+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.142482+0000","last_change":"2023-12-22T10:01:34.697799+0000","last_active":"2023-12-22T10:01:49.142482+0000","last_peered":"2023-12-22T10:01:49.142482+0000","last_clean":"2023-12-22T10:01:49.142482+0000","last_became_active":"2023-12-22T10:01:34.697233+0000","last_became_peered":"2023-12-22T10:01:34.697233+0000","last_unstale":"2023-12-22T10:01:49.142482+0000","last_undegraded":"2023-12-22T10:01:49.142482+0000","last_fullsized":"2023-12-22T10:01:49.142482+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.010690+0000","last_change":"2023-12-22T10:01:50.010690+0000","last_active":"2023-12-22T10:01:50.010690+0000","last_peered":"2023-12-22T10:01:50.010690+0000","last_clean":"2023-12-22T10:01:50.010690+0000","last_became_active":"2023-12-22T10:01:50.010405+0000","last_became_peered":"2023-12-22T10:01:50.010405+0000","last_unstale":"2023-12-22T10:01:50.010690+0000","last_undegraded":"2023-12-22T10:01:50.010690+0000","last_fullsized":"2023-12-22T10:01:50.010690+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"36'9","reported_seq":24,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.146873+0000","last_change":"2023-12-22T10:01:35.156435+0000","last_active":"2023-12-22T10:01:49.146873+0000","last_peered":"2023-12-22T10:01:49.146873+0000","last_clean":"2023-12-22T10:01:49.146873+0000","last_became_active":"2023-12-22T10:01:35.156132+0000","last_became_peered":"2023-12-22T10:01:35.156132+0000","last_unstale":"2023-12-22T10:01:49.146873+0000","last_undegraded":"2023-12-22T10:01:49.146873+0000","last_fullsized":"2023-12-22T10:01:49.146873+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"41'3","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.142253+0000","last_change":"2023-12-22T10:01:34.681213+0000","last_active":"2023-12-22T10:01:49.142253+0000","last_peered":"2023-12-22T10:01:49.142253+0000","last_clean":"2023-12-22T10:01:49.142253+0000","last_became_active":"2023-12-22T10:01:34.680928+0000","last_became_peered":"2023-12-22T10:01:34.680928+0000","last_unstale":"2023-12-22T10:01:49.142253+0000","last_undegraded":"2023-12-22T10:01:49.142253+0000","last_fullsized":"2023-12-22T10:01:49.142253+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.019491+0000","last_change":"2023-12-22T10:01:50.019491+0000","last_active":"2023-12-22T10:01:50.019491+0000","last_peered":"2023-12-22T10:01:50.019491+0000","last_clean":"2023-12-22T10:01:50.019491+0000","last_became_active":"2023-12-22T10:01:50.018516+0000","last_became_peered":"2023-12-22T10:01:50.018516+0000","last_unstale":"2023-12-22T10:01:50.019491+0000","last_undegraded":"2023-12-22T10:01:50.019491+0000","last_fullsized":"2023-12-22T10:01:50.019491+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"36'2","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.991004+0000","last_change":"2023-12-22T10:01:35.140301+0000","last_active":"2023-12-22T10:01:49.991004+0000","last_peered":"2023-12-22T10:01:49.991004+0000","last_clean":"2023-12-22T10:01:49.991004+0000","last_became_active":"2023-12-22T10:01:35.140013+0000","last_became_peered":"2023-12-22T10:01:35.140013+0000","last_unstale":"2023-12-22T10:01:49.991004+0000","last_undegraded":"2023-12-22T10:01:49.991004+0000","last_fullsized":"2023-12-22T10:01:49.991004+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":18,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.990425+0000","last_change":"2023-12-22T10:01:34.700554+0000","last_active":"2023-12-22T10:01:49.990425+0000","last_peered":"2023-12-22T10:01:49.990425+0000","last_clean":"2023-12-22T10:01:49.990425+0000","last_became_active":"2023-12-22T10:01:34.700250+0000","last_became_peered":"2023-12-22T10:01:34.700250+0000","last_unstale":"2023-12-22T10:01:49.990425+0000","last_undegraded":"2023-12-22T10:01:49.990425+0000","last_fullsized":"2023-12-22T10:01:49.990425+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.003901+0000","last_change":"2023-12-22T10:01:50.002814+0000","last_active":"2023-12-22T10:01:50.003901+0000","last_peered":"2023-12-22T10:01:50.003901+0000","last_clean":"2023-12-22T10:01:50.003901+0000","last_became_active":"2023-12-22T10:01:50.002549+0000","last_became_peered":"2023-12-22T10:01:50.002549+0000","last_unstale":"2023-12-22T10:01:50.003901+0000","last_undegraded":"2023-12-22T10:01:50.003901+0000","last_fullsized":"2023-12-22T10:01:50.003901+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"36'5","reported_seq":19,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.149567+0000","last_change":"2023-12-22T10:01:35.149330+0000","last_active":"2023-12-22T10:01:49.149567+0000","last_peered":"2023-12-22T10:01:49.149567+0000","last_clean":"2023-12-22T10:01:49.149567+0000","last_became_active":"2023-12-22T10:01:35.148997+0000","last_became_peered":"2023-12-22T10:01:35.148997+0000","last_unstale":"2023-12-22T10:01:49.149567+0000","last_undegraded":"2023-12-22T10:01:49.149567+0000","last_fullsized":"2023-12-22T10:01:49.149567+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.135644+0000","last_change":"2023-12-22T10:01:34.706221+0000","last_active":"2023-12-22T10:01:49.135644+0000","last_peered":"2023-12-22T10:01:49.135644+0000","last_clean":"2023-12-22T10:01:49.135644+0000","last_became_active":"2023-12-22T10:01:34.705796+0000","last_became_peered":"2023-12-22T10:01:34.705796+0000","last_unstale":"2023-12-22T10:01:49.135644+0000","last_undegraded":"2023-12-22T10:01:49.135644+0000","last_fullsized":"2023-12-22T10:01:49.135644+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.010632+0000","last_change":"2023-12-22T10:01:50.003069+0000","last_active":"2023-12-22T10:01:50.010632+0000","last_peered":"2023-12-22T10:01:50.010632+0000","last_clean":"2023-12-22T10:01:50.010632+0000","last_became_active":"2023-12-22T10:01:50.002805+0000","last_became_peered":"2023-12-22T10:01:50.002805+0000","last_unstale":"2023-12-22T10:01:50.010632+0000","last_undegraded":"2023-12-22T10:01:50.010632+0000","last_fullsized":"2023-12-22T10:01:50.010632+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.b","version":"36'8","reported_seq":25,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.992582+0000","last_change":"2023-12-22T10:01:35.140317+0000","last_active":"2023-12-22T10:01:49.992582+0000","last_peered":"2023-12-22T10:01:49.992582+0000","last_clean":"2023-12-22T10:01:49.992582+0000","last_became_active":"2023-12-22T10:01:35.140015+0000","last_became_peered":"2023-12-22T10:01:35.140015+0000","last_unstale":"2023-12-22T10:01:49.992582+0000","last_undegraded":"2023-12-22T10:01:49.992582+0000","last_fullsized":"2023-12-22T10:01:49.992582+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":18,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.989876+0000","last_change":"2023-12-22T10:01:34.695101+0000","last_active":"2023-12-22T10:01:49.989876+0000","last_peered":"2023-12-22T10:01:49.989876+0000","last_clean":"2023-12-22T10:01:49.989876+0000","last_became_active":"2023-12-22T10:01:34.694803+0000","last_became_peered":"2023-12-22T10:01:34.694803+0000","last_unstale":"2023-12-22T10:01:49.989876+0000","last_undegraded":"2023-12-22T10:01:49.989876+0000","last_fullsized":"2023-12-22T10:01:49.989876+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.010613+0000","last_change":"2023-12-22T10:01:50.002777+0000","last_active":"2023-12-22T10:01:50.010613+0000","last_peered":"2023-12-22T10:01:50.010613+0000","last_clean":"2023-12-22T10:01:50.010613+0000","last_became_active":"2023-12-22T10:01:50.002463+0000","last_became_peered":"2023-12-22T10:01:50.002463+0000","last_unstale":"2023-12-22T10:01:50.010613+0000","last_undegraded":"2023-12-22T10:01:50.010613+0000","last_fullsized":"2023-12-22T10:01:50.010613+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"36'7","reported_seq":21,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.150839+0000","last_change":"2023-12-22T10:01:35.148013+0000","last_active":"2023-12-22T10:01:49.150839+0000","last_peered":"2023-12-22T10:01:49.150839+0000","last_clean":"2023-12-22T10:01:49.150839+0000","last_became_active":"2023-12-22T10:01:35.147694+0000","last_became_peered":"2023-12-22T10:01:35.147694+0000","last_unstale":"2023-12-22T10:01:49.150839+0000","last_undegraded":"2023-12-22T10:01:49.150839+0000","last_fullsized":"2023-12-22T10:01:49.150839+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":18,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.995497+0000","last_change":"2023-12-22T10:01:34.698883+0000","last_active":"2023-12-22T10:01:49.995497+0000","last_peered":"2023-12-22T10:01:49.995497+0000","last_clean":"2023-12-22T10:01:49.995497+0000","last_became_active":"2023-12-22T10:01:34.698295+0000","last_became_peered":"2023-12-22T10:01:34.698295+0000","last_unstale":"2023-12-22T10:01:49.995497+0000","last_undegraded":"2023-12-22T10:01:49.995497+0000","last_fullsized":"2023-12-22T10:01:49.995497+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":31,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.150000+0000","last_change":"2023-12-22T10:00:28.036372+0000","last_active":"2023-12-22T10:01:49.150000+0000","last_peered":"2023-12-22T10:01:49.150000+0000","last_clean":"2023-12-22T10:01:49.150000+0000","last_became_active":"2023-12-22T10:00:28.035974+0000","last_became_peered":"2023-12-22T10:00:28.035974+0000","last_unstale":"2023-12-22T10:01:49.150000+0000","last_undegraded":"2023-12-22T10:01:49.150000+0000","last_fullsized":"2023-12-22T10:01:49.150000+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_clean_scrub_stamp":"2023-12-22T10:00:27.001906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.016852+0000","last_change":"2023-12-22T10:01:50.016852+0000","last_active":"2023-12-22T10:01:50.016852+0000","last_peered":"2023-12-22T10:01:50.016852+0000","last_clean":"2023-12-22T10:01:50.016852+0000","last_became_active":"2023-12-22T10:01:50.015151+0000","last_became_peered":"2023-12-22T10:01:50.015151+0000","last_unstale":"2023-12-22T10:01:50.016852+0000","last_undegraded":"2023-12-22T10:01:50.016852+0000","last_fullsized":"2023-12-22T10:01:50.016852+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2","version":"36'8","reported_seq":23,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.149167+0000","last_change":"2023-12-22T10:01:35.153601+0000","last_active":"2023-12-22T10:01:49.149167+0000","last_peered":"2023-12-22T10:01:49.149167+0000","last_clean":"2023-12-22T10:01:49.149167+0000","last_became_active":"2023-12-22T10:01:35.152791+0000","last_became_peered":"2023-12-22T10:01:35.152791+0000","last_unstale":"2023-12-22T10:01:49.149167+0000","last_undegraded":"2023-12-22T10:01:49.149167+0000","last_fullsized":"2023-12-22T10:01:49.149167+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":16,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.147307+0000","last_change":"2023-12-22T10:01:34.680407+0000","last_active":"2023-12-22T10:01:49.147307+0000","last_peered":"2023-12-22T10:01:49.147307+0000","last_clean":"2023-12-22T10:01:49.147307+0000","last_became_active":"2023-12-22T10:01:34.679458+0000","last_became_peered":"2023-12-22T10:01:34.679458+0000","last_unstale":"2023-12-22T10:01:49.147307+0000","last_undegraded":"2023-12-22T10:01:49.147307+0000","last_fullsized":"2023-12-22T10:01:49.147307+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":35,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.994109+0000","last_change":"2023-12-22T10:00:28.035308+0000","last_active":"2023-12-22T10:01:49.994109+0000","last_peered":"2023-12-22T10:01:49.994109+0000","last_clean":"2023-12-22T10:01:49.994109+0000","last_became_active":"2023-12-22T10:00:28.035002+0000","last_became_peered":"2023-12-22T10:00:28.035002+0000","last_unstale":"2023-12-22T10:01:49.994109+0000","last_undegraded":"2023-12-22T10:01:49.994109+0000","last_fullsized":"2023-12-22T10:01:49.994109+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_clean_scrub_stamp":"2023-12-22T10:00:27.001906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.021130+0000","last_change":"2023-12-22T10:01:50.021130+0000","last_active":"2023-12-22T10:01:50.021130+0000","last_peered":"2023-12-22T10:01:50.021130+0000","last_clean":"2023-12-22T10:01:50.021130+0000","last_became_active":"2023-12-22T10:01:50.020930+0000","last_became_peered":"2023-12-22T10:01:50.020930+0000","last_unstale":"2023-12-22T10:01:50.021130+0000","last_undegraded":"2023-12-22T10:01:50.021130+0000","last_fullsized":"2023-12-22T10:01:50.021130+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"36'5","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.989575+0000","last_change":"2023-12-22T10:01:35.156062+0000","last_active":"2023-12-22T10:01:49.989575+0000","last_peered":"2023-12-22T10:01:49.989575+0000","last_clean":"2023-12-22T10:01:49.989575+0000","last_became_active":"2023-12-22T10:01:35.155705+0000","last_became_peered":"2023-12-22T10:01:35.155705+0000","last_unstale":"2023-12-22T10:01:49.989575+0000","last_undegraded":"2023-12-22T10:01:49.989575+0000","last_fullsized":"2023-12-22T10:01:49.989575+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.149968+0000","last_change":"2023-12-22T10:01:34.684207+0000","last_active":"2023-12-22T10:01:49.149968+0000","last_peered":"2023-12-22T10:01:49.149968+0000","last_clean":"2023-12-22T10:01:49.149968+0000","last_became_active":"2023-12-22T10:01:34.683911+0000","last_became_peered":"2023-12-22T10:01:34.683911+0000","last_unstale":"2023-12-22T10:01:49.149968+0000","last_undegraded":"2023-12-22T10:01:49.149968+0000","last_fullsized":"2023-12-22T10:01:49.149968+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":31,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.150293+0000","last_change":"2023-12-22T10:00:28.029892+0000","last_active":"2023-12-22T10:01:49.150293+0000","last_peered":"2023-12-22T10:01:49.150293+0000","last_clean":"2023-12-22T10:01:49.150293+0000","last_became_active":"2023-12-22T10:00:28.029391+0000","last_became_peered":"2023-12-22T10:00:28.029391+0000","last_unstale":"2023-12-22T10:01:49.150293+0000","last_undegraded":"2023-12-22T10:01:49.150293+0000","last_fullsized":"2023-12-22T10:01:49.150293+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_clean_scrub_stamp":"2023-12-22T10:00:27.001906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.996762+0000","last_change":"2023-12-22T10:01:49.996762+0000","last_active":"2023-12-22T10:01:49.996762+0000","last_peered":"2023-12-22T10:01:49.996762+0000","last_clean":"2023-12-22T10:01:49.996762+0000","last_became_active":"2023-12-22T10:01:49.996197+0000","last_became_peered":"2023-12-22T10:01:49.996197+0000","last_unstale":"2023-12-22T10:01:49.996762+0000","last_undegraded":"2023-12-22T10:01:49.996762+0000","last_fullsized":"2023-12-22T10:01:49.996762+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"36'8","reported_seq":25,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.992629+0000","last_change":"2023-12-22T10:01:35.130148+0000","last_active":"2023-12-22T10:01:49.992629+0000","last_peered":"2023-12-22T10:01:49.992629+0000","last_clean":"2023-12-22T10:01:49.992629+0000","last_became_active":"2023-12-22T10:01:35.129858+0000","last_became_peered":"2023-12-22T10:01:35.129858+0000","last_unstale":"2023-12-22T10:01:49.992629+0000","last_undegraded":"2023-12-22T10:01:49.992629+0000","last_fullsized":"2023-12-22T10:01:49.992629+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":18,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.992872+0000","last_change":"2023-12-22T10:01:34.693923+0000","last_active":"2023-12-22T10:01:49.992872+0000","last_peered":"2023-12-22T10:01:49.992872+0000","last_clean":"2023-12-22T10:01:49.992872+0000","last_became_active":"2023-12-22T10:01:34.693616+0000","last_became_peered":"2023-12-22T10:01:34.693616+0000","last_unstale":"2023-12-22T10:01:49.992872+0000","last_undegraded":"2023-12-22T10:01:49.992872+0000","last_fullsized":"2023-12-22T10:01:49.992872+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":30,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.142605+0000","last_change":"2023-12-22T10:00:28.025395+0000","last_active":"2023-12-22T10:01:49.142605+0000","last_peered":"2023-12-22T10:01:49.142605+0000","last_clean":"2023-12-22T10:01:49.142605+0000","last_became_active":"2023-12-22T10:00:28.024588+0000","last_became_peered":"2023-12-22T10:00:28.024588+0000","last_unstale":"2023-12-22T10:01:49.142605+0000","last_undegraded":"2023-12-22T10:01:49.142605+0000","last_fullsized":"2023-12-22T10:01:49.142605+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_clean_scrub_stamp":"2023-12-22T10:00:27.001906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.018915+0000","last_change":"2023-12-22T10:01:50.018915+0000","last_active":"2023-12-22T10:01:50.018915+0000","last_peered":"2023-12-22T10:01:50.018915+0000","last_clean":"2023-12-22T10:01:50.018915+0000","last_became_active":"2023-12-22T10:01:50.013225+0000","last_became_peered":"2023-12-22T10:01:50.013225+0000","last_unstale":"2023-12-22T10:01:50.018915+0000","last_undegraded":"2023-12-22T10:01:50.018915+0000","last_fullsized":"2023-12-22T10:01:50.018915+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"36'7","reported_seq":21,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.142126+0000","last_change":"2023-12-22T10:01:35.161679+0000","last_active":"2023-12-22T10:01:49.142126+0000","last_peered":"2023-12-22T10:01:49.142126+0000","last_clean":"2023-12-22T10:01:49.142126+0000","last_became_active":"2023-12-22T10:01:35.161420+0000","last_became_peered":"2023-12-22T10:01:35.161420+0000","last_unstale":"2023-12-22T10:01:49.142126+0000","last_undegraded":"2023-12-22T10:01:49.142126+0000","last_fullsized":"2023-12-22T10:01:49.142126+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":18,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.993153+0000","last_change":"2023-12-22T10:01:34.695408+0000","last_active":"2023-12-22T10:01:49.993153+0000","last_peered":"2023-12-22T10:01:49.993153+0000","last_clean":"2023-12-22T10:01:49.993153+0000","last_became_active":"2023-12-22T10:01:34.694999+0000","last_became_peered":"2023-12-22T10:01:34.694999+0000","last_unstale":"2023-12-22T10:01:49.993153+0000","last_undegraded":"2023-12-22T10:01:49.993153+0000","last_fullsized":"2023-12-22T10:01:49.993153+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":31,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.149411+0000","last_change":"2023-12-22T10:00:28.029884+0000","last_active":"2023-12-22T10:01:49.149411+0000","last_peered":"2023-12-22T10:01:49.149411+0000","last_clean":"2023-12-22T10:01:49.149411+0000","last_became_active":"2023-12-22T10:00:28.029422+0000","last_became_peered":"2023-12-22T10:00:28.029422+0000","last_unstale":"2023-12-22T10:01:49.149411+0000","last_undegraded":"2023-12-22T10:01:49.149411+0000","last_fullsized":"2023-12-22T10:01:49.149411+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_clean_scrub_stamp":"2023-12-22T10:00:27.001906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.019009+0000","last_change":"2023-12-22T10:01:50.015894+0000","last_active":"2023-12-22T10:01:50.019009+0000","last_peered":"2023-12-22T10:01:50.019009+0000","last_clean":"2023-12-22T10:01:50.019009+0000","last_became_active":"2023-12-22T10:01:50.015573+0000","last_became_peered":"2023-12-22T10:01:50.015573+0000","last_unstale":"2023-12-22T10:01:50.019009+0000","last_undegraded":"2023-12-22T10:01:50.019009+0000","last_fullsized":"2023-12-22T10:01:50.019009+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.5","version":"36'5","reported_seq":19,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.150519+0000","last_change":"2023-12-22T10:01:35.148673+0000","last_active":"2023-12-22T10:01:49.150519+0000","last_peered":"2023-12-22T10:01:49.150519+0000","last_clean":"2023-12-22T10:01:49.150519+0000","last_became_active":"2023-12-22T10:01:35.148293+0000","last_became_peered":"2023-12-22T10:01:35.148293+0000","last_unstale":"2023-12-22T10:01:49.150519+0000","last_undegraded":"2023-12-22T10:01:49.150519+0000","last_fullsized":"2023-12-22T10:01:49.150519+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":18,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.996045+0000","last_change":"2023-12-22T10:01:34.698687+0000","last_active":"2023-12-22T10:01:49.996045+0000","last_peered":"2023-12-22T10:01:49.996045+0000","last_clean":"2023-12-22T10:01:49.996045+0000","last_became_active":"2023-12-22T10:01:34.698369+0000","last_became_peered":"2023-12-22T10:01:34.698369+0000","last_unstale":"2023-12-22T10:01:49.996045+0000","last_undegraded":"2023-12-22T10:01:49.996045+0000","last_fullsized":"2023-12-22T10:01:49.996045+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":33,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.992605+0000","last_change":"2023-12-22T10:00:28.028621+0000","last_active":"2023-12-22T10:01:49.992605+0000","last_peered":"2023-12-22T10:01:49.992605+0000","last_clean":"2023-12-22T10:01:49.992605+0000","last_became_active":"2023-12-22T10:00:28.028159+0000","last_became_peered":"2023-12-22T10:00:28.028159+0000","last_unstale":"2023-12-22T10:01:49.992605+0000","last_undegraded":"2023-12-22T10:01:49.992605+0000","last_fullsized":"2023-12-22T10:01:49.992605+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_clean_scrub_stamp":"2023-12-22T10:00:27.001906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.022259+0000","last_change":"2023-12-22T10:01:50.022259+0000","last_active":"2023-12-22T10:01:50.022259+0000","last_peered":"2023-12-22T10:01:50.022259+0000","last_clean":"2023-12-22T10:01:50.022259+0000","last_became_active":"2023-12-22T10:01:50.021651+0000","last_became_peered":"2023-12-22T10:01:50.021651+0000","last_unstale":"2023-12-22T10:01:50.022259+0000","last_undegraded":"2023-12-22T10:01:50.022259+0000","last_fullsized":"2023-12-22T10:01:50.022259+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"36'9","reported_seq":26,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.994792+0000","last_change":"2023-12-22T10:01:35.139521+0000","last_active":"2023-12-22T10:01:49.994792+0000","last_peered":"2023-12-22T10:01:49.994792+0000","last_clean":"2023-12-22T10:01:49.994792+0000","last_became_active":"2023-12-22T10:01:35.139189+0000","last_became_peered":"2023-12-22T10:01:35.139189+0000","last_unstale":"2023-12-22T10:01:49.994792+0000","last_undegraded":"2023-12-22T10:01:49.994792+0000","last_fullsized":"2023-12-22T10:01:49.994792+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"41'3","reported_seq":19,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.149906+0000","last_change":"2023-12-22T10:01:34.680088+0000","last_active":"2023-12-22T10:01:49.149906+0000","last_peered":"2023-12-22T10:01:49.149906+0000","last_clean":"2023-12-22T10:01:49.149906+0000","last_became_active":"2023-12-22T10:01:34.679800+0000","last_became_peered":"2023-12-22T10:01:34.679800+0000","last_unstale":"2023-12-22T10:01:49.149906+0000","last_undegraded":"2023-12-22T10:01:49.149906+0000","last_fullsized":"2023-12-22T10:01:49.149906+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":31,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.147051+0000","last_change":"2023-12-22T10:00:28.030883+0000","last_active":"2023-12-22T10:01:49.147051+0000","last_peered":"2023-12-22T10:01:49.147051+0000","last_clean":"2023-12-22T10:01:49.147051+0000","last_became_active":"2023-12-22T10:00:28.030284+0000","last_became_peered":"2023-12-22T10:00:28.030284+0000","last_unstale":"2023-12-22T10:01:49.147051+0000","last_undegraded":"2023-12-22T10:01:49.147051+0000","last_fullsized":"2023-12-22T10:01:49.147051+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_clean_scrub_stamp":"2023-12-22T10:00:27.001906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.016338+0000","last_change":"2023-12-22T10:01:50.016338+0000","last_active":"2023-12-22T10:01:50.016338+0000","last_peered":"2023-12-22T10:01:50.016338+0000","last_clean":"2023-12-22T10:01:50.016338+0000","last_became_active":"2023-12-22T10:01:50.015435+0000","last_became_peered":"2023-12-22T10:01:50.015435+0000","last_unstale":"2023-12-22T10:01:50.016338+0000","last_undegraded":"2023-12-22T10:01:50.016338+0000","last_fullsized":"2023-12-22T10:01:50.016338+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.7","version":"36'8","reported_seq":23,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.149633+0000","last_change":"2023-12-22T10:01:35.159707+0000","last_active":"2023-12-22T10:01:49.149633+0000","last_peered":"2023-12-22T10:01:49.149633+0000","last_clean":"2023-12-22T10:01:49.149633+0000","last_became_active":"2023-12-22T10:01:35.159054+0000","last_became_peered":"2023-12-22T10:01:35.159054+0000","last_unstale":"2023-12-22T10:01:49.149633+0000","last_undegraded":"2023-12-22T10:01:49.149633+0000","last_fullsized":"2023-12-22T10:01:49.149633+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.150239+0000","last_change":"2023-12-22T10:01:34.688735+0000","last_active":"2023-12-22T10:01:49.150239+0000","last_peered":"2023-12-22T10:01:49.150239+0000","last_clean":"2023-12-22T10:01:49.150239+0000","last_became_active":"2023-12-22T10:01:34.688216+0000","last_became_peered":"2023-12-22T10:01:34.688216+0000","last_unstale":"2023-12-22T10:01:49.150239+0000","last_undegraded":"2023-12-22T10:01:49.150239+0000","last_fullsized":"2023-12-22T10:01:49.150239+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":31,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.149991+0000","last_change":"2023-12-22T10:00:28.031790+0000","last_active":"2023-12-22T10:01:49.149991+0000","last_peered":"2023-12-22T10:01:49.149991+0000","last_clean":"2023-12-22T10:01:49.149991+0000","last_became_active":"2023-12-22T10:00:28.031190+0000","last_became_peered":"2023-12-22T10:00:28.031190+0000","last_unstale":"2023-12-22T10:01:49.149991+0000","last_undegraded":"2023-12-22T10:01:49.149991+0000","last_fullsized":"2023-12-22T10:01:49.149991+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_clean_scrub_stamp":"2023-12-22T10:00:27.001906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":32,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.135130+0000","last_change":"2023-12-22T10:00:27.889031+0000","last_active":"2023-12-22T10:01:49.135130+0000","last_peered":"2023-12-22T10:01:49.135130+0000","last_clean":"2023-12-22T10:01:49.135130+0000","last_became_active":"2023-12-22T10:00:27.888164+0000","last_became_peered":"2023-12-22T10:00:27.888164+0000","last_unstale":"2023-12-22T10:01:49.135130+0000","last_undegraded":"2023-12-22T10:01:49.135130+0000","last_fullsized":"2023-12-22T10:01:49.135130+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:25.998963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:25.998963+0000","last_clean_scrub_stamp":"2023-12-22T10:00:25.998963+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":6291456,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":504,"ondisk_log_size":504,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":92,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":81,"ondisk_log_size":81,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297580,"kb_used_data":484,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074260,"statfs":{"total":96636764160,"available":96332042240,"internally_reserved":0,"allocated":495616,"data_stored":218923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 10:01:29 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.143,"15min":1.143},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.677,"5min":1.677,"15min":1.677},"last":0.89500000000000002},{"interface":"front","average":{"1min":1.161,"5min":1.161,"15min":1.161},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":1.093}]},{"osd":1,"last update":"Fri Dec 22 10:01:29 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.25,"15min":1.25},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.8899999999999999,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":1.494},{"interface":"front","average":{"1min":1.337,"5min":1.337,"15min":1.337},"min":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":2.6819999999999999,"5min":2.6819999999999999,"15min":2.6819999999999999},"last":1.196}]},{"osd":2,"last update":"Fri Dec 22 10:01:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":2.8490000000000002,"5min":2.8490000000000002,"15min":2.8490000000000002},"last":1.137},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.774,"5min":1.774,"15min":1.774},"last":1.3500000000000001}]},{"osd":3,"last update":"Fri Dec 22 10:01:29 2023","interfaces":[{"interface":"back","average":{"1min":1.321,"5min":1.321,"15min":1.321},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":2.3690000000000002,"5min":2.3690000000000002,"15min":2.3690000000000002},"last":1.2150000000000001},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"min":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"max":{"1min":2.0899999999999999,"5min":2.0899999999999999,"15min":2.0899999999999999},"last":1.4390000000000001}]},{"osd":4,"last update":"Fri Dec 22 10:01:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.764,"5min":1.764,"15min":1.764},"last":0.99199999999999999},{"interface":"front","average":{"1min":1.278,"5min":1.278,"15min":1.278},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":2.2930000000000001,"5min":2.2930000000000001,"15min":2.2930000000000001},"last":1.3069999999999999}]},{"osd":5,"last update":"Fri Dec 22 10:01:29 2023","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.228,"15min":1.228},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.786,"5min":1.786,"15min":1.786},"last":1.5489999999999999},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":2.73,"5min":2.73,"15min":2.73},"last":1.5580000000000001}]},{"osd":6,"last update":"Fri Dec 22 10:01:29 2023","interfaces":[{"interface":"back","average":{"1min":1.476,"5min":1.476,"15min":1.476},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":2.7690000000000001,"5min":2.7690000000000001,"15min":2.7690000000000001},"last":1.635},{"interface":"front","average":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":2.8820000000000001,"5min":2.8820000000000001,"15min":2.8820000000000001},"last":1.524}]}]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297580,"kb_used_data":484,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074260,"statfs":{"total":96636764160,"available":96332042240,"internally_reserved":0,"allocated":495616,"data_stored":218923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.131,"15min":1.131},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":1.1279999999999999},{"interface":"front","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.617,"5min":1.617,"15min":1.617},"last":1.3899999999999999}]},{"osd":1,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":1.0780000000000001},{"interface":"front","average":{"1min":1.085,"5min":1.085,"15min":1.085},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.657,"5min":1.657,"15min":1.657},"last":0.93700000000000006}]},{"osd":2,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.077,"15min":1.077},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":1.4530000000000001},{"interface":"front","average":{"1min":1.145,"5min":1.145,"15min":1.145},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.583,"5min":1.583,"15min":1.583},"last":1.2310000000000001}]},{"osd":3,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.262,"15min":1.262},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":1.034},{"interface":"front","average":{"1min":1.252,"5min":1.252,"15min":1.252},"min":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":1.6359999999999999,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":1.002}]},{"osd":4,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.282,"15min":1.282},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.7310000000000001,"5min":1.7310000000000001,"15min":1.7310000000000001},"last":1.369},{"interface":"front","average":{"1min":1.361,"5min":1.361,"15min":1.361},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":2.2280000000000002,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":1.165}]},{"osd":5,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"min":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":1.907,"5min":1.907,"15min":1.907},"last":0.90300000000000002},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":2.363,"5min":2.363,"15min":2.363},"last":1.2689999999999999}]},{"osd":7,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"min":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"max":{"1min":2.1459999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.2989999999999999},{"interface":"front","average":{"1min":1.403,"5min":1.403,"15min":1.403},"min":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"max":{"1min":2.1779999999999999,"5min":2.1779999999999999,"15min":2.1779999999999999},"last":1.3380000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301676,"kb_used_data":4580,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94070164,"statfs":{"total":96636764160,"available":96327847936,"internally_reserved":0,"allocated":4689920,"data_stored":4413227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":0.93500000000000005},{"interface":"front","average":{"1min":1.123,"5min":1.123,"15min":1.123},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.6559999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":0.94699999999999995}]},{"osd":1,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.89800000000000002},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":2.0070000000000001,"5min":2.0070000000000001,"15min":2.0070000000000001},"last":0.63300000000000001}]},{"osd":2,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.76000000000000001},{"interface":"front","average":{"1min":1.119,"5min":1.119,"15min":1.119},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.607,"5min":1.607,"15min":1.607},"last":1.0629999999999999}]},{"osd":3,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.133,"15min":1.133},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":1.0920000000000001},{"interface":"front","average":{"1min":1.179,"5min":1.179,"15min":1.179},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.488,"5min":1.488,"15min":1.488},"last":1.1859999999999999}]},{"osd":4,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.145,"15min":1.145},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":1.8779999999999999,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.98699999999999999},{"interface":"front","average":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"min":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":1.006}]},{"osd":6,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.242,"15min":1.242},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.7749999999999999,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":1.117},{"interface":"front","average":{"1min":1.236,"5min":1.236,"15min":1.236},"min":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":1.0980000000000001}]},{"osd":7,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.236,"15min":1.236},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":1.516,"5min":1.516,"15min":1.516},"last":1.054},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.8620000000000001,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":1.2989999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297580,"kb_used_data":484,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074260,"statfs":{"total":96636764160,"available":96332042240,"internally_reserved":0,"allocated":495616,"data_stored":218923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.149,"15min":1.149},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":0.95299999999999996},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"min":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.80200000000000005}]},{"osd":1,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":1.012,"15min":1.012},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":1.0229999999999999},{"interface":"front","average":{"1min":1.077,"5min":1.077,"15min":1.077},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":1.1830000000000001}]},{"osd":2,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.641,"5min":1.641,"15min":1.641},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.272,"5min":1.272,"15min":1.272},"min":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"max":{"1min":1.8340000000000001,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":1.333}]},{"osd":3,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.173,"15min":1.173},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":1.7490000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":1.151},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"min":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"max":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":1.3799999999999999}]},{"osd":5,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":1.216,"15min":1.216},"min":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"max":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":1.0880000000000001},{"interface":"front","average":{"1min":1.173,"5min":1.173,"15min":1.173},"min":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":1.9350000000000001,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":1.28}]},{"osd":6,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":1.869,"5min":1.869,"15min":1.869},"last":1.3089999999999999},{"interface":"front","average":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"min":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"max":{"1min":1.9910000000000001,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":1.266}]},{"osd":7,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"min":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"max":{"1min":2.1960000000000002,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":1.3460000000000001},{"interface":"front","average":{"1min":1.391,"5min":1.391,"15min":1.391},"min":{"1min":1.044,"5min":1.044,"15min":1.044},"max":{"1min":1.8680000000000001,"5min":1.8680000000000001,"15min":1.8680000000000001},"last":1.2170000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303724,"kb_used_data":6628,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94068116,"statfs":{"total":96636764160,"available":96325750784,"internally_reserved":0,"allocated":6787072,"data_stored":6510379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 10:01:25 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.93999999999999995}]},{"osd":1,"last update":"Fri Dec 22 10:01:25 2023","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.78000000000000003},{"interface":"front","average":{"1min":1.109,"5min":1.109,"15min":1.109},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":1.415}]},{"osd":2,"last update":"Fri Dec 22 10:01:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":1.133},{"interface":"front","average":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.702,"5min":1.702,"15min":1.702},"last":0.99299999999999999}]},{"osd":4,"last update":"Fri Dec 22 10:01:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.2,"15min":1.2},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":1.091},{"interface":"front","average":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":2.0619999999999998,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":1.448}]},{"osd":5,"last update":"Fri Dec 22 10:01:25 2023","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.333,"15min":1.333},"min":{"1min":0.878,"5min":0.878,"15min":0.878},"max":{"1min":1.9339999999999999,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":1.363},{"interface":"front","average":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"min":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"max":{"1min":2.1720000000000002,"5min":2.1720000000000002,"15min":2.1720000000000002},"last":1.1910000000000001}]},{"osd":6,"last update":"Fri Dec 22 10:01:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.8640000000000001,"5min":1.8640000000000001,"15min":1.8640000000000001},"last":1.284},{"interface":"front","average":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":2.2130000000000001,"5min":2.2130000000000001,"15min":2.2130000000000001},"last":1.2549999999999999}]},{"osd":7,"last update":"Fri Dec 22 10:01:25 2023","interfaces":[{"interface":"back","average":{"1min":1.405,"5min":1.405,"15min":1.405},"min":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"max":{"1min":2.1389999999999998,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":1.3400000000000001},{"interface":"front","average":{"1min":1.431,"5min":1.431,"15min":1.431},"min":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":2.105,"5min":2.105,"15min":2.105},"last":1.385}]}]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297580,"kb_used_data":484,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074260,"statfs":{"total":96636764160,"available":96332042240,"internally_reserved":0,"allocated":495616,"data_stored":218923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":1.04},{"interface":"front","average":{"1min":1.083,"5min":1.083,"15min":1.083},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.78800000000000003}]},{"osd":1,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.52,"5min":1.52,"15min":1.52},"last":0.88900000000000001},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":2.3809999999999998,"5min":2.3809999999999998,"15min":2.3809999999999998},"last":0.61299999999999999}]},{"osd":3,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.698,"5min":1.698,"15min":1.698},"last":0.85599999999999998},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.788,"5min":1.788,"15min":1.788},"last":0.97599999999999998}]},{"osd":4,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.381,"15min":1.381},"min":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"max":{"1min":2.234,"5min":2.234,"15min":2.234},"last":0.94099999999999995},{"interface":"front","average":{"1min":1.296,"5min":1.296,"15min":1.296},"min":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"max":{"1min":2.1230000000000002,"5min":2.1230000000000002,"15min":2.1230000000000002},"last":1.3129999999999999}]},{"osd":5,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"min":{"1min":1.109,"5min":1.109,"15min":1.109},"max":{"1min":2.0960000000000001,"5min":2.0960000000000001,"15min":2.0960000000000001},"last":1.284},{"interface":"front","average":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"min":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"max":{"1min":1.9730000000000001,"5min":1.9730000000000001,"15min":1.9730000000000001},"last":1.2}]},{"osd":6,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"min":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"max":{"1min":2.298,"5min":2.298,"15min":2.298},"last":1.518},{"interface":"front","average":{"1min":1.46,"5min":1.46,"15min":1.46},"min":{"1min":1.02,"5min":1.02,"15min":1.02},"max":{"1min":1.899,"5min":1.899,"15min":1.899},"last":1.2390000000000001}]},{"osd":7,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.458,"5min":1.458,"15min":1.458},"min":{"1min":1,"5min":1,"15min":1},"max":{"1min":2.0289999999999999,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":0.98999999999999999},{"interface":"front","average":{"1min":1.415,"5min":1.415,"15min":1.415},"min":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"max":{"1min":2.0179999999999998,"5min":2.0179999999999998,"15min":2.0179999999999998},"last":1.415}]}]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297580,"kb_used_data":484,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074260,"statfs":{"total":96636764160,"available":96332042240,"internally_reserved":0,"allocated":495616,"data_stored":218923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.54100000000000004}]},{"osd":2,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.40899999999999997},{"interface":"front","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.60699999999999998}]},{"osd":3,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.66600000000000004},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.63100000000000001}]},{"osd":4,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":0.55400000000000005},{"interface":"front","average":{"1min":1.236,"5min":1.236,"15min":1.236},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":2.0710000000000002,"5min":2.0710000000000002,"15min":2.0710000000000002},"last":0.71399999999999997}]},{"osd":5,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"min":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"max":{"1min":1.8129999999999999,"5min":1.8129999999999999,"15min":1.8129999999999999},"last":0.93899999999999995},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"min":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"max":{"1min":1.881,"5min":1.881,"15min":1.881},"last":0.81599999999999995}]},{"osd":6,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"min":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"max":{"1min":1.8779999999999999,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.997},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"min":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":1.946,"5min":1.946,"15min":1.946},"last":0.85599999999999998}]},{"osd":7,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"min":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"max":{"1min":1.9279999999999999,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":0.872},{"interface":"front","average":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"min":{"1min":1.03,"5min":1.03,"15min":1.03},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.97399999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299628,"kb_used_data":2532,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94072212,"statfs":{"total":96636764160,"available":96329945088,"internally_reserved":0,"allocated":2592768,"data_stored":2316075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":2.7250000000000001,"5min":2.7250000000000001,"15min":2.7250000000000001},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":1.171}]},{"osd":2,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":2.7799999999999998,"5min":2.7799999999999998,"15min":2.7799999999999998},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.84299999999999997}]},{"osd":3,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":2.919,"5min":2.919,"15min":2.919},"last":0.69299999999999995},{"interface":"front","average":{"1min":1.248,"5min":1.248,"15min":1.248},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":2.8959999999999999,"5min":2.8959999999999999,"15min":2.8959999999999999},"last":0.92800000000000005}]},{"osd":4,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":0.95599999999999996},{"interface":"front","average":{"1min":1.292,"5min":1.292,"15min":1.292},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":3.1280000000000001,"5min":3.1280000000000001,"15min":3.1280000000000001},"last":0.97899999999999998}]},{"osd":5,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"min":{"1min":0.87,"5min":0.87,"15min":0.87},"max":{"1min":3.0760000000000001,"5min":3.0760000000000001,"15min":3.0760000000000001},"last":0.83199999999999996},{"interface":"front","average":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":2.512,"5min":2.512,"15min":2.512},"last":1.04}]},{"osd":6,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.5,"5min":1.5,"15min":1.5},"min":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"max":{"1min":2.8199999999999998,"5min":2.8199999999999998,"15min":2.8199999999999998},"last":1.107},{"interface":"front","average":{"1min":1.51,"5min":1.51,"15min":1.51},"min":{"1min":1.032,"5min":1.032,"15min":1.032},"max":{"1min":4.6029999999999998,"5min":4.6029999999999998,"15min":4.6029999999999998},"last":1.0760000000000001}]},{"osd":7,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.417,"5min":1.417,"15min":1.417},"min":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"max":{"1min":2.0190000000000001,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":1.2629999999999999},{"interface":"front","average":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"min":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"max":{"1min":3.6339999999999999,"5min":3.6339999999999999,"15min":3.6339999999999999},"last":1.1990000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2097152,"data_stored":2097152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-22T10:01:54.397 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-22T10:01:54.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.592+0000 7f37e0ba9700 1 Processor -- start 2023-12-22T10:01:54.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.592+0000 7f37e0ba9700 1 -- start start 2023-12-22T10:01:54.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.596+0000 7f37e0ba9700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f37dc1581f0 0x7f37dc0c3080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:54.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.596+0000 7f37e0ba9700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f37dc0c3570 0x7f37dc0a7070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:54.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.596+0000 7f37e0ba9700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37dc0a68b0 con 0x7f37dc157e10 2023-12-22T10:01:54.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.596+0000 7f37e0ba9700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37dc065610 con 0x7f37dc1581f0 2023-12-22T10:01:54.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.596+0000 7f37e0ba9700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37dc0658f0 con 0x7f37dc0c3570 2023-12-22T10:01:54.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.596+0000 7f37da59c700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f37dc157e10 0x7f37dc0c1820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:45080/0 (socket says 172.21.15.45:45080) 2023-12-22T10:01:54.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.596+0000 7f37da59c700 1 -- 172.21.15.45:0/1872342924 learned_addr learned my addr 172.21.15.45:0/1872342924 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:01:54.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.596+0000 7f37d9d9b700 1 --2- 172.21.15.45:0/1872342924 >> v2:172.21.15.113:3300/0 conn(0x7f37dc1581f0 0x7f37dc0c3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:54.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.596+0000 7f37dad9d700 1 --2- 172.21.15.45:0/1872342924 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f37dc0c3570 0x7f37dc0a7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:54.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.596+0000 7f37d959a700 1 -- 172.21.15.45:0/1872342924 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2490713918 0 0) 0x7f37dc0a68b0 con 0x7f37dc157e10 2023-12-22T10:01:54.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.596+0000 7f37d959a700 1 -- 172.21.15.45:0/1872342924 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37c40033f0 con 0x7f37dc157e10 2023-12-22T10:01:54.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.596+0000 7f37d9d9b700 1 -- 172.21.15.45:0/1872342924 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f37dc0c3570 msgr2=0x7f37dc0a7070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:54.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.596+0000 7f37d9d9b700 1 --2- 172.21.15.45:0/1872342924 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f37dc0c3570 0x7f37dc0a7070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:54.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.596+0000 7f37d9d9b700 1 -- 172.21.15.45:0/1872342924 >> v1:172.21.15.45:6789/0 conn(0x7f37dc157e10 legacy=0x7f37dc0c1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:54.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.596+0000 7f37d9d9b700 1 -- 172.21.15.45:0/1872342924 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37dc065bd0 con 0x7f37dc1581f0 2023-12-22T10:01:54.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.600+0000 7f37d9d9b700 1 --2- 172.21.15.45:0/1872342924 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f37dc1581f0 0x7f37dc0c3080 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f37d0009760 tx=0x7f37d0009060).ready entity=mon.1 client_cookie=adac11e540e81a87 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:54.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.600+0000 7f37d959a700 1 -- 172.21.15.45:0/1872342924 <== mon.1 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d000d4a0 con 0x7f37dc1581f0 2023-12-22T10:01:54.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.600+0000 7f37d959a700 1 -- 172.21.15.45:0/1872342924 <== mon.1 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37d000d600 con 0x7f37dc1581f0 2023-12-22T10:01:54.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.600+0000 7f37d959a700 1 -- 172.21.15.45:0/1872342924 <== mon.1 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d000d980 con 0x7f37dc1581f0 2023-12-22T10:01:54.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.600+0000 7f37e0ba9700 1 -- 172.21.15.45:0/1872342924 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f37dc1581f0 msgr2=0x7f37dc0c3080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:54.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.600+0000 7f37e0ba9700 1 --2- 172.21.15.45:0/1872342924 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f37dc1581f0 0x7f37dc0c3080 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f37d0009760 tx=0x7f37d0009060).stop 2023-12-22T10:01:54.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.600+0000 7f37e0ba9700 1 -- 172.21.15.45:0/1872342924 shutdown_connections 2023-12-22T10:01:54.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.600+0000 7f37e0ba9700 1 --2- 172.21.15.45:0/1872342924 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f37dc0c3570 0x7f37dc0a7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:54.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.600+0000 7f37e0ba9700 1 --2- 172.21.15.45:0/1872342924 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f37dc1581f0 0x7f37dc0c3080 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:54.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.600+0000 7f37e0ba9700 1 -- 172.21.15.45:0/1872342924 >> 172.21.15.45:0/1872342924 conn(0x7f37dc066a70 msgr2=0x7f37dc066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:54.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.600+0000 7f37e0ba9700 1 -- 172.21.15.45:0/1872342924 shutdown_connections 2023-12-22T10:01:54.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.600+0000 7f37e0ba9700 1 -- 172.21.15.45:0/1872342924 wait complete. 2023-12-22T10:01:54.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.604+0000 7f37e0ba9700 1 Processor -- start 2023-12-22T10:01:54.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.604+0000 7f37e0ba9700 1 -- start start 2023-12-22T10:01:54.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.604+0000 7f37e0ba9700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f37dc0c3570 0x7f37dc16b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:54.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.604+0000 7f37e0ba9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f37dc157e10 0x7f37dc0c66c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:54.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.604+0000 7f37e0ba9700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f37dc1581f0 0x7f37dc0c6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:54.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.604+0000 7f37e0ba9700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37dc0c70a0 con 0x7f37dc157e10 2023-12-22T10:01:54.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.604+0000 7f37e0ba9700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37dc0ab5d0 con 0x7f37dc0c3570 2023-12-22T10:01:54.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.604+0000 7f37e0ba9700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37dc16b510 con 0x7f37dc1581f0 2023-12-22T10:01:54.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.604+0000 7f37d9d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f37dc157e10 0x7f37dc0c66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:54.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.608+0000 7f37d9d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f37dc157e10 0x7f37dc0c66c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48370/0 (socket says 172.21.15.45:48370) 2023-12-22T10:01:54.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.608+0000 7f37d9d9b700 1 -- 172.21.15.45:0/812462755 learned_addr learned my addr 172.21.15.45:0/812462755 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:54.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.608+0000 7f37dad9d700 1 --2- 172.21.15.45:0/812462755 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f37dc1581f0 0x7f37dc0c6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:54.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.608+0000 7f37da59c700 1 --2- 172.21.15.45:0/812462755 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f37dc0c3570 0x7f37dc16b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:54.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.608+0000 7f37d9d9b700 1 -- 172.21.15.45:0/812462755 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f37dc1581f0 msgr2=0x7f37dc0c6bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:54.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.608+0000 7f37d9d9b700 1 --2- 172.21.15.45:0/812462755 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f37dc1581f0 0x7f37dc0c6bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:54.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.608+0000 7f37d9d9b700 1 -- 172.21.15.45:0/812462755 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f37dc0c3570 msgr2=0x7f37dc16b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:54.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.608+0000 7f37d9d9b700 1 --2- 172.21.15.45:0/812462755 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f37dc0c3570 0x7f37dc16b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:54.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.608+0000 7f37d9d9b700 1 -- 172.21.15.45:0/812462755 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37d00092a0 con 0x7f37dc157e10 2023-12-22T10:01:54.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.608+0000 7f37da59c700 1 --2- 172.21.15.45:0/812462755 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f37dc0c3570 0x7f37dc16b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T10:01:54.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.608+0000 7f37d9d9b700 1 --2- 172.21.15.45:0/812462755 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f37dc157e10 0x7f37dc0c66c0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 rx=0x7f37dc0643a0 tx=0x7f37d0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:54.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.608+0000 7f37ca7fc700 1 -- 172.21.15.45:0/812462755 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d000dd30 con 0x7f37dc157e10 2023-12-22T10:01:54.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.608+0000 7f37ca7fc700 1 -- 172.21.15.45:0/812462755 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37d000de90 con 0x7f37dc157e10 2023-12-22T10:01:54.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.608+0000 7f37ca7fc700 1 -- 172.21.15.45:0/812462755 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d000d980 con 0x7f37dc157e10 2023-12-22T10:01:54.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.608+0000 7f37e0ba9700 1 -- 172.21.15.45:0/812462755 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37dc0aa9c0 con 0x7f37dc157e10 2023-12-22T10:01:54.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.608+0000 7f37e0ba9700 1 -- 172.21.15.45:0/812462755 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37dc0aaf80 con 0x7f37dc157e10 2023-12-22T10:01:54.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.608+0000 7f37e0ba9700 1 -- 172.21.15.45:0/812462755 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37dc06c070 con 0x7f37dc157e10 2023-12-22T10:01:54.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.612+0000 7f37ca7fc700 1 -- 172.21.15.45:0/812462755 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f37d001d640 con 0x7f37dc157e10 2023-12-22T10:01:54.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.612+0000 7f37ca7fc700 1 --2- 172.21.15.45:0/812462755 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f37bc05a4e0 0x7f37bc05c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:54.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.612+0000 7f37ca7fc700 1 -- 172.21.15.45:0/812462755 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6660+0+0 (secure 0 0 0) 0x7f37d00762d0 con 0x7f37dc157e10 2023-12-22T10:01:54.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.612+0000 7f37da59c700 1 --2- 172.21.15.45:0/812462755 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f37bc05a4e0 0x7f37bc05c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:54.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.612+0000 7f37da59c700 1 --2- 172.21.15.45:0/812462755 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f37bc05a4e0 0x7f37bc05c9a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7f37cc007fd0 tx=0x7f37cc009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:54.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.620+0000 7f37ca7fc700 1 -- 172.21.15.45:0/812462755 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f37d00497d0 con 0x7f37dc157e10 2023-12-22T10:01:54.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.784+0000 7f37e0ba9700 1 -- 172.21.15.45:0/812462755 --> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f37dc15de90 con 0x7f37bc05a4e0 2023-12-22T10:01:54.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.800+0000 7f37ca7fc700 1 -- 172.21.15.45:0/812462755 <== mgr.4104 v2:172.21.15.45:6832/33679 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+503622 (secure 0 0 0) 0x7f37dc15de90 con 0x7f37bc05a4e0 2023-12-22T10:01:54.807 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:01:54.808 INFO:tasks.ceph.mon.a.smithi045.stderr:2023-12-22T10:01:54.808+0000 7fd344a42700 -1 log_channel(cluster) log [ERR] : Health check update: 2 filesystems are offline (MDS_ALL_DOWN) 2023-12-22T10:01:54.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.812+0000 7f37e0ba9700 1 -- 172.21.15.45:0/812462755 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f37bc05a4e0 msgr2=0x7f37bc05c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:54.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.812+0000 7f37e0ba9700 1 --2- 172.21.15.45:0/812462755 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f37bc05a4e0 0x7f37bc05c9a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7f37cc007fd0 tx=0x7f37cc009040).stop 2023-12-22T10:01:54.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.812+0000 7f37e0ba9700 1 -- 172.21.15.45:0/812462755 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f37dc157e10 msgr2=0x7f37dc0c66c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:54.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.812+0000 7f37e0ba9700 1 --2- 172.21.15.45:0/812462755 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f37dc157e10 0x7f37dc0c66c0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 rx=0x7f37dc0643a0 tx=0x7f37d0016000).stop 2023-12-22T10:01:54.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.812+0000 7f37e0ba9700 1 -- 172.21.15.45:0/812462755 shutdown_connections 2023-12-22T10:01:54.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.812+0000 7f37e0ba9700 1 --2- 172.21.15.45:0/812462755 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f37bc05a4e0 0x7f37bc05c9a0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:54.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.816+0000 7f37e0ba9700 1 --2- 172.21.15.45:0/812462755 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f37dc1581f0 0x7f37dc0c6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:54.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.816+0000 7f37e0ba9700 1 --2- 172.21.15.45:0/812462755 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f37dc157e10 0x7f37dc0c66c0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:54.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.816+0000 7f37e0ba9700 1 --2- 172.21.15.45:0/812462755 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f37dc0c3570 0x7f37dc16b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:54.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.816+0000 7f37e0ba9700 1 -- 172.21.15.45:0/812462755 >> 172.21.15.45:0/812462755 conn(0x7f37dc066a70 msgr2=0x7f37dc0a8ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:54.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.816+0000 7f37e0ba9700 1 -- 172.21.15.45:0/812462755 shutdown_connections 2023-12-22T10:01:54.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:54.816+0000 7f37e0ba9700 1 -- 172.21.15.45:0/812462755 wait complete. 2023-12-22T10:01:54.818 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-12-22T10:01:54.835 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":81,"stamp":"2023-12-22T10:01:53.978102+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6291456,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":96,"num_write_kb":6180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":585,"ondisk_log_size":585,"up":402,"acting":402,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":316,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2392928,"kb_used_data":16160,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752581792,"statfs":{"total":773094113280,"available":770643755008,"internally_reserved":0,"allocated":16547840,"data_stored":14334296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-15489,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002053"},"pg_stats":[{"pgid":"7.3d","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.005787+0000","last_change":"2023-12-22T10:01:50.005787+0000","last_active":"2023-12-22T10:01:50.005787+0000","last_peered":"2023-12-22T10:01:50.005787+0000","last_clean":"2023-12-22T10:01:50.005787+0000","last_became_active":"2023-12-22T10:01:50.005246+0000","last_became_peered":"2023-12-22T10:01:50.005246+0000","last_unstale":"2023-12-22T10:01:50.005787+0000","last_undegraded":"2023-12-22T10:01:50.005787+0000","last_fullsized":"2023-12-22T10:01:50.005787+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3c","version":"36'8","reported_seq":25,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.994132+0000","last_change":"2023-12-22T10:01:35.152281+0000","last_active":"2023-12-22T10:01:49.994132+0000","last_peered":"2023-12-22T10:01:49.994132+0000","last_clean":"2023-12-22T10:01:49.994132+0000","last_became_active":"2023-12-22T10:01:35.151922+0000","last_became_peered":"2023-12-22T10:01:35.151922+0000","last_unstale":"2023-12-22T10:01:49.994132+0000","last_undegraded":"2023-12-22T10:01:49.994132+0000","last_fullsized":"2023-12-22T10:01:49.994132+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3f","version":"41'7","reported_seq":23,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.151522+0000","last_change":"2023-12-22T10:01:34.692598+0000","last_active":"2023-12-22T10:01:49.151522+0000","last_peered":"2023-12-22T10:01:49.151522+0000","last_clean":"2023-12-22T10:01:49.151522+0000","last_became_active":"2023-12-22T10:01:34.692294+0000","last_became_peered":"2023-12-22T10:01:34.692294+0000","last_unstale":"2023-12-22T10:01:49.151522+0000","last_undegraded":"2023-12-22T10:01:49.151522+0000","last_fullsized":"2023-12-22T10:01:49.151522+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.017559+0000","last_change":"2023-12-22T10:01:50.017559+0000","last_active":"2023-12-22T10:01:50.017559+0000","last_peered":"2023-12-22T10:01:50.017559+0000","last_clean":"2023-12-22T10:01:50.017559+0000","last_became_active":"2023-12-22T10:01:50.017261+0000","last_became_peered":"2023-12-22T10:01:50.017261+0000","last_unstale":"2023-12-22T10:01:50.017559+0000","last_undegraded":"2023-12-22T10:01:50.017559+0000","last_fullsized":"2023-12-22T10:01:50.017559+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.3d","version":"36'7","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.992771+0000","last_change":"2023-12-22T10:01:35.151608+0000","last_active":"2023-12-22T10:01:49.992771+0000","last_peered":"2023-12-22T10:01:49.992771+0000","last_clean":"2023-12-22T10:01:49.992771+0000","last_became_active":"2023-12-22T10:01:35.151006+0000","last_became_peered":"2023-12-22T10:01:35.151006+0000","last_unstale":"2023-12-22T10:01:49.992771+0000","last_undegraded":"2023-12-22T10:01:49.992771+0000","last_fullsized":"2023-12-22T10:01:49.992771+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.142291+0000","last_change":"2023-12-22T10:01:34.697062+0000","last_active":"2023-12-22T10:01:49.142291+0000","last_peered":"2023-12-22T10:01:49.142291+0000","last_clean":"2023-12-22T10:01:49.142291+0000","last_became_active":"2023-12-22T10:01:34.696760+0000","last_became_peered":"2023-12-22T10:01:34.696760+0000","last_unstale":"2023-12-22T10:01:49.142291+0000","last_undegraded":"2023-12-22T10:01:49.142291+0000","last_fullsized":"2023-12-22T10:01:49.142291+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3f","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.009220+0000","last_change":"2023-12-22T10:01:50.009220+0000","last_active":"2023-12-22T10:01:50.009220+0000","last_peered":"2023-12-22T10:01:50.009220+0000","last_clean":"2023-12-22T10:01:50.009220+0000","last_became_active":"2023-12-22T10:01:50.008919+0000","last_became_peered":"2023-12-22T10:01:50.008919+0000","last_unstale":"2023-12-22T10:01:50.009220+0000","last_undegraded":"2023-12-22T10:01:50.009220+0000","last_fullsized":"2023-12-22T10:01:50.009220+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3e","version":"36'4","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.993460+0000","last_change":"2023-12-22T10:01:35.134766+0000","last_active":"2023-12-22T10:01:49.993460+0000","last_peered":"2023-12-22T10:01:49.993460+0000","last_clean":"2023-12-22T10:01:49.993460+0000","last_became_active":"2023-12-22T10:01:35.131420+0000","last_became_peered":"2023-12-22T10:01:35.131420+0000","last_unstale":"2023-12-22T10:01:49.993460+0000","last_undegraded":"2023-12-22T10:01:49.993460+0000","last_fullsized":"2023-12-22T10:01:49.993460+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.136464+0000","last_change":"2023-12-22T10:01:34.705273+0000","last_active":"2023-12-22T10:01:49.136464+0000","last_peered":"2023-12-22T10:01:49.136464+0000","last_clean":"2023-12-22T10:01:49.136464+0000","last_became_active":"2023-12-22T10:01:34.704899+0000","last_became_peered":"2023-12-22T10:01:34.704899+0000","last_unstale":"2023-12-22T10:01:49.136464+0000","last_undegraded":"2023-12-22T10:01:49.136464+0000","last_fullsized":"2023-12-22T10:01:49.136464+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.009318+0000","last_change":"2023-12-22T10:01:50.009318+0000","last_active":"2023-12-22T10:01:50.009318+0000","last_peered":"2023-12-22T10:01:50.009318+0000","last_clean":"2023-12-22T10:01:50.009318+0000","last_became_active":"2023-12-22T10:01:50.008957+0000","last_became_peered":"2023-12-22T10:01:50.008957+0000","last_unstale":"2023-12-22T10:01:50.009318+0000","last_undegraded":"2023-12-22T10:01:50.009318+0000","last_fullsized":"2023-12-22T10:01:50.009318+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3f","version":"36'8","reported_seq":25,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.992818+0000","last_change":"2023-12-22T10:01:35.140720+0000","last_active":"2023-12-22T10:01:49.992818+0000","last_peered":"2023-12-22T10:01:49.992818+0000","last_clean":"2023-12-22T10:01:49.992818+0000","last_became_active":"2023-12-22T10:01:35.137419+0000","last_became_peered":"2023-12-22T10:01:35.137419+0000","last_unstale":"2023-12-22T10:01:49.992818+0000","last_undegraded":"2023-12-22T10:01:49.992818+0000","last_fullsized":"2023-12-22T10:01:49.992818+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3c","version":"41'3","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.994346+0000","last_change":"2023-12-22T10:01:34.698706+0000","last_active":"2023-12-22T10:01:49.994346+0000","last_peered":"2023-12-22T10:01:49.994346+0000","last_clean":"2023-12-22T10:01:49.994346+0000","last_became_active":"2023-12-22T10:01:34.698384+0000","last_became_peered":"2023-12-22T10:01:34.698384+0000","last_unstale":"2023-12-22T10:01:49.994346+0000","last_undegraded":"2023-12-22T10:01:49.994346+0000","last_fullsized":"2023-12-22T10:01:49.994346+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.024528+0000","last_change":"2023-12-22T10:01:50.024528+0000","last_active":"2023-12-22T10:01:50.024528+0000","last_peered":"2023-12-22T10:01:50.024528+0000","last_clean":"2023-12-22T10:01:50.024528+0000","last_became_active":"2023-12-22T10:01:50.024170+0000","last_became_peered":"2023-12-22T10:01:50.024170+0000","last_unstale":"2023-12-22T10:01:50.024528+0000","last_undegraded":"2023-12-22T10:01:50.024528+0000","last_fullsized":"2023-12-22T10:01:50.024528+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.38","version":"36'9","reported_seq":26,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.994803+0000","last_change":"2023-12-22T10:01:35.144798+0000","last_active":"2023-12-22T10:01:49.994803+0000","last_peered":"2023-12-22T10:01:49.994803+0000","last_clean":"2023-12-22T10:01:49.994803+0000","last_became_active":"2023-12-22T10:01:35.143992+0000","last_became_peered":"2023-12-22T10:01:35.143992+0000","last_unstale":"2023-12-22T10:01:49.994803+0000","last_undegraded":"2023-12-22T10:01:49.994803+0000","last_fullsized":"2023-12-22T10:01:49.994803+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"35'1","reported_seq":16,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.142110+0000","last_change":"2023-12-22T10:01:34.687808+0000","last_active":"2023-12-22T10:01:49.142110+0000","last_peered":"2023-12-22T10:01:49.142110+0000","last_clean":"2023-12-22T10:01:49.142110+0000","last_became_active":"2023-12-22T10:01:34.687419+0000","last_became_peered":"2023-12-22T10:01:34.687419+0000","last_unstale":"2023-12-22T10:01:49.142110+0000","last_undegraded":"2023-12-22T10:01:49.142110+0000","last_fullsized":"2023-12-22T10:01:49.142110+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.016819+0000","last_change":"2023-12-22T10:01:50.016819+0000","last_active":"2023-12-22T10:01:50.016819+0000","last_peered":"2023-12-22T10:01:50.016819+0000","last_clean":"2023-12-22T10:01:50.016819+0000","last_became_active":"2023-12-22T10:01:50.015901+0000","last_became_peered":"2023-12-22T10:01:50.015901+0000","last_unstale":"2023-12-22T10:01:50.016819+0000","last_undegraded":"2023-12-22T10:01:50.016819+0000","last_fullsized":"2023-12-22T10:01:50.016819+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.39","version":"36'5","reported_seq":19,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.135394+0000","last_change":"2023-12-22T10:01:35.135065+0000","last_active":"2023-12-22T10:01:49.135394+0000","last_peered":"2023-12-22T10:01:49.135394+0000","last_clean":"2023-12-22T10:01:49.135394+0000","last_became_active":"2023-12-22T10:01:35.134446+0000","last_became_peered":"2023-12-22T10:01:35.134446+0000","last_unstale":"2023-12-22T10:01:49.135394+0000","last_undegraded":"2023-12-22T10:01:49.135394+0000","last_fullsized":"2023-12-22T10:01:49.135394+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3a","version":"35'1","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.993340+0000","last_change":"2023-12-22T10:01:34.690637+0000","last_active":"2023-12-22T10:01:49.993340+0000","last_peered":"2023-12-22T10:01:49.993340+0000","last_clean":"2023-12-22T10:01:49.993340+0000","last_became_active":"2023-12-22T10:01:34.690359+0000","last_became_peered":"2023-12-22T10:01:34.690359+0000","last_unstale":"2023-12-22T10:01:49.993340+0000","last_undegraded":"2023-12-22T10:01:49.993340+0000","last_fullsized":"2023-12-22T10:01:49.993340+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.005696+0000","last_change":"2023-12-22T10:01:50.005696+0000","last_active":"2023-12-22T10:01:50.005696+0000","last_peered":"2023-12-22T10:01:50.005696+0000","last_clean":"2023-12-22T10:01:50.005696+0000","last_became_active":"2023-12-22T10:01:50.005382+0000","last_became_peered":"2023-12-22T10:01:50.005382+0000","last_unstale":"2023-12-22T10:01:50.005696+0000","last_undegraded":"2023-12-22T10:01:50.005696+0000","last_fullsized":"2023-12-22T10:01:50.005696+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3a","version":"36'6","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.990283+0000","last_change":"2023-12-22T10:01:35.136920+0000","last_active":"2023-12-22T10:01:49.990283+0000","last_peered":"2023-12-22T10:01:49.990283+0000","last_clean":"2023-12-22T10:01:49.990283+0000","last_became_active":"2023-12-22T10:01:35.136645+0000","last_became_peered":"2023-12-22T10:01:35.136645+0000","last_unstale":"2023-12-22T10:01:49.990283+0000","last_undegraded":"2023-12-22T10:01:49.990283+0000","last_fullsized":"2023-12-22T10:01:49.990283+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":16,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.149740+0000","last_change":"2023-12-22T10:01:34.705207+0000","last_active":"2023-12-22T10:01:49.149740+0000","last_peered":"2023-12-22T10:01:49.149740+0000","last_clean":"2023-12-22T10:01:49.149740+0000","last_became_active":"2023-12-22T10:01:34.704843+0000","last_became_peered":"2023-12-22T10:01:34.704843+0000","last_unstale":"2023-12-22T10:01:49.149740+0000","last_undegraded":"2023-12-22T10:01:49.149740+0000","last_fullsized":"2023-12-22T10:01:49.149740+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.023194+0000","last_change":"2023-12-22T10:01:50.021048+0000","last_active":"2023-12-22T10:01:50.023194+0000","last_peered":"2023-12-22T10:01:50.023194+0000","last_clean":"2023-12-22T10:01:50.023194+0000","last_became_active":"2023-12-22T10:01:50.020746+0000","last_became_peered":"2023-12-22T10:01:50.020746+0000","last_unstale":"2023-12-22T10:01:50.023194+0000","last_undegraded":"2023-12-22T10:01:50.023194+0000","last_fullsized":"2023-12-22T10:01:50.023194+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3b","version":"36'4","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.994792+0000","last_change":"2023-12-22T10:01:35.143343+0000","last_active":"2023-12-22T10:01:49.994792+0000","last_peered":"2023-12-22T10:01:49.994792+0000","last_clean":"2023-12-22T10:01:49.994792+0000","last_became_active":"2023-12-22T10:01:35.142969+0000","last_became_peered":"2023-12-22T10:01:35.142969+0000","last_unstale":"2023-12-22T10:01:49.994792+0000","last_undegraded":"2023-12-22T10:01:49.994792+0000","last_fullsized":"2023-12-22T10:01:49.994792+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":16,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.149096+0000","last_change":"2023-12-22T10:01:34.694961+0000","last_active":"2023-12-22T10:01:49.149096+0000","last_peered":"2023-12-22T10:01:49.149096+0000","last_clean":"2023-12-22T10:01:49.149096+0000","last_became_active":"2023-12-22T10:01:34.694670+0000","last_became_peered":"2023-12-22T10:01:34.694670+0000","last_unstale":"2023-12-22T10:01:49.149096+0000","last_undegraded":"2023-12-22T10:01:49.149096+0000","last_fullsized":"2023-12-22T10:01:49.149096+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.018904+0000","last_change":"2023-12-22T10:01:50.018904+0000","last_active":"2023-12-22T10:01:50.018904+0000","last_peered":"2023-12-22T10:01:50.018904+0000","last_clean":"2023-12-22T10:01:50.018904+0000","last_became_active":"2023-12-22T10:01:50.018699+0000","last_became_peered":"2023-12-22T10:01:50.018699+0000","last_unstale":"2023-12-22T10:01:50.018904+0000","last_undegraded":"2023-12-22T10:01:50.018904+0000","last_fullsized":"2023-12-22T10:01:50.018904+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"36'7","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.994663+0000","last_change":"2023-12-22T10:01:35.133665+0000","last_active":"2023-12-22T10:01:49.994663+0000","last_peered":"2023-12-22T10:01:49.994663+0000","last_clean":"2023-12-22T10:01:49.994663+0000","last_became_active":"2023-12-22T10:01:35.133400+0000","last_became_peered":"2023-12-22T10:01:35.133400+0000","last_unstale":"2023-12-22T10:01:49.994663+0000","last_undegraded":"2023-12-22T10:01:49.994663+0000","last_fullsized":"2023-12-22T10:01:49.994663+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.137020+0000","last_change":"2023-12-22T10:01:34.701407+0000","last_active":"2023-12-22T10:01:49.137020+0000","last_peered":"2023-12-22T10:01:49.137020+0000","last_clean":"2023-12-22T10:01:49.137020+0000","last_became_active":"2023-12-22T10:01:34.701143+0000","last_became_peered":"2023-12-22T10:01:34.701143+0000","last_unstale":"2023-12-22T10:01:49.137020+0000","last_undegraded":"2023-12-22T10:01:49.137020+0000","last_fullsized":"2023-12-22T10:01:49.137020+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.999874+0000","last_change":"2023-12-22T10:01:49.999874+0000","last_active":"2023-12-22T10:01:49.999874+0000","last_peered":"2023-12-22T10:01:49.999874+0000","last_clean":"2023-12-22T10:01:49.999874+0000","last_became_active":"2023-12-22T10:01:49.999389+0000","last_became_peered":"2023-12-22T10:01:49.999389+0000","last_unstale":"2023-12-22T10:01:49.999874+0000","last_undegraded":"2023-12-22T10:01:49.999874+0000","last_fullsized":"2023-12-22T10:01:49.999874+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.35","version":"36'6","reported_seq":20,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.150313+0000","last_change":"2023-12-22T10:01:35.148993+0000","last_active":"2023-12-22T10:01:49.150313+0000","last_peered":"2023-12-22T10:01:49.150313+0000","last_clean":"2023-12-22T10:01:49.150313+0000","last_became_active":"2023-12-22T10:01:35.148614+0000","last_became_peered":"2023-12-22T10:01:35.148614+0000","last_unstale":"2023-12-22T10:01:49.150313+0000","last_undegraded":"2023-12-22T10:01:49.150313+0000","last_fullsized":"2023-12-22T10:01:49.150313+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":18,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.993998+0000","last_change":"2023-12-22T10:01:34.690874+0000","last_active":"2023-12-22T10:01:49.993998+0000","last_peered":"2023-12-22T10:01:49.993998+0000","last_clean":"2023-12-22T10:01:49.993998+0000","last_became_active":"2023-12-22T10:01:34.690525+0000","last_became_peered":"2023-12-22T10:01:34.690525+0000","last_unstale":"2023-12-22T10:01:49.993998+0000","last_undegraded":"2023-12-22T10:01:49.993998+0000","last_fullsized":"2023-12-22T10:01:49.993998+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.010250+0000","last_change":"2023-12-22T10:01:50.006314+0000","last_active":"2023-12-22T10:01:50.010250+0000","last_peered":"2023-12-22T10:01:50.010250+0000","last_clean":"2023-12-22T10:01:50.010250+0000","last_became_active":"2023-12-22T10:01:50.005950+0000","last_became_peered":"2023-12-22T10:01:50.005950+0000","last_unstale":"2023-12-22T10:01:50.010250+0000","last_undegraded":"2023-12-22T10:01:50.010250+0000","last_fullsized":"2023-12-22T10:01:50.010250+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.36","version":"36'15","reported_seq":29,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.136193+0000","last_change":"2023-12-22T10:01:35.163651+0000","last_active":"2023-12-22T10:01:49.136193+0000","last_peered":"2023-12-22T10:01:49.136193+0000","last_clean":"2023-12-22T10:01:49.136193+0000","last_became_active":"2023-12-22T10:01:35.163305+0000","last_became_peered":"2023-12-22T10:01:35.163305+0000","last_unstale":"2023-12-22T10:01:49.136193+0000","last_undegraded":"2023-12-22T10:01:49.136193+0000","last_fullsized":"2023-12-22T10:01:49.136193+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":16,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.150201+0000","last_change":"2023-12-22T10:01:34.691997+0000","last_active":"2023-12-22T10:01:49.150201+0000","last_peered":"2023-12-22T10:01:49.150201+0000","last_clean":"2023-12-22T10:01:49.150201+0000","last_became_active":"2023-12-22T10:01:34.691557+0000","last_became_peered":"2023-12-22T10:01:34.691557+0000","last_unstale":"2023-12-22T10:01:49.150201+0000","last_undegraded":"2023-12-22T10:01:49.150201+0000","last_fullsized":"2023-12-22T10:01:49.150201+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.013954+0000","last_change":"2023-12-22T10:01:50.008491+0000","last_active":"2023-12-22T10:01:50.013954+0000","last_peered":"2023-12-22T10:01:50.013954+0000","last_clean":"2023-12-22T10:01:50.013954+0000","last_became_active":"2023-12-22T10:01:50.008177+0000","last_became_peered":"2023-12-22T10:01:50.008177+0000","last_unstale":"2023-12-22T10:01:50.013954+0000","last_undegraded":"2023-12-22T10:01:50.013954+0000","last_fullsized":"2023-12-22T10:01:50.013954+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.37","version":"36'11","reported_seq":28,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.993914+0000","last_change":"2023-12-22T10:01:35.153014+0000","last_active":"2023-12-22T10:01:49.993914+0000","last_peered":"2023-12-22T10:01:49.993914+0000","last_clean":"2023-12-22T10:01:49.993914+0000","last_became_active":"2023-12-22T10:01:35.152544+0000","last_became_peered":"2023-12-22T10:01:35.152544+0000","last_unstale":"2023-12-22T10:01:49.993914+0000","last_undegraded":"2023-12-22T10:01:49.993914+0000","last_fullsized":"2023-12-22T10:01:49.993914+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"41'15","reported_seq":30,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.136185+0000","last_change":"2023-12-22T10:01:34.698273+0000","last_active":"2023-12-22T10:01:49.136185+0000","last_peered":"2023-12-22T10:01:49.136185+0000","last_clean":"2023-12-22T10:01:49.136185+0000","last_became_active":"2023-12-22T10:01:34.697971+0000","last_became_peered":"2023-12-22T10:01:34.697971+0000","last_unstale":"2023-12-22T10:01:49.136185+0000","last_undegraded":"2023-12-22T10:01:49.136185+0000","last_fullsized":"2023-12-22T10:01:49.136185+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.015859+0000","last_change":"2023-12-22T10:01:50.015859+0000","last_active":"2023-12-22T10:01:50.015859+0000","last_peered":"2023-12-22T10:01:50.015859+0000","last_clean":"2023-12-22T10:01:50.015859+0000","last_became_active":"2023-12-22T10:01:50.015573+0000","last_became_peered":"2023-12-22T10:01:50.015573+0000","last_unstale":"2023-12-22T10:01:50.015859+0000","last_undegraded":"2023-12-22T10:01:50.015859+0000","last_fullsized":"2023-12-22T10:01:50.015859+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"36'9","reported_seq":23,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.134966+0000","last_change":"2023-12-22T10:01:35.157227+0000","last_active":"2023-12-22T10:01:49.134966+0000","last_peered":"2023-12-22T10:01:49.134966+0000","last_clean":"2023-12-22T10:01:49.134966+0000","last_became_active":"2023-12-22T10:01:35.156649+0000","last_became_peered":"2023-12-22T10:01:35.156649+0000","last_unstale":"2023-12-22T10:01:49.134966+0000","last_undegraded":"2023-12-22T10:01:49.134966+0000","last_fullsized":"2023-12-22T10:01:49.134966+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"41'2","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.991555+0000","last_change":"2023-12-22T10:01:34.696594+0000","last_active":"2023-12-22T10:01:49.991555+0000","last_peered":"2023-12-22T10:01:49.991555+0000","last_clean":"2023-12-22T10:01:49.991555+0000","last_became_active":"2023-12-22T10:01:34.696150+0000","last_became_peered":"2023-12-22T10:01:34.696150+0000","last_unstale":"2023-12-22T10:01:49.991555+0000","last_undegraded":"2023-12-22T10:01:49.991555+0000","last_fullsized":"2023-12-22T10:01:49.991555+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.022052+0000","last_change":"2023-12-22T10:01:50.022052+0000","last_active":"2023-12-22T10:01:50.022052+0000","last_peered":"2023-12-22T10:01:50.022052+0000","last_clean":"2023-12-22T10:01:50.022052+0000","last_became_active":"2023-12-22T10:01:50.021777+0000","last_became_peered":"2023-12-22T10:01:50.021777+0000","last_unstale":"2023-12-22T10:01:50.022052+0000","last_undegraded":"2023-12-22T10:01:50.022052+0000","last_fullsized":"2023-12-22T10:01:50.022052+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.31","version":"36'7","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.146998+0000","last_change":"2023-12-22T10:01:35.143685+0000","last_active":"2023-12-22T10:01:49.146998+0000","last_peered":"2023-12-22T10:01:49.146998+0000","last_clean":"2023-12-22T10:01:49.146998+0000","last_became_active":"2023-12-22T10:01:35.142366+0000","last_became_peered":"2023-12-22T10:01:35.142366+0000","last_unstale":"2023-12-22T10:01:49.146998+0000","last_undegraded":"2023-12-22T10:01:49.146998+0000","last_fullsized":"2023-12-22T10:01:49.146998+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":18,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.994049+0000","last_change":"2023-12-22T10:01:34.691884+0000","last_active":"2023-12-22T10:01:49.994049+0000","last_peered":"2023-12-22T10:01:49.994049+0000","last_clean":"2023-12-22T10:01:49.994049+0000","last_became_active":"2023-12-22T10:01:34.691602+0000","last_became_peered":"2023-12-22T10:01:34.691602+0000","last_unstale":"2023-12-22T10:01:49.994049+0000","last_undegraded":"2023-12-22T10:01:49.994049+0000","last_fullsized":"2023-12-22T10:01:49.994049+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.023189+0000","last_change":"2023-12-22T10:01:50.020971+0000","last_active":"2023-12-22T10:01:50.023189+0000","last_peered":"2023-12-22T10:01:50.023189+0000","last_clean":"2023-12-22T10:01:50.023189+0000","last_became_active":"2023-12-22T10:01:50.020655+0000","last_became_peered":"2023-12-22T10:01:50.020655+0000","last_unstale":"2023-12-22T10:01:50.023189+0000","last_undegraded":"2023-12-22T10:01:50.023189+0000","last_fullsized":"2023-12-22T10:01:50.023189+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.32","version":"36'8","reported_seq":23,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.150762+0000","last_change":"2023-12-22T10:01:35.137981+0000","last_active":"2023-12-22T10:01:49.150762+0000","last_peered":"2023-12-22T10:01:49.150762+0000","last_clean":"2023-12-22T10:01:49.150762+0000","last_became_active":"2023-12-22T10:01:35.137659+0000","last_became_peered":"2023-12-22T10:01:35.137659+0000","last_unstale":"2023-12-22T10:01:49.150762+0000","last_undegraded":"2023-12-22T10:01:49.150762+0000","last_fullsized":"2023-12-22T10:01:49.150762+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.149796+0000","last_change":"2023-12-22T10:01:34.701089+0000","last_active":"2023-12-22T10:01:49.149796+0000","last_peered":"2023-12-22T10:01:49.149796+0000","last_clean":"2023-12-22T10:01:49.149796+0000","last_became_active":"2023-12-22T10:01:34.699878+0000","last_became_peered":"2023-12-22T10:01:34.699878+0000","last_unstale":"2023-12-22T10:01:49.149796+0000","last_undegraded":"2023-12-22T10:01:49.149796+0000","last_fullsized":"2023-12-22T10:01:49.149796+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.016195+0000","last_change":"2023-12-22T10:01:50.016195+0000","last_active":"2023-12-22T10:01:50.016195+0000","last_peered":"2023-12-22T10:01:50.016195+0000","last_clean":"2023-12-22T10:01:50.016195+0000","last_became_active":"2023-12-22T10:01:50.015294+0000","last_became_peered":"2023-12-22T10:01:50.015294+0000","last_unstale":"2023-12-22T10:01:50.016195+0000","last_undegraded":"2023-12-22T10:01:50.016195+0000","last_fullsized":"2023-12-22T10:01:50.016195+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.33","version":"36'10","reported_seq":24,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.135793+0000","last_change":"2023-12-22T10:01:35.143515+0000","last_active":"2023-12-22T10:01:49.135793+0000","last_peered":"2023-12-22T10:01:49.135793+0000","last_clean":"2023-12-22T10:01:49.135793+0000","last_became_active":"2023-12-22T10:01:35.143051+0000","last_became_peered":"2023-12-22T10:01:35.143051+0000","last_unstale":"2023-12-22T10:01:49.135793+0000","last_undegraded":"2023-12-22T10:01:49.135793+0000","last_fullsized":"2023-12-22T10:01:49.135793+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.30","version":"41'9","reported_seq":24,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.150579+0000","last_change":"2023-12-22T10:01:34.682518+0000","last_active":"2023-12-22T10:01:49.150579+0000","last_peered":"2023-12-22T10:01:49.150579+0000","last_clean":"2023-12-22T10:01:49.150579+0000","last_became_active":"2023-12-22T10:01:34.680968+0000","last_became_peered":"2023-12-22T10:01:34.680968+0000","last_unstale":"2023-12-22T10:01:49.150579+0000","last_undegraded":"2023-12-22T10:01:49.150579+0000","last_fullsized":"2023-12-22T10:01:49.150579+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.003440+0000","last_change":"2023-12-22T10:01:50.003440+0000","last_active":"2023-12-22T10:01:50.003440+0000","last_peered":"2023-12-22T10:01:50.003440+0000","last_clean":"2023-12-22T10:01:50.003440+0000","last_became_active":"2023-12-22T10:01:50.003142+0000","last_became_peered":"2023-12-22T10:01:50.003142+0000","last_unstale":"2023-12-22T10:01:50.003440+0000","last_undegraded":"2023-12-22T10:01:50.003440+0000","last_fullsized":"2023-12-22T10:01:50.003440+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2c","version":"36'8","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.150156+0000","last_change":"2023-12-22T10:01:35.156632+0000","last_active":"2023-12-22T10:01:49.150156+0000","last_peered":"2023-12-22T10:01:49.150156+0000","last_clean":"2023-12-22T10:01:49.150156+0000","last_became_active":"2023-12-22T10:01:35.156348+0000","last_became_peered":"2023-12-22T10:01:35.156348+0000","last_unstale":"2023-12-22T10:01:49.150156+0000","last_undegraded":"2023-12-22T10:01:49.150156+0000","last_fullsized":"2023-12-22T10:01:49.150156+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":16,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.149719+0000","last_change":"2023-12-22T10:01:34.694956+0000","last_active":"2023-12-22T10:01:49.149719+0000","last_peered":"2023-12-22T10:01:49.149719+0000","last_clean":"2023-12-22T10:01:49.149719+0000","last_became_active":"2023-12-22T10:01:34.694670+0000","last_became_peered":"2023-12-22T10:01:34.694670+0000","last_unstale":"2023-12-22T10:01:49.149719+0000","last_undegraded":"2023-12-22T10:01:49.149719+0000","last_fullsized":"2023-12-22T10:01:49.149719+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.014674+0000","last_change":"2023-12-22T10:01:50.012069+0000","last_active":"2023-12-22T10:01:50.014674+0000","last_peered":"2023-12-22T10:01:50.014674+0000","last_clean":"2023-12-22T10:01:50.014674+0000","last_became_active":"2023-12-22T10:01:50.011441+0000","last_became_peered":"2023-12-22T10:01:50.011441+0000","last_unstale":"2023-12-22T10:01:50.014674+0000","last_undegraded":"2023-12-22T10:01:50.014674+0000","last_fullsized":"2023-12-22T10:01:50.014674+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2d","version":"36'7","reported_seq":21,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.143060+0000","last_change":"2023-12-22T10:01:35.145727+0000","last_active":"2023-12-22T10:01:49.143060+0000","last_peered":"2023-12-22T10:01:49.143060+0000","last_clean":"2023-12-22T10:01:49.143060+0000","last_became_active":"2023-12-22T10:01:35.143309+0000","last_became_peered":"2023-12-22T10:01:35.143309+0000","last_unstale":"2023-12-22T10:01:49.143060+0000","last_undegraded":"2023-12-22T10:01:49.143060+0000","last_fullsized":"2023-12-22T10:01:49.143060+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":18,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.995962+0000","last_change":"2023-12-22T10:01:34.693702+0000","last_active":"2023-12-22T10:01:49.995962+0000","last_peered":"2023-12-22T10:01:49.995962+0000","last_clean":"2023-12-22T10:01:49.995962+0000","last_became_active":"2023-12-22T10:01:34.693312+0000","last_became_peered":"2023-12-22T10:01:34.693312+0000","last_unstale":"2023-12-22T10:01:49.995962+0000","last_undegraded":"2023-12-22T10:01:49.995962+0000","last_fullsized":"2023-12-22T10:01:49.995962+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.999975+0000","last_change":"2023-12-22T10:01:49.999975+0000","last_active":"2023-12-22T10:01:49.999975+0000","last_peered":"2023-12-22T10:01:49.999975+0000","last_clean":"2023-12-22T10:01:49.999975+0000","last_became_active":"2023-12-22T10:01:49.999687+0000","last_became_peered":"2023-12-22T10:01:49.999687+0000","last_unstale":"2023-12-22T10:01:49.999975+0000","last_undegraded":"2023-12-22T10:01:49.999975+0000","last_fullsized":"2023-12-22T10:01:49.999975+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2e","version":"36'10","reported_seq":25,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.150058+0000","last_change":"2023-12-22T10:01:35.161551+0000","last_active":"2023-12-22T10:01:49.150058+0000","last_peered":"2023-12-22T10:01:49.150058+0000","last_clean":"2023-12-22T10:01:49.150058+0000","last_became_active":"2023-12-22T10:01:35.161234+0000","last_became_peered":"2023-12-22T10:01:35.161234+0000","last_unstale":"2023-12-22T10:01:49.150058+0000","last_undegraded":"2023-12-22T10:01:49.150058+0000","last_fullsized":"2023-12-22T10:01:49.150058+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"41'2","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.994295+0000","last_change":"2023-12-22T10:01:34.703838+0000","last_active":"2023-12-22T10:01:49.994295+0000","last_peered":"2023-12-22T10:01:49.994295+0000","last_clean":"2023-12-22T10:01:49.994295+0000","last_became_active":"2023-12-22T10:01:34.703546+0000","last_became_peered":"2023-12-22T10:01:34.703546+0000","last_unstale":"2023-12-22T10:01:49.994295+0000","last_undegraded":"2023-12-22T10:01:49.994295+0000","last_fullsized":"2023-12-22T10:01:49.994295+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.016291+0000","last_change":"2023-12-22T10:01:50.016291+0000","last_active":"2023-12-22T10:01:50.016291+0000","last_peered":"2023-12-22T10:01:50.016291+0000","last_clean":"2023-12-22T10:01:50.016291+0000","last_became_active":"2023-12-22T10:01:50.015984+0000","last_became_peered":"2023-12-22T10:01:50.015984+0000","last_unstale":"2023-12-22T10:01:50.016291+0000","last_undegraded":"2023-12-22T10:01:50.016291+0000","last_fullsized":"2023-12-22T10:01:50.016291+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2f","version":"36'9","reported_seq":24,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.149806+0000","last_change":"2023-12-22T10:01:35.162395+0000","last_active":"2023-12-22T10:01:49.149806+0000","last_peered":"2023-12-22T10:01:49.149806+0000","last_clean":"2023-12-22T10:01:49.149806+0000","last_became_active":"2023-12-22T10:01:35.162144+0000","last_became_peered":"2023-12-22T10:01:35.162144+0000","last_unstale":"2023-12-22T10:01:49.149806+0000","last_undegraded":"2023-12-22T10:01:49.149806+0000","last_fullsized":"2023-12-22T10:01:49.149806+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2097152,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":18,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.990577+0000","last_change":"2023-12-22T10:01:34.700164+0000","last_active":"2023-12-22T10:01:49.990577+0000","last_peered":"2023-12-22T10:01:49.990577+0000","last_clean":"2023-12-22T10:01:49.990577+0000","last_became_active":"2023-12-22T10:01:34.699864+0000","last_became_peered":"2023-12-22T10:01:34.699864+0000","last_unstale":"2023-12-22T10:01:49.990577+0000","last_undegraded":"2023-12-22T10:01:49.990577+0000","last_fullsized":"2023-12-22T10:01:49.990577+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.017039+0000","last_change":"2023-12-22T10:01:50.017039+0000","last_active":"2023-12-22T10:01:50.017039+0000","last_peered":"2023-12-22T10:01:50.017039+0000","last_clean":"2023-12-22T10:01:50.017039+0000","last_became_active":"2023-12-22T10:01:50.016152+0000","last_became_peered":"2023-12-22T10:01:50.016152+0000","last_unstale":"2023-12-22T10:01:50.017039+0000","last_undegraded":"2023-12-22T10:01:50.017039+0000","last_fullsized":"2023-12-22T10:01:50.017039+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.28","version":"36'6","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.994938+0000","last_change":"2023-12-22T10:01:35.144436+0000","last_active":"2023-12-22T10:01:49.994938+0000","last_peered":"2023-12-22T10:01:49.994938+0000","last_clean":"2023-12-22T10:01:49.994938+0000","last_became_active":"2023-12-22T10:01:35.143672+0000","last_became_peered":"2023-12-22T10:01:35.143672+0000","last_unstale":"2023-12-22T10:01:49.994938+0000","last_undegraded":"2023-12-22T10:01:49.994938+0000","last_fullsized":"2023-12-22T10:01:49.994938+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2b","version":"35'1","reported_seq":16,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.150866+0000","last_change":"2023-12-22T10:01:34.695729+0000","last_active":"2023-12-22T10:01:49.150866+0000","last_peered":"2023-12-22T10:01:49.150866+0000","last_clean":"2023-12-22T10:01:49.150866+0000","last_became_active":"2023-12-22T10:01:34.695350+0000","last_became_peered":"2023-12-22T10:01:34.695350+0000","last_unstale":"2023-12-22T10:01:49.150866+0000","last_undegraded":"2023-12-22T10:01:49.150866+0000","last_fullsized":"2023-12-22T10:01:49.150866+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.023520+0000","last_change":"2023-12-22T10:01:50.023520+0000","last_active":"2023-12-22T10:01:50.023520+0000","last_peered":"2023-12-22T10:01:50.023520+0000","last_clean":"2023-12-22T10:01:50.023520+0000","last_became_active":"2023-12-22T10:01:50.023053+0000","last_became_peered":"2023-12-22T10:01:50.023053+0000","last_unstale":"2023-12-22T10:01:50.023520+0000","last_undegraded":"2023-12-22T10:01:50.023520+0000","last_fullsized":"2023-12-22T10:01:50.023520+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.29","version":"36'8","reported_seq":23,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.147084+0000","last_change":"2023-12-22T10:01:35.153565+0000","last_active":"2023-12-22T10:01:49.147084+0000","last_peered":"2023-12-22T10:01:49.147084+0000","last_clean":"2023-12-22T10:01:49.147084+0000","last_became_active":"2023-12-22T10:01:35.153282+0000","last_became_peered":"2023-12-22T10:01:35.153282+0000","last_unstale":"2023-12-22T10:01:49.147084+0000","last_undegraded":"2023-12-22T10:01:49.147084+0000","last_fullsized":"2023-12-22T10:01:49.147084+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":16,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.150852+0000","last_change":"2023-12-22T10:01:34.698295+0000","last_active":"2023-12-22T10:01:49.150852+0000","last_peered":"2023-12-22T10:01:49.150852+0000","last_clean":"2023-12-22T10:01:49.150852+0000","last_became_active":"2023-12-22T10:01:34.697636+0000","last_became_peered":"2023-12-22T10:01:34.697636+0000","last_unstale":"2023-12-22T10:01:49.150852+0000","last_undegraded":"2023-12-22T10:01:49.150852+0000","last_fullsized":"2023-12-22T10:01:49.150852+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.018818+0000","last_change":"2023-12-22T10:01:50.018818+0000","last_active":"2023-12-22T10:01:50.018818+0000","last_peered":"2023-12-22T10:01:50.018818+0000","last_clean":"2023-12-22T10:01:50.018818+0000","last_became_active":"2023-12-22T10:01:50.018529+0000","last_became_peered":"2023-12-22T10:01:50.018529+0000","last_unstale":"2023-12-22T10:01:50.018818+0000","last_undegraded":"2023-12-22T10:01:50.018818+0000","last_fullsized":"2023-12-22T10:01:50.018818+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"36'9","reported_seq":23,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.149450+0000","last_change":"2023-12-22T10:01:35.145659+0000","last_active":"2023-12-22T10:01:49.149450+0000","last_peered":"2023-12-22T10:01:49.149450+0000","last_clean":"2023-12-22T10:01:49.149450+0000","last_became_active":"2023-12-22T10:01:35.145349+0000","last_became_peered":"2023-12-22T10:01:35.145349+0000","last_unstale":"2023-12-22T10:01:49.149450+0000","last_undegraded":"2023-12-22T10:01:49.149450+0000","last_fullsized":"2023-12-22T10:01:49.149450+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":18,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.989750+0000","last_change":"2023-12-22T10:01:34.706960+0000","last_active":"2023-12-22T10:01:49.989750+0000","last_peered":"2023-12-22T10:01:49.989750+0000","last_clean":"2023-12-22T10:01:49.989750+0000","last_became_active":"2023-12-22T10:01:34.706683+0000","last_became_peered":"2023-12-22T10:01:34.706683+0000","last_unstale":"2023-12-22T10:01:49.989750+0000","last_undegraded":"2023-12-22T10:01:49.989750+0000","last_fullsized":"2023-12-22T10:01:49.989750+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.009744+0000","last_change":"2023-12-22T10:01:50.002604+0000","last_active":"2023-12-22T10:01:50.009744+0000","last_peered":"2023-12-22T10:01:50.009744+0000","last_clean":"2023-12-22T10:01:50.009744+0000","last_became_active":"2023-12-22T10:01:50.002000+0000","last_became_peered":"2023-12-22T10:01:50.002000+0000","last_unstale":"2023-12-22T10:01:50.009744+0000","last_undegraded":"2023-12-22T10:01:50.009744+0000","last_fullsized":"2023-12-22T10:01:50.009744+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2b","version":"36'11","reported_seq":25,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.150743+0000","last_change":"2023-12-22T10:01:35.149661+0000","last_active":"2023-12-22T10:01:49.150743+0000","last_peered":"2023-12-22T10:01:49.150743+0000","last_clean":"2023-12-22T10:01:49.150743+0000","last_became_active":"2023-12-22T10:01:35.149440+0000","last_became_peered":"2023-12-22T10:01:35.149440+0000","last_unstale":"2023-12-22T10:01:49.150743+0000","last_undegraded":"2023-12-22T10:01:49.150743+0000","last_fullsized":"2023-12-22T10:01:49.150743+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":16,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.148876+0000","last_change":"2023-12-22T10:01:34.698945+0000","last_active":"2023-12-22T10:01:49.148876+0000","last_peered":"2023-12-22T10:01:49.148876+0000","last_clean":"2023-12-22T10:01:49.148876+0000","last_became_active":"2023-12-22T10:01:34.698609+0000","last_became_peered":"2023-12-22T10:01:34.698609+0000","last_unstale":"2023-12-22T10:01:49.148876+0000","last_undegraded":"2023-12-22T10:01:49.148876+0000","last_fullsized":"2023-12-22T10:01:49.148876+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.008012+0000","last_change":"2023-12-22T10:01:50.008012+0000","last_active":"2023-12-22T10:01:50.008012+0000","last_peered":"2023-12-22T10:01:50.008012+0000","last_clean":"2023-12-22T10:01:50.008012+0000","last_became_active":"2023-12-22T10:01:50.007756+0000","last_became_peered":"2023-12-22T10:01:50.007756+0000","last_unstale":"2023-12-22T10:01:50.008012+0000","last_undegraded":"2023-12-22T10:01:50.008012+0000","last_fullsized":"2023-12-22T10:01:50.008012+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.24","version":"36'4","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.135840+0000","last_change":"2023-12-22T10:01:35.155343+0000","last_active":"2023-12-22T10:01:49.135840+0000","last_peered":"2023-12-22T10:01:49.135840+0000","last_clean":"2023-12-22T10:01:49.135840+0000","last_became_active":"2023-12-22T10:01:35.154943+0000","last_became_peered":"2023-12-22T10:01:35.154943+0000","last_unstale":"2023-12-22T10:01:49.135840+0000","last_undegraded":"2023-12-22T10:01:49.135840+0000","last_fullsized":"2023-12-22T10:01:49.135840+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":18,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.992683+0000","last_change":"2023-12-22T10:01:34.689294+0000","last_active":"2023-12-22T10:01:49.992683+0000","last_peered":"2023-12-22T10:01:49.992683+0000","last_clean":"2023-12-22T10:01:49.992683+0000","last_became_active":"2023-12-22T10:01:34.687510+0000","last_became_peered":"2023-12-22T10:01:34.687510+0000","last_unstale":"2023-12-22T10:01:49.992683+0000","last_undegraded":"2023-12-22T10:01:49.992683+0000","last_fullsized":"2023-12-22T10:01:49.992683+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.013215+0000","last_change":"2023-12-22T10:01:50.013215+0000","last_active":"2023-12-22T10:01:50.013215+0000","last_peered":"2023-12-22T10:01:50.013215+0000","last_clean":"2023-12-22T10:01:50.013215+0000","last_became_active":"2023-12-22T10:01:50.012570+0000","last_became_peered":"2023-12-22T10:01:50.012570+0000","last_unstale":"2023-12-22T10:01:50.013215+0000","last_undegraded":"2023-12-22T10:01:50.013215+0000","last_fullsized":"2023-12-22T10:01:50.013215+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.25","version":"36'6","reported_seq":20,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.150401+0000","last_change":"2023-12-22T10:01:35.148843+0000","last_active":"2023-12-22T10:01:49.150401+0000","last_peered":"2023-12-22T10:01:49.150401+0000","last_clean":"2023-12-22T10:01:49.150401+0000","last_became_active":"2023-12-22T10:01:35.148363+0000","last_became_peered":"2023-12-22T10:01:35.148363+0000","last_unstale":"2023-12-22T10:01:49.150401+0000","last_undegraded":"2023-12-22T10:01:49.150401+0000","last_fullsized":"2023-12-22T10:01:49.150401+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.26","version":"41'3","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.994095+0000","last_change":"2023-12-22T10:01:34.702043+0000","last_active":"2023-12-22T10:01:49.994095+0000","last_peered":"2023-12-22T10:01:49.994095+0000","last_clean":"2023-12-22T10:01:49.994095+0000","last_became_active":"2023-12-22T10:01:34.701318+0000","last_became_peered":"2023-12-22T10:01:34.701318+0000","last_unstale":"2023-12-22T10:01:49.994095+0000","last_undegraded":"2023-12-22T10:01:49.994095+0000","last_fullsized":"2023-12-22T10:01:49.994095+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.009260+0000","last_change":"2023-12-22T10:01:50.009260+0000","last_active":"2023-12-22T10:01:50.009260+0000","last_peered":"2023-12-22T10:01:50.009260+0000","last_clean":"2023-12-22T10:01:50.009260+0000","last_became_active":"2023-12-22T10:01:50.008997+0000","last_became_peered":"2023-12-22T10:01:50.008997+0000","last_unstale":"2023-12-22T10:01:50.009260+0000","last_undegraded":"2023-12-22T10:01:50.009260+0000","last_fullsized":"2023-12-22T10:01:50.009260+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.26","version":"36'15","reported_seq":32,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.993891+0000","last_change":"2023-12-22T10:01:35.134712+0000","last_active":"2023-12-22T10:01:49.993891+0000","last_peered":"2023-12-22T10:01:49.993891+0000","last_clean":"2023-12-22T10:01:49.993891+0000","last_became_active":"2023-12-22T10:01:35.134447+0000","last_became_peered":"2023-12-22T10:01:35.134447+0000","last_unstale":"2023-12-22T10:01:49.993891+0000","last_undegraded":"2023-12-22T10:01:49.993891+0000","last_fullsized":"2023-12-22T10:01:49.993891+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.143146+0000","last_change":"2023-12-22T10:01:34.688497+0000","last_active":"2023-12-22T10:01:49.143146+0000","last_peered":"2023-12-22T10:01:49.143146+0000","last_clean":"2023-12-22T10:01:49.143146+0000","last_became_active":"2023-12-22T10:01:34.688207+0000","last_became_peered":"2023-12-22T10:01:34.688207+0000","last_unstale":"2023-12-22T10:01:49.143146+0000","last_undegraded":"2023-12-22T10:01:49.143146+0000","last_fullsized":"2023-12-22T10:01:49.143146+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.017463+0000","last_change":"2023-12-22T10:01:50.017463+0000","last_active":"2023-12-22T10:01:50.017463+0000","last_peered":"2023-12-22T10:01:50.017463+0000","last_clean":"2023-12-22T10:01:50.017463+0000","last_became_active":"2023-12-22T10:01:50.014988+0000","last_became_peered":"2023-12-22T10:01:50.014988+0000","last_unstale":"2023-12-22T10:01:50.017463+0000","last_undegraded":"2023-12-22T10:01:50.017463+0000","last_fullsized":"2023-12-22T10:01:50.017463+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.27","version":"36'2","reported_seq":17,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.151336+0000","last_change":"2023-12-22T10:01:35.143383+0000","last_active":"2023-12-22T10:01:49.151336+0000","last_peered":"2023-12-22T10:01:49.151336+0000","last_clean":"2023-12-22T10:01:49.151336+0000","last_became_active":"2023-12-22T10:01:35.143073+0000","last_became_peered":"2023-12-22T10:01:35.143073+0000","last_unstale":"2023-12-22T10:01:49.151336+0000","last_undegraded":"2023-12-22T10:01:49.151336+0000","last_fullsized":"2023-12-22T10:01:49.151336+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":16,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.152419+0000","last_change":"2023-12-22T10:01:34.695905+0000","last_active":"2023-12-22T10:01:49.152419+0000","last_peered":"2023-12-22T10:01:49.152419+0000","last_clean":"2023-12-22T10:01:49.152419+0000","last_became_active":"2023-12-22T10:01:34.695517+0000","last_became_peered":"2023-12-22T10:01:34.695517+0000","last_unstale":"2023-12-22T10:01:49.152419+0000","last_undegraded":"2023-12-22T10:01:49.152419+0000","last_fullsized":"2023-12-22T10:01:49.152419+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.001887+0000","last_change":"2023-12-22T10:01:49.999817+0000","last_active":"2023-12-22T10:01:50.001887+0000","last_peered":"2023-12-22T10:01:50.001887+0000","last_clean":"2023-12-22T10:01:50.001887+0000","last_became_active":"2023-12-22T10:01:49.999543+0000","last_became_peered":"2023-12-22T10:01:49.999543+0000","last_unstale":"2023-12-22T10:01:50.001887+0000","last_undegraded":"2023-12-22T10:01:50.001887+0000","last_fullsized":"2023-12-22T10:01:50.001887+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.20","version":"36'9","reported_seq":26,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.995067+0000","last_change":"2023-12-22T10:01:35.144625+0000","last_active":"2023-12-22T10:01:49.995067+0000","last_peered":"2023-12-22T10:01:49.995067+0000","last_clean":"2023-12-22T10:01:49.995067+0000","last_became_active":"2023-12-22T10:01:35.142641+0000","last_became_peered":"2023-12-22T10:01:35.142641+0000","last_unstale":"2023-12-22T10:01:49.995067+0000","last_undegraded":"2023-12-22T10:01:49.995067+0000","last_fullsized":"2023-12-22T10:01:49.995067+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.150932+0000","last_change":"2023-12-22T10:01:34.698158+0000","last_active":"2023-12-22T10:01:49.150932+0000","last_peered":"2023-12-22T10:01:49.150932+0000","last_clean":"2023-12-22T10:01:49.150932+0000","last_became_active":"2023-12-22T10:01:34.695554+0000","last_became_peered":"2023-12-22T10:01:34.695554+0000","last_unstale":"2023-12-22T10:01:49.150932+0000","last_undegraded":"2023-12-22T10:01:49.150932+0000","last_fullsized":"2023-12-22T10:01:49.150932+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.012039+0000","last_change":"2023-12-22T10:01:50.012039+0000","last_active":"2023-12-22T10:01:50.012039+0000","last_peered":"2023-12-22T10:01:50.012039+0000","last_clean":"2023-12-22T10:01:50.012039+0000","last_became_active":"2023-12-22T10:01:50.011753+0000","last_became_peered":"2023-12-22T10:01:50.011753+0000","last_unstale":"2023-12-22T10:01:50.012039+0000","last_undegraded":"2023-12-22T10:01:50.012039+0000","last_fullsized":"2023-12-22T10:01:50.012039+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.21","version":"36'12","reported_seq":26,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.135244+0000","last_change":"2023-12-22T10:01:35.134824+0000","last_active":"2023-12-22T10:01:49.135244+0000","last_peered":"2023-12-22T10:01:49.135244+0000","last_clean":"2023-12-22T10:01:49.135244+0000","last_became_active":"2023-12-22T10:01:35.134157+0000","last_became_peered":"2023-12-22T10:01:35.134157+0000","last_unstale":"2023-12-22T10:01:49.135244+0000","last_undegraded":"2023-12-22T10:01:49.135244+0000","last_fullsized":"2023-12-22T10:01:49.135244+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.149789+0000","last_change":"2023-12-22T10:01:34.690897+0000","last_active":"2023-12-22T10:01:49.149789+0000","last_peered":"2023-12-22T10:01:49.149789+0000","last_clean":"2023-12-22T10:01:49.149789+0000","last_became_active":"2023-12-22T10:01:34.689026+0000","last_became_peered":"2023-12-22T10:01:34.689026+0000","last_unstale":"2023-12-22T10:01:49.149789+0000","last_undegraded":"2023-12-22T10:01:49.149789+0000","last_fullsized":"2023-12-22T10:01:49.149789+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.007764+0000","last_change":"2023-12-22T10:01:50.007764+0000","last_active":"2023-12-22T10:01:50.007764+0000","last_peered":"2023-12-22T10:01:50.007764+0000","last_clean":"2023-12-22T10:01:50.007764+0000","last_became_active":"2023-12-22T10:01:50.006037+0000","last_became_peered":"2023-12-22T10:01:50.006037+0000","last_unstale":"2023-12-22T10:01:50.007764+0000","last_undegraded":"2023-12-22T10:01:50.007764+0000","last_fullsized":"2023-12-22T10:01:50.007764+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.22","version":"36'8","reported_seq":23,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.148945+0000","last_change":"2023-12-22T10:01:35.153324+0000","last_active":"2023-12-22T10:01:49.148945+0000","last_peered":"2023-12-22T10:01:49.148945+0000","last_clean":"2023-12-22T10:01:49.148945+0000","last_became_active":"2023-12-22T10:01:35.152234+0000","last_became_peered":"2023-12-22T10:01:35.152234+0000","last_unstale":"2023-12-22T10:01:49.148945+0000","last_undegraded":"2023-12-22T10:01:49.148945+0000","last_fullsized":"2023-12-22T10:01:49.148945+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":16,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.149814+0000","last_change":"2023-12-22T10:01:34.684413+0000","last_active":"2023-12-22T10:01:49.149814+0000","last_peered":"2023-12-22T10:01:49.149814+0000","last_clean":"2023-12-22T10:01:49.149814+0000","last_became_active":"2023-12-22T10:01:34.684083+0000","last_became_peered":"2023-12-22T10:01:34.684083+0000","last_unstale":"2023-12-22T10:01:49.149814+0000","last_undegraded":"2023-12-22T10:01:49.149814+0000","last_fullsized":"2023-12-22T10:01:49.149814+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.009675+0000","last_change":"2023-12-22T10:01:50.009675+0000","last_active":"2023-12-22T10:01:50.009675+0000","last_peered":"2023-12-22T10:01:50.009675+0000","last_clean":"2023-12-22T10:01:50.009675+0000","last_became_active":"2023-12-22T10:01:50.009187+0000","last_became_peered":"2023-12-22T10:01:50.009187+0000","last_unstale":"2023-12-22T10:01:50.009675+0000","last_undegraded":"2023-12-22T10:01:50.009675+0000","last_fullsized":"2023-12-22T10:01:50.009675+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.23","version":"36'7","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.149897+0000","last_change":"2023-12-22T10:01:35.152474+0000","last_active":"2023-12-22T10:01:49.149897+0000","last_peered":"2023-12-22T10:01:49.149897+0000","last_clean":"2023-12-22T10:01:49.149897+0000","last_became_active":"2023-12-22T10:01:35.152153+0000","last_became_peered":"2023-12-22T10:01:35.152153+0000","last_unstale":"2023-12-22T10:01:49.149897+0000","last_undegraded":"2023-12-22T10:01:49.149897+0000","last_fullsized":"2023-12-22T10:01:49.149897+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":16,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.146971+0000","last_change":"2023-12-22T10:01:34.689631+0000","last_active":"2023-12-22T10:01:49.146971+0000","last_peered":"2023-12-22T10:01:49.146971+0000","last_clean":"2023-12-22T10:01:49.146971+0000","last_became_active":"2023-12-22T10:01:34.689296+0000","last_became_peered":"2023-12-22T10:01:34.689296+0000","last_unstale":"2023-12-22T10:01:49.146971+0000","last_undegraded":"2023-12-22T10:01:49.146971+0000","last_fullsized":"2023-12-22T10:01:49.146971+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.016591+0000","last_change":"2023-12-22T10:01:50.016591+0000","last_active":"2023-12-22T10:01:50.016591+0000","last_peered":"2023-12-22T10:01:50.016591+0000","last_clean":"2023-12-22T10:01:50.016591+0000","last_became_active":"2023-12-22T10:01:50.016237+0000","last_became_peered":"2023-12-22T10:01:50.016237+0000","last_unstale":"2023-12-22T10:01:50.016591+0000","last_undegraded":"2023-12-22T10:01:50.016591+0000","last_fullsized":"2023-12-22T10:01:50.016591+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1c","version":"36'9","reported_seq":24,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.150431+0000","last_change":"2023-12-22T10:01:35.158342+0000","last_active":"2023-12-22T10:01:49.150431+0000","last_peered":"2023-12-22T10:01:49.150431+0000","last_clean":"2023-12-22T10:01:49.150431+0000","last_became_active":"2023-12-22T10:01:35.156056+0000","last_became_peered":"2023-12-22T10:01:35.156056+0000","last_unstale":"2023-12-22T10:01:49.150431+0000","last_undegraded":"2023-12-22T10:01:49.150431+0000","last_fullsized":"2023-12-22T10:01:49.150431+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"35'1","reported_seq":17,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.151627+0000","last_change":"2023-12-22T10:01:34.692535+0000","last_active":"2023-12-22T10:01:49.151627+0000","last_peered":"2023-12-22T10:01:49.151627+0000","last_clean":"2023-12-22T10:01:49.151627+0000","last_became_active":"2023-12-22T10:01:34.692223+0000","last_became_peered":"2023-12-22T10:01:34.692223+0000","last_unstale":"2023-12-22T10:01:49.151627+0000","last_undegraded":"2023-12-22T10:01:49.151627+0000","last_fullsized":"2023-12-22T10:01:49.151627+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.014041+0000","last_change":"2023-12-22T10:01:50.014041+0000","last_active":"2023-12-22T10:01:50.014041+0000","last_peered":"2023-12-22T10:01:50.014041+0000","last_clean":"2023-12-22T10:01:50.014041+0000","last_became_active":"2023-12-22T10:01:50.013539+0000","last_became_peered":"2023-12-22T10:01:50.013539+0000","last_unstale":"2023-12-22T10:01:50.014041+0000","last_undegraded":"2023-12-22T10:01:50.014041+0000","last_fullsized":"2023-12-22T10:01:50.014041+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"36'15","reported_seq":32,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.990687+0000","last_change":"2023-12-22T10:01:35.151202+0000","last_active":"2023-12-22T10:01:49.990687+0000","last_peered":"2023-12-22T10:01:49.990687+0000","last_clean":"2023-12-22T10:01:49.990687+0000","last_became_active":"2023-12-22T10:01:35.150961+0000","last_became_peered":"2023-12-22T10:01:35.150961+0000","last_unstale":"2023-12-22T10:01:49.990687+0000","last_undegraded":"2023-12-22T10:01:49.990687+0000","last_fullsized":"2023-12-22T10:01:49.990687+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"35'1","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.993689+0000","last_change":"2023-12-22T10:01:34.689373+0000","last_active":"2023-12-22T10:01:49.993689+0000","last_peered":"2023-12-22T10:01:49.993689+0000","last_clean":"2023-12-22T10:01:49.993689+0000","last_became_active":"2023-12-22T10:01:34.689010+0000","last_became_peered":"2023-12-22T10:01:34.689010+0000","last_unstale":"2023-12-22T10:01:49.993689+0000","last_undegraded":"2023-12-22T10:01:49.993689+0000","last_fullsized":"2023-12-22T10:01:49.993689+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.004786+0000","last_change":"2023-12-22T10:01:50.004786+0000","last_active":"2023-12-22T10:01:50.004786+0000","last_peered":"2023-12-22T10:01:50.004786+0000","last_clean":"2023-12-22T10:01:50.004786+0000","last_became_active":"2023-12-22T10:01:50.004548+0000","last_became_peered":"2023-12-22T10:01:50.004548+0000","last_unstale":"2023-12-22T10:01:50.004786+0000","last_undegraded":"2023-12-22T10:01:50.004786+0000","last_fullsized":"2023-12-22T10:01:50.004786+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"36'5","reported_seq":20,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.150262+0000","last_change":"2023-12-22T10:01:35.157214+0000","last_active":"2023-12-22T10:01:49.150262+0000","last_peered":"2023-12-22T10:01:49.150262+0000","last_clean":"2023-12-22T10:01:49.150262+0000","last_became_active":"2023-12-22T10:01:35.156041+0000","last_became_peered":"2023-12-22T10:01:35.156041+0000","last_unstale":"2023-12-22T10:01:49.150262+0000","last_undegraded":"2023-12-22T10:01:49.150262+0000","last_fullsized":"2023-12-22T10:01:49.150262+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"41'3","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.992599+0000","last_change":"2023-12-22T10:01:34.693006+0000","last_active":"2023-12-22T10:01:49.992599+0000","last_peered":"2023-12-22T10:01:49.992599+0000","last_clean":"2023-12-22T10:01:49.992599+0000","last_became_active":"2023-12-22T10:01:34.692460+0000","last_became_peered":"2023-12-22T10:01:34.692460+0000","last_unstale":"2023-12-22T10:01:49.992599+0000","last_undegraded":"2023-12-22T10:01:49.992599+0000","last_fullsized":"2023-12-22T10:01:49.992599+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.013042+0000","last_change":"2023-12-22T10:01:50.010840+0000","last_active":"2023-12-22T10:01:50.013042+0000","last_peered":"2023-12-22T10:01:50.013042+0000","last_clean":"2023-12-22T10:01:50.013042+0000","last_became_active":"2023-12-22T10:01:50.010285+0000","last_became_peered":"2023-12-22T10:01:50.010285+0000","last_unstale":"2023-12-22T10:01:50.013042+0000","last_undegraded":"2023-12-22T10:01:50.013042+0000","last_fullsized":"2023-12-22T10:01:50.013042+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1f","version":"36'6","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.993987+0000","last_change":"2023-12-22T10:01:35.145742+0000","last_active":"2023-12-22T10:01:49.993987+0000","last_peered":"2023-12-22T10:01:49.993987+0000","last_clean":"2023-12-22T10:01:49.993987+0000","last_became_active":"2023-12-22T10:01:35.145385+0000","last_became_peered":"2023-12-22T10:01:35.145385+0000","last_unstale":"2023-12-22T10:01:49.993987+0000","last_undegraded":"2023-12-22T10:01:49.993987+0000","last_fullsized":"2023-12-22T10:01:49.993987+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":16,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.152829+0000","last_change":"2023-12-22T10:01:34.698319+0000","last_active":"2023-12-22T10:01:49.152829+0000","last_peered":"2023-12-22T10:01:49.152829+0000","last_clean":"2023-12-22T10:01:49.152829+0000","last_became_active":"2023-12-22T10:01:34.698118+0000","last_became_peered":"2023-12-22T10:01:34.698118+0000","last_unstale":"2023-12-22T10:01:49.152829+0000","last_undegraded":"2023-12-22T10:01:49.152829+0000","last_fullsized":"2023-12-22T10:01:49.152829+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.008343+0000","last_change":"2023-12-22T10:01:50.008343+0000","last_active":"2023-12-22T10:01:50.008343+0000","last_peered":"2023-12-22T10:01:50.008343+0000","last_clean":"2023-12-22T10:01:50.008343+0000","last_became_active":"2023-12-22T10:01:50.007973+0000","last_became_peered":"2023-12-22T10:01:50.007973+0000","last_unstale":"2023-12-22T10:01:50.008343+0000","last_undegraded":"2023-12-22T10:01:50.008343+0000","last_fullsized":"2023-12-22T10:01:50.008343+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.18","version":"36'8","reported_seq":25,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.995148+0000","last_change":"2023-12-22T10:01:35.144227+0000","last_active":"2023-12-22T10:01:49.995148+0000","last_peered":"2023-12-22T10:01:49.995148+0000","last_clean":"2023-12-22T10:01:49.995148+0000","last_became_active":"2023-12-22T10:01:35.141822+0000","last_became_peered":"2023-12-22T10:01:35.141822+0000","last_unstale":"2023-12-22T10:01:49.995148+0000","last_undegraded":"2023-12-22T10:01:49.995148+0000","last_fullsized":"2023-12-22T10:01:49.995148+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":16,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.153014+0000","last_change":"2023-12-22T10:01:34.687654+0000","last_active":"2023-12-22T10:01:49.153014+0000","last_peered":"2023-12-22T10:01:49.153014+0000","last_clean":"2023-12-22T10:01:49.153014+0000","last_became_active":"2023-12-22T10:01:34.687337+0000","last_became_peered":"2023-12-22T10:01:34.687337+0000","last_unstale":"2023-12-22T10:01:49.153014+0000","last_undegraded":"2023-12-22T10:01:49.153014+0000","last_fullsized":"2023-12-22T10:01:49.153014+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.018656+0000","last_change":"2023-12-22T10:01:50.015643+0000","last_active":"2023-12-22T10:01:50.018656+0000","last_peered":"2023-12-22T10:01:50.018656+0000","last_clean":"2023-12-22T10:01:50.018656+0000","last_became_active":"2023-12-22T10:01:50.015323+0000","last_became_peered":"2023-12-22T10:01:50.015323+0000","last_unstale":"2023-12-22T10:01:50.018656+0000","last_undegraded":"2023-12-22T10:01:50.018656+0000","last_fullsized":"2023-12-22T10:01:50.018656+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"36'10","reported_seq":24,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.149700+0000","last_change":"2023-12-22T10:01:35.148573+0000","last_active":"2023-12-22T10:01:49.149700+0000","last_peered":"2023-12-22T10:01:49.149700+0000","last_clean":"2023-12-22T10:01:49.149700+0000","last_became_active":"2023-12-22T10:01:35.148279+0000","last_became_peered":"2023-12-22T10:01:35.148279+0000","last_unstale":"2023-12-22T10:01:49.149700+0000","last_undegraded":"2023-12-22T10:01:49.149700+0000","last_fullsized":"2023-12-22T10:01:49.149700+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.135728+0000","last_change":"2023-12-22T10:01:34.702330+0000","last_active":"2023-12-22T10:01:49.135728+0000","last_peered":"2023-12-22T10:01:49.135728+0000","last_clean":"2023-12-22T10:01:49.135728+0000","last_became_active":"2023-12-22T10:01:34.701937+0000","last_became_peered":"2023-12-22T10:01:34.701937+0000","last_unstale":"2023-12-22T10:01:49.135728+0000","last_undegraded":"2023-12-22T10:01:49.135728+0000","last_fullsized":"2023-12-22T10:01:49.135728+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.022969+0000","last_change":"2023-12-22T10:01:50.019611+0000","last_active":"2023-12-22T10:01:50.022969+0000","last_peered":"2023-12-22T10:01:50.022969+0000","last_clean":"2023-12-22T10:01:50.022969+0000","last_became_active":"2023-12-22T10:01:50.019383+0000","last_became_peered":"2023-12-22T10:01:50.019383+0000","last_unstale":"2023-12-22T10:01:50.022969+0000","last_undegraded":"2023-12-22T10:01:50.022969+0000","last_fullsized":"2023-12-22T10:01:50.022969+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"36'7","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.149051+0000","last_change":"2023-12-22T10:01:35.161623+0000","last_active":"2023-12-22T10:01:49.149051+0000","last_peered":"2023-12-22T10:01:49.149051+0000","last_clean":"2023-12-22T10:01:49.149051+0000","last_became_active":"2023-12-22T10:01:35.161366+0000","last_became_peered":"2023-12-22T10:01:35.161366+0000","last_unstale":"2023-12-22T10:01:49.149051+0000","last_undegraded":"2023-12-22T10:01:49.149051+0000","last_fullsized":"2023-12-22T10:01:49.149051+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":18,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.991145+0000","last_change":"2023-12-22T10:01:34.694683+0000","last_active":"2023-12-22T10:01:49.991145+0000","last_peered":"2023-12-22T10:01:49.991145+0000","last_clean":"2023-12-22T10:01:49.991145+0000","last_became_active":"2023-12-22T10:01:34.693873+0000","last_became_peered":"2023-12-22T10:01:34.693873+0000","last_unstale":"2023-12-22T10:01:49.991145+0000","last_undegraded":"2023-12-22T10:01:49.991145+0000","last_fullsized":"2023-12-22T10:01:49.991145+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.004492+0000","last_change":"2023-12-22T10:01:50.004492+0000","last_active":"2023-12-22T10:01:50.004492+0000","last_peered":"2023-12-22T10:01:50.004492+0000","last_clean":"2023-12-22T10:01:50.004492+0000","last_became_active":"2023-12-22T10:01:50.004195+0000","last_became_peered":"2023-12-22T10:01:50.004195+0000","last_unstale":"2023-12-22T10:01:50.004492+0000","last_undegraded":"2023-12-22T10:01:50.004492+0000","last_fullsized":"2023-12-22T10:01:50.004492+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1b","version":"36'8","reported_seq":25,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.991423+0000","last_change":"2023-12-22T10:01:35.141439+0000","last_active":"2023-12-22T10:01:49.991423+0000","last_peered":"2023-12-22T10:01:49.991423+0000","last_clean":"2023-12-22T10:01:49.991423+0000","last_became_active":"2023-12-22T10:01:35.141140+0000","last_became_peered":"2023-12-22T10:01:35.141140+0000","last_unstale":"2023-12-22T10:01:49.991423+0000","last_undegraded":"2023-12-22T10:01:49.991423+0000","last_fullsized":"2023-12-22T10:01:49.991423+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.135032+0000","last_change":"2023-12-22T10:01:34.701959+0000","last_active":"2023-12-22T10:01:49.135032+0000","last_peered":"2023-12-22T10:01:49.135032+0000","last_clean":"2023-12-22T10:01:49.135032+0000","last_became_active":"2023-12-22T10:01:34.693141+0000","last_became_peered":"2023-12-22T10:01:34.693141+0000","last_unstale":"2023-12-22T10:01:49.135032+0000","last_undegraded":"2023-12-22T10:01:49.135032+0000","last_fullsized":"2023-12-22T10:01:49.135032+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.022436+0000","last_change":"2023-12-22T10:01:50.022436+0000","last_active":"2023-12-22T10:01:50.022436+0000","last_peered":"2023-12-22T10:01:50.022436+0000","last_clean":"2023-12-22T10:01:50.022436+0000","last_became_active":"2023-12-22T10:01:50.021995+0000","last_became_peered":"2023-12-22T10:01:50.021995+0000","last_unstale":"2023-12-22T10:01:50.022436+0000","last_undegraded":"2023-12-22T10:01:50.022436+0000","last_fullsized":"2023-12-22T10:01:50.022436+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"36'11","reported_seq":28,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.994241+0000","last_change":"2023-12-22T10:01:35.153160+0000","last_active":"2023-12-22T10:01:49.994241+0000","last_peered":"2023-12-22T10:01:49.994241+0000","last_clean":"2023-12-22T10:01:49.994241+0000","last_became_active":"2023-12-22T10:01:35.152160+0000","last_became_peered":"2023-12-22T10:01:35.152160+0000","last_unstale":"2023-12-22T10:01:49.994241+0000","last_undegraded":"2023-12-22T10:01:49.994241+0000","last_fullsized":"2023-12-22T10:01:49.994241+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":18,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.992913+0000","last_change":"2023-12-22T10:01:34.685148+0000","last_active":"2023-12-22T10:01:49.992913+0000","last_peered":"2023-12-22T10:01:49.992913+0000","last_clean":"2023-12-22T10:01:49.992913+0000","last_became_active":"2023-12-22T10:01:34.684840+0000","last_became_peered":"2023-12-22T10:01:34.684840+0000","last_unstale":"2023-12-22T10:01:49.992913+0000","last_undegraded":"2023-12-22T10:01:49.992913+0000","last_fullsized":"2023-12-22T10:01:49.992913+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.019852+0000","last_change":"2023-12-22T10:01:50.019852+0000","last_active":"2023-12-22T10:01:50.019852+0000","last_peered":"2023-12-22T10:01:50.019852+0000","last_clean":"2023-12-22T10:01:50.019852+0000","last_became_active":"2023-12-22T10:01:50.019485+0000","last_became_peered":"2023-12-22T10:01:50.019485+0000","last_unstale":"2023-12-22T10:01:50.019852+0000","last_undegraded":"2023-12-22T10:01:50.019852+0000","last_fullsized":"2023-12-22T10:01:50.019852+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"36'6","reported_seq":21,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.153270+0000","last_change":"2023-12-22T10:01:35.152114+0000","last_active":"2023-12-22T10:01:49.153270+0000","last_peered":"2023-12-22T10:01:49.153270+0000","last_clean":"2023-12-22T10:01:49.153270+0000","last_became_active":"2023-12-22T10:01:35.151816+0000","last_became_peered":"2023-12-22T10:01:35.151816+0000","last_unstale":"2023-12-22T10:01:49.153270+0000","last_undegraded":"2023-12-22T10:01:49.153270+0000","last_fullsized":"2023-12-22T10:01:49.153270+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":16,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.150153+0000","last_change":"2023-12-22T10:01:34.693683+0000","last_active":"2023-12-22T10:01:49.150153+0000","last_peered":"2023-12-22T10:01:49.150153+0000","last_clean":"2023-12-22T10:01:49.150153+0000","last_became_active":"2023-12-22T10:01:34.693296+0000","last_became_peered":"2023-12-22T10:01:34.693296+0000","last_unstale":"2023-12-22T10:01:49.150153+0000","last_undegraded":"2023-12-22T10:01:49.150153+0000","last_fullsized":"2023-12-22T10:01:49.150153+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.998354+0000","last_change":"2023-12-22T10:01:49.998354+0000","last_active":"2023-12-22T10:01:49.998354+0000","last_peered":"2023-12-22T10:01:49.998354+0000","last_clean":"2023-12-22T10:01:49.998354+0000","last_became_active":"2023-12-22T10:01:49.997935+0000","last_became_peered":"2023-12-22T10:01:49.997935+0000","last_unstale":"2023-12-22T10:01:49.998354+0000","last_undegraded":"2023-12-22T10:01:49.998354+0000","last_fullsized":"2023-12-22T10:01:49.998354+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.16","version":"36'10","reported_seq":27,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.994016+0000","last_change":"2023-12-22T10:01:35.138193+0000","last_active":"2023-12-22T10:01:49.994016+0000","last_peered":"2023-12-22T10:01:49.994016+0000","last_clean":"2023-12-22T10:01:49.994016+0000","last_became_active":"2023-12-22T10:01:35.137926+0000","last_became_peered":"2023-12-22T10:01:35.137926+0000","last_unstale":"2023-12-22T10:01:49.994016+0000","last_undegraded":"2023-12-22T10:01:49.994016+0000","last_fullsized":"2023-12-22T10:01:49.994016+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"41'5","reported_seq":21,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.150109+0000","last_change":"2023-12-22T10:01:34.696240+0000","last_active":"2023-12-22T10:01:49.150109+0000","last_peered":"2023-12-22T10:01:49.150109+0000","last_clean":"2023-12-22T10:01:49.150109+0000","last_became_active":"2023-12-22T10:01:34.695913+0000","last_became_peered":"2023-12-22T10:01:34.695913+0000","last_unstale":"2023-12-22T10:01:49.150109+0000","last_undegraded":"2023-12-22T10:01:49.150109+0000","last_fullsized":"2023-12-22T10:01:49.150109+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.006651+0000","last_change":"2023-12-22T10:01:50.006651+0000","last_active":"2023-12-22T10:01:50.006651+0000","last_peered":"2023-12-22T10:01:50.006651+0000","last_clean":"2023-12-22T10:01:50.006651+0000","last_became_active":"2023-12-22T10:01:50.006361+0000","last_became_peered":"2023-12-22T10:01:50.006361+0000","last_unstale":"2023-12-22T10:01:50.006651+0000","last_undegraded":"2023-12-22T10:01:50.006651+0000","last_fullsized":"2023-12-22T10:01:50.006651+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"36'9","reported_seq":23,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.136870+0000","last_change":"2023-12-22T10:01:35.136369+0000","last_active":"2023-12-22T10:01:49.136870+0000","last_peered":"2023-12-22T10:01:49.136870+0000","last_clean":"2023-12-22T10:01:49.136870+0000","last_became_active":"2023-12-22T10:01:35.136123+0000","last_became_peered":"2023-12-22T10:01:35.136123+0000","last_unstale":"2023-12-22T10:01:49.136870+0000","last_undegraded":"2023-12-22T10:01:49.136870+0000","last_fullsized":"2023-12-22T10:01:49.136870+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"41'7","reported_seq":25,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.994471+0000","last_change":"2023-12-22T10:01:34.690599+0000","last_active":"2023-12-22T10:01:49.994471+0000","last_peered":"2023-12-22T10:01:49.994471+0000","last_clean":"2023-12-22T10:01:49.994471+0000","last_became_active":"2023-12-22T10:01:34.690313+0000","last_became_peered":"2023-12-22T10:01:34.690313+0000","last_unstale":"2023-12-22T10:01:49.994471+0000","last_undegraded":"2023-12-22T10:01:49.994471+0000","last_fullsized":"2023-12-22T10:01:49.994471+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.996941+0000","last_change":"2023-12-22T10:01:49.996941+0000","last_active":"2023-12-22T10:01:49.996941+0000","last_peered":"2023-12-22T10:01:49.996941+0000","last_clean":"2023-12-22T10:01:49.996941+0000","last_became_active":"2023-12-22T10:01:49.996479+0000","last_became_peered":"2023-12-22T10:01:49.996479+0000","last_unstale":"2023-12-22T10:01:49.996941+0000","last_undegraded":"2023-12-22T10:01:49.996941+0000","last_fullsized":"2023-12-22T10:01:49.996941+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.10","version":"36'6","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.995221+0000","last_change":"2023-12-22T10:01:35.141012+0000","last_active":"2023-12-22T10:01:49.995221+0000","last_peered":"2023-12-22T10:01:49.995221+0000","last_clean":"2023-12-22T10:01:49.995221+0000","last_became_active":"2023-12-22T10:01:35.140498+0000","last_became_peered":"2023-12-22T10:01:35.140498+0000","last_unstale":"2023-12-22T10:01:49.995221+0000","last_undegraded":"2023-12-22T10:01:49.995221+0000","last_fullsized":"2023-12-22T10:01:49.995221+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"41'3","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.992683+0000","last_change":"2023-12-22T10:01:34.694064+0000","last_active":"2023-12-22T10:01:49.992683+0000","last_peered":"2023-12-22T10:01:49.992683+0000","last_clean":"2023-12-22T10:01:49.992683+0000","last_became_active":"2023-12-22T10:01:34.693775+0000","last_became_peered":"2023-12-22T10:01:34.693775+0000","last_unstale":"2023-12-22T10:01:49.992683+0000","last_undegraded":"2023-12-22T10:01:49.992683+0000","last_fullsized":"2023-12-22T10:01:49.992683+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.012883+0000","last_change":"2023-12-22T10:01:50.008873+0000","last_active":"2023-12-22T10:01:50.012883+0000","last_peered":"2023-12-22T10:01:50.012883+0000","last_clean":"2023-12-22T10:01:50.012883+0000","last_became_active":"2023-12-22T10:01:50.004656+0000","last_became_peered":"2023-12-22T10:01:50.004656+0000","last_unstale":"2023-12-22T10:01:50.012883+0000","last_undegraded":"2023-12-22T10:01:50.012883+0000","last_fullsized":"2023-12-22T10:01:50.012883+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.11","version":"36'6","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.989406+0000","last_change":"2023-12-22T10:01:35.136270+0000","last_active":"2023-12-22T10:01:49.989406+0000","last_peered":"2023-12-22T10:01:49.989406+0000","last_clean":"2023-12-22T10:01:49.989406+0000","last_became_active":"2023-12-22T10:01:35.135729+0000","last_became_peered":"2023-12-22T10:01:35.135729+0000","last_unstale":"2023-12-22T10:01:49.989406+0000","last_undegraded":"2023-12-22T10:01:49.989406+0000","last_fullsized":"2023-12-22T10:01:49.989406+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":18,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.990547+0000","last_change":"2023-12-22T10:01:34.705576+0000","last_active":"2023-12-22T10:01:49.990547+0000","last_peered":"2023-12-22T10:01:49.990547+0000","last_clean":"2023-12-22T10:01:49.990547+0000","last_became_active":"2023-12-22T10:01:34.705340+0000","last_became_peered":"2023-12-22T10:01:34.705340+0000","last_unstale":"2023-12-22T10:01:49.990547+0000","last_undegraded":"2023-12-22T10:01:49.990547+0000","last_fullsized":"2023-12-22T10:01:49.990547+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.012982+0000","last_change":"2023-12-22T10:01:50.009454+0000","last_active":"2023-12-22T10:01:50.012982+0000","last_peered":"2023-12-22T10:01:50.012982+0000","last_clean":"2023-12-22T10:01:50.012982+0000","last_became_active":"2023-12-22T10:01:50.009154+0000","last_became_peered":"2023-12-22T10:01:50.009154+0000","last_unstale":"2023-12-22T10:01:50.012982+0000","last_undegraded":"2023-12-22T10:01:50.012982+0000","last_fullsized":"2023-12-22T10:01:50.012982+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.12","version":"36'10","reported_seq":24,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.149885+0000","last_change":"2023-12-22T10:01:35.140150+0000","last_active":"2023-12-22T10:01:49.149885+0000","last_peered":"2023-12-22T10:01:49.149885+0000","last_clean":"2023-12-22T10:01:49.149885+0000","last_became_active":"2023-12-22T10:01:35.139884+0000","last_became_peered":"2023-12-22T10:01:35.139884+0000","last_unstale":"2023-12-22T10:01:49.149885+0000","last_undegraded":"2023-12-22T10:01:49.149885+0000","last_fullsized":"2023-12-22T10:01:49.149885+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":16,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.147196+0000","last_change":"2023-12-22T10:01:34.690703+0000","last_active":"2023-12-22T10:01:49.147196+0000","last_peered":"2023-12-22T10:01:49.147196+0000","last_clean":"2023-12-22T10:01:49.147196+0000","last_became_active":"2023-12-22T10:01:34.690369+0000","last_became_peered":"2023-12-22T10:01:34.690369+0000","last_unstale":"2023-12-22T10:01:49.147196+0000","last_undegraded":"2023-12-22T10:01:49.147196+0000","last_fullsized":"2023-12-22T10:01:49.147196+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.020970+0000","last_change":"2023-12-22T10:01:50.020970+0000","last_active":"2023-12-22T10:01:50.020970+0000","last_peered":"2023-12-22T10:01:50.020970+0000","last_clean":"2023-12-22T10:01:50.020970+0000","last_became_active":"2023-12-22T10:01:50.016890+0000","last_became_peered":"2023-12-22T10:01:50.016890+0000","last_unstale":"2023-12-22T10:01:50.020970+0000","last_undegraded":"2023-12-22T10:01:50.020970+0000","last_fullsized":"2023-12-22T10:01:50.020970+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.13","version":"36'15","reported_seq":32,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.992398+0000","last_change":"2023-12-22T10:01:35.128289+0000","last_active":"2023-12-22T10:01:49.992398+0000","last_peered":"2023-12-22T10:01:49.992398+0000","last_clean":"2023-12-22T10:01:49.992398+0000","last_became_active":"2023-12-22T10:01:35.127995+0000","last_became_peered":"2023-12-22T10:01:35.127995+0000","last_unstale":"2023-12-22T10:01:49.992398+0000","last_undegraded":"2023-12-22T10:01:49.992398+0000","last_fullsized":"2023-12-22T10:01:49.992398+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"41'6","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.148958+0000","last_change":"2023-12-22T10:01:34.705549+0000","last_active":"2023-12-22T10:01:49.148958+0000","last_peered":"2023-12-22T10:01:49.148958+0000","last_clean":"2023-12-22T10:01:49.148958+0000","last_became_active":"2023-12-22T10:01:34.704846+0000","last_became_peered":"2023-12-22T10:01:34.704846+0000","last_unstale":"2023-12-22T10:01:49.148958+0000","last_undegraded":"2023-12-22T10:01:49.148958+0000","last_fullsized":"2023-12-22T10:01:49.148958+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.005509+0000","last_change":"2023-12-22T10:01:50.005509+0000","last_active":"2023-12-22T10:01:50.005509+0000","last_peered":"2023-12-22T10:01:50.005509+0000","last_clean":"2023-12-22T10:01:50.005509+0000","last_became_active":"2023-12-22T10:01:50.005190+0000","last_became_peered":"2023-12-22T10:01:50.005190+0000","last_unstale":"2023-12-22T10:01:50.005509+0000","last_undegraded":"2023-12-22T10:01:50.005509+0000","last_fullsized":"2023-12-22T10:01:50.005509+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"36'6","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.990458+0000","last_change":"2023-12-22T10:01:35.139893+0000","last_active":"2023-12-22T10:01:49.990458+0000","last_peered":"2023-12-22T10:01:49.990458+0000","last_clean":"2023-12-22T10:01:49.990458+0000","last_became_active":"2023-12-22T10:01:35.138934+0000","last_became_peered":"2023-12-22T10:01:35.138934+0000","last_unstale":"2023-12-22T10:01:49.990458+0000","last_undegraded":"2023-12-22T10:01:49.990458+0000","last_fullsized":"2023-12-22T10:01:49.990458+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"41'2","reported_seq":17,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.137290+0000","last_change":"2023-12-22T10:01:34.687756+0000","last_active":"2023-12-22T10:01:49.137290+0000","last_peered":"2023-12-22T10:01:49.137290+0000","last_clean":"2023-12-22T10:01:49.137290+0000","last_became_active":"2023-12-22T10:01:34.687316+0000","last_became_peered":"2023-12-22T10:01:34.687316+0000","last_unstale":"2023-12-22T10:01:49.137290+0000","last_undegraded":"2023-12-22T10:01:49.137290+0000","last_fullsized":"2023-12-22T10:01:49.137290+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.023706+0000","last_change":"2023-12-22T10:01:50.023706+0000","last_active":"2023-12-22T10:01:50.023706+0000","last_peered":"2023-12-22T10:01:50.023706+0000","last_clean":"2023-12-22T10:01:50.023706+0000","last_became_active":"2023-12-22T10:01:50.023361+0000","last_became_peered":"2023-12-22T10:01:50.023361+0000","last_unstale":"2023-12-22T10:01:50.023706+0000","last_undegraded":"2023-12-22T10:01:50.023706+0000","last_fullsized":"2023-12-22T10:01:50.023706+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"36'7","reported_seq":21,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.136304+0000","last_change":"2023-12-22T10:01:35.142614+0000","last_active":"2023-12-22T10:01:49.136304+0000","last_peered":"2023-12-22T10:01:49.136304+0000","last_clean":"2023-12-22T10:01:49.136304+0000","last_became_active":"2023-12-22T10:01:35.139303+0000","last_became_peered":"2023-12-22T10:01:35.139303+0000","last_unstale":"2023-12-22T10:01:49.136304+0000","last_undegraded":"2023-12-22T10:01:49.136304+0000","last_fullsized":"2023-12-22T10:01:49.136304+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"41'3","reported_seq":19,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.150366+0000","last_change":"2023-12-22T10:01:34.696868+0000","last_active":"2023-12-22T10:01:49.150366+0000","last_peered":"2023-12-22T10:01:49.150366+0000","last_clean":"2023-12-22T10:01:49.150366+0000","last_became_active":"2023-12-22T10:01:34.696571+0000","last_became_peered":"2023-12-22T10:01:34.696571+0000","last_unstale":"2023-12-22T10:01:49.150366+0000","last_undegraded":"2023-12-22T10:01:49.150366+0000","last_fullsized":"2023-12-22T10:01:49.150366+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.009970+0000","last_change":"2023-12-22T10:01:50.005005+0000","last_active":"2023-12-22T10:01:50.009970+0000","last_peered":"2023-12-22T10:01:50.009970+0000","last_clean":"2023-12-22T10:01:50.009970+0000","last_became_active":"2023-12-22T10:01:50.004641+0000","last_became_peered":"2023-12-22T10:01:50.004641+0000","last_unstale":"2023-12-22T10:01:50.009970+0000","last_undegraded":"2023-12-22T10:01:50.009970+0000","last_fullsized":"2023-12-22T10:01:50.009970+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"36'5","reported_seq":19,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.136135+0000","last_change":"2023-12-22T10:01:35.141882+0000","last_active":"2023-12-22T10:01:49.136135+0000","last_peered":"2023-12-22T10:01:49.136135+0000","last_clean":"2023-12-22T10:01:49.136135+0000","last_became_active":"2023-12-22T10:01:35.141536+0000","last_became_peered":"2023-12-22T10:01:35.141536+0000","last_unstale":"2023-12-22T10:01:49.136135+0000","last_undegraded":"2023-12-22T10:01:49.136135+0000","last_fullsized":"2023-12-22T10:01:49.136135+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":18,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.993061+0000","last_change":"2023-12-22T10:01:34.699249+0000","last_active":"2023-12-22T10:01:49.993061+0000","last_peered":"2023-12-22T10:01:49.993061+0000","last_clean":"2023-12-22T10:01:49.993061+0000","last_became_active":"2023-12-22T10:01:34.698955+0000","last_became_peered":"2023-12-22T10:01:34.698955+0000","last_unstale":"2023-12-22T10:01:49.993061+0000","last_undegraded":"2023-12-22T10:01:49.993061+0000","last_fullsized":"2023-12-22T10:01:49.993061+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.007279+0000","last_change":"2023-12-22T10:01:50.006101+0000","last_active":"2023-12-22T10:01:50.007279+0000","last_peered":"2023-12-22T10:01:50.007279+0000","last_clean":"2023-12-22T10:01:50.007279+0000","last_became_active":"2023-12-22T10:01:50.005369+0000","last_became_peered":"2023-12-22T10:01:50.005369+0000","last_unstale":"2023-12-22T10:01:50.007279+0000","last_undegraded":"2023-12-22T10:01:50.007279+0000","last_fullsized":"2023-12-22T10:01:50.007279+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"36'9","reported_seq":23,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.142181+0000","last_change":"2023-12-22T10:01:35.143645+0000","last_active":"2023-12-22T10:01:49.142181+0000","last_peered":"2023-12-22T10:01:49.142181+0000","last_clean":"2023-12-22T10:01:49.142181+0000","last_became_active":"2023-12-22T10:01:35.143327+0000","last_became_peered":"2023-12-22T10:01:35.143327+0000","last_unstale":"2023-12-22T10:01:49.142181+0000","last_undegraded":"2023-12-22T10:01:49.142181+0000","last_fullsized":"2023-12-22T10:01:49.142181+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.142482+0000","last_change":"2023-12-22T10:01:34.697799+0000","last_active":"2023-12-22T10:01:49.142482+0000","last_peered":"2023-12-22T10:01:49.142482+0000","last_clean":"2023-12-22T10:01:49.142482+0000","last_became_active":"2023-12-22T10:01:34.697233+0000","last_became_peered":"2023-12-22T10:01:34.697233+0000","last_unstale":"2023-12-22T10:01:49.142482+0000","last_undegraded":"2023-12-22T10:01:49.142482+0000","last_fullsized":"2023-12-22T10:01:49.142482+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.010690+0000","last_change":"2023-12-22T10:01:50.010690+0000","last_active":"2023-12-22T10:01:50.010690+0000","last_peered":"2023-12-22T10:01:50.010690+0000","last_clean":"2023-12-22T10:01:50.010690+0000","last_became_active":"2023-12-22T10:01:50.010405+0000","last_became_peered":"2023-12-22T10:01:50.010405+0000","last_unstale":"2023-12-22T10:01:50.010690+0000","last_undegraded":"2023-12-22T10:01:50.010690+0000","last_fullsized":"2023-12-22T10:01:50.010690+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"36'9","reported_seq":24,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.146873+0000","last_change":"2023-12-22T10:01:35.156435+0000","last_active":"2023-12-22T10:01:49.146873+0000","last_peered":"2023-12-22T10:01:49.146873+0000","last_clean":"2023-12-22T10:01:49.146873+0000","last_became_active":"2023-12-22T10:01:35.156132+0000","last_became_peered":"2023-12-22T10:01:35.156132+0000","last_unstale":"2023-12-22T10:01:49.146873+0000","last_undegraded":"2023-12-22T10:01:49.146873+0000","last_fullsized":"2023-12-22T10:01:49.146873+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"41'3","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.142253+0000","last_change":"2023-12-22T10:01:34.681213+0000","last_active":"2023-12-22T10:01:49.142253+0000","last_peered":"2023-12-22T10:01:49.142253+0000","last_clean":"2023-12-22T10:01:49.142253+0000","last_became_active":"2023-12-22T10:01:34.680928+0000","last_became_peered":"2023-12-22T10:01:34.680928+0000","last_unstale":"2023-12-22T10:01:49.142253+0000","last_undegraded":"2023-12-22T10:01:49.142253+0000","last_fullsized":"2023-12-22T10:01:49.142253+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.019491+0000","last_change":"2023-12-22T10:01:50.019491+0000","last_active":"2023-12-22T10:01:50.019491+0000","last_peered":"2023-12-22T10:01:50.019491+0000","last_clean":"2023-12-22T10:01:50.019491+0000","last_became_active":"2023-12-22T10:01:50.018516+0000","last_became_peered":"2023-12-22T10:01:50.018516+0000","last_unstale":"2023-12-22T10:01:50.019491+0000","last_undegraded":"2023-12-22T10:01:50.019491+0000","last_fullsized":"2023-12-22T10:01:50.019491+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"36'2","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.991004+0000","last_change":"2023-12-22T10:01:35.140301+0000","last_active":"2023-12-22T10:01:49.991004+0000","last_peered":"2023-12-22T10:01:49.991004+0000","last_clean":"2023-12-22T10:01:49.991004+0000","last_became_active":"2023-12-22T10:01:35.140013+0000","last_became_peered":"2023-12-22T10:01:35.140013+0000","last_unstale":"2023-12-22T10:01:49.991004+0000","last_undegraded":"2023-12-22T10:01:49.991004+0000","last_fullsized":"2023-12-22T10:01:49.991004+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":18,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.990425+0000","last_change":"2023-12-22T10:01:34.700554+0000","last_active":"2023-12-22T10:01:49.990425+0000","last_peered":"2023-12-22T10:01:49.990425+0000","last_clean":"2023-12-22T10:01:49.990425+0000","last_became_active":"2023-12-22T10:01:34.700250+0000","last_became_peered":"2023-12-22T10:01:34.700250+0000","last_unstale":"2023-12-22T10:01:49.990425+0000","last_undegraded":"2023-12-22T10:01:49.990425+0000","last_fullsized":"2023-12-22T10:01:49.990425+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.003901+0000","last_change":"2023-12-22T10:01:50.002814+0000","last_active":"2023-12-22T10:01:50.003901+0000","last_peered":"2023-12-22T10:01:50.003901+0000","last_clean":"2023-12-22T10:01:50.003901+0000","last_became_active":"2023-12-22T10:01:50.002549+0000","last_became_peered":"2023-12-22T10:01:50.002549+0000","last_unstale":"2023-12-22T10:01:50.003901+0000","last_undegraded":"2023-12-22T10:01:50.003901+0000","last_fullsized":"2023-12-22T10:01:50.003901+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"36'5","reported_seq":19,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.149567+0000","last_change":"2023-12-22T10:01:35.149330+0000","last_active":"2023-12-22T10:01:49.149567+0000","last_peered":"2023-12-22T10:01:49.149567+0000","last_clean":"2023-12-22T10:01:49.149567+0000","last_became_active":"2023-12-22T10:01:35.148997+0000","last_became_peered":"2023-12-22T10:01:35.148997+0000","last_unstale":"2023-12-22T10:01:49.149567+0000","last_undegraded":"2023-12-22T10:01:49.149567+0000","last_fullsized":"2023-12-22T10:01:49.149567+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.135644+0000","last_change":"2023-12-22T10:01:34.706221+0000","last_active":"2023-12-22T10:01:49.135644+0000","last_peered":"2023-12-22T10:01:49.135644+0000","last_clean":"2023-12-22T10:01:49.135644+0000","last_became_active":"2023-12-22T10:01:34.705796+0000","last_became_peered":"2023-12-22T10:01:34.705796+0000","last_unstale":"2023-12-22T10:01:49.135644+0000","last_undegraded":"2023-12-22T10:01:49.135644+0000","last_fullsized":"2023-12-22T10:01:49.135644+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.010632+0000","last_change":"2023-12-22T10:01:50.003069+0000","last_active":"2023-12-22T10:01:50.010632+0000","last_peered":"2023-12-22T10:01:50.010632+0000","last_clean":"2023-12-22T10:01:50.010632+0000","last_became_active":"2023-12-22T10:01:50.002805+0000","last_became_peered":"2023-12-22T10:01:50.002805+0000","last_unstale":"2023-12-22T10:01:50.010632+0000","last_undegraded":"2023-12-22T10:01:50.010632+0000","last_fullsized":"2023-12-22T10:01:50.010632+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.b","version":"36'8","reported_seq":25,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.992582+0000","last_change":"2023-12-22T10:01:35.140317+0000","last_active":"2023-12-22T10:01:49.992582+0000","last_peered":"2023-12-22T10:01:49.992582+0000","last_clean":"2023-12-22T10:01:49.992582+0000","last_became_active":"2023-12-22T10:01:35.140015+0000","last_became_peered":"2023-12-22T10:01:35.140015+0000","last_unstale":"2023-12-22T10:01:49.992582+0000","last_undegraded":"2023-12-22T10:01:49.992582+0000","last_fullsized":"2023-12-22T10:01:49.992582+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":18,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.989876+0000","last_change":"2023-12-22T10:01:34.695101+0000","last_active":"2023-12-22T10:01:49.989876+0000","last_peered":"2023-12-22T10:01:49.989876+0000","last_clean":"2023-12-22T10:01:49.989876+0000","last_became_active":"2023-12-22T10:01:34.694803+0000","last_became_peered":"2023-12-22T10:01:34.694803+0000","last_unstale":"2023-12-22T10:01:49.989876+0000","last_undegraded":"2023-12-22T10:01:49.989876+0000","last_fullsized":"2023-12-22T10:01:49.989876+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.010613+0000","last_change":"2023-12-22T10:01:50.002777+0000","last_active":"2023-12-22T10:01:50.010613+0000","last_peered":"2023-12-22T10:01:50.010613+0000","last_clean":"2023-12-22T10:01:50.010613+0000","last_became_active":"2023-12-22T10:01:50.002463+0000","last_became_peered":"2023-12-22T10:01:50.002463+0000","last_unstale":"2023-12-22T10:01:50.010613+0000","last_undegraded":"2023-12-22T10:01:50.010613+0000","last_fullsized":"2023-12-22T10:01:50.010613+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"36'7","reported_seq":21,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.150839+0000","last_change":"2023-12-22T10:01:35.148013+0000","last_active":"2023-12-22T10:01:49.150839+0000","last_peered":"2023-12-22T10:01:49.150839+0000","last_clean":"2023-12-22T10:01:49.150839+0000","last_became_active":"2023-12-22T10:01:35.147694+0000","last_became_peered":"2023-12-22T10:01:35.147694+0000","last_unstale":"2023-12-22T10:01:49.150839+0000","last_undegraded":"2023-12-22T10:01:49.150839+0000","last_fullsized":"2023-12-22T10:01:49.150839+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":18,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.995497+0000","last_change":"2023-12-22T10:01:34.698883+0000","last_active":"2023-12-22T10:01:49.995497+0000","last_peered":"2023-12-22T10:01:49.995497+0000","last_clean":"2023-12-22T10:01:49.995497+0000","last_became_active":"2023-12-22T10:01:34.698295+0000","last_became_peered":"2023-12-22T10:01:34.698295+0000","last_unstale":"2023-12-22T10:01:49.995497+0000","last_undegraded":"2023-12-22T10:01:49.995497+0000","last_fullsized":"2023-12-22T10:01:49.995497+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":31,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.150000+0000","last_change":"2023-12-22T10:00:28.036372+0000","last_active":"2023-12-22T10:01:49.150000+0000","last_peered":"2023-12-22T10:01:49.150000+0000","last_clean":"2023-12-22T10:01:49.150000+0000","last_became_active":"2023-12-22T10:00:28.035974+0000","last_became_peered":"2023-12-22T10:00:28.035974+0000","last_unstale":"2023-12-22T10:01:49.150000+0000","last_undegraded":"2023-12-22T10:01:49.150000+0000","last_fullsized":"2023-12-22T10:01:49.150000+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_clean_scrub_stamp":"2023-12-22T10:00:27.001906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.016852+0000","last_change":"2023-12-22T10:01:50.016852+0000","last_active":"2023-12-22T10:01:50.016852+0000","last_peered":"2023-12-22T10:01:50.016852+0000","last_clean":"2023-12-22T10:01:50.016852+0000","last_became_active":"2023-12-22T10:01:50.015151+0000","last_became_peered":"2023-12-22T10:01:50.015151+0000","last_unstale":"2023-12-22T10:01:50.016852+0000","last_undegraded":"2023-12-22T10:01:50.016852+0000","last_fullsized":"2023-12-22T10:01:50.016852+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2","version":"36'8","reported_seq":23,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.149167+0000","last_change":"2023-12-22T10:01:35.153601+0000","last_active":"2023-12-22T10:01:49.149167+0000","last_peered":"2023-12-22T10:01:49.149167+0000","last_clean":"2023-12-22T10:01:49.149167+0000","last_became_active":"2023-12-22T10:01:35.152791+0000","last_became_peered":"2023-12-22T10:01:35.152791+0000","last_unstale":"2023-12-22T10:01:49.149167+0000","last_undegraded":"2023-12-22T10:01:49.149167+0000","last_fullsized":"2023-12-22T10:01:49.149167+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":16,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.147307+0000","last_change":"2023-12-22T10:01:34.680407+0000","last_active":"2023-12-22T10:01:49.147307+0000","last_peered":"2023-12-22T10:01:49.147307+0000","last_clean":"2023-12-22T10:01:49.147307+0000","last_became_active":"2023-12-22T10:01:34.679458+0000","last_became_peered":"2023-12-22T10:01:34.679458+0000","last_unstale":"2023-12-22T10:01:49.147307+0000","last_undegraded":"2023-12-22T10:01:49.147307+0000","last_fullsized":"2023-12-22T10:01:49.147307+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":35,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.994109+0000","last_change":"2023-12-22T10:00:28.035308+0000","last_active":"2023-12-22T10:01:49.994109+0000","last_peered":"2023-12-22T10:01:49.994109+0000","last_clean":"2023-12-22T10:01:49.994109+0000","last_became_active":"2023-12-22T10:00:28.035002+0000","last_became_peered":"2023-12-22T10:00:28.035002+0000","last_unstale":"2023-12-22T10:01:49.994109+0000","last_undegraded":"2023-12-22T10:01:49.994109+0000","last_fullsized":"2023-12-22T10:01:49.994109+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_clean_scrub_stamp":"2023-12-22T10:00:27.001906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.021130+0000","last_change":"2023-12-22T10:01:50.021130+0000","last_active":"2023-12-22T10:01:50.021130+0000","last_peered":"2023-12-22T10:01:50.021130+0000","last_clean":"2023-12-22T10:01:50.021130+0000","last_became_active":"2023-12-22T10:01:50.020930+0000","last_became_peered":"2023-12-22T10:01:50.020930+0000","last_unstale":"2023-12-22T10:01:50.021130+0000","last_undegraded":"2023-12-22T10:01:50.021130+0000","last_fullsized":"2023-12-22T10:01:50.021130+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"36'5","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.989575+0000","last_change":"2023-12-22T10:01:35.156062+0000","last_active":"2023-12-22T10:01:49.989575+0000","last_peered":"2023-12-22T10:01:49.989575+0000","last_clean":"2023-12-22T10:01:49.989575+0000","last_became_active":"2023-12-22T10:01:35.155705+0000","last_became_peered":"2023-12-22T10:01:35.155705+0000","last_unstale":"2023-12-22T10:01:49.989575+0000","last_undegraded":"2023-12-22T10:01:49.989575+0000","last_fullsized":"2023-12-22T10:01:49.989575+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.149968+0000","last_change":"2023-12-22T10:01:34.684207+0000","last_active":"2023-12-22T10:01:49.149968+0000","last_peered":"2023-12-22T10:01:49.149968+0000","last_clean":"2023-12-22T10:01:49.149968+0000","last_became_active":"2023-12-22T10:01:34.683911+0000","last_became_peered":"2023-12-22T10:01:34.683911+0000","last_unstale":"2023-12-22T10:01:49.149968+0000","last_undegraded":"2023-12-22T10:01:49.149968+0000","last_fullsized":"2023-12-22T10:01:49.149968+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":31,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.150293+0000","last_change":"2023-12-22T10:00:28.029892+0000","last_active":"2023-12-22T10:01:49.150293+0000","last_peered":"2023-12-22T10:01:49.150293+0000","last_clean":"2023-12-22T10:01:49.150293+0000","last_became_active":"2023-12-22T10:00:28.029391+0000","last_became_peered":"2023-12-22T10:00:28.029391+0000","last_unstale":"2023-12-22T10:01:49.150293+0000","last_undegraded":"2023-12-22T10:01:49.150293+0000","last_fullsized":"2023-12-22T10:01:49.150293+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_clean_scrub_stamp":"2023-12-22T10:00:27.001906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.996762+0000","last_change":"2023-12-22T10:01:49.996762+0000","last_active":"2023-12-22T10:01:49.996762+0000","last_peered":"2023-12-22T10:01:49.996762+0000","last_clean":"2023-12-22T10:01:49.996762+0000","last_became_active":"2023-12-22T10:01:49.996197+0000","last_became_peered":"2023-12-22T10:01:49.996197+0000","last_unstale":"2023-12-22T10:01:49.996762+0000","last_undegraded":"2023-12-22T10:01:49.996762+0000","last_fullsized":"2023-12-22T10:01:49.996762+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"36'8","reported_seq":25,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.992629+0000","last_change":"2023-12-22T10:01:35.130148+0000","last_active":"2023-12-22T10:01:49.992629+0000","last_peered":"2023-12-22T10:01:49.992629+0000","last_clean":"2023-12-22T10:01:49.992629+0000","last_became_active":"2023-12-22T10:01:35.129858+0000","last_became_peered":"2023-12-22T10:01:35.129858+0000","last_unstale":"2023-12-22T10:01:49.992629+0000","last_undegraded":"2023-12-22T10:01:49.992629+0000","last_fullsized":"2023-12-22T10:01:49.992629+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":18,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.992872+0000","last_change":"2023-12-22T10:01:34.693923+0000","last_active":"2023-12-22T10:01:49.992872+0000","last_peered":"2023-12-22T10:01:49.992872+0000","last_clean":"2023-12-22T10:01:49.992872+0000","last_became_active":"2023-12-22T10:01:34.693616+0000","last_became_peered":"2023-12-22T10:01:34.693616+0000","last_unstale":"2023-12-22T10:01:49.992872+0000","last_undegraded":"2023-12-22T10:01:49.992872+0000","last_fullsized":"2023-12-22T10:01:49.992872+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":30,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.142605+0000","last_change":"2023-12-22T10:00:28.025395+0000","last_active":"2023-12-22T10:01:49.142605+0000","last_peered":"2023-12-22T10:01:49.142605+0000","last_clean":"2023-12-22T10:01:49.142605+0000","last_became_active":"2023-12-22T10:00:28.024588+0000","last_became_peered":"2023-12-22T10:00:28.024588+0000","last_unstale":"2023-12-22T10:01:49.142605+0000","last_undegraded":"2023-12-22T10:01:49.142605+0000","last_fullsized":"2023-12-22T10:01:49.142605+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_clean_scrub_stamp":"2023-12-22T10:00:27.001906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.018915+0000","last_change":"2023-12-22T10:01:50.018915+0000","last_active":"2023-12-22T10:01:50.018915+0000","last_peered":"2023-12-22T10:01:50.018915+0000","last_clean":"2023-12-22T10:01:50.018915+0000","last_became_active":"2023-12-22T10:01:50.013225+0000","last_became_peered":"2023-12-22T10:01:50.013225+0000","last_unstale":"2023-12-22T10:01:50.018915+0000","last_undegraded":"2023-12-22T10:01:50.018915+0000","last_fullsized":"2023-12-22T10:01:50.018915+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"36'7","reported_seq":21,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.142126+0000","last_change":"2023-12-22T10:01:35.161679+0000","last_active":"2023-12-22T10:01:49.142126+0000","last_peered":"2023-12-22T10:01:49.142126+0000","last_clean":"2023-12-22T10:01:49.142126+0000","last_became_active":"2023-12-22T10:01:35.161420+0000","last_became_peered":"2023-12-22T10:01:35.161420+0000","last_unstale":"2023-12-22T10:01:49.142126+0000","last_undegraded":"2023-12-22T10:01:49.142126+0000","last_fullsized":"2023-12-22T10:01:49.142126+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":18,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.993153+0000","last_change":"2023-12-22T10:01:34.695408+0000","last_active":"2023-12-22T10:01:49.993153+0000","last_peered":"2023-12-22T10:01:49.993153+0000","last_clean":"2023-12-22T10:01:49.993153+0000","last_became_active":"2023-12-22T10:01:34.694999+0000","last_became_peered":"2023-12-22T10:01:34.694999+0000","last_unstale":"2023-12-22T10:01:49.993153+0000","last_undegraded":"2023-12-22T10:01:49.993153+0000","last_fullsized":"2023-12-22T10:01:49.993153+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":31,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.149411+0000","last_change":"2023-12-22T10:00:28.029884+0000","last_active":"2023-12-22T10:01:49.149411+0000","last_peered":"2023-12-22T10:01:49.149411+0000","last_clean":"2023-12-22T10:01:49.149411+0000","last_became_active":"2023-12-22T10:00:28.029422+0000","last_became_peered":"2023-12-22T10:00:28.029422+0000","last_unstale":"2023-12-22T10:01:49.149411+0000","last_undegraded":"2023-12-22T10:01:49.149411+0000","last_fullsized":"2023-12-22T10:01:49.149411+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_clean_scrub_stamp":"2023-12-22T10:00:27.001906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.019009+0000","last_change":"2023-12-22T10:01:50.015894+0000","last_active":"2023-12-22T10:01:50.019009+0000","last_peered":"2023-12-22T10:01:50.019009+0000","last_clean":"2023-12-22T10:01:50.019009+0000","last_became_active":"2023-12-22T10:01:50.015573+0000","last_became_peered":"2023-12-22T10:01:50.015573+0000","last_unstale":"2023-12-22T10:01:50.019009+0000","last_undegraded":"2023-12-22T10:01:50.019009+0000","last_fullsized":"2023-12-22T10:01:50.019009+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.5","version":"36'5","reported_seq":19,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.150519+0000","last_change":"2023-12-22T10:01:35.148673+0000","last_active":"2023-12-22T10:01:49.150519+0000","last_peered":"2023-12-22T10:01:49.150519+0000","last_clean":"2023-12-22T10:01:49.150519+0000","last_became_active":"2023-12-22T10:01:35.148293+0000","last_became_peered":"2023-12-22T10:01:35.148293+0000","last_unstale":"2023-12-22T10:01:49.150519+0000","last_undegraded":"2023-12-22T10:01:49.150519+0000","last_fullsized":"2023-12-22T10:01:49.150519+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":18,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.996045+0000","last_change":"2023-12-22T10:01:34.698687+0000","last_active":"2023-12-22T10:01:49.996045+0000","last_peered":"2023-12-22T10:01:49.996045+0000","last_clean":"2023-12-22T10:01:49.996045+0000","last_became_active":"2023-12-22T10:01:34.698369+0000","last_became_peered":"2023-12-22T10:01:34.698369+0000","last_unstale":"2023-12-22T10:01:49.996045+0000","last_undegraded":"2023-12-22T10:01:49.996045+0000","last_fullsized":"2023-12-22T10:01:49.996045+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":33,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.992605+0000","last_change":"2023-12-22T10:00:28.028621+0000","last_active":"2023-12-22T10:01:49.992605+0000","last_peered":"2023-12-22T10:01:49.992605+0000","last_clean":"2023-12-22T10:01:49.992605+0000","last_became_active":"2023-12-22T10:00:28.028159+0000","last_became_peered":"2023-12-22T10:00:28.028159+0000","last_unstale":"2023-12-22T10:01:49.992605+0000","last_undegraded":"2023-12-22T10:01:49.992605+0000","last_fullsized":"2023-12-22T10:01:49.992605+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_clean_scrub_stamp":"2023-12-22T10:00:27.001906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.022259+0000","last_change":"2023-12-22T10:01:50.022259+0000","last_active":"2023-12-22T10:01:50.022259+0000","last_peered":"2023-12-22T10:01:50.022259+0000","last_clean":"2023-12-22T10:01:50.022259+0000","last_became_active":"2023-12-22T10:01:50.021651+0000","last_became_peered":"2023-12-22T10:01:50.021651+0000","last_unstale":"2023-12-22T10:01:50.022259+0000","last_undegraded":"2023-12-22T10:01:50.022259+0000","last_fullsized":"2023-12-22T10:01:50.022259+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"36'9","reported_seq":26,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.994792+0000","last_change":"2023-12-22T10:01:35.139521+0000","last_active":"2023-12-22T10:01:49.994792+0000","last_peered":"2023-12-22T10:01:49.994792+0000","last_clean":"2023-12-22T10:01:49.994792+0000","last_became_active":"2023-12-22T10:01:35.139189+0000","last_became_peered":"2023-12-22T10:01:35.139189+0000","last_unstale":"2023-12-22T10:01:49.994792+0000","last_undegraded":"2023-12-22T10:01:49.994792+0000","last_fullsized":"2023-12-22T10:01:49.994792+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"41'3","reported_seq":19,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.149906+0000","last_change":"2023-12-22T10:01:34.680088+0000","last_active":"2023-12-22T10:01:49.149906+0000","last_peered":"2023-12-22T10:01:49.149906+0000","last_clean":"2023-12-22T10:01:49.149906+0000","last_became_active":"2023-12-22T10:01:34.679800+0000","last_became_peered":"2023-12-22T10:01:34.679800+0000","last_unstale":"2023-12-22T10:01:49.149906+0000","last_undegraded":"2023-12-22T10:01:49.149906+0000","last_fullsized":"2023-12-22T10:01:49.149906+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":31,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.147051+0000","last_change":"2023-12-22T10:00:28.030883+0000","last_active":"2023-12-22T10:01:49.147051+0000","last_peered":"2023-12-22T10:01:49.147051+0000","last_clean":"2023-12-22T10:01:49.147051+0000","last_became_active":"2023-12-22T10:00:28.030284+0000","last_became_peered":"2023-12-22T10:00:28.030284+0000","last_unstale":"2023-12-22T10:01:49.147051+0000","last_undegraded":"2023-12-22T10:01:49.147051+0000","last_fullsized":"2023-12-22T10:01:49.147051+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_clean_scrub_stamp":"2023-12-22T10:00:27.001906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":8,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-22T10:01:50.016338+0000","last_change":"2023-12-22T10:01:50.016338+0000","last_active":"2023-12-22T10:01:50.016338+0000","last_peered":"2023-12-22T10:01:50.016338+0000","last_clean":"2023-12-22T10:01:50.016338+0000","last_became_active":"2023-12-22T10:01:50.015435+0000","last_became_peered":"2023-12-22T10:01:50.015435+0000","last_unstale":"2023-12-22T10:01:50.016338+0000","last_undegraded":"2023-12-22T10:01:50.016338+0000","last_fullsized":"2023-12-22T10:01:50.016338+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:49.124116+0000","last_clean_scrub_stamp":"2023-12-22T10:01:49.124116+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.7","version":"36'8","reported_seq":23,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.149633+0000","last_change":"2023-12-22T10:01:35.159707+0000","last_active":"2023-12-22T10:01:49.149633+0000","last_peered":"2023-12-22T10:01:49.149633+0000","last_clean":"2023-12-22T10:01:49.149633+0000","last_became_active":"2023-12-22T10:01:35.159054+0000","last_became_peered":"2023-12-22T10:01:35.159054+0000","last_unstale":"2023-12-22T10:01:49.149633+0000","last_undegraded":"2023-12-22T10:01:49.149633+0000","last_fullsized":"2023-12-22T10:01:49.149633+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:34.647930+0000","last_clean_scrub_stamp":"2023-12-22T10:01:34.647930+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.150239+0000","last_change":"2023-12-22T10:01:34.688735+0000","last_active":"2023-12-22T10:01:49.150239+0000","last_peered":"2023-12-22T10:01:49.150239+0000","last_clean":"2023-12-22T10:01:49.150239+0000","last_became_active":"2023-12-22T10:01:34.688216+0000","last_became_peered":"2023-12-22T10:01:34.688216+0000","last_unstale":"2023-12-22T10:01:49.150239+0000","last_undegraded":"2023-12-22T10:01:49.150239+0000","last_fullsized":"2023-12-22T10:01:49.150239+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:01:33.642305+0000","last_clean_scrub_stamp":"2023-12-22T10:01:33.642305+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":31,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.149991+0000","last_change":"2023-12-22T10:00:28.031790+0000","last_active":"2023-12-22T10:01:49.149991+0000","last_peered":"2023-12-22T10:01:49.149991+0000","last_clean":"2023-12-22T10:01:49.149991+0000","last_became_active":"2023-12-22T10:00:28.031190+0000","last_became_peered":"2023-12-22T10:00:28.031190+0000","last_unstale":"2023-12-22T10:01:49.149991+0000","last_undegraded":"2023-12-22T10:01:49.149991+0000","last_fullsized":"2023-12-22T10:01:49.149991+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_clean_scrub_stamp":"2023-12-22T10:00:27.001906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":32,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-22T10:01:49.135130+0000","last_change":"2023-12-22T10:00:27.889031+0000","last_active":"2023-12-22T10:01:49.135130+0000","last_peered":"2023-12-22T10:01:49.135130+0000","last_clean":"2023-12-22T10:01:49.135130+0000","last_became_active":"2023-12-22T10:00:27.888164+0000","last_became_peered":"2023-12-22T10:00:27.888164+0000","last_unstale":"2023-12-22T10:01:49.135130+0000","last_undegraded":"2023-12-22T10:01:49.135130+0000","last_fullsized":"2023-12-22T10:01:49.135130+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:25.998963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:25.998963+0000","last_clean_scrub_stamp":"2023-12-22T10:00:25.998963+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":6291456,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":504,"ondisk_log_size":504,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":92,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":81,"ondisk_log_size":81,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297580,"kb_used_data":484,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074260,"statfs":{"total":96636764160,"available":96332042240,"internally_reserved":0,"allocated":495616,"data_stored":218923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 10:01:29 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.143,"15min":1.143},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.677,"5min":1.677,"15min":1.677},"last":0.89500000000000002},{"interface":"front","average":{"1min":1.161,"5min":1.161,"15min":1.161},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":1.093}]},{"osd":1,"last update":"Fri Dec 22 10:01:29 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.25,"15min":1.25},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.8899999999999999,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":1.494},{"interface":"front","average":{"1min":1.337,"5min":1.337,"15min":1.337},"min":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":2.6819999999999999,"5min":2.6819999999999999,"15min":2.6819999999999999},"last":1.196}]},{"osd":2,"last update":"Fri Dec 22 10:01:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":2.8490000000000002,"5min":2.8490000000000002,"15min":2.8490000000000002},"last":1.137},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.774,"5min":1.774,"15min":1.774},"last":1.3500000000000001}]},{"osd":3,"last update":"Fri Dec 22 10:01:29 2023","interfaces":[{"interface":"back","average":{"1min":1.321,"5min":1.321,"15min":1.321},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":2.3690000000000002,"5min":2.3690000000000002,"15min":2.3690000000000002},"last":1.2150000000000001},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"min":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"max":{"1min":2.0899999999999999,"5min":2.0899999999999999,"15min":2.0899999999999999},"last":1.4390000000000001}]},{"osd":4,"last update":"Fri Dec 22 10:01:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.764,"5min":1.764,"15min":1.764},"last":0.99199999999999999},{"interface":"front","average":{"1min":1.278,"5min":1.278,"15min":1.278},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":2.2930000000000001,"5min":2.2930000000000001,"15min":2.2930000000000001},"last":1.3069999999999999}]},{"osd":5,"last update":"Fri Dec 22 10:01:29 2023","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.228,"15min":1.228},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.786,"5min":1.786,"15min":1.786},"last":1.5489999999999999},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":2.73,"5min":2.73,"15min":2.73},"last":1.5580000000000001}]},{"osd":6,"last update":"Fri Dec 22 10:01:29 2023","interfaces":[{"interface":"back","average":{"1min":1.476,"5min":1.476,"15min":1.476},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":2.7690000000000001,"5min":2.7690000000000001,"15min":2.7690000000000001},"last":1.635},{"interface":"front","average":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":2.8820000000000001,"5min":2.8820000000000001,"15min":2.8820000000000001},"last":1.524}]}]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297580,"kb_used_data":484,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074260,"statfs":{"total":96636764160,"available":96332042240,"internally_reserved":0,"allocated":495616,"data_stored":218923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.131,"15min":1.131},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":1.1279999999999999},{"interface":"front","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.617,"5min":1.617,"15min":1.617},"last":1.3899999999999999}]},{"osd":1,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":1.0780000000000001},{"interface":"front","average":{"1min":1.085,"5min":1.085,"15min":1.085},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.657,"5min":1.657,"15min":1.657},"last":0.93700000000000006}]},{"osd":2,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.077,"15min":1.077},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":1.4530000000000001},{"interface":"front","average":{"1min":1.145,"5min":1.145,"15min":1.145},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.583,"5min":1.583,"15min":1.583},"last":1.2310000000000001}]},{"osd":3,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.262,"15min":1.262},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":1.034},{"interface":"front","average":{"1min":1.252,"5min":1.252,"15min":1.252},"min":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":1.6359999999999999,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":1.002}]},{"osd":4,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.282,"15min":1.282},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.7310000000000001,"5min":1.7310000000000001,"15min":1.7310000000000001},"last":1.369},{"interface":"front","average":{"1min":1.361,"5min":1.361,"15min":1.361},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":2.2280000000000002,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":1.165}]},{"osd":5,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"min":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":1.907,"5min":1.907,"15min":1.907},"last":0.90300000000000002},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":2.363,"5min":2.363,"15min":2.363},"last":1.2689999999999999}]},{"osd":7,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"min":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"max":{"1min":2.1459999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.2989999999999999},{"interface":"front","average":{"1min":1.403,"5min":1.403,"15min":1.403},"min":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"max":{"1min":2.1779999999999999,"5min":2.1779999999999999,"15min":2.1779999999999999},"last":1.3380000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301676,"kb_used_data":4580,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94070164,"statfs":{"total":96636764160,"available":96327847936,"internally_reserved":0,"allocated":4689920,"data_stored":4413227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":0.93500000000000005},{"interface":"front","average":{"1min":1.123,"5min":1.123,"15min":1.123},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.6559999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":0.94699999999999995}]},{"osd":1,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.89800000000000002},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":2.0070000000000001,"5min":2.0070000000000001,"15min":2.0070000000000001},"last":0.63300000000000001}]},{"osd":2,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.76000000000000001},{"interface":"front","average":{"1min":1.119,"5min":1.119,"15min":1.119},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.607,"5min":1.607,"15min":1.607},"last":1.0629999999999999}]},{"osd":3,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.133,"15min":1.133},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":1.0920000000000001},{"interface":"front","average":{"1min":1.179,"5min":1.179,"15min":1.179},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.488,"5min":1.488,"15min":1.488},"last":1.1859999999999999}]},{"osd":4,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.145,"15min":1.145},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":1.8779999999999999,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.98699999999999999},{"interface":"front","average":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"min":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":1.006}]},{"osd":6,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.242,"15min":1.242},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.7749999999999999,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":1.117},{"interface":"front","average":{"1min":1.236,"5min":1.236,"15min":1.236},"min":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":1.0980000000000001}]},{"osd":7,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.236,"15min":1.236},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":1.516,"5min":1.516,"15min":1.516},"last":1.054},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.8620000000000001,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":1.2989999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297580,"kb_used_data":484,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074260,"statfs":{"total":96636764160,"available":96332042240,"internally_reserved":0,"allocated":495616,"data_stored":218923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.149,"15min":1.149},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":0.95299999999999996},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"min":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.80200000000000005}]},{"osd":1,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":1.012,"15min":1.012},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":1.0229999999999999},{"interface":"front","average":{"1min":1.077,"5min":1.077,"15min":1.077},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":1.1830000000000001}]},{"osd":2,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.641,"5min":1.641,"15min":1.641},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.272,"5min":1.272,"15min":1.272},"min":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"max":{"1min":1.8340000000000001,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":1.333}]},{"osd":3,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.173,"15min":1.173},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":1.7490000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":1.151},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"min":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"max":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":1.3799999999999999}]},{"osd":5,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":1.216,"15min":1.216},"min":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"max":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":1.0880000000000001},{"interface":"front","average":{"1min":1.173,"5min":1.173,"15min":1.173},"min":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":1.9350000000000001,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":1.28}]},{"osd":6,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":1.869,"5min":1.869,"15min":1.869},"last":1.3089999999999999},{"interface":"front","average":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"min":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"max":{"1min":1.9910000000000001,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":1.266}]},{"osd":7,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"min":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"max":{"1min":2.1960000000000002,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":1.3460000000000001},{"interface":"front","average":{"1min":1.391,"5min":1.391,"15min":1.391},"min":{"1min":1.044,"5min":1.044,"15min":1.044},"max":{"1min":1.8680000000000001,"5min":1.8680000000000001,"15min":1.8680000000000001},"last":1.2170000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303724,"kb_used_data":6628,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94068116,"statfs":{"total":96636764160,"available":96325750784,"internally_reserved":0,"allocated":6787072,"data_stored":6510379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 10:01:25 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.93999999999999995}]},{"osd":1,"last update":"Fri Dec 22 10:01:25 2023","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.78000000000000003},{"interface":"front","average":{"1min":1.109,"5min":1.109,"15min":1.109},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":1.415}]},{"osd":2,"last update":"Fri Dec 22 10:01:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":1.133},{"interface":"front","average":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.702,"5min":1.702,"15min":1.702},"last":0.99299999999999999}]},{"osd":4,"last update":"Fri Dec 22 10:01:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.2,"15min":1.2},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":1.091},{"interface":"front","average":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":2.0619999999999998,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":1.448}]},{"osd":5,"last update":"Fri Dec 22 10:01:25 2023","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.333,"15min":1.333},"min":{"1min":0.878,"5min":0.878,"15min":0.878},"max":{"1min":1.9339999999999999,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":1.363},{"interface":"front","average":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"min":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"max":{"1min":2.1720000000000002,"5min":2.1720000000000002,"15min":2.1720000000000002},"last":1.1910000000000001}]},{"osd":6,"last update":"Fri Dec 22 10:01:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.8640000000000001,"5min":1.8640000000000001,"15min":1.8640000000000001},"last":1.284},{"interface":"front","average":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":2.2130000000000001,"5min":2.2130000000000001,"15min":2.2130000000000001},"last":1.2549999999999999}]},{"osd":7,"last update":"Fri Dec 22 10:01:25 2023","interfaces":[{"interface":"back","average":{"1min":1.405,"5min":1.405,"15min":1.405},"min":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"max":{"1min":2.1389999999999998,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":1.3400000000000001},{"interface":"front","average":{"1min":1.431,"5min":1.431,"15min":1.431},"min":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":2.105,"5min":2.105,"15min":2.105},"last":1.385}]}]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297580,"kb_used_data":484,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074260,"statfs":{"total":96636764160,"available":96332042240,"internally_reserved":0,"allocated":495616,"data_stored":218923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":1.04},{"interface":"front","average":{"1min":1.083,"5min":1.083,"15min":1.083},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.78800000000000003}]},{"osd":1,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.52,"5min":1.52,"15min":1.52},"last":0.88900000000000001},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":2.3809999999999998,"5min":2.3809999999999998,"15min":2.3809999999999998},"last":0.61299999999999999}]},{"osd":3,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.698,"5min":1.698,"15min":1.698},"last":0.85599999999999998},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.788,"5min":1.788,"15min":1.788},"last":0.97599999999999998}]},{"osd":4,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.381,"15min":1.381},"min":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"max":{"1min":2.234,"5min":2.234,"15min":2.234},"last":0.94099999999999995},{"interface":"front","average":{"1min":1.296,"5min":1.296,"15min":1.296},"min":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"max":{"1min":2.1230000000000002,"5min":2.1230000000000002,"15min":2.1230000000000002},"last":1.3129999999999999}]},{"osd":5,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"min":{"1min":1.109,"5min":1.109,"15min":1.109},"max":{"1min":2.0960000000000001,"5min":2.0960000000000001,"15min":2.0960000000000001},"last":1.284},{"interface":"front","average":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"min":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"max":{"1min":1.9730000000000001,"5min":1.9730000000000001,"15min":1.9730000000000001},"last":1.2}]},{"osd":6,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"min":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"max":{"1min":2.298,"5min":2.298,"15min":2.298},"last":1.518},{"interface":"front","average":{"1min":1.46,"5min":1.46,"15min":1.46},"min":{"1min":1.02,"5min":1.02,"15min":1.02},"max":{"1min":1.899,"5min":1.899,"15min":1.899},"last":1.2390000000000001}]},{"osd":7,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.458,"5min":1.458,"15min":1.458},"min":{"1min":1,"5min":1,"15min":1},"max":{"1min":2.0289999999999999,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":0.98999999999999999},{"interface":"front","average":{"1min":1.415,"5min":1.415,"15min":1.415},"min":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"max":{"1min":2.0179999999999998,"5min":2.0179999999999998,"15min":2.0179999999999998},"last":1.415}]}]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297580,"kb_used_data":484,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074260,"statfs":{"total":96636764160,"available":96332042240,"internally_reserved":0,"allocated":495616,"data_stored":218923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.54100000000000004}]},{"osd":2,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.40899999999999997},{"interface":"front","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.60699999999999998}]},{"osd":3,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.66600000000000004},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.63100000000000001}]},{"osd":4,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":0.55400000000000005},{"interface":"front","average":{"1min":1.236,"5min":1.236,"15min":1.236},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":2.0710000000000002,"5min":2.0710000000000002,"15min":2.0710000000000002},"last":0.71399999999999997}]},{"osd":5,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"min":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"max":{"1min":1.8129999999999999,"5min":1.8129999999999999,"15min":1.8129999999999999},"last":0.93899999999999995},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"min":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"max":{"1min":1.881,"5min":1.881,"15min":1.881},"last":0.81599999999999995}]},{"osd":6,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"min":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"max":{"1min":1.8779999999999999,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.997},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"min":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":1.946,"5min":1.946,"15min":1.946},"last":0.85599999999999998}]},{"osd":7,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"min":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"max":{"1min":1.9279999999999999,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":0.872},{"interface":"front","average":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"min":{"1min":1.03,"5min":1.03,"15min":1.03},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.97399999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299628,"kb_used_data":2532,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94072212,"statfs":{"total":96636764160,"available":96329945088,"internally_reserved":0,"allocated":2592768,"data_stored":2316075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":2.7250000000000001,"5min":2.7250000000000001,"15min":2.7250000000000001},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":1.171}]},{"osd":2,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":2.7799999999999998,"5min":2.7799999999999998,"15min":2.7799999999999998},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.84299999999999997}]},{"osd":3,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":2.919,"5min":2.919,"15min":2.919},"last":0.69299999999999995},{"interface":"front","average":{"1min":1.248,"5min":1.248,"15min":1.248},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":2.8959999999999999,"5min":2.8959999999999999,"15min":2.8959999999999999},"last":0.92800000000000005}]},{"osd":4,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":0.95599999999999996},{"interface":"front","average":{"1min":1.292,"5min":1.292,"15min":1.292},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":3.1280000000000001,"5min":3.1280000000000001,"15min":3.1280000000000001},"last":0.97899999999999998}]},{"osd":5,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"min":{"1min":0.87,"5min":0.87,"15min":0.87},"max":{"1min":3.0760000000000001,"5min":3.0760000000000001,"15min":3.0760000000000001},"last":0.83199999999999996},{"interface":"front","average":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":2.512,"5min":2.512,"15min":2.512},"last":1.04}]},{"osd":6,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.5,"5min":1.5,"15min":1.5},"min":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"max":{"1min":2.8199999999999998,"5min":2.8199999999999998,"15min":2.8199999999999998},"last":1.107},{"interface":"front","average":{"1min":1.51,"5min":1.51,"15min":1.51},"min":{"1min":1.032,"5min":1.032,"15min":1.032},"max":{"1min":4.6029999999999998,"5min":4.6029999999999998,"15min":4.6029999999999998},"last":1.0760000000000001}]},{"osd":7,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.417,"5min":1.417,"15min":1.417},"min":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"max":{"1min":2.0190000000000001,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":1.2629999999999999},{"interface":"front","average":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"min":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"max":{"1min":3.6339999999999999,"5min":3.6339999999999999,"15min":3.6339999999999999},"last":1.1990000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2097152,"data_stored":2097152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-22T10:01:54.845 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-22T10:01:54.845 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph - s 2023-12-22T10:01:55.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.048+0000 7fbf184ff700 1 Processor -- start 2023-12-22T10:01:55.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.048+0000 7fbf184ff700 1 -- start start 2023-12-22T10:01:55.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.052+0000 7fbf184ff700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fbf100a7d20 0x7fbf100c3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:55.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.052+0000 7fbf184ff700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fbf100c3a80 0x7fbf100c5180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:55.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.052+0000 7fbf184ff700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf100c5b20 con 0x7fbf100c5670 2023-12-22T10:01:55.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.052+0000 7fbf184ff700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf10151f20 con 0x7fbf100c3a80 2023-12-22T10:01:55.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.052+0000 7fbf184ff700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf100c4d00 con 0x7fbf100a7d20 2023-12-22T10:01:55.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.052+0000 7fbf15a9a700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fbf100c3a80 0x7fbf100c5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:55.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.052+0000 7fbf1629b700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fbf100a7d20 0x7fbf100c3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:55.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.052+0000 7fbf15a9a700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fbf100c3a80 0x7fbf100c5180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.45:43170/0 (socket says 172.21.15.45:43170) 2023-12-22T10:01:55.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.052+0000 7fbf15a9a700 1 -- 172.21.15.45:0/554583479 learned_addr learned my addr 172.21.15.45:0/554583479 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:55.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.052+0000 7fbf1629b700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fbf100a7d20 0x7fbf100c3590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.113:3301/0 says I am v2:172.21.15.45:48140/0 (socket says 172.21.15.45:48140) 2023-12-22T10:01:55.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.052+0000 7fbf1629b700 1 -- 172.21.15.45:0/554583479 >> v2:172.21.15.113:3300/0 conn(0x7fbf100c3a80 msgr2=0x7fbf100c5180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:55.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.052+0000 7fbf1629b700 1 --2- 172.21.15.45:0/554583479 >> v2:172.21.15.113:3300/0 conn(0x7fbf100c3a80 0x7fbf100c5180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:55.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.052+0000 7fbf1629b700 1 -- 172.21.15.45:0/554583479 >> v1:172.21.15.113:6789/0 conn(0x7fbf100c5670 legacy=0x7fbf100c6860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:55.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.052+0000 7fbf1629b700 1 -- 172.21.15.45:0/554583479 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf100c3ea0 con 0x7fbf100a7d20 2023-12-22T10:01:55.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.056+0000 7fbf1629b700 1 --2- 172.21.15.45:0/554583479 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fbf100a7d20 0x7fbf100c3590 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7fbf0c006fd0 tx=0x7fbf0c006f40).ready entity=mon.2 client_cookie=98f741a63e139614 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:55.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.056+0000 7fbf15299700 1 -- 172.21.15.45:0/554583479 <== mon.2 v2:172.21.15.113:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf0c005880 con 0x7fbf100a7d20 2023-12-22T10:01:55.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.056+0000 7fbf15299700 1 -- 172.21.15.45:0/554583479 <== mon.2 v2:172.21.15.113:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf0c0059e0 con 0x7fbf100a7d20 2023-12-22T10:01:55.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.056+0000 7fbf15299700 1 -- 172.21.15.45:0/554583479 <== mon.2 v2:172.21.15.113:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf0c005d60 con 0x7fbf100a7d20 2023-12-22T10:01:55.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.056+0000 7fbf184ff700 1 -- 172.21.15.45:0/554583479 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fbf100a7d20 msgr2=0x7fbf100c3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:55.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.056+0000 7fbf184ff700 1 --2- 172.21.15.45:0/554583479 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fbf100a7d20 0x7fbf100c3590 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7fbf0c006fd0 tx=0x7fbf0c006f40).stop 2023-12-22T10:01:55.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.056+0000 7fbf184ff700 1 -- 172.21.15.45:0/554583479 shutdown_connections 2023-12-22T10:01:55.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.056+0000 7fbf184ff700 1 --2- 172.21.15.45:0/554583479 >> v2:172.21.15.113:3300/0 conn(0x7fbf100c3a80 0x7fbf100c5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:55.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.056+0000 7fbf184ff700 1 --2- 172.21.15.45:0/554583479 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fbf100a7d20 0x7fbf100c3590 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:55.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.056+0000 7fbf184ff700 1 -- 172.21.15.45:0/554583479 >> 172.21.15.45:0/554583479 conn(0x7fbf10082670 msgr2=0x7fbf10091f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:55.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.056+0000 7fbf184ff700 1 -- 172.21.15.45:0/554583479 shutdown_connections 2023-12-22T10:01:55.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.056+0000 7fbf184ff700 1 -- 172.21.15.45:0/554583479 wait complete. 2023-12-22T10:01:55.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.060+0000 7fbf184ff700 1 Processor -- start 2023-12-22T10:01:55.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.060+0000 7fbf184ff700 1 -- start start 2023-12-22T10:01:55.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.060+0000 7fbf184ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf100a7d20 0x7fbf1014fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:55.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.060+0000 7fbf184ff700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbf100c3a80 0x7fbf10168830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:55.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.060+0000 7fbf184ff700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fbf100c5670 0x7fbf10152110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:55.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.060+0000 7fbf184ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf10153cc0 con 0x7fbf100a7d20 2023-12-22T10:01:55.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.060+0000 7fbf184ff700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf101534b0 con 0x7fbf100c3a80 2023-12-22T10:01:55.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.060+0000 7fbf184ff700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf100ad740 con 0x7fbf100c5670 2023-12-22T10:01:55.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.060+0000 7fbf1629b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf100a7d20 0x7fbf1014fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:55.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.060+0000 7fbf1629b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf100a7d20 0x7fbf1014fef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48372/0 (socket says 172.21.15.45:48372) 2023-12-22T10:01:55.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.060+0000 7fbf1629b700 1 -- 172.21.15.45:0/2915044935 learned_addr learned my addr 172.21.15.45:0/2915044935 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:55.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.060+0000 7fbf16a9c700 1 --2- 172.21.15.45:0/2915044935 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fbf100c5670 0x7fbf10152110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:55.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.060+0000 7fbf15a9a700 1 --2- 172.21.15.45:0/2915044935 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbf100c3a80 0x7fbf10168830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:55.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.060+0000 7fbf1629b700 1 -- 172.21.15.45:0/2915044935 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fbf100c5670 msgr2=0x7fbf10152110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:55.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.060+0000 7fbf1629b700 1 --2- 172.21.15.45:0/2915044935 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fbf100c5670 0x7fbf10152110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:55.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.060+0000 7fbf1629b700 1 -- 172.21.15.45:0/2915044935 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbf100c3a80 msgr2=0x7fbf10168830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:55.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.060+0000 7fbf1629b700 1 --2- 172.21.15.45:0/2915044935 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbf100c3a80 0x7fbf10168830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:55.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.060+0000 7fbf1629b700 1 -- 172.21.15.45:0/2915044935 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf0c009250 con 0x7fbf100a7d20 2023-12-22T10:01:55.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.060+0000 7fbf15a9a700 1 --2- 172.21.15.45:0/2915044935 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fbf100c3a80 0x7fbf10168830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T10:01:55.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.060+0000 7fbf16a9c700 1 --2- 172.21.15.45:0/2915044935 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fbf100c5670 0x7fbf10152110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T10:01:55.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.060+0000 7fbf1629b700 1 --2- 172.21.15.45:0/2915044935 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf100a7d20 0x7fbf1014fef0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7fbf0c006f80 tx=0x7fbf0c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:55.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.064+0000 7fbf067fc700 1 -- 172.21.15.45:0/2915044935 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf0c00f7f0 con 0x7fbf100a7d20 2023-12-22T10:01:55.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.064+0000 7fbf067fc700 1 -- 172.21.15.45:0/2915044935 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf0c00f970 con 0x7fbf100a7d20 2023-12-22T10:01:55.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.064+0000 7fbf184ff700 1 -- 172.21.15.45:0/2915044935 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf10168d20 con 0x7fbf100a7d20 2023-12-22T10:01:55.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.064+0000 7fbf067fc700 1 -- 172.21.15.45:0/2915044935 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf0c00fd30 con 0x7fbf100a7d20 2023-12-22T10:01:55.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.064+0000 7fbf184ff700 1 -- 172.21.15.45:0/2915044935 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf100ad130 con 0x7fbf100a7d20 2023-12-22T10:01:55.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.064+0000 7fbf184ff700 1 -- 172.21.15.45:0/2915044935 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf10153760 con 0x7fbf100a7d20 2023-12-22T10:01:55.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.064+0000 7fbf067fc700 1 -- 172.21.15.45:0/2915044935 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fbf0c011650 con 0x7fbf100a7d20 2023-12-22T10:01:55.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.068+0000 7fbf067fc700 1 --2- 172.21.15.45:0/2915044935 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fbef405a510 0x7fbef405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:55.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.068+0000 7fbf067fc700 1 -- 172.21.15.45:0/2915044935 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6660+0+0 (secure 0 0 0) 0x7fbf0c076040 con 0x7fbf100a7d20 2023-12-22T10:01:55.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.068+0000 7fbf15a9a700 1 --2- 172.21.15.45:0/2915044935 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fbef405a510 0x7fbef405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:55.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.068+0000 7fbf15a9a700 1 --2- 172.21.15.45:0/2915044935 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fbef405a510 0x7fbef405c9d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7fbf00006bc0 tx=0x7fbf00008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:55.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.076+0000 7fbf067fc700 1 -- 172.21.15.45:0/2915044935 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fbf0c049600 con 0x7fbf100a7d20 2023-12-22T10:01:55.409 INFO:teuthology.orchestra.run.smithi045.stderr:no valid command found; 10 closest matches: 2023-12-22T10:01:55.409 INFO:teuthology.orchestra.run.smithi045.stderr:pg stat 2023-12-22T10:01:55.409 INFO:teuthology.orchestra.run.smithi045.stderr:pg getmap 2023-12-22T10:01:55.409 INFO:teuthology.orchestra.run.smithi045.stderr:pg dump [all|summary|sum|delta|pools|osds|pgs|pgs_brief...] 2023-12-22T10:01:55.410 INFO:teuthology.orchestra.run.smithi045.stderr:pg dump_json [all|summary|sum|pools|osds|pgs...] 2023-12-22T10:01:55.410 INFO:teuthology.orchestra.run.smithi045.stderr:pg dump_pools_json 2023-12-22T10:01:55.410 INFO:teuthology.orchestra.run.smithi045.stderr:pg ls-by-pool [...] 2023-12-22T10:01:55.410 INFO:teuthology.orchestra.run.smithi045.stderr:pg ls-by-primary [] [...] 2023-12-22T10:01:55.410 INFO:teuthology.orchestra.run.smithi045.stderr:pg ls-by-osd [] [...] 2023-12-22T10:01:55.410 INFO:teuthology.orchestra.run.smithi045.stderr:pg ls [] [...] 2023-12-22T10:01:55.410 INFO:teuthology.orchestra.run.smithi045.stderr:pg dump_stuck [inactive|unclean|stale|undersized|degraded...] [] 2023-12-22T10:01:55.410 INFO:teuthology.orchestra.run.smithi045.stderr:Error EINVAL: invalid command 2023-12-22T10:01:55.421 DEBUG:teuthology.orchestra.run:got remote process result: 22 2023-12-22T10:01:55.422 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-22T10:01:55.422 DEBUG:teuthology.orchestra.run.smithi045:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-22T10:01:55.463 DEBUG:teuthology.orchestra.run.smithi113:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-22T10:01:55.509 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-22T10:01:55.509 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi045.front.sepia.ceph.com 2023-12-22T10:01:55.510 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T10:01:55.510 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-22T10:01:55.530 INFO:teuthology.orchestra.run.smithi045.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-12-22T10:01:55.531 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-22T10:01:55.532 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi113.front.sepia.ceph.com 2023-12-22T10:01:55.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T10:01:55.532 DEBUG:teuthology.orchestra.run.smithi113:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-22T10:01:55.575 INFO:teuthology.orchestra.run.smithi113.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-12-22T10:01:55.576 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-22T10:01:55.577 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi045.front.sepia.ceph.com 2023-12-22T10:01:55.577 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T10:01:55.577 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-12-22T10:01:55.598 INFO:teuthology.orchestra.run.smithi045.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-12-22T10:01:55.599 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-22T10:01:55.600 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi113.front.sepia.ceph.com 2023-12-22T10:01:55.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T10:01:55.600 DEBUG:teuthology.orchestra.run.smithi113:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-12-22T10:01:55.642 INFO:teuthology.orchestra.run.smithi113.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-12-22T10:01:55.643 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-22T10:01:55.644 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T10:01:55.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.812+0000 7fd5f6fb9700 1 Processor -- start 2023-12-22T10:01:55.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.812+0000 7fd5f6fb9700 1 -- start start 2023-12-22T10:01:55.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.812+0000 7fd5f6fb9700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fd5f00a8ad0 0x7fd5f0065860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:55.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.812+0000 7fd5f6fb9700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd5f015bb60 0x7fd5f015c010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:55.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.812+0000 7fd5f6fb9700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5f00c17e0 con 0x7fd5f00a8eb0 2023-12-22T10:01:55.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.812+0000 7fd5f6fb9700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5f015c500 con 0x7fd5f00a8ad0 2023-12-22T10:01:55.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.812+0000 7fd5f6fb9700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f00c2630 con 0x7fd5f015bb60 2023-12-22T10:01:55.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.812+0000 7fd5f5fb7700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fd5f00a8ad0 0x7fd5f0065860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:55.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.812+0000 7fd5f5fb7700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fd5f00a8ad0 0x7fd5f0065860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.45:43190/0 (socket says 172.21.15.45:43190) 2023-12-22T10:01:55.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.812+0000 7fd5f5fb7700 1 -- 172.21.15.45:0/1022838548 learned_addr learned my addr 172.21.15.45:0/1022838548 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:55.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.812+0000 7fd5f67b8700 1 --2- 172.21.15.45:0/1022838548 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd5f015bb60 0x7fd5f015c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:55.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.812+0000 7fd5f57b6700 1 --1- 172.21.15.45:0/1022838548 >> v1:172.21.15.113:6789/0 conn(0x7fd5f00a8eb0 0x7fd5f00c10d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.45:60708/0 (socket says 172.21.15.45:60708) 2023-12-22T10:01:55.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.816+0000 7fd5f5fb7700 1 -- 172.21.15.45:0/1022838548 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd5f015bb60 msgr2=0x7fd5f015c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:55.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.816+0000 7fd5f5fb7700 1 --2- 172.21.15.45:0/1022838548 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd5f015bb60 0x7fd5f015c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:55.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.816+0000 7fd5f5fb7700 1 -- 172.21.15.45:0/1022838548 >> v1:172.21.15.113:6789/0 conn(0x7fd5f00a8eb0 legacy=0x7fd5f00c10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:55.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.816+0000 7fd5f5fb7700 1 -- 172.21.15.45:0/1022838548 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5f01584c0 con 0x7fd5f00a8ad0 2023-12-22T10:01:55.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.816+0000 7fd5f4fb5700 1 -- 172.21.15.45:0/1022838548 <== mon.1 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2826979462 0 0) 0x7fd5e0001110 con 0x7fd5f00a8eb0 2023-12-22T10:01:55.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.816+0000 7fd5f5fb7700 1 --2- 172.21.15.45:0/1022838548 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd5f00a8ad0 0x7fd5f0065860 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7fd5ec006fd0 tx=0x7fd5ec0090f0).ready entity=mon.1 client_cookie=f4207f7832a34ee2 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:55.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.816+0000 7fd5f4fb5700 1 -- 172.21.15.45:0/1022838548 <== mon.1 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5ec00b580 con 0x7fd5f00a8ad0 2023-12-22T10:01:55.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.816+0000 7fd5f4fb5700 1 -- 172.21.15.45:0/1022838548 <== mon.1 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5ec00b6e0 con 0x7fd5f00a8ad0 2023-12-22T10:01:55.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.816+0000 7fd5f4fb5700 1 -- 172.21.15.45:0/1022838548 <== mon.1 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5ec00ba60 con 0x7fd5f00a8ad0 2023-12-22T10:01:55.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.816+0000 7fd5f6fb9700 1 -- 172.21.15.45:0/1022838548 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd5f00a8ad0 msgr2=0x7fd5f0065860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:55.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.816+0000 7fd5f6fb9700 1 --2- 172.21.15.45:0/1022838548 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd5f00a8ad0 0x7fd5f0065860 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7fd5ec006fd0 tx=0x7fd5ec0090f0).stop 2023-12-22T10:01:55.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.816+0000 7fd5f6fb9700 1 -- 172.21.15.45:0/1022838548 shutdown_connections 2023-12-22T10:01:55.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.816+0000 7fd5f6fb9700 1 --2- 172.21.15.45:0/1022838548 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd5f015bb60 0x7fd5f015c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:55.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.816+0000 7fd5f6fb9700 1 --2- 172.21.15.45:0/1022838548 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd5f00a8ad0 0x7fd5f0065860 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:55.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.816+0000 7fd5f6fb9700 1 -- 172.21.15.45:0/1022838548 >> 172.21.15.45:0/1022838548 conn(0x7fd5f0067540 msgr2=0x7fd5f00c6460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:55.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.816+0000 7fd5f6fb9700 1 -- 172.21.15.45:0/1022838548 shutdown_connections 2023-12-22T10:01:55.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.816+0000 7fd5f6fb9700 1 -- 172.21.15.45:0/1022838548 wait complete. 2023-12-22T10:01:55.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.820+0000 7fd5f6fb9700 1 Processor -- start 2023-12-22T10:01:55.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.820+0000 7fd5f6fb9700 1 -- start start 2023-12-22T10:01:55.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.820+0000 7fd5f6fb9700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd5f00a8ad0 0x7fd5f00aa550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:55.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.820+0000 7fd5f6fb9700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd5f015bb60 0x7fd5f014eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:55.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.820+0000 7fd5f6fb9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5f014f3b0 0x7fd5f00aba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:55.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.820+0000 7fd5f6fb9700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f014f830 con 0x7fd5f014f3b0 2023-12-22T10:01:55.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.820+0000 7fd5f6fb9700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f016cee0 con 0x7fd5f00a8ad0 2023-12-22T10:01:55.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.820+0000 7fd5f6fb9700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f00a94b0 con 0x7fd5f015bb60 2023-12-22T10:01:55.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.820+0000 7fd5f5fb7700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd5f00a8ad0 0x7fd5f00aa550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:55.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.820+0000 7fd5f57b6700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd5f015bb60 0x7fd5f014eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:55.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.820+0000 7fd5f5fb7700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd5f00a8ad0 0x7fd5f00aa550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.45:43204/0 (socket says 172.21.15.45:43204) 2023-12-22T10:01:55.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.820+0000 7fd5f5fb7700 1 -- 172.21.15.45:0/1874319996 learned_addr learned my addr 172.21.15.45:0/1874319996 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:55.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.820+0000 7fd5f67b8700 1 --2- 172.21.15.45:0/1874319996 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5f014f3b0 0x7fd5f00aba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:55.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.824+0000 7fd5f5fb7700 1 -- 172.21.15.45:0/1874319996 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd5f015bb60 msgr2=0x7fd5f014eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:55.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.824+0000 7fd5f5fb7700 1 --2- 172.21.15.45:0/1874319996 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd5f015bb60 0x7fd5f014eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:55.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.824+0000 7fd5f5fb7700 1 -- 172.21.15.45:0/1874319996 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5f014f3b0 msgr2=0x7fd5f00aba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:55.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.824+0000 7fd5f5fb7700 1 --2- 172.21.15.45:0/1874319996 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5f014f3b0 0x7fd5f00aba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:55.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.824+0000 7fd5f5fb7700 1 -- 172.21.15.45:0/1874319996 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5ec009370 con 0x7fd5f00a8ad0 2023-12-22T10:01:55.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.824+0000 7fd5f5fb7700 1 --2- 172.21.15.45:0/1874319996 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd5f00a8ad0 0x7fd5f00aa550 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7fd5ec009fd0 tx=0x7fd5ec017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:55.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.824+0000 7fd5e5ffb700 1 -- 172.21.15.45:0/1874319996 <== mon.1 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5ec00b850 con 0x7fd5f00a8ad0 2023-12-22T10:01:55.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.824+0000 7fd5e5ffb700 1 -- 172.21.15.45:0/1874319996 <== mon.1 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5ec00b9b0 con 0x7fd5f00a8ad0 2023-12-22T10:01:55.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.824+0000 7fd5f6fb9700 1 -- 172.21.15.45:0/1874319996 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5f00a9790 con 0x7fd5f00a8ad0 2023-12-22T10:01:55.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.824+0000 7fd5e5ffb700 1 -- 172.21.15.45:0/1874319996 <== mon.1 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5ec01b660 con 0x7fd5f00a8ad0 2023-12-22T10:01:55.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.824+0000 7fd5f6fb9700 1 -- 172.21.15.45:0/1874319996 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5f00a9d50 con 0x7fd5f00a8ad0 2023-12-22T10:01:55.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.824+0000 7fd5f6fb9700 1 -- 172.21.15.45:0/1874319996 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5f00bc940 con 0x7fd5f00a8ad0 2023-12-22T10:01:55.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.828+0000 7fd5e5ffb700 1 -- 172.21.15.45:0/1874319996 <== mon.1 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fd5ec01ba50 con 0x7fd5f00a8ad0 2023-12-22T10:01:55.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.828+0000 7fd5e5ffb700 1 --2- 172.21.15.45:0/1874319996 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fd5d405a560 0x7fd5d405ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:55.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.828+0000 7fd5e5ffb700 1 -- 172.21.15.45:0/1874319996 <== mon.1 v2:172.21.15.113:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6660+0+0 (secure 0 0 0) 0x7fd5ec0761b0 con 0x7fd5f00a8ad0 2023-12-22T10:01:55.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.828+0000 7fd5f57b6700 1 --2- 172.21.15.45:0/1874319996 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fd5d405a560 0x7fd5d405ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:55.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.832+0000 7fd5f57b6700 1 --2- 172.21.15.45:0/1874319996 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fd5d405a560 0x7fd5d405ca20 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7fd5f015a2c0 tx=0x7fd5e0007d70).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:55.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:55.840+0000 7fd5e5ffb700 1 -- 172.21.15.45:0/1874319996 <== mon.1 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd5f00bc940 con 0x7fd5f00a8ad0 2023-12-22T10:01:56.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.048+0000 7fd5f6fb9700 1 -- 172.21.15.45:0/1874319996 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd5f00bc940 con 0x7fd5f00a8ad0 2023-12-22T10:01:56.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.048+0000 7fd5e5ffb700 1 -- 172.21.15.45:0/1874319996 <== mon.1 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+5445 (secure 0 0 0) 0x7fd5f00bc940 con 0x7fd5f00a8ad0 2023-12-22T10:01:56.047 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:01:56.047 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":21,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4925,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6836/1120392063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1120392063},{"type":"v1","addr":"172.21.15.45:6836","nonce":1120392063}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6835/2332598072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":2332598072},{"type":"v1","addr":"172.21.15.113:6835","nonce":2332598072}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5253,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/2884671415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6835","nonce":2884671415},{"type":"v1","addr":"172.21.15.45:6837","nonce":2884671415}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5284,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6833/2223286979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6832","nonce":2223286979},{"type":"v1","addr":"172.21.15.113:6833","nonce":2223286979}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":17,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T10:01:35.105595+0000","modified":"2023-12-22T10:01:46.041463+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":37,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":21,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T10:01:49.976984+0000","modified":"2023-12-22T10:01:53.149442+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[6],"metadata_pool":7,"enabled":true,"fs_name":"recovery_fs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-12-22T10:01:56.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.052+0000 7fd5f6fb9700 1 -- 172.21.15.45:0/1874319996 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fd5d405a560 msgr2=0x7fd5d405ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:56.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.052+0000 7fd5f6fb9700 1 --2- 172.21.15.45:0/1874319996 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fd5d405a560 0x7fd5d405ca20 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7fd5f015a2c0 tx=0x7fd5e0007d70).stop 2023-12-22T10:01:56.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.052+0000 7fd5f6fb9700 1 -- 172.21.15.45:0/1874319996 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd5f00a8ad0 msgr2=0x7fd5f00aa550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:56.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.052+0000 7fd5f6fb9700 1 --2- 172.21.15.45:0/1874319996 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd5f00a8ad0 0x7fd5f00aa550 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7fd5ec009fd0 tx=0x7fd5ec017000).stop 2023-12-22T10:01:56.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.052+0000 7fd5f6fb9700 1 -- 172.21.15.45:0/1874319996 shutdown_connections 2023-12-22T10:01:56.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.052+0000 7fd5f6fb9700 1 --2- 172.21.15.45:0/1874319996 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5f014f3b0 0x7fd5f00aba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:56.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.052+0000 7fd5f6fb9700 1 --2- 172.21.15.45:0/1874319996 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fd5d405a560 0x7fd5d405ca20 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:56.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.052+0000 7fd5f6fb9700 1 --2- 172.21.15.45:0/1874319996 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd5f015bb60 0x7fd5f014eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:56.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.052+0000 7fd5f6fb9700 1 --2- 172.21.15.45:0/1874319996 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd5f00a8ad0 0x7fd5f00aa550 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:56.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.052+0000 7fd5f6fb9700 1 -- 172.21.15.45:0/1874319996 >> 172.21.15.45:0/1874319996 conn(0x7fd5f0067540 msgr2=0x7fd5f006a000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:56.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.052+0000 7fd5f6fb9700 1 -- 172.21.15.45:0/1874319996 shutdown_connections 2023-12-22T10:01:56.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.052+0000 7fd5f6fb9700 1 -- 172.21.15.45:0/1874319996 wait complete. 2023-12-22T10:01:56.052 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 21 2023-12-22T10:01:56.074 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T10:01:56.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.236+0000 7febe759e700 1 Processor -- start 2023-12-22T10:01:56.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.236+0000 7febe759e700 1 -- start start 2023-12-22T10:01:56.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.240+0000 7febe759e700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7febe8150730 0x7febe8068a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:56.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.240+0000 7febe759e700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7febe80c6b70 0x7febe80c27f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:56.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.240+0000 7febe759e700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febe8068f70 con 0x7febe806a290 2023-12-22T10:01:56.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.240+0000 7febe759e700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febe80691f0 con 0x7febe8150730 2023-12-22T10:01:56.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.240+0000 7febe759e700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febe80694d0 con 0x7febe80c6b70 2023-12-22T10:01:56.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.240+0000 7febddd9b700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7febe806a290 0x7febe80c20e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:45094/0 (socket says 172.21.15.45:45094) 2023-12-22T10:01:56.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.240+0000 7febddd9b700 1 -- 172.21.15.45:0/3192117396 learned_addr learned my addr 172.21.15.45:0/3192117396 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:01:56.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.240+0000 7febe6d9d700 1 --2- 172.21.15.45:0/3192117396 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7febe80c6b70 0x7febe80c27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:56.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.240+0000 7febe659c700 1 --2- 172.21.15.45:0/3192117396 >> v2:172.21.15.113:3300/0 conn(0x7febe8150730 0x7febe8068a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:56.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.240+0000 7febe5d9b700 1 -- 172.21.15.45:0/3192117396 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3496165623 0 0) 0x7febe8068f70 con 0x7febe806a290 2023-12-22T10:01:56.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.240+0000 7febe5d9b700 1 -- 172.21.15.45:0/3192117396 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7febd40033f0 con 0x7febe806a290 2023-12-22T10:01:56.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.240+0000 7febe6d9d700 1 -- 172.21.15.45:0/3192117396 >> v2:172.21.15.113:3300/0 conn(0x7febe8150730 msgr2=0x7febe8068a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:56.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.240+0000 7febe6d9d700 1 --2- 172.21.15.45:0/3192117396 >> v2:172.21.15.113:3300/0 conn(0x7febe8150730 0x7febe8068a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:56.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.240+0000 7febe6d9d700 1 -- 172.21.15.45:0/3192117396 >> v1:172.21.15.45:6789/0 conn(0x7febe806a290 legacy=0x7febe80c20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:56.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.240+0000 7febe6d9d700 1 -- 172.21.15.45:0/3192117396 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febe80697b0 con 0x7febe80c6b70 2023-12-22T10:01:56.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.244+0000 7febe6d9d700 1 --2- 172.21.15.45:0/3192117396 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7febe80c6b70 0x7febe80c27f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7febe0009760 tx=0x7febe0009060).ready entity=mon.2 client_cookie=9ed390782c17dacb server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:56.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.244+0000 7febe5d9b700 1 -- 172.21.15.45:0/3192117396 <== mon.2 v2:172.21.15.113:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe000d4a0 con 0x7febe80c6b70 2023-12-22T10:01:56.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.244+0000 7febe5d9b700 1 -- 172.21.15.45:0/3192117396 <== mon.2 v2:172.21.15.113:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febe000d600 con 0x7febe80c6b70 2023-12-22T10:01:56.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.244+0000 7febe5d9b700 1 -- 172.21.15.45:0/3192117396 <== mon.2 v2:172.21.15.113:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe000d980 con 0x7febe80c6b70 2023-12-22T10:01:56.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.244+0000 7febe759e700 1 -- 172.21.15.45:0/3192117396 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7febe80c6b70 msgr2=0x7febe80c27f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:56.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.244+0000 7febe759e700 1 --2- 172.21.15.45:0/3192117396 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7febe80c6b70 0x7febe80c27f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7febe0009760 tx=0x7febe0009060).stop 2023-12-22T10:01:56.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.244+0000 7febe759e700 1 -- 172.21.15.45:0/3192117396 shutdown_connections 2023-12-22T10:01:56.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.244+0000 7febe759e700 1 --2- 172.21.15.45:0/3192117396 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7febe80c6b70 0x7febe80c27f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:56.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.244+0000 7febe759e700 1 --2- 172.21.15.45:0/3192117396 >> v2:172.21.15.113:3300/0 conn(0x7febe8150730 0x7febe8068a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:56.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.244+0000 7febe759e700 1 -- 172.21.15.45:0/3192117396 >> 172.21.15.45:0/3192117396 conn(0x7febe8067540 msgr2=0x7febe80c6460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:56.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.244+0000 7febe759e700 1 -- 172.21.15.45:0/3192117396 shutdown_connections 2023-12-22T10:01:56.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.244+0000 7febe759e700 1 -- 172.21.15.45:0/3192117396 wait complete. 2023-12-22T10:01:56.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.248+0000 7febe759e700 1 Processor -- start 2023-12-22T10:01:56.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.248+0000 7febe759e700 1 -- start start 2023-12-22T10:01:56.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.248+0000 7febe759e700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7febe806a290 0x7febe8146fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:56.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.248+0000 7febe759e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7febe80c6b70 0x7febe81530e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:56.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.248+0000 7febe759e700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7febe8150730 0x7febe81535d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:56.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.248+0000 7febe759e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febe8153ac0 con 0x7febe80c6b70 2023-12-22T10:01:56.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.248+0000 7febe759e700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febe8147b60 con 0x7febe806a290 2023-12-22T10:01:56.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.248+0000 7febe759e700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febe8147830 con 0x7febe8150730 2023-12-22T10:01:56.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.248+0000 7febddd9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7febe80c6b70 0x7febe81530e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:56.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.248+0000 7febddd9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7febe80c6b70 0x7febe81530e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48398/0 (socket says 172.21.15.45:48398) 2023-12-22T10:01:56.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.248+0000 7febe6d9d700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7febe8150730 0x7febe81535d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:56.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.248+0000 7febddd9b700 1 -- 172.21.15.45:0/3149347440 learned_addr learned my addr 172.21.15.45:0/3149347440 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:56.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.248+0000 7febe659c700 1 --2- 172.21.15.45:0/3149347440 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7febe806a290 0x7febe8146fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:56.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.252+0000 7febe6d9d700 1 -- 172.21.15.45:0/3149347440 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7febe806a290 msgr2=0x7febe8146fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:56.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.252+0000 7febe6d9d700 1 --2- 172.21.15.45:0/3149347440 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7febe806a290 0x7febe8146fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:56.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.252+0000 7febe6d9d700 1 -- 172.21.15.45:0/3149347440 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7febe80c6b70 msgr2=0x7febe81530e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:56.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.252+0000 7febe6d9d700 1 --2- 172.21.15.45:0/3149347440 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7febe80c6b70 0x7febe81530e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:56.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.252+0000 7febe6d9d700 1 -- 172.21.15.45:0/3149347440 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febe00092a0 con 0x7febe8150730 2023-12-22T10:01:56.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.252+0000 7febddd9b700 1 --2- 172.21.15.45:0/3149347440 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7febe80c6b70 0x7febe81530e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-12-22T10:01:56.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.252+0000 7febe6d9d700 1 --2- 172.21.15.45:0/3149347440 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7febe8150730 0x7febe81535d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7febe0013000 tx=0x7febe0016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:56.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.252+0000 7febdeffd700 1 -- 172.21.15.45:0/3149347440 <== mon.2 v2:172.21.15.113:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe000d4a0 con 0x7febe8150730 2023-12-22T10:01:56.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.252+0000 7febdeffd700 1 -- 172.21.15.45:0/3149347440 <== mon.2 v2:172.21.15.113:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febe000d770 con 0x7febe8150730 2023-12-22T10:01:56.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.252+0000 7febdeffd700 1 -- 172.21.15.45:0/3149347440 <== mon.2 v2:172.21.15.113:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe001d430 con 0x7febe8150730 2023-12-22T10:01:56.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.252+0000 7febe759e700 1 -- 172.21.15.45:0/3149347440 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febe80be3f0 con 0x7febe8150730 2023-12-22T10:01:56.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.252+0000 7febe759e700 1 -- 172.21.15.45:0/3149347440 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febe80be9b0 con 0x7febe8150730 2023-12-22T10:01:56.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.252+0000 7febe759e700 1 -- 172.21.15.45:0/3149347440 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febe8147cd0 con 0x7febe8150730 2023-12-22T10:01:56.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.256+0000 7febdeffd700 1 -- 172.21.15.45:0/3149347440 <== mon.2 v2:172.21.15.113:3301/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7febe001d7a0 con 0x7febe8150730 2023-12-22T10:01:56.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.256+0000 7febdeffd700 1 --2- 172.21.15.45:0/3149347440 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7febc805a510 0x7febc805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:56.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.256+0000 7febdeffd700 1 -- 172.21.15.45:0/3149347440 <== mon.2 v2:172.21.15.113:3301/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6660+0+0 (secure 0 0 0) 0x7febe0076180 con 0x7febe8150730 2023-12-22T10:01:56.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.256+0000 7febe659c700 1 --2- 172.21.15.45:0/3149347440 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7febc805a510 0x7febc805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:56.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.256+0000 7febe659c700 1 --2- 172.21.15.45:0/3149347440 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7febc805a510 0x7febc805c9d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7febd800f570 tx=0x7febd800b040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:56.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.264+0000 7febdeffd700 1 -- 172.21.15.45:0/3149347440 <== mon.2 v2:172.21.15.113:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7febe0049740 con 0x7febe8150730 2023-12-22T10:01:56.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.440+0000 7febe759e700 1 -- 172.21.15.45:0/3149347440 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7febe8047060 con 0x7febe8150730 2023-12-22T10:01:56.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.440+0000 7febdeffd700 1 -- 172.21.15.45:0/3149347440 <== mon.2 v2:172.21.15.113:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+18686 (secure 0 0 0) 0x7febe004cd60 con 0x7febe8150730 2023-12-22T10:01:56.441 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:01:56.441 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":44,"fsid":"98b0837e-5e68-4c8f-a1a0-e9424baaad8f","created":"2023-12-22T10:00:15.010174+0000","modified":"2023-12-22T10:01:50.986605+0000","last_up_change":"2023-12-22T10:00:24.980513+0000","last_in_change":"2023-12-22T10:00:17.887172+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-12-22T10:00:25.069641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-12-22T10:00:26.906399+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-22T10:01:33.592093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-22T10:01:34.130811+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"recovery_fs"}}},{"pool":7,"pool_name":"recovery_fs_metadata","create_time":"2023-12-22T10:01:49.073877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"recovery_fs"}}}],"osds":[{"osd":0,"uuid":"e19943a0-1c6b-47df-b6bb-383472077890","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":33777},{"type":"v1","addr":"172.21.15.45:6819","nonce":33777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":33777},{"type":"v1","addr":"172.21.15.45:6822","nonce":33777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":33777},{"type":"v1","addr":"172.21.15.45:6830","nonce":33777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":33777},{"type":"v1","addr":"172.21.15.45:6826","nonce":33777}]},"public_addr":"172.21.15.45:6819/33777","cluster_addr":"172.21.15.45:6822/33777","heartbeat_back_addr":"172.21.15.45:6830/33777","heartbeat_front_addr":"172.21.15.45:6826/33777","state":["exists","up"]},{"osd":1,"uuid":"69670f34-f082-45a7-8f67-e962acc136e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":33775},{"type":"v1","addr":"172.21.15.45:6809","nonce":33775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":33775},{"type":"v1","addr":"172.21.15.45:6811","nonce":33775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":33775},{"type":"v1","addr":"172.21.15.45:6815","nonce":33775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":33775},{"type":"v1","addr":"172.21.15.45:6813","nonce":33775}]},"public_addr":"172.21.15.45:6809/33775","cluster_addr":"172.21.15.45:6811/33775","heartbeat_back_addr":"172.21.15.45:6815/33775","heartbeat_front_addr":"172.21.15.45:6813/33775","state":["exists","up"]},{"osd":2,"uuid":"d909d49b-82b8-401b-9947-e49dd167bb95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":33776},{"type":"v1","addr":"172.21.15.45:6801","nonce":33776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":33776},{"type":"v1","addr":"172.21.15.45:6803","nonce":33776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":33776},{"type":"v1","addr":"172.21.15.45:6807","nonce":33776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":33776},{"type":"v1","addr":"172.21.15.45:6805","nonce":33776}]},"public_addr":"172.21.15.45:6801/33776","cluster_addr":"172.21.15.45:6803/33776","heartbeat_back_addr":"172.21.15.45:6807/33776","heartbeat_front_addr":"172.21.15.45:6805/33776","state":["exists","up"]},{"osd":3,"uuid":"db104ca9-3a94-4d39-a2be-bd06db888095","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":33782},{"type":"v1","addr":"172.21.15.45:6817","nonce":33782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":33782},{"type":"v1","addr":"172.21.15.45:6823","nonce":33782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":33782},{"type":"v1","addr":"172.21.15.45:6831","nonce":33782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":33782},{"type":"v1","addr":"172.21.15.45:6827","nonce":33782}]},"public_addr":"172.21.15.45:6817/33782","cluster_addr":"172.21.15.45:6823/33782","heartbeat_back_addr":"172.21.15.45:6831/33782","heartbeat_front_addr":"172.21.15.45:6827/33782","state":["exists","up"]},{"osd":4,"uuid":"9f4eaff4-e433-4479-a0d1-ee7a33375ca6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":34099},{"type":"v1","addr":"172.21.15.113:6811","nonce":34099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":34099},{"type":"v1","addr":"172.21.15.113:6815","nonce":34099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":34099},{"type":"v1","addr":"172.21.15.113:6823","nonce":34099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6816","nonce":34099},{"type":"v1","addr":"172.21.15.113:6818","nonce":34099}]},"public_addr":"172.21.15.113:6811/34099","cluster_addr":"172.21.15.113:6815/34099","heartbeat_back_addr":"172.21.15.113:6823/34099","heartbeat_front_addr":"172.21.15.113:6818/34099","state":["exists","up"]},{"osd":5,"uuid":"1efc5591-180b-43af-8611-0068aadc5aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":34100},{"type":"v1","addr":"172.21.15.113:6801","nonce":34100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":34100},{"type":"v1","addr":"172.21.15.113:6803","nonce":34100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":34100},{"type":"v1","addr":"172.21.15.113:6807","nonce":34100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":34100},{"type":"v1","addr":"172.21.15.113:6805","nonce":34100}]},"public_addr":"172.21.15.113:6801/34100","cluster_addr":"172.21.15.113:6803/34100","heartbeat_back_addr":"172.21.15.113:6807/34100","heartbeat_front_addr":"172.21.15.113:6805/34100","state":["exists","up"]},{"osd":6,"uuid":"6c89d9d8-c153-4a48-afa9-97e4c403f1ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":34101},{"type":"v1","addr":"172.21.15.113:6810","nonce":34101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6812","nonce":34101},{"type":"v1","addr":"172.21.15.113:6814","nonce":34101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6822","nonce":34101},{"type":"v1","addr":"172.21.15.113:6824","nonce":34101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":34101},{"type":"v1","addr":"172.21.15.113:6819","nonce":34101}]},"public_addr":"172.21.15.113:6810/34101","cluster_addr":"172.21.15.113:6814/34101","heartbeat_back_addr":"172.21.15.113:6824/34101","heartbeat_front_addr":"172.21.15.113:6819/34101","state":["exists","up"]},{"osd":7,"uuid":"1855e70c-23f6-4c08-ad7f-774c2148235b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6821","nonce":34102},{"type":"v1","addr":"172.21.15.113:6825","nonce":34102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":34102},{"type":"v1","addr":"172.21.15.113:6827","nonce":34102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":34102},{"type":"v1","addr":"172.21.15.113:6831","nonce":34102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6828","nonce":34102},{"type":"v1","addr":"172.21.15.113:6829","nonce":34102}]},"public_addr":"172.21.15.113:6825/34102","cluster_addr":"172.21.15.113:6827/34102","heartbeat_back_addr":"172.21.15.113:6831/34102","heartbeat_front_addr":"172.21.15.113:6829/34102","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.812672+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.825045+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.700105+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.856563+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.954683+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.883234+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.883994+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.821686+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.45:6835/1879154206":"2023-12-23T10:01:45.243059+0000","172.21.15.45:6834/1879154206":"2023-12-23T10:01:45.243059+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T10:01:56.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.444+0000 7febe759e700 1 -- 172.21.15.45:0/3149347440 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7febc805a510 msgr2=0x7febc805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:56.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.444+0000 7febe759e700 1 --2- 172.21.15.45:0/3149347440 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7febc805a510 0x7febc805c9d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7febd800f570 tx=0x7febd800b040).stop 2023-12-22T10:01:56.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.444+0000 7febe759e700 1 -- 172.21.15.45:0/3149347440 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7febe8150730 msgr2=0x7febe81535d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:56.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.444+0000 7febe759e700 1 --2- 172.21.15.45:0/3149347440 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7febe8150730 0x7febe81535d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7febe0013000 tx=0x7febe0016000).stop 2023-12-22T10:01:56.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.444+0000 7febe759e700 1 -- 172.21.15.45:0/3149347440 shutdown_connections 2023-12-22T10:01:56.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.444+0000 7febe759e700 1 --2- 172.21.15.45:0/3149347440 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7febc805a510 0x7febc805c9d0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:56.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.444+0000 7febe759e700 1 --2- 172.21.15.45:0/3149347440 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7febe8150730 0x7febe81535d0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:56.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.444+0000 7febe759e700 1 --2- 172.21.15.45:0/3149347440 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7febe80c6b70 0x7febe81530e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:56.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.444+0000 7febe759e700 1 --2- 172.21.15.45:0/3149347440 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7febe806a290 0x7febe8146fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:56.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.444+0000 7febe759e700 1 -- 172.21.15.45:0/3149347440 >> 172.21.15.45:0/3149347440 conn(0x7febe8067540 msgr2=0x7febe8149ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:56.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.444+0000 7febe759e700 1 -- 172.21.15.45:0/3149347440 shutdown_connections 2023-12-22T10:01:56.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.444+0000 7febe759e700 1 -- 172.21.15.45:0/3149347440 wait complete. 2023-12-22T10:01:56.465 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-12-22T10:00:25.069641+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-12-22T10:00:26.906399+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-22T10:01:33.592093+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-12-22T10:01:34.130811+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'recovery_fs'}}}, {'pool': 7, 'pool_name': 'recovery_fs_metadata', 'create_time': '2023-12-22T10:01:49.073877+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'recovery_fs'}}}] 2023-12-22T10:01:56.466 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-12-22T10:01:56.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.636+0000 7f4c450db700 1 Processor -- start 2023-12-22T10:01:56.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.636+0000 7f4c450db700 1 -- start start 2023-12-22T10:01:56.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.636+0000 7f4c450db700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4c400c5900 0x7f4c400ac6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:56.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.636+0000 7f4c450db700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f4c400aa660 0x7f4c400c7430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:56.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.636+0000 7f4c450db700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c400c8d50 con 0x7f4c400ac2d0 2023-12-22T10:01:56.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.636+0000 7f4c450db700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c400c95f0 con 0x7f4c400c5900 2023-12-22T10:01:56.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.636+0000 7f4c450db700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c400aaaf0 con 0x7f4c400aa660 2023-12-22T10:01:56.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.636+0000 7f4c3e59c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4c400c5900 0x7f4c400ac6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:56.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.636+0000 7f4c3e59c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4c400c5900 0x7f4c400ac6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48404/0 (socket says 172.21.15.45:48404) 2023-12-22T10:01:56.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.636+0000 7f4c3e59c700 1 -- 172.21.15.45:0/1563665040 learned_addr learned my addr 172.21.15.45:0/1563665040 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:56.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.640+0000 7f4c3f59e700 1 --2- 172.21.15.45:0/1563665040 >> v2:172.21.15.113:3300/0 conn(0x7f4c400aa660 0x7f4c400c7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:56.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.640+0000 7f4c3e59c700 1 -- 172.21.15.45:0/1563665040 >> v2:172.21.15.113:3300/0 conn(0x7f4c400aa660 msgr2=0x7f4c400c7430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:56.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.640+0000 7f4c3e59c700 1 --2- 172.21.15.45:0/1563665040 >> v2:172.21.15.113:3300/0 conn(0x7f4c400aa660 0x7f4c400c7430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:56.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.640+0000 7f4c3e59c700 1 -- 172.21.15.45:0/1563665040 >> v1:172.21.15.45:6789/0 conn(0x7f4c400ac2d0 legacy=0x7f4c40158050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:56.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.640+0000 7f4c3e59c700 1 -- 172.21.15.45:0/1563665040 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c400c5ee0 con 0x7f4c400c5900 2023-12-22T10:01:56.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.640+0000 7f4c3f59e700 1 --2- 172.21.15.45:0/1563665040 >> v2:172.21.15.113:3300/0 conn(0x7f4c400aa660 0x7f4c400c7430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-12-22T10:01:56.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.640+0000 7f4c3e59c700 1 --2- 172.21.15.45:0/1563665040 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c400c5900 0x7f4c400ac6b0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 rx=0x7f4c40154070 tx=0x7f4c340090f0).ready entity=mon.0 client_cookie=6375d8f30e16bd82 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:56.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.640+0000 7f4c3dd9b700 1 -- 172.21.15.45:0/1563665040 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c3400b600 con 0x7f4c400c5900 2023-12-22T10:01:56.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.640+0000 7f4c3dd9b700 1 -- 172.21.15.45:0/1563665040 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c3400b760 con 0x7f4c400c5900 2023-12-22T10:01:56.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.640+0000 7f4c3dd9b700 1 -- 172.21.15.45:0/1563665040 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c3400bae0 con 0x7f4c400c5900 2023-12-22T10:01:56.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.640+0000 7f4c450db700 1 -- 172.21.15.45:0/1563665040 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c400c5900 msgr2=0x7f4c400ac6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:56.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.640+0000 7f4c450db700 1 --2- 172.21.15.45:0/1563665040 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c400c5900 0x7f4c400ac6b0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 rx=0x7f4c40154070 tx=0x7f4c340090f0).stop 2023-12-22T10:01:56.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.640+0000 7f4c450db700 1 -- 172.21.15.45:0/1563665040 shutdown_connections 2023-12-22T10:01:56.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.640+0000 7f4c450db700 1 --2- 172.21.15.45:0/1563665040 >> v2:172.21.15.113:3300/0 conn(0x7f4c400aa660 0x7f4c400c7430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:56.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.640+0000 7f4c450db700 1 --2- 172.21.15.45:0/1563665040 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c400c5900 0x7f4c400ac6b0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:56.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.640+0000 7f4c450db700 1 -- 172.21.15.45:0/1563665040 >> 172.21.15.45:0/1563665040 conn(0x7f4c40082a50 msgr2=0x7f4c40066a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:56.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.640+0000 7f4c450db700 1 -- 172.21.15.45:0/1563665040 shutdown_connections 2023-12-22T10:01:56.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.640+0000 7f4c450db700 1 -- 172.21.15.45:0/1563665040 wait complete. 2023-12-22T10:01:56.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.644+0000 7f4c450db700 1 Processor -- start 2023-12-22T10:01:56.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.644+0000 7f4c450db700 1 -- start start 2023-12-22T10:01:56.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.644+0000 7f4c450db700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4c400aa660 0x7f4c40153690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:56.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.644+0000 7f4c450db700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f4c400ac2d0 0x7f4c40152eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:56.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.644+0000 7f4c450db700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c400c5900 0x7f4c400c7430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:56.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.644+0000 7f4c450db700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c4015a640 con 0x7f4c400c5900 2023-12-22T10:01:56.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.644+0000 7f4c450db700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c400a94d0 con 0x7f4c400aa660 2023-12-22T10:01:56.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.644+0000 7f4c450db700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c400a9910 con 0x7f4c400ac2d0 2023-12-22T10:01:56.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.648+0000 7f4c3f59e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c400c5900 0x7f4c400c7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:56.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.648+0000 7f4c3f59e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c400c5900 0x7f4c400c7430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48418/0 (socket says 172.21.15.45:48418) 2023-12-22T10:01:56.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.648+0000 7f4c3f59e700 1 -- 172.21.15.45:0/139741623 learned_addr learned my addr 172.21.15.45:0/139741623 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:56.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.648+0000 7f4c3e59c700 1 --2- 172.21.15.45:0/139741623 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f4c400ac2d0 0x7f4c40152eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:56.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.648+0000 7f4c3ed9d700 1 --2- 172.21.15.45:0/139741623 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4c400aa660 0x7f4c40153690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:56.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.648+0000 7f4c3f59e700 1 -- 172.21.15.45:0/139741623 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f4c400ac2d0 msgr2=0x7f4c40152eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:56.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.648+0000 7f4c3f59e700 1 --2- 172.21.15.45:0/139741623 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f4c400ac2d0 0x7f4c40152eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:56.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.648+0000 7f4c3f59e700 1 -- 172.21.15.45:0/139741623 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4c400aa660 msgr2=0x7f4c40153690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:56.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.648+0000 7f4c3f59e700 1 --2- 172.21.15.45:0/139741623 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4c400aa660 0x7f4c40153690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:56.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.648+0000 7f4c3f59e700 1 -- 172.21.15.45:0/139741623 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c34009370 con 0x7f4c400c5900 2023-12-22T10:01:56.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.648+0000 7f4c3e59c700 1 --2- 172.21.15.45:0/139741623 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f4c400ac2d0 0x7f4c40152eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-12-22T10:01:56.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.648+0000 7f4c3ed9d700 1 --2- 172.21.15.45:0/139741623 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4c400aa660 0x7f4c40153690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-12-22T10:01:56.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.648+0000 7f4c3f59e700 1 --2- 172.21.15.45:0/139741623 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c400c5900 0x7f4c400c7430 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 rx=0x7f4c3800a380 tx=0x7f4c38007900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:56.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.648+0000 7f4c26ffd700 1 -- 172.21.15.45:0/139741623 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c38016470 con 0x7f4c400c5900 2023-12-22T10:01:56.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.648+0000 7f4c26ffd700 1 -- 172.21.15.45:0/139741623 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c380165d0 con 0x7f4c400c5900 2023-12-22T10:01:56.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.648+0000 7f4c26ffd700 1 -- 172.21.15.45:0/139741623 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c38016950 con 0x7f4c400c5900 2023-12-22T10:01:56.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.648+0000 7f4c450db700 1 -- 172.21.15.45:0/139741623 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c40153b80 con 0x7f4c400c5900 2023-12-22T10:01:56.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.648+0000 7f4c450db700 1 -- 172.21.15.45:0/139741623 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c40159ca0 con 0x7f4c400c5900 2023-12-22T10:01:56.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.648+0000 7f4c450db700 1 -- 172.21.15.45:0/139741623 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c4006c070 con 0x7f4c400c5900 2023-12-22T10:01:56.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.652+0000 7f4c26ffd700 1 -- 172.21.15.45:0/139741623 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f4c38013070 con 0x7f4c400c5900 2023-12-22T10:01:56.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.652+0000 7f4c26ffd700 1 --2- 172.21.15.45:0/139741623 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f4c2c05a510 0x7f4c2c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:56.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.652+0000 7f4c26ffd700 1 -- 172.21.15.45:0/139741623 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6660+0+0 (secure 0 0 0) 0x7f4c38075750 con 0x7f4c400c5900 2023-12-22T10:01:56.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.652+0000 7f4c3ed9d700 1 --2- 172.21.15.45:0/139741623 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f4c2c05a510 0x7f4c2c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:56.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.656+0000 7f4c3ed9d700 1 --2- 172.21.15.45:0/139741623 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f4c2c05a510 0x7f4c2c05c9d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f4c30001c40 tx=0x7f4c30009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:56.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.660+0000 7f4c26ffd700 1 -- 172.21.15.45:0/139741623 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f4c38048c50 con 0x7f4c400c5900 2023-12-22T10:01:56.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.824+0000 7f4c450db700 1 -- 172.21.15.45:0/139741623 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f4c400c8750 con 0x7f4c400c5900 2023-12-22T10:01:56.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.828+0000 7f4c26ffd700 1 -- 172.21.15.45:0/139741623 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v44) v1 ==== 110+0+10 (secure 0 0 0) 0x7f4c3804c270 con 0x7f4c400c5900 2023-12-22T10:01:56.826 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-12-22T10:01:56.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.832+0000 7f4c450db700 1 -- 172.21.15.45:0/139741623 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f4c2c05a510 msgr2=0x7f4c2c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:56.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.832+0000 7f4c450db700 1 --2- 172.21.15.45:0/139741623 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f4c2c05a510 0x7f4c2c05c9d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f4c30001c40 tx=0x7f4c30009040).stop 2023-12-22T10:01:56.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.832+0000 7f4c450db700 1 -- 172.21.15.45:0/139741623 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c400c5900 msgr2=0x7f4c400c7430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:56.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.832+0000 7f4c450db700 1 --2- 172.21.15.45:0/139741623 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c400c5900 0x7f4c400c7430 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 rx=0x7f4c3800a380 tx=0x7f4c38007900).stop 2023-12-22T10:01:56.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.832+0000 7f4c450db700 1 -- 172.21.15.45:0/139741623 shutdown_connections 2023-12-22T10:01:56.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.832+0000 7f4c450db700 1 --2- 172.21.15.45:0/139741623 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c400c5900 0x7f4c400c7430 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:56.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.832+0000 7f4c450db700 1 --2- 172.21.15.45:0/139741623 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f4c2c05a510 0x7f4c2c05c9d0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:56.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.832+0000 7f4c450db700 1 --2- 172.21.15.45:0/139741623 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f4c400ac2d0 0x7f4c40152eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:56.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.832+0000 7f4c450db700 1 --2- 172.21.15.45:0/139741623 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4c400aa660 0x7f4c40153690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:56.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.832+0000 7f4c450db700 1 -- 172.21.15.45:0/139741623 >> 172.21.15.45:0/139741623 conn(0x7f4c40082a50 msgr2=0x7f4c400ca7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:56.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.832+0000 7f4c450db700 1 -- 172.21.15.45:0/139741623 shutdown_connections 2023-12-22T10:01:56.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:56.832+0000 7f4c450db700 1 -- 172.21.15.45:0/139741623 wait complete. 2023-12-22T10:01:56.858 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-12-22T10:01:57.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.036+0000 7fb055569700 1 Processor -- start 2023-12-22T10:01:57.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.036+0000 7fb055569700 1 -- start start 2023-12-22T10:01:57.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.040+0000 7fb055569700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0500c1010 0x7fb0500c0130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:57.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.040+0000 7fb055569700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb0501541b0 0x7fb0500c5790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:57.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.040+0000 7fb055569700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0500aa200 con 0x7fb0500c13f0 2023-12-22T10:01:57.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.040+0000 7fb055569700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb050151d10 con 0x7fb0501541b0 2023-12-22T10:01:57.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.040+0000 7fb055569700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb050154730 con 0x7fb0500c1010 2023-12-22T10:01:57.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.040+0000 7fb04f7fe700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb0501541b0 0x7fb0500c5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:57.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.040+0000 7fb04effd700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb0500c1010 0x7fb0500c0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:57.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.040+0000 7fb04f7fe700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb0501541b0 0x7fb0500c5790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48420/0 (socket says 172.21.15.45:48420) 2023-12-22T10:01:57.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.040+0000 7fb04f7fe700 1 -- 172.21.15.45:0/3238809448 learned_addr learned my addr 172.21.15.45:0/3238809448 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:57.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.040+0000 7fb04f7fe700 1 -- 172.21.15.45:0/3238809448 >> v2:172.21.15.113:3300/0 conn(0x7fb0500c1010 msgr2=0x7fb0500c0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:57.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.040+0000 7fb04f7fe700 1 --2- 172.21.15.45:0/3238809448 >> v2:172.21.15.113:3300/0 conn(0x7fb0500c1010 0x7fb0500c0130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:57.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.040+0000 7fb04f7fe700 1 -- 172.21.15.45:0/3238809448 >> v1:172.21.15.113:6789/0 conn(0x7fb0500c13f0 legacy=0x7fb0500a9af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:57.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.040+0000 7fb04f7fe700 1 -- 172.21.15.45:0/3238809448 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb050154a10 con 0x7fb0501541b0 2023-12-22T10:01:57.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.040+0000 7fb04f7fe700 1 --2- 172.21.15.45:0/3238809448 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb0501541b0 0x7fb0500c5790 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 rx=0x7fb05005f090 tx=0x7fb048009840).ready entity=mon.0 client_cookie=fe2c3be61b741afc server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:57.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.044+0000 7fb04dffb700 1 -- 172.21.15.45:0/3238809448 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb04800e070 con 0x7fb0501541b0 2023-12-22T10:01:57.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.044+0000 7fb04dffb700 1 -- 172.21.15.45:0/3238809448 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb04800ba20 con 0x7fb0501541b0 2023-12-22T10:01:57.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.044+0000 7fb04dffb700 1 -- 172.21.15.45:0/3238809448 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb04800bda0 con 0x7fb0501541b0 2023-12-22T10:01:57.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.044+0000 7fb055569700 1 -- 172.21.15.45:0/3238809448 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb0501541b0 msgr2=0x7fb0500c5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:57.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.044+0000 7fb055569700 1 --2- 172.21.15.45:0/3238809448 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb0501541b0 0x7fb0500c5790 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 rx=0x7fb05005f090 tx=0x7fb048009840).stop 2023-12-22T10:01:57.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.044+0000 7fb055569700 1 -- 172.21.15.45:0/3238809448 shutdown_connections 2023-12-22T10:01:57.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.044+0000 7fb055569700 1 --2- 172.21.15.45:0/3238809448 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb0501541b0 0x7fb0500c5790 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:57.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.044+0000 7fb055569700 1 --2- 172.21.15.45:0/3238809448 >> v2:172.21.15.113:3300/0 conn(0x7fb0500c1010 0x7fb0500c0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:57.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.044+0000 7fb055569700 1 -- 172.21.15.45:0/3238809448 >> 172.21.15.45:0/3238809448 conn(0x7fb050066a70 msgr2=0x7fb050066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:57.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.044+0000 7fb055569700 1 -- 172.21.15.45:0/3238809448 shutdown_connections 2023-12-22T10:01:57.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.044+0000 7fb055569700 1 -- 172.21.15.45:0/3238809448 wait complete. 2023-12-22T10:01:57.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.048+0000 7fb055569700 1 Processor -- start 2023-12-22T10:01:57.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.048+0000 7fb055569700 1 -- start start 2023-12-22T10:01:57.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.048+0000 7fb055569700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb0500c1010 0x7fb0500adc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:57.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.048+0000 7fb055569700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb0500c13f0 0x7fb050167170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:57.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.048+0000 7fb055569700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb0501541b0 0x7fb0501642e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:57.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.048+0000 7fb055569700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0500abaf0 con 0x7fb0500c1010 2023-12-22T10:01:57.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.048+0000 7fb055569700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0500abdd0 con 0x7fb0501541b0 2023-12-22T10:01:57.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.048+0000 7fb055569700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb050167660 con 0x7fb0500c13f0 2023-12-22T10:01:57.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.048+0000 7fb04effd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb0500c1010 0x7fb0500adc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:57.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.052+0000 7fb04effd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb0500c1010 0x7fb0500adc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48426/0 (socket says 172.21.15.45:48426) 2023-12-22T10:01:57.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.052+0000 7fb04effd700 1 -- 172.21.15.45:0/419018010 learned_addr learned my addr 172.21.15.45:0/419018010 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:57.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.052+0000 7fb04f7fe700 1 --2- 172.21.15.45:0/419018010 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb0501541b0 0x7fb0501642e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:57.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.052+0000 7fb04e7fc700 1 --2- 172.21.15.45:0/419018010 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb0500c13f0 0x7fb050167170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:57.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.052+0000 7fb04effd700 1 -- 172.21.15.45:0/419018010 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb0500c13f0 msgr2=0x7fb050167170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:57.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.052+0000 7fb04effd700 1 --2- 172.21.15.45:0/419018010 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb0500c13f0 0x7fb050167170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:57.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.052+0000 7fb04effd700 1 -- 172.21.15.45:0/419018010 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb0501541b0 msgr2=0x7fb0501642e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:57.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.052+0000 7fb04effd700 1 --2- 172.21.15.45:0/419018010 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb0501541b0 0x7fb0501642e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:57.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.052+0000 7fb04effd700 1 -- 172.21.15.45:0/419018010 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb048009ae0 con 0x7fb0500c1010 2023-12-22T10:01:57.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.052+0000 7fb04effd700 1 --2- 172.21.15.45:0/419018010 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb0500c1010 0x7fb0500adc20 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7fb04000e960 tx=0x7fb040009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:57.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.052+0000 7fb036ffd700 1 -- 172.21.15.45:0/419018010 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb040012600 con 0x7fb0500c1010 2023-12-22T10:01:57.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.052+0000 7fb055569700 1 -- 172.21.15.45:0/419018010 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb050164b10 con 0x7fb0500c1010 2023-12-22T10:01:57.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.052+0000 7fb036ffd700 1 -- 172.21.15.45:0/419018010 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb040012760 con 0x7fb0500c1010 2023-12-22T10:01:57.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.052+0000 7fb036ffd700 1 -- 172.21.15.45:0/419018010 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb040012ae0 con 0x7fb0500c1010 2023-12-22T10:01:57.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.052+0000 7fb055569700 1 -- 172.21.15.45:0/419018010 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0501650d0 con 0x7fb0500c1010 2023-12-22T10:01:57.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.052+0000 7fb055569700 1 -- 172.21.15.45:0/419018010 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb050047060 con 0x7fb0500c1010 2023-12-22T10:01:57.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.056+0000 7fb036ffd700 1 -- 172.21.15.45:0/419018010 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fb04001b400 con 0x7fb0500c1010 2023-12-22T10:01:57.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.056+0000 7fb036ffd700 1 --2- 172.21.15.45:0/419018010 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fb03c05a510 0x7fb03c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:57.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.056+0000 7fb036ffd700 1 -- 172.21.15.45:0/419018010 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6660+0+0 (secure 0 0 0) 0x7fb040074f30 con 0x7fb0500c1010 2023-12-22T10:01:57.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.056+0000 7fb04e7fc700 1 --2- 172.21.15.45:0/419018010 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fb03c05a510 0x7fb03c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:57.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.056+0000 7fb04e7fc700 1 --2- 172.21.15.45:0/419018010 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fb03c05a510 0x7fb03c05c9d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7fb05014dbc0 tx=0x7fb044007d40).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:57.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.060+0000 7fb036ffd700 1 -- 172.21.15.45:0/419018010 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb0400483d0 con 0x7fb0500c1010 2023-12-22T10:01:57.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.232+0000 7fb055569700 1 -- 172.21.15.45:0/419018010 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb050154cf0 con 0x7fb0500c1010 2023-12-22T10:01:57.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.232+0000 7fb036ffd700 1 -- 172.21.15.45:0/419018010 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v44) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb04004b9f0 con 0x7fb0500c1010 2023-12-22T10:01:57.232 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-12-22T10:01:57.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.236+0000 7fb055569700 1 -- 172.21.15.45:0/419018010 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fb03c05a510 msgr2=0x7fb03c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:57.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.236+0000 7fb055569700 1 --2- 172.21.15.45:0/419018010 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fb03c05a510 0x7fb03c05c9d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7fb05014dbc0 tx=0x7fb044007d40).stop 2023-12-22T10:01:57.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.236+0000 7fb055569700 1 -- 172.21.15.45:0/419018010 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb0500c1010 msgr2=0x7fb0500adc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:57.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.236+0000 7fb055569700 1 --2- 172.21.15.45:0/419018010 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb0500c1010 0x7fb0500adc20 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7fb04000e960 tx=0x7fb040009060).stop 2023-12-22T10:01:57.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.236+0000 7fb055569700 1 -- 172.21.15.45:0/419018010 shutdown_connections 2023-12-22T10:01:57.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.236+0000 7fb055569700 1 --2- 172.21.15.45:0/419018010 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb0501541b0 0x7fb0501642e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:57.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.236+0000 7fb055569700 1 --2- 172.21.15.45:0/419018010 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fb03c05a510 0x7fb03c05c9d0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:57.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.236+0000 7fb055569700 1 --2- 172.21.15.45:0/419018010 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb0500c13f0 0x7fb050167170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:57.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.236+0000 7fb055569700 1 --2- 172.21.15.45:0/419018010 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb0500c1010 0x7fb0500adc20 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:57.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.236+0000 7fb055569700 1 -- 172.21.15.45:0/419018010 >> 172.21.15.45:0/419018010 conn(0x7fb050066a70 msgr2=0x7fb0501558e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:57.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.236+0000 7fb055569700 1 -- 172.21.15.45:0/419018010 shutdown_connections 2023-12-22T10:01:57.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.236+0000 7fb055569700 1 -- 172.21.15.45:0/419018010 wait complete. 2023-12-22T10:01:57.256 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-22T10:01:57.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.420+0000 7f289b59e700 1 Processor -- start 2023-12-22T10:01:57.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.420+0000 7f289b59e700 1 -- start start 2023-12-22T10:01:57.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.424+0000 7f289b59e700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f289c0acca0 0x7f289c0ad080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:57.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.424+0000 7f289b59e700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f289c0c9d20 0x7f289c0c97e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:57.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.424+0000 7f289b59e700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f289c0c5810 con 0x7f289c0ca230 2023-12-22T10:01:57.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.424+0000 7f289b59e700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f289c0c8d90 con 0x7f289c0c9d20 2023-12-22T10:01:57.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.424+0000 7f289b59e700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f289c0c9350 con 0x7f289c0acca0 2023-12-22T10:01:57.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.424+0000 7f2893fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f289c0c9d20 0x7f289c0c97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:57.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.424+0000 7f2893fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f289c0c9d20 0x7f289c0c97e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48436/0 (socket says 172.21.15.45:48436) 2023-12-22T10:01:57.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.424+0000 7f2893fff700 1 -- 172.21.15.45:0/56045605 learned_addr learned my addr 172.21.15.45:0/56045605 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:57.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.424+0000 7f289a59c700 1 --2- 172.21.15.45:0/56045605 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f289c0acca0 0x7f289c0ad080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:57.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.424+0000 7f2893fff700 1 -- 172.21.15.45:0/56045605 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f289c0acca0 msgr2=0x7f289c0ad080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:57.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.424+0000 7f2893fff700 1 --2- 172.21.15.45:0/56045605 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f289c0acca0 0x7f289c0ad080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:57.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.424+0000 7f2893fff700 1 -- 172.21.15.45:0/56045605 >> v1:172.21.15.45:6789/0 conn(0x7f289c0ca230 legacy=0x7f289c068ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:57.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.424+0000 7f2893fff700 1 -- 172.21.15.45:0/56045605 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f289c154070 con 0x7f289c0c9d20 2023-12-22T10:01:57.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.424+0000 7f2893fff700 1 --2- 172.21.15.45:0/56045605 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f289c0c9d20 0x7f289c0c97e0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0x7f2884006fd0 tx=0x7f28840090f0).ready entity=mon.0 client_cookie=6f4e4b8c3d4c34e2 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:57.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.424+0000 7f2899d9b700 1 -- 172.21.15.45:0/56045605 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f288400b600 con 0x7f289c0c9d20 2023-12-22T10:01:57.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.424+0000 7f2899d9b700 1 -- 172.21.15.45:0/56045605 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f288400b760 con 0x7f289c0c9d20 2023-12-22T10:01:57.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.424+0000 7f2899d9b700 1 -- 172.21.15.45:0/56045605 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f288400bae0 con 0x7f289c0c9d20 2023-12-22T10:01:57.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.424+0000 7f289b59e700 1 -- 172.21.15.45:0/56045605 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f289c0c9d20 msgr2=0x7f289c0c97e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:57.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.424+0000 7f289b59e700 1 --2- 172.21.15.45:0/56045605 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f289c0c9d20 0x7f289c0c97e0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0x7f2884006fd0 tx=0x7f28840090f0).stop 2023-12-22T10:01:57.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.424+0000 7f289b59e700 1 -- 172.21.15.45:0/56045605 shutdown_connections 2023-12-22T10:01:57.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.424+0000 7f289b59e700 1 --2- 172.21.15.45:0/56045605 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f289c0c9d20 0x7f289c0c97e0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:57.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.424+0000 7f289b59e700 1 --2- 172.21.15.45:0/56045605 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f289c0acca0 0x7f289c0ad080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:57.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.424+0000 7f289b59e700 1 -- 172.21.15.45:0/56045605 >> 172.21.15.45:0/56045605 conn(0x7f289c0674f0 msgr2=0x7f289c0ca820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:57.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.424+0000 7f289b59e700 1 -- 172.21.15.45:0/56045605 shutdown_connections 2023-12-22T10:01:57.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.424+0000 7f289b59e700 1 -- 172.21.15.45:0/56045605 wait complete. 2023-12-22T10:01:57.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.428+0000 7f289b59e700 1 Processor -- start 2023-12-22T10:01:57.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.428+0000 7f289b59e700 1 -- start start 2023-12-22T10:01:57.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.428+0000 7f289b59e700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f289c0acca0 0x7f289c0ae960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:57.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.428+0000 7f289b59e700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f289c0c9d20 0x7f289c0aee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:57.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.428+0000 7f289b59e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f289c0ca230 0x7f289c0ad970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:57.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.428+0000 7f289b59e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f289c0af340 con 0x7f289c0ca230 2023-12-22T10:01:57.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.428+0000 7f289b59e700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f289c0c2840 con 0x7f289c0c9d20 2023-12-22T10:01:57.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.428+0000 7f289b59e700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f289c0c1c30 con 0x7f289c0acca0 2023-12-22T10:01:57.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.428+0000 7f289ad9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f289c0ca230 0x7f289c0ad970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:57.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.428+0000 7f289a59c700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f289c0acca0 0x7f289c0ae960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:57.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.428+0000 7f289ad9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f289c0ca230 0x7f289c0ad970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48444/0 (socket says 172.21.15.45:48444) 2023-12-22T10:01:57.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.428+0000 7f289a59c700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f289c0acca0 0x7f289c0ae960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.113:3301/0 says I am v2:172.21.15.45:48232/0 (socket says 172.21.15.45:48232) 2023-12-22T10:01:57.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.428+0000 7f2893fff700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f289c0c9d20 0x7f289c0aee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:57.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.428+0000 7f289ad9d700 1 -- 172.21.15.45:0/1290146714 learned_addr learned my addr 172.21.15.45:0/1290146714 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:57.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.432+0000 7f289ad9d700 1 -- 172.21.15.45:0/1290146714 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f289c0acca0 msgr2=0x7f289c0ae960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:57.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.432+0000 7f289ad9d700 1 --2- 172.21.15.45:0/1290146714 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f289c0acca0 0x7f289c0ae960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:57.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.432+0000 7f289ad9d700 1 -- 172.21.15.45:0/1290146714 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f289c0c9d20 msgr2=0x7f289c0aee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:57.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.432+0000 7f289ad9d700 1 --2- 172.21.15.45:0/1290146714 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f289c0c9d20 0x7f289c0aee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:57.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.432+0000 7f289ad9d700 1 -- 172.21.15.45:0/1290146714 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2884009370 con 0x7f289c0ca230 2023-12-22T10:01:57.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.432+0000 7f289ad9d700 1 --2- 172.21.15.45:0/1290146714 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f289c0ca230 0x7f289c0ad970 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7f289400c440 tx=0x7f2894007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:57.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.432+0000 7f28927fc700 1 -- 172.21.15.45:0/1290146714 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28940123f0 con 0x7f289c0ca230 2023-12-22T10:01:57.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.432+0000 7f28927fc700 1 -- 172.21.15.45:0/1290146714 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2894001e90 con 0x7f289c0ca230 2023-12-22T10:01:57.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.432+0000 7f28927fc700 1 -- 172.21.15.45:0/1290146714 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2894012760 con 0x7f289c0ca230 2023-12-22T10:01:57.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.432+0000 7f289b59e700 1 -- 172.21.15.45:0/1290146714 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f289c0c1f10 con 0x7f289c0ca230 2023-12-22T10:01:57.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.432+0000 7f289b59e700 1 -- 172.21.15.45:0/1290146714 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f289c0c24d0 con 0x7f289c0ca230 2023-12-22T10:01:57.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.432+0000 7f289b59e700 1 -- 172.21.15.45:0/1290146714 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f289c0c29d0 con 0x7f289c0ca230 2023-12-22T10:01:57.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.436+0000 7f28927fc700 1 -- 172.21.15.45:0/1290146714 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f2894012b50 con 0x7f289c0ca230 2023-12-22T10:01:57.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.436+0000 7f28927fc700 1 --2- 172.21.15.45:0/1290146714 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f287c05a510 0x7f287c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:57.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.436+0000 7f28927fc700 1 -- 172.21.15.45:0/1290146714 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6660+0+0 (secure 0 0 0) 0x7f2894073de0 con 0x7f289c0ca230 2023-12-22T10:01:57.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.436+0000 7f289a59c700 1 --2- 172.21.15.45:0/1290146714 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f287c05a510 0x7f287c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:57.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.436+0000 7f289a59c700 1 --2- 172.21.15.45:0/1290146714 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f287c05a510 0x7f287c05c9d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7f288c0075a0 tx=0x7f288c0097e0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:57.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.440+0000 7f28927fc700 1 -- 172.21.15.45:0/1290146714 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f28940472e0 con 0x7f289c0ca230 2023-12-22T10:01:57.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.604+0000 7f289b59e700 1 -- 172.21.15.45:0/1290146714 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f289c047060 con 0x7f289c0ca230 2023-12-22T10:01:57.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.604+0000 7f28927fc700 1 -- 172.21.15.45:0/1290146714 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v44) v1 ==== 104+0+11 (secure 0 0 0) 0x7f289404a900 con 0x7f289c0ca230 2023-12-22T10:01:57.604 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-22T10:01:57.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.608+0000 7f289b59e700 1 -- 172.21.15.45:0/1290146714 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f287c05a510 msgr2=0x7f287c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:57.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.608+0000 7f289b59e700 1 --2- 172.21.15.45:0/1290146714 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f287c05a510 0x7f287c05c9d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7f288c0075a0 tx=0x7f288c0097e0).stop 2023-12-22T10:01:57.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.608+0000 7f289b59e700 1 -- 172.21.15.45:0/1290146714 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f289c0ca230 msgr2=0x7f289c0ad970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:57.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.608+0000 7f289b59e700 1 --2- 172.21.15.45:0/1290146714 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f289c0ca230 0x7f289c0ad970 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7f289400c440 tx=0x7f2894007d70).stop 2023-12-22T10:01:57.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.608+0000 7f289b59e700 1 -- 172.21.15.45:0/1290146714 shutdown_connections 2023-12-22T10:01:57.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.608+0000 7f289b59e700 1 --2- 172.21.15.45:0/1290146714 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f289c0ca230 0x7f289c0ad970 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:57.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.608+0000 7f289b59e700 1 --2- 172.21.15.45:0/1290146714 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f289c0c9d20 0x7f289c0aee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:57.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.608+0000 7f289b59e700 1 --2- 172.21.15.45:0/1290146714 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f287c05a510 0x7f287c05c9d0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:57.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.608+0000 7f289b59e700 1 --2- 172.21.15.45:0/1290146714 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f289c0acca0 0x7f289c0ae960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:57.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.608+0000 7f289b59e700 1 -- 172.21.15.45:0/1290146714 >> 172.21.15.45:0/1290146714 conn(0x7f289c0674f0 msgr2=0x7f289c068ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:57.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.608+0000 7f289b59e700 1 -- 172.21.15.45:0/1290146714 shutdown_connections 2023-12-22T10:01:57.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.608+0000 7f289b59e700 1 -- 172.21.15.45:0/1290146714 wait complete. 2023-12-22T10:01:57.631 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-22T10:01:57.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.808+0000 7fb2d9569700 1 Processor -- start 2023-12-22T10:01:57.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.808+0000 7fb2d9569700 1 -- start start 2023-12-22T10:01:57.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.812+0000 7fb2d9569700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb2d40a9240 0x7fb2d4065890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:57.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.812+0000 7fb2d9569700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2d40c2cb0 con 0x7fb2d405dd80 2023-12-22T10:01:57.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.812+0000 7fb2d9569700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2d41520b0 con 0x7fb2d4151cd0 2023-12-22T10:01:57.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.812+0000 7fb2d9569700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d4065fd0 con 0x7fb2d40a9240 2023-12-22T10:01:57.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.816+0000 7fb2d37fe700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fb2d405dd80 0x7fb2d4067030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:45766/0 (socket says 172.21.15.45:45766) 2023-12-22T10:01:57.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.816+0000 7fb2d37fe700 1 -- 172.21.15.45:0/1970555041 learned_addr learned my addr 172.21.15.45:0/1970555041 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:01:57.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.816+0000 7fb2cbfff700 1 --2- 172.21.15.45:0/1970555041 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb2d40a9240 0x7fb2d4065890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:57.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.816+0000 7fb2d27fc700 1 -- 172.21.15.45:0/1970555041 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2391598403 0 0) 0x7fb2d40c2cb0 con 0x7fb2d405dd80 2023-12-22T10:01:57.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.816+0000 7fb2d27fc700 1 -- 172.21.15.45:0/1970555041 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2c00033f0 con 0x7fb2d405dd80 2023-12-22T10:01:57.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.816+0000 7fb2d27fc700 1 -- 172.21.15.45:0/1970555041 <== mon.1 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1186926392 0 0) 0x7fb2c4001110 con 0x7fb2d4151cd0 2023-12-22T10:01:57.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.816+0000 7fb2d27fc700 1 -- 172.21.15.45:0/1970555041 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2d40c2cb0 con 0x7fb2d4151cd0 2023-12-22T10:01:57.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.816+0000 7fb2d27fc700 1 -- 172.21.15.45:0/1970555041 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 856557869 0 0) 0x7fb2c00033f0 con 0x7fb2d405dd80 2023-12-22T10:01:57.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.816+0000 7fb2d27fc700 1 -- 172.21.15.45:0/1970555041 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb2d40a9240 msgr2=0x7fb2d4065890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:57.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.816+0000 7fb2d27fc700 1 --2- 172.21.15.45:0/1970555041 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb2d40a9240 0x7fb2d4065890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:57.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.816+0000 7fb2d27fc700 1 -- 172.21.15.45:0/1970555041 >> v1:172.21.15.113:6789/0 conn(0x7fb2d4151cd0 legacy=0x7fb2d40a8b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:57.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.816+0000 7fb2d27fc700 1 -- 172.21.15.45:0/1970555041 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2d4066ba0 con 0x7fb2d405dd80 2023-12-22T10:01:57.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.816+0000 7fb2d27fc700 1 -- 172.21.15.45:0/1970555041 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2619163070 0 0) 0x7fb2cc0017f0 con 0x7fb2d405dd80 2023-12-22T10:01:57.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.816+0000 7fb2d27fc700 1 -- 172.21.15.45:0/1970555041 >> v1:172.21.15.45:6789/0 conn(0x7fb2d405dd80 legacy=0x7fb2d4067030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:57.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.816+0000 7fb2d27fc700 1 --2- 172.21.15.45:0/1970555041 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb2d40a9240 0x7fb2c0003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:57.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.816+0000 7fb2d27fc700 1 --2- 172.21.15.45:0/1970555041 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2c0004000 0x7fb2c0004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:57.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.816+0000 7fb2d27fc700 1 --2- 172.21.15.45:0/1970555041 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb2c0004b80 0x7fb2c0005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:57.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.816+0000 7fb2d27fc700 1 -- 172.21.15.45:0/1970555041 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d4065fd0 con 0x7fb2c0004000 2023-12-22T10:01:57.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.816+0000 7fb2d27fc700 1 -- 172.21.15.45:0/1970555041 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c000b9c0 con 0x7fb2c0004b80 2023-12-22T10:01:57.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.816+0000 7fb2d27fc700 1 -- 172.21.15.45:0/1970555041 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c000bb80 con 0x7fb2d40a9240 2023-12-22T10:01:57.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.816+0000 7fb2cbfff700 1 --2- 172.21.15.45:0/1970555041 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2c0004000 0x7fb2c0004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:57.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.816+0000 7fb2d37fe700 1 --2- 172.21.15.45:0/1970555041 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb2c0004b80 0x7fb2c0005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:57.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.816+0000 7fb2d2ffd700 1 --2- 172.21.15.45:0/1970555041 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb2d40a9240 0x7fb2c0003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:57.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.816+0000 7fb2cbfff700 1 -- 172.21.15.45:0/1970555041 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb2d40a9240 msgr2=0x7fb2c0003aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:57.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.816+0000 7fb2cbfff700 1 --2- 172.21.15.45:0/1970555041 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb2d40a9240 0x7fb2c0003aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:57.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.816+0000 7fb2cbfff700 1 -- 172.21.15.45:0/1970555041 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb2c0004b80 msgr2=0x7fb2c0005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:57.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.816+0000 7fb2cbfff700 1 --2- 172.21.15.45:0/1970555041 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb2c0004b80 0x7fb2c0005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:57.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.816+0000 7fb2cbfff700 1 -- 172.21.15.45:0/1970555041 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2c00033f0 con 0x7fb2c0004000 2023-12-22T10:01:57.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.816+0000 7fb2d2ffd700 1 --2- 172.21.15.45:0/1970555041 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb2d40a9240 0x7fb2c0003aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-12-22T10:01:57.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.816+0000 7fb2cbfff700 1 --2- 172.21.15.45:0/1970555041 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2c0004000 0x7fb2c0004690 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7fb2bc006d80 tx=0x7fb2bc009060).ready entity=mon.0 client_cookie=62d7b228f285e6d6 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:57.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.820+0000 7fb2d27fc700 1 -- 172.21.15.45:0/1970555041 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2bc009e90 con 0x7fb2c0004000 2023-12-22T10:01:57.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.820+0000 7fb2d27fc700 1 -- 172.21.15.45:0/1970555041 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2bc009430 con 0x7fb2c0004000 2023-12-22T10:01:57.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.820+0000 7fb2d27fc700 1 -- 172.21.15.45:0/1970555041 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2bc00e820 con 0x7fb2c0004000 2023-12-22T10:01:57.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.820+0000 7fb2d9569700 1 -- 172.21.15.45:0/1970555041 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2c0004000 msgr2=0x7fb2c0004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:57.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.820+0000 7fb2d9569700 1 --2- 172.21.15.45:0/1970555041 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2c0004000 0x7fb2c0004690 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7fb2bc006d80 tx=0x7fb2bc009060).stop 2023-12-22T10:01:57.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.820+0000 7fb2d37fe700 1 -- 172.21.15.45:0/1970555041 reap_dead start 2023-12-22T10:01:57.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.820+0000 7fb2d9569700 1 -- 172.21.15.45:0/1970555041 shutdown_connections 2023-12-22T10:01:57.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.820+0000 7fb2d9569700 1 -- 172.21.15.45:0/1970555041 >> 172.21.15.45:0/1970555041 conn(0x7fb2d40c7800 msgr2=0x7fb2d40c37d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:57.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.820+0000 7fb2d9569700 1 -- 172.21.15.45:0/1970555041 shutdown_connections 2023-12-22T10:01:57.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.820+0000 7fb2d9569700 1 -- 172.21.15.45:0/1970555041 wait complete. 2023-12-22T10:01:57.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.820+0000 7fb2d9569700 1 Processor -- start 2023-12-22T10:01:57.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.820+0000 7fb2d9569700 1 -- start start 2023-12-22T10:01:57.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.824+0000 7fb2d9569700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2c0004000 0x7fb2d4155150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:57.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.824+0000 7fb2d9569700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb2d413a490 0x7fb2d4152690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:57.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.824+0000 7fb2d9569700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb2d40c56e0 0x7fb2d40c5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:57.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.824+0000 7fb2d9569700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d40be720 con 0x7fb2c0004000 2023-12-22T10:01:57.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.824+0000 7fb2d9569700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d40c6050 con 0x7fb2d413a490 2023-12-22T10:01:57.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.824+0000 7fb2d9569700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d413a910 con 0x7fb2d40c56e0 2023-12-22T10:01:57.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.824+0000 7fb2d2ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2c0004000 0x7fb2d4155150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:57.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.824+0000 7fb2d2ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2c0004000 0x7fb2d4155150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47050/0 (socket says 172.21.15.45:47050) 2023-12-22T10:01:57.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.824+0000 7fb2d2ffd700 1 -- 172.21.15.45:0/266760377 learned_addr learned my addr 172.21.15.45:0/266760377 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:57.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.824+0000 7fb2d37fe700 1 --2- 172.21.15.45:0/266760377 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb2d40c56e0 0x7fb2d40c5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:57.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.824+0000 7fb2cbfff700 1 --2- 172.21.15.45:0/266760377 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb2d413a490 0x7fb2d4152690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:57.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.824+0000 7fb2d2ffd700 1 -- 172.21.15.45:0/266760377 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb2d40c56e0 msgr2=0x7fb2d40c5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:57.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.824+0000 7fb2d2ffd700 1 --2- 172.21.15.45:0/266760377 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb2d40c56e0 0x7fb2d40c5b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:57.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.824+0000 7fb2d2ffd700 1 -- 172.21.15.45:0/266760377 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb2d413a490 msgr2=0x7fb2d4152690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:57.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.824+0000 7fb2d2ffd700 1 --2- 172.21.15.45:0/266760377 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb2d413a490 0x7fb2d4152690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:57.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.824+0000 7fb2d2ffd700 1 -- 172.21.15.45:0/266760377 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2d40be900 con 0x7fb2c0004000 2023-12-22T10:01:57.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.824+0000 7fb2cbfff700 1 --2- 172.21.15.45:0/266760377 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb2d413a490 0x7fb2d4152690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-12-22T10:01:57.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.824+0000 7fb2d2ffd700 1 --2- 172.21.15.45:0/266760377 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2c0004000 0x7fb2d4155150 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0x7fb2c400d7e0 tx=0x7fb2c4009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:57.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.824+0000 7fb2caffd700 1 -- 172.21.15.45:0/266760377 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2c4011580 con 0x7fb2c0004000 2023-12-22T10:01:57.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.824+0000 7fb2caffd700 1 -- 172.21.15.45:0/266760377 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2c40116e0 con 0x7fb2c0004000 2023-12-22T10:01:57.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.824+0000 7fb2d9569700 1 -- 172.21.15.45:0/266760377 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2d40bebe0 con 0x7fb2c0004000 2023-12-22T10:01:57.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.824+0000 7fb2caffd700 1 -- 172.21.15.45:0/266760377 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2c4011a60 con 0x7fb2c0004000 2023-12-22T10:01:57.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.824+0000 7fb2d9569700 1 -- 172.21.15.45:0/266760377 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2d40bf1a0 con 0x7fb2c0004000 2023-12-22T10:01:57.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.828+0000 7fb2d9569700 1 -- 172.21.15.45:0/266760377 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2d4047060 con 0x7fb2c0004000 2023-12-22T10:01:57.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.828+0000 7fb2caffd700 1 -- 172.21.15.45:0/266760377 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fb2c401c460 con 0x7fb2c0004000 2023-12-22T10:01:57.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.828+0000 7fb2caffd700 1 --2- 172.21.15.45:0/266760377 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fb2b405a540 0x7fb2b405ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:57.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.828+0000 7fb2caffd700 1 -- 172.21.15.45:0/266760377 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6660+0+0 (secure 0 0 0) 0x7fb2c4074930 con 0x7fb2c0004000 2023-12-22T10:01:57.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.828+0000 7fb2cbfff700 1 --2- 172.21.15.45:0/266760377 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fb2b405a540 0x7fb2b405ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:57.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.832+0000 7fb2cbfff700 1 --2- 172.21.15.45:0/266760377 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fb2b405a540 0x7fb2b405ca00 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7fb2d40be6b0 tx=0x7fb2bc01a000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:57.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:57.836+0000 7fb2caffd700 1 -- 172.21.15.45:0/266760377 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb2c4047e90 con 0x7fb2c0004000 2023-12-22T10:01:58.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.008+0000 7fb2d9569700 1 -- 172.21.15.45:0/266760377 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb2d41520b0 con 0x7fb2c0004000 2023-12-22T10:01:58.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.012+0000 7fb2caffd700 1 -- 172.21.15.45:0/266760377 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v44) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb2d41520b0 con 0x7fb2c0004000 2023-12-22T10:01:58.010 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-22T10:01:58.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.012+0000 7fb2d9569700 1 -- 172.21.15.45:0/266760377 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fb2b405a540 msgr2=0x7fb2b405ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:58.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.012+0000 7fb2d9569700 1 --2- 172.21.15.45:0/266760377 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fb2b405a540 0x7fb2b405ca00 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7fb2d40be6b0 tx=0x7fb2bc01a000).stop 2023-12-22T10:01:58.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.012+0000 7fb2d9569700 1 -- 172.21.15.45:0/266760377 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2c0004000 msgr2=0x7fb2d4155150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:58.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.012+0000 7fb2d9569700 1 --2- 172.21.15.45:0/266760377 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2c0004000 0x7fb2d4155150 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0x7fb2c400d7e0 tx=0x7fb2c4009040).stop 2023-12-22T10:01:58.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.012+0000 7fb2d9569700 1 -- 172.21.15.45:0/266760377 shutdown_connections 2023-12-22T10:01:58.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.012+0000 7fb2d9569700 1 --2- 172.21.15.45:0/266760377 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fb2b405a540 0x7fb2b405ca00 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:58.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.012+0000 7fb2d9569700 1 --2- 172.21.15.45:0/266760377 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb2d40c56e0 0x7fb2d40c5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:58.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.012+0000 7fb2d9569700 1 --2- 172.21.15.45:0/266760377 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb2d413a490 0x7fb2d4152690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:58.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.012+0000 7fb2d9569700 1 --2- 172.21.15.45:0/266760377 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2c0004000 0x7fb2d4155150 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:58.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.012+0000 7fb2d9569700 1 -- 172.21.15.45:0/266760377 >> 172.21.15.45:0/266760377 conn(0x7fb2d40c7800 msgr2=0x7fb2d4155f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:58.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.012+0000 7fb2d9569700 1 -- 172.21.15.45:0/266760377 shutdown_connections 2023-12-22T10:01:58.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.012+0000 7fb2d9569700 1 -- 172.21.15.45:0/266760377 wait complete. 2023-12-22T10:01:58.035 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get recovery_fs_metadata pg_num 2023-12-22T10:01:58.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.207+0000 7f8ed759e700 1 Processor -- start 2023-12-22T10:01:58.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.207+0000 7f8ed759e700 1 -- start start 2023-12-22T10:01:58.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.211+0000 7f8ed759e700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8ed80647c0 0x7f8ed8064ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:58.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.211+0000 7f8ed759e700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f8ed806a5b0 0x7f8ed80c19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:58.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.211+0000 7f8ed759e700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ed80c4470 con 0x7f8ed80c1e90 2023-12-22T10:01:58.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.211+0000 7f8ed759e700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ed80c2c90 con 0x7f8ed80647c0 2023-12-22T10:01:58.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.211+0000 7f8ed759e700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed80c23f0 con 0x7f8ed806a5b0 2023-12-22T10:01:58.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.211+0000 7f8ed659c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8ed80647c0 0x7f8ed8064ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:58.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.211+0000 7f8ed659c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8ed80647c0 0x7f8ed8064ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47052/0 (socket says 172.21.15.45:47052) 2023-12-22T10:01:58.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.211+0000 7f8ed659c700 1 -- 172.21.15.45:0/233495301 learned_addr learned my addr 172.21.15.45:0/233495301 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:58.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.211+0000 7f8ed5d9b700 1 --2- 172.21.15.45:0/233495301 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f8ed806a5b0 0x7f8ed80c19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:58.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.211+0000 7f8ed659c700 1 -- 172.21.15.45:0/233495301 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f8ed806a5b0 msgr2=0x7f8ed80c19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:58.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.211+0000 7f8ed659c700 1 --2- 172.21.15.45:0/233495301 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f8ed806a5b0 0x7f8ed80c19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:58.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.211+0000 7f8ed659c700 1 -- 172.21.15.45:0/233495301 >> v1:172.21.15.45:6789/0 conn(0x7f8ed80c1e90 legacy=0x7f8ed814f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:58.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.211+0000 7f8ed659c700 1 -- 172.21.15.45:0/233495301 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ed80c26d0 con 0x7f8ed80647c0 2023-12-22T10:01:58.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.215+0000 7f8ed659c700 1 --2- 172.21.15.45:0/233495301 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ed80647c0 0x7f8ed8064ba0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 rx=0x7f8ec8006fd0 tx=0x7f8ec80090f0).ready entity=mon.0 client_cookie=76021f5932a99daa server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:58.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.215+0000 7f8ed559a700 1 -- 172.21.15.45:0/233495301 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec800b580 con 0x7f8ed80647c0 2023-12-22T10:01:58.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.215+0000 7f8ed559a700 1 -- 172.21.15.45:0/233495301 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ec800b6e0 con 0x7f8ed80647c0 2023-12-22T10:01:58.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.215+0000 7f8ed559a700 1 -- 172.21.15.45:0/233495301 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec800ba60 con 0x7f8ed80647c0 2023-12-22T10:01:58.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.215+0000 7f8ed759e700 1 -- 172.21.15.45:0/233495301 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ed80647c0 msgr2=0x7f8ed8064ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:58.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.215+0000 7f8ed759e700 1 --2- 172.21.15.45:0/233495301 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ed80647c0 0x7f8ed8064ba0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 rx=0x7f8ec8006fd0 tx=0x7f8ec80090f0).stop 2023-12-22T10:01:58.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.215+0000 7f8ed759e700 1 -- 172.21.15.45:0/233495301 shutdown_connections 2023-12-22T10:01:58.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.215+0000 7f8ed759e700 1 --2- 172.21.15.45:0/233495301 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f8ed806a5b0 0x7f8ed80c19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:58.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.215+0000 7f8ed759e700 1 --2- 172.21.15.45:0/233495301 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ed80647c0 0x7f8ed8064ba0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:58.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.215+0000 7f8ed759e700 1 -- 172.21.15.45:0/233495301 >> 172.21.15.45:0/233495301 conn(0x7f8ed8067500 msgr2=0x7f8ed80c6440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:58.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.215+0000 7f8ed759e700 1 -- 172.21.15.45:0/233495301 shutdown_connections 2023-12-22T10:01:58.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.215+0000 7f8ed759e700 1 -- 172.21.15.45:0/233495301 wait complete. 2023-12-22T10:01:58.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.219+0000 7f8ed759e700 1 Processor -- start 2023-12-22T10:01:58.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.219+0000 7f8ed759e700 1 -- start start 2023-12-22T10:01:58.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.219+0000 7f8ed759e700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f8ed80647c0 0x7f8ed81586c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:58.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.219+0000 7f8ed759e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ed806a5b0 0x7f8ed813cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:58.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.219+0000 7f8ed759e700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8ed80c1e90 0x7f8ed815a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:58.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.219+0000 7f8ed759e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed814b650 con 0x7f8ed806a5b0 2023-12-22T10:01:58.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.219+0000 7f8ed759e700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed8158bb0 con 0x7f8ed80c1e90 2023-12-22T10:01:58.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.219+0000 7f8ed759e700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed8159ad0 con 0x7f8ed80647c0 2023-12-22T10:01:58.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.219+0000 7f8ed5d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ed806a5b0 0x7f8ed813cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:58.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.219+0000 7f8ed5d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ed806a5b0 0x7f8ed813cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47060/0 (socket says 172.21.15.45:47060) 2023-12-22T10:01:58.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.219+0000 7f8ed5d9b700 1 -- 172.21.15.45:0/1357039199 learned_addr learned my addr 172.21.15.45:0/1357039199 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:58.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.219+0000 7f8ed6d9d700 1 --2- 172.21.15.45:0/1357039199 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8ed80c1e90 0x7f8ed815a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:58.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.219+0000 7f8ed659c700 1 --2- 172.21.15.45:0/1357039199 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f8ed80647c0 0x7f8ed81586c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:58.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.219+0000 7f8ed5d9b700 1 -- 172.21.15.45:0/1357039199 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f8ed80647c0 msgr2=0x7f8ed81586c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:58.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.219+0000 7f8ed5d9b700 1 --2- 172.21.15.45:0/1357039199 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f8ed80647c0 0x7f8ed81586c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:58.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.219+0000 7f8ed5d9b700 1 -- 172.21.15.45:0/1357039199 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8ed80c1e90 msgr2=0x7f8ed815a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:58.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.219+0000 7f8ed5d9b700 1 --2- 172.21.15.45:0/1357039199 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8ed80c1e90 0x7f8ed815a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:58.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.219+0000 7f8ed5d9b700 1 -- 172.21.15.45:0/1357039199 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ec8009370 con 0x7f8ed806a5b0 2023-12-22T10:01:58.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.219+0000 7f8ed659c700 1 --2- 172.21.15.45:0/1357039199 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f8ed80647c0 0x7f8ed81586c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-12-22T10:01:58.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.219+0000 7f8ed5d9b700 1 --2- 172.21.15.45:0/1357039199 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ed806a5b0 0x7f8ed813cbd0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0x7f8ecc00e930 tx=0x7f8ecc009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:58.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.219+0000 7f8ec67fc700 1 -- 172.21.15.45:0/1357039199 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ecc00eed0 con 0x7f8ed806a5b0 2023-12-22T10:01:58.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.223+0000 7f8ec67fc700 1 -- 172.21.15.45:0/1357039199 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ecc00c850 con 0x7f8ed806a5b0 2023-12-22T10:01:58.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.223+0000 7f8ec67fc700 1 -- 172.21.15.45:0/1357039199 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ecc00cbd0 con 0x7f8ed806a5b0 2023-12-22T10:01:58.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.223+0000 7f8ed759e700 1 -- 172.21.15.45:0/1357039199 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ed8159db0 con 0x7f8ed806a5b0 2023-12-22T10:01:58.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.223+0000 7f8ed759e700 1 -- 172.21.15.45:0/1357039199 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ed815a370 con 0x7f8ed806a5b0 2023-12-22T10:01:58.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.223+0000 7f8ed759e700 1 -- 172.21.15.45:0/1357039199 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ed8047060 con 0x7f8ed806a5b0 2023-12-22T10:01:58.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.223+0000 7f8ec67fc700 1 -- 172.21.15.45:0/1357039199 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f8ecc01b400 con 0x7f8ed806a5b0 2023-12-22T10:01:58.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.223+0000 7f8ec67fc700 1 --2- 172.21.15.45:0/1357039199 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f8eb805a510 0x7f8eb805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:58.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.227+0000 7f8ec67fc700 1 -- 172.21.15.45:0/1357039199 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6660+0+0 (secure 0 0 0) 0x7f8ecc074ff0 con 0x7f8ed806a5b0 2023-12-22T10:01:58.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.227+0000 7f8ed659c700 1 --2- 172.21.15.45:0/1357039199 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f8eb805a510 0x7f8eb805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:58.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.227+0000 7f8ed659c700 1 --2- 172.21.15.45:0/1357039199 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f8eb805a510 0x7f8eb805c9d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f8ec8006df0 tx=0x7f8ec8017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:58.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.231+0000 7f8ec67fc700 1 -- 172.21.15.45:0/1357039199 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f8ecc0a3b00 con 0x7f8ed806a5b0 2023-12-22T10:01:58.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.395+0000 7f8ed759e700 1 -- 172.21.15.45:0/1357039199 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "recovery_fs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8ed80c29b0 con 0x7f8ed806a5b0 2023-12-22T10:01:58.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.395+0000 7f8ec67fc700 1 -- 172.21.15.45:0/1357039199 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "recovery_fs_metadata", "var": "pg_num"}]=0 v44) v1 ==== 109+0+11 (secure 0 0 0) 0x7f8ecc0484f0 con 0x7f8ed806a5b0 2023-12-22T10:01:58.395 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-22T10:01:58.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.399+0000 7f8ed759e700 1 -- 172.21.15.45:0/1357039199 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f8eb805a510 msgr2=0x7f8eb805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:58.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.399+0000 7f8ed759e700 1 --2- 172.21.15.45:0/1357039199 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f8eb805a510 0x7f8eb805c9d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f8ec8006df0 tx=0x7f8ec8017000).stop 2023-12-22T10:01:58.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.399+0000 7f8ed759e700 1 -- 172.21.15.45:0/1357039199 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ed806a5b0 msgr2=0x7f8ed813cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:58.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.399+0000 7f8ed759e700 1 --2- 172.21.15.45:0/1357039199 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ed806a5b0 0x7f8ed813cbd0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0x7f8ecc00e930 tx=0x7f8ecc009060).stop 2023-12-22T10:01:58.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.399+0000 7f8ed759e700 1 -- 172.21.15.45:0/1357039199 shutdown_connections 2023-12-22T10:01:58.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.399+0000 7f8ed759e700 1 --2- 172.21.15.45:0/1357039199 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8ed80c1e90 0x7f8ed815a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:58.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.399+0000 7f8ed759e700 1 --2- 172.21.15.45:0/1357039199 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ed806a5b0 0x7f8ed813cbd0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:58.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.399+0000 7f8ed759e700 1 --2- 172.21.15.45:0/1357039199 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f8eb805a510 0x7f8eb805c9d0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:58.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.399+0000 7f8ed759e700 1 --2- 172.21.15.45:0/1357039199 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f8ed80647c0 0x7f8ed81586c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:58.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.399+0000 7f8ed759e700 1 -- 172.21.15.45:0/1357039199 >> 172.21.15.45:0/1357039199 conn(0x7f8ed8067500 msgr2=0x7f8ed80a9520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:58.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.399+0000 7f8ed759e700 1 -- 172.21.15.45:0/1357039199 shutdown_connections 2023-12-22T10:01:58.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.399+0000 7f8ed759e700 1 -- 172.21.15.45:0/1357039199 wait complete. 2023-12-22T10:01:58.417 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T10:01:58.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.587+0000 7f85f4d69700 1 Processor -- start 2023-12-22T10:01:58.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.587+0000 7f85f4d69700 1 -- start start 2023-12-22T10:01:58.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.587+0000 7f85f4d69700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f85f0151ad0 0x7f85f00bdcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:58.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.587+0000 7f85f4d69700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f85f00be1b0 0x7f85f00c2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:58.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.587+0000 7f85f4d69700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85f00bd830 con 0x7f85f01516f0 2023-12-22T10:01:58.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.587+0000 7f85f4d69700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85f00be600 con 0x7f85f00be1b0 2023-12-22T10:01:58.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.587+0000 7f85f4d69700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85f00bcc20 con 0x7f85f0151ad0 2023-12-22T10:01:58.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.587+0000 7f85ee59c700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f85f01516f0 0x7f85f0153110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:45790/0 (socket says 172.21.15.45:45790) 2023-12-22T10:01:58.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.587+0000 7f85ee59c700 1 -- 172.21.15.45:0/3600181309 learned_addr learned my addr 172.21.15.45:0/3600181309 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:01:58.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.587+0000 7f85edd9b700 1 --2- 172.21.15.45:0/3600181309 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f85f0151ad0 0x7f85f00bdcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:58.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.587+0000 7f85eed9d700 1 --2- 172.21.15.45:0/3600181309 >> v2:172.21.15.113:3300/0 conn(0x7f85f00be1b0 0x7f85f00c2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:58.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.587+0000 7f85ed59a700 1 -- 172.21.15.45:0/3600181309 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3858214304 0 0) 0x7f85f00bd830 con 0x7f85f01516f0 2023-12-22T10:01:58.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.587+0000 7f85ed59a700 1 -- 172.21.15.45:0/3600181309 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85d80033f0 con 0x7f85f01516f0 2023-12-22T10:01:58.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.591+0000 7f85edd9b700 1 -- 172.21.15.45:0/3600181309 >> v2:172.21.15.113:3300/0 conn(0x7f85f00be1b0 msgr2=0x7f85f00c2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:58.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.591+0000 7f85edd9b700 1 --2- 172.21.15.45:0/3600181309 >> v2:172.21.15.113:3300/0 conn(0x7f85f00be1b0 0x7f85f00c2660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:58.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.591+0000 7f85edd9b700 1 -- 172.21.15.45:0/3600181309 >> v1:172.21.15.45:6789/0 conn(0x7f85f01516f0 legacy=0x7f85f0153110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:58.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.591+0000 7f85ed59a700 1 -- 172.21.15.45:0/3600181309 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3645843029 0 0) 0x7f85d80033f0 con 0x7f85f01516f0 2023-12-22T10:01:58.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.591+0000 7f85edd9b700 1 -- 172.21.15.45:0/3600181309 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85f00bcf00 con 0x7f85f0151ad0 2023-12-22T10:01:58.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.591+0000 7f85edd9b700 1 --2- 172.21.15.45:0/3600181309 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f85f0151ad0 0x7f85f00bdcc0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f85e4009760 tx=0x7f85e4009060).ready entity=mon.2 client_cookie=6a9f685a647c2f46 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:58.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.591+0000 7f85ed59a700 1 -- 172.21.15.45:0/3600181309 <== mon.2 v2:172.21.15.113:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e0001470 con 0x7f85f0151ad0 2023-12-22T10:01:58.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.591+0000 7f85ed59a700 1 -- 172.21.15.45:0/3600181309 <== mon.2 v2:172.21.15.113:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85e4011400 con 0x7f85f0151ad0 2023-12-22T10:01:58.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.591+0000 7f85ed59a700 1 -- 172.21.15.45:0/3600181309 <== mon.2 v2:172.21.15.113:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e4011780 con 0x7f85f0151ad0 2023-12-22T10:01:58.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.591+0000 7f85f4d69700 1 -- 172.21.15.45:0/3600181309 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f85f0151ad0 msgr2=0x7f85f00bdcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:58.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.591+0000 7f85f4d69700 1 --2- 172.21.15.45:0/3600181309 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f85f0151ad0 0x7f85f00bdcc0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f85e4009760 tx=0x7f85e4009060).stop 2023-12-22T10:01:58.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.591+0000 7f85f4d69700 1 -- 172.21.15.45:0/3600181309 shutdown_connections 2023-12-22T10:01:58.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.591+0000 7f85f4d69700 1 --2- 172.21.15.45:0/3600181309 >> v2:172.21.15.113:3300/0 conn(0x7f85f00be1b0 0x7f85f00c2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:58.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.591+0000 7f85f4d69700 1 --2- 172.21.15.45:0/3600181309 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f85f0151ad0 0x7f85f00bdcc0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:58.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.591+0000 7f85f4d69700 1 -- 172.21.15.45:0/3600181309 >> 172.21.15.45:0/3600181309 conn(0x7f85f0067b80 msgr2=0x7f85f0067f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:58.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.591+0000 7f85f4d69700 1 -- 172.21.15.45:0/3600181309 shutdown_connections 2023-12-22T10:01:58.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.591+0000 7f85f4d69700 1 -- 172.21.15.45:0/3600181309 wait complete. 2023-12-22T10:01:58.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.595+0000 7f85f4d69700 1 Processor -- start 2023-12-22T10:01:58.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.595+0000 7f85f4d69700 1 -- start start 2023-12-22T10:01:58.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.595+0000 7f85f4d69700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f85f00be1b0 0x7f85f013e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:58.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.595+0000 7f85f4d69700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f85f01516f0 0x7f85f00bede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:58.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.595+0000 7f85f4d69700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85f0151ad0 0x7f85f00c6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:58.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.595+0000 7f85f4d69700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85f00c61e0 con 0x7f85f0151ad0 2023-12-22T10:01:58.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.595+0000 7f85f4d69700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85f00c55d0 con 0x7f85f01516f0 2023-12-22T10:01:58.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.595+0000 7f85f4d69700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85f00c58b0 con 0x7f85f00be1b0 2023-12-22T10:01:58.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.595+0000 7f85eed9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85f0151ad0 0x7f85f00c6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:58.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.595+0000 7f85eed9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85f0151ad0 0x7f85f00c6670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47068/0 (socket says 172.21.15.45:47068) 2023-12-22T10:01:58.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.595+0000 7f85eed9d700 1 -- 172.21.15.45:0/3561052352 learned_addr learned my addr 172.21.15.45:0/3561052352 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:58.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.595+0000 7f85ee59c700 1 --2- 172.21.15.45:0/3561052352 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f85f00be1b0 0x7f85f013e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:58.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.595+0000 7f85edd9b700 1 --2- 172.21.15.45:0/3561052352 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f85f01516f0 0x7f85f00bede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:58.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.599+0000 7f85eed9d700 1 -- 172.21.15.45:0/3561052352 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f85f00be1b0 msgr2=0x7f85f013e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:58.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.599+0000 7f85eed9d700 1 --2- 172.21.15.45:0/3561052352 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f85f00be1b0 0x7f85f013e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:58.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.599+0000 7f85eed9d700 1 -- 172.21.15.45:0/3561052352 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f85f01516f0 msgr2=0x7f85f00bede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:58.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.599+0000 7f85eed9d700 1 --2- 172.21.15.45:0/3561052352 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f85f01516f0 0x7f85f00bede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:58.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.599+0000 7f85eed9d700 1 -- 172.21.15.45:0/3561052352 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85e40092a0 con 0x7f85f0151ad0 2023-12-22T10:01:58.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.599+0000 7f85edd9b700 1 --2- 172.21.15.45:0/3561052352 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f85f01516f0 0x7f85f00bede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T10:01:58.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.599+0000 7f85eed9d700 1 --2- 172.21.15.45:0/3561052352 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85f0151ad0 0x7f85f00c6670 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7f85e8009e90 tx=0x7f85e800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:58.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.599+0000 7f85de7fc700 1 -- 172.21.15.45:0/3561052352 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e800cb50 con 0x7f85f0151ad0 2023-12-22T10:01:58.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.599+0000 7f85de7fc700 1 -- 172.21.15.45:0/3561052352 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85e800f040 con 0x7f85f0151ad0 2023-12-22T10:01:58.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.599+0000 7f85f4d69700 1 -- 172.21.15.45:0/3561052352 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85f00c5b90 con 0x7f85f0151ad0 2023-12-22T10:01:58.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.599+0000 7f85de7fc700 1 -- 172.21.15.45:0/3561052352 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e800cec0 con 0x7f85f0151ad0 2023-12-22T10:01:58.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.599+0000 7f85f4d69700 1 -- 172.21.15.45:0/3561052352 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85f00be910 con 0x7f85f0151ad0 2023-12-22T10:01:58.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.599+0000 7f85f4d69700 1 -- 172.21.15.45:0/3561052352 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85f00c6350 con 0x7f85f0151ad0 2023-12-22T10:01:58.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.603+0000 7f85de7fc700 1 -- 172.21.15.45:0/3561052352 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f85e8013610 con 0x7f85f0151ad0 2023-12-22T10:01:58.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.603+0000 7f85de7fc700 1 --2- 172.21.15.45:0/3561052352 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f85d005a510 0x7f85d005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:58.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.603+0000 7f85de7fc700 1 -- 172.21.15.45:0/3561052352 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6660+0+0 (secure 0 0 0) 0x7f85e80753f0 con 0x7f85f0151ad0 2023-12-22T10:01:58.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.603+0000 7f85ee59c700 1 --2- 172.21.15.45:0/3561052352 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f85d005a510 0x7f85d005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:58.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.607+0000 7f85ee59c700 1 --2- 172.21.15.45:0/3561052352 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f85d005a510 0x7f85d005c9d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f85e00011e0 tx=0x7f85e0001aa0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:58.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.611+0000 7f85de7fc700 1 -- 172.21.15.45:0/3561052352 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f85e80488f0 con 0x7f85f0151ad0 2023-12-22T10:01:58.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.811+0000 7f85f4d69700 1 -- 172.21.15.45:0/3561052352 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f85f00c6010 con 0x7f85f0151ad0 2023-12-22T10:01:58.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.811+0000 7f85de7fc700 1 -- 172.21.15.45:0/3561052352 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+5445 (secure 0 0 0) 0x7f85e804bf10 con 0x7f85f0151ad0 2023-12-22T10:01:58.813 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:01:58.813 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":21,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4925,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6836/1120392063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1120392063},{"type":"v1","addr":"172.21.15.45:6836","nonce":1120392063}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6835/2332598072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":2332598072},{"type":"v1","addr":"172.21.15.113:6835","nonce":2332598072}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5253,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/2884671415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6835","nonce":2884671415},{"type":"v1","addr":"172.21.15.45:6837","nonce":2884671415}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5284,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6833/2223286979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6832","nonce":2223286979},{"type":"v1","addr":"172.21.15.113:6833","nonce":2223286979}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":17,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T10:01:35.105595+0000","modified":"2023-12-22T10:01:46.041463+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":37,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":21,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T10:01:49.976984+0000","modified":"2023-12-22T10:01:53.149442+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[6],"metadata_pool":7,"enabled":true,"fs_name":"recovery_fs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-12-22T10:01:58.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.815+0000 7f85f4d69700 1 -- 172.21.15.45:0/3561052352 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f85d005a510 msgr2=0x7f85d005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:58.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.815+0000 7f85f4d69700 1 --2- 172.21.15.45:0/3561052352 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f85d005a510 0x7f85d005c9d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f85e00011e0 tx=0x7f85e0001aa0).stop 2023-12-22T10:01:58.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.815+0000 7f85f4d69700 1 -- 172.21.15.45:0/3561052352 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85f0151ad0 msgr2=0x7f85f00c6670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:58.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.815+0000 7f85f4d69700 1 --2- 172.21.15.45:0/3561052352 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85f0151ad0 0x7f85f00c6670 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7f85e8009e90 tx=0x7f85e800b040).stop 2023-12-22T10:01:58.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.819+0000 7f85f4d69700 1 -- 172.21.15.45:0/3561052352 shutdown_connections 2023-12-22T10:01:58.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.819+0000 7f85f4d69700 1 --2- 172.21.15.45:0/3561052352 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85f0151ad0 0x7f85f00c6670 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:58.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.819+0000 7f85f4d69700 1 --2- 172.21.15.45:0/3561052352 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f85f01516f0 0x7f85f00bede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:58.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.819+0000 7f85f4d69700 1 --2- 172.21.15.45:0/3561052352 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f85d005a510 0x7f85d005c9d0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:58.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.819+0000 7f85f4d69700 1 --2- 172.21.15.45:0/3561052352 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f85f00be1b0 0x7f85f013e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:58.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.819+0000 7f85f4d69700 1 -- 172.21.15.45:0/3561052352 >> 172.21.15.45:0/3561052352 conn(0x7f85f0067b80 msgr2=0x7f85f00637e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:58.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.819+0000 7f85f4d69700 1 -- 172.21.15.45:0/3561052352 shutdown_connections 2023-12-22T10:01:58.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:58.819+0000 7f85f4d69700 1 -- 172.21.15.45:0/3561052352 wait complete. 2023-12-22T10:01:58.819 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 21 2023-12-22T10:01:58.839 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T10:01:59.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.007+0000 7f7d59a9b700 1 Processor -- start 2023-12-22T10:01:59.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.007+0000 7f7d59a9b700 1 -- start start 2023-12-22T10:01:59.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.011+0000 7f7d59a9b700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7d540c5900 0x7f7d541580d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:59.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.011+0000 7f7d59a9b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7d540c7430 0x7f7d540c78c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:59.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.011+0000 7f7d59a9b700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d540c9720 con 0x7f7d540ac5c0 2023-12-22T10:01:59.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.011+0000 7f7d59a9b700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d541585c0 con 0x7f7d540c7430 2023-12-22T10:01:59.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.011+0000 7f7d59a9b700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d54153ec0 con 0x7f7d540c5900 2023-12-22T10:01:59.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.011+0000 7f7d53fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7d540c7430 0x7f7d540c78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:59.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.011+0000 7f7d4affd700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7d540c5900 0x7f7d541580d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:59.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.011+0000 7f7d4affd700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7d540c5900 0x7f7d541580d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.113:3301/0 says I am v2:172.21.15.45:42598/0 (socket says 172.21.15.45:42598) 2023-12-22T10:01:59.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.011+0000 7f7d4affd700 1 -- 172.21.15.45:0/41729915 learned_addr learned my addr 172.21.15.45:0/41729915 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:59.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.011+0000 7f7d53fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7d540c7430 0x7f7d540c78c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47074/0 (socket says 172.21.15.45:47074) 2023-12-22T10:01:59.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.011+0000 7f7d537fe700 1 --1- 172.21.15.45:0/41729915 >> v1:172.21.15.113:6789/0 conn(0x7f7d540ac5c0 0x7f7d540aa660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.45:39376/0 (socket says 172.21.15.45:39376) 2023-12-22T10:01:59.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.011+0000 7f7d53fff700 1 -- 172.21.15.45:0/41729915 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7d540c5900 msgr2=0x7f7d541580d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:59.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.011+0000 7f7d53fff700 1 --2- 172.21.15.45:0/41729915 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7d540c5900 0x7f7d541580d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:59.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.011+0000 7f7d53fff700 1 -- 172.21.15.45:0/41729915 >> v1:172.21.15.113:6789/0 conn(0x7f7d540ac5c0 legacy=0x7f7d540aa660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:59.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.011+0000 7f7d53fff700 1 -- 172.21.15.45:0/41729915 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d540c5d60 con 0x7f7d540c7430 2023-12-22T10:01:59.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.011+0000 7f7d4affd700 1 --2- 172.21.15.45:0/41729915 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7d540c5900 0x7f7d541580d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-12-22T10:01:59.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.011+0000 7f7d53fff700 1 --2- 172.21.15.45:0/41729915 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d540c7430 0x7f7d540c78c0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 rx=0x7f7d4c009e60 tx=0x7f7d4c009780).ready entity=mon.0 client_cookie=7781e2ff02b5dd8a server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:59.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.011+0000 7f7d52ffd700 1 -- 172.21.15.45:0/41729915 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d4c00e070 con 0x7f7d540c7430 2023-12-22T10:01:59.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.011+0000 7f7d52ffd700 1 -- 172.21.15.45:0/41729915 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d4c00bbf0 con 0x7f7d540c7430 2023-12-22T10:01:59.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.011+0000 7f7d52ffd700 1 -- 172.21.15.45:0/41729915 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d4c012410 con 0x7f7d540c7430 2023-12-22T10:01:59.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.015+0000 7f7d59a9b700 1 -- 172.21.15.45:0/41729915 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d540c7430 msgr2=0x7f7d540c78c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:59.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.015+0000 7f7d59a9b700 1 --2- 172.21.15.45:0/41729915 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d540c7430 0x7f7d540c78c0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 rx=0x7f7d4c009e60 tx=0x7f7d4c009780).stop 2023-12-22T10:01:59.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.015+0000 7f7d59a9b700 1 -- 172.21.15.45:0/41729915 shutdown_connections 2023-12-22T10:01:59.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.015+0000 7f7d59a9b700 1 --2- 172.21.15.45:0/41729915 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d540c7430 0x7f7d540c78c0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:59.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.015+0000 7f7d59a9b700 1 --2- 172.21.15.45:0/41729915 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7d540c5900 0x7f7d541580d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:59.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.015+0000 7f7d59a9b700 1 -- 172.21.15.45:0/41729915 >> 172.21.15.45:0/41729915 conn(0x7f7d54082a30 msgr2=0x7f7d54066a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:59.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.015+0000 7f7d59a9b700 1 -- 172.21.15.45:0/41729915 shutdown_connections 2023-12-22T10:01:59.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.015+0000 7f7d59a9b700 1 -- 172.21.15.45:0/41729915 wait complete. 2023-12-22T10:01:59.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.015+0000 7f7d59a9b700 1 Processor -- start 2023-12-22T10:01:59.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.019+0000 7f7d59a9b700 1 -- start start 2023-12-22T10:01:59.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.019+0000 7f7d59a9b700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7d540ac5c0 0x7f7d5414f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:59.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.019+0000 7f7d59a9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d540c5900 0x7f7d54153100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:59.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.019+0000 7f7d59a9b700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7d540c7430 0x7f7d541535f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:59.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.019+0000 7f7d59a9b700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d54153ae0 con 0x7f7d540c5900 2023-12-22T10:01:59.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.019+0000 7f7d59a9b700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d540c1ae0 con 0x7f7d540ac5c0 2023-12-22T10:01:59.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.019+0000 7f7d59a9b700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d540afe80 con 0x7f7d540c7430 2023-12-22T10:01:59.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.019+0000 7f7d4affd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d540c5900 0x7f7d54153100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:59.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.019+0000 7f7d4affd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d540c5900 0x7f7d54153100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47090/0 (socket says 172.21.15.45:47090) 2023-12-22T10:01:59.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.019+0000 7f7d4affd700 1 -- 172.21.15.45:0/2915285731 learned_addr learned my addr 172.21.15.45:0/2915285731 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:59.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.019+0000 7f7d53fff700 1 --2- 172.21.15.45:0/2915285731 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7d540c7430 0x7f7d541535f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:59.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.019+0000 7f7d537fe700 1 --2- 172.21.15.45:0/2915285731 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7d540ac5c0 0x7f7d5414f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:59.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.019+0000 7f7d4affd700 1 -- 172.21.15.45:0/2915285731 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7d540c7430 msgr2=0x7f7d541535f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:59.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.019+0000 7f7d4affd700 1 --2- 172.21.15.45:0/2915285731 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7d540c7430 0x7f7d541535f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:59.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.019+0000 7f7d4affd700 1 -- 172.21.15.45:0/2915285731 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7d540ac5c0 msgr2=0x7f7d5414f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:59.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.019+0000 7f7d4affd700 1 --2- 172.21.15.45:0/2915285731 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7d540ac5c0 0x7f7d5414f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:59.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.019+0000 7f7d4affd700 1 -- 172.21.15.45:0/2915285731 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d3c009370 con 0x7f7d540c5900 2023-12-22T10:01:59.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.019+0000 7f7d4affd700 1 --2- 172.21.15.45:0/2915285731 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d540c5900 0x7f7d54153100 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 rx=0x7f7d3c00ea20 tx=0x7f7d3c0090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:59.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.019+0000 7f7d4bfff700 1 -- 172.21.15.45:0/2915285731 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d3c00c850 con 0x7f7d540c5900 2023-12-22T10:01:59.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.019+0000 7f7d4bfff700 1 -- 172.21.15.45:0/2915285731 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d3c00c9b0 con 0x7f7d540c5900 2023-12-22T10:01:59.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.019+0000 7f7d59a9b700 1 -- 172.21.15.45:0/2915285731 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d4c009a20 con 0x7f7d540c5900 2023-12-22T10:01:59.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.019+0000 7f7d4bfff700 1 -- 172.21.15.45:0/2915285731 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d3c00cd30 con 0x7f7d540c5900 2023-12-22T10:01:59.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.019+0000 7f7d59a9b700 1 -- 172.21.15.45:0/2915285731 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d540b0440 con 0x7f7d540c5900 2023-12-22T10:01:59.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.023+0000 7f7d59a9b700 1 -- 172.21.15.45:0/2915285731 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d5406c070 con 0x7f7d540c5900 2023-12-22T10:01:59.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.023+0000 7f7d4bfff700 1 -- 172.21.15.45:0/2915285731 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f7d3c012600 con 0x7f7d540c5900 2023-12-22T10:01:59.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.027+0000 7f7d4bfff700 1 --2- 172.21.15.45:0/2915285731 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f7d3405a540 0x7f7d3405ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:59.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.027+0000 7f7d4bfff700 1 -- 172.21.15.45:0/2915285731 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6660+0+0 (secure 0 0 0) 0x7f7d3c075060 con 0x7f7d540c5900 2023-12-22T10:01:59.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.027+0000 7f7d537fe700 1 --2- 172.21.15.45:0/2915285731 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f7d3405a540 0x7f7d3405ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:59.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.027+0000 7f7d537fe700 1 --2- 172.21.15.45:0/2915285731 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f7d3405a540 0x7f7d3405ca00 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f7d440076b0 tx=0x7f7d44007bf0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:59.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.031+0000 7f7d4bfff700 1 -- 172.21.15.45:0/2915285731 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f7d3c0a3b00 con 0x7f7d540c5900 2023-12-22T10:01:59.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.207+0000 7f7d59a9b700 1 -- 172.21.15.45:0/2915285731 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7d540c8750 con 0x7f7d540c5900 2023-12-22T10:01:59.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.211+0000 7f7d4bfff700 1 -- 172.21.15.45:0/2915285731 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+18686 (secure 0 0 0) 0x7f7d3c016020 con 0x7f7d540c5900 2023-12-22T10:01:59.212 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:01:59.212 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":44,"fsid":"98b0837e-5e68-4c8f-a1a0-e9424baaad8f","created":"2023-12-22T10:00:15.010174+0000","modified":"2023-12-22T10:01:50.986605+0000","last_up_change":"2023-12-22T10:00:24.980513+0000","last_in_change":"2023-12-22T10:00:17.887172+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-12-22T10:00:25.069641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-12-22T10:00:26.906399+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-22T10:01:33.592093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-22T10:01:34.130811+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"recovery_fs"}}},{"pool":7,"pool_name":"recovery_fs_metadata","create_time":"2023-12-22T10:01:49.073877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"recovery_fs"}}}],"osds":[{"osd":0,"uuid":"e19943a0-1c6b-47df-b6bb-383472077890","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":33777},{"type":"v1","addr":"172.21.15.45:6819","nonce":33777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":33777},{"type":"v1","addr":"172.21.15.45:6822","nonce":33777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":33777},{"type":"v1","addr":"172.21.15.45:6830","nonce":33777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":33777},{"type":"v1","addr":"172.21.15.45:6826","nonce":33777}]},"public_addr":"172.21.15.45:6819/33777","cluster_addr":"172.21.15.45:6822/33777","heartbeat_back_addr":"172.21.15.45:6830/33777","heartbeat_front_addr":"172.21.15.45:6826/33777","state":["exists","up"]},{"osd":1,"uuid":"69670f34-f082-45a7-8f67-e962acc136e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":33775},{"type":"v1","addr":"172.21.15.45:6809","nonce":33775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":33775},{"type":"v1","addr":"172.21.15.45:6811","nonce":33775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":33775},{"type":"v1","addr":"172.21.15.45:6815","nonce":33775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":33775},{"type":"v1","addr":"172.21.15.45:6813","nonce":33775}]},"public_addr":"172.21.15.45:6809/33775","cluster_addr":"172.21.15.45:6811/33775","heartbeat_back_addr":"172.21.15.45:6815/33775","heartbeat_front_addr":"172.21.15.45:6813/33775","state":["exists","up"]},{"osd":2,"uuid":"d909d49b-82b8-401b-9947-e49dd167bb95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":33776},{"type":"v1","addr":"172.21.15.45:6801","nonce":33776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":33776},{"type":"v1","addr":"172.21.15.45:6803","nonce":33776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":33776},{"type":"v1","addr":"172.21.15.45:6807","nonce":33776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":33776},{"type":"v1","addr":"172.21.15.45:6805","nonce":33776}]},"public_addr":"172.21.15.45:6801/33776","cluster_addr":"172.21.15.45:6803/33776","heartbeat_back_addr":"172.21.15.45:6807/33776","heartbeat_front_addr":"172.21.15.45:6805/33776","state":["exists","up"]},{"osd":3,"uuid":"db104ca9-3a94-4d39-a2be-bd06db888095","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":33782},{"type":"v1","addr":"172.21.15.45:6817","nonce":33782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":33782},{"type":"v1","addr":"172.21.15.45:6823","nonce":33782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":33782},{"type":"v1","addr":"172.21.15.45:6831","nonce":33782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":33782},{"type":"v1","addr":"172.21.15.45:6827","nonce":33782}]},"public_addr":"172.21.15.45:6817/33782","cluster_addr":"172.21.15.45:6823/33782","heartbeat_back_addr":"172.21.15.45:6831/33782","heartbeat_front_addr":"172.21.15.45:6827/33782","state":["exists","up"]},{"osd":4,"uuid":"9f4eaff4-e433-4479-a0d1-ee7a33375ca6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":34099},{"type":"v1","addr":"172.21.15.113:6811","nonce":34099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":34099},{"type":"v1","addr":"172.21.15.113:6815","nonce":34099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":34099},{"type":"v1","addr":"172.21.15.113:6823","nonce":34099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6816","nonce":34099},{"type":"v1","addr":"172.21.15.113:6818","nonce":34099}]},"public_addr":"172.21.15.113:6811/34099","cluster_addr":"172.21.15.113:6815/34099","heartbeat_back_addr":"172.21.15.113:6823/34099","heartbeat_front_addr":"172.21.15.113:6818/34099","state":["exists","up"]},{"osd":5,"uuid":"1efc5591-180b-43af-8611-0068aadc5aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":34100},{"type":"v1","addr":"172.21.15.113:6801","nonce":34100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":34100},{"type":"v1","addr":"172.21.15.113:6803","nonce":34100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":34100},{"type":"v1","addr":"172.21.15.113:6807","nonce":34100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":34100},{"type":"v1","addr":"172.21.15.113:6805","nonce":34100}]},"public_addr":"172.21.15.113:6801/34100","cluster_addr":"172.21.15.113:6803/34100","heartbeat_back_addr":"172.21.15.113:6807/34100","heartbeat_front_addr":"172.21.15.113:6805/34100","state":["exists","up"]},{"osd":6,"uuid":"6c89d9d8-c153-4a48-afa9-97e4c403f1ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":34101},{"type":"v1","addr":"172.21.15.113:6810","nonce":34101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6812","nonce":34101},{"type":"v1","addr":"172.21.15.113:6814","nonce":34101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6822","nonce":34101},{"type":"v1","addr":"172.21.15.113:6824","nonce":34101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":34101},{"type":"v1","addr":"172.21.15.113:6819","nonce":34101}]},"public_addr":"172.21.15.113:6810/34101","cluster_addr":"172.21.15.113:6814/34101","heartbeat_back_addr":"172.21.15.113:6824/34101","heartbeat_front_addr":"172.21.15.113:6819/34101","state":["exists","up"]},{"osd":7,"uuid":"1855e70c-23f6-4c08-ad7f-774c2148235b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6821","nonce":34102},{"type":"v1","addr":"172.21.15.113:6825","nonce":34102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":34102},{"type":"v1","addr":"172.21.15.113:6827","nonce":34102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":34102},{"type":"v1","addr":"172.21.15.113:6831","nonce":34102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6828","nonce":34102},{"type":"v1","addr":"172.21.15.113:6829","nonce":34102}]},"public_addr":"172.21.15.113:6825/34102","cluster_addr":"172.21.15.113:6827/34102","heartbeat_back_addr":"172.21.15.113:6831/34102","heartbeat_front_addr":"172.21.15.113:6829/34102","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.812672+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.825045+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.700105+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.856563+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.954683+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.883234+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.883994+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.821686+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.45:6835/1879154206":"2023-12-23T10:01:45.243059+0000","172.21.15.45:6834/1879154206":"2023-12-23T10:01:45.243059+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T10:01:59.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.215+0000 7f7d59a9b700 1 -- 172.21.15.45:0/2915285731 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f7d3405a540 msgr2=0x7f7d3405ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:59.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.215+0000 7f7d59a9b700 1 --2- 172.21.15.45:0/2915285731 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f7d3405a540 0x7f7d3405ca00 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f7d440076b0 tx=0x7f7d44007bf0).stop 2023-12-22T10:01:59.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.215+0000 7f7d59a9b700 1 -- 172.21.15.45:0/2915285731 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d540c5900 msgr2=0x7f7d54153100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:59.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.215+0000 7f7d59a9b700 1 --2- 172.21.15.45:0/2915285731 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d540c5900 0x7f7d54153100 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 rx=0x7f7d3c00ea20 tx=0x7f7d3c0090f0).stop 2023-12-22T10:01:59.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.215+0000 7f7d59a9b700 1 -- 172.21.15.45:0/2915285731 shutdown_connections 2023-12-22T10:01:59.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.215+0000 7f7d59a9b700 1 --2- 172.21.15.45:0/2915285731 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f7d3405a540 0x7f7d3405ca00 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:59.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.215+0000 7f7d59a9b700 1 --2- 172.21.15.45:0/2915285731 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7d540c7430 0x7f7d541535f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:59.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.215+0000 7f7d59a9b700 1 --2- 172.21.15.45:0/2915285731 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d540c5900 0x7f7d54153100 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:59.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.215+0000 7f7d59a9b700 1 --2- 172.21.15.45:0/2915285731 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7d540ac5c0 0x7f7d5414f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:59.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.215+0000 7f7d59a9b700 1 -- 172.21.15.45:0/2915285731 >> 172.21.15.45:0/2915285731 conn(0x7f7d54082a30 msgr2=0x7f7d54152800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:59.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.215+0000 7f7d59a9b700 1 -- 172.21.15.45:0/2915285731 shutdown_connections 2023-12-22T10:01:59.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.215+0000 7f7d59a9b700 1 -- 172.21.15.45:0/2915285731 wait complete. 2023-12-22T10:01:59.236 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-22T10:01:59.236 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T10:01:59.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.399+0000 7f2b371b9700 1 Processor -- start 2023-12-22T10:01:59.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.399+0000 7f2b371b9700 1 -- start start 2023-12-22T10:01:59.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.403+0000 7f2b371b9700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f2b300a9ed0 0x7f2b300c1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:59.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.403+0000 7f2b371b9700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2b300bf910 0x7f2b300bfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:59.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.403+0000 7f2b371b9700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b300c0f70 con 0x7f2b300c5960 2023-12-22T10:01:59.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.403+0000 7f2b371b9700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b300aa2b0 con 0x7f2b300bf910 2023-12-22T10:01:59.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.403+0000 7f2b371b9700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b300c0360 con 0x7f2b300a9ed0 2023-12-22T10:01:59.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.403+0000 7f2b359b6700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2b300bf910 0x7f2b300bfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:59.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.403+0000 7f2b359b6700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2b300bf910 0x7f2b300bfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47096/0 (socket says 172.21.15.45:47096) 2023-12-22T10:01:59.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.403+0000 7f2b359b6700 1 -- 172.21.15.45:0/291856098 learned_addr learned my addr 172.21.15.45:0/291856098 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:59.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.403+0000 7f2b361b7700 1 --2- 172.21.15.45:0/291856098 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f2b300a9ed0 0x7f2b300c1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:59.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.403+0000 7f2b359b6700 1 -- 172.21.15.45:0/291856098 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f2b300a9ed0 msgr2=0x7f2b300c1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:01:59.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.403+0000 7f2b359b6700 1 --2- 172.21.15.45:0/291856098 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f2b300a9ed0 0x7f2b300c1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:59.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.403+0000 7f2b359b6700 1 -- 172.21.15.45:0/291856098 >> v1:172.21.15.45:6789/0 conn(0x7f2b300c5960 legacy=0x7f2b300c5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:59.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.403+0000 7f2b359b6700 1 -- 172.21.15.45:0/291856098 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b300c0640 con 0x7f2b300bf910 2023-12-22T10:01:59.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.403+0000 7f2b359b6700 1 --2- 172.21.15.45:0/291856098 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b300bf910 0x7f2b300bfd70 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 rx=0x7f2b20006fd0 tx=0x7f2b200090f0).ready entity=mon.0 client_cookie=dce64fedb57d57e0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:59.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.403+0000 7f2b351b5700 1 -- 172.21.15.45:0/291856098 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b2000b580 con 0x7f2b300bf910 2023-12-22T10:01:59.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.403+0000 7f2b351b5700 1 -- 172.21.15.45:0/291856098 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b2000b6e0 con 0x7f2b300bf910 2023-12-22T10:01:59.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.403+0000 7f2b351b5700 1 -- 172.21.15.45:0/291856098 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b2000ba60 con 0x7f2b300bf910 2023-12-22T10:01:59.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.407+0000 7f2b371b9700 1 -- 172.21.15.45:0/291856098 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b300bf910 msgr2=0x7f2b300bfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:59.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.407+0000 7f2b371b9700 1 --2- 172.21.15.45:0/291856098 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b300bf910 0x7f2b300bfd70 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 rx=0x7f2b20006fd0 tx=0x7f2b200090f0).stop 2023-12-22T10:01:59.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.407+0000 7f2b371b9700 1 -- 172.21.15.45:0/291856098 shutdown_connections 2023-12-22T10:01:59.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.407+0000 7f2b371b9700 1 --2- 172.21.15.45:0/291856098 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b300bf910 0x7f2b300bfd70 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:59.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.407+0000 7f2b371b9700 1 --2- 172.21.15.45:0/291856098 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f2b300a9ed0 0x7f2b300c1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:59.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.407+0000 7f2b371b9700 1 -- 172.21.15.45:0/291856098 >> 172.21.15.45:0/291856098 conn(0x7f2b30067500 msgr2=0x7f2b300ca9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:59.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.407+0000 7f2b371b9700 1 -- 172.21.15.45:0/291856098 shutdown_connections 2023-12-22T10:01:59.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.407+0000 7f2b371b9700 1 -- 172.21.15.45:0/291856098 wait complete. 2023-12-22T10:01:59.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.407+0000 7f2b371b9700 1 Processor -- start 2023-12-22T10:01:59.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.407+0000 7f2b371b9700 1 -- start start 2023-12-22T10:01:59.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.411+0000 7f2b371b9700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f2b300a9ed0 0x7f2b30168570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:59.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.411+0000 7f2b371b9700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2b300bf910 0x7f2b301568e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:59.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.411+0000 7f2b371b9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b300c5960 0x7f2b30142310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:59.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.411+0000 7f2b371b9700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b30168a60 con 0x7f2b300c5960 2023-12-22T10:01:59.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.411+0000 7f2b371b9700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b301570e0 con 0x7f2b300bf910 2023-12-22T10:01:59.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.411+0000 7f2b371b9700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b301573c0 con 0x7f2b300a9ed0 2023-12-22T10:01:59.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.411+0000 7f2b369b8700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b300c5960 0x7f2b30142310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:59.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.411+0000 7f2b369b8700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b300c5960 0x7f2b30142310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47104/0 (socket says 172.21.15.45:47104) 2023-12-22T10:01:59.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.411+0000 7f2b369b8700 1 -- 172.21.15.45:0/923940369 learned_addr learned my addr 172.21.15.45:0/923940369 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:59.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.411+0000 7f2b361b7700 1 --2- 172.21.15.45:0/923940369 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f2b300a9ed0 0x7f2b30168570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:59.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.411+0000 7f2b359b6700 1 --2- 172.21.15.45:0/923940369 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2b300bf910 0x7f2b301568e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:59.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.411+0000 7f2b369b8700 1 -- 172.21.15.45:0/923940369 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f2b300a9ed0 msgr2=0x7f2b30168570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:59.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.411+0000 7f2b369b8700 1 --2- 172.21.15.45:0/923940369 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f2b300a9ed0 0x7f2b30168570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:59.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.411+0000 7f2b369b8700 1 -- 172.21.15.45:0/923940369 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2b300bf910 msgr2=0x7f2b301568e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:59.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.411+0000 7f2b369b8700 1 --2- 172.21.15.45:0/923940369 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2b300bf910 0x7f2b301568e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:59.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.411+0000 7f2b369b8700 1 -- 172.21.15.45:0/923940369 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b20009370 con 0x7f2b300c5960 2023-12-22T10:01:59.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.411+0000 7f2b361b7700 1 --2- 172.21.15.45:0/923940369 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f2b300a9ed0 0x7f2b30168570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-12-22T10:01:59.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.411+0000 7f2b369b8700 1 --2- 172.21.15.45:0/923940369 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b300c5960 0x7f2b30142310 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7f2b2800c7c0 tx=0x7f2b28001510).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:59.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.411+0000 7f2b267fc700 1 -- 172.21.15.45:0/923940369 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b2800e4a0 con 0x7f2b300c5960 2023-12-22T10:01:59.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.411+0000 7f2b267fc700 1 -- 172.21.15.45:0/923940369 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b2800e600 con 0x7f2b300c5960 2023-12-22T10:01:59.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.411+0000 7f2b371b9700 1 -- 172.21.15.45:0/923940369 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b301576a0 con 0x7f2b300c5960 2023-12-22T10:01:59.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.411+0000 7f2b267fc700 1 -- 172.21.15.45:0/923940369 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b2800e980 con 0x7f2b300c5960 2023-12-22T10:01:59.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.411+0000 7f2b371b9700 1 -- 172.21.15.45:0/923940369 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b30156dd0 con 0x7f2b300c5960 2023-12-22T10:01:59.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.415+0000 7f2b371b9700 1 -- 172.21.15.45:0/923940369 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b30047060 con 0x7f2b300c5960 2023-12-22T10:01:59.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.415+0000 7f2b267fc700 1 -- 172.21.15.45:0/923940369 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f2b2800ed30 con 0x7f2b300c5960 2023-12-22T10:01:59.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.415+0000 7f2b267fc700 1 --2- 172.21.15.45:0/923940369 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f2b1405a540 0x7f2b1405ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:59.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.415+0000 7f2b267fc700 1 -- 172.21.15.45:0/923940369 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6660+0+0 (secure 0 0 0) 0x7f2b28074200 con 0x7f2b300c5960 2023-12-22T10:01:59.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.419+0000 7f2b361b7700 1 --2- 172.21.15.45:0/923940369 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f2b1405a540 0x7f2b1405ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:59.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.419+0000 7f2b361b7700 1 --2- 172.21.15.45:0/923940369 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f2b1405a540 0x7f2b1405ca00 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7f2b2c011310 tx=0x7f2b2c009060).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:59.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.423+0000 7f2b267fc700 1 -- 172.21.15.45:0/923940369 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f2b28047700 con 0x7f2b300c5960 2023-12-22T10:01:59.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.619+0000 7f2b371b9700 1 -- 172.21.15.45:0/923940369 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2b300ad470 con 0x7f2b300c5960 2023-12-22T10:01:59.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.619+0000 7f2b267fc700 1 -- 172.21.15.45:0/923940369 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+5445 (secure 0 0 0) 0x7f2b2804ad20 con 0x7f2b300c5960 2023-12-22T10:01:59.619 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:01:59.620 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":21,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4925,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6836/1120392063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1120392063},{"type":"v1","addr":"172.21.15.45:6836","nonce":1120392063}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6835/2332598072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":2332598072},{"type":"v1","addr":"172.21.15.113:6835","nonce":2332598072}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5253,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/2884671415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6835","nonce":2884671415},{"type":"v1","addr":"172.21.15.45:6837","nonce":2884671415}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5284,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6833/2223286979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6832","nonce":2223286979},{"type":"v1","addr":"172.21.15.113:6833","nonce":2223286979}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":17,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T10:01:35.105595+0000","modified":"2023-12-22T10:01:46.041463+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":37,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":21,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T10:01:49.976984+0000","modified":"2023-12-22T10:01:53.149442+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[6],"metadata_pool":7,"enabled":true,"fs_name":"recovery_fs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-12-22T10:01:59.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.623+0000 7f2b371b9700 1 -- 172.21.15.45:0/923940369 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f2b1405a540 msgr2=0x7f2b1405ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:59.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.623+0000 7f2b371b9700 1 --2- 172.21.15.45:0/923940369 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f2b1405a540 0x7f2b1405ca00 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7f2b2c011310 tx=0x7f2b2c009060).stop 2023-12-22T10:01:59.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.623+0000 7f2b371b9700 1 -- 172.21.15.45:0/923940369 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b300c5960 msgr2=0x7f2b30142310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:59.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.623+0000 7f2b371b9700 1 --2- 172.21.15.45:0/923940369 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b300c5960 0x7f2b30142310 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7f2b2800c7c0 tx=0x7f2b28001510).stop 2023-12-22T10:01:59.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.623+0000 7f2b371b9700 1 -- 172.21.15.45:0/923940369 shutdown_connections 2023-12-22T10:01:59.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.623+0000 7f2b371b9700 1 --2- 172.21.15.45:0/923940369 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b300c5960 0x7f2b30142310 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:59.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.623+0000 7f2b371b9700 1 --2- 172.21.15.45:0/923940369 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f2b300bf910 0x7f2b301568e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:59.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.623+0000 7f2b371b9700 1 --2- 172.21.15.45:0/923940369 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f2b1405a540 0x7f2b1405ca00 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:59.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.623+0000 7f2b371b9700 1 --2- 172.21.15.45:0/923940369 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f2b300a9ed0 0x7f2b30168570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:59.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.623+0000 7f2b371b9700 1 -- 172.21.15.45:0/923940369 >> 172.21.15.45:0/923940369 conn(0x7f2b30067500 msgr2=0x7f2b300c9f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:59.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.623+0000 7f2b371b9700 1 -- 172.21.15.45:0/923940369 shutdown_connections 2023-12-22T10:01:59.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.623+0000 7f2b371b9700 1 -- 172.21.15.45:0/923940369 wait complete. 2023-12-22T10:01:59.624 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 21 2023-12-22T10:01:59.644 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T10:01:59.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.803+0000 7f531ada9700 1 Processor -- start 2023-12-22T10:01:59.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.803+0000 7f531ada9700 1 -- start start 2023-12-22T10:01:59.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.807+0000 7f531ada9700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f53140c02e0 0x7f5314153e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:59.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.807+0000 7f531ada9700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53140c3c70 con 0x7f5314153aa0 2023-12-22T10:01:59.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.807+0000 7f531ada9700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53140c27d0 con 0x7f5314067590 2023-12-22T10:01:59.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.807+0000 7f531ada9700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5314065870 con 0x7f53140c02e0 2023-12-22T10:01:59.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.807+0000 7f5318b45700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f5314153aa0 0x7f53140bfbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:45818/0 (socket says 172.21.15.45:45818) 2023-12-22T10:01:59.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.807+0000 7f5318b45700 1 -- 172.21.15.45:0/1324599709 learned_addr learned my addr 172.21.15.45:0/1324599709 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:01:59.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.807+0000 7f530bfff700 1 --2- 172.21.15.45:0/1324599709 >> v2:172.21.15.45:3300/0 conn(0x7f53140c02e0 0x7f5314153e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:59.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.807+0000 7f530b7fe700 1 -- 172.21.15.45:0/1324599709 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1274805942 0 0) 0x7f53140c3c70 con 0x7f5314153aa0 2023-12-22T10:01:59.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.807+0000 7f530b7fe700 1 -- 172.21.15.45:0/1324599709 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52fc0033f0 con 0x7f5314153aa0 2023-12-22T10:01:59.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.807+0000 7f530bfff700 1 -- 172.21.15.45:0/1324599709 >> v1:172.21.15.113:6789/0 conn(0x7f5314067590 legacy=0x7f5314154370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:59.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.807+0000 7f530bfff700 1 -- 172.21.15.45:0/1324599709 >> v1:172.21.15.45:6789/0 conn(0x7f5314153aa0 legacy=0x7f53140bfbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:59.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.807+0000 7f530bfff700 1 -- 172.21.15.45:0/1324599709 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5314065b50 con 0x7f53140c02e0 2023-12-22T10:01:59.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.811+0000 7f530bfff700 1 --2- 172.21.15.45:0/1324599709 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53140c02e0 0x7f5314153e80 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 rx=0x7f5304009760 tx=0x7f5304009060).ready entity=mon.0 client_cookie=18fe424fd56e766a server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:59.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.811+0000 7f530b7fe700 1 -- 172.21.15.45:0/1324599709 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f530400f510 con 0x7f53140c02e0 2023-12-22T10:01:59.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.811+0000 7f530b7fe700 1 -- 172.21.15.45:0/1324599709 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f530400f670 con 0x7f53140c02e0 2023-12-22T10:01:59.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.811+0000 7f530b7fe700 1 -- 172.21.15.45:0/1324599709 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f530400f9f0 con 0x7f53140c02e0 2023-12-22T10:01:59.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.811+0000 7f531ada9700 1 -- 172.21.15.45:0/1324599709 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53140c02e0 msgr2=0x7f5314153e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:59.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.811+0000 7f531ada9700 1 --2- 172.21.15.45:0/1324599709 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53140c02e0 0x7f5314153e80 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 rx=0x7f5304009760 tx=0x7f5304009060).stop 2023-12-22T10:01:59.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.811+0000 7f531ada9700 1 -- 172.21.15.45:0/1324599709 shutdown_connections 2023-12-22T10:01:59.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.811+0000 7f531ada9700 1 --2- 172.21.15.45:0/1324599709 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53140c02e0 0x7f5314153e80 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:59.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.811+0000 7f531ada9700 1 -- 172.21.15.45:0/1324599709 >> 172.21.15.45:0/1324599709 conn(0x7f5314066a70 msgr2=0x7f5314066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:01:59.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.811+0000 7f531ada9700 1 -- 172.21.15.45:0/1324599709 shutdown_connections 2023-12-22T10:01:59.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.811+0000 7f531ada9700 1 -- 172.21.15.45:0/1324599709 wait complete. 2023-12-22T10:01:59.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.815+0000 7f531ada9700 1 Processor -- start 2023-12-22T10:01:59.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.815+0000 7f531ada9700 1 -- start start 2023-12-22T10:01:59.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.819+0000 7f531ada9700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5314067590 0x7f53141652c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:59.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.819+0000 7f531ada9700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f53140c02e0 0x7f5314166f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:59.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.819+0000 7f531ada9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5314153aa0 0x7f53141569a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:59.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.819+0000 7f531ada9700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5314157c00 con 0x7f5314153aa0 2023-12-22T10:01:59.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.819+0000 7f531ada9700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5314158a60 con 0x7f5314067590 2023-12-22T10:01:59.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.819+0000 7f531ada9700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f531414f520 con 0x7f53140c02e0 2023-12-22T10:01:59.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.819+0000 7f5319346700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5314153aa0 0x7f53141569a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:59.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.819+0000 7f5319346700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5314153aa0 0x7f53141569a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47108/0 (socket says 172.21.15.45:47108) 2023-12-22T10:01:59.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.819+0000 7f530bfff700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f53140c02e0 0x7f5314166f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:59.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.819+0000 7f5319346700 1 -- 172.21.15.45:0/3101588817 learned_addr learned my addr 172.21.15.45:0/3101588817 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:01:59.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.819+0000 7f5318b45700 1 --2- 172.21.15.45:0/3101588817 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5314067590 0x7f53141652c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:59.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.819+0000 7f530bfff700 1 -- 172.21.15.45:0/3101588817 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5314067590 msgr2=0x7f53141652c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:59.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.819+0000 7f530bfff700 1 --2- 172.21.15.45:0/3101588817 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5314067590 0x7f53141652c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:59.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.819+0000 7f530bfff700 1 -- 172.21.15.45:0/3101588817 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5314153aa0 msgr2=0x7f53141569a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:01:59.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.819+0000 7f530bfff700 1 --2- 172.21.15.45:0/3101588817 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5314153aa0 0x7f53141569a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:01:59.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.819+0000 7f530bfff700 1 -- 172.21.15.45:0/3101588817 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53040092a0 con 0x7f53140c02e0 2023-12-22T10:01:59.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.819+0000 7f5319346700 1 --2- 172.21.15.45:0/3101588817 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5314153aa0 0x7f53141569a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-12-22T10:01:59.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.819+0000 7f530bfff700 1 --2- 172.21.15.45:0/3101588817 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f53140c02e0 0x7f5314166f20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f5304014000 tx=0x7f5304017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:59.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.819+0000 7f5308ff9700 1 -- 172.21.15.45:0/3101588817 <== mon.2 v2:172.21.15.113:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f530400f7e0 con 0x7f53140c02e0 2023-12-22T10:01:59.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.819+0000 7f5308ff9700 1 -- 172.21.15.45:0/3101588817 <== mon.2 v2:172.21.15.113:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f530400f940 con 0x7f53140c02e0 2023-12-22T10:01:59.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.819+0000 7f5308ff9700 1 -- 172.21.15.45:0/3101588817 <== mon.2 v2:172.21.15.113:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f530401b660 con 0x7f53140c02e0 2023-12-22T10:01:59.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.819+0000 7f531ada9700 1 -- 172.21.15.45:0/3101588817 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5314157e50 con 0x7f53140c02e0 2023-12-22T10:01:59.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.819+0000 7f531ada9700 1 -- 172.21.15.45:0/3101588817 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5314158410 con 0x7f53140c02e0 2023-12-22T10:01:59.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.823+0000 7f531ada9700 1 -- 172.21.15.45:0/3101588817 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f531406c070 con 0x7f53140c02e0 2023-12-22T10:01:59.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.823+0000 7f5308ff9700 1 -- 172.21.15.45:0/3101588817 <== mon.2 v2:172.21.15.113:3301/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f530401b9d0 con 0x7f53140c02e0 2023-12-22T10:01:59.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.823+0000 7f5308ff9700 1 --2- 172.21.15.45:0/3101588817 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f530005a510 0x7f530005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:01:59.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.823+0000 7f5308ff9700 1 -- 172.21.15.45:0/3101588817 <== mon.2 v2:172.21.15.113:3301/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6660+0+0 (secure 0 0 0) 0x7f5304076160 con 0x7f53140c02e0 2023-12-22T10:01:59.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.823+0000 7f5318b45700 1 --2- 172.21.15.45:0/3101588817 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f530005a510 0x7f530005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:01:59.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.823+0000 7f5318b45700 1 --2- 172.21.15.45:0/3101588817 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f530005a510 0x7f530005c9d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f5310005ad0 tx=0x7f5310009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:01:59.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:01:59.831+0000 7f5308ff9700 1 -- 172.21.15.45:0/3101588817 <== mon.2 v2:172.21.15.113:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f5304049660 con 0x7f53140c02e0 2023-12-22T10:02:00.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.035+0000 7f531ada9700 1 -- 172.21.15.45:0/3101588817 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5314065e30 con 0x7f53140c02e0 2023-12-22T10:02:00.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.035+0000 7f5308ff9700 1 -- 172.21.15.45:0/3101588817 <== mon.2 v2:172.21.15.113:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+5445 (secure 0 0 0) 0x7f5304029090 con 0x7f53140c02e0 2023-12-22T10:02:00.037 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:02:00.037 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":21,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4925,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6836/1120392063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1120392063},{"type":"v1","addr":"172.21.15.45:6836","nonce":1120392063}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6835/2332598072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":2332598072},{"type":"v1","addr":"172.21.15.113:6835","nonce":2332598072}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5253,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/2884671415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6835","nonce":2884671415},{"type":"v1","addr":"172.21.15.45:6837","nonce":2884671415}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5284,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6833/2223286979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6832","nonce":2223286979},{"type":"v1","addr":"172.21.15.113:6833","nonce":2223286979}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":17,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T10:01:35.105595+0000","modified":"2023-12-22T10:01:46.041463+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":37,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":21,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T10:01:49.976984+0000","modified":"2023-12-22T10:01:53.149442+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[6],"metadata_pool":7,"enabled":true,"fs_name":"recovery_fs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-12-22T10:02:00.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.043+0000 7f531ada9700 1 -- 172.21.15.45:0/3101588817 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f530005a510 msgr2=0x7f530005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:00.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.043+0000 7f531ada9700 1 --2- 172.21.15.45:0/3101588817 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f530005a510 0x7f530005c9d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f5310005ad0 tx=0x7f5310009040).stop 2023-12-22T10:02:00.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.043+0000 7f531ada9700 1 -- 172.21.15.45:0/3101588817 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f53140c02e0 msgr2=0x7f5314166f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:00.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.043+0000 7f531ada9700 1 --2- 172.21.15.45:0/3101588817 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f53140c02e0 0x7f5314166f20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f5304014000 tx=0x7f5304017000).stop 2023-12-22T10:02:00.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.043+0000 7f531ada9700 1 -- 172.21.15.45:0/3101588817 shutdown_connections 2023-12-22T10:02:00.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.043+0000 7f531ada9700 1 --2- 172.21.15.45:0/3101588817 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5314153aa0 0x7f53141569a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:00.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.043+0000 7f531ada9700 1 --2- 172.21.15.45:0/3101588817 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f530005a510 0x7f530005c9d0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:00.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.043+0000 7f531ada9700 1 --2- 172.21.15.45:0/3101588817 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f53140c02e0 0x7f5314166f20 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:00.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.043+0000 7f531ada9700 1 --2- 172.21.15.45:0/3101588817 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5314067590 0x7f53141652c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:00.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.043+0000 7f531ada9700 1 -- 172.21.15.45:0/3101588817 >> 172.21.15.45:0/3101588817 conn(0x7f5314066a70 msgr2=0x7f5314151830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:02:00.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.043+0000 7f531ada9700 1 -- 172.21.15.45:0/3101588817 shutdown_connections 2023-12-22T10:02:00.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.043+0000 7f531ada9700 1 -- 172.21.15.45:0/3101588817 wait complete. 2023-12-22T10:02:00.046 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 21 2023-12-22T10:02:00.064 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T10:02:00.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.235+0000 7f86e759e700 1 Processor -- start 2023-12-22T10:02:00.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.235+0000 7f86e759e700 1 -- start start 2023-12-22T10:02:00.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.239+0000 7f86e759e700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f86e8150730 0x7f86e8068a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:00.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.239+0000 7f86e759e700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f86e80c6b70 0x7f86e80c27f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:00.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.239+0000 7f86e759e700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86e8068f70 con 0x7f86e806a290 2023-12-22T10:02:00.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.239+0000 7f86e759e700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86e80691f0 con 0x7f86e8150730 2023-12-22T10:02:00.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.239+0000 7f86e759e700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86e80694d0 con 0x7f86e80c6b70 2023-12-22T10:02:00.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.239+0000 7f86e5d9b700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f86e806a290 0x7f86e80c20e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:45832/0 (socket says 172.21.15.45:45832) 2023-12-22T10:02:00.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.239+0000 7f86e659c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f86e8150730 0x7f86e8068a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:00.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.239+0000 7f86e5d9b700 1 -- 172.21.15.45:0/3896215045 learned_addr learned my addr 172.21.15.45:0/3896215045 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:02:00.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.239+0000 7f86e6d9d700 1 --2- 172.21.15.45:0/3896215045 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f86e80c6b70 0x7f86e80c27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:00.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.239+0000 7f86e659c700 1 -- 172.21.15.45:0/3896215045 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f86e80c6b70 msgr2=0x7f86e80c27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:02:00.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.239+0000 7f86e659c700 1 --2- 172.21.15.45:0/3896215045 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f86e80c6b70 0x7f86e80c27f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:00.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.239+0000 7f86e659c700 1 -- 172.21.15.45:0/3896215045 >> v1:172.21.15.45:6789/0 conn(0x7f86e806a290 legacy=0x7f86e80c20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:00.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.239+0000 7f86e659c700 1 -- 172.21.15.45:0/3896215045 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86e80697b0 con 0x7f86e8150730 2023-12-22T10:02:00.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.243+0000 7f86e659c700 1 --2- 172.21.15.45:0/3896215045 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86e8150730 0x7f86e8068a80 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 rx=0x7f86d8009760 tx=0x7f86d8009060).ready entity=mon.0 client_cookie=e0ffb17361badd2b server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:00.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.243+0000 7f86e559a700 1 -- 172.21.15.45:0/3896215045 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d800f6b0 con 0x7f86e8150730 2023-12-22T10:02:00.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.243+0000 7f86e559a700 1 -- 172.21.15.45:0/3896215045 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86d800f810 con 0x7f86e8150730 2023-12-22T10:02:00.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.243+0000 7f86e559a700 1 -- 172.21.15.45:0/3896215045 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d800fb90 con 0x7f86e8150730 2023-12-22T10:02:00.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.243+0000 7f86e759e700 1 -- 172.21.15.45:0/3896215045 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86e8150730 msgr2=0x7f86e8068a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:00.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.243+0000 7f86e759e700 1 --2- 172.21.15.45:0/3896215045 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86e8150730 0x7f86e8068a80 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 rx=0x7f86d8009760 tx=0x7f86d8009060).stop 2023-12-22T10:02:00.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.243+0000 7f86e759e700 1 -- 172.21.15.45:0/3896215045 shutdown_connections 2023-12-22T10:02:00.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.243+0000 7f86e759e700 1 --2- 172.21.15.45:0/3896215045 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f86e80c6b70 0x7f86e80c27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:00.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.243+0000 7f86e759e700 1 --2- 172.21.15.45:0/3896215045 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86e8150730 0x7f86e8068a80 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:00.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.243+0000 7f86e759e700 1 -- 172.21.15.45:0/3896215045 >> 172.21.15.45:0/3896215045 conn(0x7f86e8067540 msgr2=0x7f86e80c6460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:02:00.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.243+0000 7f86e759e700 1 -- 172.21.15.45:0/3896215045 shutdown_connections 2023-12-22T10:02:00.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.243+0000 7f86e759e700 1 -- 172.21.15.45:0/3896215045 wait complete. 2023-12-22T10:02:00.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.247+0000 7f86e759e700 1 Processor -- start 2023-12-22T10:02:00.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.247+0000 7f86e759e700 1 -- start start 2023-12-22T10:02:00.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.247+0000 7f86e759e700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f86e806a290 0x7f86e80be110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:00.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.247+0000 7f86e759e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86e80c6b70 0x7f86e814f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:00.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.247+0000 7f86e759e700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f86e8150730 0x7f86e814d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:00.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.247+0000 7f86e759e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e814def0 con 0x7f86e80c6b70 2023-12-22T10:02:00.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.247+0000 7f86e759e700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e80bdc80 con 0x7f86e806a290 2023-12-22T10:02:00.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.247+0000 7f86e759e700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86e814dc10 con 0x7f86e8150730 2023-12-22T10:02:00.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.247+0000 7f86e5d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86e80c6b70 0x7f86e814f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:00.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.247+0000 7f86e5d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86e80c6b70 0x7f86e814f9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47120/0 (socket says 172.21.15.45:47120) 2023-12-22T10:02:00.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.247+0000 7f86e5d9b700 1 -- 172.21.15.45:0/3070126933 learned_addr learned my addr 172.21.15.45:0/3070126933 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:02:00.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.247+0000 7f86e6d9d700 1 --2- 172.21.15.45:0/3070126933 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f86e8150730 0x7f86e814d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:00.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.247+0000 7f86e659c700 1 --2- 172.21.15.45:0/3070126933 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f86e806a290 0x7f86e80be110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:00.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.247+0000 7f86e5d9b700 1 -- 172.21.15.45:0/3070126933 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f86e8150730 msgr2=0x7f86e814d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:00.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.247+0000 7f86e5d9b700 1 --2- 172.21.15.45:0/3070126933 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f86e8150730 0x7f86e814d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:00.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.247+0000 7f86e5d9b700 1 -- 172.21.15.45:0/3070126933 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f86e806a290 msgr2=0x7f86e80be110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:00.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.247+0000 7f86e5d9b700 1 --2- 172.21.15.45:0/3070126933 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f86e806a290 0x7f86e80be110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:00.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.247+0000 7f86e5d9b700 1 -- 172.21.15.45:0/3070126933 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86d80092a0 con 0x7f86e80c6b70 2023-12-22T10:02:00.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.247+0000 7f86e659c700 1 --2- 172.21.15.45:0/3070126933 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f86e806a290 0x7f86e80be110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T10:02:00.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.247+0000 7f86e5d9b700 1 --2- 172.21.15.45:0/3070126933 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86e80c6b70 0x7f86e814f9f0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 rx=0x7f86dc00c410 tx=0x7f86dc007e50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:00.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.251+0000 7f86d67fc700 1 -- 172.21.15.45:0/3070126933 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86dc00ce30 con 0x7f86e80c6b70 2023-12-22T10:02:00.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.251+0000 7f86d67fc700 1 -- 172.21.15.45:0/3070126933 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86dc0072e0 con 0x7f86e80c6b70 2023-12-22T10:02:00.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.251+0000 7f86d67fc700 1 -- 172.21.15.45:0/3070126933 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86dc0057a0 con 0x7f86e80c6b70 2023-12-22T10:02:00.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.251+0000 7f86e759e700 1 -- 172.21.15.45:0/3070126933 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86e80bd630 con 0x7f86e80c6b70 2023-12-22T10:02:00.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.251+0000 7f86e759e700 1 -- 172.21.15.45:0/3070126933 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86e814fee0 con 0x7f86e80c6b70 2023-12-22T10:02:00.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.251+0000 7f86e759e700 1 -- 172.21.15.45:0/3070126933 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86e8154070 con 0x7f86e80c6b70 2023-12-22T10:02:00.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.251+0000 7f86d67fc700 1 -- 172.21.15.45:0/3070126933 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f86dc005b50 con 0x7f86e80c6b70 2023-12-22T10:02:00.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.255+0000 7f86d67fc700 1 --2- 172.21.15.45:0/3070126933 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f86c805a510 0x7f86c805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:00.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.255+0000 7f86d67fc700 1 -- 172.21.15.45:0/3070126933 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6660+0+0 (secure 0 0 0) 0x7f86dc074130 con 0x7f86e80c6b70 2023-12-22T10:02:00.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.255+0000 7f86e659c700 1 --2- 172.21.15.45:0/3070126933 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f86c805a510 0x7f86c805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:00.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.255+0000 7f86e659c700 1 --2- 172.21.15.45:0/3070126933 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f86c805a510 0x7f86c805c9d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7f86e81632d0 tx=0x7f86d8019000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:00.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.259+0000 7f86d67fc700 1 -- 172.21.15.45:0/3070126933 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f86dc047630 con 0x7f86e80c6b70 2023-12-22T10:02:00.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.423+0000 7f86e759e700 1 -- 172.21.15.45:0/3070126933 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f86e80c0b80 con 0x7f86e80c6b70 2023-12-22T10:02:00.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.427+0000 7f86d67fc700 1 -- 172.21.15.45:0/3070126933 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+18686 (secure 0 0 0) 0x7f86dc04ac50 con 0x7f86e80c6b70 2023-12-22T10:02:00.426 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:02:00.427 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":44,"fsid":"98b0837e-5e68-4c8f-a1a0-e9424baaad8f","created":"2023-12-22T10:00:15.010174+0000","modified":"2023-12-22T10:01:50.986605+0000","last_up_change":"2023-12-22T10:00:24.980513+0000","last_in_change":"2023-12-22T10:00:17.887172+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-12-22T10:00:25.069641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-12-22T10:00:26.906399+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-22T10:01:33.592093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-22T10:01:34.130811+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"recovery_fs"}}},{"pool":7,"pool_name":"recovery_fs_metadata","create_time":"2023-12-22T10:01:49.073877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"recovery_fs"}}}],"osds":[{"osd":0,"uuid":"e19943a0-1c6b-47df-b6bb-383472077890","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":33777},{"type":"v1","addr":"172.21.15.45:6819","nonce":33777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":33777},{"type":"v1","addr":"172.21.15.45:6822","nonce":33777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":33777},{"type":"v1","addr":"172.21.15.45:6830","nonce":33777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":33777},{"type":"v1","addr":"172.21.15.45:6826","nonce":33777}]},"public_addr":"172.21.15.45:6819/33777","cluster_addr":"172.21.15.45:6822/33777","heartbeat_back_addr":"172.21.15.45:6830/33777","heartbeat_front_addr":"172.21.15.45:6826/33777","state":["exists","up"]},{"osd":1,"uuid":"69670f34-f082-45a7-8f67-e962acc136e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":33775},{"type":"v1","addr":"172.21.15.45:6809","nonce":33775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":33775},{"type":"v1","addr":"172.21.15.45:6811","nonce":33775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":33775},{"type":"v1","addr":"172.21.15.45:6815","nonce":33775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":33775},{"type":"v1","addr":"172.21.15.45:6813","nonce":33775}]},"public_addr":"172.21.15.45:6809/33775","cluster_addr":"172.21.15.45:6811/33775","heartbeat_back_addr":"172.21.15.45:6815/33775","heartbeat_front_addr":"172.21.15.45:6813/33775","state":["exists","up"]},{"osd":2,"uuid":"d909d49b-82b8-401b-9947-e49dd167bb95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":33776},{"type":"v1","addr":"172.21.15.45:6801","nonce":33776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":33776},{"type":"v1","addr":"172.21.15.45:6803","nonce":33776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":33776},{"type":"v1","addr":"172.21.15.45:6807","nonce":33776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":33776},{"type":"v1","addr":"172.21.15.45:6805","nonce":33776}]},"public_addr":"172.21.15.45:6801/33776","cluster_addr":"172.21.15.45:6803/33776","heartbeat_back_addr":"172.21.15.45:6807/33776","heartbeat_front_addr":"172.21.15.45:6805/33776","state":["exists","up"]},{"osd":3,"uuid":"db104ca9-3a94-4d39-a2be-bd06db888095","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":33782},{"type":"v1","addr":"172.21.15.45:6817","nonce":33782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":33782},{"type":"v1","addr":"172.21.15.45:6823","nonce":33782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":33782},{"type":"v1","addr":"172.21.15.45:6831","nonce":33782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":33782},{"type":"v1","addr":"172.21.15.45:6827","nonce":33782}]},"public_addr":"172.21.15.45:6817/33782","cluster_addr":"172.21.15.45:6823/33782","heartbeat_back_addr":"172.21.15.45:6831/33782","heartbeat_front_addr":"172.21.15.45:6827/33782","state":["exists","up"]},{"osd":4,"uuid":"9f4eaff4-e433-4479-a0d1-ee7a33375ca6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":34099},{"type":"v1","addr":"172.21.15.113:6811","nonce":34099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":34099},{"type":"v1","addr":"172.21.15.113:6815","nonce":34099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":34099},{"type":"v1","addr":"172.21.15.113:6823","nonce":34099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6816","nonce":34099},{"type":"v1","addr":"172.21.15.113:6818","nonce":34099}]},"public_addr":"172.21.15.113:6811/34099","cluster_addr":"172.21.15.113:6815/34099","heartbeat_back_addr":"172.21.15.113:6823/34099","heartbeat_front_addr":"172.21.15.113:6818/34099","state":["exists","up"]},{"osd":5,"uuid":"1efc5591-180b-43af-8611-0068aadc5aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":34100},{"type":"v1","addr":"172.21.15.113:6801","nonce":34100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":34100},{"type":"v1","addr":"172.21.15.113:6803","nonce":34100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":34100},{"type":"v1","addr":"172.21.15.113:6807","nonce":34100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":34100},{"type":"v1","addr":"172.21.15.113:6805","nonce":34100}]},"public_addr":"172.21.15.113:6801/34100","cluster_addr":"172.21.15.113:6803/34100","heartbeat_back_addr":"172.21.15.113:6807/34100","heartbeat_front_addr":"172.21.15.113:6805/34100","state":["exists","up"]},{"osd":6,"uuid":"6c89d9d8-c153-4a48-afa9-97e4c403f1ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":34101},{"type":"v1","addr":"172.21.15.113:6810","nonce":34101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6812","nonce":34101},{"type":"v1","addr":"172.21.15.113:6814","nonce":34101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6822","nonce":34101},{"type":"v1","addr":"172.21.15.113:6824","nonce":34101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":34101},{"type":"v1","addr":"172.21.15.113:6819","nonce":34101}]},"public_addr":"172.21.15.113:6810/34101","cluster_addr":"172.21.15.113:6814/34101","heartbeat_back_addr":"172.21.15.113:6824/34101","heartbeat_front_addr":"172.21.15.113:6819/34101","state":["exists","up"]},{"osd":7,"uuid":"1855e70c-23f6-4c08-ad7f-774c2148235b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6821","nonce":34102},{"type":"v1","addr":"172.21.15.113:6825","nonce":34102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":34102},{"type":"v1","addr":"172.21.15.113:6827","nonce":34102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":34102},{"type":"v1","addr":"172.21.15.113:6831","nonce":34102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6828","nonce":34102},{"type":"v1","addr":"172.21.15.113:6829","nonce":34102}]},"public_addr":"172.21.15.113:6825/34102","cluster_addr":"172.21.15.113:6827/34102","heartbeat_back_addr":"172.21.15.113:6831/34102","heartbeat_front_addr":"172.21.15.113:6829/34102","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.812672+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.825045+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.700105+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.856563+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.954683+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.883234+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.883994+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.821686+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.45:6835/1879154206":"2023-12-23T10:01:45.243059+0000","172.21.15.45:6834/1879154206":"2023-12-23T10:01:45.243059+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T10:02:00.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.427+0000 7f86e759e700 1 -- 172.21.15.45:0/3070126933 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f86c805a510 msgr2=0x7f86c805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:00.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.427+0000 7f86e759e700 1 --2- 172.21.15.45:0/3070126933 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f86c805a510 0x7f86c805c9d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7f86e81632d0 tx=0x7f86d8019000).stop 2023-12-22T10:02:00.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.427+0000 7f86e759e700 1 -- 172.21.15.45:0/3070126933 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86e80c6b70 msgr2=0x7f86e814f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:00.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.427+0000 7f86e759e700 1 --2- 172.21.15.45:0/3070126933 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86e80c6b70 0x7f86e814f9f0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 rx=0x7f86dc00c410 tx=0x7f86dc007e50).stop 2023-12-22T10:02:00.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.427+0000 7f86e759e700 1 -- 172.21.15.45:0/3070126933 shutdown_connections 2023-12-22T10:02:00.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.427+0000 7f86e759e700 1 --2- 172.21.15.45:0/3070126933 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f86c805a510 0x7f86c805c9d0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:00.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.427+0000 7f86e759e700 1 --2- 172.21.15.45:0/3070126933 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f86e8150730 0x7f86e814d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:00.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.427+0000 7f86e759e700 1 --2- 172.21.15.45:0/3070126933 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86e80c6b70 0x7f86e814f9f0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:00.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.427+0000 7f86e759e700 1 --2- 172.21.15.45:0/3070126933 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f86e806a290 0x7f86e80be110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:00.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.427+0000 7f86e759e700 1 -- 172.21.15.45:0/3070126933 >> 172.21.15.45:0/3070126933 conn(0x7f86e8067540 msgr2=0x7f86e80bcac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:02:00.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.427+0000 7f86e759e700 1 -- 172.21.15.45:0/3070126933 shutdown_connections 2023-12-22T10:02:00.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.427+0000 7f86e759e700 1 -- 172.21.15.45:0/3070126933 wait complete. 2023-12-22T10:02:00.452 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-22T10:02:00.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.619+0000 7f23fe769700 1 Processor -- start 2023-12-22T10:02:00.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.619+0000 7f23fe769700 1 -- start start 2023-12-22T10:02:00.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.623+0000 7f23fe769700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f23f80c7b40 0x7f23f81580d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:00.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.623+0000 7f23fe769700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23f80c9720 con 0x7f23f80c5900 2023-12-22T10:02:00.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.623+0000 7f23fe769700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23f8153ec0 con 0x7f23f80ac5c0 2023-12-22T10:02:00.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.623+0000 7f23fe769700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23f81585c0 con 0x7f23f80c7b40 2023-12-22T10:02:00.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.623+0000 7f23f77fe700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f23f80c5900 0x7f23f80c7430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:45840/0 (socket says 172.21.15.45:45840) 2023-12-22T10:02:00.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.623+0000 7f23f77fe700 1 -- 172.21.15.45:0/2193180191 learned_addr learned my addr 172.21.15.45:0/2193180191 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:02:00.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.623+0000 7f23fcd06700 1 --2- 172.21.15.45:0/2193180191 >> v2:172.21.15.113:3300/0 conn(0x7f23f80c7b40 0x7f23f81580d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:00.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.623+0000 7f23f6ffd700 1 -- 172.21.15.45:0/2193180191 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3614389457 0 0) 0x7f23f80c9720 con 0x7f23f80c5900 2023-12-22T10:02:00.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.623+0000 7f23f6ffd700 1 -- 172.21.15.45:0/2193180191 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23e00033f0 con 0x7f23f80c5900 2023-12-22T10:02:00.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.623+0000 7f23f6ffd700 1 -- 172.21.15.45:0/2193180191 <== mon.1 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2801609012 0 0) 0x7f23f8153ec0 con 0x7f23f80ac5c0 2023-12-22T10:02:00.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.623+0000 7f23f6ffd700 1 -- 172.21.15.45:0/2193180191 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23f80c9720 con 0x7f23f80ac5c0 2023-12-22T10:02:00.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.623+0000 7f23fcd06700 1 -- 172.21.15.45:0/2193180191 >> v1:172.21.15.113:6789/0 conn(0x7f23f80ac5c0 legacy=0x7f23f80aa660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:00.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.623+0000 7f23fcd06700 1 -- 172.21.15.45:0/2193180191 >> v1:172.21.15.45:6789/0 conn(0x7f23f80c5900 legacy=0x7f23f80c7430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:00.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.623+0000 7f23fcd06700 1 -- 172.21.15.45:0/2193180191 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23f80c5d60 con 0x7f23f80c7b40 2023-12-22T10:02:00.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.623+0000 7f23fcd06700 1 --2- 172.21.15.45:0/2193180191 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f23f80c7b40 0x7f23f81580d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f23f0009e60 tx=0x7f23f0009780).ready entity=mon.1 client_cookie=37ed2fee8a17e4d server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:00.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.623+0000 7f23f6ffd700 1 -- 172.21.15.45:0/2193180191 <== mon.1 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f000e070 con 0x7f23f80c7b40 2023-12-22T10:02:00.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.623+0000 7f23f6ffd700 1 -- 172.21.15.45:0/2193180191 <== mon.1 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23f000bb40 con 0x7f23f80c7b40 2023-12-22T10:02:00.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.623+0000 7f23f6ffd700 1 -- 172.21.15.45:0/2193180191 <== mon.1 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f0012410 con 0x7f23f80c7b40 2023-12-22T10:02:00.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.627+0000 7f23fe769700 1 -- 172.21.15.45:0/2193180191 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f23f80c7b40 msgr2=0x7f23f81580d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:00.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.627+0000 7f23fe769700 1 --2- 172.21.15.45:0/2193180191 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f23f80c7b40 0x7f23f81580d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f23f0009e60 tx=0x7f23f0009780).stop 2023-12-22T10:02:00.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.627+0000 7f23fe769700 1 -- 172.21.15.45:0/2193180191 shutdown_connections 2023-12-22T10:02:00.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.627+0000 7f23fe769700 1 --2- 172.21.15.45:0/2193180191 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f23f80c7b40 0x7f23f81580d0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:00.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.627+0000 7f23fe769700 1 -- 172.21.15.45:0/2193180191 >> 172.21.15.45:0/2193180191 conn(0x7f23f8082a30 msgr2=0x7f23f8066a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:02:00.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.627+0000 7f23fe769700 1 -- 172.21.15.45:0/2193180191 shutdown_connections 2023-12-22T10:02:00.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.627+0000 7f23fe769700 1 -- 172.21.15.45:0/2193180191 wait complete. 2023-12-22T10:02:00.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.627+0000 7f23fe769700 1 Processor -- start 2023-12-22T10:02:00.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.627+0000 7f23fe769700 1 -- start start 2023-12-22T10:02:00.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.627+0000 7f23fe769700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23f80ac5c0 0x7f23f80a9790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:00.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.627+0000 7f23fe769700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f23f80c5900 0x7f23f81517b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:00.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.631+0000 7f23fe769700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f23f80c7b40 0x7f23f80c9e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:00.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.631+0000 7f23fe769700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23f80c1ca0 con 0x7f23f80ac5c0 2023-12-22T10:02:00.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.631+0000 7f23fe769700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23f80a9c80 con 0x7f23f80c7b40 2023-12-22T10:02:00.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.631+0000 7f23fe769700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23f8168680 con 0x7f23f80c5900 2023-12-22T10:02:00.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.631+0000 7f23f7fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23f80ac5c0 0x7f23f80a9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:00.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.631+0000 7f23f7fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23f80ac5c0 0x7f23f80a9790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47134/0 (socket says 172.21.15.45:47134) 2023-12-22T10:02:00.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.631+0000 7f23f7fff700 1 -- 172.21.15.45:0/636227025 learned_addr learned my addr 172.21.15.45:0/636227025 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:02:00.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.631+0000 7f23f77fe700 1 --2- 172.21.15.45:0/636227025 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f23f80c5900 0x7f23f81517b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:00.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.631+0000 7f23fcd06700 1 --2- 172.21.15.45:0/636227025 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f23f80c7b40 0x7f23f80c9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:00.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.631+0000 7f23f7fff700 1 -- 172.21.15.45:0/636227025 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f23f80c5900 msgr2=0x7f23f81517b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:00.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.631+0000 7f23f7fff700 1 --2- 172.21.15.45:0/636227025 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f23f80c5900 0x7f23f81517b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:00.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.631+0000 7f23f7fff700 1 -- 172.21.15.45:0/636227025 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f23f80c7b40 msgr2=0x7f23f80c9e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:00.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.631+0000 7f23f7fff700 1 --2- 172.21.15.45:0/636227025 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f23f80c7b40 0x7f23f80c9e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:00.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.631+0000 7f23f7fff700 1 -- 172.21.15.45:0/636227025 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23f0009a20 con 0x7f23f80ac5c0 2023-12-22T10:02:00.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.631+0000 7f23fcd06700 1 --2- 172.21.15.45:0/636227025 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f23f80c7b40 0x7f23f80c9e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-12-22T10:02:00.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.631+0000 7f23f7fff700 1 --2- 172.21.15.45:0/636227025 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23f80ac5c0 0x7f23f80a9790 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 rx=0x7f23e800c490 tx=0x7f23e8007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:00.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.631+0000 7f23dffff700 1 -- 172.21.15.45:0/636227025 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23e800f470 con 0x7f23f80ac5c0 2023-12-22T10:02:00.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.631+0000 7f23dffff700 1 -- 172.21.15.45:0/636227025 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23e800f5d0 con 0x7f23f80ac5c0 2023-12-22T10:02:00.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.631+0000 7f23dffff700 1 -- 172.21.15.45:0/636227025 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23e800f990 con 0x7f23f80ac5c0 2023-12-22T10:02:00.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.631+0000 7f23fe769700 1 -- 172.21.15.45:0/636227025 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23f80c24f0 con 0x7f23f80ac5c0 2023-12-22T10:02:00.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.631+0000 7f23fe769700 1 -- 172.21.15.45:0/636227025 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23f80c2130 con 0x7f23f80ac5c0 2023-12-22T10:02:00.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.635+0000 7f23fe769700 1 -- 172.21.15.45:0/636227025 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23f806c070 con 0x7f23f80ac5c0 2023-12-22T10:02:00.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.635+0000 7f23dffff700 1 -- 172.21.15.45:0/636227025 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f23e800fd40 con 0x7f23f80ac5c0 2023-12-22T10:02:00.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.635+0000 7f23dffff700 1 --2- 172.21.15.45:0/636227025 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f23e405a540 0x7f23e405ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:00.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.635+0000 7f23dffff700 1 -- 172.21.15.45:0/636227025 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6660+0+0 (secure 0 0 0) 0x7f23e8073f70 con 0x7f23f80ac5c0 2023-12-22T10:02:00.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.635+0000 7f23f77fe700 1 --2- 172.21.15.45:0/636227025 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f23e405a540 0x7f23e405ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:00.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.635+0000 7f23f77fe700 1 --2- 172.21.15.45:0/636227025 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f23e405a540 0x7f23e405ca00 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7f23ec005750 tx=0x7f23ec009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:00.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.639+0000 7f23dffff700 1 -- 172.21.15.45:0/636227025 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f23e80a2b00 con 0x7f23f80ac5c0 2023-12-22T10:02:00.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:00.839+0000 7f23fe769700 1 -- 172.21.15.45:0/636227025 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f23f80c5fc0 con 0x7f23f80ac5c0 2023-12-22T10:02:01.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:01.823+0000 7f23dffff700 1 -- 172.21.15.45:0/636227025 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v22) v1 ==== 161+0+0 (secure 0 0 0) 0x7f23e8047530 con 0x7f23f80ac5c0 2023-12-22T10:02:01.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:01.831+0000 7f23fe769700 1 -- 172.21.15.45:0/636227025 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f23e405a540 msgr2=0x7f23e405ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:01.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:01.831+0000 7f23fe769700 1 --2- 172.21.15.45:0/636227025 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f23e405a540 0x7f23e405ca00 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7f23ec005750 tx=0x7f23ec009040).stop 2023-12-22T10:02:01.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:01.831+0000 7f23fe769700 1 -- 172.21.15.45:0/636227025 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23f80ac5c0 msgr2=0x7f23f80a9790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:01.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:01.831+0000 7f23fe769700 1 --2- 172.21.15.45:0/636227025 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23f80ac5c0 0x7f23f80a9790 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 rx=0x7f23e800c490 tx=0x7f23e8007c90).stop 2023-12-22T10:02:01.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:01.831+0000 7f23fe769700 1 -- 172.21.15.45:0/636227025 shutdown_connections 2023-12-22T10:02:01.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:01.831+0000 7f23fe769700 1 --2- 172.21.15.45:0/636227025 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f23f80c7b40 0x7f23f80c9e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:01.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:01.831+0000 7f23fe769700 1 --2- 172.21.15.45:0/636227025 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f23e405a540 0x7f23e405ca00 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:01.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:01.831+0000 7f23fe769700 1 --2- 172.21.15.45:0/636227025 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f23f80c5900 0x7f23f81517b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:01.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:01.831+0000 7f23fe769700 1 --2- 172.21.15.45:0/636227025 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23f80ac5c0 0x7f23f80a9790 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:01.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:01.831+0000 7f23fe769700 1 -- 172.21.15.45:0/636227025 >> 172.21.15.45:0/636227025 conn(0x7f23f8082a30 msgr2=0x7f23f8153610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:02:01.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:01.831+0000 7f23fe769700 1 -- 172.21.15.45:0/636227025 shutdown_connections 2023-12-22T10:02:01.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:01.831+0000 7f23fe769700 1 -- 172.21.15.45:0/636227025 wait complete. 2023-12-22T10:02:01.833 INFO:teuthology.orchestra.run.smithi045.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-22T10:02:01.853 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-22T10:02:02.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:02.027+0000 7f533521b700 1 Processor -- start 2023-12-22T10:02:02.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:02.027+0000 7f533521b700 1 -- start start 2023-12-22T10:02:02.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:02.031+0000 7f533521b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f53300ac2d0 0x7f53300c5900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:02.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:02.031+0000 7f533521b700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f53300ac6b0 0x7f53300aa660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:02.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:02.031+0000 7f533521b700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f5330158050 0x7f53300c7430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:02.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:02.031+0000 7f533521b700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53300c8d50 con 0x7f53300ac2d0 2023-12-22T10:02:02.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:02.031+0000 7f533521b700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53300c95f0 con 0x7f5330158050 2023-12-22T10:02:02.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:02.031+0000 7f533521b700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53300aab50 con 0x7f53300ac6b0 2023-12-22T10:02:02.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:02.031+0000 7f532ed9d700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f53300ac2d0 0x7f53300c5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:02.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:02.031+0000 7f532ed9d700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f53300ac2d0 0x7f53300c5900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47136/0 (socket says 172.21.15.45:47136) 2023-12-22T10:02:02.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:02.031+0000 7f532ed9d700 1 -- 172.21.15.45:0/620509909 learned_addr learned my addr 172.21.15.45:0/620509909 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:02:02.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:02.031+0000 7f532e59c700 1 --2- 172.21.15.45:0/620509909 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f53300ac6b0 0x7f53300aa660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:02.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:02.031+0000 7f532f59e700 1 --2- 172.21.15.45:0/620509909 >> v2:172.21.15.113:3300/0 conn(0x7f5330158050 0x7f53300c7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:02.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:02.031+0000 7f532ed9d700 1 -- 172.21.15.45:0/620509909 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f53300ac6b0 msgr2=0x7f53300aa660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:02:02.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:02.031+0000 7f532ed9d700 1 --2- 172.21.15.45:0/620509909 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f53300ac6b0 0x7f53300aa660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:02.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:02.031+0000 7f532ed9d700 1 -- 172.21.15.45:0/620509909 >> v2:172.21.15.113:3300/0 conn(0x7f5330158050 msgr2=0x7f53300c7430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:02:02.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:02.031+0000 7f532ed9d700 1 --2- 172.21.15.45:0/620509909 >> v2:172.21.15.113:3300/0 conn(0x7f5330158050 0x7f53300c7430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:02.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:02.031+0000 7f532ed9d700 1 -- 172.21.15.45:0/620509909 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53300acb10 con 0x7f53300ac2d0 2023-12-22T10:02:02.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:02.031+0000 7f532f59e700 1 --2- 172.21.15.45:0/620509909 >> v2:172.21.15.113:3300/0 conn(0x7f5330158050 0x7f53300c7430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-12-22T10:02:02.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:02.031+0000 7f532ed9d700 1 --2- 172.21.15.45:0/620509909 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53300ac2d0 0x7f53300c5900 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 rx=0x7f53300c5480 tx=0x7f53200090f0).ready entity=mon.0 client_cookie=cc84234cbc45bbe2 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:02.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:02.031+0000 7f532dd9b700 1 -- 172.21.15.45:0/620509909 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f532000b600 con 0x7f53300ac2d0 2023-12-22T10:02:02.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:02.031+0000 7f532dd9b700 1 -- 172.21.15.45:0/620509909 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f532000b760 con 0x7f53300ac2d0 2023-12-22T10:02:02.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:02.031+0000 7f532dd9b700 1 -- 172.21.15.45:0/620509909 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f532000bae0 con 0x7f53300ac2d0 2023-12-22T10:02:02.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:02.031+0000 7f533521b700 1 -- 172.21.15.45:0/620509909 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53300ac2d0 msgr2=0x7f53300c5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:02.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:02.031+0000 7f533521b700 1 --2- 172.21.15.45:0/620509909 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53300ac2d0 0x7f53300c5900 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 rx=0x7f53300c5480 tx=0x7f53200090f0).stop 2023-12-22T10:02:02.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:02.031+0000 7f533521b700 1 -- 172.21.15.45:0/620509909 shutdown_connections 2023-12-22T10:02:02.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:02.031+0000 7f533521b700 1 --2- 172.21.15.45:0/620509909 >> v2:172.21.15.113:3300/0 conn(0x7f5330158050 0x7f53300c7430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:02.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:02.031+0000 7f533521b700 1 --2- 172.21.15.45:0/620509909 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f53300ac6b0 0x7f53300aa660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:02.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:02.031+0000 7f533521b700 1 --2- 172.21.15.45:0/620509909 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53300ac2d0 0x7f53300c5900 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:02.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:02.031+0000 7f533521b700 1 -- 172.21.15.45:0/620509909 >> 172.21.15.45:0/620509909 conn(0x7f5330082a50 msgr2=0x7f5330066a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:02:02.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:02.031+0000 7f533521b700 1 -- 172.21.15.45:0/620509909 shutdown_connections 2023-12-22T10:02:02.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:02.031+0000 7f533521b700 1 -- 172.21.15.45:0/620509909 wait complete. 2023-12-22T10:02:02.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:02.035+0000 7f533521b700 1 Processor -- start 2023-12-22T10:02:02.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:02.035+0000 7f533521b700 1 -- start start 2023-12-22T10:02:02.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:02.035+0000 7f533521b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53300ac2d0 0x7f533014c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:02.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:02.035+0000 7f533521b700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f53300ac6b0 0x7f53300af9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:02.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:02.035+0000 7f533521b700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f5330158050 0x7f53300afed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:02.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:02.035+0000 7f533521b700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5330062760 con 0x7f53300ac2d0 2023-12-22T10:02:02.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:02.035+0000 7f533521b700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53300b03c0 con 0x7f53300ac6b0 2023-12-22T10:02:02.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:02.035+0000 7f533521b700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53300c4fb0 con 0x7f5330158050 2023-12-22T10:02:02.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:02.039+0000 7f532ed9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53300ac2d0 0x7f533014c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:02.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:02.039+0000 7f532ed9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53300ac2d0 0x7f533014c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47150/0 (socket says 172.21.15.45:47150) 2023-12-22T10:02:02.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:02.039+0000 7f532ed9d700 1 -- 172.21.15.45:0/914653011 learned_addr learned my addr 172.21.15.45:0/914653011 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:02:02.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:02.039+0000 7f532e59c700 1 --2- 172.21.15.45:0/914653011 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f53300ac6b0 0x7f53300af9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:02.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:02.039+0000 7f532f59e700 1 --2- 172.21.15.45:0/914653011 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f5330158050 0x7f53300afed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:02.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:02.039+0000 7f532ed9d700 1 -- 172.21.15.45:0/914653011 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f5330158050 msgr2=0x7f53300afed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:02.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:02.039+0000 7f532ed9d700 1 --2- 172.21.15.45:0/914653011 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f5330158050 0x7f53300afed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:02.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:02.039+0000 7f532ed9d700 1 -- 172.21.15.45:0/914653011 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f53300ac6b0 msgr2=0x7f53300af9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:02.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:02.039+0000 7f532ed9d700 1 --2- 172.21.15.45:0/914653011 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f53300ac6b0 0x7f53300af9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:02.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:02.039+0000 7f532ed9d700 1 -- 172.21.15.45:0/914653011 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5320009370 con 0x7f53300ac2d0 2023-12-22T10:02:02.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:02.039+0000 7f532ed9d700 1 --2- 172.21.15.45:0/914653011 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53300ac2d0 0x7f533014c510 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 rx=0x7f533005ec40 tx=0x7f5320017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:02.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:02.039+0000 7f5316ffd700 1 -- 172.21.15.45:0/914653011 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f532000bea0 con 0x7f53300ac2d0 2023-12-22T10:02:02.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:02.039+0000 7f5316ffd700 1 -- 172.21.15.45:0/914653011 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f532000b8d0 con 0x7f53300ac2d0 2023-12-22T10:02:02.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:02.039+0000 7f533521b700 1 -- 172.21.15.45:0/914653011 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5330156ae0 con 0x7f53300ac2d0 2023-12-22T10:02:02.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:02.039+0000 7f5316ffd700 1 -- 172.21.15.45:0/914653011 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f532001b640 con 0x7f53300ac2d0 2023-12-22T10:02:02.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:02.039+0000 7f533521b700 1 -- 172.21.15.45:0/914653011 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f533014ca00 con 0x7f53300ac2d0 2023-12-22T10:02:02.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:02.039+0000 7f533521b700 1 -- 172.21.15.45:0/914653011 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5330156940 con 0x7f53300ac2d0 2023-12-22T10:02:02.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:02.043+0000 7f5316ffd700 1 -- 172.21.15.45:0/914653011 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f532001b9b0 con 0x7f53300ac2d0 2023-12-22T10:02:02.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:02.043+0000 7f5316ffd700 1 --2- 172.21.15.45:0/914653011 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f531c05a560 0x7f531c05ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:02.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:02.043+0000 7f5316ffd700 1 -- 172.21.15.45:0/914653011 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6660+0+0 (secure 0 0 0) 0x7f53200762f0 con 0x7f53300ac2d0 2023-12-22T10:02:02.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:02.043+0000 7f532e59c700 1 --2- 172.21.15.45:0/914653011 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f531c05a560 0x7f531c05ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:02.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:02.043+0000 7f532e59c700 1 --2- 172.21.15.45:0/914653011 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f531c05a560 0x7f531c05ca20 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7f5330152d50 tx=0x7f5324008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:02.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:02.051+0000 7f5316ffd700 1 -- 172.21.15.45:0/914653011 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f5330156940 con 0x7f53300ac2d0 2023-12-22T10:02:02.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:02.251+0000 7f533521b700 1 -- 172.21.15.45:0/914653011 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f5330156940 con 0x7f53300ac2d0 2023-12-22T10:02:02.822 INFO:tasks.ceph.mon.a.smithi045.stderr:2023-12-22T10:02:02.823+0000 7fd344a42700 -1 log_channel(cluster) log [ERR] : Health check update: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-22T10:02:02.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:02.835+0000 7f5316ffd700 1 -- 172.21.15.45:0/914653011 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v23) v1 ==== 104+0+0 (secure 0 0 0) 0x7f5330156940 con 0x7f53300ac2d0 2023-12-22T10:02:02.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:02.839+0000 7f533521b700 1 -- 172.21.15.45:0/914653011 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f531c05a560 msgr2=0x7f531c05ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:02.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:02.839+0000 7f533521b700 1 --2- 172.21.15.45:0/914653011 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f531c05a560 0x7f531c05ca20 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7f5330152d50 tx=0x7f5324008040).stop 2023-12-22T10:02:02.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:02.839+0000 7f533521b700 1 -- 172.21.15.45:0/914653011 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53300ac2d0 msgr2=0x7f533014c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:02.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:02.839+0000 7f533521b700 1 --2- 172.21.15.45:0/914653011 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53300ac2d0 0x7f533014c510 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 rx=0x7f533005ec40 tx=0x7f5320017000).stop 2023-12-22T10:02:02.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:02.839+0000 7f533521b700 1 -- 172.21.15.45:0/914653011 shutdown_connections 2023-12-22T10:02:02.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:02.839+0000 7f533521b700 1 --2- 172.21.15.45:0/914653011 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f531c05a560 0x7f531c05ca20 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:02.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:02.839+0000 7f533521b700 1 --2- 172.21.15.45:0/914653011 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f5330158050 0x7f53300afed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:02.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:02.839+0000 7f533521b700 1 --2- 172.21.15.45:0/914653011 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f53300ac6b0 0x7f53300af9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:02.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:02.839+0000 7f533521b700 1 --2- 172.21.15.45:0/914653011 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53300ac2d0 0x7f533014c510 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:02.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:02.839+0000 7f533521b700 1 -- 172.21.15.45:0/914653011 >> 172.21.15.45:0/914653011 conn(0x7f5330082a50 msgr2=0x7f53300ab810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:02:02.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:02.839+0000 7f533521b700 1 -- 172.21.15.45:0/914653011 shutdown_connections 2023-12-22T10:02:02.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:02.839+0000 7f533521b700 1 -- 172.21.15.45:0/914653011 wait complete. 2023-12-22T10:02:02.865 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-22T10:02:03.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:03.039+0000 7fba9dbf9700 1 Processor -- start 2023-12-22T10:02:03.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:03.039+0000 7fba9dbf9700 1 -- start start 2023-12-22T10:02:03.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:03.039+0000 7fba9dbf9700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fba980acc10 0x7fba980bfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:03.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:03.039+0000 7fba9dbf9700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fba98067180 0x7fba980c6c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:03.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:03.039+0000 7fba9dbf9700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba980ad450 con 0x7fba980acff0 2023-12-22T10:02:03.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:03.039+0000 7fba9dbf9700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba980c7110 con 0x7fba980acc10 2023-12-22T10:02:03.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:03.039+0000 7fba9dbf9700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba980aa870 con 0x7fba98067180 2023-12-22T10:02:03.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:03.039+0000 7fba9cbf7700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fba980acc10 0x7fba980bfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:03.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:03.039+0000 7fba9cbf7700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fba980acc10 0x7fba980bfcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.45:45772/0 (socket says 172.21.15.45:45772) 2023-12-22T10:02:03.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:03.039+0000 7fba9cbf7700 1 -- 172.21.15.45:0/3269710892 learned_addr learned my addr 172.21.15.45:0/3269710892 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:02:03.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:03.043+0000 7fba9d3f8700 1 --2- 172.21.15.45:0/3269710892 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fba98067180 0x7fba980c6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:03.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:03.043+0000 7fba9cbf7700 1 -- 172.21.15.45:0/3269710892 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fba98067180 msgr2=0x7fba980c6c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:02:03.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:03.043+0000 7fba9cbf7700 1 --2- 172.21.15.45:0/3269710892 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fba98067180 0x7fba980c6c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:03.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:03.043+0000 7fba9cbf7700 1 -- 172.21.15.45:0/3269710892 >> v1:172.21.15.113:6789/0 conn(0x7fba980acff0 legacy=0x7fba98066a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:03.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:03.043+0000 7fba9cbf7700 1 -- 172.21.15.45:0/3269710892 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba980c0320 con 0x7fba980acc10 2023-12-22T10:02:03.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:03.043+0000 7fba9d3f8700 1 --2- 172.21.15.45:0/3269710892 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fba98067180 0x7fba980c6c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T10:02:03.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:03.043+0000 7fba9cbf7700 1 --2- 172.21.15.45:0/3269710892 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fba980acc10 0x7fba980bfcd0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7fba94006fd0 tx=0x7fba940090f0).ready entity=mon.1 client_cookie=d883338a3950341d server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:03.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:03.043+0000 7fba8f7fe700 1 -- 172.21.15.45:0/3269710892 <== mon.1 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba9400b600 con 0x7fba980acc10 2023-12-22T10:02:03.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:03.043+0000 7fba8f7fe700 1 -- 172.21.15.45:0/3269710892 <== mon.1 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba9400b760 con 0x7fba980acc10 2023-12-22T10:02:03.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:03.043+0000 7fba8f7fe700 1 -- 172.21.15.45:0/3269710892 <== mon.1 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba9400bae0 con 0x7fba980acc10 2023-12-22T10:02:03.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:03.043+0000 7fba9dbf9700 1 -- 172.21.15.45:0/3269710892 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fba980acc10 msgr2=0x7fba980bfcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:03.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:03.043+0000 7fba9dbf9700 1 --2- 172.21.15.45:0/3269710892 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fba980acc10 0x7fba980bfcd0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7fba94006fd0 tx=0x7fba940090f0).stop 2023-12-22T10:02:03.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:03.043+0000 7fba9dbf9700 1 -- 172.21.15.45:0/3269710892 shutdown_connections 2023-12-22T10:02:03.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:03.043+0000 7fba9dbf9700 1 --2- 172.21.15.45:0/3269710892 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fba98067180 0x7fba980c6c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:03.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:03.043+0000 7fba9dbf9700 1 --2- 172.21.15.45:0/3269710892 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fba980acc10 0x7fba980bfcd0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:03.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:03.043+0000 7fba9dbf9700 1 -- 172.21.15.45:0/3269710892 >> 172.21.15.45:0/3269710892 conn(0x7fba980cb330 msgr2=0x7fba980c7300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:02:03.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:03.043+0000 7fba9dbf9700 1 -- 172.21.15.45:0/3269710892 shutdown_connections 2023-12-22T10:02:03.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:03.043+0000 7fba9dbf9700 1 -- 172.21.15.45:0/3269710892 wait complete. 2023-12-22T10:02:03.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:03.047+0000 7fba9dbf9700 1 Processor -- start 2023-12-22T10:02:03.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:03.047+0000 7fba9dbf9700 1 -- start start 2023-12-22T10:02:03.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:03.047+0000 7fba9dbf9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba98067180 0x7fba98164f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:03.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:03.047+0000 7fba9dbf9700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fba980acc10 0x7fba980af1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:03.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:03.047+0000 7fba9dbf9700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fba980acff0 0x7fba98167050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:03.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:03.047+0000 7fba9dbf9700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba980af6a0 con 0x7fba98067180 2023-12-22T10:02:03.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:03.047+0000 7fba9dbf9700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba980af920 con 0x7fba980acc10 2023-12-22T10:02:03.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:03.047+0000 7fba9dbf9700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba980afc00 con 0x7fba980acff0 2023-12-22T10:02:03.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:03.047+0000 7fba9cbf7700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba98067180 0x7fba98164f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:03.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:03.047+0000 7fba9cbf7700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba98067180 0x7fba98164f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47156/0 (socket says 172.21.15.45:47156) 2023-12-22T10:02:03.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:03.047+0000 7fba9cbf7700 1 -- 172.21.15.45:0/3154691882 learned_addr learned my addr 172.21.15.45:0/3154691882 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:02:03.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:03.047+0000 7fba8ffff700 1 --2- 172.21.15.45:0/3154691882 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fba980acc10 0x7fba980af1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:03.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:03.047+0000 7fba9d3f8700 1 --2- 172.21.15.45:0/3154691882 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fba980acff0 0x7fba98167050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:03.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:03.051+0000 7fba9cbf7700 1 -- 172.21.15.45:0/3154691882 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fba980acff0 msgr2=0x7fba98167050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:03.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:03.051+0000 7fba9cbf7700 1 --2- 172.21.15.45:0/3154691882 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fba980acff0 0x7fba98167050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:03.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:03.051+0000 7fba9cbf7700 1 -- 172.21.15.45:0/3154691882 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fba980acc10 msgr2=0x7fba980af1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:03.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:03.051+0000 7fba9cbf7700 1 --2- 172.21.15.45:0/3154691882 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fba980acc10 0x7fba980af1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:03.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:03.051+0000 7fba9cbf7700 1 -- 172.21.15.45:0/3154691882 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba94009370 con 0x7fba98067180 2023-12-22T10:02:03.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:03.051+0000 7fba9cbf7700 1 --2- 172.21.15.45:0/3154691882 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba98067180 0x7fba98164f50 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 rx=0x7fba980c0bd0 tx=0x7fba94017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:03.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:03.051+0000 7fba8cff9700 1 -- 172.21.15.45:0/3154691882 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba9400b8d0 con 0x7fba98067180 2023-12-22T10:02:03.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:03.051+0000 7fba8cff9700 1 -- 172.21.15.45:0/3154691882 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba9400ba30 con 0x7fba98067180 2023-12-22T10:02:03.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:03.051+0000 7fba8cff9700 1 -- 172.21.15.45:0/3154691882 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba9401b660 con 0x7fba98067180 2023-12-22T10:02:03.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:03.051+0000 7fba9dbf9700 1 -- 172.21.15.45:0/3154691882 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba980afee0 con 0x7fba98067180 2023-12-22T10:02:03.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:03.051+0000 7fba9dbf9700 1 -- 172.21.15.45:0/3154691882 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba980b04a0 con 0x7fba98067180 2023-12-22T10:02:03.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:03.051+0000 7fba9dbf9700 1 -- 172.21.15.45:0/3154691882 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba98165570 con 0x7fba98067180 2023-12-22T10:02:03.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:03.055+0000 7fba8cff9700 1 -- 172.21.15.45:0/3154691882 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fba9401ba50 con 0x7fba98067180 2023-12-22T10:02:03.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:03.055+0000 7fba8cff9700 1 --2- 172.21.15.45:0/3154691882 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fba8405a540 0x7fba8405ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:03.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:03.055+0000 7fba8cff9700 1 -- 172.21.15.45:0/3154691882 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6660+0+0 (secure 0 0 0) 0x7fba94075f10 con 0x7fba98067180 2023-12-22T10:02:03.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:03.055+0000 7fba8ffff700 1 --2- 172.21.15.45:0/3154691882 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fba8405a540 0x7fba8405ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:03.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:03.055+0000 7fba8ffff700 1 --2- 172.21.15.45:0/3154691882 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fba8405a540 0x7fba8405ca00 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7fba980c6920 tx=0x7fba88009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:03.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:03.059+0000 7fba8cff9700 1 -- 172.21.15.45:0/3154691882 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fba94049490 con 0x7fba98067180 2023-12-22T10:02:03.077 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:02:03.086 DEBUG:teuthology.orchestra.run.smithi113:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:02:03.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:03.235+0000 7fba9dbf9700 1 -- 172.21.15.45:0/3154691882 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fba98047060 con 0x7fba98067180 2023-12-22T10:02:03.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:03.847+0000 7fba8cff9700 1 -- 172.21.15.45:0/3154691882 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v45) v1 ==== 181+0+0 (secure 0 0 0) 0x7fba9401f070 con 0x7fba98067180 2023-12-22T10:02:03.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:03.851+0000 7fba9dbf9700 1 -- 172.21.15.45:0/3154691882 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fba8405a540 msgr2=0x7fba8405ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:03.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:03.851+0000 7fba9dbf9700 1 --2- 172.21.15.45:0/3154691882 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fba8405a540 0x7fba8405ca00 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7fba980c6920 tx=0x7fba88009040).stop 2023-12-22T10:02:03.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:03.851+0000 7fba9dbf9700 1 -- 172.21.15.45:0/3154691882 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba98067180 msgr2=0x7fba98164f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:03.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:03.851+0000 7fba9dbf9700 1 --2- 172.21.15.45:0/3154691882 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba98067180 0x7fba98164f50 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 rx=0x7fba980c0bd0 tx=0x7fba94017000).stop 2023-12-22T10:02:03.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:03.855+0000 7fba9dbf9700 1 -- 172.21.15.45:0/3154691882 shutdown_connections 2023-12-22T10:02:03.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:03.855+0000 7fba9dbf9700 1 --2- 172.21.15.45:0/3154691882 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fba8405a540 0x7fba8405ca00 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:03.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:03.855+0000 7fba9dbf9700 1 --2- 172.21.15.45:0/3154691882 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fba980acff0 0x7fba98167050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:03.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:03.855+0000 7fba9dbf9700 1 --2- 172.21.15.45:0/3154691882 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fba980acc10 0x7fba980af1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:03.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:03.855+0000 7fba9dbf9700 1 --2- 172.21.15.45:0/3154691882 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba98067180 0x7fba98164f50 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:03.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:03.855+0000 7fba9dbf9700 1 -- 172.21.15.45:0/3154691882 >> 172.21.15.45:0/3154691882 conn(0x7fba980cb330 msgr2=0x7fba981533c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:02:03.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:03.855+0000 7fba9dbf9700 1 -- 172.21.15.45:0/3154691882 shutdown_connections 2023-12-22T10:02:03.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:03.855+0000 7fba9dbf9700 1 -- 172.21.15.45:0/3154691882 wait complete. 2023-12-22T10:02:03.857 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_metadata' removed 2023-12-22T10:02:03.877 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-22T10:02:04.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.055+0000 7f7515bb9700 1 Processor -- start 2023-12-22T10:02:04.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.055+0000 7f7515bb9700 1 -- start start 2023-12-22T10:02:04.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.059+0000 7f7515bb9700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f75100acc10 0x7f75100bfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:04.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.059+0000 7f7515bb9700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7510067180 0x7f75100c6c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:04.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.059+0000 7f7515bb9700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75100ad450 con 0x7f75100acff0 2023-12-22T10:02:04.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.059+0000 7f7515bb9700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75100c7110 con 0x7f7510067180 2023-12-22T10:02:04.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.059+0000 7f7515bb9700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75100aa870 con 0x7f75100acc10 2023-12-22T10:02:04.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.059+0000 7f75153b8700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7510067180 0x7f75100c6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:04.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.059+0000 7f7514bb7700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f75100acc10 0x7f75100bfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:04.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.059+0000 7f750ffff700 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f75100acff0 0x7f7510066a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.45:39424/0 (socket says 172.21.15.45:39424) 2023-12-22T10:02:04.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.059+0000 7f75153b8700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7510067180 0x7f75100c6c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.45:45786/0 (socket says 172.21.15.45:45786) 2023-12-22T10:02:04.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.059+0000 7f750ffff700 1 -- 172.21.15.45:0/4282494717 learned_addr learned my addr 172.21.15.45:0/4282494717 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:02:04.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.059+0000 7f7514bb7700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f75100acc10 0x7f75100bfcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.113:3301/0 says I am v2:172.21.15.45:42714/0 (socket says 172.21.15.45:42714) 2023-12-22T10:02:04.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.059+0000 7f75153b8700 1 -- 172.21.15.45:0/4282494717 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f75100acc10 msgr2=0x7f75100bfcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:02:04.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.059+0000 7f75153b8700 1 --2- 172.21.15.45:0/4282494717 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f75100acc10 0x7f75100bfcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:04.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.059+0000 7f75153b8700 1 -- 172.21.15.45:0/4282494717 >> v1:172.21.15.113:6789/0 conn(0x7f75100acff0 legacy=0x7f7510066a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:04.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.059+0000 7f75153b8700 1 -- 172.21.15.45:0/4282494717 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75100c0320 con 0x7f7510067180 2023-12-22T10:02:04.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.063+0000 7f75153b8700 1 --2- 172.21.15.45:0/4282494717 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7510067180 0x7f75100c6c20 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f7508009e60 tx=0x7f7508009780).ready entity=mon.1 client_cookie=38e6a967fb5dedba server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:04.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.063+0000 7f750f7fe700 1 -- 172.21.15.45:0/4282494717 <== mon.1 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750800e070 con 0x7f7510067180 2023-12-22T10:02:04.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.063+0000 7f750f7fe700 1 -- 172.21.15.45:0/4282494717 <== mon.1 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f750800bb60 con 0x7f7510067180 2023-12-22T10:02:04.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.063+0000 7f750f7fe700 1 -- 172.21.15.45:0/4282494717 <== mon.1 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7508012410 con 0x7f7510067180 2023-12-22T10:02:04.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.063+0000 7f7515bb9700 1 -- 172.21.15.45:0/4282494717 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7510067180 msgr2=0x7f75100c6c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:04.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.063+0000 7f7515bb9700 1 --2- 172.21.15.45:0/4282494717 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7510067180 0x7f75100c6c20 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f7508009e60 tx=0x7f7508009780).stop 2023-12-22T10:02:04.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.063+0000 7f7515bb9700 1 -- 172.21.15.45:0/4282494717 shutdown_connections 2023-12-22T10:02:04.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.063+0000 7f7515bb9700 1 --2- 172.21.15.45:0/4282494717 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7510067180 0x7f75100c6c20 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:04.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.063+0000 7f7515bb9700 1 --2- 172.21.15.45:0/4282494717 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f75100acc10 0x7f75100bfcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:04.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.063+0000 7f7515bb9700 1 -- 172.21.15.45:0/4282494717 >> 172.21.15.45:0/4282494717 conn(0x7f75100cb330 msgr2=0x7f75100c7300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:02:04.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.063+0000 7f7515bb9700 1 -- 172.21.15.45:0/4282494717 shutdown_connections 2023-12-22T10:02:04.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.063+0000 7f7515bb9700 1 -- 172.21.15.45:0/4282494717 wait complete. 2023-12-22T10:02:04.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.067+0000 7f7515bb9700 1 Processor -- start 2023-12-22T10:02:04.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.067+0000 7f7515bb9700 1 -- start start 2023-12-22T10:02:04.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.067+0000 7f7515bb9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7510067180 0x7f75100c6450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:04.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.067+0000 7f7515bb9700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f75100acc10 0x7f75101568d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:04.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.067+0000 7f7515bb9700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f75100acff0 0x7f75101453f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:04.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.067+0000 7f7515bb9700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7510156dc0 con 0x7f7510067180 2023-12-22T10:02:04.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.067+0000 7f7515bb9700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75100c53b0 con 0x7f75100acff0 2023-12-22T10:02:04.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.067+0000 7f7515bb9700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75100c5690 con 0x7f75100acc10 2023-12-22T10:02:04.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.067+0000 7f7514bb7700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7510067180 0x7f75100c6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:04.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.067+0000 7f7514bb7700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7510067180 0x7f75100c6450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47170/0 (socket says 172.21.15.45:47170) 2023-12-22T10:02:04.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.067+0000 7f7514bb7700 1 -- 172.21.15.45:0/269840115 learned_addr learned my addr 172.21.15.45:0/269840115 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:02:04.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.067+0000 7f750ffff700 1 --2- 172.21.15.45:0/269840115 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f75100acc10 0x7f75101568d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:04.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.067+0000 7f75153b8700 1 --2- 172.21.15.45:0/269840115 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f75100acff0 0x7f75101453f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:04.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.067+0000 7f7514bb7700 1 -- 172.21.15.45:0/269840115 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f75100acc10 msgr2=0x7f75101568d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:04.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.067+0000 7f7514bb7700 1 --2- 172.21.15.45:0/269840115 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f75100acc10 0x7f75101568d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:04.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.067+0000 7f7514bb7700 1 -- 172.21.15.45:0/269840115 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f75100acff0 msgr2=0x7f75101453f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:04.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.067+0000 7f7514bb7700 1 --2- 172.21.15.45:0/269840115 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f75100acff0 0x7f75101453f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:04.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.067+0000 7f7514bb7700 1 -- 172.21.15.45:0/269840115 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7508009a20 con 0x7f7510067180 2023-12-22T10:02:04.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.067+0000 7f7514bb7700 1 --2- 172.21.15.45:0/269840115 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7510067180 0x7f75100c6450 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 rx=0x7f750400e930 tx=0x7f7504009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:04.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.071+0000 7f750cff9700 1 -- 172.21.15.45:0/269840115 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7504012600 con 0x7f7510067180 2023-12-22T10:02:04.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.071+0000 7f750cff9700 1 -- 172.21.15.45:0/269840115 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7504012760 con 0x7f7510067180 2023-12-22T10:02:04.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.071+0000 7f750cff9700 1 -- 172.21.15.45:0/269840115 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7504012ae0 con 0x7f7510067180 2023-12-22T10:02:04.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.071+0000 7f7515bb9700 1 -- 172.21.15.45:0/269840115 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75100c5970 con 0x7f7510067180 2023-12-22T10:02:04.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.071+0000 7f7515bb9700 1 -- 172.21.15.45:0/269840115 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75100c5f30 con 0x7f7510067180 2023-12-22T10:02:04.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.071+0000 7f7515bb9700 1 -- 172.21.15.45:0/269840115 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7510066f50 con 0x7f7510067180 2023-12-22T10:02:04.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.071+0000 7f750cff9700 1 -- 172.21.15.45:0/269840115 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f750401b400 con 0x7f7510067180 2023-12-22T10:02:04.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.075+0000 7f750cff9700 1 --2- 172.21.15.45:0/269840115 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f74f405a510 0x7f74f405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:04.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.075+0000 7f750cff9700 1 -- 172.21.15.45:0/269840115 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6222+0+0 (secure 0 0 0) 0x7f7504074cf0 con 0x7f7510067180 2023-12-22T10:02:04.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.075+0000 7f750ffff700 1 --2- 172.21.15.45:0/269840115 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f74f405a510 0x7f74f405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:04.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.075+0000 7f750ffff700 1 --2- 172.21.15.45:0/269840115 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f74f405a510 0x7f74f405c9d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7f7510156330 tx=0x7f74fc009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:04.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.079+0000 7f750cff9700 1 -- 172.21.15.45:0/269840115 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f7510066f50 con 0x7f7510067180 2023-12-22T10:02:04.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.263+0000 7f7515bb9700 1 -- 172.21.15.45:0/269840115 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f7510066f50 con 0x7f7510067180 2023-12-22T10:02:04.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.263+0000 7f750cff9700 1 -- 172.21.15.45:0/269840115 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=-16 pool 'cephfs_data' is in use by CephFS v45) v1 ==== 181+0+0 (secure 0 0 0) 0x7f7510066f50 con 0x7f7510067180 2023-12-22T10:02:04.265 INFO:teuthology.orchestra.run.smithi045.stderr:Error EBUSY: pool 'cephfs_data' is in use by CephFS 2023-12-22T10:02:04.277 DEBUG:teuthology.orchestra.run:got remote process result: 16 2023-12-22T10:02:04.278 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T10:02:04.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.439+0000 7fdb0a079700 1 Processor -- start 2023-12-22T10:02:04.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.439+0000 7fdb0a079700 1 -- start start 2023-12-22T10:02:04.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.443+0000 7fdb0a079700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fdb041578a0 0x7fdb04157c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:04.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.443+0000 7fdb0a079700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fdb04068a80 0x7fdb04068ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:04.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.443+0000 7fdb0a079700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb040c1d50 con 0x7fdb040c21e0 2023-12-22T10:02:04.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.443+0000 7fdb0a079700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb040c1420 con 0x7fdb041578a0 2023-12-22T10:02:04.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.443+0000 7fdb0a079700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb040c1700 con 0x7fdb04068a80 2023-12-22T10:02:04.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.443+0000 7fdb09077700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fdb041578a0 0x7fdb04157c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:04.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.443+0000 7fdb08876700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fdb04068a80 0x7fdb04068ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:04.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.443+0000 7fdb09077700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fdb041578a0 0x7fdb04157c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.45:45814/0 (socket says 172.21.15.45:45814) 2023-12-22T10:02:04.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.443+0000 7fdb09077700 1 -- 172.21.15.45:0/683336230 learned_addr learned my addr 172.21.15.45:0/683336230 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:02:04.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.443+0000 7fdb09077700 1 -- 172.21.15.45:0/683336230 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fdb04068a80 msgr2=0x7fdb04068ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:02:04.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.443+0000 7fdb09077700 1 --2- 172.21.15.45:0/683336230 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fdb04068a80 0x7fdb04068ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:04.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.443+0000 7fdb09077700 1 -- 172.21.15.45:0/683336230 >> v1:172.21.15.113:6789/0 conn(0x7fdb040c21e0 legacy=0x7fdb041535a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:04.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.443+0000 7fdb09077700 1 -- 172.21.15.45:0/683336230 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb040c19e0 con 0x7fdb041578a0 2023-12-22T10:02:04.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.447+0000 7fdb09077700 1 --2- 172.21.15.45:0/683336230 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdb041578a0 0x7fdb04157c80 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7fdb00006fd0 tx=0x7fdb000090f0).ready entity=mon.1 client_cookie=74c02086102fb8bc server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:04.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.447+0000 7fdafbfff700 1 -- 172.21.15.45:0/683336230 <== mon.1 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb0000b580 con 0x7fdb041578a0 2023-12-22T10:02:04.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.447+0000 7fdafbfff700 1 -- 172.21.15.45:0/683336230 <== mon.1 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb0000b6e0 con 0x7fdb041578a0 2023-12-22T10:02:04.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.447+0000 7fdafbfff700 1 -- 172.21.15.45:0/683336230 <== mon.1 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb0000ba60 con 0x7fdb041578a0 2023-12-22T10:02:04.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.447+0000 7fdb0a079700 1 -- 172.21.15.45:0/683336230 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdb041578a0 msgr2=0x7fdb04157c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:04.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.447+0000 7fdb0a079700 1 --2- 172.21.15.45:0/683336230 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdb041578a0 0x7fdb04157c80 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7fdb00006fd0 tx=0x7fdb000090f0).stop 2023-12-22T10:02:04.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.447+0000 7fdb0a079700 1 -- 172.21.15.45:0/683336230 shutdown_connections 2023-12-22T10:02:04.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.447+0000 7fdb0a079700 1 --2- 172.21.15.45:0/683336230 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fdb04068a80 0x7fdb04068ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:04.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.447+0000 7fdb0a079700 1 --2- 172.21.15.45:0/683336230 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdb041578a0 0x7fdb04157c80 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:04.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.447+0000 7fdb0a079700 1 -- 172.21.15.45:0/683336230 >> 172.21.15.45:0/683336230 conn(0x7fdb04067540 msgr2=0x7fdb040c6460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:02:04.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.447+0000 7fdb0a079700 1 -- 172.21.15.45:0/683336230 shutdown_connections 2023-12-22T10:02:04.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.447+0000 7fdb0a079700 1 -- 172.21.15.45:0/683336230 wait complete. 2023-12-22T10:02:04.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.451+0000 7fdb0a079700 1 Processor -- start 2023-12-22T10:02:04.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.451+0000 7fdb0a079700 1 -- start start 2023-12-22T10:02:04.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.451+0000 7fdb0a079700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb04068a80 0x7fdb0414c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:04.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.451+0000 7fdb0a079700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdb040c21e0 0x7fdb04163fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:04.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.451+0000 7fdb0a079700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fdb041578a0 0x7fdb041644b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:04.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.451+0000 7fdb0a079700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb04153510 con 0x7fdb04068a80 2023-12-22T10:02:04.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.451+0000 7fdb0a079700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb040bd500 con 0x7fdb040c21e0 2023-12-22T10:02:04.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.451+0000 7fdb0a079700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb040be080 con 0x7fdb041578a0 2023-12-22T10:02:04.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.451+0000 7fdb09077700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb04068a80 0x7fdb0414c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:04.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.451+0000 7fdb09077700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb04068a80 0x7fdb0414c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47186/0 (socket says 172.21.15.45:47186) 2023-12-22T10:02:04.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.451+0000 7fdb09077700 1 -- 172.21.15.45:0/4133972145 learned_addr learned my addr 172.21.15.45:0/4133972145 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:02:04.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.455+0000 7fdb08876700 1 --2- 172.21.15.45:0/4133972145 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdb040c21e0 0x7fdb04163fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:04.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.455+0000 7fdb09878700 1 --2- 172.21.15.45:0/4133972145 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fdb041578a0 0x7fdb041644b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:04.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.455+0000 7fdb09077700 1 -- 172.21.15.45:0/4133972145 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fdb041578a0 msgr2=0x7fdb041644b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:04.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.455+0000 7fdb09077700 1 --2- 172.21.15.45:0/4133972145 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fdb041578a0 0x7fdb041644b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:04.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.455+0000 7fdb09077700 1 -- 172.21.15.45:0/4133972145 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdb040c21e0 msgr2=0x7fdb04163fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:04.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.455+0000 7fdb09077700 1 --2- 172.21.15.45:0/4133972145 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdb040c21e0 0x7fdb04163fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:04.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.455+0000 7fdb09077700 1 -- 172.21.15.45:0/4133972145 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb00009370 con 0x7fdb04068a80 2023-12-22T10:02:04.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.455+0000 7fdb09077700 1 --2- 172.21.15.45:0/4133972145 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb04068a80 0x7fdb0414c8b0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0x7fdb00009130 tx=0x7fdb00017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:04.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.455+0000 7fdaf97fa700 1 -- 172.21.15.45:0/4133972145 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb0000b850 con 0x7fdb04068a80 2023-12-22T10:02:04.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.455+0000 7fdaf97fa700 1 -- 172.21.15.45:0/4133972145 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb0000b9b0 con 0x7fdb04068a80 2023-12-22T10:02:04.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.455+0000 7fdaf97fa700 1 -- 172.21.15.45:0/4133972145 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb0001b660 con 0x7fdb04068a80 2023-12-22T10:02:04.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.455+0000 7fdb0a079700 1 -- 172.21.15.45:0/4133972145 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb040bd750 con 0x7fdb04068a80 2023-12-22T10:02:04.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.455+0000 7fdb0a079700 1 -- 172.21.15.45:0/4133972145 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb040bdd10 con 0x7fdb04068a80 2023-12-22T10:02:04.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.455+0000 7fdb0a079700 1 -- 172.21.15.45:0/4133972145 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb040638f0 con 0x7fdb04068a80 2023-12-22T10:02:04.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.459+0000 7fdaf97fa700 1 -- 172.21.15.45:0/4133972145 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fdb0001ba50 con 0x7fdb04068a80 2023-12-22T10:02:04.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.459+0000 7fdaf97fa700 1 --2- 172.21.15.45:0/4133972145 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fdae805a510 0x7fdae805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:04.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.459+0000 7fdaf97fa700 1 -- 172.21.15.45:0/4133972145 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6222+0+0 (secure 0 0 0) 0x7fdb00076100 con 0x7fdb04068a80 2023-12-22T10:02:04.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.459+0000 7fdb08876700 1 --2- 172.21.15.45:0/4133972145 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fdae805a510 0x7fdae805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:04.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.463+0000 7fdb08876700 1 --2- 172.21.15.45:0/4133972145 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fdae805a510 0x7fdae805c9d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7fdb040c6720 tx=0x7fdaf4008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:04.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.463+0000 7fdaf97fa700 1 -- 172.21.15.45:0/4133972145 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fdb040638f0 con 0x7fdb04068a80 2023-12-22T10:02:04.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.627+0000 7fdb0a079700 1 -- 172.21.15.45:0/4133972145 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdb040638f0 con 0x7fdb04068a80 2023-12-22T10:02:04.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.627+0000 7fdaf97fa700 1 -- 172.21.15.45:0/4133972145 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) v1 ==== 74+0+17072 (secure 0 0 0) 0x7fdb040638f0 con 0x7fdb04068a80 2023-12-22T10:02:04.629 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:02:04.629 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":45,"fsid":"98b0837e-5e68-4c8f-a1a0-e9424baaad8f","created":"2023-12-22T10:00:15.010174+0000","modified":"2023-12-22T10:02:03.840874+0000","last_up_change":"2023-12-22T10:00:24.980513+0000","last_in_change":"2023-12-22T10:00:17.887172+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-12-22T10:00:25.069641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-12-22T10:00:26.906399+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-22T10:01:34.130811+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"recovery_fs"}}},{"pool":7,"pool_name":"recovery_fs_metadata","create_time":"2023-12-22T10:01:49.073877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"recovery_fs"}}}],"osds":[{"osd":0,"uuid":"e19943a0-1c6b-47df-b6bb-383472077890","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":33777},{"type":"v1","addr":"172.21.15.45:6819","nonce":33777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":33777},{"type":"v1","addr":"172.21.15.45:6822","nonce":33777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":33777},{"type":"v1","addr":"172.21.15.45:6830","nonce":33777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":33777},{"type":"v1","addr":"172.21.15.45:6826","nonce":33777}]},"public_addr":"172.21.15.45:6819/33777","cluster_addr":"172.21.15.45:6822/33777","heartbeat_back_addr":"172.21.15.45:6830/33777","heartbeat_front_addr":"172.21.15.45:6826/33777","state":["exists","up"]},{"osd":1,"uuid":"69670f34-f082-45a7-8f67-e962acc136e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":33775},{"type":"v1","addr":"172.21.15.45:6809","nonce":33775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":33775},{"type":"v1","addr":"172.21.15.45:6811","nonce":33775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":33775},{"type":"v1","addr":"172.21.15.45:6815","nonce":33775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":33775},{"type":"v1","addr":"172.21.15.45:6813","nonce":33775}]},"public_addr":"172.21.15.45:6809/33775","cluster_addr":"172.21.15.45:6811/33775","heartbeat_back_addr":"172.21.15.45:6815/33775","heartbeat_front_addr":"172.21.15.45:6813/33775","state":["exists","up"]},{"osd":2,"uuid":"d909d49b-82b8-401b-9947-e49dd167bb95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":33776},{"type":"v1","addr":"172.21.15.45:6801","nonce":33776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":33776},{"type":"v1","addr":"172.21.15.45:6803","nonce":33776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":33776},{"type":"v1","addr":"172.21.15.45:6807","nonce":33776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":33776},{"type":"v1","addr":"172.21.15.45:6805","nonce":33776}]},"public_addr":"172.21.15.45:6801/33776","cluster_addr":"172.21.15.45:6803/33776","heartbeat_back_addr":"172.21.15.45:6807/33776","heartbeat_front_addr":"172.21.15.45:6805/33776","state":["exists","up"]},{"osd":3,"uuid":"db104ca9-3a94-4d39-a2be-bd06db888095","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":33782},{"type":"v1","addr":"172.21.15.45:6817","nonce":33782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":33782},{"type":"v1","addr":"172.21.15.45:6823","nonce":33782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":33782},{"type":"v1","addr":"172.21.15.45:6831","nonce":33782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":33782},{"type":"v1","addr":"172.21.15.45:6827","nonce":33782}]},"public_addr":"172.21.15.45:6817/33782","cluster_addr":"172.21.15.45:6823/33782","heartbeat_back_addr":"172.21.15.45:6831/33782","heartbeat_front_addr":"172.21.15.45:6827/33782","state":["exists","up"]},{"osd":4,"uuid":"9f4eaff4-e433-4479-a0d1-ee7a33375ca6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":34099},{"type":"v1","addr":"172.21.15.113:6811","nonce":34099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":34099},{"type":"v1","addr":"172.21.15.113:6815","nonce":34099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":34099},{"type":"v1","addr":"172.21.15.113:6823","nonce":34099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6816","nonce":34099},{"type":"v1","addr":"172.21.15.113:6818","nonce":34099}]},"public_addr":"172.21.15.113:6811/34099","cluster_addr":"172.21.15.113:6815/34099","heartbeat_back_addr":"172.21.15.113:6823/34099","heartbeat_front_addr":"172.21.15.113:6818/34099","state":["exists","up"]},{"osd":5,"uuid":"1efc5591-180b-43af-8611-0068aadc5aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":34100},{"type":"v1","addr":"172.21.15.113:6801","nonce":34100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":34100},{"type":"v1","addr":"172.21.15.113:6803","nonce":34100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":34100},{"type":"v1","addr":"172.21.15.113:6807","nonce":34100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":34100},{"type":"v1","addr":"172.21.15.113:6805","nonce":34100}]},"public_addr":"172.21.15.113:6801/34100","cluster_addr":"172.21.15.113:6803/34100","heartbeat_back_addr":"172.21.15.113:6807/34100","heartbeat_front_addr":"172.21.15.113:6805/34100","state":["exists","up"]},{"osd":6,"uuid":"6c89d9d8-c153-4a48-afa9-97e4c403f1ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":34101},{"type":"v1","addr":"172.21.15.113:6810","nonce":34101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6812","nonce":34101},{"type":"v1","addr":"172.21.15.113:6814","nonce":34101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6822","nonce":34101},{"type":"v1","addr":"172.21.15.113:6824","nonce":34101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":34101},{"type":"v1","addr":"172.21.15.113:6819","nonce":34101}]},"public_addr":"172.21.15.113:6810/34101","cluster_addr":"172.21.15.113:6814/34101","heartbeat_back_addr":"172.21.15.113:6824/34101","heartbeat_front_addr":"172.21.15.113:6819/34101","state":["exists","up"]},{"osd":7,"uuid":"1855e70c-23f6-4c08-ad7f-774c2148235b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6821","nonce":34102},{"type":"v1","addr":"172.21.15.113:6825","nonce":34102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":34102},{"type":"v1","addr":"172.21.15.113:6827","nonce":34102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":34102},{"type":"v1","addr":"172.21.15.113:6831","nonce":34102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6828","nonce":34102},{"type":"v1","addr":"172.21.15.113:6829","nonce":34102}]},"public_addr":"172.21.15.113:6825/34102","cluster_addr":"172.21.15.113:6827/34102","heartbeat_back_addr":"172.21.15.113:6831/34102","heartbeat_front_addr":"172.21.15.113:6829/34102","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.812672+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.825045+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.700105+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.856563+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.954683+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.883234+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.883994+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.821686+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.45:6835/1879154206":"2023-12-23T10:01:45.243059+0000","172.21.15.45:6834/1879154206":"2023-12-23T10:01:45.243059+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T10:02:04.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.631+0000 7fdb0a079700 1 -- 172.21.15.45:0/4133972145 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fdae805a510 msgr2=0x7fdae805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:04.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.631+0000 7fdb0a079700 1 --2- 172.21.15.45:0/4133972145 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fdae805a510 0x7fdae805c9d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7fdb040c6720 tx=0x7fdaf4008040).stop 2023-12-22T10:02:04.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.631+0000 7fdb0a079700 1 -- 172.21.15.45:0/4133972145 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb04068a80 msgr2=0x7fdb0414c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:04.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.631+0000 7fdb0a079700 1 --2- 172.21.15.45:0/4133972145 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb04068a80 0x7fdb0414c8b0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0x7fdb00009130 tx=0x7fdb00017000).stop 2023-12-22T10:02:04.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.631+0000 7fdb0a079700 1 -- 172.21.15.45:0/4133972145 shutdown_connections 2023-12-22T10:02:04.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.631+0000 7fdb0a079700 1 --2- 172.21.15.45:0/4133972145 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fdae805a510 0x7fdae805c9d0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:04.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.631+0000 7fdb0a079700 1 --2- 172.21.15.45:0/4133972145 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fdb041578a0 0x7fdb041644b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:04.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.631+0000 7fdb0a079700 1 --2- 172.21.15.45:0/4133972145 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fdb040c21e0 0x7fdb04163fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:04.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.631+0000 7fdb0a079700 1 --2- 172.21.15.45:0/4133972145 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb04068a80 0x7fdb0414c8b0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:04.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.631+0000 7fdb0a079700 1 -- 172.21.15.45:0/4133972145 >> 172.21.15.45:0/4133972145 conn(0x7fdb04067540 msgr2=0x7fdb040c2690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:02:04.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.631+0000 7fdb0a079700 1 -- 172.21.15.45:0/4133972145 shutdown_connections 2023-12-22T10:02:04.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.631+0000 7fdb0a079700 1 -- 172.21.15.45:0/4133972145 wait complete. 2023-12-22T10:02:04.652 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-12-22T10:00:25.069641+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-12-22T10:00:26.906399+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-12-22T10:01:34.130811+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'recovery_fs'}}}, {'pool': 7, 'pool_name': 'recovery_fs_metadata', 'create_time': '2023-12-22T10:01:49.073877+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'recovery_fs'}}}] 2023-12-22T10:02:04.653 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-12-22T10:02:04.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.823+0000 7fcfa6af1700 1 Processor -- start 2023-12-22T10:02:04.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.823+0000 7fcfa6af1700 1 -- start start 2023-12-22T10:02:04.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.823+0000 7fcfa6af1700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fcfa00c73d0 0x7fcfa00c7810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:04.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.823+0000 7fcfa6af1700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fcfa00aaa70 0x7fcfa00aaf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:04.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.823+0000 7fcfa6af1700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfa00aa600 con 0x7fcfa0156e50 2023-12-22T10:02:04.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.823+0000 7fcfa6af1700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfa00c6cb0 con 0x7fcfa00aaa70 2023-12-22T10:02:04.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.823+0000 7fcfa6af1700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa00c56b0 con 0x7fcfa00c73d0 2023-12-22T10:02:04.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.823+0000 7fcf9ffff700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fcfa00c73d0 0x7fcfa00c7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:04.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.823+0000 7fcfa508e700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fcfa00aaa70 0x7fcfa00aaf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:04.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.823+0000 7fcf9ffff700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fcfa00c73d0 0x7fcfa00c7810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.113:3301/0 says I am v2:172.21.15.45:42746/0 (socket says 172.21.15.45:42746) 2023-12-22T10:02:04.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.823+0000 7fcf9ffff700 1 -- 172.21.15.45:0/978452266 learned_addr learned my addr 172.21.15.45:0/978452266 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:02:04.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.827+0000 7fcf9ffff700 1 -- 172.21.15.45:0/978452266 >> v2:172.21.15.113:3300/0 conn(0x7fcfa00aaa70 msgr2=0x7fcfa00aaf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:02:04.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.827+0000 7fcf9ffff700 1 --2- 172.21.15.45:0/978452266 >> v2:172.21.15.113:3300/0 conn(0x7fcfa00aaa70 0x7fcfa00aaf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:04.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.827+0000 7fcf9ffff700 1 -- 172.21.15.45:0/978452266 >> v1:172.21.15.113:6789/0 conn(0x7fcfa0156e50 legacy=0x7fcfa00c4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:04.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.827+0000 7fcf9ffff700 1 -- 172.21.15.45:0/978452266 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfa00c7d00 con 0x7fcfa00c73d0 2023-12-22T10:02:04.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.827+0000 7fcf9ffff700 1 --2- 172.21.15.45:0/978452266 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fcfa00c73d0 0x7fcfa00c7810 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7fcf8c006fd0 tx=0x7fcf8c0090f0).ready entity=mon.2 client_cookie=4248543cac049993 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:04.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.827+0000 7fcf9f7fe700 1 -- 172.21.15.45:0/978452266 <== mon.2 v2:172.21.15.113:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf8c00b580 con 0x7fcfa00c73d0 2023-12-22T10:02:04.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.827+0000 7fcf9f7fe700 1 -- 172.21.15.45:0/978452266 <== mon.2 v2:172.21.15.113:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf8c00b6e0 con 0x7fcfa00c73d0 2023-12-22T10:02:04.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.827+0000 7fcf9f7fe700 1 -- 172.21.15.45:0/978452266 <== mon.2 v2:172.21.15.113:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf8c00ba60 con 0x7fcfa00c73d0 2023-12-22T10:02:04.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.827+0000 7fcfa6af1700 1 -- 172.21.15.45:0/978452266 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fcfa00c73d0 msgr2=0x7fcfa00c7810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:04.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.827+0000 7fcfa6af1700 1 --2- 172.21.15.45:0/978452266 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fcfa00c73d0 0x7fcfa00c7810 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7fcf8c006fd0 tx=0x7fcf8c0090f0).stop 2023-12-22T10:02:04.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.827+0000 7fcfa6af1700 1 -- 172.21.15.45:0/978452266 shutdown_connections 2023-12-22T10:02:04.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.827+0000 7fcfa6af1700 1 --2- 172.21.15.45:0/978452266 >> v2:172.21.15.113:3300/0 conn(0x7fcfa00aaa70 0x7fcfa00aaf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:04.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.827+0000 7fcfa6af1700 1 --2- 172.21.15.45:0/978452266 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fcfa00c73d0 0x7fcfa00c7810 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:04.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.827+0000 7fcfa6af1700 1 -- 172.21.15.45:0/978452266 >> 172.21.15.45:0/978452266 conn(0x7fcfa0066a70 msgr2=0x7fcfa0066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:02:04.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.827+0000 7fcfa6af1700 1 -- 172.21.15.45:0/978452266 shutdown_connections 2023-12-22T10:02:04.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.827+0000 7fcfa6af1700 1 -- 172.21.15.45:0/978452266 wait complete. 2023-12-22T10:02:04.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.831+0000 7fcfa6af1700 1 Processor -- start 2023-12-22T10:02:04.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.831+0000 7fcfa6af1700 1 -- start start 2023-12-22T10:02:04.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.831+0000 7fcfa6af1700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcfa00aaa70 0x7fcfa0153ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:04.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.831+0000 7fcfa6af1700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcfa00c73d0 0x7fcfa0065d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:04.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.831+0000 7fcfa6af1700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fcfa0156e50 0x7fcfa00c08d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:04.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.831+0000 7fcfa6af1700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa00a9ba0 con 0x7fcfa00aaa70 2023-12-22T10:02:04.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.831+0000 7fcfa6af1700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa0153fc0 con 0x7fcfa00c73d0 2023-12-22T10:02:04.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.831+0000 7fcfa6af1700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa0168790 con 0x7fcfa0156e50 2023-12-22T10:02:04.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.831+0000 7fcfa488d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcfa00aaa70 0x7fcfa0153ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:04.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.831+0000 7fcfa488d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcfa00aaa70 0x7fcfa0153ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47190/0 (socket says 172.21.15.45:47190) 2023-12-22T10:02:04.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.831+0000 7fcfa488d700 1 -- 172.21.15.45:0/4182836518 learned_addr learned my addr 172.21.15.45:0/4182836518 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:02:04.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.831+0000 7fcfa508e700 1 --2- 172.21.15.45:0/4182836518 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fcfa0156e50 0x7fcfa00c08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:04.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.831+0000 7fcf9ffff700 1 --2- 172.21.15.45:0/4182836518 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcfa00c73d0 0x7fcfa0065d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:04.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.831+0000 7fcf9ffff700 1 -- 172.21.15.45:0/4182836518 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fcfa0156e50 msgr2=0x7fcfa00c08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:04.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.831+0000 7fcf9ffff700 1 --2- 172.21.15.45:0/4182836518 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fcfa0156e50 0x7fcfa00c08d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:04.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.831+0000 7fcf9ffff700 1 -- 172.21.15.45:0/4182836518 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcfa00aaa70 msgr2=0x7fcfa0153ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:04.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.831+0000 7fcf9ffff700 1 --2- 172.21.15.45:0/4182836518 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcfa00aaa70 0x7fcfa0153ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:04.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.831+0000 7fcf9ffff700 1 -- 172.21.15.45:0/4182836518 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf8c009370 con 0x7fcfa00c73d0 2023-12-22T10:02:04.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.831+0000 7fcfa488d700 1 --2- 172.21.15.45:0/4182836518 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcfa00aaa70 0x7fcfa0153ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-12-22T10:02:04.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.835+0000 7fcf9ffff700 1 --2- 172.21.15.45:0/4182836518 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcfa00c73d0 0x7fcfa0065d80 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7fcf8c014000 tx=0x7fcf8c017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:04.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.835+0000 7fcf9cff9700 1 -- 172.21.15.45:0/4182836518 <== mon.1 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf8c006d90 con 0x7fcfa00c73d0 2023-12-22T10:02:04.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.835+0000 7fcf9cff9700 1 -- 172.21.15.45:0/4182836518 <== mon.1 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf8c000bc0 con 0x7fcfa00c73d0 2023-12-22T10:02:04.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.835+0000 7fcfa6af1700 1 -- 172.21.15.45:0/4182836518 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfa0168a70 con 0x7fcfa00c73d0 2023-12-22T10:02:04.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.835+0000 7fcf9cff9700 1 -- 172.21.15.45:0/4182836518 <== mon.1 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf8c01c420 con 0x7fcfa00c73d0 2023-12-22T10:02:04.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.835+0000 7fcfa6af1700 1 -- 172.21.15.45:0/4182836518 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfa0169030 con 0x7fcfa00c73d0 2023-12-22T10:02:04.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.835+0000 7fcfa6af1700 1 -- 172.21.15.45:0/4182836518 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfa01695a0 con 0x7fcfa00c73d0 2023-12-22T10:02:04.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.839+0000 7fcf9cff9700 1 -- 172.21.15.45:0/4182836518 <== mon.1 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fcf8c01c810 con 0x7fcfa00c73d0 2023-12-22T10:02:04.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.839+0000 7fcf9cff9700 1 --2- 172.21.15.45:0/4182836518 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fcf8405a560 0x7fcf8405ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:04.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.839+0000 7fcf9cff9700 1 -- 172.21.15.45:0/4182836518 <== mon.1 v2:172.21.15.113:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6222+0+0 (secure 0 0 0) 0x7fcf8c0763e0 con 0x7fcfa00c73d0 2023-12-22T10:02:04.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.839+0000 7fcfa488d700 1 --2- 172.21.15.45:0/4182836518 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fcf8405a560 0x7fcf8405ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:04.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.839+0000 7fcfa488d700 1 --2- 172.21.15.45:0/4182836518 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fcf8405a560 0x7fcf8405ca20 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7fcfa00a9160 tx=0x7fcf94009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:04.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:04.847+0000 7fcf9cff9700 1 -- 172.21.15.45:0/4182836518 <== mon.1 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fcfa01695a0 con 0x7fcfa00c73d0 2023-12-22T10:02:05.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.019+0000 7fcfa6af1700 1 -- 172.21.15.45:0/4182836518 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fcfa01695a0 con 0x7fcfa00c73d0 2023-12-22T10:02:05.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.023+0000 7fcf9cff9700 1 -- 172.21.15.45:0/4182836518 <== mon.1 v2:172.21.15.113:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v45) v1 ==== 110+0+10 (secure 0 0 0) 0x7fcfa01695a0 con 0x7fcfa00c73d0 2023-12-22T10:02:05.022 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-12-22T10:02:05.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.023+0000 7fcfa6af1700 1 -- 172.21.15.45:0/4182836518 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fcf8405a560 msgr2=0x7fcf8405ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:05.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.023+0000 7fcfa6af1700 1 --2- 172.21.15.45:0/4182836518 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fcf8405a560 0x7fcf8405ca20 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7fcfa00a9160 tx=0x7fcf94009040).stop 2023-12-22T10:02:05.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.023+0000 7fcfa6af1700 1 -- 172.21.15.45:0/4182836518 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcfa00c73d0 msgr2=0x7fcfa0065d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:05.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.023+0000 7fcfa6af1700 1 --2- 172.21.15.45:0/4182836518 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcfa00c73d0 0x7fcfa0065d80 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7fcf8c014000 tx=0x7fcf8c017000).stop 2023-12-22T10:02:05.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.023+0000 7fcfa6af1700 1 -- 172.21.15.45:0/4182836518 shutdown_connections 2023-12-22T10:02:05.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.023+0000 7fcfa6af1700 1 --2- 172.21.15.45:0/4182836518 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fcf8405a560 0x7fcf8405ca20 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:05.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.023+0000 7fcfa6af1700 1 --2- 172.21.15.45:0/4182836518 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fcfa0156e50 0x7fcfa00c08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:05.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.023+0000 7fcfa6af1700 1 --2- 172.21.15.45:0/4182836518 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fcfa00c73d0 0x7fcfa0065d80 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:05.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.023+0000 7fcfa6af1700 1 --2- 172.21.15.45:0/4182836518 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcfa00aaa70 0x7fcfa0153ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:05.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.023+0000 7fcfa6af1700 1 -- 172.21.15.45:0/4182836518 >> 172.21.15.45:0/4182836518 conn(0x7fcfa0066a70 msgr2=0x7fcfa00ab830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:02:05.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.023+0000 7fcfa6af1700 1 -- 172.21.15.45:0/4182836518 shutdown_connections 2023-12-22T10:02:05.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.023+0000 7fcfa6af1700 1 -- 172.21.15.45:0/4182836518 wait complete. 2023-12-22T10:02:05.044 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-12-22T10:02:05.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.223+0000 7efe3401b700 1 Processor -- start 2023-12-22T10:02:05.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.223+0000 7efe3401b700 1 -- start start 2023-12-22T10:02:05.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.227+0000 7efe3401b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7efe2c0c1d80 0x7efe2c158120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:05.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.227+0000 7efe3401b700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe2c069180 con 0x7efe2c157d40 2023-12-22T10:02:05.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.227+0000 7efe3401b700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe2c069460 con 0x7efe2c065930 2023-12-22T10:02:05.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.227+0000 7efe3401b700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe2c069e00 con 0x7efe2c0c1d80 2023-12-22T10:02:05.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.227+0000 7efe315b6700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7efe2c0c1d80 0x7efe2c158120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:05.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.227+0000 7efe315b6700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7efe2c0c1d80 0x7efe2c158120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47196/0 (socket says 172.21.15.45:47196) 2023-12-22T10:02:05.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.227+0000 7efe315b6700 1 -- 172.21.15.45:0/267098128 learned_addr learned my addr 172.21.15.45:0/267098128 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:02:05.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.227+0000 7efe315b6700 1 -- 172.21.15.45:0/267098128 >> v1:172.21.15.113:6789/0 conn(0x7efe2c065930 legacy=0x7efe2c0a5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:02:05.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.227+0000 7efe315b6700 1 -- 172.21.15.45:0/267098128 >> v1:172.21.15.45:6789/0 conn(0x7efe2c157d40 legacy=0x7efe2c0c1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:05.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.227+0000 7efe315b6700 1 -- 172.21.15.45:0/267098128 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe2c069740 con 0x7efe2c0c1d80 2023-12-22T10:02:05.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.227+0000 7efe315b6700 1 --2- 172.21.15.45:0/267098128 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe2c0c1d80 0x7efe2c158120 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 rx=0x7efe1c006fd0 tx=0x7efe1c0090f0).ready entity=mon.0 client_cookie=aff4b5c215c191c1 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:05.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.227+0000 7efe30db5700 1 -- 172.21.15.45:0/267098128 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe1c00b600 con 0x7efe2c0c1d80 2023-12-22T10:02:05.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.227+0000 7efe30db5700 1 -- 172.21.15.45:0/267098128 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe1c00b760 con 0x7efe2c0c1d80 2023-12-22T10:02:05.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.227+0000 7efe30db5700 1 -- 172.21.15.45:0/267098128 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe1c00bb00 con 0x7efe2c0c1d80 2023-12-22T10:02:05.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.231+0000 7efe3401b700 1 -- 172.21.15.45:0/267098128 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe2c0c1d80 msgr2=0x7efe2c158120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:05.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.231+0000 7efe3401b700 1 --2- 172.21.15.45:0/267098128 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe2c0c1d80 0x7efe2c158120 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 rx=0x7efe1c006fd0 tx=0x7efe1c0090f0).stop 2023-12-22T10:02:05.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.231+0000 7efe3401b700 1 -- 172.21.15.45:0/267098128 shutdown_connections 2023-12-22T10:02:05.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.231+0000 7efe3401b700 1 --2- 172.21.15.45:0/267098128 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe2c0c1d80 0x7efe2c158120 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:05.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.231+0000 7efe3401b700 1 -- 172.21.15.45:0/267098128 >> 172.21.15.45:0/267098128 conn(0x7efe2c066a70 msgr2=0x7efe2c066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:02:05.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.231+0000 7efe3401b700 1 -- 172.21.15.45:0/267098128 shutdown_connections 2023-12-22T10:02:05.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.231+0000 7efe3401b700 1 -- 172.21.15.45:0/267098128 wait complete. 2023-12-22T10:02:05.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.235+0000 7efe3401b700 1 Processor -- start 2023-12-22T10:02:05.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.235+0000 7efe3401b700 1 -- start start 2023-12-22T10:02:05.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.235+0000 7efe3401b700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efe2c065930 0x7efe2c169330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:05.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.235+0000 7efe3401b700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7efe2c0c1d80 0x7efe2c0c4540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:05.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.235+0000 7efe3401b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe2c157d40 0x7efe2c0a58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:05.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.235+0000 7efe3401b700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe2c0bec90 con 0x7efe2c157d40 2023-12-22T10:02:05.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.235+0000 7efe3401b700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe2c0c5530 con 0x7efe2c065930 2023-12-22T10:02:05.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.235+0000 7efe3401b700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe2c0bef50 con 0x7efe2c0c1d80 2023-12-22T10:02:05.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.235+0000 7efe325b8700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe2c157d40 0x7efe2c0a58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:05.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.235+0000 7efe325b8700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe2c157d40 0x7efe2c0a58b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47198/0 (socket says 172.21.15.45:47198) 2023-12-22T10:02:05.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.235+0000 7efe325b8700 1 -- 172.21.15.45:0/2764033972 learned_addr learned my addr 172.21.15.45:0/2764033972 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:02:05.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.235+0000 7efe315b6700 1 --2- 172.21.15.45:0/2764033972 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7efe2c0c1d80 0x7efe2c0c4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:05.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.235+0000 7efe31db7700 1 --2- 172.21.15.45:0/2764033972 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efe2c065930 0x7efe2c169330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:05.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.235+0000 7efe325b8700 1 -- 172.21.15.45:0/2764033972 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7efe2c0c1d80 msgr2=0x7efe2c0c4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:05.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.235+0000 7efe325b8700 1 --2- 172.21.15.45:0/2764033972 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7efe2c0c1d80 0x7efe2c0c4540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:05.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.235+0000 7efe325b8700 1 -- 172.21.15.45:0/2764033972 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efe2c065930 msgr2=0x7efe2c169330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:05.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.235+0000 7efe325b8700 1 --2- 172.21.15.45:0/2764033972 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efe2c065930 0x7efe2c169330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:05.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.235+0000 7efe325b8700 1 -- 172.21.15.45:0/2764033972 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe1c009370 con 0x7efe2c157d40 2023-12-22T10:02:05.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.239+0000 7efe325b8700 1 --2- 172.21.15.45:0/2764033972 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe2c157d40 0x7efe2c0a58b0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7efe2400b810 tx=0x7efe240092d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:05.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.239+0000 7efe21ffb700 1 -- 172.21.15.45:0/2764033972 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe24001500 con 0x7efe2c157d40 2023-12-22T10:02:05.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.239+0000 7efe21ffb700 1 -- 172.21.15.45:0/2764033972 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe240016a0 con 0x7efe2c157d40 2023-12-22T10:02:05.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.239+0000 7efe21ffb700 1 -- 172.21.15.45:0/2764033972 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe24001a60 con 0x7efe2c157d40 2023-12-22T10:02:05.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.239+0000 7efe3401b700 1 -- 172.21.15.45:0/2764033972 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe2c0c4a30 con 0x7efe2c157d40 2023-12-22T10:02:05.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.239+0000 7efe3401b700 1 -- 172.21.15.45:0/2764033972 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe2c0c4f70 con 0x7efe2c157d40 2023-12-22T10:02:05.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.239+0000 7efe3401b700 1 -- 172.21.15.45:0/2764033972 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe2c06c070 con 0x7efe2c157d40 2023-12-22T10:02:05.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.239+0000 7efe21ffb700 1 -- 172.21.15.45:0/2764033972 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7efe24011460 con 0x7efe2c157d40 2023-12-22T10:02:05.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.243+0000 7efe21ffb700 1 --2- 172.21.15.45:0/2764033972 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7efe1005a510 0x7efe1005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:05.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.243+0000 7efe21ffb700 1 -- 172.21.15.45:0/2764033972 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6222+0+0 (secure 0 0 0) 0x7efe240742e0 con 0x7efe2c157d40 2023-12-22T10:02:05.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.243+0000 7efe31db7700 1 --2- 172.21.15.45:0/2764033972 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7efe1005a510 0x7efe1005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:05.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.243+0000 7efe31db7700 1 --2- 172.21.15.45:0/2764033972 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7efe1005a510 0x7efe1005c9d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7efe2c157740 tx=0x7efe28009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:05.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.251+0000 7efe21ffb700 1 -- 172.21.15.45:0/2764033972 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7efe24047ab0 con 0x7efe2c157d40 2023-12-22T10:02:05.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.415+0000 7efe3401b700 1 -- 172.21.15.45:0/2764033972 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7efe2c0c0af0 con 0x7efe2c157d40 2023-12-22T10:02:05.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.415+0000 7efe21ffb700 1 -- 172.21.15.45:0/2764033972 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v45) v1 ==== 92+0+10 (secure 0 0 0) 0x7efe2404b0d0 con 0x7efe2c157d40 2023-12-22T10:02:05.417 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-12-22T10:02:05.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.419+0000 7efe3401b700 1 -- 172.21.15.45:0/2764033972 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7efe1005a510 msgr2=0x7efe1005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:05.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.419+0000 7efe3401b700 1 --2- 172.21.15.45:0/2764033972 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7efe1005a510 0x7efe1005c9d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7efe2c157740 tx=0x7efe28009040).stop 2023-12-22T10:02:05.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.419+0000 7efe3401b700 1 -- 172.21.15.45:0/2764033972 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe2c157d40 msgr2=0x7efe2c0a58b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:05.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.419+0000 7efe3401b700 1 --2- 172.21.15.45:0/2764033972 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe2c157d40 0x7efe2c0a58b0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7efe2400b810 tx=0x7efe240092d0).stop 2023-12-22T10:02:05.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.419+0000 7efe3401b700 1 -- 172.21.15.45:0/2764033972 shutdown_connections 2023-12-22T10:02:05.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.419+0000 7efe3401b700 1 --2- 172.21.15.45:0/2764033972 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe2c157d40 0x7efe2c0a58b0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:05.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.419+0000 7efe3401b700 1 --2- 172.21.15.45:0/2764033972 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7efe1005a510 0x7efe1005c9d0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:05.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.419+0000 7efe3401b700 1 --2- 172.21.15.45:0/2764033972 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7efe2c0c1d80 0x7efe2c0c4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:05.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.419+0000 7efe3401b700 1 --2- 172.21.15.45:0/2764033972 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efe2c065930 0x7efe2c169330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:05.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.419+0000 7efe3401b700 1 -- 172.21.15.45:0/2764033972 >> 172.21.15.45:0/2764033972 conn(0x7efe2c066a70 msgr2=0x7efe2c0a7e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:02:05.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.419+0000 7efe3401b700 1 -- 172.21.15.45:0/2764033972 shutdown_connections 2023-12-22T10:02:05.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.419+0000 7efe3401b700 1 -- 172.21.15.45:0/2764033972 wait complete. 2023-12-22T10:02:05.441 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-22T10:02:05.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.607+0000 7fd182a5b700 1 Processor -- start 2023-12-22T10:02:05.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.607+0000 7fd182a5b700 1 -- start start 2023-12-22T10:02:05.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.607+0000 7fd182a5b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd17c0c3320 0x7fd17c0c3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:05.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.607+0000 7fd182a5b700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd17c0c23f0 0x7fd17c0c2880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:05.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.607+0000 7fd182a5b700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd17c065020 con 0x7fd17c153a50 2023-12-22T10:02:05.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.607+0000 7fd182a5b700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd17c065300 con 0x7fd17c0c3320 2023-12-22T10:02:05.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.611+0000 7fd182a5b700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd17c0655e0 con 0x7fd17c0c23f0 2023-12-22T10:02:05.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.611+0000 7fd173fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd17c0c3320 0x7fd17c0c3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:05.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.611+0000 7fd17bfff700 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7fd17c153a50 0x7fd17c153e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.45:39472/0 (socket says 172.21.15.45:39472) 2023-12-22T10:02:05.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.611+0000 7fd17bfff700 1 -- 172.21.15.45:0/1899362697 learned_addr learned my addr 172.21.15.45:0/1899362697 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:02:05.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.611+0000 7fd180ff8700 1 --2- 172.21.15.45:0/1899362697 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd17c0c23f0 0x7fd17c0c2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:05.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.611+0000 7fd17b7fe700 1 -- 172.21.15.45:0/1899362697 <== mon.1 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4026710624 0 0) 0x7fd17c065020 con 0x7fd17c153a50 2023-12-22T10:02:05.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.611+0000 7fd17b7fe700 1 -- 172.21.15.45:0/1899362697 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1680033f0 con 0x7fd17c153a50 2023-12-22T10:02:05.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.611+0000 7fd173fff700 1 -- 172.21.15.45:0/1899362697 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd17c0c23f0 msgr2=0x7fd17c0c2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:02:05.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.611+0000 7fd173fff700 1 --2- 172.21.15.45:0/1899362697 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd17c0c23f0 0x7fd17c0c2880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:05.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.611+0000 7fd173fff700 1 -- 172.21.15.45:0/1899362697 >> v1:172.21.15.113:6789/0 conn(0x7fd17c153a50 legacy=0x7fd17c153e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:05.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.611+0000 7fd173fff700 1 -- 172.21.15.45:0/1899362697 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd17c0658c0 con 0x7fd17c0c3320 2023-12-22T10:02:05.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.611+0000 7fd173fff700 1 --2- 172.21.15.45:0/1899362697 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd17c0c3320 0x7fd17c0c3750 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 rx=0x7fd164009760 tx=0x7fd164009060).ready entity=mon.0 client_cookie=b70bafa86446c928 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:05.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.611+0000 7fd17b7fe700 1 -- 172.21.15.45:0/1899362697 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd16400f510 con 0x7fd17c0c3320 2023-12-22T10:02:05.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.611+0000 7fd17b7fe700 1 -- 172.21.15.45:0/1899362697 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd16400f670 con 0x7fd17c0c3320 2023-12-22T10:02:05.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.611+0000 7fd17b7fe700 1 -- 172.21.15.45:0/1899362697 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd16400f9f0 con 0x7fd17c0c3320 2023-12-22T10:02:05.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.611+0000 7fd182a5b700 1 -- 172.21.15.45:0/1899362697 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd17c0c3320 msgr2=0x7fd17c0c3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:05.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.611+0000 7fd182a5b700 1 --2- 172.21.15.45:0/1899362697 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd17c0c3320 0x7fd17c0c3750 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 rx=0x7fd164009760 tx=0x7fd164009060).stop 2023-12-22T10:02:05.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.611+0000 7fd182a5b700 1 -- 172.21.15.45:0/1899362697 shutdown_connections 2023-12-22T10:02:05.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.611+0000 7fd182a5b700 1 --2- 172.21.15.45:0/1899362697 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd17c0c23f0 0x7fd17c0c2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:05.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.611+0000 7fd182a5b700 1 --2- 172.21.15.45:0/1899362697 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd17c0c3320 0x7fd17c0c3750 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:05.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.611+0000 7fd182a5b700 1 -- 172.21.15.45:0/1899362697 >> 172.21.15.45:0/1899362697 conn(0x7fd17c066a70 msgr2=0x7fd17c066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:02:05.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.615+0000 7fd182a5b700 1 -- 172.21.15.45:0/1899362697 shutdown_connections 2023-12-22T10:02:05.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.615+0000 7fd182a5b700 1 -- 172.21.15.45:0/1899362697 wait complete. 2023-12-22T10:02:05.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.615+0000 7fd182a5b700 1 Processor -- start 2023-12-22T10:02:05.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.615+0000 7fd182a5b700 1 -- start start 2023-12-22T10:02:05.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.615+0000 7fd182a5b700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd17c0c23f0 0x7fd17c154700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:05.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.615+0000 7fd182a5b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd17c0c3320 0x7fd17c0a48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:05.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.615+0000 7fd182a5b700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd17c153a50 0x7fd17c0a4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:05.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.615+0000 7fd182a5b700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd17c0a52a0 con 0x7fd17c0c3320 2023-12-22T10:02:05.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.615+0000 7fd182a5b700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd17c0aa730 con 0x7fd17c0c23f0 2023-12-22T10:02:05.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.615+0000 7fd182a5b700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd17c1575a0 con 0x7fd17c153a50 2023-12-22T10:02:05.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.619+0000 7fd173fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd17c0c3320 0x7fd17c0a48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:05.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.619+0000 7fd173fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd17c0c3320 0x7fd17c0a48c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47228/0 (socket says 172.21.15.45:47228) 2023-12-22T10:02:05.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.619+0000 7fd173fff700 1 -- 172.21.15.45:0/2310389719 learned_addr learned my addr 172.21.15.45:0/2310389719 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:02:05.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.619+0000 7fd17bfff700 1 --2- 172.21.15.45:0/2310389719 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd17c0c23f0 0x7fd17c154700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:05.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.619+0000 7fd180ff8700 1 --2- 172.21.15.45:0/2310389719 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd17c153a50 0x7fd17c0a4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:05.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.619+0000 7fd173fff700 1 -- 172.21.15.45:0/2310389719 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd17c153a50 msgr2=0x7fd17c0a4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:05.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.619+0000 7fd173fff700 1 --2- 172.21.15.45:0/2310389719 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd17c153a50 0x7fd17c0a4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:05.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.619+0000 7fd173fff700 1 -- 172.21.15.45:0/2310389719 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd17c0c23f0 msgr2=0x7fd17c154700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:05.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.619+0000 7fd173fff700 1 --2- 172.21.15.45:0/2310389719 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd17c0c23f0 0x7fd17c154700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:05.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.619+0000 7fd173fff700 1 -- 172.21.15.45:0/2310389719 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1640092a0 con 0x7fd17c0c3320 2023-12-22T10:02:05.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.619+0000 7fd17bfff700 1 --2- 172.21.15.45:0/2310389719 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd17c0c23f0 0x7fd17c154700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T10:02:05.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.619+0000 7fd173fff700 1 --2- 172.21.15.45:0/2310389719 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd17c0c3320 0x7fd17c0a48c0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 rx=0x7fd164009d50 tx=0x7fd164017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:05.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.619+0000 7fd178ff9700 1 -- 172.21.15.45:0/2310389719 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd16400f9f0 con 0x7fd17c0c3320 2023-12-22T10:02:05.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.619+0000 7fd178ff9700 1 -- 172.21.15.45:0/2310389719 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd164000c90 con 0x7fd17c0c3320 2023-12-22T10:02:05.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.619+0000 7fd178ff9700 1 -- 172.21.15.45:0/2310389719 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd16401b660 con 0x7fd17c0c3320 2023-12-22T10:02:05.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.619+0000 7fd182a5b700 1 -- 172.21.15.45:0/2310389719 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd17c0aa9f0 con 0x7fd17c0c3320 2023-12-22T10:02:05.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.619+0000 7fd182a5b700 1 -- 172.21.15.45:0/2310389719 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd17c154bf0 con 0x7fd17c0c3320 2023-12-22T10:02:05.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.619+0000 7fd182a5b700 1 -- 172.21.15.45:0/2310389719 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd17c0aaef0 con 0x7fd17c0c3320 2023-12-22T10:02:05.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.623+0000 7fd178ff9700 1 -- 172.21.15.45:0/2310389719 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fd16401ba10 con 0x7fd17c0c3320 2023-12-22T10:02:05.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.623+0000 7fd178ff9700 1 --2- 172.21.15.45:0/2310389719 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fd15c05a540 0x7fd15c05ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:05.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.623+0000 7fd178ff9700 1 -- 172.21.15.45:0/2310389719 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6222+0+0 (secure 0 0 0) 0x7fd164076320 con 0x7fd17c0c3320 2023-12-22T10:02:05.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.623+0000 7fd17bfff700 1 --2- 172.21.15.45:0/2310389719 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fd15c05a540 0x7fd15c05ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:05.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.623+0000 7fd17bfff700 1 --2- 172.21.15.45:0/2310389719 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fd15c05a540 0x7fd15c05ca00 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7fd16c007fd0 tx=0x7fd16c009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:05.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.631+0000 7fd178ff9700 1 -- 172.21.15.45:0/2310389719 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd164049b50 con 0x7fd17c0c3320 2023-12-22T10:02:05.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.795+0000 7fd182a5b700 1 -- 172.21.15.45:0/2310389719 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd17c06c070 con 0x7fd17c0c3320 2023-12-22T10:02:05.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.795+0000 7fd178ff9700 1 -- 172.21.15.45:0/2310389719 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v45) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd16404d170 con 0x7fd17c0c3320 2023-12-22T10:02:05.795 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-22T10:02:05.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.795+0000 7fd182a5b700 1 -- 172.21.15.45:0/2310389719 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fd15c05a540 msgr2=0x7fd15c05ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:05.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.795+0000 7fd182a5b700 1 --2- 172.21.15.45:0/2310389719 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fd15c05a540 0x7fd15c05ca00 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7fd16c007fd0 tx=0x7fd16c009040).stop 2023-12-22T10:02:05.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.795+0000 7fd182a5b700 1 -- 172.21.15.45:0/2310389719 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd17c0c3320 msgr2=0x7fd17c0a48c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:05.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.795+0000 7fd182a5b700 1 --2- 172.21.15.45:0/2310389719 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd17c0c3320 0x7fd17c0a48c0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 rx=0x7fd164009d50 tx=0x7fd164017000).stop 2023-12-22T10:02:05.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.799+0000 7fd182a5b700 1 -- 172.21.15.45:0/2310389719 shutdown_connections 2023-12-22T10:02:05.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.799+0000 7fd182a5b700 1 --2- 172.21.15.45:0/2310389719 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fd15c05a540 0x7fd15c05ca00 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:05.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.799+0000 7fd182a5b700 1 --2- 172.21.15.45:0/2310389719 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd17c153a50 0x7fd17c0a4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:05.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.799+0000 7fd182a5b700 1 --2- 172.21.15.45:0/2310389719 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd17c0c3320 0x7fd17c0a48c0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:05.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.799+0000 7fd182a5b700 1 --2- 172.21.15.45:0/2310389719 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd17c0c23f0 0x7fd17c154700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:05.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.799+0000 7fd182a5b700 1 -- 172.21.15.45:0/2310389719 >> 172.21.15.45:0/2310389719 conn(0x7fd17c066a70 msgr2=0x7fd17c14f690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:02:05.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.799+0000 7fd182a5b700 1 -- 172.21.15.45:0/2310389719 shutdown_connections 2023-12-22T10:02:05.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.799+0000 7fd182a5b700 1 -- 172.21.15.45:0/2310389719 wait complete. 2023-12-22T10:02:05.818 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get recovery_fs_metadata pg_num 2023-12-22T10:02:05.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.987+0000 7f6215439700 1 Processor -- start 2023-12-22T10:02:05.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.987+0000 7f6215439700 1 -- start start 2023-12-22T10:02:05.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.991+0000 7f6215439700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f621013b440 0x7f6210063c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:05.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.991+0000 7f6215439700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62100be5e0 con 0x7f621013b060 2023-12-22T10:02:05.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.991+0000 7f6215439700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62100bd9d0 con 0x7f62100640f0 2023-12-22T10:02:05.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.991+0000 7f6215439700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62100a5ad0 con 0x7f621013b440 2023-12-22T10:02:05.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.991+0000 7f620ffff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f621013b060 0x7f62100a53c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:45866/0 (socket says 172.21.15.45:45866) 2023-12-22T10:02:05.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.991+0000 7f620ffff700 1 -- 172.21.15.45:0/3822137560 learned_addr learned my addr 172.21.15.45:0/3822137560 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:02:05.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.991+0000 7f6207fff700 1 --2- 172.21.15.45:0/3822137560 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f621013b440 0x7f6210063c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:05.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.991+0000 7f620f7fe700 1 -- 172.21.15.45:0/3822137560 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3515642136 0 0) 0x7f62100be5e0 con 0x7f621013b060 2023-12-22T10:02:05.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.991+0000 7f620f7fe700 1 -- 172.21.15.45:0/3822137560 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61fc0033f0 con 0x7f621013b060 2023-12-22T10:02:05.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.991+0000 7f6207fff700 1 -- 172.21.15.45:0/3822137560 >> v1:172.21.15.113:6789/0 conn(0x7f62100640f0 legacy=0x7f62100c2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:05.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.991+0000 7f6207fff700 1 -- 172.21.15.45:0/3822137560 >> v1:172.21.15.45:6789/0 conn(0x7f621013b060 legacy=0x7f62100a53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:05.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.991+0000 7f6207fff700 1 -- 172.21.15.45:0/3822137560 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62100bdcb0 con 0x7f621013b440 2023-12-22T10:02:05.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.991+0000 7f6207fff700 1 --2- 172.21.15.45:0/3822137560 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f621013b440 0x7f6210063c00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f61f8009790 tx=0x7f61f8009060).ready entity=mon.2 client_cookie=91dabf1e1909f9d3 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:05.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.991+0000 7f620f7fe700 1 -- 172.21.15.45:0/3822137560 <== mon.2 v2:172.21.15.113:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f800f510 con 0x7f621013b440 2023-12-22T10:02:05.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.991+0000 7f620f7fe700 1 -- 172.21.15.45:0/3822137560 <== mon.2 v2:172.21.15.113:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61f800f670 con 0x7f621013b440 2023-12-22T10:02:05.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.991+0000 7f620f7fe700 1 -- 172.21.15.45:0/3822137560 <== mon.2 v2:172.21.15.113:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f800f9f0 con 0x7f621013b440 2023-12-22T10:02:05.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.995+0000 7f6215439700 1 -- 172.21.15.45:0/3822137560 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f621013b440 msgr2=0x7f6210063c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:05.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.995+0000 7f6215439700 1 --2- 172.21.15.45:0/3822137560 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f621013b440 0x7f6210063c00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f61f8009790 tx=0x7f61f8009060).stop 2023-12-22T10:02:05.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.995+0000 7f6215439700 1 -- 172.21.15.45:0/3822137560 shutdown_connections 2023-12-22T10:02:05.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.995+0000 7f6215439700 1 --2- 172.21.15.45:0/3822137560 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f621013b440 0x7f6210063c00 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:05.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.995+0000 7f6215439700 1 -- 172.21.15.45:0/3822137560 >> 172.21.15.45:0/3822137560 conn(0x7f6210067500 msgr2=0x7f62100c8690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:02:05.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.995+0000 7f6215439700 1 -- 172.21.15.45:0/3822137560 shutdown_connections 2023-12-22T10:02:05.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.995+0000 7f6215439700 1 -- 172.21.15.45:0/3822137560 wait complete. 2023-12-22T10:02:05.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.995+0000 7f6215439700 1 Processor -- start 2023-12-22T10:02:05.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.999+0000 7f6215439700 1 -- start start 2023-12-22T10:02:05.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.999+0000 7f6215439700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f62100640f0 0x7f62100c06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:05.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.999+0000 7f6215439700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f621013b060 0x7f62100beaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:05.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.999+0000 7f6215439700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f621013b440 0x7f62100bef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:05.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.999+0000 7f6215439700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62100a9110 con 0x7f621013b440 2023-12-22T10:02:05.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.999+0000 7f6215439700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62100bf480 con 0x7f62100640f0 2023-12-22T10:02:05.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.999+0000 7f6215439700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62100a8e30 con 0x7f621013b060 2023-12-22T10:02:06.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.999+0000 7f6207fff700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f621013b060 0x7f62100beaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:06.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.999+0000 7f6214c38700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f621013b440 0x7f62100bef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:06.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.999+0000 7f6207fff700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f621013b060 0x7f62100beaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.113:3301/0 says I am v2:172.21.15.45:42810/0 (socket says 172.21.15.45:42810) 2023-12-22T10:02:06.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.999+0000 7f6207fff700 1 -- 172.21.15.45:0/1844646840 learned_addr learned my addr 172.21.15.45:0/1844646840 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:02:06.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.999+0000 7f620ffff700 1 --2- 172.21.15.45:0/1844646840 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f62100640f0 0x7f62100c06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:06.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.999+0000 7f6207fff700 1 -- 172.21.15.45:0/1844646840 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f62100640f0 msgr2=0x7f62100c06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:06.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.999+0000 7f6207fff700 1 --2- 172.21.15.45:0/1844646840 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f62100640f0 0x7f62100c06b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:06.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.999+0000 7f6207fff700 1 -- 172.21.15.45:0/1844646840 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f621013b440 msgr2=0x7f62100bef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:06.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.999+0000 7f6207fff700 1 --2- 172.21.15.45:0/1844646840 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f621013b440 0x7f62100bef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:06.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.999+0000 7f6207fff700 1 -- 172.21.15.45:0/1844646840 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61f80092a0 con 0x7f621013b060 2023-12-22T10:02:06.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.999+0000 7f6214c38700 1 --2- 172.21.15.45:0/1844646840 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f621013b440 0x7f62100bef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-12-22T10:02:06.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:05.999+0000 7f6207fff700 1 --2- 172.21.15.45:0/1844646840 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f621013b060 0x7f62100beaa0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f61f8009e30 tx=0x7f61f8017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:06.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.003+0000 7f620cff9700 1 -- 172.21.15.45:0/1844646840 <== mon.2 v2:172.21.15.113:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f8000bc0 con 0x7f621013b060 2023-12-22T10:02:06.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.003+0000 7f620cff9700 1 -- 172.21.15.45:0/1844646840 <== mon.2 v2:172.21.15.113:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61f800f7e0 con 0x7f621013b060 2023-12-22T10:02:06.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.003+0000 7f620cff9700 1 -- 172.21.15.45:0/1844646840 <== mon.2 v2:172.21.15.113:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f8000d20 con 0x7f621013b060 2023-12-22T10:02:06.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.003+0000 7f6215439700 1 -- 172.21.15.45:0/1844646840 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62100a9700 con 0x7f621013b060 2023-12-22T10:02:06.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.003+0000 7f6215439700 1 -- 172.21.15.45:0/1844646840 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62100a9cc0 con 0x7f621013b060 2023-12-22T10:02:06.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.003+0000 7f6215439700 1 -- 172.21.15.45:0/1844646840 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62100a9ee0 con 0x7f621013b060 2023-12-22T10:02:06.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.003+0000 7f620cff9700 1 -- 172.21.15.45:0/1844646840 <== mon.2 v2:172.21.15.113:3301/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f61f801b890 con 0x7f621013b060 2023-12-22T10:02:06.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.003+0000 7f620cff9700 1 --2- 172.21.15.45:0/1844646840 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f61f005a510 0x7f61f005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:06.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.007+0000 7f620cff9700 1 -- 172.21.15.45:0/1844646840 <== mon.2 v2:172.21.15.113:3301/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6222+0+0 (secure 0 0 0) 0x7f61f8075fa0 con 0x7f621013b060 2023-12-22T10:02:06.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.007+0000 7f620ffff700 1 --2- 172.21.15.45:0/1844646840 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f61f005a510 0x7f61f005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:06.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.007+0000 7f620ffff700 1 --2- 172.21.15.45:0/1844646840 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f61f005a510 0x7f61f005c9d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7f6200007fd0 tx=0x7f6200009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:06.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.015+0000 7f620cff9700 1 -- 172.21.15.45:0/1844646840 <== mon.2 v2:172.21.15.113:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f61f80a4b00 con 0x7f621013b060 2023-12-22T10:02:06.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.195+0000 7f6215439700 1 -- 172.21.15.45:0/1844646840 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "recovery_fs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6210047060 con 0x7f621013b060 2023-12-22T10:02:06.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.195+0000 7f620cff9700 1 -- 172.21.15.45:0/1844646840 <== mon.2 v2:172.21.15.113:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "recovery_fs_metadata", "var": "pg_num"}]=0 v45) v1 ==== 109+0+11 (secure 0 0 0) 0x7f61f8029020 con 0x7f621013b060 2023-12-22T10:02:06.195 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-22T10:02:06.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.199+0000 7f6215439700 1 -- 172.21.15.45:0/1844646840 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f61f005a510 msgr2=0x7f61f005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:06.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.199+0000 7f6215439700 1 --2- 172.21.15.45:0/1844646840 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f61f005a510 0x7f61f005c9d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7f6200007fd0 tx=0x7f6200009040).stop 2023-12-22T10:02:06.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.199+0000 7f6215439700 1 -- 172.21.15.45:0/1844646840 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f621013b060 msgr2=0x7f62100beaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:06.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.199+0000 7f6215439700 1 --2- 172.21.15.45:0/1844646840 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f621013b060 0x7f62100beaa0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f61f8009e30 tx=0x7f61f8017000).stop 2023-12-22T10:02:06.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.199+0000 7f6215439700 1 -- 172.21.15.45:0/1844646840 shutdown_connections 2023-12-22T10:02:06.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.199+0000 7f6215439700 1 --2- 172.21.15.45:0/1844646840 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f621013b440 0x7f62100bef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:06.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.199+0000 7f6215439700 1 --2- 172.21.15.45:0/1844646840 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f61f005a510 0x7f61f005c9d0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:06.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.199+0000 7f6215439700 1 --2- 172.21.15.45:0/1844646840 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f621013b060 0x7f62100beaa0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:06.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.199+0000 7f6215439700 1 --2- 172.21.15.45:0/1844646840 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f62100640f0 0x7f62100c06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:06.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.199+0000 7f6215439700 1 -- 172.21.15.45:0/1844646840 >> 172.21.15.45:0/1844646840 conn(0x7f6210067500 msgr2=0x7f6210063520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:02:06.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.199+0000 7f6215439700 1 -- 172.21.15.45:0/1844646840 shutdown_connections 2023-12-22T10:02:06.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.199+0000 7f6215439700 1 -- 172.21.15.45:0/1844646840 wait complete. 2023-12-22T10:02:06.216 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T10:02:06.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.383+0000 7fc02405b700 1 Processor -- start 2023-12-22T10:02:06.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.383+0000 7fc02405b700 1 -- start start 2023-12-22T10:02:06.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.383+0000 7fc02405b700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fc01c157e10 0x7fc01c0c1820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:06.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.383+0000 7fc02405b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc01c1581f0 0x7fc01c0c1d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:06.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.383+0000 7fc02405b700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc01c0c3080 0x7fc01c0c3530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:06.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.383+0000 7fc02405b700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc01c0a68b0 con 0x7fc01c1581f0 2023-12-22T10:02:06.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.383+0000 7fc02405b700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc01c065610 con 0x7fc01c157e10 2023-12-22T10:02:06.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.383+0000 7fc02405b700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc01c0658f0 con 0x7fc01c0c3080 2023-12-22T10:02:06.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.387+0000 7fc0215f6700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc01c1581f0 0x7fc01c0c1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:06.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.387+0000 7fc0215f6700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc01c1581f0 0x7fc01c0c1d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47242/0 (socket says 172.21.15.45:47242) 2023-12-22T10:02:06.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.387+0000 7fc0215f6700 1 -- 172.21.15.45:0/2254905817 learned_addr learned my addr 172.21.15.45:0/2254905817 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:02:06.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.387+0000 7fc0225f8700 1 --2- 172.21.15.45:0/2254905817 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc01c0c3080 0x7fc01c0c3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:06.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.387+0000 7fc021df7700 1 --2- 172.21.15.45:0/2254905817 >> v2:172.21.15.113:3300/0 conn(0x7fc01c157e10 0x7fc01c0c1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:06.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.387+0000 7fc0215f6700 1 -- 172.21.15.45:0/2254905817 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc01c0c3080 msgr2=0x7fc01c0c3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:02:06.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.387+0000 7fc0215f6700 1 --2- 172.21.15.45:0/2254905817 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc01c0c3080 0x7fc01c0c3530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:06.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.387+0000 7fc0215f6700 1 -- 172.21.15.45:0/2254905817 >> v2:172.21.15.113:3300/0 conn(0x7fc01c157e10 msgr2=0x7fc01c0c1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:02:06.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.387+0000 7fc0215f6700 1 --2- 172.21.15.45:0/2254905817 >> v2:172.21.15.113:3300/0 conn(0x7fc01c157e10 0x7fc01c0c1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:06.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.387+0000 7fc0215f6700 1 -- 172.21.15.45:0/2254905817 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc01c065bd0 con 0x7fc01c1581f0 2023-12-22T10:02:06.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.387+0000 7fc0215f6700 1 --2- 172.21.15.45:0/2254905817 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc01c1581f0 0x7fc01c0c1d10 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0x7fc01c0639e0 tx=0x7fc00c0090f0).ready entity=mon.0 client_cookie=a0f882c032c0bdce server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:06.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.387+0000 7fc020df5700 1 -- 172.21.15.45:0/2254905817 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc00c00f510 con 0x7fc01c1581f0 2023-12-22T10:02:06.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.387+0000 7fc020df5700 1 -- 172.21.15.45:0/2254905817 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc00c00f670 con 0x7fc01c1581f0 2023-12-22T10:02:06.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.387+0000 7fc020df5700 1 -- 172.21.15.45:0/2254905817 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc00c00fa10 con 0x7fc01c1581f0 2023-12-22T10:02:06.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.387+0000 7fc02405b700 1 -- 172.21.15.45:0/2254905817 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc01c1581f0 msgr2=0x7fc01c0c1d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:06.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.387+0000 7fc02405b700 1 --2- 172.21.15.45:0/2254905817 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc01c1581f0 0x7fc01c0c1d10 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0x7fc01c0639e0 tx=0x7fc00c0090f0).stop 2023-12-22T10:02:06.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.387+0000 7fc02405b700 1 -- 172.21.15.45:0/2254905817 shutdown_connections 2023-12-22T10:02:06.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.387+0000 7fc02405b700 1 --2- 172.21.15.45:0/2254905817 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc01c0c3080 0x7fc01c0c3530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:06.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.387+0000 7fc02405b700 1 --2- 172.21.15.45:0/2254905817 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc01c1581f0 0x7fc01c0c1d10 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:06.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.387+0000 7fc02405b700 1 --2- 172.21.15.45:0/2254905817 >> v2:172.21.15.113:3300/0 conn(0x7fc01c157e10 0x7fc01c0c1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:06.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.387+0000 7fc02405b700 1 -- 172.21.15.45:0/2254905817 >> 172.21.15.45:0/2254905817 conn(0x7fc01c066a70 msgr2=0x7fc01c066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:02:06.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.391+0000 7fc02405b700 1 -- 172.21.15.45:0/2254905817 shutdown_connections 2023-12-22T10:02:06.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.391+0000 7fc02405b700 1 -- 172.21.15.45:0/2254905817 wait complete. 2023-12-22T10:02:06.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.391+0000 7fc02405b700 1 Processor -- start 2023-12-22T10:02:06.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.391+0000 7fc02405b700 1 -- start start 2023-12-22T10:02:06.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.395+0000 7fc02405b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc01c0c3080 0x7fc01c0ab0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:06.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.395+0000 7fc02405b700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc01c157e10 0x7fc01c15afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:06.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.395+0000 7fc02405b700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc01c1581f0 0x7fc01c153760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:06.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.395+0000 7fc02405b700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc01c0ab5b0 con 0x7fc01c0c3080 2023-12-22T10:02:06.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.395+0000 7fc02405b700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc01c1692f0 con 0x7fc01c1581f0 2023-12-22T10:02:06.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.395+0000 7fc02405b700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc01c1686e0 con 0x7fc01c157e10 2023-12-22T10:02:06.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.395+0000 7fc021df7700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc01c0c3080 0x7fc01c0ab0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:06.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.395+0000 7fc021df7700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc01c0c3080 0x7fc01c0ab0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47254/0 (socket says 172.21.15.45:47254) 2023-12-22T10:02:06.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.395+0000 7fc021df7700 1 -- 172.21.15.45:0/133318128 learned_addr learned my addr 172.21.15.45:0/133318128 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:02:06.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.395+0000 7fc0215f6700 1 --2- 172.21.15.45:0/133318128 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc01c157e10 0x7fc01c15afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:06.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.395+0000 7fc0225f8700 1 --2- 172.21.15.45:0/133318128 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc01c1581f0 0x7fc01c153760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:06.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.395+0000 7fc021df7700 1 -- 172.21.15.45:0/133318128 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc01c157e10 msgr2=0x7fc01c15afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:06.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.395+0000 7fc021df7700 1 --2- 172.21.15.45:0/133318128 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc01c157e10 0x7fc01c15afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:06.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.395+0000 7fc021df7700 1 -- 172.21.15.45:0/133318128 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc01c1581f0 msgr2=0x7fc01c153760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:06.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.395+0000 7fc021df7700 1 --2- 172.21.15.45:0/133318128 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc01c1581f0 0x7fc01c153760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:06.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.395+0000 7fc021df7700 1 -- 172.21.15.45:0/133318128 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc00c009370 con 0x7fc01c0c3080 2023-12-22T10:02:06.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.395+0000 7fc0225f8700 1 --2- 172.21.15.45:0/133318128 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc01c1581f0 0x7fc01c153760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-12-22T10:02:06.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.395+0000 7fc021df7700 1 --2- 172.21.15.45:0/133318128 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc01c0c3080 0x7fc01c0ab0c0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 rx=0x7fc01800e930 tx=0x7fc018009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:06.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.395+0000 7fc011ffb700 1 -- 172.21.15.45:0/133318128 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc01800eed0 con 0x7fc01c0c3080 2023-12-22T10:02:06.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.395+0000 7fc011ffb700 1 -- 172.21.15.45:0/133318128 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc01800c850 con 0x7fc01c0c3080 2023-12-22T10:02:06.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.395+0000 7fc02405b700 1 -- 172.21.15.45:0/133318128 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc01c1689c0 con 0x7fc01c0c3080 2023-12-22T10:02:06.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.395+0000 7fc011ffb700 1 -- 172.21.15.45:0/133318128 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc01800cbd0 con 0x7fc01c0c3080 2023-12-22T10:02:06.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.395+0000 7fc02405b700 1 -- 172.21.15.45:0/133318128 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc01c168f80 con 0x7fc01c0c3080 2023-12-22T10:02:06.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.395+0000 7fc02405b700 1 -- 172.21.15.45:0/133318128 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc01c0c2840 con 0x7fc01c0c3080 2023-12-22T10:02:06.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.399+0000 7fc011ffb700 1 -- 172.21.15.45:0/133318128 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fc01801b400 con 0x7fc01c0c3080 2023-12-22T10:02:06.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.399+0000 7fc011ffb700 1 --2- 172.21.15.45:0/133318128 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fc00005a510 0x7fc00005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:06.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.399+0000 7fc011ffb700 1 -- 172.21.15.45:0/133318128 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6222+0+0 (secure 0 0 0) 0x7fc018074dd0 con 0x7fc01c0c3080 2023-12-22T10:02:06.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.399+0000 7fc0215f6700 1 --2- 172.21.15.45:0/133318128 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fc00005a510 0x7fc00005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:06.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.399+0000 7fc0215f6700 1 --2- 172.21.15.45:0/133318128 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fc00005a510 0x7fc00005c9d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7fc01c0639e0 tx=0x7fc00c017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:06.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.407+0000 7fc011ffb700 1 -- 172.21.15.45:0/133318128 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc01c0c2840 con 0x7fc01c0c3080 2023-12-22T10:02:06.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.607+0000 7fc02405b700 1 -- 172.21.15.45:0/133318128 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc01c0c2840 con 0x7fc01c0c3080 2023-12-22T10:02:06.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.607+0000 7fc011ffb700 1 -- 172.21.15.45:0/133318128 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4492 (secure 0 0 0) 0x7fc01c0c2840 con 0x7fc01c0c3080 2023-12-22T10:02:06.607 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:02:06.607 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":23,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4925,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6836/1120392063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1120392063},{"type":"v1","addr":"172.21.15.45:6836","nonce":1120392063}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6835/2332598072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":2332598072},{"type":"v1","addr":"172.21.15.113:6835","nonce":2332598072}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5253,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/2884671415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6835","nonce":2884671415},{"type":"v1","addr":"172.21.15.45:6837","nonce":2884671415}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5284,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6833/2223286979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6832","nonce":2223286979},{"type":"v1","addr":"172.21.15.113:6833","nonce":2223286979}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":21,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T10:01:49.976984+0000","modified":"2023-12-22T10:01:53.149442+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[6],"metadata_pool":7,"enabled":true,"fs_name":"recovery_fs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-12-22T10:02:06.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.611+0000 7fc02405b700 1 -- 172.21.15.45:0/133318128 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fc00005a510 msgr2=0x7fc00005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:06.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.611+0000 7fc02405b700 1 --2- 172.21.15.45:0/133318128 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fc00005a510 0x7fc00005c9d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7fc01c0639e0 tx=0x7fc00c017000).stop 2023-12-22T10:02:06.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.611+0000 7fc02405b700 1 -- 172.21.15.45:0/133318128 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc01c0c3080 msgr2=0x7fc01c0ab0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:06.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.611+0000 7fc02405b700 1 --2- 172.21.15.45:0/133318128 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc01c0c3080 0x7fc01c0ab0c0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 rx=0x7fc01800e930 tx=0x7fc018009060).stop 2023-12-22T10:02:06.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.611+0000 7fc02405b700 1 -- 172.21.15.45:0/133318128 shutdown_connections 2023-12-22T10:02:06.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.611+0000 7fc02405b700 1 --2- 172.21.15.45:0/133318128 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fc01c1581f0 0x7fc01c153760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:06.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.611+0000 7fc02405b700 1 --2- 172.21.15.45:0/133318128 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fc00005a510 0x7fc00005c9d0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:06.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.611+0000 7fc02405b700 1 --2- 172.21.15.45:0/133318128 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fc01c157e10 0x7fc01c15afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:06.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.611+0000 7fc02405b700 1 --2- 172.21.15.45:0/133318128 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc01c0c3080 0x7fc01c0ab0c0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:06.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.611+0000 7fc02405b700 1 -- 172.21.15.45:0/133318128 >> 172.21.15.45:0/133318128 conn(0x7fc01c066a70 msgr2=0x7fc01c155d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:02:06.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.611+0000 7fc02405b700 1 -- 172.21.15.45:0/133318128 shutdown_connections 2023-12-22T10:02:06.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.611+0000 7fc02405b700 1 -- 172.21.15.45:0/133318128 wait complete. 2023-12-22T10:02:06.612 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 23 2023-12-22T10:02:06.631 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T10:02:06.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.787+0000 7f5586b79700 1 Processor -- start 2023-12-22T10:02:06.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.791+0000 7f5586b79700 1 -- start start 2023-12-22T10:02:06.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.791+0000 7f5586b79700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f55800662e0 0x7f55800a7120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:06.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.791+0000 7f5586b79700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55800bc570 con 0x7f55800c3140 2023-12-22T10:02:06.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.791+0000 7f5586b79700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55800bc850 con 0x7f5580068290 2023-12-22T10:02:06.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.791+0000 7f5586b79700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55800bcb30 con 0x7f55800662e0 2023-12-22T10:02:06.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.791+0000 7f5585b77700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f55800c3140 0x7f55800c3520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:45880/0 (socket says 172.21.15.45:45880) 2023-12-22T10:02:06.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.791+0000 7f5585b77700 1 -- 172.21.15.45:0/519537231 learned_addr learned my addr 172.21.15.45:0/519537231 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:02:06.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.795+0000 7f5585376700 1 --2- 172.21.15.45:0/519537231 >> v2:172.21.15.45:3300/0 conn(0x7f55800662e0 0x7f55800a7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:06.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.795+0000 7f5584b75700 1 -- 172.21.15.45:0/519537231 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 654307816 0 0) 0x7f55800bc570 con 0x7f55800c3140 2023-12-22T10:02:06.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.795+0000 7f5584b75700 1 -- 172.21.15.45:0/519537231 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f556c0033f0 con 0x7f55800c3140 2023-12-22T10:02:06.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.795+0000 7f5584b75700 1 -- 172.21.15.45:0/519537231 <== mon.1 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2803778030 0 0) 0x7f55800bc850 con 0x7f5580068290 2023-12-22T10:02:06.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.795+0000 7f5584b75700 1 -- 172.21.15.45:0/519537231 --> v1:172.21.15.113:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55800bc570 con 0x7f5580068290 2023-12-22T10:02:06.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.795+0000 7f5585376700 1 -- 172.21.15.45:0/519537231 >> v1:172.21.15.113:6789/0 conn(0x7f5580068290 legacy=0x7f55800bd610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:06.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.795+0000 7f5585376700 1 -- 172.21.15.45:0/519537231 >> v1:172.21.15.45:6789/0 conn(0x7f55800c3140 legacy=0x7f55800c3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:06.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.795+0000 7f5585376700 1 -- 172.21.15.45:0/519537231 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55800bce10 con 0x7f55800662e0 2023-12-22T10:02:06.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.795+0000 7f5585376700 1 --2- 172.21.15.45:0/519537231 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f55800662e0 0x7f55800a7120 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 rx=0x7f5570009760 tx=0x7f5570009060).ready entity=mon.0 client_cookie=3034f59d88ff4cc6 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:06.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.795+0000 7f5584b75700 1 -- 172.21.15.45:0/519537231 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f557000d4a0 con 0x7f55800662e0 2023-12-22T10:02:06.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.795+0000 7f5584b75700 1 -- 172.21.15.45:0/519537231 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f557000d600 con 0x7f55800662e0 2023-12-22T10:02:06.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.795+0000 7f5584b75700 1 -- 172.21.15.45:0/519537231 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f557000d980 con 0x7f55800662e0 2023-12-22T10:02:06.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.795+0000 7f5586b79700 1 -- 172.21.15.45:0/519537231 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f55800662e0 msgr2=0x7f55800a7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:06.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.795+0000 7f5586b79700 1 --2- 172.21.15.45:0/519537231 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f55800662e0 0x7f55800a7120 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 rx=0x7f5570009760 tx=0x7f5570009060).stop 2023-12-22T10:02:06.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.795+0000 7f5586b79700 1 -- 172.21.15.45:0/519537231 shutdown_connections 2023-12-22T10:02:06.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.795+0000 7f5586b79700 1 --2- 172.21.15.45:0/519537231 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f55800662e0 0x7f55800a7120 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:06.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.795+0000 7f5586b79700 1 -- 172.21.15.45:0/519537231 >> 172.21.15.45:0/519537231 conn(0x7f5580062cc0 msgr2=0x7f5580067b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:02:06.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.799+0000 7f5586b79700 1 -- 172.21.15.45:0/519537231 shutdown_connections 2023-12-22T10:02:06.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.799+0000 7f5586b79700 1 -- 172.21.15.45:0/519537231 wait complete. 2023-12-22T10:02:06.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.799+0000 7f5586b79700 1 Processor -- start 2023-12-22T10:02:06.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.799+0000 7f5586b79700 1 -- start start 2023-12-22T10:02:06.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.799+0000 7f5586b79700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f55800662e0 0x7f55800ab010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:06.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.799+0000 7f5586b79700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f5580068290 0x7f55800a3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:06.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.799+0000 7f5586b79700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f55800c3140 0x7f558014c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:06.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.799+0000 7f5586b79700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55800a3d80 con 0x7f55800c3140 2023-12-22T10:02:06.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.799+0000 7f5586b79700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55800a3fc0 con 0x7f55800662e0 2023-12-22T10:02:06.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.799+0000 7f5586b79700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55800a42a0 con 0x7f5580068290 2023-12-22T10:02:06.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.803+0000 7f5586378700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f55800c3140 0x7f558014c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:06.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.803+0000 7f5586378700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f55800c3140 0x7f558014c030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47260/0 (socket says 172.21.15.45:47260) 2023-12-22T10:02:06.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.803+0000 7f5586378700 1 -- 172.21.15.45:0/787404777 learned_addr learned my addr 172.21.15.45:0/787404777 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:02:06.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.803+0000 7f5585376700 1 --2- 172.21.15.45:0/787404777 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f5580068290 0x7f55800a3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:06.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.803+0000 7f5585b77700 1 --2- 172.21.15.45:0/787404777 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f55800662e0 0x7f55800ab010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:06.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.803+0000 7f5586378700 1 -- 172.21.15.45:0/787404777 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f5580068290 msgr2=0x7f55800a3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:06.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.803+0000 7f5586378700 1 --2- 172.21.15.45:0/787404777 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f5580068290 0x7f55800a3890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:06.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.803+0000 7f5586378700 1 -- 172.21.15.45:0/787404777 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f55800662e0 msgr2=0x7f55800ab010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:06.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.803+0000 7f5586378700 1 --2- 172.21.15.45:0/787404777 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f55800662e0 0x7f55800ab010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:06.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.803+0000 7f5586378700 1 -- 172.21.15.45:0/787404777 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55700092a0 con 0x7f55800c3140 2023-12-22T10:02:06.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.803+0000 7f5585b77700 1 --2- 172.21.15.45:0/787404777 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f55800662e0 0x7f55800ab010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T10:02:06.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.803+0000 7f5586378700 1 --2- 172.21.15.45:0/787404777 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f55800c3140 0x7f558014c030 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7f557800c710 tx=0x7f557800ca20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:06.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.803+0000 7f5575ffb700 1 -- 172.21.15.45:0/787404777 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5578010510 con 0x7f55800c3140 2023-12-22T10:02:06.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.803+0000 7f5575ffb700 1 -- 172.21.15.45:0/787404777 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5578010670 con 0x7f55800c3140 2023-12-22T10:02:06.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.803+0000 7f5575ffb700 1 -- 172.21.15.45:0/787404777 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55780109f0 con 0x7f55800c3140 2023-12-22T10:02:06.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.803+0000 7f5586b79700 1 -- 172.21.15.45:0/787404777 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55800a4580 con 0x7f55800c3140 2023-12-22T10:02:06.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.803+0000 7f5586b79700 1 -- 172.21.15.45:0/787404777 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55800c5de0 con 0x7f55800c3140 2023-12-22T10:02:06.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.803+0000 7f5586b79700 1 -- 172.21.15.45:0/787404777 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55800644d0 con 0x7f55800c3140 2023-12-22T10:02:06.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.807+0000 7f5575ffb700 1 -- 172.21.15.45:0/787404777 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f557801b400 con 0x7f55800c3140 2023-12-22T10:02:06.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.807+0000 7f5575ffb700 1 --2- 172.21.15.45:0/787404777 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f556405a510 0x7f556405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:06.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.807+0000 7f5575ffb700 1 -- 172.21.15.45:0/787404777 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6222+0+0 (secure 0 0 0) 0x7f55780746c0 con 0x7f55800c3140 2023-12-22T10:02:06.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.807+0000 7f5585b77700 1 --2- 172.21.15.45:0/787404777 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f556405a510 0x7f556405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:06.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.807+0000 7f5585b77700 1 --2- 172.21.15.45:0/787404777 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f556405a510 0x7f556405c9d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f557c007fd0 tx=0x7f557c009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:06.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.811+0000 7f5575ffb700 1 -- 172.21.15.45:0/787404777 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f55800644d0 con 0x7f55800c3140 2023-12-22T10:02:06.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.983+0000 7f5586b79700 1 -- 172.21.15.45:0/787404777 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f55800644d0 con 0x7f55800c3140 2023-12-22T10:02:06.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.983+0000 7f5575ffb700 1 -- 172.21.15.45:0/787404777 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) v1 ==== 74+0+17072 (secure 0 0 0) 0x7f55800644d0 con 0x7f55800c3140 2023-12-22T10:02:06.986 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:02:06.986 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":45,"fsid":"98b0837e-5e68-4c8f-a1a0-e9424baaad8f","created":"2023-12-22T10:00:15.010174+0000","modified":"2023-12-22T10:02:03.840874+0000","last_up_change":"2023-12-22T10:00:24.980513+0000","last_in_change":"2023-12-22T10:00:17.887172+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-12-22T10:00:25.069641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-12-22T10:00:26.906399+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-22T10:01:34.130811+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"recovery_fs"}}},{"pool":7,"pool_name":"recovery_fs_metadata","create_time":"2023-12-22T10:01:49.073877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"recovery_fs"}}}],"osds":[{"osd":0,"uuid":"e19943a0-1c6b-47df-b6bb-383472077890","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":33777},{"type":"v1","addr":"172.21.15.45:6819","nonce":33777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":33777},{"type":"v1","addr":"172.21.15.45:6822","nonce":33777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":33777},{"type":"v1","addr":"172.21.15.45:6830","nonce":33777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":33777},{"type":"v1","addr":"172.21.15.45:6826","nonce":33777}]},"public_addr":"172.21.15.45:6819/33777","cluster_addr":"172.21.15.45:6822/33777","heartbeat_back_addr":"172.21.15.45:6830/33777","heartbeat_front_addr":"172.21.15.45:6826/33777","state":["exists","up"]},{"osd":1,"uuid":"69670f34-f082-45a7-8f67-e962acc136e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":33775},{"type":"v1","addr":"172.21.15.45:6809","nonce":33775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":33775},{"type":"v1","addr":"172.21.15.45:6811","nonce":33775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":33775},{"type":"v1","addr":"172.21.15.45:6815","nonce":33775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":33775},{"type":"v1","addr":"172.21.15.45:6813","nonce":33775}]},"public_addr":"172.21.15.45:6809/33775","cluster_addr":"172.21.15.45:6811/33775","heartbeat_back_addr":"172.21.15.45:6815/33775","heartbeat_front_addr":"172.21.15.45:6813/33775","state":["exists","up"]},{"osd":2,"uuid":"d909d49b-82b8-401b-9947-e49dd167bb95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":33776},{"type":"v1","addr":"172.21.15.45:6801","nonce":33776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":33776},{"type":"v1","addr":"172.21.15.45:6803","nonce":33776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":33776},{"type":"v1","addr":"172.21.15.45:6807","nonce":33776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":33776},{"type":"v1","addr":"172.21.15.45:6805","nonce":33776}]},"public_addr":"172.21.15.45:6801/33776","cluster_addr":"172.21.15.45:6803/33776","heartbeat_back_addr":"172.21.15.45:6807/33776","heartbeat_front_addr":"172.21.15.45:6805/33776","state":["exists","up"]},{"osd":3,"uuid":"db104ca9-3a94-4d39-a2be-bd06db888095","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":33782},{"type":"v1","addr":"172.21.15.45:6817","nonce":33782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":33782},{"type":"v1","addr":"172.21.15.45:6823","nonce":33782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":33782},{"type":"v1","addr":"172.21.15.45:6831","nonce":33782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":33782},{"type":"v1","addr":"172.21.15.45:6827","nonce":33782}]},"public_addr":"172.21.15.45:6817/33782","cluster_addr":"172.21.15.45:6823/33782","heartbeat_back_addr":"172.21.15.45:6831/33782","heartbeat_front_addr":"172.21.15.45:6827/33782","state":["exists","up"]},{"osd":4,"uuid":"9f4eaff4-e433-4479-a0d1-ee7a33375ca6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":34099},{"type":"v1","addr":"172.21.15.113:6811","nonce":34099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":34099},{"type":"v1","addr":"172.21.15.113:6815","nonce":34099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":34099},{"type":"v1","addr":"172.21.15.113:6823","nonce":34099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6816","nonce":34099},{"type":"v1","addr":"172.21.15.113:6818","nonce":34099}]},"public_addr":"172.21.15.113:6811/34099","cluster_addr":"172.21.15.113:6815/34099","heartbeat_back_addr":"172.21.15.113:6823/34099","heartbeat_front_addr":"172.21.15.113:6818/34099","state":["exists","up"]},{"osd":5,"uuid":"1efc5591-180b-43af-8611-0068aadc5aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":34100},{"type":"v1","addr":"172.21.15.113:6801","nonce":34100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":34100},{"type":"v1","addr":"172.21.15.113:6803","nonce":34100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":34100},{"type":"v1","addr":"172.21.15.113:6807","nonce":34100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":34100},{"type":"v1","addr":"172.21.15.113:6805","nonce":34100}]},"public_addr":"172.21.15.113:6801/34100","cluster_addr":"172.21.15.113:6803/34100","heartbeat_back_addr":"172.21.15.113:6807/34100","heartbeat_front_addr":"172.21.15.113:6805/34100","state":["exists","up"]},{"osd":6,"uuid":"6c89d9d8-c153-4a48-afa9-97e4c403f1ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":34101},{"type":"v1","addr":"172.21.15.113:6810","nonce":34101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6812","nonce":34101},{"type":"v1","addr":"172.21.15.113:6814","nonce":34101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6822","nonce":34101},{"type":"v1","addr":"172.21.15.113:6824","nonce":34101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":34101},{"type":"v1","addr":"172.21.15.113:6819","nonce":34101}]},"public_addr":"172.21.15.113:6810/34101","cluster_addr":"172.21.15.113:6814/34101","heartbeat_back_addr":"172.21.15.113:6824/34101","heartbeat_front_addr":"172.21.15.113:6819/34101","state":["exists","up"]},{"osd":7,"uuid":"1855e70c-23f6-4c08-ad7f-774c2148235b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6821","nonce":34102},{"type":"v1","addr":"172.21.15.113:6825","nonce":34102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":34102},{"type":"v1","addr":"172.21.15.113:6827","nonce":34102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":34102},{"type":"v1","addr":"172.21.15.113:6831","nonce":34102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6828","nonce":34102},{"type":"v1","addr":"172.21.15.113:6829","nonce":34102}]},"public_addr":"172.21.15.113:6825/34102","cluster_addr":"172.21.15.113:6827/34102","heartbeat_back_addr":"172.21.15.113:6831/34102","heartbeat_front_addr":"172.21.15.113:6829/34102","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.812672+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.825045+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.700105+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.856563+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.954683+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.883234+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.883994+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.821686+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.45:6835/1879154206":"2023-12-23T10:01:45.243059+0000","172.21.15.45:6834/1879154206":"2023-12-23T10:01:45.243059+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T10:02:06.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.987+0000 7f5586b79700 1 -- 172.21.15.45:0/787404777 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f556405a510 msgr2=0x7f556405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:06.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.987+0000 7f5586b79700 1 --2- 172.21.15.45:0/787404777 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f556405a510 0x7f556405c9d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f557c007fd0 tx=0x7f557c009040).stop 2023-12-22T10:02:06.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.987+0000 7f5586b79700 1 -- 172.21.15.45:0/787404777 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f55800c3140 msgr2=0x7f558014c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:06.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.987+0000 7f5586b79700 1 --2- 172.21.15.45:0/787404777 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f55800c3140 0x7f558014c030 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7f557800c710 tx=0x7f557800ca20).stop 2023-12-22T10:02:06.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.987+0000 7f5586b79700 1 -- 172.21.15.45:0/787404777 shutdown_connections 2023-12-22T10:02:06.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.987+0000 7f5586b79700 1 --2- 172.21.15.45:0/787404777 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f55800c3140 0x7f558014c030 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:06.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.987+0000 7f5586b79700 1 --2- 172.21.15.45:0/787404777 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f556405a510 0x7f556405c9d0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:06.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.987+0000 7f5586b79700 1 --2- 172.21.15.45:0/787404777 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f5580068290 0x7f55800a3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:06.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.987+0000 7f5586b79700 1 --2- 172.21.15.45:0/787404777 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f55800662e0 0x7f55800ab010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:06.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.987+0000 7f5586b79700 1 -- 172.21.15.45:0/787404777 >> 172.21.15.45:0/787404777 conn(0x7f5580062cc0 msgr2=0x7f5580067600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:02:06.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.987+0000 7f5586b79700 1 -- 172.21.15.45:0/787404777 shutdown_connections 2023-12-22T10:02:06.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:06.987+0000 7f5586b79700 1 -- 172.21.15.45:0/787404777 wait complete. 2023-12-22T10:02:07.011 INFO:tasks.cephfs.filesystem:Destroying file system recovery_fs and related pools 2023-12-22T10:02:07.011 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T10:02:07.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.175+0000 7f9e115db700 1 Processor -- start 2023-12-22T10:02:07.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.175+0000 7f9e115db700 1 -- start start 2023-12-22T10:02:07.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.179+0000 7f9e115db700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f9e0c0c79d0 0x7f9e0c0c5040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:07.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.179+0000 7f9e115db700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f9e0c0a9820 0x7f9e0c0a9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:07.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.179+0000 7f9e115db700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e0c0c5810 con 0x7f9e0c0c75f0 2023-12-22T10:02:07.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.179+0000 7f9e115db700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e0c0c6020 con 0x7f9e0c0c79d0 2023-12-22T10:02:07.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.179+0000 7f9e115db700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0c0c7e20 con 0x7f9e0c0a9820 2023-12-22T10:02:07.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.179+0000 7f9e0affd700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f9e0c0c75f0 0x7f9e0c157ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:45890/0 (socket says 172.21.15.45:45890) 2023-12-22T10:02:07.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.179+0000 7f9e0affd700 1 -- 172.21.15.45:0/1638390211 learned_addr learned my addr 172.21.15.45:0/1638390211 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:02:07.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.179+0000 7f9e0b7fe700 1 --2- 172.21.15.45:0/1638390211 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f9e0c0a9820 0x7f9e0c0a9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:07.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.179+0000 7f9e03fff700 1 --2- 172.21.15.45:0/1638390211 >> v2:172.21.15.113:3300/0 conn(0x7f9e0c0c79d0 0x7f9e0c0c5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:07.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.179+0000 7f9e0a7fc700 1 -- 172.21.15.45:0/1638390211 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1929064667 0 0) 0x7f9e0c0c5810 con 0x7f9e0c0c75f0 2023-12-22T10:02:07.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.179+0000 7f9e0a7fc700 1 -- 172.21.15.45:0/1638390211 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9df80033f0 con 0x7f9e0c0c75f0 2023-12-22T10:02:07.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.183+0000 7f9e0b7fe700 1 -- 172.21.15.45:0/1638390211 >> v2:172.21.15.113:3300/0 conn(0x7f9e0c0c79d0 msgr2=0x7f9e0c0c5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:02:07.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.183+0000 7f9e0b7fe700 1 --2- 172.21.15.45:0/1638390211 >> v2:172.21.15.113:3300/0 conn(0x7f9e0c0c79d0 0x7f9e0c0c5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:07.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.183+0000 7f9e0b7fe700 1 -- 172.21.15.45:0/1638390211 >> v1:172.21.15.45:6789/0 conn(0x7f9e0c0c75f0 legacy=0x7f9e0c157ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:07.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.183+0000 7f9e0b7fe700 1 -- 172.21.15.45:0/1638390211 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e0c0c5530 con 0x7f9e0c0a9820 2023-12-22T10:02:07.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.183+0000 7f9e0b7fe700 1 --2- 172.21.15.45:0/1638390211 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f9e0c0a9820 0x7f9e0c0a9cb0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f9e04009e60 tx=0x7f9e04009780).ready entity=mon.2 client_cookie=f085b674f30865ac server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:07.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.183+0000 7f9e0a7fc700 1 -- 172.21.15.45:0/1638390211 <== mon.2 v2:172.21.15.113:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e0400e070 con 0x7f9e0c0a9820 2023-12-22T10:02:07.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.183+0000 7f9e0a7fc700 1 -- 172.21.15.45:0/1638390211 <== mon.2 v2:172.21.15.113:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e0400bab0 con 0x7f9e0c0a9820 2023-12-22T10:02:07.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.183+0000 7f9e0a7fc700 1 -- 172.21.15.45:0/1638390211 <== mon.2 v2:172.21.15.113:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e0400be30 con 0x7f9e0c0a9820 2023-12-22T10:02:07.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.183+0000 7f9e115db700 1 -- 172.21.15.45:0/1638390211 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f9e0c0a9820 msgr2=0x7f9e0c0a9cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:07.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.183+0000 7f9e115db700 1 --2- 172.21.15.45:0/1638390211 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f9e0c0a9820 0x7f9e0c0a9cb0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f9e04009e60 tx=0x7f9e04009780).stop 2023-12-22T10:02:07.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.183+0000 7f9e115db700 1 -- 172.21.15.45:0/1638390211 shutdown_connections 2023-12-22T10:02:07.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.183+0000 7f9e115db700 1 --2- 172.21.15.45:0/1638390211 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f9e0c0a9820 0x7f9e0c0a9cb0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:07.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.183+0000 7f9e115db700 1 --2- 172.21.15.45:0/1638390211 >> v2:172.21.15.113:3300/0 conn(0x7f9e0c0c79d0 0x7f9e0c0c5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:07.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.183+0000 7f9e115db700 1 -- 172.21.15.45:0/1638390211 >> 172.21.15.45:0/1638390211 conn(0x7f9e0c066a70 msgr2=0x7f9e0c066e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:02:07.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.183+0000 7f9e115db700 1 -- 172.21.15.45:0/1638390211 shutdown_connections 2023-12-22T10:02:07.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.183+0000 7f9e115db700 1 -- 172.21.15.45:0/1638390211 wait complete. 2023-12-22T10:02:07.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.187+0000 7f9e115db700 1 Processor -- start 2023-12-22T10:02:07.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.187+0000 7f9e115db700 1 -- start start 2023-12-22T10:02:07.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.187+0000 7f9e115db700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9e0c0a9820 0x7f9e0c1434a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:07.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.187+0000 7f9e115db700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e0c0c75f0 0x7f9e0c14baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:07.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.187+0000 7f9e115db700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f9e0c0c79d0 0x7f9e0c14bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:07.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.187+0000 7f9e115db700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0c0acbd0 con 0x7f9e0c0c75f0 2023-12-22T10:02:07.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.187+0000 7f9e115db700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0c14f940 con 0x7f9e0c0a9820 2023-12-22T10:02:07.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.187+0000 7f9e115db700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0c150780 con 0x7f9e0c0c79d0 2023-12-22T10:02:07.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.187+0000 7f9e03fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e0c0c75f0 0x7f9e0c14baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:07.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.187+0000 7f9e03fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e0c0c75f0 0x7f9e0c14baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47264/0 (socket says 172.21.15.45:47264) 2023-12-22T10:02:07.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.187+0000 7f9e03fff700 1 -- 172.21.15.45:0/1996652213 learned_addr learned my addr 172.21.15.45:0/1996652213 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:02:07.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.187+0000 7f9e0affd700 1 --2- 172.21.15.45:0/1996652213 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9e0c0a9820 0x7f9e0c1434a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:07.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.187+0000 7f9e0b7fe700 1 --2- 172.21.15.45:0/1996652213 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f9e0c0c79d0 0x7f9e0c14bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:07.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.187+0000 7f9e03fff700 1 -- 172.21.15.45:0/1996652213 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f9e0c0c79d0 msgr2=0x7f9e0c14bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:07.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.187+0000 7f9e03fff700 1 --2- 172.21.15.45:0/1996652213 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f9e0c0c79d0 0x7f9e0c14bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:07.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.187+0000 7f9e03fff700 1 -- 172.21.15.45:0/1996652213 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9e0c0a9820 msgr2=0x7f9e0c1434a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:07.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.187+0000 7f9e03fff700 1 --2- 172.21.15.45:0/1996652213 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9e0c0a9820 0x7f9e0c1434a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:07.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.187+0000 7f9e03fff700 1 -- 172.21.15.45:0/1996652213 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e04009a20 con 0x7f9e0c0c75f0 2023-12-22T10:02:07.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.187+0000 7f9e03fff700 1 --2- 172.21.15.45:0/1996652213 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e0c0c75f0 0x7f9e0c14baf0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 rx=0x7f9df400e930 tx=0x7f9df4009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:07.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.191+0000 7f9e02ffd700 1 -- 172.21.15.45:0/1996652213 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df4012600 con 0x7f9e0c0c75f0 2023-12-22T10:02:07.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.191+0000 7f9e02ffd700 1 -- 172.21.15.45:0/1996652213 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9df4012760 con 0x7f9e0c0c75f0 2023-12-22T10:02:07.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.191+0000 7f9e02ffd700 1 -- 172.21.15.45:0/1996652213 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df4012ae0 con 0x7f9e0c0c75f0 2023-12-22T10:02:07.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.191+0000 7f9e115db700 1 -- 172.21.15.45:0/1996652213 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e0c14fb70 con 0x7f9e0c0c75f0 2023-12-22T10:02:07.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.191+0000 7f9e115db700 1 -- 172.21.15.45:0/1996652213 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e0c150130 con 0x7f9e0c0c75f0 2023-12-22T10:02:07.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.191+0000 7f9e115db700 1 -- 172.21.15.45:0/1996652213 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e0c06c070 con 0x7f9e0c0c75f0 2023-12-22T10:02:07.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.191+0000 7f9e02ffd700 1 -- 172.21.15.45:0/1996652213 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f9df401b400 con 0x7f9e0c0c75f0 2023-12-22T10:02:07.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.195+0000 7f9e02ffd700 1 --2- 172.21.15.45:0/1996652213 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f9dec05a540 0x7f9dec05ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:07.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.195+0000 7f9e02ffd700 1 -- 172.21.15.45:0/1996652213 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6222+0+0 (secure 0 0 0) 0x7f9df4074ad0 con 0x7f9e0c0c75f0 2023-12-22T10:02:07.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.195+0000 7f9e0affd700 1 --2- 172.21.15.45:0/1996652213 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f9dec05a540 0x7f9dec05ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:07.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.195+0000 7f9e0affd700 1 --2- 172.21.15.45:0/1996652213 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f9dec05a540 0x7f9dec05ca00 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7f9dfc005750 tx=0x7f9dfc009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:07.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.199+0000 7f9e02ffd700 1 -- 172.21.15.45:0/1996652213 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f9df4048130 con 0x7f9e0c0c75f0 2023-12-22T10:02:07.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.399+0000 7f9e115db700 1 -- 172.21.15.45:0/1996652213 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9e0c0c5a60 con 0x7f9e0c0c75f0 2023-12-22T10:02:07.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.399+0000 7f9e02ffd700 1 -- 172.21.15.45:0/1996652213 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4492 (secure 0 0 0) 0x7f9df404b750 con 0x7f9e0c0c75f0 2023-12-22T10:02:07.399 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:02:07.399 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":23,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4925,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6836/1120392063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1120392063},{"type":"v1","addr":"172.21.15.45:6836","nonce":1120392063}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6835/2332598072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":2332598072},{"type":"v1","addr":"172.21.15.113:6835","nonce":2332598072}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5253,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/2884671415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6835","nonce":2884671415},{"type":"v1","addr":"172.21.15.45:6837","nonce":2884671415}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5284,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6833/2223286979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6832","nonce":2223286979},{"type":"v1","addr":"172.21.15.113:6833","nonce":2223286979}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":21,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T10:01:49.976984+0000","modified":"2023-12-22T10:01:53.149442+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[6],"metadata_pool":7,"enabled":true,"fs_name":"recovery_fs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-12-22T10:02:07.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.403+0000 7f9e115db700 1 -- 172.21.15.45:0/1996652213 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f9dec05a540 msgr2=0x7f9dec05ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:07.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.403+0000 7f9e115db700 1 --2- 172.21.15.45:0/1996652213 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f9dec05a540 0x7f9dec05ca00 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7f9dfc005750 tx=0x7f9dfc009040).stop 2023-12-22T10:02:07.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.403+0000 7f9e115db700 1 -- 172.21.15.45:0/1996652213 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e0c0c75f0 msgr2=0x7f9e0c14baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:07.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.403+0000 7f9e115db700 1 --2- 172.21.15.45:0/1996652213 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e0c0c75f0 0x7f9e0c14baf0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 rx=0x7f9df400e930 tx=0x7f9df4009060).stop 2023-12-22T10:02:07.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.403+0000 7f9e115db700 1 -- 172.21.15.45:0/1996652213 shutdown_connections 2023-12-22T10:02:07.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.403+0000 7f9e115db700 1 --2- 172.21.15.45:0/1996652213 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f9dec05a540 0x7f9dec05ca00 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:07.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.403+0000 7f9e115db700 1 --2- 172.21.15.45:0/1996652213 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f9e0c0c79d0 0x7f9e0c14bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:07.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.403+0000 7f9e115db700 1 --2- 172.21.15.45:0/1996652213 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e0c0c75f0 0x7f9e0c14baf0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:07.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.403+0000 7f9e115db700 1 --2- 172.21.15.45:0/1996652213 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f9e0c0a9820 0x7f9e0c1434a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:07.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.403+0000 7f9e115db700 1 -- 172.21.15.45:0/1996652213 >> 172.21.15.45:0/1996652213 conn(0x7f9e0c066a70 msgr2=0x7f9e0c0c8b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:02:07.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.403+0000 7f9e115db700 1 -- 172.21.15.45:0/1996652213 shutdown_connections 2023-12-22T10:02:07.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.403+0000 7f9e115db700 1 -- 172.21.15.45:0/1996652213 wait complete. 2023-12-22T10:02:07.406 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 23 2023-12-22T10:02:07.427 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T10:02:07.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.591+0000 7f0adbbdb700 1 Processor -- start 2023-12-22T10:02:07.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.591+0000 7f0adbbdb700 1 -- start start 2023-12-22T10:02:07.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.591+0000 7f0adbbdb700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f0ad40c7b40 0x7f0ad41580d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:07.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.591+0000 7f0adbbdb700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ad40c9720 con 0x7f0ad40c5900 2023-12-22T10:02:07.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.591+0000 7f0adbbdb700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ad4153ec0 con 0x7f0ad40ac5c0 2023-12-22T10:02:07.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.591+0000 7f0adbbdb700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad41585c0 con 0x7f0ad40c7b40 2023-12-22T10:02:07.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.595+0000 7f0ad9176700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f0ad40c5900 0x7f0ad40c7430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:45892/0 (socket says 172.21.15.45:45892) 2023-12-22T10:02:07.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.595+0000 7f0ad9176700 1 -- 172.21.15.45:0/3966074971 learned_addr learned my addr 172.21.15.45:0/3966074971 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:02:07.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.595+0000 7f0ad9977700 1 --1- 172.21.15.45:0/3966074971 >> v1:172.21.15.113:6789/0 conn(0x7f0ad40ac5c0 0x7f0ad40aa660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.45:39488/0 (socket says 172.21.15.45:39488) 2023-12-22T10:02:07.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.595+0000 7f0ada178700 1 --2- 172.21.15.45:0/3966074971 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f0ad40c7b40 0x7f0ad41580d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:07.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.595+0000 7f0ad8975700 1 -- 172.21.15.45:0/3966074971 <== mon.1 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 751430323 0 0) 0x7f0ad4153ec0 con 0x7f0ad40ac5c0 2023-12-22T10:02:07.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.595+0000 7f0ada178700 1 -- 172.21.15.45:0/3966074971 >> v1:172.21.15.113:6789/0 conn(0x7f0ad40ac5c0 legacy=0x7f0ad40aa660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:07.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.595+0000 7f0ada178700 1 -- 172.21.15.45:0/3966074971 >> v1:172.21.15.45:6789/0 conn(0x7f0ad40c5900 legacy=0x7f0ad40c7430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:07.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.595+0000 7f0ada178700 1 -- 172.21.15.45:0/3966074971 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ad40c5d60 con 0x7f0ad40c7b40 2023-12-22T10:02:07.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.595+0000 7f0ada178700 1 --2- 172.21.15.45:0/3966074971 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f0ad40c7b40 0x7f0ad41580d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f0acc009e90 tx=0x7f0acc009780).ready entity=mon.2 client_cookie=9dfe86d5ea94e977 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:07.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.595+0000 7f0ad8975700 1 -- 172.21.15.45:0/3966074971 <== mon.2 v2:172.21.15.113:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0acc00e070 con 0x7f0ad40c7b40 2023-12-22T10:02:07.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.595+0000 7f0ad8975700 1 -- 172.21.15.45:0/3966074971 <== mon.2 v2:172.21.15.113:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0acc00bb30 con 0x7f0ad40c7b40 2023-12-22T10:02:07.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.595+0000 7f0ad8975700 1 -- 172.21.15.45:0/3966074971 <== mon.2 v2:172.21.15.113:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0acc00beb0 con 0x7f0ad40c7b40 2023-12-22T10:02:07.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.595+0000 7f0adbbdb700 1 -- 172.21.15.45:0/3966074971 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f0ad40c7b40 msgr2=0x7f0ad41580d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:07.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.595+0000 7f0adbbdb700 1 --2- 172.21.15.45:0/3966074971 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f0ad40c7b40 0x7f0ad41580d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f0acc009e90 tx=0x7f0acc009780).stop 2023-12-22T10:02:07.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.595+0000 7f0adbbdb700 1 -- 172.21.15.45:0/3966074971 shutdown_connections 2023-12-22T10:02:07.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.595+0000 7f0adbbdb700 1 --2- 172.21.15.45:0/3966074971 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f0ad40c7b40 0x7f0ad41580d0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:07.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.595+0000 7f0adbbdb700 1 -- 172.21.15.45:0/3966074971 >> 172.21.15.45:0/3966074971 conn(0x7f0ad4082a30 msgr2=0x7f0ad4066a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:02:07.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.595+0000 7f0adbbdb700 1 -- 172.21.15.45:0/3966074971 shutdown_connections 2023-12-22T10:02:07.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.599+0000 7f0adbbdb700 1 -- 172.21.15.45:0/3966074971 wait complete. 2023-12-22T10:02:07.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.599+0000 7f0adbbdb700 1 Processor -- start 2023-12-22T10:02:07.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.599+0000 7f0adbbdb700 1 -- start start 2023-12-22T10:02:07.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.599+0000 7f0adbbdb700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0ad40ac5c0 0x7f0ad40c28b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:07.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.599+0000 7f0adbbdb700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ad40c5900 0x7f0ad4151480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:07.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.599+0000 7f0adbbdb700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f0ad40c7b40 0x7f0ad4151970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:07.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.599+0000 7f0adbbdb700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad40aec70 con 0x7f0ad40c5900 2023-12-22T10:02:07.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.599+0000 7f0adbbdb700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad4151e60 con 0x7f0ad40ac5c0 2023-12-22T10:02:07.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.599+0000 7f0adbbdb700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad4169700 con 0x7f0ad40c7b40 2023-12-22T10:02:07.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.599+0000 7f0ad9176700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ad40c5900 0x7f0ad4151480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:07.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.599+0000 7f0ad9176700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ad40c5900 0x7f0ad4151480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47276/0 (socket says 172.21.15.45:47276) 2023-12-22T10:02:07.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.599+0000 7f0ad9176700 1 -- 172.21.15.45:0/49123281 learned_addr learned my addr 172.21.15.45:0/49123281 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:02:07.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.603+0000 7f0ada178700 1 --2- 172.21.15.45:0/49123281 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f0ad40c7b40 0x7f0ad4151970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:07.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.603+0000 7f0ad9977700 1 --2- 172.21.15.45:0/49123281 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0ad40ac5c0 0x7f0ad40c28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:07.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.603+0000 7f0ad9176700 1 -- 172.21.15.45:0/49123281 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f0ad40c7b40 msgr2=0x7f0ad4151970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:07.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.603+0000 7f0ad9176700 1 --2- 172.21.15.45:0/49123281 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f0ad40c7b40 0x7f0ad4151970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:07.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.603+0000 7f0ad9176700 1 -- 172.21.15.45:0/49123281 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0ad40ac5c0 msgr2=0x7f0ad40c28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:07.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.603+0000 7f0ad9176700 1 --2- 172.21.15.45:0/49123281 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0ad40ac5c0 0x7f0ad40c28b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:07.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.603+0000 7f0ad9176700 1 -- 172.21.15.45:0/49123281 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0acc009a20 con 0x7f0ad40c5900 2023-12-22T10:02:07.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.603+0000 7f0ad9977700 1 --2- 172.21.15.45:0/49123281 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0ad40ac5c0 0x7f0ad40c28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T10:02:07.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.603+0000 7f0ad9176700 1 --2- 172.21.15.45:0/49123281 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ad40c5900 0x7f0ad4151480 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 rx=0x7f0ac400c590 tx=0x7f0ac4007d00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:07.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.603+0000 7f0ac9ffb700 1 -- 172.21.15.45:0/49123281 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac40072e0 con 0x7f0ad40c5900 2023-12-22T10:02:07.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.603+0000 7f0ac9ffb700 1 -- 172.21.15.45:0/49123281 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ac4007440 con 0x7f0ad40c5900 2023-12-22T10:02:07.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.603+0000 7f0adbbdb700 1 -- 172.21.15.45:0/49123281 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ad40c9bb0 con 0x7f0ad40c5900 2023-12-22T10:02:07.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.603+0000 7f0ac9ffb700 1 -- 172.21.15.45:0/49123281 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac40057a0 con 0x7f0ad40c5900 2023-12-22T10:02:07.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.603+0000 7f0adbbdb700 1 -- 172.21.15.45:0/49123281 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ad40ca450 con 0x7f0ad40c5900 2023-12-22T10:02:07.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.607+0000 7f0adbbdb700 1 -- 172.21.15.45:0/49123281 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ad40c9fa0 con 0x7f0ad40c5900 2023-12-22T10:02:07.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.607+0000 7f0ac9ffb700 1 -- 172.21.15.45:0/49123281 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f0ac4005b90 con 0x7f0ad40c5900 2023-12-22T10:02:07.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.607+0000 7f0ac9ffb700 1 --2- 172.21.15.45:0/49123281 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f0ab805a510 0x7f0ab805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:07.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.607+0000 7f0ac9ffb700 1 -- 172.21.15.45:0/49123281 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6222+0+0 (secure 0 0 0) 0x7f0ac4074070 con 0x7f0ad40c5900 2023-12-22T10:02:07.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.607+0000 7f0ad9977700 1 --2- 172.21.15.45:0/49123281 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f0ab805a510 0x7f0ab805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:07.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.607+0000 7f0ad9977700 1 --2- 172.21.15.45:0/49123281 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f0ab805a510 0x7f0ab805c9d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f0ad0007fd0 tx=0x7f0ad0007af0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:07.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.611+0000 7f0ac9ffb700 1 -- 172.21.15.45:0/49123281 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f0ac40477f0 con 0x7f0ad40c5900 2023-12-22T10:02:07.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.811+0000 7f0adbbdb700 1 -- 172.21.15.45:0/49123281 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0ad406c070 con 0x7f0ad40c5900 2023-12-22T10:02:07.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.815+0000 7f0ac9ffb700 1 -- 172.21.15.45:0/49123281 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4492 (secure 0 0 0) 0x7f0ac4007e40 con 0x7f0ad40c5900 2023-12-22T10:02:07.814 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:02:07.814 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":23,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4925,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6836/1120392063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1120392063},{"type":"v1","addr":"172.21.15.45:6836","nonce":1120392063}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6835/2332598072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":2332598072},{"type":"v1","addr":"172.21.15.113:6835","nonce":2332598072}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5253,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/2884671415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6835","nonce":2884671415},{"type":"v1","addr":"172.21.15.45:6837","nonce":2884671415}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5284,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6833/2223286979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6832","nonce":2223286979},{"type":"v1","addr":"172.21.15.113:6833","nonce":2223286979}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":21,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-22T10:01:49.976984+0000","modified":"2023-12-22T10:01:53.149442+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[6],"metadata_pool":7,"enabled":true,"fs_name":"recovery_fs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-12-22T10:02:07.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.815+0000 7f0adbbdb700 1 -- 172.21.15.45:0/49123281 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f0ab805a510 msgr2=0x7f0ab805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:07.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.815+0000 7f0adbbdb700 1 --2- 172.21.15.45:0/49123281 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f0ab805a510 0x7f0ab805c9d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f0ad0007fd0 tx=0x7f0ad0007af0).stop 2023-12-22T10:02:07.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.815+0000 7f0adbbdb700 1 -- 172.21.15.45:0/49123281 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ad40c5900 msgr2=0x7f0ad4151480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:07.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.815+0000 7f0adbbdb700 1 --2- 172.21.15.45:0/49123281 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ad40c5900 0x7f0ad4151480 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 rx=0x7f0ac400c590 tx=0x7f0ac4007d00).stop 2023-12-22T10:02:07.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.815+0000 7f0adbbdb700 1 -- 172.21.15.45:0/49123281 shutdown_connections 2023-12-22T10:02:07.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.815+0000 7f0adbbdb700 1 --2- 172.21.15.45:0/49123281 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f0ab805a510 0x7f0ab805c9d0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:07.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.815+0000 7f0adbbdb700 1 --2- 172.21.15.45:0/49123281 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f0ad40c7b40 0x7f0ad4151970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:07.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.815+0000 7f0adbbdb700 1 --2- 172.21.15.45:0/49123281 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ad40c5900 0x7f0ad4151480 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:07.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.815+0000 7f0adbbdb700 1 --2- 172.21.15.45:0/49123281 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0ad40ac5c0 0x7f0ad40c28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:07.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.815+0000 7f0adbbdb700 1 -- 172.21.15.45:0/49123281 >> 172.21.15.45:0/49123281 conn(0x7f0ad4082a30 msgr2=0x7f0ad41572c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:02:07.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.819+0000 7f0adbbdb700 1 -- 172.21.15.45:0/49123281 shutdown_connections 2023-12-22T10:02:07.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:07.819+0000 7f0adbbdb700 1 -- 172.21.15.45:0/49123281 wait complete. 2023-12-22T10:02:07.820 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 23 2023-12-22T10:02:07.838 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T10:02:08.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.003+0000 7ffa570e4700 1 Processor -- start 2023-12-22T10:02:08.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.003+0000 7ffa570e4700 1 -- start start 2023-12-22T10:02:08.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.007+0000 7ffa570e4700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ffa500c6070 0x7ffa500aa940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:08.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.007+0000 7ffa570e4700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa500c0f70 con 0x7ffa500c1400 2023-12-22T10:02:08.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.007+0000 7ffa570e4700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa500aa2b0 con 0x7ffa500a9ed0 2023-12-22T10:02:08.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.007+0000 7ffa570e4700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa500c1860 con 0x7ffa500c6070 2023-12-22T10:02:08.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.007+0000 7ffa558e1700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7ffa500c1400 0x7ffa500c5960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:54638/0 (socket says 172.21.15.45:54638) 2023-12-22T10:02:08.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.007+0000 7ffa558e1700 1 -- 172.21.15.45:0/711999787 learned_addr learned my addr 172.21.15.45:0/711999787 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:02:08.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.007+0000 7ffa568e3700 1 --2- 172.21.15.45:0/711999787 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ffa500c6070 0x7ffa500aa940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:08.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.007+0000 7ffa550e0700 1 -- 172.21.15.45:0/711999787 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2163050377 0 0) 0x7ffa500c0f70 con 0x7ffa500c1400 2023-12-22T10:02:08.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.007+0000 7ffa550e0700 1 -- 172.21.15.45:0/711999787 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa3c0033f0 con 0x7ffa500c1400 2023-12-22T10:02:08.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.007+0000 7ffa568e3700 1 -- 172.21.15.45:0/711999787 >> v1:172.21.15.113:6789/0 conn(0x7ffa500a9ed0 legacy=0x7ffa500bf910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:08.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.007+0000 7ffa550e0700 1 -- 172.21.15.45:0/711999787 <== mon.1 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1926277098 0 0) 0x7ffa500aa2b0 con 0x7ffa500a9ed0 2023-12-22T10:02:08.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.007+0000 7ffa568e3700 1 -- 172.21.15.45:0/711999787 >> v1:172.21.15.45:6789/0 conn(0x7ffa500c1400 legacy=0x7ffa500c5960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:08.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.007+0000 7ffa568e3700 1 -- 172.21.15.45:0/711999787 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa500c0360 con 0x7ffa500c6070 2023-12-22T10:02:08.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.011+0000 7ffa568e3700 1 --2- 172.21.15.45:0/711999787 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ffa500c6070 0x7ffa500aa940 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7ffa48009e90 tx=0x7ffa48009780).ready entity=mon.2 client_cookie=17490bc51c238f7b server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:08.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.011+0000 7ffa550e0700 1 -- 172.21.15.45:0/711999787 <== mon.2 v2:172.21.15.113:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa4800e070 con 0x7ffa500c6070 2023-12-22T10:02:08.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.011+0000 7ffa550e0700 1 -- 172.21.15.45:0/711999787 <== mon.2 v2:172.21.15.113:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa4800b850 con 0x7ffa500c6070 2023-12-22T10:02:08.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.011+0000 7ffa550e0700 1 -- 172.21.15.45:0/711999787 <== mon.2 v2:172.21.15.113:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa40001470 con 0x7ffa500c6070 2023-12-22T10:02:08.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.011+0000 7ffa570e4700 1 -- 172.21.15.45:0/711999787 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ffa500c6070 msgr2=0x7ffa500aa940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:08.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.011+0000 7ffa570e4700 1 --2- 172.21.15.45:0/711999787 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ffa500c6070 0x7ffa500aa940 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7ffa48009e90 tx=0x7ffa48009780).stop 2023-12-22T10:02:08.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.011+0000 7ffa570e4700 1 -- 172.21.15.45:0/711999787 shutdown_connections 2023-12-22T10:02:08.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.011+0000 7ffa570e4700 1 --2- 172.21.15.45:0/711999787 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ffa500c6070 0x7ffa500aa940 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:08.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.011+0000 7ffa570e4700 1 -- 172.21.15.45:0/711999787 >> 172.21.15.45:0/711999787 conn(0x7ffa50067500 msgr2=0x7ffa500ca9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:02:08.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.011+0000 7ffa570e4700 1 -- 172.21.15.45:0/711999787 shutdown_connections 2023-12-22T10:02:08.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.011+0000 7ffa570e4700 1 -- 172.21.15.45:0/711999787 wait complete. 2023-12-22T10:02:08.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.015+0000 7ffa570e4700 1 Processor -- start 2023-12-22T10:02:08.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.015+0000 7ffa570e4700 1 -- start start 2023-12-22T10:02:08.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.015+0000 7ffa570e4700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa500a9ed0 0x7ffa5014c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:08.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.015+0000 7ffa570e4700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffa500c1400 0x7ffa50151d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:08.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.015+0000 7ffa570e4700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ffa500c6070 0x7ffa501581f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:08.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.015+0000 7ffa570e4700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa50150fd0 con 0x7ffa500a9ed0 2023-12-22T10:02:08.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.015+0000 7ffa570e4700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa50150390 con 0x7ffa500c1400 2023-12-22T10:02:08.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.015+0000 7ffa570e4700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa50150630 con 0x7ffa500c6070 2023-12-22T10:02:08.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.015+0000 7ffa560e2700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa500a9ed0 0x7ffa5014c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:08.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.015+0000 7ffa560e2700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa500a9ed0 0x7ffa5014c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42808/0 (socket says 172.21.15.45:42808) 2023-12-22T10:02:08.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.015+0000 7ffa560e2700 1 -- 172.21.15.45:0/1510378320 learned_addr learned my addr 172.21.15.45:0/1510378320 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:02:08.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.015+0000 7ffa558e1700 1 --2- 172.21.15.45:0/1510378320 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffa500c1400 0x7ffa50151d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:08.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.015+0000 7ffa568e3700 1 --2- 172.21.15.45:0/1510378320 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ffa500c6070 0x7ffa501581f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:08.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.019+0000 7ffa560e2700 1 -- 172.21.15.45:0/1510378320 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ffa500c6070 msgr2=0x7ffa501581f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:08.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.019+0000 7ffa560e2700 1 --2- 172.21.15.45:0/1510378320 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ffa500c6070 0x7ffa501581f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:08.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.019+0000 7ffa560e2700 1 -- 172.21.15.45:0/1510378320 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffa500c1400 msgr2=0x7ffa50151d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:08.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.019+0000 7ffa560e2700 1 --2- 172.21.15.45:0/1510378320 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffa500c1400 0x7ffa50151d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:08.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.019+0000 7ffa560e2700 1 -- 172.21.15.45:0/1510378320 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa48009a20 con 0x7ffa500a9ed0 2023-12-22T10:02:08.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.019+0000 7ffa568e3700 1 --2- 172.21.15.45:0/1510378320 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ffa500c6070 0x7ffa501581f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-12-22T10:02:08.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.019+0000 7ffa560e2700 1 --2- 172.21.15.45:0/1510378320 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa500a9ed0 0x7ffa5014c4a0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 rx=0x7ffa4c001eb0 tx=0x7ffa4c007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:08.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.019+0000 7ffa467fc700 1 -- 172.21.15.45:0/1510378320 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa4c00ce60 con 0x7ffa500a9ed0 2023-12-22T10:02:08.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.019+0000 7ffa467fc700 1 -- 172.21.15.45:0/1510378320 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa4c00f470 con 0x7ffa500a9ed0 2023-12-22T10:02:08.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.019+0000 7ffa570e4700 1 -- 172.21.15.45:0/1510378320 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa50150910 con 0x7ffa500a9ed0 2023-12-22T10:02:08.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.019+0000 7ffa467fc700 1 -- 172.21.15.45:0/1510378320 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa4c00f810 con 0x7ffa500a9ed0 2023-12-22T10:02:08.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.019+0000 7ffa570e4700 1 -- 172.21.15.45:0/1510378320 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa5014c990 con 0x7ffa500a9ed0 2023-12-22T10:02:08.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.019+0000 7ffa570e4700 1 -- 172.21.15.45:0/1510378320 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa50047060 con 0x7ffa500a9ed0 2023-12-22T10:02:08.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.019+0000 7ffa467fc700 1 -- 172.21.15.45:0/1510378320 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7ffa4c00fb80 con 0x7ffa500a9ed0 2023-12-22T10:02:08.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.023+0000 7ffa467fc700 1 --2- 172.21.15.45:0/1510378320 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7ffa3405a540 0x7ffa3405ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:08.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.023+0000 7ffa467fc700 1 -- 172.21.15.45:0/1510378320 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6222+0+0 (secure 0 0 0) 0x7ffa4c073ce0 con 0x7ffa500a9ed0 2023-12-22T10:02:08.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.023+0000 7ffa558e1700 1 --2- 172.21.15.45:0/1510378320 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7ffa3405a540 0x7ffa3405ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:08.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.023+0000 7ffa558e1700 1 --2- 172.21.15.45:0/1510378320 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7ffa3405a540 0x7ffa3405ca00 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7ffa500b0900 tx=0x7ffa40000bc0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:08.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.031+0000 7ffa467fc700 1 -- 172.21.15.45:0/1510378320 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ffa4c047460 con 0x7ffa500a9ed0 2023-12-22T10:02:08.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.199+0000 7ffa570e4700 1 -- 172.21.15.45:0/1510378320 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffa500c0640 con 0x7ffa500a9ed0 2023-12-22T10:02:08.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.203+0000 7ffa467fc700 1 -- 172.21.15.45:0/1510378320 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) v1 ==== 74+0+17072 (secure 0 0 0) 0x7ffa4c04aa80 con 0x7ffa500a9ed0 2023-12-22T10:02:08.204 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:02:08.204 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":45,"fsid":"98b0837e-5e68-4c8f-a1a0-e9424baaad8f","created":"2023-12-22T10:00:15.010174+0000","modified":"2023-12-22T10:02:03.840874+0000","last_up_change":"2023-12-22T10:00:24.980513+0000","last_in_change":"2023-12-22T10:00:17.887172+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-12-22T10:00:25.069641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-12-22T10:00:26.906399+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-22T10:01:34.130811+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"recovery_fs"}}},{"pool":7,"pool_name":"recovery_fs_metadata","create_time":"2023-12-22T10:01:49.073877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"recovery_fs"}}}],"osds":[{"osd":0,"uuid":"e19943a0-1c6b-47df-b6bb-383472077890","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":33777},{"type":"v1","addr":"172.21.15.45:6819","nonce":33777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":33777},{"type":"v1","addr":"172.21.15.45:6822","nonce":33777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":33777},{"type":"v1","addr":"172.21.15.45:6830","nonce":33777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":33777},{"type":"v1","addr":"172.21.15.45:6826","nonce":33777}]},"public_addr":"172.21.15.45:6819/33777","cluster_addr":"172.21.15.45:6822/33777","heartbeat_back_addr":"172.21.15.45:6830/33777","heartbeat_front_addr":"172.21.15.45:6826/33777","state":["exists","up"]},{"osd":1,"uuid":"69670f34-f082-45a7-8f67-e962acc136e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":33775},{"type":"v1","addr":"172.21.15.45:6809","nonce":33775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":33775},{"type":"v1","addr":"172.21.15.45:6811","nonce":33775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":33775},{"type":"v1","addr":"172.21.15.45:6815","nonce":33775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":33775},{"type":"v1","addr":"172.21.15.45:6813","nonce":33775}]},"public_addr":"172.21.15.45:6809/33775","cluster_addr":"172.21.15.45:6811/33775","heartbeat_back_addr":"172.21.15.45:6815/33775","heartbeat_front_addr":"172.21.15.45:6813/33775","state":["exists","up"]},{"osd":2,"uuid":"d909d49b-82b8-401b-9947-e49dd167bb95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":33776},{"type":"v1","addr":"172.21.15.45:6801","nonce":33776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":33776},{"type":"v1","addr":"172.21.15.45:6803","nonce":33776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":33776},{"type":"v1","addr":"172.21.15.45:6807","nonce":33776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":33776},{"type":"v1","addr":"172.21.15.45:6805","nonce":33776}]},"public_addr":"172.21.15.45:6801/33776","cluster_addr":"172.21.15.45:6803/33776","heartbeat_back_addr":"172.21.15.45:6807/33776","heartbeat_front_addr":"172.21.15.45:6805/33776","state":["exists","up"]},{"osd":3,"uuid":"db104ca9-3a94-4d39-a2be-bd06db888095","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":33782},{"type":"v1","addr":"172.21.15.45:6817","nonce":33782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":33782},{"type":"v1","addr":"172.21.15.45:6823","nonce":33782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":33782},{"type":"v1","addr":"172.21.15.45:6831","nonce":33782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":33782},{"type":"v1","addr":"172.21.15.45:6827","nonce":33782}]},"public_addr":"172.21.15.45:6817/33782","cluster_addr":"172.21.15.45:6823/33782","heartbeat_back_addr":"172.21.15.45:6831/33782","heartbeat_front_addr":"172.21.15.45:6827/33782","state":["exists","up"]},{"osd":4,"uuid":"9f4eaff4-e433-4479-a0d1-ee7a33375ca6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":34099},{"type":"v1","addr":"172.21.15.113:6811","nonce":34099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":34099},{"type":"v1","addr":"172.21.15.113:6815","nonce":34099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":34099},{"type":"v1","addr":"172.21.15.113:6823","nonce":34099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6816","nonce":34099},{"type":"v1","addr":"172.21.15.113:6818","nonce":34099}]},"public_addr":"172.21.15.113:6811/34099","cluster_addr":"172.21.15.113:6815/34099","heartbeat_back_addr":"172.21.15.113:6823/34099","heartbeat_front_addr":"172.21.15.113:6818/34099","state":["exists","up"]},{"osd":5,"uuid":"1efc5591-180b-43af-8611-0068aadc5aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":34100},{"type":"v1","addr":"172.21.15.113:6801","nonce":34100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":34100},{"type":"v1","addr":"172.21.15.113:6803","nonce":34100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":34100},{"type":"v1","addr":"172.21.15.113:6807","nonce":34100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":34100},{"type":"v1","addr":"172.21.15.113:6805","nonce":34100}]},"public_addr":"172.21.15.113:6801/34100","cluster_addr":"172.21.15.113:6803/34100","heartbeat_back_addr":"172.21.15.113:6807/34100","heartbeat_front_addr":"172.21.15.113:6805/34100","state":["exists","up"]},{"osd":6,"uuid":"6c89d9d8-c153-4a48-afa9-97e4c403f1ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":34101},{"type":"v1","addr":"172.21.15.113:6810","nonce":34101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6812","nonce":34101},{"type":"v1","addr":"172.21.15.113:6814","nonce":34101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6822","nonce":34101},{"type":"v1","addr":"172.21.15.113:6824","nonce":34101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":34101},{"type":"v1","addr":"172.21.15.113:6819","nonce":34101}]},"public_addr":"172.21.15.113:6810/34101","cluster_addr":"172.21.15.113:6814/34101","heartbeat_back_addr":"172.21.15.113:6824/34101","heartbeat_front_addr":"172.21.15.113:6819/34101","state":["exists","up"]},{"osd":7,"uuid":"1855e70c-23f6-4c08-ad7f-774c2148235b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6821","nonce":34102},{"type":"v1","addr":"172.21.15.113:6825","nonce":34102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":34102},{"type":"v1","addr":"172.21.15.113:6827","nonce":34102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":34102},{"type":"v1","addr":"172.21.15.113:6831","nonce":34102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6828","nonce":34102},{"type":"v1","addr":"172.21.15.113:6829","nonce":34102}]},"public_addr":"172.21.15.113:6825/34102","cluster_addr":"172.21.15.113:6827/34102","heartbeat_back_addr":"172.21.15.113:6831/34102","heartbeat_front_addr":"172.21.15.113:6829/34102","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.812672+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.825045+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.700105+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.856563+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.954683+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.883234+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.883994+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.821686+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.45:6835/1879154206":"2023-12-23T10:01:45.243059+0000","172.21.15.45:6834/1879154206":"2023-12-23T10:01:45.243059+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T10:02:08.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.207+0000 7ffa570e4700 1 -- 172.21.15.45:0/1510378320 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7ffa3405a540 msgr2=0x7ffa3405ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:08.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.207+0000 7ffa570e4700 1 --2- 172.21.15.45:0/1510378320 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7ffa3405a540 0x7ffa3405ca00 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7ffa500b0900 tx=0x7ffa40000bc0).stop 2023-12-22T10:02:08.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.207+0000 7ffa570e4700 1 -- 172.21.15.45:0/1510378320 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa500a9ed0 msgr2=0x7ffa5014c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:08.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.207+0000 7ffa570e4700 1 --2- 172.21.15.45:0/1510378320 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa500a9ed0 0x7ffa5014c4a0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 rx=0x7ffa4c001eb0 tx=0x7ffa4c007c70).stop 2023-12-22T10:02:08.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.207+0000 7ffa570e4700 1 -- 172.21.15.45:0/1510378320 shutdown_connections 2023-12-22T10:02:08.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.207+0000 7ffa570e4700 1 --2- 172.21.15.45:0/1510378320 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7ffa3405a540 0x7ffa3405ca00 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:08.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.207+0000 7ffa570e4700 1 --2- 172.21.15.45:0/1510378320 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ffa500c6070 0x7ffa501581f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:08.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.207+0000 7ffa570e4700 1 --2- 172.21.15.45:0/1510378320 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ffa500c1400 0x7ffa50151d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:08.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.207+0000 7ffa570e4700 1 --2- 172.21.15.45:0/1510378320 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa500a9ed0 0x7ffa5014c4a0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:08.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.207+0000 7ffa570e4700 1 -- 172.21.15.45:0/1510378320 >> 172.21.15.45:0/1510378320 conn(0x7ffa50067500 msgr2=0x7ffa50159e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:02:08.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.207+0000 7ffa570e4700 1 -- 172.21.15.45:0/1510378320 shutdown_connections 2023-12-22T10:02:08.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.207+0000 7ffa570e4700 1 -- 172.21.15.45:0/1510378320 wait complete. 2023-12-22T10:02:08.228 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail recovery_fs 2023-12-22T10:02:08.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.403+0000 7fb7a168f700 1 Processor -- start 2023-12-22T10:02:08.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.403+0000 7fb7a168f700 1 -- start start 2023-12-22T10:02:08.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.407+0000 7fb7a168f700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb79c0c0110 0x7fb79c0c04f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:08.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.407+0000 7fb7a168f700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb79c157c60 0x7fb79c1580c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:08.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.407+0000 7fb7a168f700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb79c0aa9b0 con 0x7fb79c0cb130 2023-12-22T10:02:08.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.407+0000 7fb7a168f700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb79c0c6c20 con 0x7fb79c0c0110 2023-12-22T10:02:08.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.407+0000 7fb7a168f700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb79c0c63a0 con 0x7fb79c157c60 2023-12-22T10:02:08.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.407+0000 7fb79bfff700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb79c0c0110 0x7fb79c0c04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:08.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.407+0000 7fb79bfff700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fb79c0c0110 0x7fb79c0c04f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.45:48746/0 (socket says 172.21.15.45:48746) 2023-12-22T10:02:08.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.407+0000 7fb79bfff700 1 -- 172.21.15.45:0/1035855401 learned_addr learned my addr 172.21.15.45:0/1035855401 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:02:08.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.407+0000 7fb793fff700 1 --1- 172.21.15.45:0/1035855401 >> v1:172.21.15.113:6789/0 conn(0x7fb79c0cb130 0x7fb79c0c5c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.45:36880/0 (socket says 172.21.15.45:36880) 2023-12-22T10:02:08.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.407+0000 7fb7a0e8e700 1 --2- 172.21.15.45:0/1035855401 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb79c157c60 0x7fb79c1580c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:08.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.407+0000 7fb79bfff700 1 -- 172.21.15.45:0/1035855401 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb79c157c60 msgr2=0x7fb79c1580c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:02:08.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.407+0000 7fb79bfff700 1 --2- 172.21.15.45:0/1035855401 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb79c157c60 0x7fb79c1580c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:08.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.407+0000 7fb79bfff700 1 -- 172.21.15.45:0/1035855401 >> v1:172.21.15.113:6789/0 conn(0x7fb79c0cb130 legacy=0x7fb79c0c5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:08.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.407+0000 7fb79bfff700 1 -- 172.21.15.45:0/1035855401 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb79c0c6660 con 0x7fb79c0c0110 2023-12-22T10:02:08.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.407+0000 7fb79b7fe700 1 -- 172.21.15.45:0/1035855401 <== mon.1 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2056886181 0 0) 0x7fb79c0aa9b0 con 0x7fb79c0cb130 2023-12-22T10:02:08.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.407+0000 7fb79bfff700 1 --2- 172.21.15.45:0/1035855401 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb79c0c0110 0x7fb79c0c04f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7fb78c006fd0 tx=0x7fb78c0090f0).ready entity=mon.1 client_cookie=8c8fb0d9a90ac718 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:08.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.407+0000 7fb79b7fe700 1 -- 172.21.15.45:0/1035855401 <== mon.1 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb78c00b580 con 0x7fb79c0c0110 2023-12-22T10:02:08.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.407+0000 7fb79b7fe700 1 -- 172.21.15.45:0/1035855401 <== mon.1 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb78c00b6e0 con 0x7fb79c0c0110 2023-12-22T10:02:08.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.407+0000 7fb79b7fe700 1 -- 172.21.15.45:0/1035855401 <== mon.1 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb78c00ba60 con 0x7fb79c0c0110 2023-12-22T10:02:08.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.411+0000 7fb7a168f700 1 -- 172.21.15.45:0/1035855401 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb79c0c0110 msgr2=0x7fb79c0c04f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:08.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.411+0000 7fb7a168f700 1 --2- 172.21.15.45:0/1035855401 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb79c0c0110 0x7fb79c0c04f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7fb78c006fd0 tx=0x7fb78c0090f0).stop 2023-12-22T10:02:08.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.411+0000 7fb7a168f700 1 -- 172.21.15.45:0/1035855401 shutdown_connections 2023-12-22T10:02:08.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.411+0000 7fb7a168f700 1 --2- 172.21.15.45:0/1035855401 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb79c157c60 0x7fb79c1580c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:08.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.411+0000 7fb7a168f700 1 --2- 172.21.15.45:0/1035855401 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb79c0c0110 0x7fb79c0c04f0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:08.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.411+0000 7fb7a168f700 1 -- 172.21.15.45:0/1035855401 >> 172.21.15.45:0/1035855401 conn(0x7fb79c067540 msgr2=0x7fb79c0ca940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:02:08.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.411+0000 7fb7a168f700 1 -- 172.21.15.45:0/1035855401 shutdown_connections 2023-12-22T10:02:08.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.411+0000 7fb7a168f700 1 -- 172.21.15.45:0/1035855401 wait complete. 2023-12-22T10:02:08.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.411+0000 7fb7a168f700 1 Processor -- start 2023-12-22T10:02:08.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.411+0000 7fb7a168f700 1 -- start start 2023-12-22T10:02:08.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.411+0000 7fb7a168f700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb79c0c0110 0x7fb79c155760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:08.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.411+0000 7fb7a168f700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb79c0cb130 0x7fb79c163cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:08.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.415+0000 7fb7a168f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb79c157c60 0x7fb79c0c4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:08.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.415+0000 7fb7a168f700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb79c165340 con 0x7fb79c157c60 2023-12-22T10:02:08.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.415+0000 7fb7a168f700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb79c164730 con 0x7fb79c0cb130 2023-12-22T10:02:08.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.415+0000 7fb7a168f700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb79c164a10 con 0x7fb79c0c0110 2023-12-22T10:02:08.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.415+0000 7fb7a0e8e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb79c157c60 0x7fb79c0c4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:08.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.415+0000 7fb7a0e8e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb79c157c60 0x7fb79c0c4ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42818/0 (socket says 172.21.15.45:42818) 2023-12-22T10:02:08.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.415+0000 7fb7a0e8e700 1 -- 172.21.15.45:0/3668786406 learned_addr learned my addr 172.21.15.45:0/3668786406 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:02:08.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.415+0000 7fb79bfff700 1 --2- 172.21.15.45:0/3668786406 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb79c0c0110 0x7fb79c155760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:08.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.415+0000 7fb793fff700 1 --2- 172.21.15.45:0/3668786406 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb79c0cb130 0x7fb79c163cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:08.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.415+0000 7fb79bfff700 1 -- 172.21.15.45:0/3668786406 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb79c0cb130 msgr2=0x7fb79c163cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:08.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.415+0000 7fb79bfff700 1 --2- 172.21.15.45:0/3668786406 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb79c0cb130 0x7fb79c163cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:08.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.415+0000 7fb79bfff700 1 -- 172.21.15.45:0/3668786406 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb79c157c60 msgr2=0x7fb79c0c4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:08.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.415+0000 7fb79bfff700 1 --2- 172.21.15.45:0/3668786406 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb79c157c60 0x7fb79c0c4ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:08.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.415+0000 7fb79bfff700 1 -- 172.21.15.45:0/3668786406 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb78c009370 con 0x7fb79c0c0110 2023-12-22T10:02:08.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.415+0000 7fb79bfff700 1 --2- 172.21.15.45:0/3668786406 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb79c0c0110 0x7fb79c155760 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fb78c014000 tx=0x7fb78c017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:08.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.415+0000 7fb798ff9700 1 -- 172.21.15.45:0/3668786406 <== mon.2 v2:172.21.15.113:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb78c006d90 con 0x7fb79c0c0110 2023-12-22T10:02:08.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.415+0000 7fb798ff9700 1 -- 172.21.15.45:0/3668786406 <== mon.2 v2:172.21.15.113:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb78c000bc0 con 0x7fb79c0c0110 2023-12-22T10:02:08.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.415+0000 7fb7a168f700 1 -- 172.21.15.45:0/3668786406 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb79c164cf0 con 0x7fb79c0c0110 2023-12-22T10:02:08.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.415+0000 7fb798ff9700 1 -- 172.21.15.45:0/3668786406 <== mon.2 v2:172.21.15.113:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb78c01c420 con 0x7fb79c0c0110 2023-12-22T10:02:08.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.415+0000 7fb7a168f700 1 -- 172.21.15.45:0/3668786406 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb79c155c50 con 0x7fb79c0c0110 2023-12-22T10:02:08.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.419+0000 7fb7a168f700 1 -- 172.21.15.45:0/3668786406 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb79c047060 con 0x7fb79c0c0110 2023-12-22T10:02:08.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.419+0000 7fb798ff9700 1 -- 172.21.15.45:0/3668786406 <== mon.2 v2:172.21.15.113:3301/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fb78c01c9e0 con 0x7fb79c0c0110 2023-12-22T10:02:08.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.419+0000 7fb798ff9700 1 --2- 172.21.15.45:0/3668786406 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fb77c05a540 0x7fb77c05ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:08.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.419+0000 7fb798ff9700 1 -- 172.21.15.45:0/3668786406 <== mon.2 v2:172.21.15.113:3301/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6222+0+0 (secure 0 0 0) 0x7fb78c076680 con 0x7fb79c0c0110 2023-12-22T10:02:08.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.419+0000 7fb793fff700 1 --2- 172.21.15.45:0/3668786406 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fb77c05a540 0x7fb77c05ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:08.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.423+0000 7fb793fff700 1 --2- 172.21.15.45:0/3668786406 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fb77c05a540 0x7fb77c05ca00 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7fb7840079b0 tx=0x7fb784007bd0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:08.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.427+0000 7fb798ff9700 1 -- 172.21.15.45:0/3668786406 <== mon.2 v2:172.21.15.113:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb78c049ce0 con 0x7fb79c0c0110 2023-12-22T10:02:08.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.627+0000 7fb7a168f700 1 -- 172.21.15.45:0/3668786406 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_command({"prefix": "fs fail", "fs_name": "recovery_fs"} v 0) v1 -- 0x7fb79c0c6940 con 0x7fb79c0c0110 2023-12-22T10:02:08.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.887+0000 7fb798ff9700 1 -- 172.21.15.45:0/3668786406 <== mon.2 v2:172.21.15.113:3301/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "recovery_fs"}]=0 recovery_fs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v24) v1 ==== 171+0+0 (secure 0 0 0) 0x7fb78c02a020 con 0x7fb79c0c0110 2023-12-22T10:02:08.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.895+0000 7fb7a168f700 1 -- 172.21.15.45:0/3668786406 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fb77c05a540 msgr2=0x7fb77c05ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:08.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.895+0000 7fb7a168f700 1 --2- 172.21.15.45:0/3668786406 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fb77c05a540 0x7fb77c05ca00 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7fb7840079b0 tx=0x7fb784007bd0).stop 2023-12-22T10:02:08.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.895+0000 7fb7a168f700 1 -- 172.21.15.45:0/3668786406 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb79c0c0110 msgr2=0x7fb79c155760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:08.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.895+0000 7fb7a168f700 1 --2- 172.21.15.45:0/3668786406 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb79c0c0110 0x7fb79c155760 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fb78c014000 tx=0x7fb78c017000).stop 2023-12-22T10:02:08.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.895+0000 7fb7a168f700 1 -- 172.21.15.45:0/3668786406 shutdown_connections 2023-12-22T10:02:08.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.895+0000 7fb7a168f700 1 --2- 172.21.15.45:0/3668786406 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb79c157c60 0x7fb79c0c4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:08.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.895+0000 7fb7a168f700 1 --2- 172.21.15.45:0/3668786406 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fb79c0cb130 0x7fb79c163cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:08.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.895+0000 7fb7a168f700 1 --2- 172.21.15.45:0/3668786406 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fb77c05a540 0x7fb77c05ca00 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:08.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.895+0000 7fb7a168f700 1 --2- 172.21.15.45:0/3668786406 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fb79c0c0110 0x7fb79c155760 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:08.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.895+0000 7fb7a168f700 1 -- 172.21.15.45:0/3668786406 >> 172.21.15.45:0/3668786406 conn(0x7fb79c067540 msgr2=0x7fb79c0c94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:02:08.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.895+0000 7fb7a168f700 1 -- 172.21.15.45:0/3668786406 shutdown_connections 2023-12-22T10:02:08.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:08.895+0000 7fb7a168f700 1 -- 172.21.15.45:0/3668786406 wait complete. 2023-12-22T10:02:08.897 INFO:teuthology.orchestra.run.smithi045.stderr:recovery_fs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-22T10:02:08.921 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm recovery_fs --yes-i-really-mean-it 2023-12-22T10:02:09.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:09.095+0000 7f0d1759e700 1 Processor -- start 2023-12-22T10:02:09.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:09.095+0000 7f0d1759e700 1 -- start start 2023-12-22T10:02:09.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:09.099+0000 7f0d1759e700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f0d1806ba70 0x7f0d180c1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:09.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:09.099+0000 7f0d1759e700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f0d18153dc0 0x7f0d1814ff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:09.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:09.099+0000 7f0d1759e700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0d180625d0 0x7f0d18062a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:09.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:09.099+0000 7f0d1759e700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d18062f70 con 0x7f0d180625d0 2023-12-22T10:02:09.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:09.099+0000 7f0d1759e700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d18153930 con 0x7f0d18153dc0 2023-12-22T10:02:09.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:09.099+0000 7f0d1759e700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d181507d0 con 0x7f0d1806ba70 2023-12-22T10:02:09.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:09.099+0000 7f0d16d9d700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0d180625d0 0x7f0d18062a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:09.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:09.099+0000 7f0d16d9d700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0d180625d0 0x7f0d18062a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42822/0 (socket says 172.21.15.45:42822) 2023-12-22T10:02:09.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:09.099+0000 7f0d16d9d700 1 -- 172.21.15.45:0/289731542 learned_addr learned my addr 172.21.15.45:0/289731542 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:02:09.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:09.099+0000 7f0d1659c700 1 --2- 172.21.15.45:0/289731542 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f0d1806ba70 0x7f0d180c1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:09.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:09.099+0000 7f0d15d9b700 1 --2- 172.21.15.45:0/289731542 >> v2:172.21.15.113:3300/0 conn(0x7f0d18153dc0 0x7f0d1814ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:09.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:09.103+0000 7f0d16d9d700 1 -- 172.21.15.45:0/289731542 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f0d1806ba70 msgr2=0x7f0d180c1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:02:09.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:09.103+0000 7f0d16d9d700 1 --2- 172.21.15.45:0/289731542 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f0d1806ba70 0x7f0d180c1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:09.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:09.103+0000 7f0d16d9d700 1 -- 172.21.15.45:0/289731542 >> v2:172.21.15.113:3300/0 conn(0x7f0d18153dc0 msgr2=0x7f0d1814ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:02:09.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:09.103+0000 7f0d16d9d700 1 --2- 172.21.15.45:0/289731542 >> v2:172.21.15.113:3300/0 conn(0x7f0d18153dc0 0x7f0d1814ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:09.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:09.103+0000 7f0d16d9d700 1 -- 172.21.15.45:0/289731542 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d18150ab0 con 0x7f0d180625d0 2023-12-22T10:02:09.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:09.103+0000 7f0d16d9d700 1 --2- 172.21.15.45:0/289731542 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d180625d0 0x7f0d18062a80 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 rx=0x7f0d18067d10 tx=0x7f0d1000ba50).ready entity=mon.0 client_cookie=70ca218d099a95b2 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:09.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:09.103+0000 7f0d1559a700 1 -- 172.21.15.45:0/289731542 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d10010070 con 0x7f0d180625d0 2023-12-22T10:02:09.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:09.103+0000 7f0d1559a700 1 -- 172.21.15.45:0/289731542 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d1000dd30 con 0x7f0d180625d0 2023-12-22T10:02:09.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:09.103+0000 7f0d1559a700 1 -- 172.21.15.45:0/289731542 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d1000dea0 con 0x7f0d180625d0 2023-12-22T10:02:09.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:09.103+0000 7f0d1759e700 1 -- 172.21.15.45:0/289731542 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d180625d0 msgr2=0x7f0d18062a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:09.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:09.103+0000 7f0d1759e700 1 --2- 172.21.15.45:0/289731542 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d180625d0 0x7f0d18062a80 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 rx=0x7f0d18067d10 tx=0x7f0d1000ba50).stop 2023-12-22T10:02:09.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:09.103+0000 7f0d1759e700 1 -- 172.21.15.45:0/289731542 shutdown_connections 2023-12-22T10:02:09.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:09.103+0000 7f0d1759e700 1 --2- 172.21.15.45:0/289731542 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d180625d0 0x7f0d18062a80 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:09.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:09.103+0000 7f0d1759e700 1 --2- 172.21.15.45:0/289731542 >> v2:172.21.15.113:3300/0 conn(0x7f0d18153dc0 0x7f0d1814ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:09.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:09.103+0000 7f0d1759e700 1 --2- 172.21.15.45:0/289731542 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f0d1806ba70 0x7f0d180c1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:09.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:09.103+0000 7f0d1759e700 1 -- 172.21.15.45:0/289731542 >> 172.21.15.45:0/289731542 conn(0x7f0d18067540 msgr2=0x7f0d180c6890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:02:09.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:09.103+0000 7f0d1759e700 1 -- 172.21.15.45:0/289731542 shutdown_connections 2023-12-22T10:02:09.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:09.103+0000 7f0d1759e700 1 -- 172.21.15.45:0/289731542 wait complete. 2023-12-22T10:02:09.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:09.107+0000 7f0d1759e700 1 Processor -- start 2023-12-22T10:02:09.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:09.107+0000 7f0d1759e700 1 -- start start 2023-12-22T10:02:09.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:09.107+0000 7f0d1759e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d180625d0 0x7f0d180bd930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:09.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:09.107+0000 7f0d1759e700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0d1806ba70 0x7f0d180a98f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:09.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:09.107+0000 7f0d1759e700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f0d18153dc0 0x7f0d1814c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:09.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:09.107+0000 7f0d1759e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d180c5b50 con 0x7f0d180625d0 2023-12-22T10:02:09.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:09.107+0000 7f0d1759e700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d180c55b0 con 0x7f0d1806ba70 2023-12-22T10:02:09.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:09.107+0000 7f0d1759e700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d180c5870 con 0x7f0d18153dc0 2023-12-22T10:02:09.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:09.107+0000 7f0d1659c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d180625d0 0x7f0d180bd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:09.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:09.107+0000 7f0d1659c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d180625d0 0x7f0d180bd930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42838/0 (socket says 172.21.15.45:42838) 2023-12-22T10:02:09.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:09.107+0000 7f0d1659c700 1 -- 172.21.15.45:0/2834903072 learned_addr learned my addr 172.21.15.45:0/2834903072 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:02:09.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:09.107+0000 7f0d16d9d700 1 --2- 172.21.15.45:0/2834903072 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f0d18153dc0 0x7f0d1814c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:09.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:09.107+0000 7f0d15d9b700 1 --2- 172.21.15.45:0/2834903072 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0d1806ba70 0x7f0d180a98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:09.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:09.107+0000 7f0d1659c700 1 -- 172.21.15.45:0/2834903072 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f0d18153dc0 msgr2=0x7f0d1814c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:09.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:09.107+0000 7f0d1659c700 1 --2- 172.21.15.45:0/2834903072 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f0d18153dc0 0x7f0d1814c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:09.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:09.107+0000 7f0d1659c700 1 -- 172.21.15.45:0/2834903072 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0d1806ba70 msgr2=0x7f0d180a98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:09.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:09.107+0000 7f0d1659c700 1 --2- 172.21.15.45:0/2834903072 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0d1806ba70 0x7f0d180a98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:09.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:09.107+0000 7f0d1659c700 1 -- 172.21.15.45:0/2834903072 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d1000bcf0 con 0x7f0d180625d0 2023-12-22T10:02:09.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:09.107+0000 7f0d15d9b700 1 --2- 172.21.15.45:0/2834903072 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0d1806ba70 0x7f0d180a98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T10:02:09.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:09.107+0000 7f0d1659c700 1 --2- 172.21.15.45:0/2834903072 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d180625d0 0x7f0d180bd930 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 rx=0x7f0d0800e930 tx=0x7f0d08009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:09.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:09.111+0000 7f0d067fc700 1 -- 172.21.15.45:0/2834903072 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d0800c670 con 0x7f0d180625d0 2023-12-22T10:02:09.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:09.111+0000 7f0d067fc700 1 -- 172.21.15.45:0/2834903072 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d0800c7d0 con 0x7f0d180625d0 2023-12-22T10:02:09.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:09.111+0000 7f0d1759e700 1 -- 172.21.15.45:0/2834903072 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d180a7130 con 0x7f0d180625d0 2023-12-22T10:02:09.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:09.111+0000 7f0d067fc700 1 -- 172.21.15.45:0/2834903072 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d0800cb50 con 0x7f0d180625d0 2023-12-22T10:02:09.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:09.111+0000 7f0d1759e700 1 -- 172.21.15.45:0/2834903072 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d180a76f0 con 0x7f0d180625d0 2023-12-22T10:02:09.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:09.111+0000 7f0d1759e700 1 -- 172.21.15.45:0/2834903072 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d180a6f90 con 0x7f0d180625d0 2023-12-22T10:02:09.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:09.115+0000 7f0d067fc700 1 -- 172.21.15.45:0/2834903072 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f0d0801b400 con 0x7f0d180625d0 2023-12-22T10:02:09.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:09.115+0000 7f0d067fc700 1 --2- 172.21.15.45:0/2834903072 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f0cf805a510 0x7f0cf805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:09.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:09.115+0000 7f0d067fc700 1 -- 172.21.15.45:0/2834903072 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6222+0+0 (secure 0 0 0) 0x7f0d08074d60 con 0x7f0d180625d0 2023-12-22T10:02:09.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:09.115+0000 7f0d15d9b700 1 --2- 172.21.15.45:0/2834903072 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f0cf805a510 0x7f0cf805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:09.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:09.115+0000 7f0d15d9b700 1 --2- 172.21.15.45:0/2834903072 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f0cf805a510 0x7f0cf805c9d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7f0d180a9140 tx=0x7f0d0c008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:09.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:09.119+0000 7f0d067fc700 1 -- 172.21.15.45:0/2834903072 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f0d180a6f90 con 0x7f0d180625d0 2023-12-22T10:02:09.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:09.323+0000 7f0d1759e700 1 -- 172.21.15.45:0/2834903072 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "recovery_fs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f0d180a6f90 con 0x7f0d180625d0 2023-12-22T10:02:09.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:09.899+0000 7f0d067fc700 1 -- 172.21.15.45:0/2834903072 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "recovery_fs", "yes_i_really_mean_it": true}]=0 v25) v1 ==== 109+0+0 (secure 0 0 0) 0x7f0d180a6f90 con 0x7f0d180625d0 2023-12-22T10:02:09.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:09.903+0000 7f0d1759e700 1 -- 172.21.15.45:0/2834903072 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f0cf805a510 msgr2=0x7f0cf805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:09.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:09.903+0000 7f0d1759e700 1 --2- 172.21.15.45:0/2834903072 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f0cf805a510 0x7f0cf805c9d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7f0d180a9140 tx=0x7f0d0c008040).stop 2023-12-22T10:02:09.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:09.903+0000 7f0d1759e700 1 -- 172.21.15.45:0/2834903072 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d180625d0 msgr2=0x7f0d180bd930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:09.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:09.903+0000 7f0d1759e700 1 --2- 172.21.15.45:0/2834903072 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d180625d0 0x7f0d180bd930 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 rx=0x7f0d0800e930 tx=0x7f0d08009060).stop 2023-12-22T10:02:09.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:09.903+0000 7f0d1759e700 1 -- 172.21.15.45:0/2834903072 shutdown_connections 2023-12-22T10:02:09.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:09.903+0000 7f0d1759e700 1 --2- 172.21.15.45:0/2834903072 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f0cf805a510 0x7f0cf805c9d0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:09.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:09.903+0000 7f0d1759e700 1 --2- 172.21.15.45:0/2834903072 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f0d18153dc0 0x7f0d1814c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:09.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:09.903+0000 7f0d1759e700 1 --2- 172.21.15.45:0/2834903072 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0d1806ba70 0x7f0d180a98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:09.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:09.903+0000 7f0d1759e700 1 --2- 172.21.15.45:0/2834903072 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d180625d0 0x7f0d180bd930 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:09.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:09.903+0000 7f0d1759e700 1 -- 172.21.15.45:0/2834903072 >> 172.21.15.45:0/2834903072 conn(0x7f0d18067540 msgr2=0x7f0d180a5c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:02:09.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:09.903+0000 7f0d1759e700 1 -- 172.21.15.45:0/2834903072 shutdown_connections 2023-12-22T10:02:09.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:09.903+0000 7f0d1759e700 1 -- 172.21.15.45:0/2834903072 wait complete. 2023-12-22T10:02:09.927 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm recovery_fs_metadata recovery_fs_metadata --yes-i-really-really-mean-it 2023-12-22T10:02:10.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:10.107+0000 7fce714b9700 1 Processor -- start 2023-12-22T10:02:10.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:10.107+0000 7fce714b9700 1 -- start start 2023-12-22T10:02:10.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:10.111+0000 7fce714b9700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fce6c0bfcd0 0x7fce6c0acff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:10.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:10.111+0000 7fce714b9700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce6c0aa870 con 0x7fce6c0acc10 2023-12-22T10:02:10.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:10.111+0000 7fce714b9700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce6c0c0320 con 0x7fce6c067180 2023-12-22T10:02:10.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:10.111+0000 7fce714b9700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce6c0aab10 con 0x7fce6c0bfcd0 2023-12-22T10:02:10.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:10.111+0000 7fce70cb8700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fce6c0bfcd0 0x7fce6c0acff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:10.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:10.111+0000 7fce70cb8700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fce6c0bfcd0 0x7fce6c0acff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42846/0 (socket says 172.21.15.45:42846) 2023-12-22T10:02:10.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:10.111+0000 7fce70cb8700 1 -- 172.21.15.45:0/2084335780 learned_addr learned my addr 172.21.15.45:0/2084335780 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:02:10.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:10.111+0000 7fce6bfff700 1 --1- 172.21.15.45:0/2084335780 >> v1:172.21.15.45:6789/0 conn(0x7fce6c0acc10 0x7fce6c066a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:54640/0 (socket says 172.21.15.45:54640) 2023-12-22T10:02:10.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:10.111+0000 7fce70cb8700 1 -- 172.21.15.45:0/2084335780 >> v1:172.21.15.113:6789/0 conn(0x7fce6c067180 legacy=0x7fce6c0ab310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:02:10.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:10.111+0000 7fce70cb8700 1 -- 172.21.15.45:0/2084335780 >> v1:172.21.15.45:6789/0 conn(0x7fce6c0acc10 legacy=0x7fce6c066a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:10.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:10.111+0000 7fce70cb8700 1 -- 172.21.15.45:0/2084335780 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce6c0aadf0 con 0x7fce6c0bfcd0 2023-12-22T10:02:10.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:10.111+0000 7fce70cb8700 1 --2- 172.21.15.45:0/2084335780 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce6c0bfcd0 0x7fce6c0acff0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7fce64009f20 tx=0x7fce64009840).ready entity=mon.0 client_cookie=acc1048bb5217137 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:10.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:10.111+0000 7fce6b7fe700 1 -- 172.21.15.45:0/2084335780 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce6400e070 con 0x7fce6c0bfcd0 2023-12-22T10:02:10.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:10.111+0000 7fce6b7fe700 1 -- 172.21.15.45:0/2084335780 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce6400ba40 con 0x7fce6c0bfcd0 2023-12-22T10:02:10.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:10.111+0000 7fce6b7fe700 1 -- 172.21.15.45:0/2084335780 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce6400bdc0 con 0x7fce6c0bfcd0 2023-12-22T10:02:10.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:10.115+0000 7fce714b9700 1 -- 172.21.15.45:0/2084335780 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce6c0bfcd0 msgr2=0x7fce6c0acff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:10.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:10.115+0000 7fce714b9700 1 --2- 172.21.15.45:0/2084335780 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce6c0bfcd0 0x7fce6c0acff0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7fce64009f20 tx=0x7fce64009840).stop 2023-12-22T10:02:10.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:10.115+0000 7fce714b9700 1 -- 172.21.15.45:0/2084335780 shutdown_connections 2023-12-22T10:02:10.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:10.115+0000 7fce714b9700 1 --2- 172.21.15.45:0/2084335780 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce6c0bfcd0 0x7fce6c0acff0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:10.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:10.115+0000 7fce714b9700 1 -- 172.21.15.45:0/2084335780 >> 172.21.15.45:0/2084335780 conn(0x7fce6c0cb330 msgr2=0x7fce6c0c7300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:02:10.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:10.115+0000 7fce714b9700 1 -- 172.21.15.45:0/2084335780 shutdown_connections 2023-12-22T10:02:10.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:10.115+0000 7fce714b9700 1 -- 172.21.15.45:0/2084335780 wait complete. 2023-12-22T10:02:10.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:10.115+0000 7fce714b9700 1 Processor -- start 2023-12-22T10:02:10.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:10.115+0000 7fce714b9700 1 -- start start 2023-12-22T10:02:10.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:10.119+0000 7fce714b9700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fce6c067180 0x7fce6c14a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:10.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:10.119+0000 7fce714b9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce6c0acc10 0x7fce6c154370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:10.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:10.119+0000 7fce714b9700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fce6c0bfcd0 0x7fce6c14d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:10.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:10.119+0000 7fce714b9700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce6c164790 con 0x7fce6c0acc10 2023-12-22T10:02:10.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:10.119+0000 7fce714b9700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce6c154d50 con 0x7fce6c0bfcd0 2023-12-22T10:02:10.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:10.119+0000 7fce714b9700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce6c155030 con 0x7fce6c067180 2023-12-22T10:02:10.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:10.119+0000 7fce637fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce6c0acc10 0x7fce6c154370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:10.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:10.119+0000 7fce637fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce6c0acc10 0x7fce6c154370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42860/0 (socket says 172.21.15.45:42860) 2023-12-22T10:02:10.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:10.119+0000 7fce637fe700 1 -- 172.21.15.45:0/66703817 learned_addr learned my addr 172.21.15.45:0/66703817 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:02:10.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:10.119+0000 7fce70cb8700 1 --2- 172.21.15.45:0/66703817 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fce6c0bfcd0 0x7fce6c14d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:10.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:10.119+0000 7fce6bfff700 1 --2- 172.21.15.45:0/66703817 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fce6c067180 0x7fce6c14a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:10.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:10.119+0000 7fce637fe700 1 -- 172.21.15.45:0/66703817 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fce6c067180 msgr2=0x7fce6c14a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:10.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:10.119+0000 7fce637fe700 1 --2- 172.21.15.45:0/66703817 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fce6c067180 0x7fce6c14a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:10.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:10.119+0000 7fce637fe700 1 -- 172.21.15.45:0/66703817 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fce6c0bfcd0 msgr2=0x7fce6c14d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:10.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:10.119+0000 7fce637fe700 1 --2- 172.21.15.45:0/66703817 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fce6c0bfcd0 0x7fce6c14d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:10.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:10.119+0000 7fce637fe700 1 -- 172.21.15.45:0/66703817 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce64009ae0 con 0x7fce6c0acc10 2023-12-22T10:02:10.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:10.119+0000 7fce637fe700 1 --2- 172.21.15.45:0/66703817 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce6c0acc10 0x7fce6c154370 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7fce5400c490 tx=0x7fce54007db0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:10.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:10.119+0000 7fce68ff9700 1 -- 172.21.15.45:0/66703817 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce54012400 con 0x7fce6c0acc10 2023-12-22T10:02:10.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:10.119+0000 7fce68ff9700 1 -- 172.21.15.45:0/66703817 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce54012560 con 0x7fce6c0acc10 2023-12-22T10:02:10.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:10.119+0000 7fce68ff9700 1 -- 172.21.15.45:0/66703817 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce54012920 con 0x7fce6c0acc10 2023-12-22T10:02:10.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:10.119+0000 7fce714b9700 1 -- 172.21.15.45:0/66703817 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce6c155310 con 0x7fce6c0acc10 2023-12-22T10:02:10.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:10.123+0000 7fce714b9700 1 -- 172.21.15.45:0/66703817 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce6c155920 con 0x7fce6c0acc10 2023-12-22T10:02:10.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:10.123+0000 7fce714b9700 1 -- 172.21.15.45:0/66703817 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce6c0ab030 con 0x7fce6c0acc10 2023-12-22T10:02:10.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:10.123+0000 7fce68ff9700 1 -- 172.21.15.45:0/66703817 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fce5401b3b0 con 0x7fce6c0acc10 2023-12-22T10:02:10.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:10.127+0000 7fce68ff9700 1 --2- 172.21.15.45:0/66703817 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fce5005a510 0x7fce5005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:10.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:10.127+0000 7fce68ff9700 1 -- 172.21.15.45:0/66703817 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6222+0+0 (secure 0 0 0) 0x7fce54073f00 con 0x7fce6c0acc10 2023-12-22T10:02:10.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:10.127+0000 7fce6bfff700 1 --2- 172.21.15.45:0/66703817 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fce5005a510 0x7fce5005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:10.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:10.127+0000 7fce6bfff700 1 --2- 172.21.15.45:0/66703817 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fce5005a510 0x7fce5005c9d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7fce5c007fd0 tx=0x7fce5c007d30).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:10.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:10.135+0000 7fce68ff9700 1 -- 172.21.15.45:0/66703817 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fce6c0ab030 con 0x7fce6c0acc10 2023-12-22T10:02:10.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:10.299+0000 7fce714b9700 1 -- 172.21.15.45:0/66703817 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "recovery_fs_metadata", "pool2": "recovery_fs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fce6c0ab030 con 0x7fce6c0acc10 2023-12-22T10:02:10.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:10.911+0000 7fce68ff9700 1 -- 172.21.15.45:0/66703817 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "recovery_fs_metadata", "pool2": "recovery_fs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'recovery_fs_metadata' removed v46) v1 ==== 196+0+0 (secure 0 0 0) 0x7fce6c0ab030 con 0x7fce6c0acc10 2023-12-22T10:02:10.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:10.911+0000 7fce714b9700 1 -- 172.21.15.45:0/66703817 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fce5005a510 msgr2=0x7fce5005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:10.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:10.911+0000 7fce714b9700 1 --2- 172.21.15.45:0/66703817 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fce5005a510 0x7fce5005c9d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7fce5c007fd0 tx=0x7fce5c007d30).stop 2023-12-22T10:02:10.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:10.911+0000 7fce714b9700 1 -- 172.21.15.45:0/66703817 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce6c0acc10 msgr2=0x7fce6c154370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:10.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:10.911+0000 7fce714b9700 1 --2- 172.21.15.45:0/66703817 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce6c0acc10 0x7fce6c154370 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7fce5400c490 tx=0x7fce54007db0).stop 2023-12-22T10:02:10.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:10.911+0000 7fce714b9700 1 -- 172.21.15.45:0/66703817 shutdown_connections 2023-12-22T10:02:10.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:10.911+0000 7fce714b9700 1 --2- 172.21.15.45:0/66703817 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fce6c0bfcd0 0x7fce6c14d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:10.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:10.911+0000 7fce714b9700 1 --2- 172.21.15.45:0/66703817 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce6c0acc10 0x7fce6c154370 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:10.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:10.911+0000 7fce714b9700 1 --2- 172.21.15.45:0/66703817 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fce5005a510 0x7fce5005c9d0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:10.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:10.911+0000 7fce714b9700 1 --2- 172.21.15.45:0/66703817 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fce6c067180 0x7fce6c14a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:10.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:10.911+0000 7fce714b9700 1 -- 172.21.15.45:0/66703817 >> 172.21.15.45:0/66703817 conn(0x7fce6c0cb330 msgr2=0x7fce6c066a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:02:10.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:10.915+0000 7fce714b9700 1 -- 172.21.15.45:0/66703817 shutdown_connections 2023-12-22T10:02:10.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:10.915+0000 7fce714b9700 1 -- 172.21.15.45:0/66703817 wait complete. 2023-12-22T10:02:10.916 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'recovery_fs_metadata' removed 2023-12-22T10:02:10.936 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-22T10:02:11.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:11.111+0000 7eff10946700 1 Processor -- start 2023-12-22T10:02:11.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:11.111+0000 7eff10946700 1 -- start start 2023-12-22T10:02:11.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:11.115+0000 7eff10946700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7eff0c150010 0x7eff0c0a7c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:11.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:11.115+0000 7eff10946700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7eff0c1503f0 0x7eff0c0c0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:11.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:11.115+0000 7eff10946700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff0c064890 con 0x7eff0c069dc0 2023-12-22T10:02:11.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:11.115+0000 7eff10946700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff0c065130 con 0x7eff0c1503f0 2023-12-22T10:02:11.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:11.115+0000 7eff10946700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff0c0c3890 con 0x7eff0c150010 2023-12-22T10:02:11.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:11.115+0000 7eff09d9b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7eff0c1503f0 0x7eff0c0c0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:11.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:11.115+0000 7eff09d9b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7eff0c1503f0 0x7eff0c0c0d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42868/0 (socket says 172.21.15.45:42868) 2023-12-22T10:02:11.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:11.115+0000 7eff09d9b700 1 -- 172.21.15.45:0/3974015127 learned_addr learned my addr 172.21.15.45:0/3974015127 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:02:11.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:11.115+0000 7eff0a59c700 1 --2- 172.21.15.45:0/3974015127 >> v2:172.21.15.113:3300/0 conn(0x7eff0c150010 0x7eff0c0a7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:11.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:11.115+0000 7eff09d9b700 1 -- 172.21.15.45:0/3974015127 >> v2:172.21.15.113:3300/0 conn(0x7eff0c150010 msgr2=0x7eff0c0a7c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:02:11.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:11.115+0000 7eff09d9b700 1 --2- 172.21.15.45:0/3974015127 >> v2:172.21.15.113:3300/0 conn(0x7eff0c150010 0x7eff0c0a7c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:11.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:11.115+0000 7eff09d9b700 1 -- 172.21.15.45:0/3974015127 >> v1:172.21.15.45:6789/0 conn(0x7eff0c069dc0 legacy=0x7eff0c0c3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:11.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:11.115+0000 7eff09d9b700 1 -- 172.21.15.45:0/3974015127 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff0c0a84f0 con 0x7eff0c1503f0 2023-12-22T10:02:11.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:11.115+0000 7eff0959a700 1 -- 172.21.15.45:0/3974015127 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1341238352 0 0) 0x7eff0c064890 con 0x7eff0c069dc0 2023-12-22T10:02:11.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:11.115+0000 7eff09d9b700 1 --2- 172.21.15.45:0/3974015127 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff0c1503f0 0x7eff0c0c0d30 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 rx=0x7eff0c063a00 tx=0x7eff0000b3b0).ready entity=mon.0 client_cookie=8cc248d01b7026f server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:11.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:11.115+0000 7eff0959a700 1 -- 172.21.15.45:0/3974015127 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff0000da40 con 0x7eff0c1503f0 2023-12-22T10:02:11.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:11.115+0000 7eff0959a700 1 -- 172.21.15.45:0/3974015127 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff0000dba0 con 0x7eff0c1503f0 2023-12-22T10:02:11.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:11.115+0000 7eff0959a700 1 -- 172.21.15.45:0/3974015127 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff00010470 con 0x7eff0c1503f0 2023-12-22T10:02:11.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:11.119+0000 7eff10946700 1 -- 172.21.15.45:0/3974015127 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff0c1503f0 msgr2=0x7eff0c0c0d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:11.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:11.119+0000 7eff10946700 1 --2- 172.21.15.45:0/3974015127 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff0c1503f0 0x7eff0c0c0d30 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 rx=0x7eff0c063a00 tx=0x7eff0000b3b0).stop 2023-12-22T10:02:11.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:11.119+0000 7eff10946700 1 -- 172.21.15.45:0/3974015127 shutdown_connections 2023-12-22T10:02:11.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:11.119+0000 7eff10946700 1 --2- 172.21.15.45:0/3974015127 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff0c1503f0 0x7eff0c0c0d30 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:11.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:11.119+0000 7eff10946700 1 --2- 172.21.15.45:0/3974015127 >> v2:172.21.15.113:3300/0 conn(0x7eff0c150010 0x7eff0c0a7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:11.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:11.119+0000 7eff10946700 1 -- 172.21.15.45:0/3974015127 >> 172.21.15.45:0/3974015127 conn(0x7eff0c066a70 msgr2=0x7eff0c066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:02:11.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:11.119+0000 7eff10946700 1 -- 172.21.15.45:0/3974015127 shutdown_connections 2023-12-22T10:02:11.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:11.119+0000 7eff10946700 1 -- 172.21.15.45:0/3974015127 wait complete. 2023-12-22T10:02:11.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:11.119+0000 7eff10946700 1 Processor -- start 2023-12-22T10:02:11.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:11.123+0000 7eff10946700 1 -- start start 2023-12-22T10:02:11.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:11.123+0000 7eff10946700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7eff0c069dc0 0x7eff0c09faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:11.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:11.123+0000 7eff10946700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff0c150010 0x7eff0c0a5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:11.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:11.123+0000 7eff10946700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7eff0c1503f0 0x7eff0c151850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:11.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:11.123+0000 7eff10946700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff0c0a6250 con 0x7eff0c150010 2023-12-22T10:02:11.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:11.123+0000 7eff10946700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff0c152c40 con 0x7eff0c069dc0 2023-12-22T10:02:11.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:11.123+0000 7eff10946700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff0c152030 con 0x7eff0c1503f0 2023-12-22T10:02:11.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:11.123+0000 7eff09d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff0c150010 0x7eff0c0a5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:11.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:11.123+0000 7eff09d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff0c150010 0x7eff0c0a5d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42872/0 (socket says 172.21.15.45:42872) 2023-12-22T10:02:11.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:11.123+0000 7eff09d9b700 1 -- 172.21.15.45:0/2875788766 learned_addr learned my addr 172.21.15.45:0/2875788766 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:02:11.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:11.123+0000 7eff0a59c700 1 --2- 172.21.15.45:0/2875788766 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7eff0c069dc0 0x7eff0c09faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:11.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:11.123+0000 7eff0ad9d700 1 --2- 172.21.15.45:0/2875788766 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7eff0c1503f0 0x7eff0c151850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:11.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:11.123+0000 7eff09d9b700 1 -- 172.21.15.45:0/2875788766 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7eff0c1503f0 msgr2=0x7eff0c151850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:11.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:11.123+0000 7eff09d9b700 1 --2- 172.21.15.45:0/2875788766 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7eff0c1503f0 0x7eff0c151850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:11.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:11.123+0000 7eff09d9b700 1 -- 172.21.15.45:0/2875788766 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7eff0c069dc0 msgr2=0x7eff0c09faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:11.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:11.123+0000 7eff09d9b700 1 --2- 172.21.15.45:0/2875788766 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7eff0c069dc0 0x7eff0c09faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:11.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:11.123+0000 7eff09d9b700 1 -- 172.21.15.45:0/2875788766 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff0000b610 con 0x7eff0c150010 2023-12-22T10:02:11.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:11.123+0000 7eff0a59c700 1 --2- 172.21.15.45:0/2875788766 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7eff0c069dc0 0x7eff0c09faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T10:02:11.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:11.123+0000 7eff09d9b700 1 --2- 172.21.15.45:0/2875788766 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff0c150010 0x7eff0c0a5d60 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7eff0c0c0ce0 tx=0x7eff0000b3b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:11.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:11.123+0000 7efefa7fc700 1 -- 172.21.15.45:0/2875788766 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff00019450 con 0x7eff0c150010 2023-12-22T10:02:11.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:11.123+0000 7efefa7fc700 1 -- 172.21.15.45:0/2875788766 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff000195b0 con 0x7eff0c150010 2023-12-22T10:02:11.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:11.127+0000 7eff10946700 1 -- 172.21.15.45:0/2875788766 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff0c152310 con 0x7eff0c150010 2023-12-22T10:02:11.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:11.127+0000 7efefa7fc700 1 -- 172.21.15.45:0/2875788766 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff00019930 con 0x7eff0c150010 2023-12-22T10:02:11.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:11.127+0000 7eff10946700 1 -- 172.21.15.45:0/2875788766 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff0c1528d0 con 0x7eff0c150010 2023-12-22T10:02:11.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:11.127+0000 7eff10946700 1 -- 172.21.15.45:0/2875788766 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff0c152dd0 con 0x7eff0c150010 2023-12-22T10:02:11.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:11.127+0000 7efefa7fc700 1 -- 172.21.15.45:0/2875788766 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7eff00019ce0 con 0x7eff0c150010 2023-12-22T10:02:11.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:11.131+0000 7efefa7fc700 1 --2- 172.21.15.45:0/2875788766 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7efeec05a510 0x7efeec05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:11.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:11.131+0000 7efefa7fc700 1 -- 172.21.15.45:0/2875788766 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5774+0+0 (secure 0 0 0) 0x7eff00075d60 con 0x7eff0c150010 2023-12-22T10:02:11.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:11.131+0000 7eff0a59c700 1 --2- 172.21.15.45:0/2875788766 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7efeec05a510 0x7efeec05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:11.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:11.131+0000 7eff0a59c700 1 --2- 172.21.15.45:0/2875788766 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7efeec05a510 0x7efeec05c9d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7eff0c062c90 tx=0x7efefc008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:11.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:11.135+0000 7efefa7fc700 1 -- 172.21.15.45:0/2875788766 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7eff000496a0 con 0x7eff0c150010 2023-12-22T10:02:11.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:11.307+0000 7eff10946700 1 -- 172.21.15.45:0/2875788766 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7eff0c06c070 con 0x7eff0c150010 2023-12-22T10:02:11.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:11.923+0000 7efefa7fc700 1 -- 172.21.15.45:0/2875788766 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v47) v1 ==== 169+0+0 (secure 0 0 0) 0x7eff00028070 con 0x7eff0c150010 2023-12-22T10:02:11.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:11.927+0000 7eff10946700 1 -- 172.21.15.45:0/2875788766 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7efeec05a510 msgr2=0x7efeec05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:11.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:11.927+0000 7eff10946700 1 --2- 172.21.15.45:0/2875788766 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7efeec05a510 0x7efeec05c9d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7eff0c062c90 tx=0x7efefc008040).stop 2023-12-22T10:02:11.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:11.927+0000 7eff10946700 1 -- 172.21.15.45:0/2875788766 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff0c150010 msgr2=0x7eff0c0a5d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:11.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:11.927+0000 7eff10946700 1 --2- 172.21.15.45:0/2875788766 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff0c150010 0x7eff0c0a5d60 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7eff0c0c0ce0 tx=0x7eff0000b3b0).stop 2023-12-22T10:02:11.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:11.927+0000 7eff10946700 1 -- 172.21.15.45:0/2875788766 shutdown_connections 2023-12-22T10:02:11.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:11.927+0000 7eff10946700 1 --2- 172.21.15.45:0/2875788766 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7efeec05a510 0x7efeec05c9d0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:11.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:11.927+0000 7eff10946700 1 --2- 172.21.15.45:0/2875788766 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7eff0c1503f0 0x7eff0c151850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:11.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:11.927+0000 7eff10946700 1 --2- 172.21.15.45:0/2875788766 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff0c150010 0x7eff0c0a5d60 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:11.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:11.927+0000 7eff10946700 1 --2- 172.21.15.45:0/2875788766 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7eff0c069dc0 0x7eff0c09faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:11.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:11.927+0000 7eff10946700 1 -- 172.21.15.45:0/2875788766 >> 172.21.15.45:0/2875788766 conn(0x7eff0c066a70 msgr2=0x7eff0c0c4590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:02:11.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:11.927+0000 7eff10946700 1 -- 172.21.15.45:0/2875788766 shutdown_connections 2023-12-22T10:02:11.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:11.927+0000 7eff10946700 1 -- 172.21.15.45:0/2875788766 wait complete. 2023-12-22T10:02:11.930 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data' removed 2023-12-22T10:02:11.962 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-22T10:02:12.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.127+0000 7faed5307700 1 Processor -- start 2023-12-22T10:02:12.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.127+0000 7faed5307700 1 -- start start 2023-12-22T10:02:12.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.127+0000 7faed5307700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7faed014f310 0x7faed0152c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:12.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.127+0000 7faed5307700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7faed014f6f0 0x7faed00c4b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:12.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.127+0000 7faed5307700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faed0152780 con 0x7faed0065740 2023-12-22T10:02:12.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.127+0000 7faed5307700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faed00c5210 con 0x7faed014f310 2023-12-22T10:02:12.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.127+0000 7faed5307700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faed0152130 con 0x7faed014f6f0 2023-12-22T10:02:12.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.127+0000 7faed4b06700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7faed0065740 0x7faed00a87c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:54660/0 (socket says 172.21.15.45:54660) 2023-12-22T10:02:12.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.127+0000 7faed4b06700 1 -- 172.21.15.45:0/495728212 learned_addr learned my addr 172.21.15.45:0/495728212 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:02:12.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.127+0000 7faecffff700 1 --2- 172.21.15.45:0/495728212 >> v2:172.21.15.45:3300/0 conn(0x7faed014f310 0x7faed0152c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:12.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.127+0000 7faecf7fe700 1 --2- 172.21.15.45:0/495728212 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7faed014f6f0 0x7faed00c4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:12.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.127+0000 7faeceffd700 1 -- 172.21.15.45:0/495728212 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 693093279 0 0) 0x7faed0152780 con 0x7faed0065740 2023-12-22T10:02:12.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.131+0000 7faeceffd700 1 -- 172.21.15.45:0/495728212 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faeb80033f0 con 0x7faed0065740 2023-12-22T10:02:12.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.131+0000 7faecf7fe700 1 -- 172.21.15.45:0/495728212 >> v2:172.21.15.45:3300/0 conn(0x7faed014f310 msgr2=0x7faed0152c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:02:12.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.131+0000 7faecf7fe700 1 --2- 172.21.15.45:0/495728212 >> v2:172.21.15.45:3300/0 conn(0x7faed014f310 0x7faed0152c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:12.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.131+0000 7faecf7fe700 1 -- 172.21.15.45:0/495728212 >> v1:172.21.15.45:6789/0 conn(0x7faed0065740 legacy=0x7faed00a87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:12.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.131+0000 7faecf7fe700 1 -- 172.21.15.45:0/495728212 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faed0152410 con 0x7faed014f6f0 2023-12-22T10:02:12.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.131+0000 7faecf7fe700 1 --2- 172.21.15.45:0/495728212 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7faed014f6f0 0x7faed00c4b80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7faec4009760 tx=0x7faec4009060).ready entity=mon.2 client_cookie=df5aeeb898752213 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:12.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.131+0000 7faeceffd700 1 -- 172.21.15.45:0/495728212 <== mon.2 v2:172.21.15.113:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec400f510 con 0x7faed014f6f0 2023-12-22T10:02:12.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.131+0000 7faeceffd700 1 -- 172.21.15.45:0/495728212 <== mon.2 v2:172.21.15.113:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faec400f670 con 0x7faed014f6f0 2023-12-22T10:02:12.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.131+0000 7faeceffd700 1 -- 172.21.15.45:0/495728212 <== mon.2 v2:172.21.15.113:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec400f9f0 con 0x7faed014f6f0 2023-12-22T10:02:12.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.131+0000 7faed5307700 1 -- 172.21.15.45:0/495728212 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7faed014f6f0 msgr2=0x7faed00c4b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:12.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.131+0000 7faed5307700 1 --2- 172.21.15.45:0/495728212 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7faed014f6f0 0x7faed00c4b80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7faec4009760 tx=0x7faec4009060).stop 2023-12-22T10:02:12.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.131+0000 7faed5307700 1 -- 172.21.15.45:0/495728212 shutdown_connections 2023-12-22T10:02:12.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.131+0000 7faed5307700 1 --2- 172.21.15.45:0/495728212 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7faed014f6f0 0x7faed00c4b80 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:12.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.131+0000 7faed5307700 1 --2- 172.21.15.45:0/495728212 >> v2:172.21.15.45:3300/0 conn(0x7faed014f310 0x7faed0152c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:12.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.131+0000 7faed5307700 1 -- 172.21.15.45:0/495728212 >> 172.21.15.45:0/495728212 conn(0x7faed0067500 msgr2=0x7faed00c6440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:02:12.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.131+0000 7faed5307700 1 -- 172.21.15.45:0/495728212 shutdown_connections 2023-12-22T10:02:12.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.131+0000 7faed5307700 1 -- 172.21.15.45:0/495728212 wait complete. 2023-12-22T10:02:12.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.135+0000 7faed5307700 1 Processor -- start 2023-12-22T10:02:12.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.135+0000 7faed5307700 1 -- start start 2023-12-22T10:02:12.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.139+0000 7faed5307700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faed0065740 0x7faed00ac070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:12.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.139+0000 7faed5307700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faed014f310 0x7faed014e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:12.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.139+0000 7faed5307700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7faed014f6f0 0x7faed00bf5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:12.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.139+0000 7faed5307700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faed014ea80 con 0x7faed014f310 2023-12-22T10:02:12.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.139+0000 7faed5307700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faed0167bd0 con 0x7faed0065740 2023-12-22T10:02:12.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.139+0000 7faed5307700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faed00c0370 con 0x7faed014f6f0 2023-12-22T10:02:12.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.139+0000 7faecf7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faed014f310 0x7faed014e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:12.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.139+0000 7faed4b06700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7faed014f6f0 0x7faed00bf5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:12.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.139+0000 7faecf7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faed014f310 0x7faed014e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42902/0 (socket says 172.21.15.45:42902) 2023-12-22T10:02:12.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.139+0000 7faecffff700 1 --2- 172.21.15.45:0/2228592373 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faed0065740 0x7faed00ac070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:12.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.139+0000 7faecf7fe700 1 -- 172.21.15.45:0/2228592373 learned_addr learned my addr 172.21.15.45:0/2228592373 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:02:12.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.139+0000 7faed4b06700 1 -- 172.21.15.45:0/2228592373 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faed0065740 msgr2=0x7faed00ac070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:12.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.139+0000 7faed4b06700 1 --2- 172.21.15.45:0/2228592373 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faed0065740 0x7faed00ac070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:12.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.139+0000 7faed4b06700 1 -- 172.21.15.45:0/2228592373 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faed014f310 msgr2=0x7faed014e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:12.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.139+0000 7faed4b06700 1 --2- 172.21.15.45:0/2228592373 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faed014f310 0x7faed014e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:12.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.139+0000 7faed4b06700 1 -- 172.21.15.45:0/2228592373 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faec40092a0 con 0x7faed014f6f0 2023-12-22T10:02:12.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.139+0000 7faecf7fe700 1 --2- 172.21.15.45:0/2228592373 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faed014f310 0x7faed014e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-12-22T10:02:12.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.139+0000 7faed4b06700 1 --2- 172.21.15.45:0/2228592373 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7faed014f6f0 0x7faed00bf5b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7faec800c790 tx=0x7faec8007f10).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:12.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.139+0000 7faeb7fff700 1 -- 172.21.15.45:0/2228592373 <== mon.2 v2:172.21.15.113:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec8005d30 con 0x7faed014f6f0 2023-12-22T10:02:12.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.139+0000 7faeb7fff700 1 -- 172.21.15.45:0/2228592373 <== mon.2 v2:172.21.15.113:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faec8005e90 con 0x7faed014f6f0 2023-12-22T10:02:12.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.139+0000 7faeb7fff700 1 -- 172.21.15.45:0/2228592373 <== mon.2 v2:172.21.15.113:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec80072e0 con 0x7faed014f6f0 2023-12-22T10:02:12.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.139+0000 7faed5307700 1 -- 172.21.15.45:0/2228592373 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faed00bfdb0 con 0x7faed014f6f0 2023-12-22T10:02:12.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.139+0000 7faed5307700 1 -- 172.21.15.45:0/2228592373 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faed0167860 con 0x7faed014f6f0 2023-12-22T10:02:12.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.143+0000 7faed5307700 1 -- 172.21.15.45:0/2228592373 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faed0167d40 con 0x7faed014f6f0 2023-12-22T10:02:12.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.143+0000 7faeb7fff700 1 -- 172.21.15.45:0/2228592373 <== mon.2 v2:172.21.15.113:3301/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7faec8007710 con 0x7faed014f6f0 2023-12-22T10:02:12.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.143+0000 7faeb7fff700 1 --2- 172.21.15.45:0/2228592373 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7faebc05a510 0x7faebc05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:12.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.143+0000 7faeb7fff700 1 -- 172.21.15.45:0/2228592373 <== mon.2 v2:172.21.15.113:3301/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5355+0+0 (secure 0 0 0) 0x7faec8073d20 con 0x7faed014f6f0 2023-12-22T10:02:12.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.143+0000 7faecffff700 1 --2- 172.21.15.45:0/2228592373 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7faebc05a510 0x7faebc05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:12.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.147+0000 7faecffff700 1 --2- 172.21.15.45:0/2228592373 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7faebc05a510 0x7faebc05c9d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7faec000bbc0 tx=0x7faec0008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:12.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.151+0000 7faeb7fff700 1 -- 172.21.15.45:0/2228592373 <== mon.2 v2:172.21.15.113:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7faec8047740 con 0x7faed014f6f0 2023-12-22T10:02:12.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.315+0000 7faed5307700 1 -- 172.21.15.45:0/2228592373 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7faed0047060 con 0x7faed014f6f0 2023-12-22T10:02:12.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.327+0000 7faeb7fff700 1 -- 172.21.15.45:0/2228592373 <== mon.2 v2:172.21.15.113:3301/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v3) v1 ==== 104+0+0 (secure 0 0 0) 0x7faec8018070 con 0x7faed014f6f0 2023-12-22T10:02:12.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.331+0000 7faed5307700 1 -- 172.21.15.45:0/2228592373 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7faebc05a510 msgr2=0x7faebc05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:12.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.331+0000 7faed5307700 1 --2- 172.21.15.45:0/2228592373 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7faebc05a510 0x7faebc05c9d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7faec000bbc0 tx=0x7faec0008040).stop 2023-12-22T10:02:12.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.331+0000 7faed5307700 1 -- 172.21.15.45:0/2228592373 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7faed014f6f0 msgr2=0x7faed00bf5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:12.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.331+0000 7faed5307700 1 --2- 172.21.15.45:0/2228592373 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7faed014f6f0 0x7faed00bf5b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7faec800c790 tx=0x7faec8007f10).stop 2023-12-22T10:02:12.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.331+0000 7faed5307700 1 -- 172.21.15.45:0/2228592373 shutdown_connections 2023-12-22T10:02:12.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.331+0000 7faed5307700 1 --2- 172.21.15.45:0/2228592373 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7faebc05a510 0x7faebc05c9d0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:12.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.331+0000 7faed5307700 1 --2- 172.21.15.45:0/2228592373 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7faed014f6f0 0x7faed00bf5b0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:12.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.331+0000 7faed5307700 1 --2- 172.21.15.45:0/2228592373 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faed014f310 0x7faed014e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:12.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.331+0000 7faed5307700 1 --2- 172.21.15.45:0/2228592373 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7faed0065740 0x7faed00ac070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:12.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.331+0000 7faed5307700 1 -- 172.21.15.45:0/2228592373 >> 172.21.15.45:0/2228592373 conn(0x7faed0067500 msgr2=0x7faed0064620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:02:12.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.331+0000 7faed5307700 1 -- 172.21.15.45:0/2228592373 shutdown_connections 2023-12-22T10:02:12.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.331+0000 7faed5307700 1 -- 172.21.15.45:0/2228592373 wait complete. 2023-12-22T10:02:12.354 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_recovery_pool.TestRecoveryPool.test_rebuild_simple' 2023-12-22T10:02:12.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.531+0000 7efcde7a9700 1 Processor -- start 2023-12-22T10:02:12.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.531+0000 7efcde7a9700 1 -- start start 2023-12-22T10:02:12.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.535+0000 7efcde7a9700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7efcd80c02e0 0x7efcd8153e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:12.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.535+0000 7efcde7a9700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcd80c3c70 con 0x7efcd8153aa0 2023-12-22T10:02:12.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.535+0000 7efcde7a9700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcd80c27d0 con 0x7efcd8067590 2023-12-22T10:02:12.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.535+0000 7efcde7a9700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcd8065870 con 0x7efcd80c02e0 2023-12-22T10:02:12.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.535+0000 7efccf7fe700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7efcd80c02e0 0x7efcd8153e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:12.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.535+0000 7efccf7fe700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7efcd80c02e0 0x7efcd8153e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42904/0 (socket says 172.21.15.45:42904) 2023-12-22T10:02:12.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.535+0000 7efccf7fe700 1 -- 172.21.15.45:0/951125243 learned_addr learned my addr 172.21.15.45:0/951125243 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:02:12.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.535+0000 7efccf7fe700 1 -- 172.21.15.45:0/951125243 >> v1:172.21.15.113:6789/0 conn(0x7efcd8067590 legacy=0x7efcd8154370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:02:12.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.535+0000 7efccf7fe700 1 -- 172.21.15.45:0/951125243 >> v1:172.21.15.45:6789/0 conn(0x7efcd8153aa0 legacy=0x7efcd80bfbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:12.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.535+0000 7efccf7fe700 1 -- 172.21.15.45:0/951125243 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcd8065b50 con 0x7efcd80c02e0 2023-12-22T10:02:12.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.539+0000 7efccf7fe700 1 --2- 172.21.15.45:0/951125243 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efcd80c02e0 0x7efcd8153e80 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 rx=0x7efcc0006fd0 tx=0x7efcc00090f0).ready entity=mon.0 client_cookie=faf7664a24df849a server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:12.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.539+0000 7efcd77fe700 1 -- 172.21.15.45:0/951125243 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc000b600 con 0x7efcd80c02e0 2023-12-22T10:02:12.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.539+0000 7efcd77fe700 1 -- 172.21.15.45:0/951125243 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcc000b760 con 0x7efcd80c02e0 2023-12-22T10:02:12.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.539+0000 7efcd77fe700 1 -- 172.21.15.45:0/951125243 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc000bae0 con 0x7efcd80c02e0 2023-12-22T10:02:12.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.539+0000 7efcde7a9700 1 -- 172.21.15.45:0/951125243 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efcd80c02e0 msgr2=0x7efcd8153e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:12.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.539+0000 7efcde7a9700 1 --2- 172.21.15.45:0/951125243 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efcd80c02e0 0x7efcd8153e80 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 rx=0x7efcc0006fd0 tx=0x7efcc00090f0).stop 2023-12-22T10:02:12.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.539+0000 7efcde7a9700 1 -- 172.21.15.45:0/951125243 shutdown_connections 2023-12-22T10:02:12.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.539+0000 7efcde7a9700 1 --2- 172.21.15.45:0/951125243 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efcd80c02e0 0x7efcd8153e80 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:12.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.539+0000 7efcde7a9700 1 -- 172.21.15.45:0/951125243 >> 172.21.15.45:0/951125243 conn(0x7efcd8066a70 msgr2=0x7efcd8066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:02:12.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.539+0000 7efcde7a9700 1 -- 172.21.15.45:0/951125243 shutdown_connections 2023-12-22T10:02:12.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.539+0000 7efcde7a9700 1 -- 172.21.15.45:0/951125243 wait complete. 2023-12-22T10:02:12.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.543+0000 7efcde7a9700 1 Processor -- start 2023-12-22T10:02:12.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.543+0000 7efcde7a9700 1 -- start start 2023-12-22T10:02:12.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.543+0000 7efcde7a9700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7efcd8067590 0x7efcd8142160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:12.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.543+0000 7efcde7a9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efcd80c02e0 0x7efcd81672f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:12.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.543+0000 7efcde7a9700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efcd8153aa0 0x7efcd81677e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:12.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.543+0000 7efcde7a9700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcd8167cd0 con 0x7efcd80c02e0 2023-12-22T10:02:12.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.543+0000 7efcde7a9700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcd8157db0 con 0x7efcd8153aa0 2023-12-22T10:02:12.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.543+0000 7efcde7a9700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcd8158650 con 0x7efcd8067590 2023-12-22T10:02:12.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.543+0000 7efccf7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efcd80c02e0 0x7efcd81672f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:12.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.543+0000 7efccf7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efcd80c02e0 0x7efcd81672f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42908/0 (socket says 172.21.15.45:42908) 2023-12-22T10:02:12.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.543+0000 7efccf7fe700 1 -- 172.21.15.45:0/172987682 learned_addr learned my addr 172.21.15.45:0/172987682 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:02:12.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.543+0000 7efcd7fff700 1 --2- 172.21.15.45:0/172987682 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7efcd8067590 0x7efcd8142160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:12.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.543+0000 7efcdcd46700 1 --2- 172.21.15.45:0/172987682 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efcd8153aa0 0x7efcd81677e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:12.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.547+0000 7efccf7fe700 1 -- 172.21.15.45:0/172987682 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7efcd8067590 msgr2=0x7efcd8142160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:12.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.547+0000 7efccf7fe700 1 --2- 172.21.15.45:0/172987682 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7efcd8067590 0x7efcd8142160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:12.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.547+0000 7efccf7fe700 1 -- 172.21.15.45:0/172987682 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efcd8153aa0 msgr2=0x7efcd81677e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:12.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.547+0000 7efccf7fe700 1 --2- 172.21.15.45:0/172987682 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efcd8153aa0 0x7efcd81677e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:12.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.547+0000 7efccf7fe700 1 -- 172.21.15.45:0/172987682 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcc0009370 con 0x7efcd80c02e0 2023-12-22T10:02:12.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.547+0000 7efccf7fe700 1 --2- 172.21.15.45:0/172987682 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efcd80c02e0 0x7efcd81672f0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 rx=0x7efcd80640c0 tx=0x7efcc0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:12.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.547+0000 7efcd4ff9700 1 -- 172.21.15.45:0/172987682 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc000b8d0 con 0x7efcd80c02e0 2023-12-22T10:02:12.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.547+0000 7efcd4ff9700 1 -- 172.21.15.45:0/172987682 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcc000ba30 con 0x7efcd80c02e0 2023-12-22T10:02:12.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.547+0000 7efcde7a9700 1 -- 172.21.15.45:0/172987682 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcd8156820 con 0x7efcd80c02e0 2023-12-22T10:02:12.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.547+0000 7efcd4ff9700 1 -- 172.21.15.45:0/172987682 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc001c670 con 0x7efcd80c02e0 2023-12-22T10:02:12.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.547+0000 7efcde7a9700 1 -- 172.21.15.45:0/172987682 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcd81582e0 con 0x7efcd80c02e0 2023-12-22T10:02:12.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.547+0000 7efcde7a9700 1 -- 172.21.15.45:0/172987682 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcd806c070 con 0x7efcd80c02e0 2023-12-22T10:02:12.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.551+0000 7efcd4ff9700 1 -- 172.21.15.45:0/172987682 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7efcc001ca20 con 0x7efcd80c02e0 2023-12-22T10:02:12.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.551+0000 7efcd4ff9700 1 --2- 172.21.15.45:0/172987682 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7efcb805a510 0x7efcb805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:12.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.551+0000 7efcd4ff9700 1 -- 172.21.15.45:0/172987682 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5355+0+0 (secure 0 0 0) 0x7efcc0075de0 con 0x7efcd80c02e0 2023-12-22T10:02:12.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.551+0000 7efcd7fff700 1 --2- 172.21.15.45:0/172987682 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7efcb805a510 0x7efcb805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:12.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.555+0000 7efcd7fff700 1 --2- 172.21.15.45:0/172987682 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7efcb805a510 0x7efcb805c9d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7efcc8003860 tx=0x7efcc8007d40).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:12.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.559+0000 7efcd4ff9700 1 -- 172.21.15.45:0/172987682 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7efcc0049800 con 0x7efcd80c02e0 2023-12-22T10:02:12.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.779+0000 7efcde7a9700 1 -- 172.21.15.45:0/172987682 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_recovery_pool.TestRecoveryPool.test_rebuild_simple"]} v 0) v1 -- 0x7efcd80681c0 con 0x7efcd80c02e0 2023-12-22T10:02:12.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.935+0000 7efcd4ff9700 1 -- 172.21.15.45:0/172987682 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_recovery_pool.TestRecoveryPool.test_rebuild_simple"]}]=0 v111) v1 ==== 147+0+0 (secure 0 0 0) 0x7efcc0020070 con 0x7efcd80c02e0 2023-12-22T10:02:12.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.939+0000 7efcde7a9700 1 -- 172.21.15.45:0/172987682 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7efcb805a510 msgr2=0x7efcb805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:12.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.939+0000 7efcde7a9700 1 --2- 172.21.15.45:0/172987682 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7efcb805a510 0x7efcb805c9d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7efcc8003860 tx=0x7efcc8007d40).stop 2023-12-22T10:02:12.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.939+0000 7efcde7a9700 1 -- 172.21.15.45:0/172987682 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efcd80c02e0 msgr2=0x7efcd81672f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:12.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.939+0000 7efcde7a9700 1 --2- 172.21.15.45:0/172987682 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efcd80c02e0 0x7efcd81672f0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 rx=0x7efcd80640c0 tx=0x7efcc0017000).stop 2023-12-22T10:02:12.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.939+0000 7efcde7a9700 1 -- 172.21.15.45:0/172987682 shutdown_connections 2023-12-22T10:02:12.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.939+0000 7efcde7a9700 1 --2- 172.21.15.45:0/172987682 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7efcd8153aa0 0x7efcd81677e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:12.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.939+0000 7efcde7a9700 1 --2- 172.21.15.45:0/172987682 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efcd80c02e0 0x7efcd81672f0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:12.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.939+0000 7efcde7a9700 1 --2- 172.21.15.45:0/172987682 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7efcb805a510 0x7efcb805c9d0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:12.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.939+0000 7efcde7a9700 1 --2- 172.21.15.45:0/172987682 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7efcd8067590 0x7efcd8142160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:12.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.939+0000 7efcde7a9700 1 -- 172.21.15.45:0/172987682 >> 172.21.15.45:0/172987682 conn(0x7efcd8066a70 msgr2=0x7efcd80ab880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:02:12.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.939+0000 7efcde7a9700 1 -- 172.21.15.45:0/172987682 shutdown_connections 2023-12-22T10:02:12.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:12.939+0000 7efcde7a9700 1 -- 172.21.15.45:0/172987682 wait complete. 2023-12-22T10:02:12.962 INFO:tasks.cephfs_test_runner:test_rebuild_simple (tasks.cephfs.test_recovery_pool.TestRecoveryPool) ... ERROR 2023-12-22T10:02:12.962 INFO:tasks.cephfs_test_runner: 2023-12-22T10:02:12.962 INFO:tasks.cephfs_test_runner:====================================================================== 2023-12-22T10:02:12.962 INFO:tasks.cephfs_test_runner:ERROR: test_rebuild_simple (tasks.cephfs.test_recovery_pool.TestRecoveryPool) 2023-12-22T10:02:12.962 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-12-22T10:02:12.962 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-12-22T10:02:12.962 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_4ab91a455dc86ea102fdfa1407dbcce323929634/qa/tasks/cephfs/test_recovery_pool.py", line 179, in test_rebuild_simple 2023-12-22T10:02:12.963 INFO:tasks.cephfs_test_runner: self._rebuild_metadata(SimpleOverlayWorkload()) 2023-12-22T10:02:12.963 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_4ab91a455dc86ea102fdfa1407dbcce323929634/qa/tasks/cephfs/test_recovery_pool.py", line 122, in _rebuild_metadata 2023-12-22T10:02:12.963 INFO:tasks.cephfs_test_runner: self.run_ceph_cmd('-s') 2023-12-22T10:02:12.963 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_4ab91a455dc86ea102fdfa1407dbcce323929634/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd 2023-12-22T10:02:12.963 INFO:tasks.cephfs_test_runner: return self.mon_manager.run_cluster_cmd(**kwargs) 2023-12-22T10:02:12.963 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_4ab91a455dc86ea102fdfa1407dbcce323929634/qa/tasks/ceph_manager.py", line 1609, in run_cluster_cmd 2023-12-22T10:02:12.963 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2023-12-22T10:02:12.963 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_9680d2aba1e76f64ade295c81599c97907457848/teuthology/orchestra/remote.py", line 523, in run 2023-12-22T10:02:12.963 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-12-22T10:02:12.963 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_9680d2aba1e76f64ade295c81599c97907457848/teuthology/orchestra/run.py", line 455, in run 2023-12-22T10:02:12.963 INFO:tasks.cephfs_test_runner: r.wait() 2023-12-22T10:02:12.963 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_9680d2aba1e76f64ade295c81599c97907457848/teuthology/orchestra/run.py", line 161, in wait 2023-12-22T10:02:12.963 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-12-22T10:02:12.963 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_9680d2aba1e76f64ade295c81599c97907457848/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-12-22T10:02:12.963 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-12-22T10:02:12.963 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi045 with status 22: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph - s' 2023-12-22T10:02:12.963 INFO:tasks.cephfs_test_runner: 2023-12-22T10:02:12.963 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-12-22T10:02:12.964 INFO:tasks.cephfs_test_runner:Ran 1 test in 60.699s 2023-12-22T10:02:12.964 INFO:tasks.cephfs_test_runner: 2023-12-22T10:02:12.964 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2023-12-22T10:02:12.964 INFO:tasks.cephfs_test_runner: 2023-12-22T10:02:12.964 INFO:tasks.cephfs_test_runner:====================================================================== 2023-12-22T10:02:12.964 INFO:tasks.cephfs_test_runner:ERROR: test_rebuild_simple (tasks.cephfs.test_recovery_pool.TestRecoveryPool) 2023-12-22T10:02:12.964 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-12-22T10:02:12.964 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-12-22T10:02:12.964 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_4ab91a455dc86ea102fdfa1407dbcce323929634/qa/tasks/cephfs/test_recovery_pool.py", line 179, in test_rebuild_simple 2023-12-22T10:02:12.964 INFO:tasks.cephfs_test_runner: self._rebuild_metadata(SimpleOverlayWorkload()) 2023-12-22T10:02:12.964 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_4ab91a455dc86ea102fdfa1407dbcce323929634/qa/tasks/cephfs/test_recovery_pool.py", line 122, in _rebuild_metadata 2023-12-22T10:02:12.964 INFO:tasks.cephfs_test_runner: self.run_ceph_cmd('-s') 2023-12-22T10:02:12.964 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_4ab91a455dc86ea102fdfa1407dbcce323929634/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd 2023-12-22T10:02:12.964 INFO:tasks.cephfs_test_runner: return self.mon_manager.run_cluster_cmd(**kwargs) 2023-12-22T10:02:12.964 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_4ab91a455dc86ea102fdfa1407dbcce323929634/qa/tasks/ceph_manager.py", line 1609, in run_cluster_cmd 2023-12-22T10:02:12.965 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2023-12-22T10:02:12.965 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_9680d2aba1e76f64ade295c81599c97907457848/teuthology/orchestra/remote.py", line 523, in run 2023-12-22T10:02:12.965 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-12-22T10:02:12.965 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_9680d2aba1e76f64ade295c81599c97907457848/teuthology/orchestra/run.py", line 455, in run 2023-12-22T10:02:12.965 INFO:tasks.cephfs_test_runner: r.wait() 2023-12-22T10:02:12.965 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_9680d2aba1e76f64ade295c81599c97907457848/teuthology/orchestra/run.py", line 161, in wait 2023-12-22T10:02:12.965 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-12-22T10:02:12.965 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_9680d2aba1e76f64ade295c81599c97907457848/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-12-22T10:02:12.965 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-12-22T10:02:12.965 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi045 with status 22: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph - s' 2023-12-22T10:02:12.965 INFO:tasks.cephfs_test_runner: 2023-12-22T10:02:12.965 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9680d2aba1e76f64ade295c81599c97907457848/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_4ab91a455dc86ea102fdfa1407dbcce323929634/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_rebuild_simple (tasks.cephfs.test_recovery_pool.TestRecoveryPool) 2023-12-22T10:02:13.044 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=89679aae2ff6414aa30ef5bbb5b74d98 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9680d2aba1e76f64ade295c81599c97907457848/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_4ab91a455dc86ea102fdfa1407dbcce323929634/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_rebuild_simple (tasks.cephfs.test_recovery_pool.TestRecoveryPool) 2023-12-22T10:02:13.045 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-12-22T10:02:13.054 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-12-22T10:02:13.074 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-12-22T10:02:13.075 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T10:02:13.075 DEBUG:teuthology.orchestra.run.smithi113:> ip netns list 2023-12-22T10:02:13.100 INFO:teuthology.orchestra.run.smithi113.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-22T10:02:13.100 INFO:teuthology.orchestra.run.smithi113.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-12-22T10:02:13.100 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T10:02:13.101 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-22T10:02:13.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T10:02:13.176 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-22T10:02:13.276 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T10:02:13.276 DEBUG:teuthology.orchestra.run.smithi113:> sudo ip link delete ceph-brx 2023-12-22T10:02:13.458 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T10:02:13.459 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2023-12-22T10:02:13.476 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-22T10:02:13.476 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-22T10:02:13.477 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T10:02:13.477 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-22T10:02:13.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T10:02:13.561 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-22T10:02:13.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-22T10:02:13.653 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link delete ceph-brx 2023-12-22T10:02:13.873 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-12-22T10:02:13.883 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2023-12-22T10:02:13.883 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T10:02:14.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.047+0000 7f09ca2b9700 1 Processor -- start 2023-12-22T10:02:14.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.051+0000 7f09ca2b9700 1 -- start start 2023-12-22T10:02:14.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.051+0000 7f09ca2b9700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f09c414fbd0 0x7f09c40bd1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:14.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.051+0000 7f09ca2b9700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f09c414ffb0 0x7f09c40c2c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:14.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.051+0000 7f09ca2b9700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f09c40c3150 0x7f09c4062230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:14.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.051+0000 7f09ca2b9700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09c40c35a0 con 0x7f09c414fbd0 2023-12-22T10:02:14.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.051+0000 7f09ca2b9700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09c40bbef0 con 0x7f09c414ffb0 2023-12-22T10:02:14.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.051+0000 7f09ca2b9700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09c40bc140 con 0x7f09c40c3150 2023-12-22T10:02:14.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.051+0000 7f09c92b7700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f09c414fbd0 0x7f09c40bd1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:14.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.051+0000 7f09c92b7700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f09c414fbd0 0x7f09c40bd1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42916/0 (socket says 172.21.15.45:42916) 2023-12-22T10:02:14.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.051+0000 7f09c92b7700 1 -- 172.21.15.45:0/1888183081 learned_addr learned my addr 172.21.15.45:0/1888183081 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:02:14.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.051+0000 7f09c8ab6700 1 --2- 172.21.15.45:0/1888183081 >> v2:172.21.15.113:3300/0 conn(0x7f09c414ffb0 0x7f09c40c2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:14.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.051+0000 7f09c9ab8700 1 --2- 172.21.15.45:0/1888183081 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f09c40c3150 0x7f09c4062230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:14.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.051+0000 7f09c92b7700 1 -- 172.21.15.45:0/1888183081 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f09c40c3150 msgr2=0x7f09c4062230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:02:14.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.051+0000 7f09c92b7700 1 --2- 172.21.15.45:0/1888183081 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f09c40c3150 0x7f09c4062230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:14.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.051+0000 7f09c92b7700 1 -- 172.21.15.45:0/1888183081 >> v2:172.21.15.113:3300/0 conn(0x7f09c414ffb0 msgr2=0x7f09c40c2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:02:14.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.051+0000 7f09c92b7700 1 --2- 172.21.15.45:0/1888183081 >> v2:172.21.15.113:3300/0 conn(0x7f09c414ffb0 0x7f09c40c2c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:14.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.051+0000 7f09c92b7700 1 -- 172.21.15.45:0/1888183081 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09c40bc420 con 0x7f09c414fbd0 2023-12-22T10:02:14.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.051+0000 7f09c92b7700 1 --2- 172.21.15.45:0/1888183081 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09c414fbd0 0x7f09c40bd1e0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7f09c4066280 tx=0x7f09c00090f0).ready entity=mon.0 client_cookie=7d5bf2e749e27640 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:14.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.051+0000 7f09bbfff700 1 -- 172.21.15.45:0/1888183081 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09c000b600 con 0x7f09c414fbd0 2023-12-22T10:02:14.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.051+0000 7f09bbfff700 1 -- 172.21.15.45:0/1888183081 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09c000b760 con 0x7f09c414fbd0 2023-12-22T10:02:14.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.051+0000 7f09bbfff700 1 -- 172.21.15.45:0/1888183081 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09c000bae0 con 0x7f09c414fbd0 2023-12-22T10:02:14.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.055+0000 7f09ca2b9700 1 -- 172.21.15.45:0/1888183081 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09c414fbd0 msgr2=0x7f09c40bd1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:14.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.055+0000 7f09ca2b9700 1 --2- 172.21.15.45:0/1888183081 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09c414fbd0 0x7f09c40bd1e0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7f09c4066280 tx=0x7f09c00090f0).stop 2023-12-22T10:02:14.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.055+0000 7f09ca2b9700 1 -- 172.21.15.45:0/1888183081 shutdown_connections 2023-12-22T10:02:14.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.055+0000 7f09ca2b9700 1 --2- 172.21.15.45:0/1888183081 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f09c40c3150 0x7f09c4062230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:14.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.055+0000 7f09ca2b9700 1 --2- 172.21.15.45:0/1888183081 >> v2:172.21.15.113:3300/0 conn(0x7f09c414ffb0 0x7f09c40c2c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:14.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.055+0000 7f09ca2b9700 1 --2- 172.21.15.45:0/1888183081 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09c414fbd0 0x7f09c40bd1e0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:14.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.055+0000 7f09ca2b9700 1 -- 172.21.15.45:0/1888183081 >> 172.21.15.45:0/1888183081 conn(0x7f09c40c37a0 msgr2=0x7f09c40c3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:02:14.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.055+0000 7f09ca2b9700 1 -- 172.21.15.45:0/1888183081 shutdown_connections 2023-12-22T10:02:14.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.055+0000 7f09ca2b9700 1 -- 172.21.15.45:0/1888183081 wait complete. 2023-12-22T10:02:14.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.059+0000 7f09ca2b9700 1 Processor -- start 2023-12-22T10:02:14.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.059+0000 7f09ca2b9700 1 -- start start 2023-12-22T10:02:14.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.059+0000 7f09ca2b9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09c40c3150 0x7f09c4165550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:14.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.059+0000 7f09ca2b9700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f09c414fbd0 0x7f09c41364a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:14.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.059+0000 7f09ca2b9700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f09c414ffb0 0x7f09c4162a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:14.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.059+0000 7f09ca2b9700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09c413a2f0 con 0x7f09c40c3150 2023-12-22T10:02:14.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.059+0000 7f09ca2b9700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09c4162f10 con 0x7f09c414ffb0 2023-12-22T10:02:14.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.059+0000 7f09ca2b9700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09c40bdf60 con 0x7f09c414fbd0 2023-12-22T10:02:14.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.059+0000 7f09c92b7700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09c40c3150 0x7f09c4165550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:14.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.059+0000 7f09c92b7700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09c40c3150 0x7f09c4165550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42918/0 (socket says 172.21.15.45:42918) 2023-12-22T10:02:14.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.059+0000 7f09c92b7700 1 -- 172.21.15.45:0/3803204020 learned_addr learned my addr 172.21.15.45:0/3803204020 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:02:14.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.059+0000 7f09c9ab8700 1 --2- 172.21.15.45:0/3803204020 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f09c414ffb0 0x7f09c4162a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:14.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.059+0000 7f09c8ab6700 1 --2- 172.21.15.45:0/3803204020 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f09c414fbd0 0x7f09c41364a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:14.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.063+0000 7f09c92b7700 1 -- 172.21.15.45:0/3803204020 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f09c414fbd0 msgr2=0x7f09c41364a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:14.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.063+0000 7f09c92b7700 1 --2- 172.21.15.45:0/3803204020 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f09c414fbd0 0x7f09c41364a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:14.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.063+0000 7f09c92b7700 1 -- 172.21.15.45:0/3803204020 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f09c414ffb0 msgr2=0x7f09c4162a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:14.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.063+0000 7f09c92b7700 1 --2- 172.21.15.45:0/3803204020 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f09c414ffb0 0x7f09c4162a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:14.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.063+0000 7f09c92b7700 1 -- 172.21.15.45:0/3803204020 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09c0009370 con 0x7f09c40c3150 2023-12-22T10:02:14.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.063+0000 7f09c92b7700 1 --2- 172.21.15.45:0/3803204020 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09c40c3150 0x7f09c4165550 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 rx=0x7f09c0009130 tx=0x7f09c0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:14.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.063+0000 7f09b97fa700 1 -- 172.21.15.45:0/3803204020 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09c0006a40 con 0x7f09c40c3150 2023-12-22T10:02:14.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.063+0000 7f09b97fa700 1 -- 172.21.15.45:0/3803204020 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09c000b8d0 con 0x7f09c40c3150 2023-12-22T10:02:14.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.063+0000 7f09ca2b9700 1 -- 172.21.15.45:0/3803204020 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09c41663d0 con 0x7f09c40c3150 2023-12-22T10:02:14.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.063+0000 7f09b97fa700 1 -- 172.21.15.45:0/3803204020 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09c001c670 con 0x7f09c40c3150 2023-12-22T10:02:14.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.063+0000 7f09ca2b9700 1 -- 172.21.15.45:0/3803204020 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09c4165e10 con 0x7f09c40c3150 2023-12-22T10:02:14.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.063+0000 7f09ca2b9700 1 -- 172.21.15.45:0/3803204020 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09c4047060 con 0x7f09c40c3150 2023-12-22T10:02:14.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.067+0000 7f09b97fa700 1 -- 172.21.15.45:0/3803204020 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f09c001ca60 con 0x7f09c40c3150 2023-12-22T10:02:14.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.067+0000 7f09b97fa700 1 --2- 172.21.15.45:0/3803204020 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f09a805a510 0x7f09a805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:14.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.067+0000 7f09b97fa700 1 -- 172.21.15.45:0/3803204020 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f09c0076260 con 0x7f09c40c3150 2023-12-22T10:02:14.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.067+0000 7f09c8ab6700 1 --2- 172.21.15.45:0/3803204020 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f09a805a510 0x7f09a805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:14.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.067+0000 7f09c8ab6700 1 --2- 172.21.15.45:0/3803204020 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f09a805a510 0x7f09a805c9d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7f09b4006fd0 tx=0x7f09b4008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:14.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.075+0000 7f09b97fa700 1 -- 172.21.15.45:0/3803204020 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f09c0049c80 con 0x7f09c40c3150 2023-12-22T10:02:14.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.239+0000 7f09ca2b9700 1 -- 172.21.15.45:0/3803204020 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f09c40bc700 con 0x7f09c40c3150 2023-12-22T10:02:14.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.243+0000 7f09b97fa700 1 -- 172.21.15.45:0/3803204020 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+13841 (secure 0 0 0) 0x7f09c002a090 con 0x7f09c40c3150 2023-12-22T10:02:14.243 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:02:14.243 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":47,"fsid":"98b0837e-5e68-4c8f-a1a0-e9424baaad8f","created":"2023-12-22T10:00:15.010174+0000","modified":"2023-12-22T10:02:11.914167+0000","last_up_change":"2023-12-22T10:00:24.980513+0000","last_in_change":"2023-12-22T10:00:17.887172+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-12-22T10:00:25.069641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-12-22T10:00:26.906399+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"e19943a0-1c6b-47df-b6bb-383472077890","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":33777},{"type":"v1","addr":"172.21.15.45:6819","nonce":33777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":33777},{"type":"v1","addr":"172.21.15.45:6822","nonce":33777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":33777},{"type":"v1","addr":"172.21.15.45:6830","nonce":33777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":33777},{"type":"v1","addr":"172.21.15.45:6826","nonce":33777}]},"public_addr":"172.21.15.45:6819/33777","cluster_addr":"172.21.15.45:6822/33777","heartbeat_back_addr":"172.21.15.45:6830/33777","heartbeat_front_addr":"172.21.15.45:6826/33777","state":["exists","up"]},{"osd":1,"uuid":"69670f34-f082-45a7-8f67-e962acc136e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":33775},{"type":"v1","addr":"172.21.15.45:6809","nonce":33775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":33775},{"type":"v1","addr":"172.21.15.45:6811","nonce":33775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":33775},{"type":"v1","addr":"172.21.15.45:6815","nonce":33775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":33775},{"type":"v1","addr":"172.21.15.45:6813","nonce":33775}]},"public_addr":"172.21.15.45:6809/33775","cluster_addr":"172.21.15.45:6811/33775","heartbeat_back_addr":"172.21.15.45:6815/33775","heartbeat_front_addr":"172.21.15.45:6813/33775","state":["exists","up"]},{"osd":2,"uuid":"d909d49b-82b8-401b-9947-e49dd167bb95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":33776},{"type":"v1","addr":"172.21.15.45:6801","nonce":33776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":33776},{"type":"v1","addr":"172.21.15.45:6803","nonce":33776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":33776},{"type":"v1","addr":"172.21.15.45:6807","nonce":33776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":33776},{"type":"v1","addr":"172.21.15.45:6805","nonce":33776}]},"public_addr":"172.21.15.45:6801/33776","cluster_addr":"172.21.15.45:6803/33776","heartbeat_back_addr":"172.21.15.45:6807/33776","heartbeat_front_addr":"172.21.15.45:6805/33776","state":["exists","up"]},{"osd":3,"uuid":"db104ca9-3a94-4d39-a2be-bd06db888095","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":33782},{"type":"v1","addr":"172.21.15.45:6817","nonce":33782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":33782},{"type":"v1","addr":"172.21.15.45:6823","nonce":33782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":33782},{"type":"v1","addr":"172.21.15.45:6831","nonce":33782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":33782},{"type":"v1","addr":"172.21.15.45:6827","nonce":33782}]},"public_addr":"172.21.15.45:6817/33782","cluster_addr":"172.21.15.45:6823/33782","heartbeat_back_addr":"172.21.15.45:6831/33782","heartbeat_front_addr":"172.21.15.45:6827/33782","state":["exists","up"]},{"osd":4,"uuid":"9f4eaff4-e433-4479-a0d1-ee7a33375ca6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":34099},{"type":"v1","addr":"172.21.15.113:6811","nonce":34099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":34099},{"type":"v1","addr":"172.21.15.113:6815","nonce":34099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":34099},{"type":"v1","addr":"172.21.15.113:6823","nonce":34099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6816","nonce":34099},{"type":"v1","addr":"172.21.15.113:6818","nonce":34099}]},"public_addr":"172.21.15.113:6811/34099","cluster_addr":"172.21.15.113:6815/34099","heartbeat_back_addr":"172.21.15.113:6823/34099","heartbeat_front_addr":"172.21.15.113:6818/34099","state":["exists","up"]},{"osd":5,"uuid":"1efc5591-180b-43af-8611-0068aadc5aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":34100},{"type":"v1","addr":"172.21.15.113:6801","nonce":34100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":34100},{"type":"v1","addr":"172.21.15.113:6803","nonce":34100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":34100},{"type":"v1","addr":"172.21.15.113:6807","nonce":34100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":34100},{"type":"v1","addr":"172.21.15.113:6805","nonce":34100}]},"public_addr":"172.21.15.113:6801/34100","cluster_addr":"172.21.15.113:6803/34100","heartbeat_back_addr":"172.21.15.113:6807/34100","heartbeat_front_addr":"172.21.15.113:6805/34100","state":["exists","up"]},{"osd":6,"uuid":"6c89d9d8-c153-4a48-afa9-97e4c403f1ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":34101},{"type":"v1","addr":"172.21.15.113:6810","nonce":34101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6812","nonce":34101},{"type":"v1","addr":"172.21.15.113:6814","nonce":34101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6822","nonce":34101},{"type":"v1","addr":"172.21.15.113:6824","nonce":34101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":34101},{"type":"v1","addr":"172.21.15.113:6819","nonce":34101}]},"public_addr":"172.21.15.113:6810/34101","cluster_addr":"172.21.15.113:6814/34101","heartbeat_back_addr":"172.21.15.113:6824/34101","heartbeat_front_addr":"172.21.15.113:6819/34101","state":["exists","up"]},{"osd":7,"uuid":"1855e70c-23f6-4c08-ad7f-774c2148235b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6821","nonce":34102},{"type":"v1","addr":"172.21.15.113:6825","nonce":34102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":34102},{"type":"v1","addr":"172.21.15.113:6827","nonce":34102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":34102},{"type":"v1","addr":"172.21.15.113:6831","nonce":34102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6828","nonce":34102},{"type":"v1","addr":"172.21.15.113:6829","nonce":34102}]},"public_addr":"172.21.15.113:6825/34102","cluster_addr":"172.21.15.113:6827/34102","heartbeat_back_addr":"172.21.15.113:6831/34102","heartbeat_front_addr":"172.21.15.113:6829/34102","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.812672+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.825045+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.700105+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.856563+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.954683+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.883234+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.883994+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.821686+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.45:6835/1879154206":"2023-12-23T10:01:45.243059+0000","172.21.15.45:6834/1879154206":"2023-12-23T10:01:45.243059+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T10:02:14.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.243+0000 7f09ca2b9700 1 -- 172.21.15.45:0/3803204020 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f09a805a510 msgr2=0x7f09a805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:14.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.243+0000 7f09ca2b9700 1 --2- 172.21.15.45:0/3803204020 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f09a805a510 0x7f09a805c9d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7f09b4006fd0 tx=0x7f09b4008040).stop 2023-12-22T10:02:14.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.243+0000 7f09ca2b9700 1 -- 172.21.15.45:0/3803204020 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09c40c3150 msgr2=0x7f09c4165550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:14.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.243+0000 7f09ca2b9700 1 --2- 172.21.15.45:0/3803204020 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09c40c3150 0x7f09c4165550 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 rx=0x7f09c0009130 tx=0x7f09c0017000).stop 2023-12-22T10:02:14.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.247+0000 7f09ca2b9700 1 -- 172.21.15.45:0/3803204020 shutdown_connections 2023-12-22T10:02:14.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.247+0000 7f09ca2b9700 1 --2- 172.21.15.45:0/3803204020 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f09c414ffb0 0x7f09c4162a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:14.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.247+0000 7f09ca2b9700 1 --2- 172.21.15.45:0/3803204020 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f09a805a510 0x7f09a805c9d0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:14.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.247+0000 7f09ca2b9700 1 --2- 172.21.15.45:0/3803204020 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f09c414fbd0 0x7f09c41364a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:14.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.247+0000 7f09ca2b9700 1 --2- 172.21.15.45:0/3803204020 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09c40c3150 0x7f09c4165550 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:14.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.247+0000 7f09ca2b9700 1 -- 172.21.15.45:0/3803204020 >> 172.21.15.45:0/3803204020 conn(0x7f09c40c37a0 msgr2=0x7f09c40c52d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:02:14.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.247+0000 7f09ca2b9700 1 -- 172.21.15.45:0/3803204020 shutdown_connections 2023-12-22T10:02:14.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.247+0000 7f09ca2b9700 1 -- 172.21.15.45:0/3803204020 wait complete. 2023-12-22T10:02:14.265 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-12-22T10:02:14.266 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-22T10:02:14.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.427+0000 7fd962639700 1 Processor -- start 2023-12-22T10:02:14.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.427+0000 7fd962639700 1 -- start start 2023-12-22T10:02:14.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.431+0000 7fd962639700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fd95c0a8eb0 0x7fd95c065860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:14.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.431+0000 7fd962639700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd95c0c17e0 con 0x7fd95c0a8ad0 2023-12-22T10:02:14.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.431+0000 7fd962639700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd95c0c2630 con 0x7fd95c15bb60 2023-12-22T10:02:14.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.431+0000 7fd962639700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd95c1584c0 con 0x7fd95c0a8eb0 2023-12-22T10:02:14.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.431+0000 7fd961637700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fd95c0a8ad0 0x7fd95c0c10d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:54676/0 (socket says 172.21.15.45:54676) 2023-12-22T10:02:14.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.431+0000 7fd961637700 1 -- 172.21.15.45:0/1754851517 learned_addr learned my addr 172.21.15.45:0/1754851517 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:02:14.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.431+0000 7fd960e36700 1 --2- 172.21.15.45:0/1754851517 >> v2:172.21.15.113:3300/0 conn(0x7fd95c0a8eb0 0x7fd95c065860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:14.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.431+0000 7fd953fff700 1 -- 172.21.15.45:0/1754851517 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1585100356 0 0) 0x7fd958001490 con 0x7fd95c0a8ad0 2023-12-22T10:02:14.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.431+0000 7fd953fff700 1 -- 172.21.15.45:0/1754851517 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9480033f0 con 0x7fd95c0a8ad0 2023-12-22T10:02:14.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.431+0000 7fd960e36700 1 -- 172.21.15.45:0/1754851517 >> v1:172.21.15.113:6789/0 conn(0x7fd95c15bb60 legacy=0x7fd95c068a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:14.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.431+0000 7fd953fff700 1 -- 172.21.15.45:0/1754851517 <== mon.1 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1865543712 0 0) 0x7fd95c0c2630 con 0x7fd95c15bb60 2023-12-22T10:02:14.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.431+0000 7fd960e36700 1 -- 172.21.15.45:0/1754851517 >> v1:172.21.15.45:6789/0 conn(0x7fd95c0a8ad0 legacy=0x7fd95c0c10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:14.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.431+0000 7fd960e36700 1 -- 172.21.15.45:0/1754851517 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd95c0c1a20 con 0x7fd95c0a8eb0 2023-12-22T10:02:14.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.431+0000 7fd960e36700 1 --2- 172.21.15.45:0/1754851517 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd95c0a8eb0 0x7fd95c065860 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7fd94c009760 tx=0x7fd94c009060).ready entity=mon.1 client_cookie=62af5b42c2651631 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:14.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.431+0000 7fd953fff700 1 -- 172.21.15.45:0/1754851517 <== mon.1 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd94c00f510 con 0x7fd95c0a8eb0 2023-12-22T10:02:14.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.431+0000 7fd953fff700 1 -- 172.21.15.45:0/1754851517 <== mon.1 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd94c00f670 con 0x7fd95c0a8eb0 2023-12-22T10:02:14.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.431+0000 7fd953fff700 1 -- 172.21.15.45:0/1754851517 <== mon.1 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd94c00f9f0 con 0x7fd95c0a8eb0 2023-12-22T10:02:14.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.435+0000 7fd962639700 1 -- 172.21.15.45:0/1754851517 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd95c0a8eb0 msgr2=0x7fd95c065860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:14.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.435+0000 7fd962639700 1 --2- 172.21.15.45:0/1754851517 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd95c0a8eb0 0x7fd95c065860 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7fd94c009760 tx=0x7fd94c009060).stop 2023-12-22T10:02:14.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.435+0000 7fd962639700 1 -- 172.21.15.45:0/1754851517 shutdown_connections 2023-12-22T10:02:14.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.435+0000 7fd962639700 1 --2- 172.21.15.45:0/1754851517 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd95c0a8eb0 0x7fd95c065860 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:14.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.435+0000 7fd962639700 1 -- 172.21.15.45:0/1754851517 >> 172.21.15.45:0/1754851517 conn(0x7fd95c067540 msgr2=0x7fd95c0c6460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:02:14.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.435+0000 7fd962639700 1 -- 172.21.15.45:0/1754851517 shutdown_connections 2023-12-22T10:02:14.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.435+0000 7fd962639700 1 -- 172.21.15.45:0/1754851517 wait complete. 2023-12-22T10:02:14.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.439+0000 7fd962639700 1 Processor -- start 2023-12-22T10:02:14.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.439+0000 7fd962639700 1 -- start start 2023-12-22T10:02:14.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.439+0000 7fd962639700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd95c0a8ad0 0x7fd95c0bfee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:14.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.439+0000 7fd962639700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd95c15bb60 0x7fd95c16c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:14.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.439+0000 7fd962639700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd95c16c610 0x7fd95c156730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:14.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.439+0000 7fd962639700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd95c0c03d0 con 0x7fd95c16c610 2023-12-22T10:02:14.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.439+0000 7fd962639700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd95c157780 con 0x7fd95c15bb60 2023-12-22T10:02:14.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.439+0000 7fd962639700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd95c16ca70 con 0x7fd95c0a8ad0 2023-12-22T10:02:14.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.439+0000 7fd961e38700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd95c16c610 0x7fd95c156730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:14.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.439+0000 7fd961e38700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd95c16c610 0x7fd95c156730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42932/0 (socket says 172.21.15.45:42932) 2023-12-22T10:02:14.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.439+0000 7fd961e38700 1 -- 172.21.15.45:0/3378309602 learned_addr learned my addr 172.21.15.45:0/3378309602 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:02:14.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.439+0000 7fd960e36700 1 --2- 172.21.15.45:0/3378309602 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd95c15bb60 0x7fd95c16c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:14.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.439+0000 7fd961637700 1 --2- 172.21.15.45:0/3378309602 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd95c0a8ad0 0x7fd95c0bfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:14.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.439+0000 7fd961e38700 1 -- 172.21.15.45:0/3378309602 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd95c0a8ad0 msgr2=0x7fd95c0bfee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:14.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.439+0000 7fd961e38700 1 --2- 172.21.15.45:0/3378309602 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd95c0a8ad0 0x7fd95c0bfee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:14.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.439+0000 7fd961e38700 1 -- 172.21.15.45:0/3378309602 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd95c15bb60 msgr2=0x7fd95c16c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:14.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.439+0000 7fd961e38700 1 --2- 172.21.15.45:0/3378309602 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd95c15bb60 0x7fd95c16c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:14.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.439+0000 7fd961e38700 1 -- 172.21.15.45:0/3378309602 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd94c0092a0 con 0x7fd95c16c610 2023-12-22T10:02:14.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.443+0000 7fd961e38700 1 --2- 172.21.15.45:0/3378309602 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd95c16c610 0x7fd95c156730 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 rx=0x7fd95400c4c0 tx=0x7fd954007db0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:14.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.443+0000 7fd9517fa700 1 -- 172.21.15.45:0/3378309602 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9540123f0 con 0x7fd95c16c610 2023-12-22T10:02:14.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.443+0000 7fd9517fa700 1 -- 172.21.15.45:0/3378309602 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd954012550 con 0x7fd95c16c610 2023-12-22T10:02:14.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.443+0000 7fd962639700 1 -- 172.21.15.45:0/3378309602 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd95c1574a0 con 0x7fd95c16c610 2023-12-22T10:02:14.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.443+0000 7fd9517fa700 1 -- 172.21.15.45:0/3378309602 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9540128d0 con 0x7fd95c16c610 2023-12-22T10:02:14.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.443+0000 7fd962639700 1 -- 172.21.15.45:0/3378309602 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd95c0a9b80 con 0x7fd95c16c610 2023-12-22T10:02:14.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.443+0000 7fd962639700 1 -- 172.21.15.45:0/3378309602 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd95c047060 con 0x7fd95c16c610 2023-12-22T10:02:14.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.447+0000 7fd9517fa700 1 -- 172.21.15.45:0/3378309602 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fd954012cc0 con 0x7fd95c16c610 2023-12-22T10:02:14.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.447+0000 7fd9517fa700 1 --2- 172.21.15.45:0/3378309602 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fd94005a510 0x7fd94005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:14.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.447+0000 7fd9517fa700 1 -- 172.21.15.45:0/3378309602 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5355+0+0 (secure 0 0 0) 0x7fd9540739d0 con 0x7fd95c16c610 2023-12-22T10:02:14.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.447+0000 7fd961637700 1 --2- 172.21.15.45:0/3378309602 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fd94005a510 0x7fd94005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:14.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.447+0000 7fd961637700 1 --2- 172.21.15.45:0/3378309602 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fd94005a510 0x7fd94005c9d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7fd958007fd0 tx=0x7fd958000f40).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:14.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.455+0000 7fd9517fa700 1 -- 172.21.15.45:0/3378309602 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd954047390 con 0x7fd95c16c610 2023-12-22T10:02:14.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.615+0000 7fd962639700 1 -- 172.21.15.45:0/3378309602 --> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd95c0a9d70 con 0x7fd94005a510 2023-12-22T10:02:14.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.623+0000 7fd9517fa700 1 -- 172.21.15.45:0/3378309602 <== mgr.4104 v2:172.21.15.45:6832/33679 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+68207 (secure 0 0 0) 0x7fd95c0a9d70 con 0x7fd94005a510 2023-12-22T10:02:14.625 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:02:14.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.627+0000 7fd962639700 1 -- 172.21.15.45:0/3378309602 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fd94005a510 msgr2=0x7fd94005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:14.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.627+0000 7fd962639700 1 --2- 172.21.15.45:0/3378309602 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fd94005a510 0x7fd94005c9d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7fd958007fd0 tx=0x7fd958000f40).stop 2023-12-22T10:02:14.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.627+0000 7fd962639700 1 -- 172.21.15.45:0/3378309602 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd95c16c610 msgr2=0x7fd95c156730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:14.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.627+0000 7fd962639700 1 --2- 172.21.15.45:0/3378309602 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd95c16c610 0x7fd95c156730 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 rx=0x7fd95400c4c0 tx=0x7fd954007db0).stop 2023-12-22T10:02:14.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.627+0000 7fd962639700 1 -- 172.21.15.45:0/3378309602 shutdown_connections 2023-12-22T10:02:14.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.627+0000 7fd962639700 1 --2- 172.21.15.45:0/3378309602 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd95c16c610 0x7fd95c156730 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:14.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.627+0000 7fd962639700 1 --2- 172.21.15.45:0/3378309602 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd95c15bb60 0x7fd95c16c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:14.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.627+0000 7fd962639700 1 --2- 172.21.15.45:0/3378309602 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fd94005a510 0x7fd94005c9d0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:14.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.627+0000 7fd962639700 1 --2- 172.21.15.45:0/3378309602 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd95c0a8ad0 0x7fd95c0bfee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:14.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.627+0000 7fd962639700 1 -- 172.21.15.45:0/3378309602 >> 172.21.15.45:0/3378309602 conn(0x7fd95c067540 msgr2=0x7fd95c155300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:02:14.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.627+0000 7fd962639700 1 -- 172.21.15.45:0/3378309602 shutdown_connections 2023-12-22T10:02:14.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.627+0000 7fd962639700 1 -- 172.21.15.45:0/3378309602 wait complete. 2023-12-22T10:02:14.630 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-12-22T10:02:14.649 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":94,"stamp":"2023-12-22T10:02:13.985626+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":234,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2393152,"kb_used_data":16384,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752581568,"statfs":{"total":773094113280,"available":770643525632,"internally_reserved":0,"allocated":16777216,"data_stored":14447320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6291456,"num_objects":-2,"num_object_clones":0,"num_object_copies":-4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-4,"num_write_kb":-6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.073819"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":34,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-12-22T10:02:04.819301+0000","last_change":"2023-12-22T10:00:28.036372+0000","last_active":"2023-12-22T10:02:04.819301+0000","last_peered":"2023-12-22T10:02:04.819301+0000","last_clean":"2023-12-22T10:02:04.819301+0000","last_became_active":"2023-12-22T10:00:28.035974+0000","last_became_peered":"2023-12-22T10:00:28.035974+0000","last_unstale":"2023-12-22T10:02:04.819301+0000","last_undegraded":"2023-12-22T10:02:04.819301+0000","last_fullsized":"2023-12-22T10:02:04.819301+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_clean_scrub_stamp":"2023-12-22T10:00:27.001906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":37,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-12-22T10:02:03.866778+0000","last_change":"2023-12-22T10:00:28.035308+0000","last_active":"2023-12-22T10:02:03.866778+0000","last_peered":"2023-12-22T10:02:03.866778+0000","last_clean":"2023-12-22T10:02:03.866778+0000","last_became_active":"2023-12-22T10:00:28.035002+0000","last_became_peered":"2023-12-22T10:00:28.035002+0000","last_unstale":"2023-12-22T10:02:03.866778+0000","last_undegraded":"2023-12-22T10:02:03.866778+0000","last_fullsized":"2023-12-22T10:02:03.866778+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_clean_scrub_stamp":"2023-12-22T10:00:27.001906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":34,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-12-22T10:02:04.814856+0000","last_change":"2023-12-22T10:00:28.029892+0000","last_active":"2023-12-22T10:02:04.814856+0000","last_peered":"2023-12-22T10:02:04.814856+0000","last_clean":"2023-12-22T10:02:04.814856+0000","last_became_active":"2023-12-22T10:00:28.029391+0000","last_became_peered":"2023-12-22T10:00:28.029391+0000","last_unstale":"2023-12-22T10:02:04.814856+0000","last_undegraded":"2023-12-22T10:02:04.814856+0000","last_fullsized":"2023-12-22T10:02:04.814856+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_clean_scrub_stamp":"2023-12-22T10:00:27.001906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":33,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-12-22T10:02:04.458312+0000","last_change":"2023-12-22T10:00:28.025395+0000","last_active":"2023-12-22T10:02:04.458312+0000","last_peered":"2023-12-22T10:02:04.458312+0000","last_clean":"2023-12-22T10:02:04.458312+0000","last_became_active":"2023-12-22T10:00:28.024588+0000","last_became_peered":"2023-12-22T10:00:28.024588+0000","last_unstale":"2023-12-22T10:02:04.458312+0000","last_undegraded":"2023-12-22T10:02:04.458312+0000","last_fullsized":"2023-12-22T10:02:04.458312+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_clean_scrub_stamp":"2023-12-22T10:00:27.001906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":34,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-12-22T10:02:04.814823+0000","last_change":"2023-12-22T10:00:28.029884+0000","last_active":"2023-12-22T10:02:04.814823+0000","last_peered":"2023-12-22T10:02:04.814823+0000","last_clean":"2023-12-22T10:02:04.814823+0000","last_became_active":"2023-12-22T10:00:28.029422+0000","last_became_peered":"2023-12-22T10:00:28.029422+0000","last_unstale":"2023-12-22T10:02:04.814823+0000","last_undegraded":"2023-12-22T10:02:04.814823+0000","last_fullsized":"2023-12-22T10:02:04.814823+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_clean_scrub_stamp":"2023-12-22T10:00:27.001906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":35,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-12-22T10:02:05.153764+0000","last_change":"2023-12-22T10:00:28.028621+0000","last_active":"2023-12-22T10:02:05.153764+0000","last_peered":"2023-12-22T10:02:05.153764+0000","last_clean":"2023-12-22T10:02:05.153764+0000","last_became_active":"2023-12-22T10:00:28.028159+0000","last_became_peered":"2023-12-22T10:00:28.028159+0000","last_unstale":"2023-12-22T10:02:05.153764+0000","last_undegraded":"2023-12-22T10:02:05.153764+0000","last_fullsized":"2023-12-22T10:02:05.153764+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_clean_scrub_stamp":"2023-12-22T10:00:27.001906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":34,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-12-22T10:02:04.815470+0000","last_change":"2023-12-22T10:00:28.030883+0000","last_active":"2023-12-22T10:02:04.815470+0000","last_peered":"2023-12-22T10:02:04.815470+0000","last_clean":"2023-12-22T10:02:04.815470+0000","last_became_active":"2023-12-22T10:00:28.030284+0000","last_became_peered":"2023-12-22T10:00:28.030284+0000","last_unstale":"2023-12-22T10:02:04.815470+0000","last_undegraded":"2023-12-22T10:02:04.815470+0000","last_fullsized":"2023-12-22T10:02:04.815470+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_clean_scrub_stamp":"2023-12-22T10:00:27.001906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":34,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-12-22T10:02:04.814965+0000","last_change":"2023-12-22T10:00:28.031790+0000","last_active":"2023-12-22T10:02:04.814965+0000","last_peered":"2023-12-22T10:02:04.814965+0000","last_clean":"2023-12-22T10:02:04.814965+0000","last_became_active":"2023-12-22T10:00:28.031190+0000","last_became_peered":"2023-12-22T10:00:28.031190+0000","last_unstale":"2023-12-22T10:02:04.814965+0000","last_undegraded":"2023-12-22T10:02:04.814965+0000","last_fullsized":"2023-12-22T10:02:04.814965+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_clean_scrub_stamp":"2023-12-22T10:00:27.001906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":35,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-12-22T10:02:05.155826+0000","last_change":"2023-12-22T10:00:27.889031+0000","last_active":"2023-12-22T10:02:05.155826+0000","last_peered":"2023-12-22T10:02:05.155826+0000","last_clean":"2023-12-22T10:02:05.155826+0000","last_became_active":"2023-12-22T10:00:27.888164+0000","last_became_peered":"2023-12-22T10:00:27.888164+0000","last_unstale":"2023-12-22T10:02:05.155826+0000","last_undegraded":"2023-12-22T10:02:05.155826+0000","last_fullsized":"2023-12-22T10:02:05.155826+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:25.998963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:25.998963+0000","last_clean_scrub_stamp":"2023-12-22T10:00:25.998963+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297608,"kb_used_data":512,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074232,"statfs":{"total":96636764160,"available":96332013568,"internally_reserved":0,"allocated":524288,"data_stored":233051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 10:01:29 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.143,"15min":1.143},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.677,"5min":1.677,"15min":1.677},"last":1.125},{"interface":"front","average":{"1min":1.161,"5min":1.161,"15min":1.161},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":1.345}]},{"osd":1,"last update":"Fri Dec 22 10:01:29 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.25,"15min":1.25},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.8899999999999999,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":1.1859999999999999},{"interface":"front","average":{"1min":1.337,"5min":1.337,"15min":1.337},"min":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":2.6819999999999999,"5min":2.6819999999999999,"15min":2.6819999999999999},"last":1.4119999999999999}]},{"osd":2,"last update":"Fri Dec 22 10:01:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":2.8490000000000002,"5min":2.8490000000000002,"15min":2.8490000000000002},"last":1.258},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.774,"5min":1.774,"15min":1.774},"last":1.0249999999999999}]},{"osd":3,"last update":"Fri Dec 22 10:01:29 2023","interfaces":[{"interface":"back","average":{"1min":1.321,"5min":1.321,"15min":1.321},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":2.3690000000000002,"5min":2.3690000000000002,"15min":2.3690000000000002},"last":1.325},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"min":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"max":{"1min":2.0899999999999999,"5min":2.0899999999999999,"15min":2.0899999999999999},"last":1.1120000000000001}]},{"osd":4,"last update":"Fri Dec 22 10:01:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.764,"5min":1.764,"15min":1.764},"last":1.0800000000000001},{"interface":"front","average":{"1min":1.278,"5min":1.278,"15min":1.278},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":2.2930000000000001,"5min":2.2930000000000001,"15min":2.2930000000000001},"last":1.1990000000000001}]},{"osd":5,"last update":"Fri Dec 22 10:01:29 2023","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.228,"15min":1.228},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.786,"5min":1.786,"15min":1.786},"last":1.2909999999999999},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":2.73,"5min":2.73,"15min":2.73},"last":1.23}]},{"osd":6,"last update":"Fri Dec 22 10:01:29 2023","interfaces":[{"interface":"back","average":{"1min":1.476,"5min":1.476,"15min":1.476},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":2.7690000000000001,"5min":2.7690000000000001,"15min":2.7690000000000001},"last":1.4630000000000001},{"interface":"front","average":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":2.8820000000000001,"5min":2.8820000000000001,"15min":2.8820000000000001},"last":1.3700000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574871,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297608,"kb_used_data":512,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074232,"statfs":{"total":96636764160,"available":96332013568,"internally_reserved":0,"allocated":524288,"data_stored":233051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.131,"15min":1.131},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":1.0700000000000001},{"interface":"front","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.617,"5min":1.617,"15min":1.617},"last":1.163}]},{"osd":1,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":0.94199999999999995},{"interface":"front","average":{"1min":1.085,"5min":1.085,"15min":1.085},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.657,"5min":1.657,"15min":1.657},"last":1.1839999999999999}]},{"osd":2,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.077,"15min":1.077},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":0.77800000000000002},{"interface":"front","average":{"1min":1.145,"5min":1.145,"15min":1.145},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.583,"5min":1.583,"15min":1.583},"last":1.0409999999999999}]},{"osd":3,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.262,"15min":1.262},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.995},{"interface":"front","average":{"1min":1.252,"5min":1.252,"15min":1.252},"min":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":1.6359999999999999,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":1.244}]},{"osd":4,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.282,"15min":1.282},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.7310000000000001,"5min":1.7310000000000001,"15min":1.7310000000000001},"last":1.272},{"interface":"front","average":{"1min":1.361,"5min":1.361,"15min":1.361},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":2.2280000000000002,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":1.321}]},{"osd":5,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"min":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":1.907,"5min":1.907,"15min":1.907},"last":1.1479999999999999},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":2.363,"5min":2.363,"15min":2.363},"last":1.343}]},{"osd":7,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"min":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"max":{"1min":2.1459999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.3919999999999999},{"interface":"front","average":{"1min":1.403,"5min":1.403,"15min":1.403},"min":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"max":{"1min":2.1779999999999999,"5min":2.1779999999999999,"15min":2.1779999999999999},"last":1.496}]}]},{"osd":5,"up_from":13,"seq":55834574871,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301704,"kb_used_data":4608,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94070136,"statfs":{"total":96636764160,"available":96327819264,"internally_reserved":0,"allocated":4718592,"data_stored":4427355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":1.4379999999999999},{"interface":"front","average":{"1min":1.123,"5min":1.123,"15min":1.123},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.6559999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":1.401}]},{"osd":1,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":1.1890000000000001},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":2.0070000000000001,"5min":2.0070000000000001,"15min":2.0070000000000001},"last":1.107}]},{"osd":2,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":1.214},{"interface":"front","average":{"1min":1.119,"5min":1.119,"15min":1.119},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.607,"5min":1.607,"15min":1.607},"last":1.3720000000000001}]},{"osd":3,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.133,"15min":1.133},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.80600000000000005},{"interface":"front","average":{"1min":1.179,"5min":1.179,"15min":1.179},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.488,"5min":1.488,"15min":1.488},"last":1.3140000000000001}]},{"osd":4,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.145,"15min":1.145},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":1.8779999999999999,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":1.1459999999999999},{"interface":"front","average":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"min":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":1.351}]},{"osd":6,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.242,"15min":1.242},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.7749999999999999,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":1.2789999999999999},{"interface":"front","average":{"1min":1.236,"5min":1.236,"15min":1.236},"min":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":1.0760000000000001}]},{"osd":7,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.236,"15min":1.236},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":1.516,"5min":1.516,"15min":1.516},"last":1.2589999999999999},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.8620000000000001,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":1.341}]}]},{"osd":4,"up_from":13,"seq":55834574871,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297608,"kb_used_data":512,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074232,"statfs":{"total":96636764160,"available":96332013568,"internally_reserved":0,"allocated":524288,"data_stored":233051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.149,"15min":1.149},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":1.1479999999999999},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"min":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.97499999999999998}]},{"osd":1,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":1.012,"15min":1.012},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":0.94199999999999995},{"interface":"front","average":{"1min":1.077,"5min":1.077,"15min":1.077},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":1.425}]},{"osd":2,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.641,"5min":1.641,"15min":1.641},"last":1.202},{"interface":"front","average":{"1min":1.272,"5min":1.272,"15min":1.272},"min":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"max":{"1min":1.8340000000000001,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":1.3260000000000001}]},{"osd":3,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.173,"15min":1.173},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":1.7490000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":1.232},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"min":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"max":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":1.381}]},{"osd":5,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":1.216,"15min":1.216},"min":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"max":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":1.4850000000000001},{"interface":"front","average":{"1min":1.173,"5min":1.173,"15min":1.173},"min":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":1.9350000000000001,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":1.3149999999999999}]},{"osd":6,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":1.869,"5min":1.869,"15min":1.869},"last":1.089},{"interface":"front","average":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"min":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"max":{"1min":1.9910000000000001,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":1.26}]},{"osd":7,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"min":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"max":{"1min":2.1960000000000002,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":1.361},{"interface":"front","average":{"1min":1.391,"5min":1.391,"15min":1.391},"min":{"1min":1.044,"5min":1.044,"15min":1.044},"max":{"1min":1.8680000000000001,"5min":1.8680000000000001,"15min":1.8680000000000001},"last":1.5029999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574871,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303752,"kb_used_data":6656,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94068088,"statfs":{"total":96636764160,"available":96325722112,"internally_reserved":0,"allocated":6815744,"data_stored":6524507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 10:01:25 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":1.145},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.60699999999999998}]},{"osd":1,"last update":"Fri Dec 22 10:01:25 2023","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":1.165},{"interface":"front","average":{"1min":1.109,"5min":1.109,"15min":1.109},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":1.385}]},{"osd":2,"last update":"Fri Dec 22 10:01:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":0.88900000000000001},{"interface":"front","average":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.702,"5min":1.702,"15min":1.702},"last":1.0549999999999999}]},{"osd":4,"last update":"Fri Dec 22 10:01:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.2,"15min":1.2},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":1.103},{"interface":"front","average":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":2.0619999999999998,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":1.038}]},{"osd":5,"last update":"Fri Dec 22 10:01:25 2023","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.333,"15min":1.333},"min":{"1min":0.878,"5min":0.878,"15min":0.878},"max":{"1min":1.9339999999999999,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":1.258},{"interface":"front","average":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"min":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"max":{"1min":2.1720000000000002,"5min":2.1720000000000002,"15min":2.1720000000000002},"last":1.3240000000000001}]},{"osd":6,"last update":"Fri Dec 22 10:01:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.8640000000000001,"5min":1.8640000000000001,"15min":1.8640000000000001},"last":1.266},{"interface":"front","average":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":2.2130000000000001,"5min":2.2130000000000001,"15min":2.2130000000000001},"last":1.3009999999999999}]},{"osd":7,"last update":"Fri Dec 22 10:01:25 2023","interfaces":[{"interface":"back","average":{"1min":1.405,"5min":1.405,"15min":1.405},"min":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"max":{"1min":2.1389999999999998,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":1.236},{"interface":"front","average":{"1min":1.431,"5min":1.431,"15min":1.431},"min":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":2.105,"5min":2.105,"15min":2.105},"last":1.212}]}]},{"osd":2,"up_from":13,"seq":55834574872,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297608,"kb_used_data":512,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074232,"statfs":{"total":96636764160,"available":96332013568,"internally_reserved":0,"allocated":524288,"data_stored":233051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":3.1589999999999998},{"interface":"front","average":{"1min":1.083,"5min":1.083,"15min":1.083},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":2.3039999999999998}]},{"osd":1,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.52,"5min":1.52,"15min":1.52},"last":3.194},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":2.3809999999999998,"5min":2.3809999999999998,"15min":2.3809999999999998},"last":3.0910000000000002}]},{"osd":3,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.698,"5min":1.698,"15min":1.698},"last":5.4059999999999997},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.788,"5min":1.788,"15min":1.788},"last":5.2789999999999999}]},{"osd":4,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.381,"15min":1.381},"min":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"max":{"1min":2.234,"5min":2.234,"15min":2.234},"last":2.2130000000000001},{"interface":"front","average":{"1min":1.296,"5min":1.296,"15min":1.296},"min":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"max":{"1min":2.1230000000000002,"5min":2.1230000000000002,"15min":2.1230000000000002},"last":2.004}]},{"osd":5,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"min":{"1min":1.109,"5min":1.109,"15min":1.109},"max":{"1min":2.0960000000000001,"5min":2.0960000000000001,"15min":2.0960000000000001},"last":2.5339999999999998},{"interface":"front","average":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"min":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"max":{"1min":1.9730000000000001,"5min":1.9730000000000001,"15min":1.9730000000000001},"last":2.2610000000000001}]},{"osd":6,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"min":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"max":{"1min":2.298,"5min":2.298,"15min":2.298},"last":1.95},{"interface":"front","average":{"1min":1.46,"5min":1.46,"15min":1.46},"min":{"1min":1.02,"5min":1.02,"15min":1.02},"max":{"1min":1.899,"5min":1.899,"15min":1.899},"last":3.1179999999999999}]},{"osd":7,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.458,"5min":1.458,"15min":1.458},"min":{"1min":1,"5min":1,"15min":1},"max":{"1min":2.0289999999999999,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":2.7269999999999999},{"interface":"front","average":{"1min":1.415,"5min":1.415,"15min":1.415},"min":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"max":{"1min":2.0179999999999998,"5min":2.0179999999999998,"15min":2.0179999999999998},"last":2.0419999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297608,"kb_used_data":512,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074232,"statfs":{"total":96636764160,"available":96332013568,"internally_reserved":0,"allocated":524288,"data_stored":233051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.90300000000000002}]},{"osd":2,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.96299999999999997},{"interface":"front","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":1.208}]},{"osd":3,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":1.4379999999999999},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":1.151}]},{"osd":4,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":1.175},{"interface":"front","average":{"1min":1.236,"5min":1.236,"15min":1.236},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":2.0710000000000002,"5min":2.0710000000000002,"15min":2.0710000000000002},"last":1.321}]},{"osd":5,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"min":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"max":{"1min":1.8129999999999999,"5min":1.8129999999999999,"15min":1.8129999999999999},"last":1.246},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"min":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"max":{"1min":1.881,"5min":1.881,"15min":1.881},"last":1.288}]},{"osd":6,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"min":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"max":{"1min":1.8779999999999999,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":1.3149999999999999},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"min":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":1.946,"5min":1.946,"15min":1.946},"last":1.3959999999999999}]},{"osd":7,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"min":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"max":{"1min":1.9279999999999999,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":1.496},{"interface":"front","average":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"min":{"1min":1.03,"5min":1.03,"15min":1.03},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":1.3720000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574871,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299656,"kb_used_data":2560,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94072184,"statfs":{"total":96636764160,"available":96329916416,"internally_reserved":0,"allocated":2621440,"data_stored":2330203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":2.7250000000000001,"5min":2.7250000000000001,"15min":2.7250000000000001},"last":0.98599999999999999},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.76000000000000001}]},{"osd":2,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":2.7799999999999998,"5min":2.7799999999999998,"15min":2.7799999999999998},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.877}]},{"osd":3,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":2.919,"5min":2.919,"15min":2.919},"last":1.1279999999999999},{"interface":"front","average":{"1min":1.248,"5min":1.248,"15min":1.248},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":2.8959999999999999,"5min":2.8959999999999999,"15min":2.8959999999999999},"last":1.276}]},{"osd":4,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":1.248},{"interface":"front","average":{"1min":1.292,"5min":1.292,"15min":1.292},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":3.1280000000000001,"5min":3.1280000000000001,"15min":3.1280000000000001},"last":1.2130000000000001}]},{"osd":5,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"min":{"1min":0.87,"5min":0.87,"15min":0.87},"max":{"1min":3.0760000000000001,"5min":3.0760000000000001,"15min":3.0760000000000001},"last":1.2649999999999999},{"interface":"front","average":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":2.512,"5min":2.512,"15min":2.512},"last":1.3660000000000001}]},{"osd":6,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.5,"5min":1.5,"15min":1.5},"min":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"max":{"1min":2.8199999999999998,"5min":2.8199999999999998,"15min":2.8199999999999998},"last":1.5129999999999999},{"interface":"front","average":{"1min":1.51,"5min":1.51,"15min":1.51},"min":{"1min":1.032,"5min":1.032,"15min":1.032},"max":{"1min":4.6029999999999998,"5min":4.6029999999999998,"15min":4.6029999999999998},"last":1.496}]},{"osd":7,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.417,"5min":1.417,"15min":1.417},"min":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"max":{"1min":2.0190000000000001,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":1.3959999999999999},{"interface":"front","average":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"min":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"max":{"1min":3.6339999999999999,"5min":3.6339999999999999,"15min":3.6339999999999999},"last":1.3129999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-22T10:02:14.654 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-22T10:02:14.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.831+0000 7f5a625f9700 1 Processor -- start 2023-12-22T10:02:14.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.831+0000 7f5a625f9700 1 -- start start 2023-12-22T10:02:14.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.831+0000 7f5a625f9700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f5a5c0a9ed0 0x7f5a5c0c1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:14.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.831+0000 7f5a625f9700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a5c0c0f70 con 0x7f5a5c0bf910 2023-12-22T10:02:14.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.831+0000 7f5a625f9700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a5c0aa2b0 con 0x7f5a5c0c6070 2023-12-22T10:02:14.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.831+0000 7f5a625f9700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a5c0c0360 con 0x7f5a5c0a9ed0 2023-12-22T10:02:14.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.831+0000 7f5a60df6700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f5a5c0bf910 0x7f5a5c0c5960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:54686/0 (socket says 172.21.15.45:54686) 2023-12-22T10:02:14.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.831+0000 7f5a60df6700 1 -- 172.21.15.45:0/3412045246 learned_addr learned my addr 172.21.15.45:0/3412045246 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:02:14.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.835+0000 7f5a615f7700 1 --2- 172.21.15.45:0/3412045246 >> v2:172.21.15.113:3300/0 conn(0x7f5a5c0a9ed0 0x7f5a5c0c1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:14.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.835+0000 7f5a53fff700 1 -- 172.21.15.45:0/3412045246 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2743909513 0 0) 0x7f5a5c0c0f70 con 0x7f5a5c0bf910 2023-12-22T10:02:14.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.835+0000 7f5a53fff700 1 -- 172.21.15.45:0/3412045246 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a480033f0 con 0x7f5a5c0bf910 2023-12-22T10:02:14.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.835+0000 7f5a615f7700 1 -- 172.21.15.45:0/3412045246 >> v1:172.21.15.113:6789/0 conn(0x7f5a5c0c6070 legacy=0x7f5a5c0aa940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:14.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.835+0000 7f5a53fff700 1 -- 172.21.15.45:0/3412045246 <== mon.1 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3151060589 0 0) 0x7f5a5c0aa2b0 con 0x7f5a5c0c6070 2023-12-22T10:02:14.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.835+0000 7f5a615f7700 1 -- 172.21.15.45:0/3412045246 >> v1:172.21.15.45:6789/0 conn(0x7f5a5c0bf910 legacy=0x7f5a5c0c5960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:14.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.835+0000 7f5a615f7700 1 -- 172.21.15.45:0/3412045246 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a5c0c0640 con 0x7f5a5c0a9ed0 2023-12-22T10:02:14.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.835+0000 7f5a615f7700 1 --2- 172.21.15.45:0/3412045246 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5a5c0a9ed0 0x7f5a5c0c1400 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f5a58009760 tx=0x7f5a58009060).ready entity=mon.1 client_cookie=71a4b2e9a12af0cf server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:14.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.835+0000 7f5a53fff700 1 -- 172.21.15.45:0/3412045246 <== mon.1 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a5800f510 con 0x7f5a5c0a9ed0 2023-12-22T10:02:14.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.835+0000 7f5a53fff700 1 -- 172.21.15.45:0/3412045246 <== mon.1 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a5800f670 con 0x7f5a5c0a9ed0 2023-12-22T10:02:14.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.835+0000 7f5a53fff700 1 -- 172.21.15.45:0/3412045246 <== mon.1 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a5800f9f0 con 0x7f5a5c0a9ed0 2023-12-22T10:02:14.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.835+0000 7f5a625f9700 1 -- 172.21.15.45:0/3412045246 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5a5c0a9ed0 msgr2=0x7f5a5c0c1400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:14.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.835+0000 7f5a625f9700 1 --2- 172.21.15.45:0/3412045246 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5a5c0a9ed0 0x7f5a5c0c1400 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f5a58009760 tx=0x7f5a58009060).stop 2023-12-22T10:02:14.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.835+0000 7f5a625f9700 1 -- 172.21.15.45:0/3412045246 shutdown_connections 2023-12-22T10:02:14.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.835+0000 7f5a625f9700 1 --2- 172.21.15.45:0/3412045246 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5a5c0a9ed0 0x7f5a5c0c1400 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:14.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.835+0000 7f5a625f9700 1 -- 172.21.15.45:0/3412045246 >> 172.21.15.45:0/3412045246 conn(0x7f5a5c067500 msgr2=0x7f5a5c0ca9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:02:14.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.835+0000 7f5a625f9700 1 -- 172.21.15.45:0/3412045246 shutdown_connections 2023-12-22T10:02:14.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.835+0000 7f5a625f9700 1 -- 172.21.15.45:0/3412045246 wait complete. 2023-12-22T10:02:14.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.839+0000 7f5a625f9700 1 Processor -- start 2023-12-22T10:02:14.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.839+0000 7f5a625f9700 1 -- start start 2023-12-22T10:02:14.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.843+0000 7f5a625f9700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5a5c0a9ed0 0x7f5a5c150620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:14.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.843+0000 7f5a625f9700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f5a5c0bf910 0x7f5a5c1675b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:14.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.843+0000 7f5a625f9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a5c0c6070 0x7f5a5c167aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:14.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.843+0000 7f5a625f9700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a5c0af690 con 0x7f5a5c0c6070 2023-12-22T10:02:14.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.843+0000 7f5a625f9700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a5c0af080 con 0x7f5a5c0a9ed0 2023-12-22T10:02:14.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.843+0000 7f5a625f9700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a5c168070 con 0x7f5a5c0bf910 2023-12-22T10:02:14.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.843+0000 7f5a61df8700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a5c0c6070 0x7f5a5c167aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:14.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.843+0000 7f5a60df6700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f5a5c0bf910 0x7f5a5c1675b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:14.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.843+0000 7f5a615f7700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5a5c0a9ed0 0x7f5a5c150620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:14.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.843+0000 7f5a615f7700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5a5c0a9ed0 0x7f5a5c150620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.45:48868/0 (socket says 172.21.15.45:48868) 2023-12-22T10:02:14.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.843+0000 7f5a615f7700 1 -- 172.21.15.45:0/2488126434 learned_addr learned my addr 172.21.15.45:0/2488126434 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:02:14.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.843+0000 7f5a61df8700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a5c0c6070 0x7f5a5c167aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42944/0 (socket says 172.21.15.45:42944) 2023-12-22T10:02:14.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.843+0000 7f5a615f7700 1 -- 172.21.15.45:0/2488126434 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f5a5c0bf910 msgr2=0x7f5a5c1675b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:14.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.843+0000 7f5a615f7700 1 --2- 172.21.15.45:0/2488126434 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f5a5c0bf910 0x7f5a5c1675b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:14.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.843+0000 7f5a615f7700 1 -- 172.21.15.45:0/2488126434 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a5c0c6070 msgr2=0x7f5a5c167aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:14.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.843+0000 7f5a615f7700 1 --2- 172.21.15.45:0/2488126434 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a5c0c6070 0x7f5a5c167aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:14.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.843+0000 7f5a615f7700 1 -- 172.21.15.45:0/2488126434 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a580092a0 con 0x7f5a5c0a9ed0 2023-12-22T10:02:14.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.843+0000 7f5a615f7700 1 --2- 172.21.15.45:0/2488126434 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5a5c0a9ed0 0x7f5a5c150620 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f5a58009e00 tx=0x7f5a58017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:14.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.843+0000 7f5a517fa700 1 -- 172.21.15.45:0/2488126434 <== mon.1 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a5800f7e0 con 0x7f5a5c0a9ed0 2023-12-22T10:02:14.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.843+0000 7f5a517fa700 1 -- 172.21.15.45:0/2488126434 <== mon.1 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a5800f940 con 0x7f5a5c0a9ed0 2023-12-22T10:02:14.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.843+0000 7f5a625f9700 1 -- 172.21.15.45:0/2488126434 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a5c168350 con 0x7f5a5c0a9ed0 2023-12-22T10:02:14.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.843+0000 7f5a517fa700 1 -- 172.21.15.45:0/2488126434 <== mon.1 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a5801b660 con 0x7f5a5c0a9ed0 2023-12-22T10:02:14.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.843+0000 7f5a625f9700 1 -- 172.21.15.45:0/2488126434 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a5c0c1c80 con 0x7f5a5c0a9ed0 2023-12-22T10:02:14.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.847+0000 7f5a625f9700 1 -- 172.21.15.45:0/2488126434 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a5c047060 con 0x7f5a5c0a9ed0 2023-12-22T10:02:14.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.847+0000 7f5a517fa700 1 -- 172.21.15.45:0/2488126434 <== mon.1 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f5a5801b9d0 con 0x7f5a5c0a9ed0 2023-12-22T10:02:14.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.847+0000 7f5a517fa700 1 --2- 172.21.15.45:0/2488126434 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f5a4005a560 0x7f5a4005ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:14.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.847+0000 7f5a517fa700 1 -- 172.21.15.45:0/2488126434 <== mon.1 v2:172.21.15.113:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f5a58075c40 con 0x7f5a5c0a9ed0 2023-12-22T10:02:14.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.847+0000 7f5a60df6700 1 --2- 172.21.15.45:0/2488126434 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f5a4005a560 0x7f5a4005ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:14.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.851+0000 7f5a60df6700 1 --2- 172.21.15.45:0/2488126434 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f5a4005a560 0x7f5a4005ca20 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7f5a5c0ca6a0 tx=0x7f5a4c009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:14.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:14.859+0000 7f5a517fa700 1 -- 172.21.15.45:0/2488126434 <== mon.1 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f5a580496e0 con 0x7f5a5c0a9ed0 2023-12-22T10:02:15.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.023+0000 7f5a625f9700 1 -- 172.21.15.45:0/2488126434 --> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5a5c0c0920 con 0x7f5a4005a560 2023-12-22T10:02:15.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.027+0000 7f5a517fa700 1 -- 172.21.15.45:0/2488126434 <== mgr.4104 v2:172.21.15.45:6832/33679 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+68207 (secure 0 0 0) 0x7f5a5c0c0920 con 0x7f5a4005a560 2023-12-22T10:02:15.029 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:02:15.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.031+0000 7f5a625f9700 1 -- 172.21.15.45:0/2488126434 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f5a4005a560 msgr2=0x7f5a4005ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:15.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.031+0000 7f5a625f9700 1 --2- 172.21.15.45:0/2488126434 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f5a4005a560 0x7f5a4005ca20 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7f5a5c0ca6a0 tx=0x7f5a4c009040).stop 2023-12-22T10:02:15.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.031+0000 7f5a625f9700 1 -- 172.21.15.45:0/2488126434 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5a5c0a9ed0 msgr2=0x7f5a5c150620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:15.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.031+0000 7f5a625f9700 1 --2- 172.21.15.45:0/2488126434 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5a5c0a9ed0 0x7f5a5c150620 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f5a58009e00 tx=0x7f5a58017000).stop 2023-12-22T10:02:15.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.031+0000 7f5a625f9700 1 -- 172.21.15.45:0/2488126434 shutdown_connections 2023-12-22T10:02:15.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.031+0000 7f5a625f9700 1 --2- 172.21.15.45:0/2488126434 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a5c0c6070 0x7f5a5c167aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:15.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.031+0000 7f5a625f9700 1 --2- 172.21.15.45:0/2488126434 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f5a4005a560 0x7f5a4005ca20 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:15.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.031+0000 7f5a625f9700 1 --2- 172.21.15.45:0/2488126434 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f5a5c0bf910 0x7f5a5c1675b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:15.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.031+0000 7f5a625f9700 1 --2- 172.21.15.45:0/2488126434 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5a5c0a9ed0 0x7f5a5c150620 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:15.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.031+0000 7f5a625f9700 1 -- 172.21.15.45:0/2488126434 >> 172.21.15.45:0/2488126434 conn(0x7f5a5c067500 msgr2=0x7f5a5c1534b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:02:15.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.031+0000 7f5a625f9700 1 -- 172.21.15.45:0/2488126434 shutdown_connections 2023-12-22T10:02:15.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.031+0000 7f5a625f9700 1 -- 172.21.15.45:0/2488126434 wait complete. 2023-12-22T10:02:15.034 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-12-22T10:02:15.054 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":94,"stamp":"2023-12-22T10:02:13.985626+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":234,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2393152,"kb_used_data":16384,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752581568,"statfs":{"total":773094113280,"available":770643525632,"internally_reserved":0,"allocated":16777216,"data_stored":14447320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6291456,"num_objects":-2,"num_object_clones":0,"num_object_copies":-4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-4,"num_write_kb":-6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.073819"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":34,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-12-22T10:02:04.819301+0000","last_change":"2023-12-22T10:00:28.036372+0000","last_active":"2023-12-22T10:02:04.819301+0000","last_peered":"2023-12-22T10:02:04.819301+0000","last_clean":"2023-12-22T10:02:04.819301+0000","last_became_active":"2023-12-22T10:00:28.035974+0000","last_became_peered":"2023-12-22T10:00:28.035974+0000","last_unstale":"2023-12-22T10:02:04.819301+0000","last_undegraded":"2023-12-22T10:02:04.819301+0000","last_fullsized":"2023-12-22T10:02:04.819301+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_clean_scrub_stamp":"2023-12-22T10:00:27.001906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":37,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-12-22T10:02:03.866778+0000","last_change":"2023-12-22T10:00:28.035308+0000","last_active":"2023-12-22T10:02:03.866778+0000","last_peered":"2023-12-22T10:02:03.866778+0000","last_clean":"2023-12-22T10:02:03.866778+0000","last_became_active":"2023-12-22T10:00:28.035002+0000","last_became_peered":"2023-12-22T10:00:28.035002+0000","last_unstale":"2023-12-22T10:02:03.866778+0000","last_undegraded":"2023-12-22T10:02:03.866778+0000","last_fullsized":"2023-12-22T10:02:03.866778+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_clean_scrub_stamp":"2023-12-22T10:00:27.001906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":34,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-12-22T10:02:04.814856+0000","last_change":"2023-12-22T10:00:28.029892+0000","last_active":"2023-12-22T10:02:04.814856+0000","last_peered":"2023-12-22T10:02:04.814856+0000","last_clean":"2023-12-22T10:02:04.814856+0000","last_became_active":"2023-12-22T10:00:28.029391+0000","last_became_peered":"2023-12-22T10:00:28.029391+0000","last_unstale":"2023-12-22T10:02:04.814856+0000","last_undegraded":"2023-12-22T10:02:04.814856+0000","last_fullsized":"2023-12-22T10:02:04.814856+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_clean_scrub_stamp":"2023-12-22T10:00:27.001906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":33,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-12-22T10:02:04.458312+0000","last_change":"2023-12-22T10:00:28.025395+0000","last_active":"2023-12-22T10:02:04.458312+0000","last_peered":"2023-12-22T10:02:04.458312+0000","last_clean":"2023-12-22T10:02:04.458312+0000","last_became_active":"2023-12-22T10:00:28.024588+0000","last_became_peered":"2023-12-22T10:00:28.024588+0000","last_unstale":"2023-12-22T10:02:04.458312+0000","last_undegraded":"2023-12-22T10:02:04.458312+0000","last_fullsized":"2023-12-22T10:02:04.458312+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_clean_scrub_stamp":"2023-12-22T10:00:27.001906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":34,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-12-22T10:02:04.814823+0000","last_change":"2023-12-22T10:00:28.029884+0000","last_active":"2023-12-22T10:02:04.814823+0000","last_peered":"2023-12-22T10:02:04.814823+0000","last_clean":"2023-12-22T10:02:04.814823+0000","last_became_active":"2023-12-22T10:00:28.029422+0000","last_became_peered":"2023-12-22T10:00:28.029422+0000","last_unstale":"2023-12-22T10:02:04.814823+0000","last_undegraded":"2023-12-22T10:02:04.814823+0000","last_fullsized":"2023-12-22T10:02:04.814823+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_clean_scrub_stamp":"2023-12-22T10:00:27.001906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":35,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-12-22T10:02:05.153764+0000","last_change":"2023-12-22T10:00:28.028621+0000","last_active":"2023-12-22T10:02:05.153764+0000","last_peered":"2023-12-22T10:02:05.153764+0000","last_clean":"2023-12-22T10:02:05.153764+0000","last_became_active":"2023-12-22T10:00:28.028159+0000","last_became_peered":"2023-12-22T10:00:28.028159+0000","last_unstale":"2023-12-22T10:02:05.153764+0000","last_undegraded":"2023-12-22T10:02:05.153764+0000","last_fullsized":"2023-12-22T10:02:05.153764+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_clean_scrub_stamp":"2023-12-22T10:00:27.001906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":34,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-12-22T10:02:04.815470+0000","last_change":"2023-12-22T10:00:28.030883+0000","last_active":"2023-12-22T10:02:04.815470+0000","last_peered":"2023-12-22T10:02:04.815470+0000","last_clean":"2023-12-22T10:02:04.815470+0000","last_became_active":"2023-12-22T10:00:28.030284+0000","last_became_peered":"2023-12-22T10:00:28.030284+0000","last_unstale":"2023-12-22T10:02:04.815470+0000","last_undegraded":"2023-12-22T10:02:04.815470+0000","last_fullsized":"2023-12-22T10:02:04.815470+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_clean_scrub_stamp":"2023-12-22T10:00:27.001906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":34,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-12-22T10:02:04.814965+0000","last_change":"2023-12-22T10:00:28.031790+0000","last_active":"2023-12-22T10:02:04.814965+0000","last_peered":"2023-12-22T10:02:04.814965+0000","last_clean":"2023-12-22T10:02:04.814965+0000","last_became_active":"2023-12-22T10:00:28.031190+0000","last_became_peered":"2023-12-22T10:00:28.031190+0000","last_unstale":"2023-12-22T10:02:04.814965+0000","last_undegraded":"2023-12-22T10:02:04.814965+0000","last_fullsized":"2023-12-22T10:02:04.814965+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_clean_scrub_stamp":"2023-12-22T10:00:27.001906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":35,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-12-22T10:02:05.155826+0000","last_change":"2023-12-22T10:00:27.889031+0000","last_active":"2023-12-22T10:02:05.155826+0000","last_peered":"2023-12-22T10:02:05.155826+0000","last_clean":"2023-12-22T10:02:05.155826+0000","last_became_active":"2023-12-22T10:00:27.888164+0000","last_became_peered":"2023-12-22T10:00:27.888164+0000","last_unstale":"2023-12-22T10:02:05.155826+0000","last_undegraded":"2023-12-22T10:02:05.155826+0000","last_fullsized":"2023-12-22T10:02:05.155826+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:25.998963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:25.998963+0000","last_clean_scrub_stamp":"2023-12-22T10:00:25.998963+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297608,"kb_used_data":512,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074232,"statfs":{"total":96636764160,"available":96332013568,"internally_reserved":0,"allocated":524288,"data_stored":233051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 10:01:29 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.143,"15min":1.143},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.677,"5min":1.677,"15min":1.677},"last":1.125},{"interface":"front","average":{"1min":1.161,"5min":1.161,"15min":1.161},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":1.345}]},{"osd":1,"last update":"Fri Dec 22 10:01:29 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.25,"15min":1.25},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.8899999999999999,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":1.1859999999999999},{"interface":"front","average":{"1min":1.337,"5min":1.337,"15min":1.337},"min":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":2.6819999999999999,"5min":2.6819999999999999,"15min":2.6819999999999999},"last":1.4119999999999999}]},{"osd":2,"last update":"Fri Dec 22 10:01:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":2.8490000000000002,"5min":2.8490000000000002,"15min":2.8490000000000002},"last":1.258},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.774,"5min":1.774,"15min":1.774},"last":1.0249999999999999}]},{"osd":3,"last update":"Fri Dec 22 10:01:29 2023","interfaces":[{"interface":"back","average":{"1min":1.321,"5min":1.321,"15min":1.321},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":2.3690000000000002,"5min":2.3690000000000002,"15min":2.3690000000000002},"last":1.325},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"min":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"max":{"1min":2.0899999999999999,"5min":2.0899999999999999,"15min":2.0899999999999999},"last":1.1120000000000001}]},{"osd":4,"last update":"Fri Dec 22 10:01:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.764,"5min":1.764,"15min":1.764},"last":1.0800000000000001},{"interface":"front","average":{"1min":1.278,"5min":1.278,"15min":1.278},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":2.2930000000000001,"5min":2.2930000000000001,"15min":2.2930000000000001},"last":1.1990000000000001}]},{"osd":5,"last update":"Fri Dec 22 10:01:29 2023","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.228,"15min":1.228},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.786,"5min":1.786,"15min":1.786},"last":1.2909999999999999},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":2.73,"5min":2.73,"15min":2.73},"last":1.23}]},{"osd":6,"last update":"Fri Dec 22 10:01:29 2023","interfaces":[{"interface":"back","average":{"1min":1.476,"5min":1.476,"15min":1.476},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":2.7690000000000001,"5min":2.7690000000000001,"15min":2.7690000000000001},"last":1.4630000000000001},{"interface":"front","average":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":2.8820000000000001,"5min":2.8820000000000001,"15min":2.8820000000000001},"last":1.3700000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574871,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297608,"kb_used_data":512,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074232,"statfs":{"total":96636764160,"available":96332013568,"internally_reserved":0,"allocated":524288,"data_stored":233051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.131,"15min":1.131},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":1.0700000000000001},{"interface":"front","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.617,"5min":1.617,"15min":1.617},"last":1.163}]},{"osd":1,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":0.94199999999999995},{"interface":"front","average":{"1min":1.085,"5min":1.085,"15min":1.085},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.657,"5min":1.657,"15min":1.657},"last":1.1839999999999999}]},{"osd":2,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.077,"15min":1.077},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":0.77800000000000002},{"interface":"front","average":{"1min":1.145,"5min":1.145,"15min":1.145},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.583,"5min":1.583,"15min":1.583},"last":1.0409999999999999}]},{"osd":3,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.262,"15min":1.262},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.995},{"interface":"front","average":{"1min":1.252,"5min":1.252,"15min":1.252},"min":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":1.6359999999999999,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":1.244}]},{"osd":4,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.282,"15min":1.282},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.7310000000000001,"5min":1.7310000000000001,"15min":1.7310000000000001},"last":1.272},{"interface":"front","average":{"1min":1.361,"5min":1.361,"15min":1.361},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":2.2280000000000002,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":1.321}]},{"osd":5,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"min":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":1.907,"5min":1.907,"15min":1.907},"last":1.1479999999999999},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":2.363,"5min":2.363,"15min":2.363},"last":1.343}]},{"osd":7,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"min":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"max":{"1min":2.1459999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.3919999999999999},{"interface":"front","average":{"1min":1.403,"5min":1.403,"15min":1.403},"min":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"max":{"1min":2.1779999999999999,"5min":2.1779999999999999,"15min":2.1779999999999999},"last":1.496}]}]},{"osd":5,"up_from":13,"seq":55834574871,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301704,"kb_used_data":4608,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94070136,"statfs":{"total":96636764160,"available":96327819264,"internally_reserved":0,"allocated":4718592,"data_stored":4427355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":1.4379999999999999},{"interface":"front","average":{"1min":1.123,"5min":1.123,"15min":1.123},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.6559999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":1.401}]},{"osd":1,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":1.1890000000000001},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":2.0070000000000001,"5min":2.0070000000000001,"15min":2.0070000000000001},"last":1.107}]},{"osd":2,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":1.214},{"interface":"front","average":{"1min":1.119,"5min":1.119,"15min":1.119},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.607,"5min":1.607,"15min":1.607},"last":1.3720000000000001}]},{"osd":3,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.133,"15min":1.133},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.80600000000000005},{"interface":"front","average":{"1min":1.179,"5min":1.179,"15min":1.179},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.488,"5min":1.488,"15min":1.488},"last":1.3140000000000001}]},{"osd":4,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.145,"15min":1.145},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":1.8779999999999999,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":1.1459999999999999},{"interface":"front","average":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"min":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":1.351}]},{"osd":6,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.242,"15min":1.242},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.7749999999999999,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":1.2789999999999999},{"interface":"front","average":{"1min":1.236,"5min":1.236,"15min":1.236},"min":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":1.0760000000000001}]},{"osd":7,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.236,"15min":1.236},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":1.516,"5min":1.516,"15min":1.516},"last":1.2589999999999999},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.8620000000000001,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":1.341}]}]},{"osd":4,"up_from":13,"seq":55834574871,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297608,"kb_used_data":512,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074232,"statfs":{"total":96636764160,"available":96332013568,"internally_reserved":0,"allocated":524288,"data_stored":233051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.149,"15min":1.149},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":1.1479999999999999},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"min":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.97499999999999998}]},{"osd":1,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":1.012,"15min":1.012},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":0.94199999999999995},{"interface":"front","average":{"1min":1.077,"5min":1.077,"15min":1.077},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":1.425}]},{"osd":2,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.641,"5min":1.641,"15min":1.641},"last":1.202},{"interface":"front","average":{"1min":1.272,"5min":1.272,"15min":1.272},"min":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"max":{"1min":1.8340000000000001,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":1.3260000000000001}]},{"osd":3,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.173,"15min":1.173},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":1.7490000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":1.232},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"min":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"max":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":1.381}]},{"osd":5,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":1.216,"15min":1.216},"min":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"max":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":1.4850000000000001},{"interface":"front","average":{"1min":1.173,"5min":1.173,"15min":1.173},"min":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":1.9350000000000001,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":1.3149999999999999}]},{"osd":6,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":1.869,"5min":1.869,"15min":1.869},"last":1.089},{"interface":"front","average":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"min":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"max":{"1min":1.9910000000000001,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":1.26}]},{"osd":7,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"min":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"max":{"1min":2.1960000000000002,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":1.361},{"interface":"front","average":{"1min":1.391,"5min":1.391,"15min":1.391},"min":{"1min":1.044,"5min":1.044,"15min":1.044},"max":{"1min":1.8680000000000001,"5min":1.8680000000000001,"15min":1.8680000000000001},"last":1.5029999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574871,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303752,"kb_used_data":6656,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94068088,"statfs":{"total":96636764160,"available":96325722112,"internally_reserved":0,"allocated":6815744,"data_stored":6524507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 10:01:25 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":1.145},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.60699999999999998}]},{"osd":1,"last update":"Fri Dec 22 10:01:25 2023","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":1.165},{"interface":"front","average":{"1min":1.109,"5min":1.109,"15min":1.109},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":1.385}]},{"osd":2,"last update":"Fri Dec 22 10:01:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":0.88900000000000001},{"interface":"front","average":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.702,"5min":1.702,"15min":1.702},"last":1.0549999999999999}]},{"osd":4,"last update":"Fri Dec 22 10:01:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.2,"15min":1.2},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":1.103},{"interface":"front","average":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":2.0619999999999998,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":1.038}]},{"osd":5,"last update":"Fri Dec 22 10:01:25 2023","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.333,"15min":1.333},"min":{"1min":0.878,"5min":0.878,"15min":0.878},"max":{"1min":1.9339999999999999,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":1.258},{"interface":"front","average":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"min":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"max":{"1min":2.1720000000000002,"5min":2.1720000000000002,"15min":2.1720000000000002},"last":1.3240000000000001}]},{"osd":6,"last update":"Fri Dec 22 10:01:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.8640000000000001,"5min":1.8640000000000001,"15min":1.8640000000000001},"last":1.266},{"interface":"front","average":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":2.2130000000000001,"5min":2.2130000000000001,"15min":2.2130000000000001},"last":1.3009999999999999}]},{"osd":7,"last update":"Fri Dec 22 10:01:25 2023","interfaces":[{"interface":"back","average":{"1min":1.405,"5min":1.405,"15min":1.405},"min":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"max":{"1min":2.1389999999999998,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":1.236},{"interface":"front","average":{"1min":1.431,"5min":1.431,"15min":1.431},"min":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":2.105,"5min":2.105,"15min":2.105},"last":1.212}]}]},{"osd":2,"up_from":13,"seq":55834574872,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297608,"kb_used_data":512,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074232,"statfs":{"total":96636764160,"available":96332013568,"internally_reserved":0,"allocated":524288,"data_stored":233051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":3.1589999999999998},{"interface":"front","average":{"1min":1.083,"5min":1.083,"15min":1.083},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":2.3039999999999998}]},{"osd":1,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.52,"5min":1.52,"15min":1.52},"last":3.194},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":2.3809999999999998,"5min":2.3809999999999998,"15min":2.3809999999999998},"last":3.0910000000000002}]},{"osd":3,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.698,"5min":1.698,"15min":1.698},"last":5.4059999999999997},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.788,"5min":1.788,"15min":1.788},"last":5.2789999999999999}]},{"osd":4,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.381,"15min":1.381},"min":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"max":{"1min":2.234,"5min":2.234,"15min":2.234},"last":2.2130000000000001},{"interface":"front","average":{"1min":1.296,"5min":1.296,"15min":1.296},"min":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"max":{"1min":2.1230000000000002,"5min":2.1230000000000002,"15min":2.1230000000000002},"last":2.004}]},{"osd":5,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"min":{"1min":1.109,"5min":1.109,"15min":1.109},"max":{"1min":2.0960000000000001,"5min":2.0960000000000001,"15min":2.0960000000000001},"last":2.5339999999999998},{"interface":"front","average":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"min":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"max":{"1min":1.9730000000000001,"5min":1.9730000000000001,"15min":1.9730000000000001},"last":2.2610000000000001}]},{"osd":6,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"min":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"max":{"1min":2.298,"5min":2.298,"15min":2.298},"last":1.95},{"interface":"front","average":{"1min":1.46,"5min":1.46,"15min":1.46},"min":{"1min":1.02,"5min":1.02,"15min":1.02},"max":{"1min":1.899,"5min":1.899,"15min":1.899},"last":3.1179999999999999}]},{"osd":7,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.458,"5min":1.458,"15min":1.458},"min":{"1min":1,"5min":1,"15min":1},"max":{"1min":2.0289999999999999,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":2.7269999999999999},{"interface":"front","average":{"1min":1.415,"5min":1.415,"15min":1.415},"min":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"max":{"1min":2.0179999999999998,"5min":2.0179999999999998,"15min":2.0179999999999998},"last":2.0419999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297608,"kb_used_data":512,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074232,"statfs":{"total":96636764160,"available":96332013568,"internally_reserved":0,"allocated":524288,"data_stored":233051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.90300000000000002}]},{"osd":2,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.96299999999999997},{"interface":"front","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":1.208}]},{"osd":3,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":1.4379999999999999},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":1.151}]},{"osd":4,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":1.175},{"interface":"front","average":{"1min":1.236,"5min":1.236,"15min":1.236},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":2.0710000000000002,"5min":2.0710000000000002,"15min":2.0710000000000002},"last":1.321}]},{"osd":5,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"min":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"max":{"1min":1.8129999999999999,"5min":1.8129999999999999,"15min":1.8129999999999999},"last":1.246},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"min":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"max":{"1min":1.881,"5min":1.881,"15min":1.881},"last":1.288}]},{"osd":6,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"min":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"max":{"1min":1.8779999999999999,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":1.3149999999999999},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"min":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":1.946,"5min":1.946,"15min":1.946},"last":1.3959999999999999}]},{"osd":7,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"min":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"max":{"1min":1.9279999999999999,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":1.496},{"interface":"front","average":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"min":{"1min":1.03,"5min":1.03,"15min":1.03},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":1.3720000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574871,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299656,"kb_used_data":2560,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94072184,"statfs":{"total":96636764160,"available":96329916416,"internally_reserved":0,"allocated":2621440,"data_stored":2330203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":2.7250000000000001,"5min":2.7250000000000001,"15min":2.7250000000000001},"last":0.98599999999999999},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.76000000000000001}]},{"osd":2,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":2.7799999999999998,"5min":2.7799999999999998,"15min":2.7799999999999998},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.877}]},{"osd":3,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":2.919,"5min":2.919,"15min":2.919},"last":1.1279999999999999},{"interface":"front","average":{"1min":1.248,"5min":1.248,"15min":1.248},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":2.8959999999999999,"5min":2.8959999999999999,"15min":2.8959999999999999},"last":1.276}]},{"osd":4,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":1.248},{"interface":"front","average":{"1min":1.292,"5min":1.292,"15min":1.292},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":3.1280000000000001,"5min":3.1280000000000001,"15min":3.1280000000000001},"last":1.2130000000000001}]},{"osd":5,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"min":{"1min":0.87,"5min":0.87,"15min":0.87},"max":{"1min":3.0760000000000001,"5min":3.0760000000000001,"15min":3.0760000000000001},"last":1.2649999999999999},{"interface":"front","average":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":2.512,"5min":2.512,"15min":2.512},"last":1.3660000000000001}]},{"osd":6,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.5,"5min":1.5,"15min":1.5},"min":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"max":{"1min":2.8199999999999998,"5min":2.8199999999999998,"15min":2.8199999999999998},"last":1.5129999999999999},{"interface":"front","average":{"1min":1.51,"5min":1.51,"15min":1.51},"min":{"1min":1.032,"5min":1.032,"15min":1.032},"max":{"1min":4.6029999999999998,"5min":4.6029999999999998,"15min":4.6029999999999998},"last":1.496}]},{"osd":7,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.417,"5min":1.417,"15min":1.417},"min":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"max":{"1min":2.0190000000000001,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":1.3959999999999999},{"interface":"front","average":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"min":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"max":{"1min":3.6339999999999999,"5min":3.6339999999999999,"15min":3.6339999999999999},"last":1.3129999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-22T10:02:15.097 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-12-22T10:02:15.098 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-22T10:02:15.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.275+0000 7f1be7946700 1 Processor -- start 2023-12-22T10:02:15.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.275+0000 7f1be7946700 1 -- start start 2023-12-22T10:02:15.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.275+0000 7f1be7946700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1be00ac5c0 0x7f1be00c5900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:15.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.275+0000 7f1be7946700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1be01580d0 0x7f1be00aa660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:15.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.275+0000 7f1be7946700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f1be00c7430 0x7f1be00c78c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:15.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.275+0000 7f1be7946700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1be00c9720 con 0x7f1be00ac5c0 2023-12-22T10:02:15.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.275+0000 7f1be7946700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1be0153ec0 con 0x7f1be00c7430 2023-12-22T10:02:15.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.275+0000 7f1be7946700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1be00c7db0 con 0x7f1be01580d0 2023-12-22T10:02:15.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.279+0000 7f1be56e2700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1be00ac5c0 0x7f1be00c5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:15.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.279+0000 7f1be56e2700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1be00ac5c0 0x7f1be00c5900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42950/0 (socket says 172.21.15.45:42950) 2023-12-22T10:02:15.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.279+0000 7f1be56e2700 1 -- 172.21.15.45:0/122216257 learned_addr learned my addr 172.21.15.45:0/122216257 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:02:15.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.279+0000 7f1be5ee3700 1 --2- 172.21.15.45:0/122216257 >> v2:172.21.15.113:3300/0 conn(0x7f1be00c7430 0x7f1be00c78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:15.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.279+0000 7f1be4ee1700 1 --2- 172.21.15.45:0/122216257 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1be01580d0 0x7f1be00aa660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:15.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.279+0000 7f1be56e2700 1 -- 172.21.15.45:0/122216257 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1be01580d0 msgr2=0x7f1be00aa660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:02:15.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.279+0000 7f1be56e2700 1 --2- 172.21.15.45:0/122216257 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1be01580d0 0x7f1be00aa660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:15.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.279+0000 7f1be56e2700 1 -- 172.21.15.45:0/122216257 >> v2:172.21.15.113:3300/0 conn(0x7f1be00c7430 msgr2=0x7f1be00c78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:02:15.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.279+0000 7f1be56e2700 1 --2- 172.21.15.45:0/122216257 >> v2:172.21.15.113:3300/0 conn(0x7f1be00c7430 0x7f1be00c78c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:15.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.279+0000 7f1be56e2700 1 -- 172.21.15.45:0/122216257 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1be0158530 con 0x7f1be00ac5c0 2023-12-22T10:02:15.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.279+0000 7f1be56e2700 1 --2- 172.21.15.45:0/122216257 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1be00ac5c0 0x7f1be00c5900 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7f1be00c4fd0 tx=0x7f1bdc0090f0).ready entity=mon.0 client_cookie=f3d56dd4b2ec5d0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:15.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.279+0000 7f1bd7fff700 1 -- 172.21.15.45:0/122216257 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bdc00f510 con 0x7f1be00ac5c0 2023-12-22T10:02:15.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.279+0000 7f1bd7fff700 1 -- 172.21.15.45:0/122216257 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bdc00f670 con 0x7f1be00ac5c0 2023-12-22T10:02:15.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.279+0000 7f1bd7fff700 1 -- 172.21.15.45:0/122216257 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bdc00f9f0 con 0x7f1be00ac5c0 2023-12-22T10:02:15.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.279+0000 7f1be7946700 1 -- 172.21.15.45:0/122216257 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1be00ac5c0 msgr2=0x7f1be00c5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:15.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.279+0000 7f1be7946700 1 --2- 172.21.15.45:0/122216257 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1be00ac5c0 0x7f1be00c5900 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7f1be00c4fd0 tx=0x7f1bdc0090f0).stop 2023-12-22T10:02:15.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.279+0000 7f1be7946700 1 -- 172.21.15.45:0/122216257 shutdown_connections 2023-12-22T10:02:15.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.279+0000 7f1be7946700 1 --2- 172.21.15.45:0/122216257 >> v2:172.21.15.113:3300/0 conn(0x7f1be00c7430 0x7f1be00c78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:15.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.279+0000 7f1be7946700 1 --2- 172.21.15.45:0/122216257 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1be01580d0 0x7f1be00aa660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:15.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.279+0000 7f1be7946700 1 --2- 172.21.15.45:0/122216257 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1be00ac5c0 0x7f1be00c5900 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:15.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.279+0000 7f1be7946700 1 -- 172.21.15.45:0/122216257 >> 172.21.15.45:0/122216257 conn(0x7f1be0082a30 msgr2=0x7f1be0066a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:02:15.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.279+0000 7f1be7946700 1 -- 172.21.15.45:0/122216257 shutdown_connections 2023-12-22T10:02:15.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.279+0000 7f1be7946700 1 -- 172.21.15.45:0/122216257 wait complete. 2023-12-22T10:02:15.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.283+0000 7f1be7946700 1 Processor -- start 2023-12-22T10:02:15.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.283+0000 7f1be7946700 1 -- start start 2023-12-22T10:02:15.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.283+0000 7f1be7946700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1be00ac5c0 0x7f1be00b03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:15.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.283+0000 7f1be7946700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1be00c7430 0x7f1be0167ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:15.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.283+0000 7f1be7946700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1be01580d0 0x7f1be0151c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:15.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.283+0000 7f1be7946700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1be00c24b0 con 0x7f1be01580d0 2023-12-22T10:02:15.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.283+0000 7f1be7946700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1be01684e0 con 0x7f1be00ac5c0 2023-12-22T10:02:15.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.283+0000 7f1be7946700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1be00b0a40 con 0x7f1be00c7430 2023-12-22T10:02:15.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.283+0000 7f1be5ee3700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1be01580d0 0x7f1be0151c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:15.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.287+0000 7f1be5ee3700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1be01580d0 0x7f1be0151c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42952/0 (socket says 172.21.15.45:42952) 2023-12-22T10:02:15.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.287+0000 7f1be5ee3700 1 -- 172.21.15.45:0/1533999222 learned_addr learned my addr 172.21.15.45:0/1533999222 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:02:15.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.287+0000 7f1be4ee1700 1 --2- 172.21.15.45:0/1533999222 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1be00c7430 0x7f1be0167ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:15.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.287+0000 7f1be56e2700 1 --2- 172.21.15.45:0/1533999222 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1be00ac5c0 0x7f1be00b03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:15.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.287+0000 7f1be5ee3700 1 -- 172.21.15.45:0/1533999222 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1be00c7430 msgr2=0x7f1be0167ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:15.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.287+0000 7f1be5ee3700 1 --2- 172.21.15.45:0/1533999222 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1be00c7430 0x7f1be0167ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:15.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.287+0000 7f1be5ee3700 1 -- 172.21.15.45:0/1533999222 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1be00ac5c0 msgr2=0x7f1be00b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:15.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.287+0000 7f1be5ee3700 1 --2- 172.21.15.45:0/1533999222 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1be00ac5c0 0x7f1be00b03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:15.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.287+0000 7f1be5ee3700 1 -- 172.21.15.45:0/1533999222 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bdc009370 con 0x7f1be01580d0 2023-12-22T10:02:15.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.287+0000 7f1be5ee3700 1 --2- 172.21.15.45:0/1533999222 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1be01580d0 0x7f1be0151c50 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0x7f1bd8009e90 tx=0x7f1bd800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:15.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.287+0000 7f1bd57fa700 1 -- 172.21.15.45:0/1533999222 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd800caa0 con 0x7f1be01580d0 2023-12-22T10:02:15.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.287+0000 7f1bd57fa700 1 -- 172.21.15.45:0/1533999222 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bd800f040 con 0x7f1be01580d0 2023-12-22T10:02:15.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.287+0000 7f1bd57fa700 1 -- 172.21.15.45:0/1533999222 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd800ce10 con 0x7f1be01580d0 2023-12-22T10:02:15.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.287+0000 7f1be7946700 1 -- 172.21.15.45:0/1533999222 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1be00c1b80 con 0x7f1be01580d0 2023-12-22T10:02:15.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.287+0000 7f1be7946700 1 -- 172.21.15.45:0/1533999222 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1be00c2140 con 0x7f1be01580d0 2023-12-22T10:02:15.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.287+0000 7f1be7946700 1 -- 172.21.15.45:0/1533999222 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1be00c2660 con 0x7f1be01580d0 2023-12-22T10:02:15.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.291+0000 7f1bd57fa700 1 -- 172.21.15.45:0/1533999222 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f1bd8013610 con 0x7f1be01580d0 2023-12-22T10:02:15.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.291+0000 7f1bd57fa700 1 --2- 172.21.15.45:0/1533999222 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f1bc405a510 0x7f1bc405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:15.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.291+0000 7f1bd57fa700 1 -- 172.21.15.45:0/1533999222 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f1bd8074da0 con 0x7f1be01580d0 2023-12-22T10:02:15.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.291+0000 7f1be56e2700 1 --2- 172.21.15.45:0/1533999222 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f1bc405a510 0x7f1bc405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:15.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.295+0000 7f1be56e2700 1 --2- 172.21.15.45:0/1533999222 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f1bc405a510 0x7f1bc405c9d0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7f1bdc009130 tx=0x7f1bdc017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:15.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.299+0000 7f1bd57fa700 1 -- 172.21.15.45:0/1533999222 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f1be00c2660 con 0x7f1be01580d0 2023-12-22T10:02:15.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.459+0000 7f1be7946700 1 -- 172.21.15.45:0/1533999222 --> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1be006c070 con 0x7f1bc405a510 2023-12-22T10:02:15.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.467+0000 7f1bd57fa700 1 -- 172.21.15.45:0/1533999222 <== mgr.4104 v2:172.21.15.45:6832/33679 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+68207 (secure 0 0 0) 0x7f1be006c070 con 0x7f1bc405a510 2023-12-22T10:02:15.467 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:02:15.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.471+0000 7f1be7946700 1 -- 172.21.15.45:0/1533999222 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f1bc405a510 msgr2=0x7f1bc405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:15.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.471+0000 7f1be7946700 1 --2- 172.21.15.45:0/1533999222 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f1bc405a510 0x7f1bc405c9d0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7f1bdc009130 tx=0x7f1bdc017000).stop 2023-12-22T10:02:15.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.471+0000 7f1be7946700 1 -- 172.21.15.45:0/1533999222 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1be01580d0 msgr2=0x7f1be0151c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:15.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.471+0000 7f1be7946700 1 --2- 172.21.15.45:0/1533999222 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1be01580d0 0x7f1be0151c50 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0x7f1bd8009e90 tx=0x7f1bd800b040).stop 2023-12-22T10:02:15.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.471+0000 7f1be7946700 1 -- 172.21.15.45:0/1533999222 shutdown_connections 2023-12-22T10:02:15.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.471+0000 7f1be7946700 1 --2- 172.21.15.45:0/1533999222 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1be01580d0 0x7f1be0151c50 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:15.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.471+0000 7f1be7946700 1 --2- 172.21.15.45:0/1533999222 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f1bc405a510 0x7f1bc405c9d0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:15.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.471+0000 7f1be7946700 1 --2- 172.21.15.45:0/1533999222 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f1be00c7430 0x7f1be0167ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:15.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.471+0000 7f1be7946700 1 --2- 172.21.15.45:0/1533999222 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f1be00ac5c0 0x7f1be00b03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:15.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.471+0000 7f1be7946700 1 -- 172.21.15.45:0/1533999222 >> 172.21.15.45:0/1533999222 conn(0x7f1be0082a30 msgr2=0x7f1be00caa30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:02:15.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.471+0000 7f1be7946700 1 -- 172.21.15.45:0/1533999222 shutdown_connections 2023-12-22T10:02:15.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.471+0000 7f1be7946700 1 -- 172.21.15.45:0/1533999222 wait complete. 2023-12-22T10:02:15.473 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-12-22T10:02:15.493 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":94,"stamp":"2023-12-22T10:02:13.985626+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":234,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2393152,"kb_used_data":16384,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752581568,"statfs":{"total":773094113280,"available":770643525632,"internally_reserved":0,"allocated":16777216,"data_stored":14447320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6291456,"num_objects":-2,"num_object_clones":0,"num_object_copies":-4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-4,"num_write_kb":-6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.073819"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":34,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-12-22T10:02:04.819301+0000","last_change":"2023-12-22T10:00:28.036372+0000","last_active":"2023-12-22T10:02:04.819301+0000","last_peered":"2023-12-22T10:02:04.819301+0000","last_clean":"2023-12-22T10:02:04.819301+0000","last_became_active":"2023-12-22T10:00:28.035974+0000","last_became_peered":"2023-12-22T10:00:28.035974+0000","last_unstale":"2023-12-22T10:02:04.819301+0000","last_undegraded":"2023-12-22T10:02:04.819301+0000","last_fullsized":"2023-12-22T10:02:04.819301+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_clean_scrub_stamp":"2023-12-22T10:00:27.001906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":37,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-12-22T10:02:03.866778+0000","last_change":"2023-12-22T10:00:28.035308+0000","last_active":"2023-12-22T10:02:03.866778+0000","last_peered":"2023-12-22T10:02:03.866778+0000","last_clean":"2023-12-22T10:02:03.866778+0000","last_became_active":"2023-12-22T10:00:28.035002+0000","last_became_peered":"2023-12-22T10:00:28.035002+0000","last_unstale":"2023-12-22T10:02:03.866778+0000","last_undegraded":"2023-12-22T10:02:03.866778+0000","last_fullsized":"2023-12-22T10:02:03.866778+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_clean_scrub_stamp":"2023-12-22T10:00:27.001906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":34,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-12-22T10:02:04.814856+0000","last_change":"2023-12-22T10:00:28.029892+0000","last_active":"2023-12-22T10:02:04.814856+0000","last_peered":"2023-12-22T10:02:04.814856+0000","last_clean":"2023-12-22T10:02:04.814856+0000","last_became_active":"2023-12-22T10:00:28.029391+0000","last_became_peered":"2023-12-22T10:00:28.029391+0000","last_unstale":"2023-12-22T10:02:04.814856+0000","last_undegraded":"2023-12-22T10:02:04.814856+0000","last_fullsized":"2023-12-22T10:02:04.814856+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_clean_scrub_stamp":"2023-12-22T10:00:27.001906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":33,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-12-22T10:02:04.458312+0000","last_change":"2023-12-22T10:00:28.025395+0000","last_active":"2023-12-22T10:02:04.458312+0000","last_peered":"2023-12-22T10:02:04.458312+0000","last_clean":"2023-12-22T10:02:04.458312+0000","last_became_active":"2023-12-22T10:00:28.024588+0000","last_became_peered":"2023-12-22T10:00:28.024588+0000","last_unstale":"2023-12-22T10:02:04.458312+0000","last_undegraded":"2023-12-22T10:02:04.458312+0000","last_fullsized":"2023-12-22T10:02:04.458312+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_clean_scrub_stamp":"2023-12-22T10:00:27.001906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":34,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-12-22T10:02:04.814823+0000","last_change":"2023-12-22T10:00:28.029884+0000","last_active":"2023-12-22T10:02:04.814823+0000","last_peered":"2023-12-22T10:02:04.814823+0000","last_clean":"2023-12-22T10:02:04.814823+0000","last_became_active":"2023-12-22T10:00:28.029422+0000","last_became_peered":"2023-12-22T10:00:28.029422+0000","last_unstale":"2023-12-22T10:02:04.814823+0000","last_undegraded":"2023-12-22T10:02:04.814823+0000","last_fullsized":"2023-12-22T10:02:04.814823+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_clean_scrub_stamp":"2023-12-22T10:00:27.001906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":35,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-12-22T10:02:05.153764+0000","last_change":"2023-12-22T10:00:28.028621+0000","last_active":"2023-12-22T10:02:05.153764+0000","last_peered":"2023-12-22T10:02:05.153764+0000","last_clean":"2023-12-22T10:02:05.153764+0000","last_became_active":"2023-12-22T10:00:28.028159+0000","last_became_peered":"2023-12-22T10:00:28.028159+0000","last_unstale":"2023-12-22T10:02:05.153764+0000","last_undegraded":"2023-12-22T10:02:05.153764+0000","last_fullsized":"2023-12-22T10:02:05.153764+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_clean_scrub_stamp":"2023-12-22T10:00:27.001906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":34,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-12-22T10:02:04.815470+0000","last_change":"2023-12-22T10:00:28.030883+0000","last_active":"2023-12-22T10:02:04.815470+0000","last_peered":"2023-12-22T10:02:04.815470+0000","last_clean":"2023-12-22T10:02:04.815470+0000","last_became_active":"2023-12-22T10:00:28.030284+0000","last_became_peered":"2023-12-22T10:00:28.030284+0000","last_unstale":"2023-12-22T10:02:04.815470+0000","last_undegraded":"2023-12-22T10:02:04.815470+0000","last_fullsized":"2023-12-22T10:02:04.815470+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_clean_scrub_stamp":"2023-12-22T10:00:27.001906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":34,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-12-22T10:02:04.814965+0000","last_change":"2023-12-22T10:00:28.031790+0000","last_active":"2023-12-22T10:02:04.814965+0000","last_peered":"2023-12-22T10:02:04.814965+0000","last_clean":"2023-12-22T10:02:04.814965+0000","last_became_active":"2023-12-22T10:00:28.031190+0000","last_became_peered":"2023-12-22T10:00:28.031190+0000","last_unstale":"2023-12-22T10:02:04.814965+0000","last_undegraded":"2023-12-22T10:02:04.814965+0000","last_fullsized":"2023-12-22T10:02:04.814965+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_clean_scrub_stamp":"2023-12-22T10:00:27.001906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":35,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-12-22T10:02:05.155826+0000","last_change":"2023-12-22T10:00:27.889031+0000","last_active":"2023-12-22T10:02:05.155826+0000","last_peered":"2023-12-22T10:02:05.155826+0000","last_clean":"2023-12-22T10:02:05.155826+0000","last_became_active":"2023-12-22T10:00:27.888164+0000","last_became_peered":"2023-12-22T10:00:27.888164+0000","last_unstale":"2023-12-22T10:02:05.155826+0000","last_undegraded":"2023-12-22T10:02:05.155826+0000","last_fullsized":"2023-12-22T10:02:05.155826+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:25.998963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:25.998963+0000","last_clean_scrub_stamp":"2023-12-22T10:00:25.998963+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297608,"kb_used_data":512,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074232,"statfs":{"total":96636764160,"available":96332013568,"internally_reserved":0,"allocated":524288,"data_stored":233051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 10:01:29 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.143,"15min":1.143},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.677,"5min":1.677,"15min":1.677},"last":1.125},{"interface":"front","average":{"1min":1.161,"5min":1.161,"15min":1.161},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":1.345}]},{"osd":1,"last update":"Fri Dec 22 10:01:29 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.25,"15min":1.25},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.8899999999999999,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":1.1859999999999999},{"interface":"front","average":{"1min":1.337,"5min":1.337,"15min":1.337},"min":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":2.6819999999999999,"5min":2.6819999999999999,"15min":2.6819999999999999},"last":1.4119999999999999}]},{"osd":2,"last update":"Fri Dec 22 10:01:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":2.8490000000000002,"5min":2.8490000000000002,"15min":2.8490000000000002},"last":1.258},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.774,"5min":1.774,"15min":1.774},"last":1.0249999999999999}]},{"osd":3,"last update":"Fri Dec 22 10:01:29 2023","interfaces":[{"interface":"back","average":{"1min":1.321,"5min":1.321,"15min":1.321},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":2.3690000000000002,"5min":2.3690000000000002,"15min":2.3690000000000002},"last":1.325},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"min":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"max":{"1min":2.0899999999999999,"5min":2.0899999999999999,"15min":2.0899999999999999},"last":1.1120000000000001}]},{"osd":4,"last update":"Fri Dec 22 10:01:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.764,"5min":1.764,"15min":1.764},"last":1.0800000000000001},{"interface":"front","average":{"1min":1.278,"5min":1.278,"15min":1.278},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":2.2930000000000001,"5min":2.2930000000000001,"15min":2.2930000000000001},"last":1.1990000000000001}]},{"osd":5,"last update":"Fri Dec 22 10:01:29 2023","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.228,"15min":1.228},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.786,"5min":1.786,"15min":1.786},"last":1.2909999999999999},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":2.73,"5min":2.73,"15min":2.73},"last":1.23}]},{"osd":6,"last update":"Fri Dec 22 10:01:29 2023","interfaces":[{"interface":"back","average":{"1min":1.476,"5min":1.476,"15min":1.476},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":2.7690000000000001,"5min":2.7690000000000001,"15min":2.7690000000000001},"last":1.4630000000000001},{"interface":"front","average":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":2.8820000000000001,"5min":2.8820000000000001,"15min":2.8820000000000001},"last":1.3700000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574871,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297608,"kb_used_data":512,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074232,"statfs":{"total":96636764160,"available":96332013568,"internally_reserved":0,"allocated":524288,"data_stored":233051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.131,"15min":1.131},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":1.0700000000000001},{"interface":"front","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.617,"5min":1.617,"15min":1.617},"last":1.163}]},{"osd":1,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":0.94199999999999995},{"interface":"front","average":{"1min":1.085,"5min":1.085,"15min":1.085},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.657,"5min":1.657,"15min":1.657},"last":1.1839999999999999}]},{"osd":2,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.077,"15min":1.077},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":0.77800000000000002},{"interface":"front","average":{"1min":1.145,"5min":1.145,"15min":1.145},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.583,"5min":1.583,"15min":1.583},"last":1.0409999999999999}]},{"osd":3,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.262,"15min":1.262},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.995},{"interface":"front","average":{"1min":1.252,"5min":1.252,"15min":1.252},"min":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":1.6359999999999999,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":1.244}]},{"osd":4,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.282,"15min":1.282},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.7310000000000001,"5min":1.7310000000000001,"15min":1.7310000000000001},"last":1.272},{"interface":"front","average":{"1min":1.361,"5min":1.361,"15min":1.361},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":2.2280000000000002,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":1.321}]},{"osd":5,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"min":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":1.907,"5min":1.907,"15min":1.907},"last":1.1479999999999999},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":2.363,"5min":2.363,"15min":2.363},"last":1.343}]},{"osd":7,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"min":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"max":{"1min":2.1459999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.3919999999999999},{"interface":"front","average":{"1min":1.403,"5min":1.403,"15min":1.403},"min":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"max":{"1min":2.1779999999999999,"5min":2.1779999999999999,"15min":2.1779999999999999},"last":1.496}]}]},{"osd":5,"up_from":13,"seq":55834574871,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301704,"kb_used_data":4608,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94070136,"statfs":{"total":96636764160,"available":96327819264,"internally_reserved":0,"allocated":4718592,"data_stored":4427355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":1.4379999999999999},{"interface":"front","average":{"1min":1.123,"5min":1.123,"15min":1.123},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.6559999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":1.401}]},{"osd":1,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":1.1890000000000001},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":2.0070000000000001,"5min":2.0070000000000001,"15min":2.0070000000000001},"last":1.107}]},{"osd":2,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":1.214},{"interface":"front","average":{"1min":1.119,"5min":1.119,"15min":1.119},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.607,"5min":1.607,"15min":1.607},"last":1.3720000000000001}]},{"osd":3,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.133,"15min":1.133},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.80600000000000005},{"interface":"front","average":{"1min":1.179,"5min":1.179,"15min":1.179},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.488,"5min":1.488,"15min":1.488},"last":1.3140000000000001}]},{"osd":4,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.145,"15min":1.145},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":1.8779999999999999,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":1.1459999999999999},{"interface":"front","average":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"min":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":1.351}]},{"osd":6,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.242,"15min":1.242},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.7749999999999999,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":1.2789999999999999},{"interface":"front","average":{"1min":1.236,"5min":1.236,"15min":1.236},"min":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":1.0760000000000001}]},{"osd":7,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.236,"15min":1.236},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":1.516,"5min":1.516,"15min":1.516},"last":1.2589999999999999},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.8620000000000001,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":1.341}]}]},{"osd":4,"up_from":13,"seq":55834574871,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297608,"kb_used_data":512,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074232,"statfs":{"total":96636764160,"available":96332013568,"internally_reserved":0,"allocated":524288,"data_stored":233051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.149,"15min":1.149},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":1.1479999999999999},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"min":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.97499999999999998}]},{"osd":1,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":1.012,"15min":1.012},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":0.94199999999999995},{"interface":"front","average":{"1min":1.077,"5min":1.077,"15min":1.077},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":1.425}]},{"osd":2,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.641,"5min":1.641,"15min":1.641},"last":1.202},{"interface":"front","average":{"1min":1.272,"5min":1.272,"15min":1.272},"min":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"max":{"1min":1.8340000000000001,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":1.3260000000000001}]},{"osd":3,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.173,"15min":1.173},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":1.7490000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":1.232},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"min":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"max":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":1.381}]},{"osd":5,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":1.216,"15min":1.216},"min":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"max":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":1.4850000000000001},{"interface":"front","average":{"1min":1.173,"5min":1.173,"15min":1.173},"min":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":1.9350000000000001,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":1.3149999999999999}]},{"osd":6,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":1.869,"5min":1.869,"15min":1.869},"last":1.089},{"interface":"front","average":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"min":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"max":{"1min":1.9910000000000001,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":1.26}]},{"osd":7,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"min":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"max":{"1min":2.1960000000000002,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":1.361},{"interface":"front","average":{"1min":1.391,"5min":1.391,"15min":1.391},"min":{"1min":1.044,"5min":1.044,"15min":1.044},"max":{"1min":1.8680000000000001,"5min":1.8680000000000001,"15min":1.8680000000000001},"last":1.5029999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574871,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303752,"kb_used_data":6656,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94068088,"statfs":{"total":96636764160,"available":96325722112,"internally_reserved":0,"allocated":6815744,"data_stored":6524507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 10:01:25 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":1.145},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.60699999999999998}]},{"osd":1,"last update":"Fri Dec 22 10:01:25 2023","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":1.165},{"interface":"front","average":{"1min":1.109,"5min":1.109,"15min":1.109},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":1.385}]},{"osd":2,"last update":"Fri Dec 22 10:01:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":0.88900000000000001},{"interface":"front","average":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.702,"5min":1.702,"15min":1.702},"last":1.0549999999999999}]},{"osd":4,"last update":"Fri Dec 22 10:01:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.2,"15min":1.2},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":1.103},{"interface":"front","average":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":2.0619999999999998,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":1.038}]},{"osd":5,"last update":"Fri Dec 22 10:01:25 2023","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.333,"15min":1.333},"min":{"1min":0.878,"5min":0.878,"15min":0.878},"max":{"1min":1.9339999999999999,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":1.258},{"interface":"front","average":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"min":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"max":{"1min":2.1720000000000002,"5min":2.1720000000000002,"15min":2.1720000000000002},"last":1.3240000000000001}]},{"osd":6,"last update":"Fri Dec 22 10:01:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.8640000000000001,"5min":1.8640000000000001,"15min":1.8640000000000001},"last":1.266},{"interface":"front","average":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":2.2130000000000001,"5min":2.2130000000000001,"15min":2.2130000000000001},"last":1.3009999999999999}]},{"osd":7,"last update":"Fri Dec 22 10:01:25 2023","interfaces":[{"interface":"back","average":{"1min":1.405,"5min":1.405,"15min":1.405},"min":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"max":{"1min":2.1389999999999998,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":1.236},{"interface":"front","average":{"1min":1.431,"5min":1.431,"15min":1.431},"min":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":2.105,"5min":2.105,"15min":2.105},"last":1.212}]}]},{"osd":2,"up_from":13,"seq":55834574872,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297608,"kb_used_data":512,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074232,"statfs":{"total":96636764160,"available":96332013568,"internally_reserved":0,"allocated":524288,"data_stored":233051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":3.1589999999999998},{"interface":"front","average":{"1min":1.083,"5min":1.083,"15min":1.083},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":2.3039999999999998}]},{"osd":1,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.52,"5min":1.52,"15min":1.52},"last":3.194},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":2.3809999999999998,"5min":2.3809999999999998,"15min":2.3809999999999998},"last":3.0910000000000002}]},{"osd":3,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.698,"5min":1.698,"15min":1.698},"last":5.4059999999999997},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.788,"5min":1.788,"15min":1.788},"last":5.2789999999999999}]},{"osd":4,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.381,"15min":1.381},"min":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"max":{"1min":2.234,"5min":2.234,"15min":2.234},"last":2.2130000000000001},{"interface":"front","average":{"1min":1.296,"5min":1.296,"15min":1.296},"min":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"max":{"1min":2.1230000000000002,"5min":2.1230000000000002,"15min":2.1230000000000002},"last":2.004}]},{"osd":5,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"min":{"1min":1.109,"5min":1.109,"15min":1.109},"max":{"1min":2.0960000000000001,"5min":2.0960000000000001,"15min":2.0960000000000001},"last":2.5339999999999998},{"interface":"front","average":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"min":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"max":{"1min":1.9730000000000001,"5min":1.9730000000000001,"15min":1.9730000000000001},"last":2.2610000000000001}]},{"osd":6,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"min":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"max":{"1min":2.298,"5min":2.298,"15min":2.298},"last":1.95},{"interface":"front","average":{"1min":1.46,"5min":1.46,"15min":1.46},"min":{"1min":1.02,"5min":1.02,"15min":1.02},"max":{"1min":1.899,"5min":1.899,"15min":1.899},"last":3.1179999999999999}]},{"osd":7,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.458,"5min":1.458,"15min":1.458},"min":{"1min":1,"5min":1,"15min":1},"max":{"1min":2.0289999999999999,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":2.7269999999999999},{"interface":"front","average":{"1min":1.415,"5min":1.415,"15min":1.415},"min":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"max":{"1min":2.0179999999999998,"5min":2.0179999999999998,"15min":2.0179999999999998},"last":2.0419999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297608,"kb_used_data":512,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074232,"statfs":{"total":96636764160,"available":96332013568,"internally_reserved":0,"allocated":524288,"data_stored":233051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.90300000000000002}]},{"osd":2,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.96299999999999997},{"interface":"front","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":1.208}]},{"osd":3,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":1.4379999999999999},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":1.151}]},{"osd":4,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":1.175},{"interface":"front","average":{"1min":1.236,"5min":1.236,"15min":1.236},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":2.0710000000000002,"5min":2.0710000000000002,"15min":2.0710000000000002},"last":1.321}]},{"osd":5,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"min":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"max":{"1min":1.8129999999999999,"5min":1.8129999999999999,"15min":1.8129999999999999},"last":1.246},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"min":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"max":{"1min":1.881,"5min":1.881,"15min":1.881},"last":1.288}]},{"osd":6,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"min":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"max":{"1min":1.8779999999999999,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":1.3149999999999999},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"min":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":1.946,"5min":1.946,"15min":1.946},"last":1.3959999999999999}]},{"osd":7,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"min":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"max":{"1min":1.9279999999999999,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":1.496},{"interface":"front","average":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"min":{"1min":1.03,"5min":1.03,"15min":1.03},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":1.3720000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574871,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299656,"kb_used_data":2560,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94072184,"statfs":{"total":96636764160,"available":96329916416,"internally_reserved":0,"allocated":2621440,"data_stored":2330203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":2.7250000000000001,"5min":2.7250000000000001,"15min":2.7250000000000001},"last":0.98599999999999999},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.76000000000000001}]},{"osd":2,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":2.7799999999999998,"5min":2.7799999999999998,"15min":2.7799999999999998},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.877}]},{"osd":3,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":2.919,"5min":2.919,"15min":2.919},"last":1.1279999999999999},{"interface":"front","average":{"1min":1.248,"5min":1.248,"15min":1.248},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":2.8959999999999999,"5min":2.8959999999999999,"15min":2.8959999999999999},"last":1.276}]},{"osd":4,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":1.248},{"interface":"front","average":{"1min":1.292,"5min":1.292,"15min":1.292},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":3.1280000000000001,"5min":3.1280000000000001,"15min":3.1280000000000001},"last":1.2130000000000001}]},{"osd":5,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"min":{"1min":0.87,"5min":0.87,"15min":0.87},"max":{"1min":3.0760000000000001,"5min":3.0760000000000001,"15min":3.0760000000000001},"last":1.2649999999999999},{"interface":"front","average":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":2.512,"5min":2.512,"15min":2.512},"last":1.3660000000000001}]},{"osd":6,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.5,"5min":1.5,"15min":1.5},"min":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"max":{"1min":2.8199999999999998,"5min":2.8199999999999998,"15min":2.8199999999999998},"last":1.5129999999999999},{"interface":"front","average":{"1min":1.51,"5min":1.51,"15min":1.51},"min":{"1min":1.032,"5min":1.032,"15min":1.032},"max":{"1min":4.6029999999999998,"5min":4.6029999999999998,"15min":4.6029999999999998},"last":1.496}]},{"osd":7,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.417,"5min":1.417,"15min":1.417},"min":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"max":{"1min":2.0190000000000001,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":1.3959999999999999},{"interface":"front","average":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"min":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"max":{"1min":3.6339999999999999,"5min":3.6339999999999999,"15min":3.6339999999999999},"last":1.3129999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-22T10:02:15.495 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-22T10:02:15.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.651+0000 7f3344f46700 1 Processor -- start 2023-12-22T10:02:15.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.655+0000 7f3344f46700 1 -- start start 2023-12-22T10:02:15.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.655+0000 7f3344f46700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3340152d50 0x7f3340151bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:15.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.655+0000 7f3344f46700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3340155620 con 0x7f3340066a70 2023-12-22T10:02:15.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.655+0000 7f3344f46700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33401561a0 con 0x7f33401517e0 2023-12-22T10:02:15.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.655+0000 7f3344f46700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3340156630 con 0x7f3340152d50 2023-12-22T10:02:15.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.655+0000 7f333dd9b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3340152d50 0x7f3340151bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:15.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.655+0000 7f333ed9d700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f3340066a70 0x7f3340064d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:54696/0 (socket says 172.21.15.45:54696) 2023-12-22T10:02:15.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.655+0000 7f333dd9b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3340152d50 0x7f3340151bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42966/0 (socket says 172.21.15.45:42966) 2023-12-22T10:02:15.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.655+0000 7f333ed9d700 1 -- 172.21.15.45:0/3494214722 learned_addr learned my addr 172.21.15.45:0/3494214722 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:02:15.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.655+0000 7f333dd9b700 1 -- 172.21.15.45:0/3494214722 >> v1:172.21.15.113:6789/0 conn(0x7f33401517e0 legacy=0x7f33400c72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:15.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.655+0000 7f333dd9b700 1 -- 172.21.15.45:0/3494214722 >> v1:172.21.15.45:6789/0 conn(0x7f3340066a70 legacy=0x7f3340064d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:15.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.655+0000 7f333dd9b700 1 -- 172.21.15.45:0/3494214722 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3340155870 con 0x7f3340152d50 2023-12-22T10:02:15.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.655+0000 7f333d59a700 1 -- 172.21.15.45:0/3494214722 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2603038113 0 0) 0x7f3340155620 con 0x7f3340066a70 2023-12-22T10:02:15.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.655+0000 7f333dd9b700 1 --2- 172.21.15.45:0/3494214722 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3340152d50 0x7f3340151bc0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 rx=0x7f3334009760 tx=0x7f3334009060).ready entity=mon.0 client_cookie=a4d144b5baa97337 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:15.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.659+0000 7f333d59a700 1 -- 172.21.15.45:0/3494214722 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f333400b580 con 0x7f3340152d50 2023-12-22T10:02:15.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.659+0000 7f333d59a700 1 -- 172.21.15.45:0/3494214722 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f333400b6e0 con 0x7f3340152d50 2023-12-22T10:02:15.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.659+0000 7f333d59a700 1 -- 172.21.15.45:0/3494214722 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f333400ba60 con 0x7f3340152d50 2023-12-22T10:02:15.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.659+0000 7f3344f46700 1 -- 172.21.15.45:0/3494214722 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3340152d50 msgr2=0x7f3340151bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:15.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.659+0000 7f3344f46700 1 --2- 172.21.15.45:0/3494214722 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3340152d50 0x7f3340151bc0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 rx=0x7f3334009760 tx=0x7f3334009060).stop 2023-12-22T10:02:15.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.659+0000 7f3344f46700 1 -- 172.21.15.45:0/3494214722 shutdown_connections 2023-12-22T10:02:15.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.659+0000 7f3344f46700 1 --2- 172.21.15.45:0/3494214722 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3340152d50 0x7f3340151bc0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:15.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.659+0000 7f3344f46700 1 -- 172.21.15.45:0/3494214722 >> 172.21.15.45:0/3494214722 conn(0x7f33400635a0 msgr2=0x7f33400c6bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:02:15.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.659+0000 7f3344f46700 1 -- 172.21.15.45:0/3494214722 shutdown_connections 2023-12-22T10:02:15.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.659+0000 7f3344f46700 1 -- 172.21.15.45:0/3494214722 wait complete. 2023-12-22T10:02:15.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.663+0000 7f3344f46700 1 Processor -- start 2023-12-22T10:02:15.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.663+0000 7f3344f46700 1 -- start start 2023-12-22T10:02:15.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.663+0000 7f3344f46700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3340066a70 0x7f33400be880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:15.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.663+0000 7f3344f46700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f33401517e0 0x7f33400c03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:15.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.663+0000 7f3344f46700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3340152d50 0x7f33400a7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:15.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.663+0000 7f3344f46700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33400c1500 con 0x7f3340066a70 2023-12-22T10:02:15.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.663+0000 7f3344f46700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33401657b0 con 0x7f3340152d50 2023-12-22T10:02:15.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.663+0000 7f3344f46700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33400be3f0 con 0x7f33401517e0 2023-12-22T10:02:15.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.663+0000 7f333e59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3340066a70 0x7f33400be880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:15.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.663+0000 7f333e59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3340066a70 0x7f33400be880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42974/0 (socket says 172.21.15.45:42974) 2023-12-22T10:02:15.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.663+0000 7f333e59c700 1 -- 172.21.15.45:0/3368591152 learned_addr learned my addr 172.21.15.45:0/3368591152 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:02:15.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.663+0000 7f333dd9b700 1 --2- 172.21.15.45:0/3368591152 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f33401517e0 0x7f33400c03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:15.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.663+0000 7f333ed9d700 1 --2- 172.21.15.45:0/3368591152 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3340152d50 0x7f33400a7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:15.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.663+0000 7f333e59c700 1 -- 172.21.15.45:0/3368591152 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f33401517e0 msgr2=0x7f33400c03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:15.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.663+0000 7f333e59c700 1 --2- 172.21.15.45:0/3368591152 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f33401517e0 0x7f33400c03f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:15.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.663+0000 7f333e59c700 1 -- 172.21.15.45:0/3368591152 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3340152d50 msgr2=0x7f33400a7ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:15.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.663+0000 7f333e59c700 1 --2- 172.21.15.45:0/3368591152 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3340152d50 0x7f33400a7ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:15.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.663+0000 7f333e59c700 1 -- 172.21.15.45:0/3368591152 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33340092a0 con 0x7f3340066a70 2023-12-22T10:02:15.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.663+0000 7f333ed9d700 1 --2- 172.21.15.45:0/3368591152 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3340152d50 0x7f33400a7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-12-22T10:02:15.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.663+0000 7f333e59c700 1 --2- 172.21.15.45:0/3368591152 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3340066a70 0x7f33400be880 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 rx=0x7f333000c4f0 tx=0x7f3330007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:15.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.663+0000 7f332e7fc700 1 -- 172.21.15.45:0/3368591152 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3330007020 con 0x7f3340066a70 2023-12-22T10:02:15.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.663+0000 7f332e7fc700 1 -- 172.21.15.45:0/3368591152 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3330001e90 con 0x7f3340066a70 2023-12-22T10:02:15.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.663+0000 7f3344f46700 1 -- 172.21.15.45:0/3368591152 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33401654d0 con 0x7f3340066a70 2023-12-22T10:02:15.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.663+0000 7f332e7fc700 1 -- 172.21.15.45:0/3368591152 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33300073b0 con 0x7f3340066a70 2023-12-22T10:02:15.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.663+0000 7f3344f46700 1 -- 172.21.15.45:0/3368591152 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33400be080 con 0x7f3340066a70 2023-12-22T10:02:15.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.667+0000 7f3344f46700 1 -- 172.21.15.45:0/3368591152 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f334006c070 con 0x7f3340066a70 2023-12-22T10:02:15.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.667+0000 7f332e7fc700 1 -- 172.21.15.45:0/3368591152 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f33300068b0 con 0x7f3340066a70 2023-12-22T10:02:15.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.671+0000 7f332e7fc700 1 --2- 172.21.15.45:0/3368591152 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f332005a510 0x7f332005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:15.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.671+0000 7f332e7fc700 1 -- 172.21.15.45:0/3368591152 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f3330073f30 con 0x7f3340066a70 2023-12-22T10:02:15.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.671+0000 7f333dd9b700 1 --2- 172.21.15.45:0/3368591152 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f332005a510 0x7f332005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:15.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.671+0000 7f333dd9b700 1 --2- 172.21.15.45:0/3368591152 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f332005a510 0x7f332005c9d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f3334009760 tx=0x7f3334017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:15.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.675+0000 7f332e7fc700 1 -- 172.21.15.45:0/3368591152 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f3330047950 con 0x7f3340066a70 2023-12-22T10:02:15.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.847+0000 7f3344f46700 1 -- 172.21.15.45:0/3368591152 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f33400c6280 con 0x7f3340066a70 2023-12-22T10:02:15.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.847+0000 7f332e7fc700 1 -- 172.21.15.45:0/3368591152 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+13841 (secure 0 0 0) 0x7f333004af70 con 0x7f3340066a70 2023-12-22T10:02:15.848 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:02:15.848 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":47,"fsid":"98b0837e-5e68-4c8f-a1a0-e9424baaad8f","created":"2023-12-22T10:00:15.010174+0000","modified":"2023-12-22T10:02:11.914167+0000","last_up_change":"2023-12-22T10:00:24.980513+0000","last_in_change":"2023-12-22T10:00:17.887172+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-12-22T10:00:25.069641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-12-22T10:00:26.906399+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"e19943a0-1c6b-47df-b6bb-383472077890","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":33777},{"type":"v1","addr":"172.21.15.45:6819","nonce":33777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":33777},{"type":"v1","addr":"172.21.15.45:6822","nonce":33777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":33777},{"type":"v1","addr":"172.21.15.45:6830","nonce":33777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":33777},{"type":"v1","addr":"172.21.15.45:6826","nonce":33777}]},"public_addr":"172.21.15.45:6819/33777","cluster_addr":"172.21.15.45:6822/33777","heartbeat_back_addr":"172.21.15.45:6830/33777","heartbeat_front_addr":"172.21.15.45:6826/33777","state":["exists","up"]},{"osd":1,"uuid":"69670f34-f082-45a7-8f67-e962acc136e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":33775},{"type":"v1","addr":"172.21.15.45:6809","nonce":33775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":33775},{"type":"v1","addr":"172.21.15.45:6811","nonce":33775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":33775},{"type":"v1","addr":"172.21.15.45:6815","nonce":33775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":33775},{"type":"v1","addr":"172.21.15.45:6813","nonce":33775}]},"public_addr":"172.21.15.45:6809/33775","cluster_addr":"172.21.15.45:6811/33775","heartbeat_back_addr":"172.21.15.45:6815/33775","heartbeat_front_addr":"172.21.15.45:6813/33775","state":["exists","up"]},{"osd":2,"uuid":"d909d49b-82b8-401b-9947-e49dd167bb95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":33776},{"type":"v1","addr":"172.21.15.45:6801","nonce":33776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":33776},{"type":"v1","addr":"172.21.15.45:6803","nonce":33776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":33776},{"type":"v1","addr":"172.21.15.45:6807","nonce":33776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":33776},{"type":"v1","addr":"172.21.15.45:6805","nonce":33776}]},"public_addr":"172.21.15.45:6801/33776","cluster_addr":"172.21.15.45:6803/33776","heartbeat_back_addr":"172.21.15.45:6807/33776","heartbeat_front_addr":"172.21.15.45:6805/33776","state":["exists","up"]},{"osd":3,"uuid":"db104ca9-3a94-4d39-a2be-bd06db888095","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":33782},{"type":"v1","addr":"172.21.15.45:6817","nonce":33782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":33782},{"type":"v1","addr":"172.21.15.45:6823","nonce":33782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6829","nonce":33782},{"type":"v1","addr":"172.21.15.45:6831","nonce":33782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6825","nonce":33782},{"type":"v1","addr":"172.21.15.45:6827","nonce":33782}]},"public_addr":"172.21.15.45:6817/33782","cluster_addr":"172.21.15.45:6823/33782","heartbeat_back_addr":"172.21.15.45:6831/33782","heartbeat_front_addr":"172.21.15.45:6827/33782","state":["exists","up"]},{"osd":4,"uuid":"9f4eaff4-e433-4479-a0d1-ee7a33375ca6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6809","nonce":34099},{"type":"v1","addr":"172.21.15.113:6811","nonce":34099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6813","nonce":34099},{"type":"v1","addr":"172.21.15.113:6815","nonce":34099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6820","nonce":34099},{"type":"v1","addr":"172.21.15.113:6823","nonce":34099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6816","nonce":34099},{"type":"v1","addr":"172.21.15.113:6818","nonce":34099}]},"public_addr":"172.21.15.113:6811/34099","cluster_addr":"172.21.15.113:6815/34099","heartbeat_back_addr":"172.21.15.113:6823/34099","heartbeat_front_addr":"172.21.15.113:6818/34099","state":["exists","up"]},{"osd":5,"uuid":"1efc5591-180b-43af-8611-0068aadc5aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6800","nonce":34100},{"type":"v1","addr":"172.21.15.113:6801","nonce":34100}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6802","nonce":34100},{"type":"v1","addr":"172.21.15.113:6803","nonce":34100}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6806","nonce":34100},{"type":"v1","addr":"172.21.15.113:6807","nonce":34100}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6804","nonce":34100},{"type":"v1","addr":"172.21.15.113:6805","nonce":34100}]},"public_addr":"172.21.15.113:6801/34100","cluster_addr":"172.21.15.113:6803/34100","heartbeat_back_addr":"172.21.15.113:6807/34100","heartbeat_front_addr":"172.21.15.113:6805/34100","state":["exists","up"]},{"osd":6,"uuid":"6c89d9d8-c153-4a48-afa9-97e4c403f1ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6808","nonce":34101},{"type":"v1","addr":"172.21.15.113:6810","nonce":34101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6812","nonce":34101},{"type":"v1","addr":"172.21.15.113:6814","nonce":34101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6822","nonce":34101},{"type":"v1","addr":"172.21.15.113:6824","nonce":34101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6817","nonce":34101},{"type":"v1","addr":"172.21.15.113:6819","nonce":34101}]},"public_addr":"172.21.15.113:6810/34101","cluster_addr":"172.21.15.113:6814/34101","heartbeat_back_addr":"172.21.15.113:6824/34101","heartbeat_front_addr":"172.21.15.113:6819/34101","state":["exists","up"]},{"osd":7,"uuid":"1855e70c-23f6-4c08-ad7f-774c2148235b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6821","nonce":34102},{"type":"v1","addr":"172.21.15.113:6825","nonce":34102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6826","nonce":34102},{"type":"v1","addr":"172.21.15.113:6827","nonce":34102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6830","nonce":34102},{"type":"v1","addr":"172.21.15.113:6831","nonce":34102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6828","nonce":34102},{"type":"v1","addr":"172.21.15.113:6829","nonce":34102}]},"public_addr":"172.21.15.113:6825/34102","cluster_addr":"172.21.15.113:6827/34102","heartbeat_back_addr":"172.21.15.113:6831/34102","heartbeat_front_addr":"172.21.15.113:6829/34102","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.812672+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.825045+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.700105+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.856563+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.954683+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.883234+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.883994+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-22T10:00:23.821686+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.45:6835/1879154206":"2023-12-23T10:01:45.243059+0000","172.21.15.45:6834/1879154206":"2023-12-23T10:01:45.243059+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-22T10:02:15.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.851+0000 7f3344f46700 1 -- 172.21.15.45:0/3368591152 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f332005a510 msgr2=0x7f332005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:15.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.851+0000 7f3344f46700 1 --2- 172.21.15.45:0/3368591152 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f332005a510 0x7f332005c9d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f3334009760 tx=0x7f3334017000).stop 2023-12-22T10:02:15.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.851+0000 7f3344f46700 1 -- 172.21.15.45:0/3368591152 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3340066a70 msgr2=0x7f33400be880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:15.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.851+0000 7f3344f46700 1 --2- 172.21.15.45:0/3368591152 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3340066a70 0x7f33400be880 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 rx=0x7f333000c4f0 tx=0x7f3330007e00).stop 2023-12-22T10:02:15.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.851+0000 7f3344f46700 1 -- 172.21.15.45:0/3368591152 shutdown_connections 2023-12-22T10:02:15.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.851+0000 7f3344f46700 1 --2- 172.21.15.45:0/3368591152 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f3340152d50 0x7f33400a7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:15.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.851+0000 7f3344f46700 1 --2- 172.21.15.45:0/3368591152 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f332005a510 0x7f332005c9d0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:15.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.851+0000 7f3344f46700 1 --2- 172.21.15.45:0/3368591152 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f33401517e0 0x7f33400c03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:15.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.851+0000 7f3344f46700 1 --2- 172.21.15.45:0/3368591152 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3340066a70 0x7f33400be880 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:15.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.851+0000 7f3344f46700 1 -- 172.21.15.45:0/3368591152 >> 172.21.15.45:0/3368591152 conn(0x7f33400635a0 msgr2=0x7f33400c7260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:02:15.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.851+0000 7f3344f46700 1 -- 172.21.15.45:0/3368591152 shutdown_connections 2023-12-22T10:02:15.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:15.851+0000 7f3344f46700 1 -- 172.21.15.45:0/3368591152 wait complete. 2023-12-22T10:02:16.870 INFO:tasks.ceph:Scrubbing osd.0 2023-12-22T10:02:16.871 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-12-22T10:02:17.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.043+0000 7f0b56db9700 1 Processor -- start 2023-12-22T10:02:17.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.043+0000 7f0b56db9700 1 -- start start 2023-12-22T10:02:17.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.043+0000 7f0b56db9700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f0b50065890 0x7f0b500c4c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:17.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.047+0000 7f0b56db9700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0b500c5110 0x7f0b500c1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:17.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.047+0000 7f0b56db9700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b500c55a0 con 0x7f0b500a8ba0 2023-12-22T10:02:17.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.047+0000 7f0b56db9700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b500c11e0 con 0x7f0b500c5110 2023-12-22T10:02:17.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.047+0000 7f0b56db9700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b501594c0 con 0x7f0b50065890 2023-12-22T10:02:17.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.047+0000 7f0b565b8700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0b500c5110 0x7f0b500c1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:17.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.047+0000 7f0b565b8700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0b500c5110 0x7f0b500c1bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42984/0 (socket says 172.21.15.45:42984) 2023-12-22T10:02:17.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.047+0000 7f0b565b8700 1 -- 172.21.15.45:0/1501662613 learned_addr learned my addr 172.21.15.45:0/1501662613 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:02:17.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.047+0000 7f0b555b6700 1 --2- 172.21.15.45:0/1501662613 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f0b50065890 0x7f0b500c4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:17.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.047+0000 7f0b55db7700 1 --1- 172.21.15.45:0/1501662613 >> v1:172.21.15.113:6789/0 conn(0x7f0b500a8ba0 0x7f0b501584a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.45:36930/0 (socket says 172.21.15.45:36930) 2023-12-22T10:02:17.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.047+0000 7f0b555b6700 1 -- 172.21.15.45:0/1501662613 >> v2:172.21.15.45:3300/0 conn(0x7f0b500c5110 msgr2=0x7f0b500c1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:02:17.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.047+0000 7f0b555b6700 1 --2- 172.21.15.45:0/1501662613 >> v2:172.21.15.45:3300/0 conn(0x7f0b500c5110 0x7f0b500c1bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:17.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.047+0000 7f0b555b6700 1 -- 172.21.15.45:0/1501662613 >> v1:172.21.15.113:6789/0 conn(0x7f0b500a8ba0 legacy=0x7f0b501584a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:17.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.047+0000 7f0b555b6700 1 -- 172.21.15.45:0/1501662613 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b50068aa0 con 0x7f0b50065890 2023-12-22T10:02:17.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.047+0000 7f0b54db5700 1 -- 172.21.15.45:0/1501662613 <== mon.1 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 875390159 0 0) 0x7f0b500c55a0 con 0x7f0b500a8ba0 2023-12-22T10:02:17.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.047+0000 7f0b565b8700 1 --2- 172.21.15.45:0/1501662613 >> v2:172.21.15.45:3300/0 conn(0x7f0b500c5110 0x7f0b500c1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-12-22T10:02:17.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.047+0000 7f0b555b6700 1 --2- 172.21.15.45:0/1501662613 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f0b50065890 0x7f0b500c4c20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f0b40009760 tx=0x7f0b40009060).ready entity=mon.2 client_cookie=fd603f39fe30cacd server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:17.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.047+0000 7f0b54db5700 1 -- 172.21.15.45:0/1501662613 <== mon.2 v2:172.21.15.113:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b4000f510 con 0x7f0b50065890 2023-12-22T10:02:17.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.047+0000 7f0b54db5700 1 -- 172.21.15.45:0/1501662613 <== mon.2 v2:172.21.15.113:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b4000f670 con 0x7f0b50065890 2023-12-22T10:02:17.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.047+0000 7f0b54db5700 1 -- 172.21.15.45:0/1501662613 <== mon.2 v2:172.21.15.113:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b4000f9f0 con 0x7f0b50065890 2023-12-22T10:02:17.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.051+0000 7f0b56db9700 1 -- 172.21.15.45:0/1501662613 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f0b50065890 msgr2=0x7f0b500c4c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:17.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.051+0000 7f0b56db9700 1 --2- 172.21.15.45:0/1501662613 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f0b50065890 0x7f0b500c4c20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f0b40009760 tx=0x7f0b40009060).stop 2023-12-22T10:02:17.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.051+0000 7f0b56db9700 1 -- 172.21.15.45:0/1501662613 shutdown_connections 2023-12-22T10:02:17.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.051+0000 7f0b56db9700 1 --2- 172.21.15.45:0/1501662613 >> v2:172.21.15.45:3300/0 conn(0x7f0b500c5110 0x7f0b500c1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:17.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.051+0000 7f0b56db9700 1 --2- 172.21.15.45:0/1501662613 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f0b50065890 0x7f0b500c4c20 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:17.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.051+0000 7f0b56db9700 1 -- 172.21.15.45:0/1501662613 >> 172.21.15.45:0/1501662613 conn(0x7f0b50067500 msgr2=0x7f0b500c6440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:02:17.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.051+0000 7f0b56db9700 1 -- 172.21.15.45:0/1501662613 shutdown_connections 2023-12-22T10:02:17.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.051+0000 7f0b56db9700 1 -- 172.21.15.45:0/1501662613 wait complete. 2023-12-22T10:02:17.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.051+0000 7f0b56db9700 1 Processor -- start 2023-12-22T10:02:17.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.051+0000 7f0b56db9700 1 -- start start 2023-12-22T10:02:17.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.051+0000 7f0b56db9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b50065890 0x7f0b5014f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:17.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.051+0000 7f0b56db9700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0b500a8ba0 0x7f0b50152df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:17.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.051+0000 7f0b56db9700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f0b500c5110 0x7f0b501532e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:17.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.051+0000 7f0b56db9700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b501537d0 con 0x7f0b50065890 2023-12-22T10:02:17.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.051+0000 7f0b56db9700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b50169120 con 0x7f0b500a8ba0 2023-12-22T10:02:17.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.051+0000 7f0b56db9700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b501687f0 con 0x7f0b500c5110 2023-12-22T10:02:17.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.055+0000 7f0b55db7700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b50065890 0x7f0b5014f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:17.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.055+0000 7f0b55db7700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b50065890 0x7f0b5014f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43000/0 (socket says 172.21.15.45:43000) 2023-12-22T10:02:17.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.055+0000 7f0b55db7700 1 -- 172.21.15.45:0/4178199989 learned_addr learned my addr 172.21.15.45:0/4178199989 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:02:17.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.055+0000 7f0b555b6700 1 --2- 172.21.15.45:0/4178199989 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0b500a8ba0 0x7f0b50152df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:17.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.055+0000 7f0b565b8700 1 --2- 172.21.15.45:0/4178199989 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f0b500c5110 0x7f0b501532e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:17.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.055+0000 7f0b55db7700 1 -- 172.21.15.45:0/4178199989 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f0b500c5110 msgr2=0x7f0b501532e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:17.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.055+0000 7f0b55db7700 1 --2- 172.21.15.45:0/4178199989 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f0b500c5110 0x7f0b501532e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:17.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.055+0000 7f0b55db7700 1 -- 172.21.15.45:0/4178199989 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0b500a8ba0 msgr2=0x7f0b50152df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:17.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.055+0000 7f0b55db7700 1 --2- 172.21.15.45:0/4178199989 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0b500a8ba0 0x7f0b50152df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:17.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.055+0000 7f0b55db7700 1 -- 172.21.15.45:0/4178199989 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b48009ae0 con 0x7f0b50065890 2023-12-22T10:02:17.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.055+0000 7f0b55db7700 1 --2- 172.21.15.45:0/4178199989 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b50065890 0x7f0b5014f840 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 rx=0x7f0b4c00c560 tx=0x7f0b4c007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:17.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.055+0000 7f0b45ffb700 1 -- 172.21.15.45:0/4178199989 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b4c0072e0 con 0x7f0b50065890 2023-12-22T10:02:17.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.055+0000 7f0b45ffb700 1 -- 172.21.15.45:0/4178199989 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b4c007440 con 0x7f0b50065890 2023-12-22T10:02:17.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.055+0000 7f0b56db9700 1 -- 172.21.15.45:0/4178199989 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b400092a0 con 0x7f0b50065890 2023-12-22T10:02:17.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.055+0000 7f0b45ffb700 1 -- 172.21.15.45:0/4178199989 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b4c0058f0 con 0x7f0b50065890 2023-12-22T10:02:17.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.055+0000 7f0b56db9700 1 -- 172.21.15.45:0/4178199989 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b50168db0 con 0x7f0b50065890 2023-12-22T10:02:17.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.055+0000 7f0b56db9700 1 -- 172.21.15.45:0/4178199989 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0b50158130 con 0x7f0b50065890 2023-12-22T10:02:17.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.059+0000 7f0b45ffb700 1 -- 172.21.15.45:0/4178199989 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f0b4c005ce0 con 0x7f0b50065890 2023-12-22T10:02:17.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.059+0000 7f0b45ffb700 1 --2- 172.21.15.45:0/4178199989 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f0b3405a510 0x7f0b3405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:17.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.059+0000 7f0b45ffb700 1 -- 172.21.15.45:0/4178199989 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f0b4c073db0 con 0x7f0b50065890 2023-12-22T10:02:17.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.059+0000 7f0b555b6700 1 --2- 172.21.15.45:0/4178199989 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f0b3405a510 0x7f0b3405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:17.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.059+0000 7f0b45ffb700 1 --2- 172.21.15.45:0/4178199989 >> [v2:172.21.15.45:6818/33777,v1:172.21.15.45:6819/33777] conn(0x7f0b34060b00 0x7f0b34062f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:17.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.059+0000 7f0b45ffb700 1 -- 172.21.15.45:0/4178199989 --> [v2:172.21.15.45:6818/33777,v1:172.21.15.45:6819/33777] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0b340635e0 con 0x7f0b34060b00 2023-12-22T10:02:17.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.059+0000 7f0b45ffb700 1 -- 172.21.15.45:0/4178199989 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0b4c076310 con 0x7f0b50065890 2023-12-22T10:02:17.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.059+0000 7f0b555b6700 1 --2- 172.21.15.45:0/4178199989 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f0b3405a510 0x7f0b3405c9d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f0b40009fd0 tx=0x7f0b40017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:17.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.059+0000 7f0b565b8700 1 --2- 172.21.15.45:0/4178199989 >> [v2:172.21.15.45:6818/33777,v1:172.21.15.45:6819/33777] conn(0x7f0b34060b00 0x7f0b34062f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:17.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.063+0000 7f0b565b8700 1 --2- 172.21.15.45:0/4178199989 >> [v2:172.21.15.45:6818/33777,v1:172.21.15.45:6819/33777] conn(0x7f0b34060b00 0x7f0b34062f60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:17.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.063+0000 7f0b45ffb700 1 -- 172.21.15.45:0/4178199989 <== osd.0 v2:172.21.15.45:6818/33777 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7f0b340635e0 con 0x7f0b34060b00 2023-12-22T10:02:17.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.083+0000 7f0b56db9700 1 -- 172.21.15.45:0/4178199989 --> [v2:172.21.15.45:6818/33777,v1:172.21.15.45:6819/33777] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f0b50047060 con 0x7f0b34060b00 2023-12-22T10:02:17.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.083+0000 7f0b45ffb700 1 -- 172.21.15.45:0/4178199989 <== osd.0 v2:172.21.15.45:6818/33777 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f0b50047060 con 0x7f0b34060b00 2023-12-22T10:02:17.083 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-22T10:02:17.083 INFO:teuthology.orchestra.run.smithi045.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-12-22T10:02:17.083 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-22T10:02:17.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.083+0000 7f0b56db9700 1 -- 172.21.15.45:0/4178199989 >> [v2:172.21.15.45:6818/33777,v1:172.21.15.45:6819/33777] conn(0x7f0b34060b00 msgr2=0x7f0b34062f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:17.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.083+0000 7f0b56db9700 1 --2- 172.21.15.45:0/4178199989 >> [v2:172.21.15.45:6818/33777,v1:172.21.15.45:6819/33777] conn(0x7f0b34060b00 0x7f0b34062f60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:17.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.083+0000 7f0b56db9700 1 -- 172.21.15.45:0/4178199989 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f0b3405a510 msgr2=0x7f0b3405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:17.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.083+0000 7f0b56db9700 1 --2- 172.21.15.45:0/4178199989 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f0b3405a510 0x7f0b3405c9d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f0b40009fd0 tx=0x7f0b40017000).stop 2023-12-22T10:02:17.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.083+0000 7f0b56db9700 1 -- 172.21.15.45:0/4178199989 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b50065890 msgr2=0x7f0b5014f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:17.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.083+0000 7f0b56db9700 1 --2- 172.21.15.45:0/4178199989 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b50065890 0x7f0b5014f840 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 rx=0x7f0b4c00c560 tx=0x7f0b4c007c90).stop 2023-12-22T10:02:17.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.083+0000 7f0b565b8700 1 -- 172.21.15.45:0/4178199989 reap_dead start 2023-12-22T10:02:17.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.083+0000 7f0b56db9700 1 -- 172.21.15.45:0/4178199989 shutdown_connections 2023-12-22T10:02:17.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.083+0000 7f0b56db9700 1 -- 172.21.15.45:0/4178199989 >> 172.21.15.45:0/4178199989 conn(0x7f0b50067500 msgr2=0x7f0b500c2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:02:17.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.083+0000 7f0b56db9700 1 -- 172.21.15.45:0/4178199989 shutdown_connections 2023-12-22T10:02:17.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.083+0000 7f0b56db9700 1 -- 172.21.15.45:0/4178199989 wait complete. 2023-12-22T10:02:17.105 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-12-22T10:02:17.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.287+0000 7f6874af1700 1 Processor -- start 2023-12-22T10:02:17.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.287+0000 7f6874af1700 1 -- start start 2023-12-22T10:02:17.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.291+0000 7f6874af1700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f68700c5710 0x7f68700c3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:17.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.291+0000 7f6874af1700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f68700672c0 0x7f68700be1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:17.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.291+0000 7f6874af1700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68700c4c40 con 0x7f68700be6a0 2023-12-22T10:02:17.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.291+0000 7f6874af1700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6870151f20 con 0x7f68700c5710 2023-12-22T10:02:17.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.291+0000 7f6874af1700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68700beaf0 con 0x7f68700672c0 2023-12-22T10:02:17.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.291+0000 7f686e59c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f68700c5710 0x7f68700c3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:17.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.291+0000 7f6867fff700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f68700672c0 0x7f68700be1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:17.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.291+0000 7f686e59c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f68700c5710 0x7f68700c3750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43014/0 (socket says 172.21.15.45:43014) 2023-12-22T10:02:17.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.291+0000 7f686e59c700 1 -- 172.21.15.45:0/1311230021 learned_addr learned my addr 172.21.15.45:0/1311230021 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:02:17.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.291+0000 7f686ed9d700 1 --1- 172.21.15.45:0/1311230021 >> v1:172.21.15.113:6789/0 conn(0x7f68700be6a0 0x7f6870155560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.45:36932/0 (socket says 172.21.15.45:36932) 2023-12-22T10:02:17.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.291+0000 7f686e59c700 1 -- 172.21.15.45:0/1311230021 >> v2:172.21.15.113:3300/0 conn(0x7f68700672c0 msgr2=0x7f68700be1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:02:17.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.291+0000 7f686e59c700 1 --2- 172.21.15.45:0/1311230021 >> v2:172.21.15.113:3300/0 conn(0x7f68700672c0 0x7f68700be1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:17.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.291+0000 7f686e59c700 1 -- 172.21.15.45:0/1311230021 >> v1:172.21.15.113:6789/0 conn(0x7f68700be6a0 legacy=0x7f6870155560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:17.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.291+0000 7f686e59c700 1 -- 172.21.15.45:0/1311230021 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68700c4030 con 0x7f68700c5710 2023-12-22T10:02:17.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.291+0000 7f686e59c700 1 --2- 172.21.15.45:0/1311230021 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68700c5710 0x7f68700c3750 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7f68700661e0 tx=0x7f68600090f0).ready entity=mon.0 client_cookie=b553be6d44a9db57 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:17.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.291+0000 7f686dd9b700 1 -- 172.21.15.45:0/1311230021 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f686000b520 con 0x7f68700c5710 2023-12-22T10:02:17.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.291+0000 7f686dd9b700 1 -- 172.21.15.45:0/1311230021 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f686000b680 con 0x7f68700c5710 2023-12-22T10:02:17.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.291+0000 7f686dd9b700 1 -- 172.21.15.45:0/1311230021 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f686000ba00 con 0x7f68700c5710 2023-12-22T10:02:17.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.295+0000 7f6874af1700 1 -- 172.21.15.45:0/1311230021 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68700c5710 msgr2=0x7f68700c3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:17.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.295+0000 7f6874af1700 1 --2- 172.21.15.45:0/1311230021 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68700c5710 0x7f68700c3750 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7f68700661e0 tx=0x7f68600090f0).stop 2023-12-22T10:02:17.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.295+0000 7f6874af1700 1 -- 172.21.15.45:0/1311230021 shutdown_connections 2023-12-22T10:02:17.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.295+0000 7f6874af1700 1 --2- 172.21.15.45:0/1311230021 >> v2:172.21.15.113:3300/0 conn(0x7f68700672c0 0x7f68700be1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:17.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.295+0000 7f6874af1700 1 --2- 172.21.15.45:0/1311230021 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68700c5710 0x7f68700c3750 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:17.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.295+0000 7f6874af1700 1 -- 172.21.15.45:0/1311230021 >> 172.21.15.45:0/1311230021 conn(0x7f6870082670 msgr2=0x7f6870091f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:02:17.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.295+0000 7f6874af1700 1 -- 172.21.15.45:0/1311230021 shutdown_connections 2023-12-22T10:02:17.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.295+0000 7f6874af1700 1 -- 172.21.15.45:0/1311230021 wait complete. 2023-12-22T10:02:17.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.295+0000 7f6874af1700 1 Processor -- start 2023-12-22T10:02:17.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.295+0000 7f6874af1700 1 -- start start 2023-12-22T10:02:17.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.299+0000 7f6874af1700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68700672c0 0x7f68700aac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:17.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.299+0000 7f6874af1700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f68700be6a0 0x7f6870153800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:17.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.299+0000 7f6874af1700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f68700c5710 0x7f6870153cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:17.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.299+0000 7f6874af1700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6870154c60 con 0x7f68700672c0 2023-12-22T10:02:17.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.299+0000 7f6874af1700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68700a7f70 con 0x7f68700c5710 2023-12-22T10:02:17.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.299+0000 7f6874af1700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68700a73f0 con 0x7f68700be6a0 2023-12-22T10:02:17.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.299+0000 7f686e59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68700672c0 0x7f68700aac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:17.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.299+0000 7f686e59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68700672c0 0x7f68700aac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43020/0 (socket says 172.21.15.45:43020) 2023-12-22T10:02:17.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.299+0000 7f686e59c700 1 -- 172.21.15.45:0/2529406409 learned_addr learned my addr 172.21.15.45:0/2529406409 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:02:17.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.299+0000 7f686ed9d700 1 --2- 172.21.15.45:0/2529406409 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f68700c5710 0x7f6870153cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:17.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.299+0000 7f6867fff700 1 --2- 172.21.15.45:0/2529406409 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f68700be6a0 0x7f6870153800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:17.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.299+0000 7f686e59c700 1 -- 172.21.15.45:0/2529406409 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f68700be6a0 msgr2=0x7f6870153800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:17.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.299+0000 7f686e59c700 1 --2- 172.21.15.45:0/2529406409 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f68700be6a0 0x7f6870153800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:17.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.299+0000 7f686e59c700 1 -- 172.21.15.45:0/2529406409 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f68700c5710 msgr2=0x7f6870153cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:17.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.299+0000 7f686e59c700 1 --2- 172.21.15.45:0/2529406409 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f68700c5710 0x7f6870153cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:17.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.299+0000 7f686e59c700 1 -- 172.21.15.45:0/2529406409 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6860009370 con 0x7f68700672c0 2023-12-22T10:02:17.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.299+0000 7f686e59c700 1 --2- 172.21.15.45:0/2529406409 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68700672c0 0x7f68700aac60 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 rx=0x7f6860009130 tx=0x7f6860017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:17.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.299+0000 7f68667fc700 1 -- 172.21.15.45:0/2529406409 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f686000be90 con 0x7f68700672c0 2023-12-22T10:02:17.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.299+0000 7f68667fc700 1 -- 172.21.15.45:0/2529406409 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f686000b7f0 con 0x7f68700672c0 2023-12-22T10:02:17.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.299+0000 7f68667fc700 1 -- 172.21.15.45:0/2529406409 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f686001b660 con 0x7f68700672c0 2023-12-22T10:02:17.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.299+0000 7f6874af1700 1 -- 172.21.15.45:0/2529406409 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68700a76d0 con 0x7f68700672c0 2023-12-22T10:02:17.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.299+0000 7f6874af1700 1 -- 172.21.15.45:0/2529406409 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68700a7c90 con 0x7f68700672c0 2023-12-22T10:02:17.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.303+0000 7f6874af1700 1 -- 172.21.15.45:0/2529406409 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f687006c070 con 0x7f68700672c0 2023-12-22T10:02:17.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.303+0000 7f68667fc700 1 -- 172.21.15.45:0/2529406409 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f686001ba10 con 0x7f68700672c0 2023-12-22T10:02:17.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.303+0000 7f68667fc700 1 --2- 172.21.15.45:0/2529406409 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f685005a4e0 0x7f685005c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:17.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.303+0000 7f68667fc700 1 -- 172.21.15.45:0/2529406409 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f6860075f50 con 0x7f68700672c0 2023-12-22T10:02:17.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.307+0000 7f6867fff700 1 --2- 172.21.15.45:0/2529406409 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f685005a4e0 0x7f685005c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:17.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.307+0000 7f6867fff700 1 --2- 172.21.15.45:0/2529406409 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f685005a4e0 0x7f685005c9a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7f68700ae9a0 tx=0x7f6858008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:17.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.311+0000 7f68667fc700 1 -- 172.21.15.45:0/2529406409 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f6860049970 con 0x7f68700672c0 2023-12-22T10:02:17.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.475+0000 7f6874af1700 1 -- 172.21.15.45:0/2529406409 --> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f6870155150 con 0x7f685005a4e0 2023-12-22T10:02:17.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.479+0000 7f68667fc700 1 -- 172.21.15.45:0/2529406409 <== mgr.4104 v2:172.21.15.45:6832/33679 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f6870155150 con 0x7f685005a4e0 2023-12-22T10:02:17.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.483+0000 7f6874af1700 1 -- 172.21.15.45:0/2529406409 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f685005a4e0 msgr2=0x7f685005c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:17.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.483+0000 7f6874af1700 1 --2- 172.21.15.45:0/2529406409 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f685005a4e0 0x7f685005c9a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7f68700ae9a0 tx=0x7f6858008040).stop 2023-12-22T10:02:17.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.483+0000 7f6874af1700 1 -- 172.21.15.45:0/2529406409 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68700672c0 msgr2=0x7f68700aac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:17.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.483+0000 7f6874af1700 1 --2- 172.21.15.45:0/2529406409 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68700672c0 0x7f68700aac60 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 rx=0x7f6860009130 tx=0x7f6860017000).stop 2023-12-22T10:02:17.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.483+0000 7f6874af1700 1 -- 172.21.15.45:0/2529406409 shutdown_connections 2023-12-22T10:02:17.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.483+0000 7f6874af1700 1 --2- 172.21.15.45:0/2529406409 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f68700c5710 0x7f6870153cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:17.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.483+0000 7f6874af1700 1 --2- 172.21.15.45:0/2529406409 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f685005a4e0 0x7f685005c9a0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:17.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.483+0000 7f6874af1700 1 --2- 172.21.15.45:0/2529406409 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f68700be6a0 0x7f6870153800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:17.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.483+0000 7f6874af1700 1 --2- 172.21.15.45:0/2529406409 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68700672c0 0x7f68700aac60 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:17.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.483+0000 7f6874af1700 1 -- 172.21.15.45:0/2529406409 >> 172.21.15.45:0/2529406409 conn(0x7f6870082670 msgr2=0x7f6870151230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:02:17.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.483+0000 7f6874af1700 1 -- 172.21.15.45:0/2529406409 shutdown_connections 2023-12-22T10:02:17.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.483+0000 7f6874af1700 1 -- 172.21.15.45:0/2529406409 wait complete. 2023-12-22T10:02:17.485 INFO:teuthology.orchestra.run.smithi045.stderr:instructed osd(s) 0 to deep-scrub 2023-12-22T10:02:17.503 INFO:tasks.ceph:Scrubbing osd.1 2023-12-22T10:02:17.503 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-12-22T10:02:17.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.675+0000 7f39ef146700 1 Processor -- start 2023-12-22T10:02:17.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.675+0000 7f39ef146700 1 -- start start 2023-12-22T10:02:17.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.679+0000 7f39ef146700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f39e80ac0e0 0x7f39e80a7050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:17.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.679+0000 7f39ef146700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f39e80c3160 0x7f39e80a5890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:17.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.679+0000 7f39ef146700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39e81521b0 con 0x7f39e80ac4c0 2023-12-22T10:02:17.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.679+0000 7f39ef146700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39e8151fa0 con 0x7f39e80c3160 2023-12-22T10:02:17.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.679+0000 7f39ef146700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39e8155d70 con 0x7f39e80ac0e0 2023-12-22T10:02:17.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.679+0000 7f39ecee2700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f39e80ac0e0 0x7f39e80a7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:17.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.679+0000 7f39ecee2700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f39e80ac0e0 0x7f39e80a7050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.113:3301/0 says I am v2:172.21.15.45:57020/0 (socket says 172.21.15.45:57020) 2023-12-22T10:02:17.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.679+0000 7f39ecee2700 1 -- 172.21.15.45:0/4293288918 learned_addr learned my addr 172.21.15.45:0/4293288918 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:02:17.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.679+0000 7f39e7fff700 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f39e80ac4c0 0x7f39e8155660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.45:36934/0 (socket says 172.21.15.45:36934) 2023-12-22T10:02:17.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.679+0000 7f39ed6e3700 1 --2- 172.21.15.45:0/4293288918 >> v2:172.21.15.113:3300/0 conn(0x7f39e80c3160 0x7f39e80a5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:17.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.679+0000 7f39ecee2700 1 -- 172.21.15.45:0/4293288918 >> v2:172.21.15.113:3300/0 conn(0x7f39e80c3160 msgr2=0x7f39e80a5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:02:17.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.679+0000 7f39ecee2700 1 --2- 172.21.15.45:0/4293288918 >> v2:172.21.15.113:3300/0 conn(0x7f39e80c3160 0x7f39e80a5890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:17.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.679+0000 7f39ecee2700 1 -- 172.21.15.45:0/4293288918 >> v1:172.21.15.113:6789/0 conn(0x7f39e80ac4c0 legacy=0x7f39e8155660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:17.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.679+0000 7f39ecee2700 1 -- 172.21.15.45:0/4293288918 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39e80c36e0 con 0x7f39e80ac0e0 2023-12-22T10:02:17.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.679+0000 7f39e77fe700 1 -- 172.21.15.45:0/4293288918 <== mon.1 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4073598429 0 0) 0x7f39e81521b0 con 0x7f39e80ac4c0 2023-12-22T10:02:17.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.683+0000 7f39ecee2700 1 --2- 172.21.15.45:0/4293288918 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f39e80ac0e0 0x7f39e80a7050 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f39dc006fd0 tx=0x7f39dc0090f0).ready entity=mon.2 client_cookie=8d76bec427f3cd4e server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:17.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.683+0000 7f39e77fe700 1 -- 172.21.15.45:0/4293288918 <== mon.2 v2:172.21.15.113:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39dc00b580 con 0x7f39e80ac0e0 2023-12-22T10:02:17.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.683+0000 7f39e77fe700 1 -- 172.21.15.45:0/4293288918 <== mon.2 v2:172.21.15.113:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39dc00b6e0 con 0x7f39e80ac0e0 2023-12-22T10:02:17.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.683+0000 7f39e77fe700 1 -- 172.21.15.45:0/4293288918 <== mon.2 v2:172.21.15.113:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39dc00ba60 con 0x7f39e80ac0e0 2023-12-22T10:02:17.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.683+0000 7f39ef146700 1 -- 172.21.15.45:0/4293288918 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f39e80ac0e0 msgr2=0x7f39e80a7050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:17.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.683+0000 7f39ef146700 1 --2- 172.21.15.45:0/4293288918 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f39e80ac0e0 0x7f39e80a7050 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f39dc006fd0 tx=0x7f39dc0090f0).stop 2023-12-22T10:02:17.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.683+0000 7f39ef146700 1 -- 172.21.15.45:0/4293288918 shutdown_connections 2023-12-22T10:02:17.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.683+0000 7f39ef146700 1 --2- 172.21.15.45:0/4293288918 >> v2:172.21.15.113:3300/0 conn(0x7f39e80c3160 0x7f39e80a5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:17.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.683+0000 7f39ef146700 1 --2- 172.21.15.45:0/4293288918 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f39e80ac0e0 0x7f39e80a7050 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:17.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.683+0000 7f39ef146700 1 -- 172.21.15.45:0/4293288918 >> 172.21.15.45:0/4293288918 conn(0x7f39e8066a70 msgr2=0x7f39e8066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:02:17.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.683+0000 7f39ef146700 1 -- 172.21.15.45:0/4293288918 shutdown_connections 2023-12-22T10:02:17.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.683+0000 7f39ef146700 1 -- 172.21.15.45:0/4293288918 wait complete. 2023-12-22T10:02:17.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.687+0000 7f39ef146700 1 Processor -- start 2023-12-22T10:02:17.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.687+0000 7f39ef146700 1 -- start start 2023-12-22T10:02:17.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.687+0000 7f39ef146700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f39e80ac0e0 0x7f39e80be2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:17.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.687+0000 7f39ef146700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f39e80c3160 0x7f39e80bb7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:17.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.687+0000 7f39ef146700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39e814e550 0x7f39e8169310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:17.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.687+0000 7f39ef146700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39e80c6340 con 0x7f39e814e550 2023-12-22T10:02:17.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.687+0000 7f39ef146700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39e80c5a50 con 0x7f39e80ac0e0 2023-12-22T10:02:17.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.687+0000 7f39ef146700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39e80c5cc0 con 0x7f39e80c3160 2023-12-22T10:02:17.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.687+0000 7f39ed6e3700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39e814e550 0x7f39e8169310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:17.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.687+0000 7f39ed6e3700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39e814e550 0x7f39e8169310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43022/0 (socket says 172.21.15.45:43022) 2023-12-22T10:02:17.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.687+0000 7f39ed6e3700 1 -- 172.21.15.45:0/1825569505 learned_addr learned my addr 172.21.15.45:0/1825569505 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:02:17.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.691+0000 7f39e7fff700 1 --2- 172.21.15.45:0/1825569505 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f39e80c3160 0x7f39e80bb7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:17.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.691+0000 7f39ecee2700 1 --2- 172.21.15.45:0/1825569505 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f39e80ac0e0 0x7f39e80be2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:17.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.691+0000 7f39ed6e3700 1 -- 172.21.15.45:0/1825569505 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f39e80c3160 msgr2=0x7f39e80bb7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:17.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.691+0000 7f39ed6e3700 1 --2- 172.21.15.45:0/1825569505 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f39e80c3160 0x7f39e80bb7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:17.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.691+0000 7f39ed6e3700 1 -- 172.21.15.45:0/1825569505 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f39e80ac0e0 msgr2=0x7f39e80be2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:17.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.691+0000 7f39ed6e3700 1 --2- 172.21.15.45:0/1825569505 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f39e80ac0e0 0x7f39e80be2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:17.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.691+0000 7f39ed6e3700 1 -- 172.21.15.45:0/1825569505 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39dc009370 con 0x7f39e814e550 2023-12-22T10:02:17.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.691+0000 7f39ed6e3700 1 --2- 172.21.15.45:0/1825569505 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39e814e550 0x7f39e8169310 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 rx=0x7f39e0009ec0 tx=0x7f39e000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:17.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.691+0000 7f39e4ff9700 1 -- 172.21.15.45:0/1825569505 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e000cb70 con 0x7f39e814e550 2023-12-22T10:02:17.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.691+0000 7f39e4ff9700 1 -- 172.21.15.45:0/1825569505 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39e000f040 con 0x7f39e814e550 2023-12-22T10:02:17.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.691+0000 7f39e4ff9700 1 -- 172.21.15.45:0/1825569505 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e000cee0 con 0x7f39e814e550 2023-12-22T10:02:17.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.691+0000 7f39ef146700 1 -- 172.21.15.45:0/1825569505 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39e80c5fa0 con 0x7f39e814e550 2023-12-22T10:02:17.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.691+0000 7f39ef146700 1 -- 172.21.15.45:0/1825569505 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39e814e9d0 con 0x7f39e814e550 2023-12-22T10:02:17.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.691+0000 7f39ef146700 1 -- 172.21.15.45:0/1825569505 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f39e8065ec0 con 0x7f39e814e550 2023-12-22T10:02:17.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.695+0000 7f39e4ff9700 1 -- 172.21.15.45:0/1825569505 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f39e0013610 con 0x7f39e814e550 2023-12-22T10:02:17.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.695+0000 7f39e4ff9700 1 --2- 172.21.15.45:0/1825569505 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f39cc05a510 0x7f39cc05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:17.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.695+0000 7f39e4ff9700 1 -- 172.21.15.45:0/1825569505 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f39e0074d50 con 0x7f39e814e550 2023-12-22T10:02:17.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.695+0000 7f39ecee2700 1 --2- 172.21.15.45:0/1825569505 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f39cc05a510 0x7f39cc05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:17.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.695+0000 7f39e4ff9700 1 --2- 172.21.15.45:0/1825569505 >> [v2:172.21.15.45:6808/33775,v1:172.21.15.45:6809/33775] conn(0x7f39cc060b00 0x7f39cc062f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:17.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.695+0000 7f39e4ff9700 1 -- 172.21.15.45:0/1825569505 --> [v2:172.21.15.45:6808/33775,v1:172.21.15.45:6809/33775] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f39cc0635e0 con 0x7f39cc060b00 2023-12-22T10:02:17.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.695+0000 7f39e4ff9700 1 -- 172.21.15.45:0/1825569505 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f39e00772b0 con 0x7f39e814e550 2023-12-22T10:02:17.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.695+0000 7f39e7fff700 1 --2- 172.21.15.45:0/1825569505 >> [v2:172.21.15.45:6808/33775,v1:172.21.15.45:6809/33775] conn(0x7f39cc060b00 0x7f39cc062f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:17.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.695+0000 7f39ecee2700 1 --2- 172.21.15.45:0/1825569505 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f39cc05a510 0x7f39cc05c9d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7f39dc009130 tx=0x7f39dc017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:17.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.699+0000 7f39e7fff700 1 --2- 172.21.15.45:0/1825569505 >> [v2:172.21.15.45:6808/33775,v1:172.21.15.45:6809/33775] conn(0x7f39cc060b00 0x7f39cc062f60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:17.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.699+0000 7f39e4ff9700 1 -- 172.21.15.45:0/1825569505 <== osd.1 v2:172.21.15.45:6808/33775 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7f39cc0635e0 con 0x7f39cc060b00 2023-12-22T10:02:17.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.715+0000 7f39ef146700 1 -- 172.21.15.45:0/1825569505 --> [v2:172.21.15.45:6808/33775,v1:172.21.15.45:6809/33775] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f39e80c64f0 con 0x7f39cc060b00 2023-12-22T10:02:17.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.715+0000 7f39e4ff9700 1 -- 172.21.15.45:0/1825569505 <== osd.1 v2:172.21.15.45:6808/33775 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f39e80c64f0 con 0x7f39cc060b00 2023-12-22T10:02:17.717 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-22T10:02:17.718 INFO:teuthology.orchestra.run.smithi045.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-12-22T10:02:17.718 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-22T10:02:17.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.719+0000 7f39ef146700 1 -- 172.21.15.45:0/1825569505 >> [v2:172.21.15.45:6808/33775,v1:172.21.15.45:6809/33775] conn(0x7f39cc060b00 msgr2=0x7f39cc062f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:17.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.719+0000 7f39ef146700 1 --2- 172.21.15.45:0/1825569505 >> [v2:172.21.15.45:6808/33775,v1:172.21.15.45:6809/33775] conn(0x7f39cc060b00 0x7f39cc062f60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:17.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.719+0000 7f39ef146700 1 -- 172.21.15.45:0/1825569505 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f39cc05a510 msgr2=0x7f39cc05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:17.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.719+0000 7f39ef146700 1 --2- 172.21.15.45:0/1825569505 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f39cc05a510 0x7f39cc05c9d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7f39dc009130 tx=0x7f39dc017000).stop 2023-12-22T10:02:17.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.719+0000 7f39ef146700 1 -- 172.21.15.45:0/1825569505 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39e814e550 msgr2=0x7f39e8169310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:17.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.719+0000 7f39ef146700 1 --2- 172.21.15.45:0/1825569505 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39e814e550 0x7f39e8169310 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 rx=0x7f39e0009ec0 tx=0x7f39e000b040).stop 2023-12-22T10:02:17.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.719+0000 7f39ed6e3700 1 -- 172.21.15.45:0/1825569505 reap_dead start 2023-12-22T10:02:17.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.719+0000 7f39ef146700 1 -- 172.21.15.45:0/1825569505 shutdown_connections 2023-12-22T10:02:17.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.719+0000 7f39ef146700 1 -- 172.21.15.45:0/1825569505 >> 172.21.15.45:0/1825569505 conn(0x7f39e8066a70 msgr2=0x7f39e80a6e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:02:17.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.719+0000 7f39ef146700 1 -- 172.21.15.45:0/1825569505 shutdown_connections 2023-12-22T10:02:17.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.719+0000 7f39ef146700 1 -- 172.21.15.45:0/1825569505 wait complete. 2023-12-22T10:02:17.741 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-12-22T10:02:17.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.903+0000 7f0dae3db700 1 Processor -- start 2023-12-22T10:02:17.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.903+0000 7f0dae3db700 1 -- start start 2023-12-22T10:02:17.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.903+0000 7f0dae3db700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0da80a56f0 0x7f0da80a79a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:17.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.903+0000 7f0dae3db700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f0da80a7e90 0x7f0da815a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:17.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.903+0000 7f0dae3db700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0da8150df0 con 0x7f0da80a8da0 2023-12-22T10:02:17.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.903+0000 7f0dae3db700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0da8151ed0 con 0x7f0da80a56f0 2023-12-22T10:02:17.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.903+0000 7f0dae3db700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0da80c1d70 con 0x7f0da80a7e90 2023-12-22T10:02:17.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.907+0000 7f0da77fe700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0da80a56f0 0x7f0da80a79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:17.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.907+0000 7f0da77fe700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0da80a56f0 0x7f0da80a79a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47008/0 (socket says 172.21.15.45:47008) 2023-12-22T10:02:17.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.907+0000 7f0da77fe700 1 -- 172.21.15.45:0/3331009340 learned_addr learned my addr 172.21.15.45:0/3331009340 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:02:17.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.907+0000 7f0dac978700 1 --2- 172.21.15.45:0/3331009340 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f0da80a7e90 0x7f0da815a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:17.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.907+0000 7f0da77fe700 1 -- 172.21.15.45:0/3331009340 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f0da80a7e90 msgr2=0x7f0da815a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:02:17.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.907+0000 7f0da77fe700 1 --2- 172.21.15.45:0/3331009340 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f0da80a7e90 0x7f0da815a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:17.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.907+0000 7f0da77fe700 1 -- 172.21.15.45:0/3331009340 >> v1:172.21.15.45:6789/0 conn(0x7f0da80a8da0 legacy=0x7f0da80c1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:17.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.907+0000 7f0da77fe700 1 -- 172.21.15.45:0/3331009340 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0da8151960 con 0x7f0da80a56f0 2023-12-22T10:02:17.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.907+0000 7f0da77fe700 1 --2- 172.21.15.45:0/3331009340 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0da80a56f0 0x7f0da80a79a0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7f0d9c006fd0 tx=0x7f0d9c0090f0).ready entity=mon.0 client_cookie=c145dfb51fafa00f server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:17.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.907+0000 7f0da6ffd700 1 -- 172.21.15.45:0/3331009340 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d9c00b600 con 0x7f0da80a56f0 2023-12-22T10:02:17.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.907+0000 7f0da6ffd700 1 -- 172.21.15.45:0/3331009340 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d9c00b760 con 0x7f0da80a56f0 2023-12-22T10:02:17.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.907+0000 7f0da6ffd700 1 -- 172.21.15.45:0/3331009340 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d9c00bb00 con 0x7f0da80a56f0 2023-12-22T10:02:17.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.907+0000 7f0dae3db700 1 -- 172.21.15.45:0/3331009340 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0da80a56f0 msgr2=0x7f0da80a79a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:17.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.907+0000 7f0dae3db700 1 --2- 172.21.15.45:0/3331009340 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0da80a56f0 0x7f0da80a79a0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7f0d9c006fd0 tx=0x7f0d9c0090f0).stop 2023-12-22T10:02:17.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.907+0000 7f0dae3db700 1 -- 172.21.15.45:0/3331009340 shutdown_connections 2023-12-22T10:02:17.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.907+0000 7f0dae3db700 1 --2- 172.21.15.45:0/3331009340 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f0da80a7e90 0x7f0da815a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:17.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.907+0000 7f0dae3db700 1 --2- 172.21.15.45:0/3331009340 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0da80a56f0 0x7f0da80a79a0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:17.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.907+0000 7f0dae3db700 1 -- 172.21.15.45:0/3331009340 >> 172.21.15.45:0/3331009340 conn(0x7f0da8066a70 msgr2=0x7f0da8066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:02:17.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.907+0000 7f0dae3db700 1 -- 172.21.15.45:0/3331009340 shutdown_connections 2023-12-22T10:02:17.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.907+0000 7f0dae3db700 1 -- 172.21.15.45:0/3331009340 wait complete. 2023-12-22T10:02:17.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.911+0000 7f0dae3db700 1 Processor -- start 2023-12-22T10:02:17.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.911+0000 7f0dae3db700 1 -- start start 2023-12-22T10:02:17.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.911+0000 7f0dae3db700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f0da80a56f0 0x7f0da80aa9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:17.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.911+0000 7f0dae3db700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0da80a7e90 0x7f0da8152e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:17.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.911+0000 7f0dae3db700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0da80a8da0 0x7f0da8145380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:17.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.911+0000 7f0dae3db700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0da80c5410 con 0x7f0da80a8da0 2023-12-22T10:02:17.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.911+0000 7f0dae3db700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0da80aafc0 con 0x7f0da80a7e90 2023-12-22T10:02:17.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.911+0000 7f0dae3db700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0da80ab2a0 con 0x7f0da80a56f0 2023-12-22T10:02:17.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.911+0000 7f0dac978700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0da80a8da0 0x7f0da8145380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:17.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.915+0000 7f0dac978700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0da80a8da0 0x7f0da8145380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47024/0 (socket says 172.21.15.45:47024) 2023-12-22T10:02:17.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.915+0000 7f0da7fff700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f0da80a56f0 0x7f0da80aa9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:17.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.915+0000 7f0da77fe700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0da80a7e90 0x7f0da8152e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:17.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.915+0000 7f0dac978700 1 -- 172.21.15.45:0/2159280846 learned_addr learned my addr 172.21.15.45:0/2159280846 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:02:17.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.915+0000 7f0dac978700 1 -- 172.21.15.45:0/2159280846 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f0da80a56f0 msgr2=0x7f0da80aa9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:17.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.915+0000 7f0dac978700 1 --2- 172.21.15.45:0/2159280846 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f0da80a56f0 0x7f0da80aa9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:17.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.915+0000 7f0dac978700 1 -- 172.21.15.45:0/2159280846 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0da80a7e90 msgr2=0x7f0da8152e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:17.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.915+0000 7f0dac978700 1 --2- 172.21.15.45:0/2159280846 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0da80a7e90 0x7f0da8152e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:17.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.915+0000 7f0dac978700 1 -- 172.21.15.45:0/2159280846 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d9c009370 con 0x7f0da80a8da0 2023-12-22T10:02:17.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.915+0000 7f0da77fe700 1 --2- 172.21.15.45:0/2159280846 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0da80a7e90 0x7f0da8152e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-12-22T10:02:17.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.915+0000 7f0dac978700 1 --2- 172.21.15.45:0/2159280846 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0da80a8da0 0x7f0da8145380 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 rx=0x7f0da0009fa0 tx=0x7f0da0009900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:17.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.915+0000 7f0d8ffff700 1 -- 172.21.15.45:0/2159280846 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da000ebc0 con 0x7f0da80a8da0 2023-12-22T10:02:17.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.915+0000 7f0d8ffff700 1 -- 172.21.15.45:0/2159280846 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0da000ed20 con 0x7f0da80a8da0 2023-12-22T10:02:17.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.915+0000 7f0dae3db700 1 -- 172.21.15.45:0/2159280846 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0da80ab580 con 0x7f0da80a8da0 2023-12-22T10:02:17.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.915+0000 7f0d8ffff700 1 -- 172.21.15.45:0/2159280846 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da0014610 con 0x7f0da80a8da0 2023-12-22T10:02:17.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.915+0000 7f0dae3db700 1 -- 172.21.15.45:0/2159280846 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0da8153340 con 0x7f0da80a8da0 2023-12-22T10:02:17.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.915+0000 7f0dae3db700 1 -- 172.21.15.45:0/2159280846 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0da80c5580 con 0x7f0da80a8da0 2023-12-22T10:02:17.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.919+0000 7f0d8ffff700 1 -- 172.21.15.45:0/2159280846 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f0da001d3b0 con 0x7f0da80a8da0 2023-12-22T10:02:17.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.919+0000 7f0d8ffff700 1 --2- 172.21.15.45:0/2159280846 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f0d9405a540 0x7f0d9405ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:17.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.919+0000 7f0d8ffff700 1 -- 172.21.15.45:0/2159280846 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f0da0074900 con 0x7f0da80a8da0 2023-12-22T10:02:17.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.919+0000 7f0da7fff700 1 --2- 172.21.15.45:0/2159280846 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f0d9405a540 0x7f0d9405ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:17.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.923+0000 7f0da7fff700 1 --2- 172.21.15.45:0/2159280846 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f0d9405a540 0x7f0d9405ca00 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7f0d98003860 tx=0x7f0d98007d40).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:17.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:17.927+0000 7f0d8ffff700 1 -- 172.21.15.45:0/2159280846 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f0da0048380 con 0x7f0da80a8da0 2023-12-22T10:02:18.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.087+0000 7f0dae3db700 1 -- 172.21.15.45:0/2159280846 --> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f0da8151bf0 con 0x7f0d9405a540 2023-12-22T10:02:18.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.091+0000 7f0d8ffff700 1 -- 172.21.15.45:0/2159280846 <== mgr.4104 v2:172.21.15.45:6832/33679 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f0da8151bf0 con 0x7f0d9405a540 2023-12-22T10:02:18.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.095+0000 7f0dae3db700 1 -- 172.21.15.45:0/2159280846 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f0d9405a540 msgr2=0x7f0d9405ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:18.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.095+0000 7f0dae3db700 1 --2- 172.21.15.45:0/2159280846 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f0d9405a540 0x7f0d9405ca00 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7f0d98003860 tx=0x7f0d98007d40).stop 2023-12-22T10:02:18.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.095+0000 7f0dae3db700 1 -- 172.21.15.45:0/2159280846 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0da80a8da0 msgr2=0x7f0da8145380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:18.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.095+0000 7f0dae3db700 1 --2- 172.21.15.45:0/2159280846 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0da80a8da0 0x7f0da8145380 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 rx=0x7f0da0009fa0 tx=0x7f0da0009900).stop 2023-12-22T10:02:18.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.095+0000 7f0dae3db700 1 -- 172.21.15.45:0/2159280846 shutdown_connections 2023-12-22T10:02:18.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.095+0000 7f0dae3db700 1 --2- 172.21.15.45:0/2159280846 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0da80a8da0 0x7f0da8145380 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:18.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.095+0000 7f0dae3db700 1 --2- 172.21.15.45:0/2159280846 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f0da80a7e90 0x7f0da8152e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:18.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.095+0000 7f0dae3db700 1 --2- 172.21.15.45:0/2159280846 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f0d9405a540 0x7f0d9405ca00 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:18.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.095+0000 7f0dae3db700 1 --2- 172.21.15.45:0/2159280846 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f0da80a56f0 0x7f0da80aa9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:18.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.095+0000 7f0dae3db700 1 -- 172.21.15.45:0/2159280846 >> 172.21.15.45:0/2159280846 conn(0x7f0da8066a70 msgr2=0x7f0da8067280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:02:18.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.095+0000 7f0dae3db700 1 -- 172.21.15.45:0/2159280846 shutdown_connections 2023-12-22T10:02:18.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.095+0000 7f0dae3db700 1 -- 172.21.15.45:0/2159280846 wait complete. 2023-12-22T10:02:18.097 INFO:teuthology.orchestra.run.smithi045.stderr:instructed osd(s) 1 to deep-scrub 2023-12-22T10:02:18.115 INFO:tasks.ceph:Scrubbing osd.2 2023-12-22T10:02:18.116 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-12-22T10:02:18.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.291+0000 7fed06cdb700 1 Processor -- start 2023-12-22T10:02:18.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.291+0000 7fed06cdb700 1 -- start start 2023-12-22T10:02:18.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.295+0000 7fed06cdb700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fed0014f960 0x7fed0014fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:18.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.295+0000 7fed06cdb700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fed000c2150 0x7fed00069440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:18.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.295+0000 7fed06cdb700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed00069930 con 0x7fed00068fe0 2023-12-22T10:02:18.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.295+0000 7fed06cdb700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed001539e0 con 0x7fed0014f960 2023-12-22T10:02:18.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.295+0000 7fed06cdb700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed00153cc0 con 0x7fed000c2150 2023-12-22T10:02:18.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.295+0000 7fed04a77700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fed0014f960 0x7fed0014fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:18.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.295+0000 7fed04a77700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fed0014f960 0x7fed0014fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47038/0 (socket says 172.21.15.45:47038) 2023-12-22T10:02:18.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.295+0000 7fed04a77700 1 -- 172.21.15.45:0/1648944973 learned_addr learned my addr 172.21.15.45:0/1648944973 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:02:18.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.295+0000 7fed05278700 1 --2- 172.21.15.45:0/1648944973 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fed000c2150 0x7fed00069440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:18.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.295+0000 7fed04a77700 1 -- 172.21.15.45:0/1648944973 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fed000c2150 msgr2=0x7fed00069440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:02:18.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.295+0000 7fed04a77700 1 --2- 172.21.15.45:0/1648944973 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fed000c2150 0x7fed00069440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:18.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.295+0000 7fed04a77700 1 -- 172.21.15.45:0/1648944973 >> v1:172.21.15.113:6789/0 conn(0x7fed00068fe0 legacy=0x7fed000c1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:18.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.295+0000 7fed04a77700 1 -- 172.21.15.45:0/1648944973 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed00153fa0 con 0x7fed0014f960 2023-12-22T10:02:18.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.295+0000 7fed04a77700 1 --2- 172.21.15.45:0/1648944973 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fed0014f960 0x7fed0014fd40 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 rx=0x7fecf4006fd0 tx=0x7fecf40090f0).ready entity=mon.0 client_cookie=e6ed2f5b1fcf0050 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:18.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.295+0000 7fecff7fe700 1 -- 172.21.15.45:0/1648944973 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf4010620 con 0x7fed0014f960 2023-12-22T10:02:18.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.295+0000 7fecff7fe700 1 -- 172.21.15.45:0/1648944973 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecf4010780 con 0x7fed0014f960 2023-12-22T10:02:18.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.295+0000 7fecff7fe700 1 -- 172.21.15.45:0/1648944973 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf4010b00 con 0x7fed0014f960 2023-12-22T10:02:18.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.299+0000 7fed06cdb700 1 -- 172.21.15.45:0/1648944973 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fed0014f960 msgr2=0x7fed0014fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:18.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.299+0000 7fed06cdb700 1 --2- 172.21.15.45:0/1648944973 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fed0014f960 0x7fed0014fd40 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 rx=0x7fecf4006fd0 tx=0x7fecf40090f0).stop 2023-12-22T10:02:18.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.299+0000 7fed06cdb700 1 -- 172.21.15.45:0/1648944973 shutdown_connections 2023-12-22T10:02:18.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.299+0000 7fed06cdb700 1 --2- 172.21.15.45:0/1648944973 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fed000c2150 0x7fed00069440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:18.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.299+0000 7fed06cdb700 1 --2- 172.21.15.45:0/1648944973 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fed0014f960 0x7fed0014fd40 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:18.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.299+0000 7fed06cdb700 1 -- 172.21.15.45:0/1648944973 >> 172.21.15.45:0/1648944973 conn(0x7fed000c6730 msgr2=0x7fed000c6b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:02:18.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.299+0000 7fed06cdb700 1 -- 172.21.15.45:0/1648944973 shutdown_connections 2023-12-22T10:02:18.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.299+0000 7fed06cdb700 1 -- 172.21.15.45:0/1648944973 wait complete. 2023-12-22T10:02:18.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.299+0000 7fed06cdb700 1 Processor -- start 2023-12-22T10:02:18.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.299+0000 7fed06cdb700 1 -- start start 2023-12-22T10:02:18.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.299+0000 7fed06cdb700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fed00068fe0 0x7fed0014a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:18.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.303+0000 7fed06cdb700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fed000c2150 0x7fed001486f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:18.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.303+0000 7fed06cdb700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fed0014f960 0x7fed0014ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:18.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.303+0000 7fed06cdb700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed001507d0 con 0x7fed00068fe0 2023-12-22T10:02:18.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.303+0000 7fed06cdb700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed00148be0 con 0x7fed000c2150 2023-12-22T10:02:18.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.303+0000 7fed06cdb700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed0014f1f0 con 0x7fed0014f960 2023-12-22T10:02:18.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.303+0000 7fed04a77700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fed00068fe0 0x7fed0014a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:18.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.303+0000 7fed04a77700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fed00068fe0 0x7fed0014a100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47042/0 (socket says 172.21.15.45:47042) 2023-12-22T10:02:18.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.303+0000 7fed04a77700 1 -- 172.21.15.45:0/2778600800 learned_addr learned my addr 172.21.15.45:0/2778600800 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:02:18.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.303+0000 7fecfffff700 1 --2- 172.21.15.45:0/2778600800 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fed000c2150 0x7fed001486f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:18.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.303+0000 7fed05278700 1 --2- 172.21.15.45:0/2778600800 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fed0014f960 0x7fed0014ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:18.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.303+0000 7fed04a77700 1 -- 172.21.15.45:0/2778600800 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fed0014f960 msgr2=0x7fed0014ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:18.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.303+0000 7fed04a77700 1 --2- 172.21.15.45:0/2778600800 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fed0014f960 0x7fed0014ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:18.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.303+0000 7fed04a77700 1 -- 172.21.15.45:0/2778600800 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fed000c2150 msgr2=0x7fed001486f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:18.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.303+0000 7fed04a77700 1 --2- 172.21.15.45:0/2778600800 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fed000c2150 0x7fed001486f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:18.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.303+0000 7fed04a77700 1 -- 172.21.15.45:0/2778600800 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecf4009370 con 0x7fed00068fe0 2023-12-22T10:02:18.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.303+0000 7fed05278700 1 --2- 172.21.15.45:0/2778600800 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fed0014f960 0x7fed0014ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T10:02:18.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.303+0000 7fed04a77700 1 --2- 172.21.15.45:0/2778600800 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fed00068fe0 0x7fed0014a100 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0x7fecf4009f50 tx=0x7fecf4018000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:18.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.303+0000 7fecfcff9700 1 -- 172.21.15.45:0/2778600800 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf4010b00 con 0x7fed00068fe0 2023-12-22T10:02:18.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.303+0000 7fecfcff9700 1 -- 172.21.15.45:0/2778600800 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecf4000c90 con 0x7fed00068fe0 2023-12-22T10:02:18.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.303+0000 7fecfcff9700 1 -- 172.21.15.45:0/2778600800 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf4023690 con 0x7fed00068fe0 2023-12-22T10:02:18.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.303+0000 7fed06cdb700 1 -- 172.21.15.45:0/2778600800 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed0014a720 con 0x7fed00068fe0 2023-12-22T10:02:18.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.303+0000 7fed06cdb700 1 -- 172.21.15.45:0/2778600800 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed00150460 con 0x7fed00068fe0 2023-12-22T10:02:18.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.307+0000 7fed06cdb700 1 -- 172.21.15.45:0/2778600800 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fed001502c0 con 0x7fed00068fe0 2023-12-22T10:02:18.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.307+0000 7fecfcff9700 1 -- 172.21.15.45:0/2778600800 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fecf4023a80 con 0x7fed00068fe0 2023-12-22T10:02:18.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.307+0000 7fecfcff9700 1 --2- 172.21.15.45:0/2778600800 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fece405a510 0x7fece405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:18.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.307+0000 7fecfcff9700 1 -- 172.21.15.45:0/2778600800 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5355+0+0 (secure 0 0 0) 0x7fecf4075bc0 con 0x7fed00068fe0 2023-12-22T10:02:18.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.307+0000 7fecfcff9700 1 --2- 172.21.15.45:0/2778600800 >> [v2:172.21.15.45:6800/33776,v1:172.21.15.45:6801/33776] conn(0x7fece4060b00 0x7fece4062f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:18.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.307+0000 7fecfcff9700 1 -- 172.21.15.45:0/2778600800 --> [v2:172.21.15.45:6800/33776,v1:172.21.15.45:6801/33776] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fece40635e0 con 0x7fece4060b00 2023-12-22T10:02:18.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.307+0000 7fecfcff9700 1 -- 172.21.15.45:0/2778600800 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7fecf407a220 con 0x7fed00068fe0 2023-12-22T10:02:18.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.307+0000 7fecfffff700 1 --2- 172.21.15.45:0/2778600800 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fece405a510 0x7fece405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:18.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.307+0000 7fed05278700 1 --2- 172.21.15.45:0/2778600800 >> [v2:172.21.15.45:6800/33776,v1:172.21.15.45:6801/33776] conn(0x7fece4060b00 0x7fece4062f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:18.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.307+0000 7fecfffff700 1 --2- 172.21.15.45:0/2778600800 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fece405a510 0x7fece405c9d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7fed000a73c0 tx=0x7fecec007d40).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:18.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.307+0000 7fed05278700 1 --2- 172.21.15.45:0/2778600800 >> [v2:172.21.15.45:6800/33776,v1:172.21.15.45:6801/33776] conn(0x7fece4060b00 0x7fece4062f60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:18.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.311+0000 7fecfcff9700 1 -- 172.21.15.45:0/2778600800 <== osd.2 v2:172.21.15.45:6800/33776 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7fece40635e0 con 0x7fece4060b00 2023-12-22T10:02:18.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.327+0000 7fed06cdb700 1 -- 172.21.15.45:0/2778600800 --> [v2:172.21.15.45:6800/33776,v1:172.21.15.45:6801/33776] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fed00150910 con 0x7fece4060b00 2023-12-22T10:02:18.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.327+0000 7fecfcff9700 1 -- 172.21.15.45:0/2778600800 <== osd.2 v2:172.21.15.45:6800/33776 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fecf8007580 con 0x7fece4060b00 2023-12-22T10:02:18.329 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-22T10:02:18.330 INFO:teuthology.orchestra.run.smithi045.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-12-22T10:02:18.330 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-22T10:02:18.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.331+0000 7fed06cdb700 1 -- 172.21.15.45:0/2778600800 >> [v2:172.21.15.45:6800/33776,v1:172.21.15.45:6801/33776] conn(0x7fece4060b00 msgr2=0x7fece4062f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:18.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.331+0000 7fed06cdb700 1 --2- 172.21.15.45:0/2778600800 >> [v2:172.21.15.45:6800/33776,v1:172.21.15.45:6801/33776] conn(0x7fece4060b00 0x7fece4062f60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:18.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.331+0000 7fed06cdb700 1 -- 172.21.15.45:0/2778600800 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fece405a510 msgr2=0x7fece405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:18.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.331+0000 7fed06cdb700 1 --2- 172.21.15.45:0/2778600800 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fece405a510 0x7fece405c9d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7fed000a73c0 tx=0x7fecec007d40).stop 2023-12-22T10:02:18.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.331+0000 7fed06cdb700 1 -- 172.21.15.45:0/2778600800 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fed00068fe0 msgr2=0x7fed0014a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:18.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.331+0000 7fed06cdb700 1 --2- 172.21.15.45:0/2778600800 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fed00068fe0 0x7fed0014a100 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0x7fecf4009f50 tx=0x7fecf4018000).stop 2023-12-22T10:02:18.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.331+0000 7fed05278700 1 -- 172.21.15.45:0/2778600800 reap_dead start 2023-12-22T10:02:18.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.331+0000 7fed06cdb700 1 -- 172.21.15.45:0/2778600800 shutdown_connections 2023-12-22T10:02:18.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.331+0000 7fed06cdb700 1 -- 172.21.15.45:0/2778600800 >> 172.21.15.45:0/2778600800 conn(0x7fed000c6730 msgr2=0x7fed00148ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:02:18.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.331+0000 7fed06cdb700 1 -- 172.21.15.45:0/2778600800 shutdown_connections 2023-12-22T10:02:18.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.331+0000 7fed06cdb700 1 -- 172.21.15.45:0/2778600800 wait complete. 2023-12-22T10:02:18.350 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-12-22T10:02:18.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.519+0000 7fe61d8f1700 1 Processor -- start 2023-12-22T10:02:18.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.519+0000 7fe61d8f1700 1 -- start start 2023-12-22T10:02:18.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.523+0000 7fe61d8f1700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fe6180c02e0 0x7fe618153e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:18.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.523+0000 7fe61d8f1700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe618067590 0x7fe618154370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:18.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.523+0000 7fe61d8f1700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6180c3c70 con 0x7fe618153aa0 2023-12-22T10:02:18.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.523+0000 7fe61d8f1700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6180c27d0 con 0x7fe618067590 2023-12-22T10:02:18.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.523+0000 7fe61d8f1700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe618065870 con 0x7fe6180c02e0 2023-12-22T10:02:18.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.523+0000 7fe616ffd700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fe618153aa0 0x7fe6180bfbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:53494/0 (socket says 172.21.15.45:53494) 2023-12-22T10:02:18.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.523+0000 7fe616ffd700 1 -- 172.21.15.45:0/2098068504 learned_addr learned my addr 172.21.15.45:0/2098068504 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:02:18.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.523+0000 7fe6177fe700 1 --2- 172.21.15.45:0/2098068504 >> v2:172.21.15.45:3300/0 conn(0x7fe618067590 0x7fe618154370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:18.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.523+0000 7fe60ffff700 1 --2- 172.21.15.45:0/2098068504 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fe6180c02e0 0x7fe618153e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:18.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.523+0000 7fe6167fc700 1 -- 172.21.15.45:0/2098068504 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3237781075 0 0) 0x7fe6180c3c70 con 0x7fe618153aa0 2023-12-22T10:02:18.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.523+0000 7fe6167fc700 1 -- 172.21.15.45:0/2098068504 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6040033f0 con 0x7fe618153aa0 2023-12-22T10:02:18.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.527+0000 7fe6177fe700 1 -- 172.21.15.45:0/2098068504 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fe6180c02e0 msgr2=0x7fe618153e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:02:18.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.527+0000 7fe6177fe700 1 --2- 172.21.15.45:0/2098068504 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fe6180c02e0 0x7fe618153e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:18.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.527+0000 7fe6177fe700 1 -- 172.21.15.45:0/2098068504 >> v1:172.21.15.45:6789/0 conn(0x7fe618153aa0 legacy=0x7fe6180bfbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:18.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.527+0000 7fe6177fe700 1 -- 172.21.15.45:0/2098068504 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe618065b50 con 0x7fe618067590 2023-12-22T10:02:18.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.527+0000 7fe60ffff700 1 --2- 172.21.15.45:0/2098068504 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fe6180c02e0 0x7fe618153e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-12-22T10:02:18.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.527+0000 7fe6177fe700 1 --2- 172.21.15.45:0/2098068504 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe618067590 0x7fe618154370 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 rx=0x7fe610009e60 tx=0x7fe610009780).ready entity=mon.0 client_cookie=a0f59f34377a5353 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:18.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.527+0000 7fe6167fc700 1 -- 172.21.15.45:0/2098068504 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe61000e070 con 0x7fe618067590 2023-12-22T10:02:18.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.527+0000 7fe6167fc700 1 -- 172.21.15.45:0/2098068504 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe61000bab0 con 0x7fe618067590 2023-12-22T10:02:18.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.527+0000 7fe6167fc700 1 -- 172.21.15.45:0/2098068504 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe61000be30 con 0x7fe618067590 2023-12-22T10:02:18.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.527+0000 7fe61d8f1700 1 -- 172.21.15.45:0/2098068504 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe618067590 msgr2=0x7fe618154370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:18.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.527+0000 7fe61d8f1700 1 --2- 172.21.15.45:0/2098068504 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe618067590 0x7fe618154370 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 rx=0x7fe610009e60 tx=0x7fe610009780).stop 2023-12-22T10:02:18.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.527+0000 7fe61d8f1700 1 -- 172.21.15.45:0/2098068504 shutdown_connections 2023-12-22T10:02:18.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.527+0000 7fe61d8f1700 1 --2- 172.21.15.45:0/2098068504 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe618067590 0x7fe618154370 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:18.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.527+0000 7fe61d8f1700 1 --2- 172.21.15.45:0/2098068504 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fe6180c02e0 0x7fe618153e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:18.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.527+0000 7fe61d8f1700 1 -- 172.21.15.45:0/2098068504 >> 172.21.15.45:0/2098068504 conn(0x7fe618066a70 msgr2=0x7fe618066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:02:18.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.527+0000 7fe61d8f1700 1 -- 172.21.15.45:0/2098068504 shutdown_connections 2023-12-22T10:02:18.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.527+0000 7fe61d8f1700 1 -- 172.21.15.45:0/2098068504 wait complete. 2023-12-22T10:02:18.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.531+0000 7fe61d8f1700 1 Processor -- start 2023-12-22T10:02:18.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.531+0000 7fe61d8f1700 1 -- start start 2023-12-22T10:02:18.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.531+0000 7fe61d8f1700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe618067590 0x7fe6181451e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:18.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.531+0000 7fe61d8f1700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe6180c02e0 0x7fe6181499d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:18.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.531+0000 7fe61d8f1700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fe618153aa0 0x7fe618166bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:18.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.531+0000 7fe61d8f1700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe618149ec0 con 0x7fe618067590 2023-12-22T10:02:18.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.531+0000 7fe61d8f1700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6181682c0 con 0x7fe6180c02e0 2023-12-22T10:02:18.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.531+0000 7fe61d8f1700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe61814a0f0 con 0x7fe618153aa0 2023-12-22T10:02:18.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.531+0000 7fe616ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe618067590 0x7fe6181451e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:18.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.531+0000 7fe616ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe618067590 0x7fe6181451e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47056/0 (socket says 172.21.15.45:47056) 2023-12-22T10:02:18.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.531+0000 7fe616ffd700 1 -- 172.21.15.45:0/3522974458 learned_addr learned my addr 172.21.15.45:0/3522974458 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:02:18.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.531+0000 7fe60ffff700 1 --2- 172.21.15.45:0/3522974458 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe6180c02e0 0x7fe6181499d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:18.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.531+0000 7fe6177fe700 1 --2- 172.21.15.45:0/3522974458 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fe618153aa0 0x7fe618166bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:18.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.531+0000 7fe616ffd700 1 -- 172.21.15.45:0/3522974458 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fe618153aa0 msgr2=0x7fe618166bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:18.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.531+0000 7fe616ffd700 1 --2- 172.21.15.45:0/3522974458 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fe618153aa0 0x7fe618166bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:18.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.531+0000 7fe616ffd700 1 -- 172.21.15.45:0/3522974458 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe6180c02e0 msgr2=0x7fe6181499d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:18.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.531+0000 7fe616ffd700 1 --2- 172.21.15.45:0/3522974458 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe6180c02e0 0x7fe6181499d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:18.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.535+0000 7fe616ffd700 1 -- 172.21.15.45:0/3522974458 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6000092a0 con 0x7fe618067590 2023-12-22T10:02:18.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.535+0000 7fe616ffd700 1 --2- 172.21.15.45:0/3522974458 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe618067590 0x7fe6181451e0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 rx=0x7fe60800c420 tx=0x7fe608007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:18.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.535+0000 7fe60effd700 1 -- 172.21.15.45:0/3522974458 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6080070d0 con 0x7fe618067590 2023-12-22T10:02:18.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.535+0000 7fe60effd700 1 -- 172.21.15.45:0/3522974458 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe608007230 con 0x7fe618067590 2023-12-22T10:02:18.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.535+0000 7fe61d8f1700 1 -- 172.21.15.45:0/3522974458 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe610009a20 con 0x7fe618067590 2023-12-22T10:02:18.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.535+0000 7fe60effd700 1 -- 172.21.15.45:0/3522974458 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6080075b0 con 0x7fe618067590 2023-12-22T10:02:18.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.535+0000 7fe61d8f1700 1 -- 172.21.15.45:0/3522974458 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe61814a6b0 con 0x7fe618067590 2023-12-22T10:02:18.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.535+0000 7fe61d8f1700 1 -- 172.21.15.45:0/3522974458 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe61806c070 con 0x7fe618067590 2023-12-22T10:02:18.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.539+0000 7fe60effd700 1 -- 172.21.15.45:0/3522974458 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fe6080059b0 con 0x7fe618067590 2023-12-22T10:02:18.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.539+0000 7fe60effd700 1 --2- 172.21.15.45:0/3522974458 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fe5f805a510 0x7fe5f805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:18.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.539+0000 7fe60effd700 1 -- 172.21.15.45:0/3522974458 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5355+0+0 (secure 0 0 0) 0x7fe608073b20 con 0x7fe618067590 2023-12-22T10:02:18.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.539+0000 7fe60ffff700 1 --2- 172.21.15.45:0/3522974458 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fe5f805a510 0x7fe5f805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:18.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.539+0000 7fe60ffff700 1 --2- 172.21.15.45:0/3522974458 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fe5f805a510 0x7fe5f805c9d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7fe6181515f0 tx=0x7fe600009060).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:18.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.543+0000 7fe60effd700 1 -- 172.21.15.45:0/3522974458 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fe608047600 con 0x7fe618067590 2023-12-22T10:02:18.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.711+0000 7fe61d8f1700 1 -- 172.21.15.45:0/3522974458 --> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7fe618151620 con 0x7fe5f805a510 2023-12-22T10:02:18.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.711+0000 7fe60effd700 1 -- 172.21.15.45:0/3522974458 <== mgr.4104 v2:172.21.15.45:6832/33679 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fe618151620 con 0x7fe5f805a510 2023-12-22T10:02:18.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.715+0000 7fe61d8f1700 1 -- 172.21.15.45:0/3522974458 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fe5f805a510 msgr2=0x7fe5f805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:18.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.715+0000 7fe61d8f1700 1 --2- 172.21.15.45:0/3522974458 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fe5f805a510 0x7fe5f805c9d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7fe6181515f0 tx=0x7fe600009060).stop 2023-12-22T10:02:18.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.715+0000 7fe61d8f1700 1 -- 172.21.15.45:0/3522974458 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe618067590 msgr2=0x7fe6181451e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:18.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.715+0000 7fe61d8f1700 1 --2- 172.21.15.45:0/3522974458 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe618067590 0x7fe6181451e0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 rx=0x7fe60800c420 tx=0x7fe608007c80).stop 2023-12-22T10:02:18.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.715+0000 7fe61d8f1700 1 -- 172.21.15.45:0/3522974458 shutdown_connections 2023-12-22T10:02:18.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.715+0000 7fe61d8f1700 1 --2- 172.21.15.45:0/3522974458 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fe5f805a510 0x7fe5f805c9d0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:18.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.715+0000 7fe61d8f1700 1 --2- 172.21.15.45:0/3522974458 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fe618153aa0 0x7fe618166bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:18.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.715+0000 7fe61d8f1700 1 --2- 172.21.15.45:0/3522974458 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fe6180c02e0 0x7fe6181499d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:18.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.715+0000 7fe61d8f1700 1 --2- 172.21.15.45:0/3522974458 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe618067590 0x7fe6181451e0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:18.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.715+0000 7fe61d8f1700 1 -- 172.21.15.45:0/3522974458 >> 172.21.15.45:0/3522974458 conn(0x7fe618066a70 msgr2=0x7fe618150b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:02:18.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.715+0000 7fe61d8f1700 1 -- 172.21.15.45:0/3522974458 shutdown_connections 2023-12-22T10:02:18.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.715+0000 7fe61d8f1700 1 -- 172.21.15.45:0/3522974458 wait complete. 2023-12-22T10:02:18.722 INFO:teuthology.orchestra.run.smithi045.stderr:instructed osd(s) 2 to deep-scrub 2023-12-22T10:02:18.737 INFO:tasks.ceph:Scrubbing osd.3 2023-12-22T10:02:18.737 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-12-22T10:02:18.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.911+0000 7f70bf89b700 1 Processor -- start 2023-12-22T10:02:18.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.911+0000 7f70bf89b700 1 -- start start 2023-12-22T10:02:18.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.915+0000 7f70bf89b700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f70b80ac2d0 0x7f70b80c5900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:18.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.915+0000 7f70bf89b700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f70b80aa660 0x7f70b80c7430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:18.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.915+0000 7f70bf89b700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70b80c8d50 con 0x7f70b80ac6b0 2023-12-22T10:02:18.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.915+0000 7f70bf89b700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70b80c95f0 con 0x7f70b80ac2d0 2023-12-22T10:02:18.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.915+0000 7f70bf89b700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70b80acb10 con 0x7f70b80aa660 2023-12-22T10:02:18.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.919+0000 7f70bd637700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f70b80ac2d0 0x7f70b80c5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:18.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.919+0000 7f70bd637700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f70b80ac2d0 0x7f70b80c5900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.45:41040/0 (socket says 172.21.15.45:41040) 2023-12-22T10:02:18.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.919+0000 7f70bd637700 1 -- 172.21.15.45:0/1122082689 learned_addr learned my addr 172.21.15.45:0/1122082689 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:02:18.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.919+0000 7f70bde38700 1 --2- 172.21.15.45:0/1122082689 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f70b80aa660 0x7f70b80c7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:18.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.919+0000 7f70bd637700 1 -- 172.21.15.45:0/1122082689 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f70b80aa660 msgr2=0x7f70b80c7430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:02:18.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.919+0000 7f70bd637700 1 --2- 172.21.15.45:0/1122082689 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f70b80aa660 0x7f70b80c7430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:18.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.919+0000 7f70bd637700 1 -- 172.21.15.45:0/1122082689 >> v1:172.21.15.113:6789/0 conn(0x7f70b80ac6b0 legacy=0x7f70b8158050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:18.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.919+0000 7f70bd637700 1 -- 172.21.15.45:0/1122082689 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70b80aaaf0 con 0x7f70b80ac2d0 2023-12-22T10:02:18.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.919+0000 7f70bd637700 1 --2- 172.21.15.45:0/1122082689 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f70b80ac2d0 0x7f70b80c5900 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7f70b4006fd0 tx=0x7f70b40090f0).ready entity=mon.1 client_cookie=5137f35a9bb50191 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:18.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.919+0000 7f70affff700 1 -- 172.21.15.45:0/1122082689 <== mon.1 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b400b580 con 0x7f70b80ac2d0 2023-12-22T10:02:18.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.919+0000 7f70affff700 1 -- 172.21.15.45:0/1122082689 <== mon.1 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70b400b6e0 con 0x7f70b80ac2d0 2023-12-22T10:02:18.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.919+0000 7f70affff700 1 -- 172.21.15.45:0/1122082689 <== mon.1 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b400ba60 con 0x7f70b80ac2d0 2023-12-22T10:02:18.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.919+0000 7f70bf89b700 1 -- 172.21.15.45:0/1122082689 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f70b80ac2d0 msgr2=0x7f70b80c5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:18.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.919+0000 7f70bf89b700 1 --2- 172.21.15.45:0/1122082689 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f70b80ac2d0 0x7f70b80c5900 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7f70b4006fd0 tx=0x7f70b40090f0).stop 2023-12-22T10:02:18.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.919+0000 7f70bf89b700 1 -- 172.21.15.45:0/1122082689 shutdown_connections 2023-12-22T10:02:18.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.919+0000 7f70bf89b700 1 --2- 172.21.15.45:0/1122082689 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f70b80aa660 0x7f70b80c7430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:18.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.919+0000 7f70bf89b700 1 --2- 172.21.15.45:0/1122082689 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f70b80ac2d0 0x7f70b80c5900 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:18.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.919+0000 7f70bf89b700 1 -- 172.21.15.45:0/1122082689 >> 172.21.15.45:0/1122082689 conn(0x7f70b8082a50 msgr2=0x7f70b8066a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:02:18.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.919+0000 7f70bf89b700 1 -- 172.21.15.45:0/1122082689 shutdown_connections 2023-12-22T10:02:18.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.923+0000 7f70bf89b700 1 -- 172.21.15.45:0/1122082689 wait complete. 2023-12-22T10:02:18.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.923+0000 7f70bf89b700 1 Processor -- start 2023-12-22T10:02:18.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.923+0000 7f70bf89b700 1 -- start start 2023-12-22T10:02:18.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.923+0000 7f70bf89b700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f70b80aa660 0x7f70b81542e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:18.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.923+0000 7f70bf89b700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f70b80ac2d0 0x7f70b8155c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:18.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.923+0000 7f70bf89b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70b80ac6b0 0x7f70b80adf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:18.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.923+0000 7f70bf89b700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b8157040 con 0x7f70b80ac6b0 2023-12-22T10:02:18.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.923+0000 7f70bf89b700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b81547d0 con 0x7f70b80ac2d0 2023-12-22T10:02:18.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.923+0000 7f70bf89b700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70b8156160 con 0x7f70b80aa660 2023-12-22T10:02:18.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.923+0000 7f70bde38700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70b80ac6b0 0x7f70b80adf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:18.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.923+0000 7f70bde38700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70b80ac6b0 0x7f70b80adf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47062/0 (socket says 172.21.15.45:47062) 2023-12-22T10:02:18.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.923+0000 7f70bde38700 1 -- 172.21.15.45:0/896004123 learned_addr learned my addr 172.21.15.45:0/896004123 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:02:18.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.927+0000 7f70bd637700 1 --2- 172.21.15.45:0/896004123 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f70b80aa660 0x7f70b81542e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:18.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.927+0000 7f70bce36700 1 --2- 172.21.15.45:0/896004123 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f70b80ac2d0 0x7f70b8155c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:18.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.927+0000 7f70bde38700 1 -- 172.21.15.45:0/896004123 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f70b80aa660 msgr2=0x7f70b81542e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:18.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.927+0000 7f70bde38700 1 --2- 172.21.15.45:0/896004123 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f70b80aa660 0x7f70b81542e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:18.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.927+0000 7f70bde38700 1 -- 172.21.15.45:0/896004123 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f70b80ac2d0 msgr2=0x7f70b8155c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:18.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.927+0000 7f70bde38700 1 --2- 172.21.15.45:0/896004123 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f70b80ac2d0 0x7f70b8155c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:18.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.927+0000 7f70bde38700 1 -- 172.21.15.45:0/896004123 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70b4009370 con 0x7f70b80ac6b0 2023-12-22T10:02:18.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.927+0000 7f70bde38700 1 --2- 172.21.15.45:0/896004123 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70b80ac6b0 0x7f70b80adf40 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 rx=0x7f70b0009e90 tx=0x7f70b000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:18.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.927+0000 7f70ad7fa700 1 -- 172.21.15.45:0/896004123 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b000cc20 con 0x7f70b80ac6b0 2023-12-22T10:02:18.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.927+0000 7f70ad7fa700 1 -- 172.21.15.45:0/896004123 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70b000f040 con 0x7f70b80ac6b0 2023-12-22T10:02:18.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.927+0000 7f70ad7fa700 1 -- 172.21.15.45:0/896004123 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b0013400 con 0x7f70b80ac6b0 2023-12-22T10:02:18.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.927+0000 7f70bf89b700 1 -- 172.21.15.45:0/896004123 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70b8156430 con 0x7f70b80ac6b0 2023-12-22T10:02:18.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.927+0000 7f70bf89b700 1 -- 172.21.15.45:0/896004123 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70b81569f0 con 0x7f70b80ac6b0 2023-12-22T10:02:18.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.927+0000 7f70bf89b700 1 -- 172.21.15.45:0/896004123 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f70b806c070 con 0x7f70b80ac6b0 2023-12-22T10:02:18.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.931+0000 7f70ad7fa700 1 -- 172.21.15.45:0/896004123 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f70b00137b0 con 0x7f70b80ac6b0 2023-12-22T10:02:18.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.931+0000 7f70ad7fa700 1 --2- 172.21.15.45:0/896004123 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f709c05a510 0x7f709c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:18.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.931+0000 7f70ad7fa700 1 -- 172.21.15.45:0/896004123 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f70b0074de0 con 0x7f70b80ac6b0 2023-12-22T10:02:18.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.931+0000 7f70bd637700 1 --2- 172.21.15.45:0/896004123 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f709c05a510 0x7f709c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:18.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.931+0000 7f70ad7fa700 1 --2- 172.21.15.45:0/896004123 >> [v2:172.21.15.45:6816/33782,v1:172.21.15.45:6817/33782] conn(0x7f709c060b00 0x7f709c062f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:18.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.931+0000 7f70ad7fa700 1 -- 172.21.15.45:0/896004123 --> [v2:172.21.15.45:6816/33782,v1:172.21.15.45:6817/33782] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f709c0635e0 con 0x7f709c060b00 2023-12-22T10:02:18.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.931+0000 7f70ad7fa700 1 -- 172.21.15.45:0/896004123 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f70b0077400 con 0x7f70b80ac6b0 2023-12-22T10:02:18.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.931+0000 7f70bce36700 1 --2- 172.21.15.45:0/896004123 >> [v2:172.21.15.45:6816/33782,v1:172.21.15.45:6817/33782] conn(0x7f709c060b00 0x7f709c062f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:18.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.931+0000 7f70bd637700 1 --2- 172.21.15.45:0/896004123 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f709c05a510 0x7f709c05c9d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7f70b4009130 tx=0x7f70b4017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:18.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.931+0000 7f70bce36700 1 --2- 172.21.15.45:0/896004123 >> [v2:172.21.15.45:6816/33782,v1:172.21.15.45:6817/33782] conn(0x7f709c060b00 0x7f709c062f60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:18.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.935+0000 7f70ad7fa700 1 -- 172.21.15.45:0/896004123 <== osd.3 v2:172.21.15.45:6816/33782 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7f709c0635e0 con 0x7f709c060b00 2023-12-22T10:02:18.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.951+0000 7f70bf89b700 1 -- 172.21.15.45:0/896004123 --> [v2:172.21.15.45:6816/33782,v1:172.21.15.45:6817/33782] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f70b80c8750 con 0x7f709c060b00 2023-12-22T10:02:18.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.951+0000 7f70ad7fa700 1 -- 172.21.15.45:0/896004123 <== osd.3 v2:172.21.15.45:6816/33782 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f70b80c8750 con 0x7f709c060b00 2023-12-22T10:02:18.953 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-22T10:02:18.953 INFO:teuthology.orchestra.run.smithi045.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-12-22T10:02:18.953 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-22T10:02:18.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.951+0000 7f70bf89b700 1 -- 172.21.15.45:0/896004123 >> [v2:172.21.15.45:6816/33782,v1:172.21.15.45:6817/33782] conn(0x7f709c060b00 msgr2=0x7f709c062f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:18.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.955+0000 7f70bf89b700 1 --2- 172.21.15.45:0/896004123 >> [v2:172.21.15.45:6816/33782,v1:172.21.15.45:6817/33782] conn(0x7f709c060b00 0x7f709c062f60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:18.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.955+0000 7f70bf89b700 1 -- 172.21.15.45:0/896004123 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f709c05a510 msgr2=0x7f709c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:18.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.955+0000 7f70bf89b700 1 --2- 172.21.15.45:0/896004123 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f709c05a510 0x7f709c05c9d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7f70b4009130 tx=0x7f70b4017000).stop 2023-12-22T10:02:18.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.955+0000 7f70bf89b700 1 -- 172.21.15.45:0/896004123 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70b80ac6b0 msgr2=0x7f70b80adf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:18.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.955+0000 7f70bf89b700 1 --2- 172.21.15.45:0/896004123 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70b80ac6b0 0x7f70b80adf40 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 rx=0x7f70b0009e90 tx=0x7f70b000b040).stop 2023-12-22T10:02:18.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.955+0000 7f70bde38700 1 -- 172.21.15.45:0/896004123 reap_dead start 2023-12-22T10:02:18.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.955+0000 7f70bf89b700 1 -- 172.21.15.45:0/896004123 shutdown_connections 2023-12-22T10:02:18.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.955+0000 7f70bf89b700 1 -- 172.21.15.45:0/896004123 >> 172.21.15.45:0/896004123 conn(0x7f70b8082a50 msgr2=0x7f70b80c7430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:02:18.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.955+0000 7f70bf89b700 1 -- 172.21.15.45:0/896004123 shutdown_connections 2023-12-22T10:02:18.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:18.955+0000 7f70bf89b700 1 -- 172.21.15.45:0/896004123 wait complete. 2023-12-22T10:02:18.974 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-12-22T10:02:19.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.147+0000 7fd27ef07700 1 Processor -- start 2023-12-22T10:02:19.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.151+0000 7fd27ef07700 1 -- start start 2023-12-22T10:02:19.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.151+0000 7fd27ef07700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd2780bbd80 0x7fd2780bc160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:19.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.151+0000 7fd27ef07700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fd278065780 0x7fd2780c0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:19.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.151+0000 7fd27ef07700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2780c2400 con 0x7fd278157940 2023-12-22T10:02:19.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.151+0000 7fd27ef07700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd278069a90 con 0x7fd2780bbd80 2023-12-22T10:02:19.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.151+0000 7fd27ef07700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd278065bc0 con 0x7fd278065780 2023-12-22T10:02:19.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.155+0000 7fd27df05700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd2780bbd80 0x7fd2780bc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:19.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.155+0000 7fd27df05700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd2780bbd80 0x7fd2780bc160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47070/0 (socket says 172.21.15.45:47070) 2023-12-22T10:02:19.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.155+0000 7fd27df05700 1 -- 172.21.15.45:0/4243139625 learned_addr learned my addr 172.21.15.45:0/4243139625 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:02:19.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.155+0000 7fd27d704700 1 --2- 172.21.15.45:0/4243139625 >> v2:172.21.15.113:3300/0 conn(0x7fd278065780 0x7fd2780c0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:19.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.155+0000 7fd27e706700 1 --1- 172.21.15.45:0/4243139625 >> v1:172.21.15.45:6789/0 conn(0x7fd278157940 0x7fd278157d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:53502/0 (socket says 172.21.15.45:53502) 2023-12-22T10:02:19.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.155+0000 7fd27df05700 1 -- 172.21.15.45:0/4243139625 >> v2:172.21.15.113:3300/0 conn(0x7fd278065780 msgr2=0x7fd2780c0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:02:19.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.155+0000 7fd27df05700 1 --2- 172.21.15.45:0/4243139625 >> v2:172.21.15.113:3300/0 conn(0x7fd278065780 0x7fd2780c0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:19.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.155+0000 7fd27df05700 1 -- 172.21.15.45:0/4243139625 >> v1:172.21.15.45:6789/0 conn(0x7fd278157940 legacy=0x7fd278157d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:19.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.155+0000 7fd27df05700 1 -- 172.21.15.45:0/4243139625 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2780c17f0 con 0x7fd2780bbd80 2023-12-22T10:02:19.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.155+0000 7fd27cf03700 1 -- 172.21.15.45:0/4243139625 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1131448622 0 0) 0x7fd2780c2400 con 0x7fd278157940 2023-12-22T10:02:19.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.155+0000 7fd27df05700 1 --2- 172.21.15.45:0/4243139625 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2780bbd80 0x7fd2780bc160 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 rx=0x7fd2780634c0 tx=0x7fd2740090f0).ready entity=mon.0 client_cookie=c872454e6a82924a server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:19.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.155+0000 7fd27cf03700 1 -- 172.21.15.45:0/4243139625 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd27400b520 con 0x7fd2780bbd80 2023-12-22T10:02:19.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.155+0000 7fd27cf03700 1 -- 172.21.15.45:0/4243139625 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd27400b680 con 0x7fd2780bbd80 2023-12-22T10:02:19.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.155+0000 7fd27cf03700 1 -- 172.21.15.45:0/4243139625 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd27400ba00 con 0x7fd2780bbd80 2023-12-22T10:02:19.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.155+0000 7fd27ef07700 1 -- 172.21.15.45:0/4243139625 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2780bbd80 msgr2=0x7fd2780bc160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:19.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.155+0000 7fd27ef07700 1 --2- 172.21.15.45:0/4243139625 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2780bbd80 0x7fd2780bc160 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 rx=0x7fd2780634c0 tx=0x7fd2740090f0).stop 2023-12-22T10:02:19.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.155+0000 7fd27ef07700 1 -- 172.21.15.45:0/4243139625 shutdown_connections 2023-12-22T10:02:19.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.155+0000 7fd27ef07700 1 --2- 172.21.15.45:0/4243139625 >> v2:172.21.15.113:3300/0 conn(0x7fd278065780 0x7fd2780c0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:19.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.155+0000 7fd27ef07700 1 --2- 172.21.15.45:0/4243139625 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2780bbd80 0x7fd2780bc160 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:19.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.155+0000 7fd27ef07700 1 -- 172.21.15.45:0/4243139625 >> 172.21.15.45:0/4243139625 conn(0x7fd278067500 msgr2=0x7fd2780c6400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:02:19.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.155+0000 7fd27ef07700 1 -- 172.21.15.45:0/4243139625 shutdown_connections 2023-12-22T10:02:19.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.155+0000 7fd27ef07700 1 -- 172.21.15.45:0/4243139625 wait complete. 2023-12-22T10:02:19.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.159+0000 7fd27ef07700 1 Processor -- start 2023-12-22T10:02:19.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.159+0000 7fd27ef07700 1 -- start start 2023-12-22T10:02:19.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.159+0000 7fd27ef07700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd278065780 0x7fd2780aa860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:19.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.159+0000 7fd27ef07700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd2780bbd80 0x7fd2780c3510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:19.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.159+0000 7fd27ef07700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd278157940 0x7fd27816c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:19.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.159+0000 7fd27ef07700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2780bdc10 con 0x7fd278157940 2023-12-22T10:02:19.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.159+0000 7fd27ef07700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd27815b340 con 0x7fd278065780 2023-12-22T10:02:19.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.159+0000 7fd27ef07700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd27816cbe0 con 0x7fd2780bbd80 2023-12-22T10:02:19.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.159+0000 7fd27e706700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd278157940 0x7fd27816c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:19.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.159+0000 7fd27df05700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd278065780 0x7fd2780aa860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:19.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.159+0000 7fd27d704700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd2780bbd80 0x7fd2780c3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:19.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.159+0000 7fd27e706700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd278157940 0x7fd27816c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47086/0 (socket says 172.21.15.45:47086) 2023-12-22T10:02:19.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.159+0000 7fd27df05700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd278065780 0x7fd2780aa860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.45:41064/0 (socket says 172.21.15.45:41064) 2023-12-22T10:02:19.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.159+0000 7fd27e706700 1 -- 172.21.15.45:0/3005131929 learned_addr learned my addr 172.21.15.45:0/3005131929 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:02:19.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.163+0000 7fd27e706700 1 -- 172.21.15.45:0/3005131929 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd2780bbd80 msgr2=0x7fd2780c3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:19.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.163+0000 7fd27e706700 1 --2- 172.21.15.45:0/3005131929 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd2780bbd80 0x7fd2780c3510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:19.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.163+0000 7fd27e706700 1 -- 172.21.15.45:0/3005131929 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd278065780 msgr2=0x7fd2780aa860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:19.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.163+0000 7fd27e706700 1 --2- 172.21.15.45:0/3005131929 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd278065780 0x7fd2780aa860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:19.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.163+0000 7fd27e706700 1 -- 172.21.15.45:0/3005131929 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd274009370 con 0x7fd278157940 2023-12-22T10:02:19.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.163+0000 7fd27df05700 1 --2- 172.21.15.45:0/3005131929 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd278065780 0x7fd2780aa860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-12-22T10:02:19.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.163+0000 7fd27e706700 1 --2- 172.21.15.45:0/3005131929 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd278157940 0x7fd27816c020 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 rx=0x7fd27000c730 tx=0x7fd270001520).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:19.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.163+0000 7fd26dffb700 1 -- 172.21.15.45:0/3005131929 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd270005c70 con 0x7fd278157940 2023-12-22T10:02:19.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.163+0000 7fd26dffb700 1 -- 172.21.15.45:0/3005131929 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd270005dd0 con 0x7fd278157940 2023-12-22T10:02:19.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.163+0000 7fd26dffb700 1 -- 172.21.15.45:0/3005131929 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd270007300 con 0x7fd278157940 2023-12-22T10:02:19.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.163+0000 7fd27ef07700 1 -- 172.21.15.45:0/3005131929 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd27816cec0 con 0x7fd278157940 2023-12-22T10:02:19.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.163+0000 7fd27ef07700 1 -- 172.21.15.45:0/3005131929 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2780bd8a0 con 0x7fd278157940 2023-12-22T10:02:19.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.163+0000 7fd27ef07700 1 -- 172.21.15.45:0/3005131929 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2780bdd80 con 0x7fd278157940 2023-12-22T10:02:19.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.167+0000 7fd26dffb700 1 -- 172.21.15.45:0/3005131929 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fd2700076b0 con 0x7fd278157940 2023-12-22T10:02:19.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.167+0000 7fd26dffb700 1 --2- 172.21.15.45:0/3005131929 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fd25c05a510 0x7fd25c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:19.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.167+0000 7fd26dffb700 1 -- 172.21.15.45:0/3005131929 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5355+0+0 (secure 0 0 0) 0x7fd270073dd0 con 0x7fd278157940 2023-12-22T10:02:19.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.167+0000 7fd27df05700 1 --2- 172.21.15.45:0/3005131929 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fd25c05a510 0x7fd25c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:19.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.167+0000 7fd27df05700 1 --2- 172.21.15.45:0/3005131929 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fd25c05a510 0x7fd25c05c9d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7fd274009130 tx=0x7fd274017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:19.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.175+0000 7fd26dffb700 1 -- 172.21.15.45:0/3005131929 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd2700478b0 con 0x7fd278157940 2023-12-22T10:02:19.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.339+0000 7fd27ef07700 1 -- 172.21.15.45:0/3005131929 --> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7fd278047060 con 0x7fd25c05a510 2023-12-22T10:02:19.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.339+0000 7fd26dffb700 1 -- 172.21.15.45:0/3005131929 <== mgr.4104 v2:172.21.15.45:6832/33679 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd278047060 con 0x7fd25c05a510 2023-12-22T10:02:19.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.343+0000 7fd27ef07700 1 -- 172.21.15.45:0/3005131929 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fd25c05a510 msgr2=0x7fd25c05c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:19.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.343+0000 7fd27ef07700 1 --2- 172.21.15.45:0/3005131929 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fd25c05a510 0x7fd25c05c9d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7fd274009130 tx=0x7fd274017000).stop 2023-12-22T10:02:19.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.343+0000 7fd27ef07700 1 -- 172.21.15.45:0/3005131929 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd278157940 msgr2=0x7fd27816c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:19.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.343+0000 7fd27ef07700 1 --2- 172.21.15.45:0/3005131929 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd278157940 0x7fd27816c020 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 rx=0x7fd27000c730 tx=0x7fd270001520).stop 2023-12-22T10:02:19.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.343+0000 7fd27ef07700 1 -- 172.21.15.45:0/3005131929 shutdown_connections 2023-12-22T10:02:19.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.343+0000 7fd27ef07700 1 --2- 172.21.15.45:0/3005131929 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd278157940 0x7fd27816c020 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:19.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.343+0000 7fd27ef07700 1 --2- 172.21.15.45:0/3005131929 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fd25c05a510 0x7fd25c05c9d0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:19.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.343+0000 7fd27ef07700 1 --2- 172.21.15.45:0/3005131929 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd2780bbd80 0x7fd2780c3510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:19.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.343+0000 7fd27ef07700 1 --2- 172.21.15.45:0/3005131929 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd278065780 0x7fd2780aa860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:19.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.343+0000 7fd27ef07700 1 -- 172.21.15.45:0/3005131929 >> 172.21.15.45:0/3005131929 conn(0x7fd278067500 msgr2=0x7fd278152920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:02:19.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.343+0000 7fd27ef07700 1 -- 172.21.15.45:0/3005131929 shutdown_connections 2023-12-22T10:02:19.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.343+0000 7fd27ef07700 1 -- 172.21.15.45:0/3005131929 wait complete. 2023-12-22T10:02:19.345 INFO:teuthology.orchestra.run.smithi045.stderr:instructed osd(s) 3 to deep-scrub 2023-12-22T10:02:19.362 INFO:tasks.ceph:Scrubbing osd.4 2023-12-22T10:02:19.363 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-12-22T10:02:19.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.531+0000 7f974aab9700 1 Processor -- start 2023-12-22T10:02:19.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.531+0000 7f974aab9700 1 -- start start 2023-12-22T10:02:19.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.535+0000 7f974aab9700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f97440a8ba0 0x7f97441584a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:19.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.535+0000 7f974aab9700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f97440c5330 0x7f97440c1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:19.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.535+0000 7f974aab9700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97441594c0 con 0x7f9744065890 2023-12-22T10:02:19.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.535+0000 7f974aab9700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97440c11e0 con 0x7f97440c5330 2023-12-22T10:02:19.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.535+0000 7f974aab9700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9744068aa0 con 0x7f97440a8ba0 2023-12-22T10:02:19.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.535+0000 7f9749ab7700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f97440a8ba0 0x7f97441584a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:19.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.535+0000 7f97492b6700 1 --1- >> v1:172.21.15.113:6789/0 conn(0x7f9744065890 0x7f97440c4c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.113:6789/0 says I am v1:172.21.15.45:49804/0 (socket says 172.21.15.45:49804) 2023-12-22T10:02:19.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.535+0000 7f97492b6700 1 -- 172.21.15.45:0/1268316016 learned_addr learned my addr 172.21.15.45:0/1268316016 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:02:19.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.535+0000 7f974a2b8700 1 --2- 172.21.15.45:0/1268316016 >> v2:172.21.15.113:3300/0 conn(0x7f97440c5330 0x7f97440c1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:19.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.535+0000 7f9749ab7700 1 -- 172.21.15.45:0/1268316016 >> v2:172.21.15.113:3300/0 conn(0x7f97440c5330 msgr2=0x7f97440c1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:02:19.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.535+0000 7f9749ab7700 1 --2- 172.21.15.45:0/1268316016 >> v2:172.21.15.113:3300/0 conn(0x7f97440c5330 0x7f97440c1bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:19.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.535+0000 7f9749ab7700 1 -- 172.21.15.45:0/1268316016 >> v1:172.21.15.113:6789/0 conn(0x7f9744065890 legacy=0x7f97440c4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:19.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.535+0000 7f9749ab7700 1 -- 172.21.15.45:0/1268316016 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9744158f00 con 0x7f97440a8ba0 2023-12-22T10:02:19.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.535+0000 7f9749ab7700 1 --2- 172.21.15.45:0/1268316016 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f97440a8ba0 0x7f97441584a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f9740009760 tx=0x7f9740009060).ready entity=mon.2 client_cookie=b6751df52c3211d0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:19.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.535+0000 7f9748ab5700 1 -- 172.21.15.45:0/1268316016 <== mon.2 v2:172.21.15.113:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f974000b580 con 0x7f97440a8ba0 2023-12-22T10:02:19.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.535+0000 7f9748ab5700 1 -- 172.21.15.45:0/1268316016 <== mon.2 v2:172.21.15.113:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f974000b6e0 con 0x7f97440a8ba0 2023-12-22T10:02:19.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.535+0000 7f9748ab5700 1 -- 172.21.15.45:0/1268316016 <== mon.2 v2:172.21.15.113:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f974000ba60 con 0x7f97440a8ba0 2023-12-22T10:02:19.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.539+0000 7f974aab9700 1 -- 172.21.15.45:0/1268316016 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f97440a8ba0 msgr2=0x7f97441584a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:19.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.539+0000 7f974aab9700 1 --2- 172.21.15.45:0/1268316016 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f97440a8ba0 0x7f97441584a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f9740009760 tx=0x7f9740009060).stop 2023-12-22T10:02:19.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.539+0000 7f974aab9700 1 -- 172.21.15.45:0/1268316016 shutdown_connections 2023-12-22T10:02:19.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.539+0000 7f974aab9700 1 --2- 172.21.15.45:0/1268316016 >> v2:172.21.15.113:3300/0 conn(0x7f97440c5330 0x7f97440c1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:19.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.539+0000 7f974aab9700 1 --2- 172.21.15.45:0/1268316016 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f97440a8ba0 0x7f97441584a0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:19.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.539+0000 7f974aab9700 1 -- 172.21.15.45:0/1268316016 >> 172.21.15.45:0/1268316016 conn(0x7f9744067500 msgr2=0x7f97440c6440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:02:19.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.539+0000 7f974aab9700 1 -- 172.21.15.45:0/1268316016 shutdown_connections 2023-12-22T10:02:19.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.539+0000 7f974aab9700 1 -- 172.21.15.45:0/1268316016 wait complete. 2023-12-22T10:02:19.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.539+0000 7f974aab9700 1 Processor -- start 2023-12-22T10:02:19.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.539+0000 7f974aab9700 1 -- start start 2023-12-22T10:02:19.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.539+0000 7f974aab9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9744065890 0x7f974415c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:19.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.539+0000 7f974aab9700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f97440a8ba0 0x7f97440bf910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:19.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.543+0000 7f974aab9700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f97440c5330 0x7f9744155560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:19.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.543+0000 7f974aab9700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97440c0490 con 0x7f9744065890 2023-12-22T10:02:19.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.543+0000 7f974aab9700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9744168840 con 0x7f97440a8ba0 2023-12-22T10:02:19.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.543+0000 7f974aab9700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97440c01b0 con 0x7f97440c5330 2023-12-22T10:02:19.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.543+0000 7f9749ab7700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9744065890 0x7f974415c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:19.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.543+0000 7f9749ab7700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9744065890 0x7f974415c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47098/0 (socket says 172.21.15.45:47098) 2023-12-22T10:02:19.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.543+0000 7f9749ab7700 1 -- 172.21.15.45:0/3442722034 learned_addr learned my addr 172.21.15.45:0/3442722034 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:02:19.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.543+0000 7f97492b6700 1 --2- 172.21.15.45:0/3442722034 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f97440a8ba0 0x7f97440bf910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:19.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.543+0000 7f974a2b8700 1 --2- 172.21.15.45:0/3442722034 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f97440c5330 0x7f9744155560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:19.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.543+0000 7f9749ab7700 1 -- 172.21.15.45:0/3442722034 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f97440c5330 msgr2=0x7f9744155560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:19.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.543+0000 7f9749ab7700 1 --2- 172.21.15.45:0/3442722034 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f97440c5330 0x7f9744155560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:19.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.543+0000 7f9749ab7700 1 -- 172.21.15.45:0/3442722034 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f97440a8ba0 msgr2=0x7f97440bf910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:19.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.543+0000 7f9749ab7700 1 --2- 172.21.15.45:0/3442722034 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f97440a8ba0 0x7f97440bf910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:19.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.543+0000 7f9749ab7700 1 -- 172.21.15.45:0/3442722034 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97400092a0 con 0x7f9744065890 2023-12-22T10:02:19.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.543+0000 7f974a2b8700 1 --2- 172.21.15.45:0/3442722034 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f97440c5330 0x7f9744155560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T10:02:19.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.543+0000 7f9749ab7700 1 --2- 172.21.15.45:0/3442722034 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9744065890 0x7f974415c620 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 rx=0x7f97440c1320 tx=0x7f9740017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:19.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.543+0000 7f9739ffb700 1 -- 172.21.15.45:0/3442722034 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f974000b850 con 0x7f9744065890 2023-12-22T10:02:19.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.543+0000 7f9739ffb700 1 -- 172.21.15.45:0/3442722034 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f974000b9b0 con 0x7f9744065890 2023-12-22T10:02:19.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.543+0000 7f974aab9700 1 -- 172.21.15.45:0/3442722034 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9744168a50 con 0x7f9744065890 2023-12-22T10:02:19.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.543+0000 7f9739ffb700 1 -- 172.21.15.45:0/3442722034 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f974001b660 con 0x7f9744065890 2023-12-22T10:02:19.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.543+0000 7f974aab9700 1 -- 172.21.15.45:0/3442722034 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9744169090 con 0x7f9744065890 2023-12-22T10:02:19.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.543+0000 7f974aab9700 1 -- 172.21.15.45:0/3442722034 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f97440bff20 con 0x7f9744065890 2023-12-22T10:02:19.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.547+0000 7f9739ffb700 1 -- 172.21.15.45:0/3442722034 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f974001ba50 con 0x7f9744065890 2023-12-22T10:02:19.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.547+0000 7f9739ffb700 1 --2- 172.21.15.45:0/3442722034 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f972805a510 0x7f972805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:19.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.547+0000 7f9739ffb700 1 -- 172.21.15.45:0/3442722034 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f9740076170 con 0x7f9744065890 2023-12-22T10:02:19.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.547+0000 7f97492b6700 1 --2- 172.21.15.45:0/3442722034 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f972805a510 0x7f972805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:19.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.547+0000 7f9739ffb700 1 --2- 172.21.15.45:0/3442722034 >> [v2:172.21.15.113:6809/34099,v1:172.21.15.113:6811/34099] conn(0x7f9728060b00 0x7f9728062f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:19.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.547+0000 7f9739ffb700 1 -- 172.21.15.45:0/3442722034 --> [v2:172.21.15.113:6809/34099,v1:172.21.15.113:6811/34099] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f97280635e0 con 0x7f9728060b00 2023-12-22T10:02:19.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.547+0000 7f9739ffb700 1 -- 172.21.15.45:0/3442722034 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f97400786d0 con 0x7f9744065890 2023-12-22T10:02:19.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.551+0000 7f97492b6700 1 --2- 172.21.15.45:0/3442722034 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f972805a510 0x7f972805c9d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7f9734007fd0 tx=0x7f9734007d30).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:19.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.551+0000 7f974a2b8700 1 --2- 172.21.15.45:0/3442722034 >> [v2:172.21.15.113:6809/34099,v1:172.21.15.113:6811/34099] conn(0x7f9728060b00 0x7f9728062f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:19.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.551+0000 7f974a2b8700 1 --2- 172.21.15.45:0/3442722034 >> [v2:172.21.15.113:6809/34099,v1:172.21.15.113:6811/34099] conn(0x7f9728060b00 0x7f9728062f60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:19.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.551+0000 7f9739ffb700 1 -- 172.21.15.45:0/3442722034 <== osd.4 v2:172.21.15.113:6809/34099 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7f97280635e0 con 0x7f9728060b00 2023-12-22T10:02:19.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.571+0000 7f974aab9700 1 -- 172.21.15.45:0/3442722034 --> [v2:172.21.15.113:6809/34099,v1:172.21.15.113:6811/34099] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f9744047060 con 0x7f9728060b00 2023-12-22T10:02:19.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.571+0000 7f9739ffb700 1 -- 172.21.15.45:0/3442722034 <== osd.4 v2:172.21.15.113:6809/34099 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f9744047060 con 0x7f9728060b00 2023-12-22T10:02:19.571 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-22T10:02:19.571 INFO:teuthology.orchestra.run.smithi045.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-12-22T10:02:19.572 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-22T10:02:19.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.571+0000 7f974aab9700 1 -- 172.21.15.45:0/3442722034 >> [v2:172.21.15.113:6809/34099,v1:172.21.15.113:6811/34099] conn(0x7f9728060b00 msgr2=0x7f9728062f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:19.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.571+0000 7f974aab9700 1 --2- 172.21.15.45:0/3442722034 >> [v2:172.21.15.113:6809/34099,v1:172.21.15.113:6811/34099] conn(0x7f9728060b00 0x7f9728062f60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:19.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.571+0000 7f974aab9700 1 -- 172.21.15.45:0/3442722034 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f972805a510 msgr2=0x7f972805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:19.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.571+0000 7f974aab9700 1 --2- 172.21.15.45:0/3442722034 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f972805a510 0x7f972805c9d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7f9734007fd0 tx=0x7f9734007d30).stop 2023-12-22T10:02:19.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.571+0000 7f974aab9700 1 -- 172.21.15.45:0/3442722034 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9744065890 msgr2=0x7f974415c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:19.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.571+0000 7f974aab9700 1 --2- 172.21.15.45:0/3442722034 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9744065890 0x7f974415c620 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 rx=0x7f97440c1320 tx=0x7f9740017000).stop 2023-12-22T10:02:19.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.571+0000 7f974a2b8700 1 -- 172.21.15.45:0/3442722034 reap_dead start 2023-12-22T10:02:19.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.571+0000 7f974aab9700 1 -- 172.21.15.45:0/3442722034 shutdown_connections 2023-12-22T10:02:19.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.571+0000 7f974aab9700 1 -- 172.21.15.45:0/3442722034 >> 172.21.15.45:0/3442722034 conn(0x7f9744067500 msgr2=0x7f97440c34b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:02:19.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.571+0000 7f974aab9700 1 -- 172.21.15.45:0/3442722034 shutdown_connections 2023-12-22T10:02:19.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.571+0000 7f974aab9700 1 -- 172.21.15.45:0/3442722034 wait complete. 2023-12-22T10:02:19.595 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-12-22T10:02:19.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.767+0000 7fd04359e700 1 Processor -- start 2023-12-22T10:02:19.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.767+0000 7fd04359e700 1 -- start start 2023-12-22T10:02:19.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.771+0000 7fd04359e700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fd0440bc160 0x7fd044065780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:19.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.771+0000 7fd04359e700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd044157940 0x7fd044157d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:19.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.771+0000 7fd04359e700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0440c2400 con 0x7fd0440bbd80 2023-12-22T10:02:19.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.771+0000 7fd04359e700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0440bc5a0 con 0x7fd0440bc160 2023-12-22T10:02:19.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.771+0000 7fd04359e700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd044069a90 con 0x7fd044157940 2023-12-22T10:02:19.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.771+0000 7fd04259c700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fd0440bbd80 0x7fd0440c0fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:53518/0 (socket says 172.21.15.45:53518) 2023-12-22T10:02:19.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.771+0000 7fd04259c700 1 -- 172.21.15.45:0/559831032 learned_addr learned my addr 172.21.15.45:0/559831032 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:02:19.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.771+0000 7fd03bfff700 1 --2- 172.21.15.45:0/559831032 >> v2:172.21.15.113:3300/0 conn(0x7fd0440bc160 0x7fd044065780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:19.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.771+0000 7fd042d9d700 1 --2- 172.21.15.45:0/559831032 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd044157940 0x7fd044157d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:19.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.771+0000 7fd03bfff700 1 -- 172.21.15.45:0/559831032 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd044157940 msgr2=0x7fd044157d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:02:19.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.771+0000 7fd041d9b700 1 -- 172.21.15.45:0/559831032 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2203045949 0 0) 0x7fd0440c2400 con 0x7fd0440bbd80 2023-12-22T10:02:19.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.771+0000 7fd03bfff700 1 --2- 172.21.15.45:0/559831032 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd044157940 0x7fd044157d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:19.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.771+0000 7fd03bfff700 1 -- 172.21.15.45:0/559831032 >> v1:172.21.15.45:6789/0 conn(0x7fd0440bbd80 legacy=0x7fd0440c0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:19.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.771+0000 7fd03bfff700 1 -- 172.21.15.45:0/559831032 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0440c17f0 con 0x7fd0440bc160 2023-12-22T10:02:19.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.771+0000 7fd03bfff700 1 --2- 172.21.15.45:0/559831032 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd0440bc160 0x7fd044065780 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7fd02c009760 tx=0x7fd02c009060).ready entity=mon.1 client_cookie=cad4b727fb39ca1b server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:19.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.771+0000 7fd041d9b700 1 -- 172.21.15.45:0/559831032 <== mon.1 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd02c00f510 con 0x7fd0440bc160 2023-12-22T10:02:19.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.771+0000 7fd041d9b700 1 -- 172.21.15.45:0/559831032 <== mon.1 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd02c00f670 con 0x7fd0440bc160 2023-12-22T10:02:19.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.771+0000 7fd041d9b700 1 -- 172.21.15.45:0/559831032 <== mon.1 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd02c00f9f0 con 0x7fd0440bc160 2023-12-22T10:02:19.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.775+0000 7fd04359e700 1 -- 172.21.15.45:0/559831032 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd0440bc160 msgr2=0x7fd044065780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:19.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.775+0000 7fd04359e700 1 --2- 172.21.15.45:0/559831032 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd0440bc160 0x7fd044065780 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7fd02c009760 tx=0x7fd02c009060).stop 2023-12-22T10:02:19.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.775+0000 7fd04359e700 1 -- 172.21.15.45:0/559831032 shutdown_connections 2023-12-22T10:02:19.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.775+0000 7fd04359e700 1 --2- 172.21.15.45:0/559831032 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd044157940 0x7fd044157d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:19.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.775+0000 7fd04359e700 1 --2- 172.21.15.45:0/559831032 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd0440bc160 0x7fd044065780 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:19.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.775+0000 7fd04359e700 1 -- 172.21.15.45:0/559831032 >> 172.21.15.45:0/559831032 conn(0x7fd044067500 msgr2=0x7fd0440c6400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:02:19.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.775+0000 7fd04359e700 1 -- 172.21.15.45:0/559831032 shutdown_connections 2023-12-22T10:02:19.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.775+0000 7fd04359e700 1 -- 172.21.15.45:0/559831032 wait complete. 2023-12-22T10:02:19.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.775+0000 7fd04359e700 1 Processor -- start 2023-12-22T10:02:19.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.779+0000 7fd04359e700 1 -- start start 2023-12-22T10:02:19.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.779+0000 7fd04359e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd0440bbd80 0x7fd0440aa9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:19.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.779+0000 7fd04359e700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd0440bc160 0x7fd044168570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:19.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.779+0000 7fd04359e700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd044157940 0x7fd044168a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:19.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.779+0000 7fd04359e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0440aae90 con 0x7fd0440bbd80 2023-12-22T10:02:19.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.779+0000 7fd04359e700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0440bfe60 con 0x7fd044157940 2023-12-22T10:02:19.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.779+0000 7fd04359e700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd044168f50 con 0x7fd0440bc160 2023-12-22T10:02:19.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.779+0000 7fd04259c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd0440bbd80 0x7fd0440aa9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:19.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.779+0000 7fd04259c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd0440bbd80 0x7fd0440aa9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47102/0 (socket says 172.21.15.45:47102) 2023-12-22T10:02:19.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.779+0000 7fd04259c700 1 -- 172.21.15.45:0/2093921390 learned_addr learned my addr 172.21.15.45:0/2093921390 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:02:19.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.779+0000 7fd03bfff700 1 --2- 172.21.15.45:0/2093921390 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd0440bc160 0x7fd044168570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:19.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.779+0000 7fd042d9d700 1 --2- 172.21.15.45:0/2093921390 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd044157940 0x7fd044168a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:19.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.779+0000 7fd04259c700 1 -- 172.21.15.45:0/2093921390 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd0440bc160 msgr2=0x7fd044168570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:19.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.779+0000 7fd04259c700 1 --2- 172.21.15.45:0/2093921390 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd0440bc160 0x7fd044168570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:19.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.779+0000 7fd04259c700 1 -- 172.21.15.45:0/2093921390 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd044157940 msgr2=0x7fd044168a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:19.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.779+0000 7fd04259c700 1 --2- 172.21.15.45:0/2093921390 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd044157940 0x7fd044168a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:19.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.779+0000 7fd04259c700 1 -- 172.21.15.45:0/2093921390 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd02c0092a0 con 0x7fd0440bbd80 2023-12-22T10:02:19.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.779+0000 7fd04259c700 1 --2- 172.21.15.45:0/2093921390 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd0440bbd80 0x7fd0440aa9a0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 rx=0x7fd034001eb0 tx=0x7fd034007e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:19.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.779+0000 7fd03a7fc700 1 -- 172.21.15.45:0/2093921390 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0340070d0 con 0x7fd0440bbd80 2023-12-22T10:02:19.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.783+0000 7fd03a7fc700 1 -- 172.21.15.45:0/2093921390 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd034007230 con 0x7fd0440bbd80 2023-12-22T10:02:19.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.783+0000 7fd03a7fc700 1 -- 172.21.15.45:0/2093921390 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0340075d0 con 0x7fd0440bbd80 2023-12-22T10:02:19.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.783+0000 7fd04359e700 1 -- 172.21.15.45:0/2093921390 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0440bf250 con 0x7fd0440bbd80 2023-12-22T10:02:19.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.783+0000 7fd04359e700 1 -- 172.21.15.45:0/2093921390 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0440bf810 con 0x7fd0440bbd80 2023-12-22T10:02:19.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.783+0000 7fd04359e700 1 -- 172.21.15.45:0/2093921390 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd044047060 con 0x7fd0440bbd80 2023-12-22T10:02:19.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.783+0000 7fd03a7fc700 1 -- 172.21.15.45:0/2093921390 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fd034005bc0 con 0x7fd0440bbd80 2023-12-22T10:02:19.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.787+0000 7fd03a7fc700 1 --2- 172.21.15.45:0/2093921390 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fd02405a510 0x7fd02405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:19.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.787+0000 7fd03a7fc700 1 -- 172.21.15.45:0/2093921390 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5355+0+0 (secure 0 0 0) 0x7fd034073de0 con 0x7fd0440bbd80 2023-12-22T10:02:19.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.787+0000 7fd03bfff700 1 --2- 172.21.15.45:0/2093921390 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fd02405a510 0x7fd02405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:19.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.787+0000 7fd03bfff700 1 --2- 172.21.15.45:0/2093921390 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fd02405a510 0x7fd02405c9d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7fd02c009fd0 tx=0x7fd02c017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:19.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.791+0000 7fd03a7fc700 1 -- 172.21.15.45:0/2093921390 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd034047800 con 0x7fd0440bbd80 2023-12-22T10:02:19.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.963+0000 7fd04359e700 1 -- 172.21.15.45:0/2093921390 --> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fd04415b360 con 0x7fd02405a510 2023-12-22T10:02:19.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.963+0000 7fd03a7fc700 1 -- 172.21.15.45:0/2093921390 <== mgr.4104 v2:172.21.15.45:6832/33679 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd04415b360 con 0x7fd02405a510 2023-12-22T10:02:19.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.967+0000 7fd04359e700 1 -- 172.21.15.45:0/2093921390 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fd02405a510 msgr2=0x7fd02405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:19.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.967+0000 7fd04359e700 1 --2- 172.21.15.45:0/2093921390 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fd02405a510 0x7fd02405c9d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7fd02c009fd0 tx=0x7fd02c017000).stop 2023-12-22T10:02:19.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.967+0000 7fd04359e700 1 -- 172.21.15.45:0/2093921390 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd0440bbd80 msgr2=0x7fd0440aa9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:19.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.967+0000 7fd04359e700 1 --2- 172.21.15.45:0/2093921390 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd0440bbd80 0x7fd0440aa9a0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 rx=0x7fd034001eb0 tx=0x7fd034007e90).stop 2023-12-22T10:02:19.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.967+0000 7fd04359e700 1 -- 172.21.15.45:0/2093921390 shutdown_connections 2023-12-22T10:02:19.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.967+0000 7fd04359e700 1 --2- 172.21.15.45:0/2093921390 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd044157940 0x7fd044168a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:19.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.967+0000 7fd04359e700 1 --2- 172.21.15.45:0/2093921390 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fd02405a510 0x7fd02405c9d0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:19.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.967+0000 7fd04359e700 1 --2- 172.21.15.45:0/2093921390 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd0440bc160 0x7fd044168570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:19.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.967+0000 7fd04359e700 1 --2- 172.21.15.45:0/2093921390 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd0440bbd80 0x7fd0440aa9a0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:19.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.967+0000 7fd04359e700 1 -- 172.21.15.45:0/2093921390 >> 172.21.15.45:0/2093921390 conn(0x7fd044067500 msgr2=0x7fd0440c43c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:02:19.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.967+0000 7fd04359e700 1 -- 172.21.15.45:0/2093921390 shutdown_connections 2023-12-22T10:02:19.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:19.967+0000 7fd04359e700 1 -- 172.21.15.45:0/2093921390 wait complete. 2023-12-22T10:02:19.970 INFO:teuthology.orchestra.run.smithi045.stderr:instructed osd(s) 4 to deep-scrub 2023-12-22T10:02:19.988 INFO:tasks.ceph:Scrubbing osd.5 2023-12-22T10:02:19.988 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-12-22T10:02:20.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.159+0000 7ff1bacdb700 1 Processor -- start 2023-12-22T10:02:20.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.159+0000 7ff1bacdb700 1 -- start start 2023-12-22T10:02:20.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.163+0000 7ff1bacdb700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7ff1b40ac2d0 0x7ff1b40c5900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:20.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.163+0000 7ff1bacdb700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff1b40ac6b0 0x7ff1b40aa660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:20.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.163+0000 7ff1bacdb700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1b40c8d50 con 0x7ff1b4158050 2023-12-22T10:02:20.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.163+0000 7ff1bacdb700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1b40c95f0 con 0x7ff1b40ac6b0 2023-12-22T10:02:20.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.163+0000 7ff1bacdb700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1b40aab50 con 0x7ff1b40ac2d0 2023-12-22T10:02:20.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.163+0000 7ff1b9278700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7ff1b4158050 0x7ff1b40c7430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:53520/0 (socket says 172.21.15.45:53520) 2023-12-22T10:02:20.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.163+0000 7ff1b3fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff1b40ac6b0 0x7ff1b40aa660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:20.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.163+0000 7ff1b9278700 1 -- 172.21.15.45:0/4019169427 learned_addr learned my addr 172.21.15.45:0/4019169427 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:02:20.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.163+0000 7ff1b8a77700 1 --2- 172.21.15.45:0/4019169427 >> v2:172.21.15.113:3300/0 conn(0x7ff1b40ac2d0 0x7ff1b40c5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:20.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.163+0000 7ff1b37fe700 1 -- 172.21.15.45:0/4019169427 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 609877321 0 0) 0x7ff1b40c8d50 con 0x7ff1b4158050 2023-12-22T10:02:20.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.163+0000 7ff1b37fe700 1 -- 172.21.15.45:0/4019169427 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1a40033f0 con 0x7ff1b4158050 2023-12-22T10:02:20.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.163+0000 7ff1b3fff700 1 -- 172.21.15.45:0/4019169427 >> v2:172.21.15.113:3300/0 conn(0x7ff1b40ac2d0 msgr2=0x7ff1b40c5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:02:20.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.163+0000 7ff1b3fff700 1 --2- 172.21.15.45:0/4019169427 >> v2:172.21.15.113:3300/0 conn(0x7ff1b40ac2d0 0x7ff1b40c5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:20.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.163+0000 7ff1b3fff700 1 -- 172.21.15.45:0/4019169427 >> v1:172.21.15.45:6789/0 conn(0x7ff1b4158050 legacy=0x7ff1b40c7430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:20.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.163+0000 7ff1b3fff700 1 -- 172.21.15.45:0/4019169427 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1b40acb10 con 0x7ff1b40ac6b0 2023-12-22T10:02:20.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.163+0000 7ff1b3fff700 1 --2- 172.21.15.45:0/4019169427 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1b40ac6b0 0x7ff1b40aa660 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7ff1b405ec70 tx=0x7ff1a0009060).ready entity=mon.0 client_cookie=af26185d1f7d62bb server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:20.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.167+0000 7ff1b37fe700 1 -- 172.21.15.45:0/4019169427 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a000d4a0 con 0x7ff1b40ac6b0 2023-12-22T10:02:20.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.167+0000 7ff1b37fe700 1 -- 172.21.15.45:0/4019169427 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1a000d600 con 0x7ff1b40ac6b0 2023-12-22T10:02:20.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.167+0000 7ff1b37fe700 1 -- 172.21.15.45:0/4019169427 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a000d980 con 0x7ff1b40ac6b0 2023-12-22T10:02:20.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.167+0000 7ff1bacdb700 1 -- 172.21.15.45:0/4019169427 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1b40ac6b0 msgr2=0x7ff1b40aa660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:20.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.167+0000 7ff1bacdb700 1 --2- 172.21.15.45:0/4019169427 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1b40ac6b0 0x7ff1b40aa660 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7ff1b405ec70 tx=0x7ff1a0009060).stop 2023-12-22T10:02:20.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.167+0000 7ff1bacdb700 1 -- 172.21.15.45:0/4019169427 shutdown_connections 2023-12-22T10:02:20.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.167+0000 7ff1bacdb700 1 --2- 172.21.15.45:0/4019169427 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1b40ac6b0 0x7ff1b40aa660 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:20.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.167+0000 7ff1bacdb700 1 --2- 172.21.15.45:0/4019169427 >> v2:172.21.15.113:3300/0 conn(0x7ff1b40ac2d0 0x7ff1b40c5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:20.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.167+0000 7ff1bacdb700 1 -- 172.21.15.45:0/4019169427 >> 172.21.15.45:0/4019169427 conn(0x7ff1b4082a50 msgr2=0x7ff1b4066a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:02:20.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.167+0000 7ff1bacdb700 1 -- 172.21.15.45:0/4019169427 shutdown_connections 2023-12-22T10:02:20.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.167+0000 7ff1bacdb700 1 -- 172.21.15.45:0/4019169427 wait complete. 2023-12-22T10:02:20.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.167+0000 7ff1bacdb700 1 Processor -- start 2023-12-22T10:02:20.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.167+0000 7ff1bacdb700 1 -- start start 2023-12-22T10:02:20.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.171+0000 7ff1bacdb700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1b40ac2d0 0x7ff1b4155a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:20.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.171+0000 7ff1bacdb700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ff1b40ac6b0 0x7ff1b40c31a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:20.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.171+0000 7ff1bacdb700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff1b4158050 0x7ff1b4167470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:20.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.171+0000 7ff1bacdb700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b4155040 con 0x7ff1b40ac2d0 2023-12-22T10:02:20.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.171+0000 7ff1bacdb700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b41555c0 con 0x7ff1b4158050 2023-12-22T10:02:20.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.171+0000 7ff1bacdb700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b4167ec0 con 0x7ff1b40ac6b0 2023-12-22T10:02:20.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.171+0000 7ff1b8a77700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1b40ac2d0 0x7ff1b4155a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:20.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.171+0000 7ff1b8a77700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1b40ac2d0 0x7ff1b4155a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47116/0 (socket says 172.21.15.45:47116) 2023-12-22T10:02:20.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.171+0000 7ff1b8a77700 1 -- 172.21.15.45:0/619997556 learned_addr learned my addr 172.21.15.45:0/619997556 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:02:20.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.171+0000 7ff1b9278700 1 --2- 172.21.15.45:0/619997556 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff1b4158050 0x7ff1b4167470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:20.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.171+0000 7ff1b3fff700 1 --2- 172.21.15.45:0/619997556 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ff1b40ac6b0 0x7ff1b40c31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:20.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.171+0000 7ff1b8a77700 1 -- 172.21.15.45:0/619997556 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ff1b40ac6b0 msgr2=0x7ff1b40c31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:20.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.171+0000 7ff1b8a77700 1 --2- 172.21.15.45:0/619997556 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ff1b40ac6b0 0x7ff1b40c31a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:20.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.171+0000 7ff1b8a77700 1 -- 172.21.15.45:0/619997556 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff1b4158050 msgr2=0x7ff1b4167470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:20.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.171+0000 7ff1b8a77700 1 --2- 172.21.15.45:0/619997556 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff1b4158050 0x7ff1b4167470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:20.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.171+0000 7ff1b8a77700 1 -- 172.21.15.45:0/619997556 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1a00092a0 con 0x7ff1b40ac2d0 2023-12-22T10:02:20.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.171+0000 7ff1b8a77700 1 --2- 172.21.15.45:0/619997556 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1b40ac2d0 0x7ff1b4155a50 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0x7ff1a800e900 tx=0x7ff1a8009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:20.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.171+0000 7ff1b0ff9700 1 -- 172.21.15.45:0/619997556 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a8012600 con 0x7ff1b40ac2d0 2023-12-22T10:02:20.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.171+0000 7ff1b0ff9700 1 -- 172.21.15.45:0/619997556 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1a8012760 con 0x7ff1b40ac2d0 2023-12-22T10:02:20.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.171+0000 7ff1bacdb700 1 -- 172.21.15.45:0/619997556 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1b41681a0 con 0x7ff1b40ac2d0 2023-12-22T10:02:20.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.171+0000 7ff1b0ff9700 1 -- 172.21.15.45:0/619997556 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a8012ae0 con 0x7ff1b40ac2d0 2023-12-22T10:02:20.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.171+0000 7ff1bacdb700 1 -- 172.21.15.45:0/619997556 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1b4156dc0 con 0x7ff1b40ac2d0 2023-12-22T10:02:20.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.175+0000 7ff1bacdb700 1 -- 172.21.15.45:0/619997556 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff1b406c070 con 0x7ff1b40ac2d0 2023-12-22T10:02:20.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.175+0000 7ff1b0ff9700 1 -- 172.21.15.45:0/619997556 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7ff1a801b400 con 0x7ff1b40ac2d0 2023-12-22T10:02:20.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.175+0000 7ff1b0ff9700 1 --2- 172.21.15.45:0/619997556 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7ff19805a510 0x7ff19805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:20.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.175+0000 7ff1b0ff9700 1 -- 172.21.15.45:0/619997556 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5355+0+0 (secure 0 0 0) 0x7ff1a8074740 con 0x7ff1b40ac2d0 2023-12-22T10:02:20.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.175+0000 7ff1b3fff700 1 --2- 172.21.15.45:0/619997556 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7ff19805a510 0x7ff19805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:20.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.175+0000 7ff1b0ff9700 1 --2- 172.21.15.45:0/619997556 >> [v2:172.21.15.113:6800/34100,v1:172.21.15.113:6801/34100] conn(0x7ff198060b00 0x7ff198062f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:20.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.175+0000 7ff1b0ff9700 1 -- 172.21.15.45:0/619997556 --> [v2:172.21.15.113:6800/34100,v1:172.21.15.113:6801/34100] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff1980635e0 con 0x7ff198060b00 2023-12-22T10:02:20.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.175+0000 7ff1b0ff9700 1 -- 172.21.15.45:0/619997556 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff1a8076d60 con 0x7ff1b40ac2d0 2023-12-22T10:02:20.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.175+0000 7ff1b3fff700 1 --2- 172.21.15.45:0/619997556 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7ff19805a510 0x7ff19805c9d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7ff1a000d260 tx=0x7ff1a0016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:20.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.175+0000 7ff1b9278700 1 --2- 172.21.15.45:0/619997556 >> [v2:172.21.15.113:6800/34100,v1:172.21.15.113:6801/34100] conn(0x7ff198060b00 0x7ff198062f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:20.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.179+0000 7ff1b9278700 1 --2- 172.21.15.45:0/619997556 >> [v2:172.21.15.113:6800/34100,v1:172.21.15.113:6801/34100] conn(0x7ff198060b00 0x7ff198062f60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:20.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.179+0000 7ff1b0ff9700 1 -- 172.21.15.45:0/619997556 <== osd.5 v2:172.21.15.113:6800/34100 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7ff1980635e0 con 0x7ff198060b00 2023-12-22T10:02:20.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.195+0000 7ff1bacdb700 1 -- 172.21.15.45:0/619997556 --> [v2:172.21.15.113:6800/34100,v1:172.21.15.113:6801/34100] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ff1b40c8750 con 0x7ff198060b00 2023-12-22T10:02:20.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.199+0000 7ff1b0ff9700 1 -- 172.21.15.45:0/619997556 <== osd.5 v2:172.21.15.113:6800/34100 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7ff1b40c8750 con 0x7ff198060b00 2023-12-22T10:02:20.198 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-22T10:02:20.199 INFO:teuthology.orchestra.run.smithi045.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-12-22T10:02:20.199 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-22T10:02:20.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.199+0000 7ff1bacdb700 1 -- 172.21.15.45:0/619997556 >> [v2:172.21.15.113:6800/34100,v1:172.21.15.113:6801/34100] conn(0x7ff198060b00 msgr2=0x7ff198062f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:20.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.199+0000 7ff1bacdb700 1 --2- 172.21.15.45:0/619997556 >> [v2:172.21.15.113:6800/34100,v1:172.21.15.113:6801/34100] conn(0x7ff198060b00 0x7ff198062f60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:20.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.199+0000 7ff1bacdb700 1 -- 172.21.15.45:0/619997556 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7ff19805a510 msgr2=0x7ff19805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:20.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.199+0000 7ff1bacdb700 1 --2- 172.21.15.45:0/619997556 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7ff19805a510 0x7ff19805c9d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7ff1a000d260 tx=0x7ff1a0016000).stop 2023-12-22T10:02:20.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.199+0000 7ff1bacdb700 1 -- 172.21.15.45:0/619997556 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1b40ac2d0 msgr2=0x7ff1b4155a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:20.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.199+0000 7ff1bacdb700 1 --2- 172.21.15.45:0/619997556 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1b40ac2d0 0x7ff1b4155a50 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0x7ff1a800e900 tx=0x7ff1a8009060).stop 2023-12-22T10:02:20.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.199+0000 7ff1b9278700 1 -- 172.21.15.45:0/619997556 reap_dead start 2023-12-22T10:02:20.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.199+0000 7ff1bacdb700 1 -- 172.21.15.45:0/619997556 shutdown_connections 2023-12-22T10:02:20.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.199+0000 7ff1bacdb700 1 -- 172.21.15.45:0/619997556 >> 172.21.15.45:0/619997556 conn(0x7ff1b4082a50 msgr2=0x7ff1b40c0240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:02:20.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.199+0000 7ff1bacdb700 1 -- 172.21.15.45:0/619997556 shutdown_connections 2023-12-22T10:02:20.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.199+0000 7ff1bacdb700 1 -- 172.21.15.45:0/619997556 wait complete. 2023-12-22T10:02:20.219 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-12-22T10:02:20.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.391+0000 7ff2f8d46700 1 Processor -- start 2023-12-22T10:02:20.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.391+0000 7ff2f8d46700 1 -- start start 2023-12-22T10:02:20.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.395+0000 7ff2f8d46700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ff2f40a7420 0x7ff2f40c3160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:20.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.395+0000 7ff2f8d46700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2f4155740 con 0x7ff2f4151cd0 2023-12-22T10:02:20.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.395+0000 7ff2f8d46700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2f40a61b0 con 0x7ff2f41518f0 2023-12-22T10:02:20.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.395+0000 7ff2f8d46700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f40c40f0 con 0x7ff2f40a7420 2023-12-22T10:02:20.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.395+0000 7ff2f1d9b700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7ff2f4151cd0 0x7ff2f40a6d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:53522/0 (socket says 172.21.15.45:53522) 2023-12-22T10:02:20.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.395+0000 7ff2f1d9b700 1 -- 172.21.15.45:0/104526023 learned_addr learned my addr 172.21.15.45:0/104526023 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:02:20.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.395+0000 7ff2f2d9d700 1 --2- 172.21.15.45:0/104526023 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ff2f40a7420 0x7ff2f40c3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:20.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.395+0000 7ff2f159a700 1 -- 172.21.15.45:0/104526023 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2607959436 0 0) 0x7ff2f4155740 con 0x7ff2f4151cd0 2023-12-22T10:02:20.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.395+0000 7ff2f159a700 1 -- 172.21.15.45:0/104526023 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2dc0033f0 con 0x7ff2f4151cd0 2023-12-22T10:02:20.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.395+0000 7ff2f2d9d700 1 -- 172.21.15.45:0/104526023 >> v1:172.21.15.113:6789/0 conn(0x7ff2f41518f0 legacy=0x7ff2f4064890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:20.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.395+0000 7ff2f159a700 1 -- 172.21.15.45:0/104526023 <== mon.1 v1:172.21.15.113:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 616287244 0 0) 0x7ff2f40a61b0 con 0x7ff2f41518f0 2023-12-22T10:02:20.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.395+0000 7ff2f2d9d700 1 -- 172.21.15.45:0/104526023 >> v1:172.21.15.45:6789/0 conn(0x7ff2f4151cd0 legacy=0x7ff2f40a6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:20.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.395+0000 7ff2f2d9d700 1 -- 172.21.15.45:0/104526023 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2f4064fa0 con 0x7ff2f40a7420 2023-12-22T10:02:20.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.395+0000 7ff2f2d9d700 1 --2- 172.21.15.45:0/104526023 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ff2f40a7420 0x7ff2f40c3160 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7ff2ec009e90 tx=0x7ff2ec009780).ready entity=mon.2 client_cookie=fc1a5d88dd7ff955 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:20.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.399+0000 7ff2f159a700 1 -- 172.21.15.45:0/104526023 <== mon.2 v2:172.21.15.113:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2ec00e070 con 0x7ff2f40a7420 2023-12-22T10:02:20.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.399+0000 7ff2f159a700 1 -- 172.21.15.45:0/104526023 <== mon.2 v2:172.21.15.113:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2ec00bb60 con 0x7ff2f40a7420 2023-12-22T10:02:20.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.399+0000 7ff2f159a700 1 -- 172.21.15.45:0/104526023 <== mon.2 v2:172.21.15.113:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2ec00bee0 con 0x7ff2f40a7420 2023-12-22T10:02:20.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.399+0000 7ff2f8d46700 1 -- 172.21.15.45:0/104526023 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ff2f40a7420 msgr2=0x7ff2f40c3160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:20.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.399+0000 7ff2f8d46700 1 --2- 172.21.15.45:0/104526023 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ff2f40a7420 0x7ff2f40c3160 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7ff2ec009e90 tx=0x7ff2ec009780).stop 2023-12-22T10:02:20.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.399+0000 7ff2f8d46700 1 -- 172.21.15.45:0/104526023 shutdown_connections 2023-12-22T10:02:20.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.399+0000 7ff2f8d46700 1 --2- 172.21.15.45:0/104526023 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ff2f40a7420 0x7ff2f40c3160 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:20.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.399+0000 7ff2f8d46700 1 -- 172.21.15.45:0/104526023 >> 172.21.15.45:0/104526023 conn(0x7ff2f4066a70 msgr2=0x7ff2f4066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:02:20.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.399+0000 7ff2f8d46700 1 -- 172.21.15.45:0/104526023 shutdown_connections 2023-12-22T10:02:20.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.399+0000 7ff2f8d46700 1 -- 172.21.15.45:0/104526023 wait complete. 2023-12-22T10:02:20.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.403+0000 7ff2f8d46700 1 Processor -- start 2023-12-22T10:02:20.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.403+0000 7ff2f8d46700 1 -- start start 2023-12-22T10:02:20.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.403+0000 7ff2f8d46700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff2f40a7420 0x7ff2f41425c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:20.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.403+0000 7ff2f8d46700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ff2f41518f0 0x7ff2f416bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:20.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.403+0000 7ff2f8d46700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff2f4151cd0 0x7ff2f414aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:20.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.403+0000 7ff2f8d46700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f40a9d60 con 0x7ff2f4151cd0 2023-12-22T10:02:20.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.403+0000 7ff2f8d46700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f416c700 con 0x7ff2f40a7420 2023-12-22T10:02:20.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.403+0000 7ff2f8d46700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f416c9e0 con 0x7ff2f41518f0 2023-12-22T10:02:20.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.403+0000 7ff2f259c700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff2f40a7420 0x7ff2f41425c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:20.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.403+0000 7ff2f2d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff2f4151cd0 0x7ff2f414aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:20.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.403+0000 7ff2f259c700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff2f40a7420 0x7ff2f41425c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.45:41124/0 (socket says 172.21.15.45:41124) 2023-12-22T10:02:20.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.403+0000 7ff2f259c700 1 -- 172.21.15.45:0/1092325816 learned_addr learned my addr 172.21.15.45:0/1092325816 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:02:20.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.403+0000 7ff2f1d9b700 1 --2- 172.21.15.45:0/1092325816 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ff2f41518f0 0x7ff2f416bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:20.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.403+0000 7ff2f2d9d700 1 -- 172.21.15.45:0/1092325816 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ff2f41518f0 msgr2=0x7ff2f416bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:20.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.403+0000 7ff2f2d9d700 1 --2- 172.21.15.45:0/1092325816 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ff2f41518f0 0x7ff2f416bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:20.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.403+0000 7ff2f2d9d700 1 -- 172.21.15.45:0/1092325816 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff2f40a7420 msgr2=0x7ff2f41425c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:20.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.403+0000 7ff2f2d9d700 1 --2- 172.21.15.45:0/1092325816 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff2f40a7420 0x7ff2f41425c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:20.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.403+0000 7ff2f2d9d700 1 -- 172.21.15.45:0/1092325816 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2ec009a20 con 0x7ff2f4151cd0 2023-12-22T10:02:20.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.403+0000 7ff2f259c700 1 --2- 172.21.15.45:0/1092325816 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff2f40a7420 0x7ff2f41425c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-12-22T10:02:20.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.403+0000 7ff2f1d9b700 1 --2- 172.21.15.45:0/1092325816 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ff2f41518f0 0x7ff2f416bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T10:02:20.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.403+0000 7ff2f2d9d700 1 --2- 172.21.15.45:0/1092325816 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff2f4151cd0 0x7ff2f414aed0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7ff2ec014000 tx=0x7ff2ec009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:20.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.407+0000 7ff2e27fc700 1 -- 172.21.15.45:0/1092325816 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2ec01c660 con 0x7ff2f4151cd0 2023-12-22T10:02:20.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.407+0000 7ff2e27fc700 1 -- 172.21.15.45:0/1092325816 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2ec01c800 con 0x7ff2f4151cd0 2023-12-22T10:02:20.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.407+0000 7ff2e27fc700 1 -- 172.21.15.45:0/1092325816 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2ec01cbc0 con 0x7ff2f4151cd0 2023-12-22T10:02:20.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.407+0000 7ff2f8d46700 1 -- 172.21.15.45:0/1092325816 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2f40a99f0 con 0x7ff2f4151cd0 2023-12-22T10:02:20.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.407+0000 7ff2f8d46700 1 -- 172.21.15.45:0/1092325816 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2f4142ab0 con 0x7ff2f4151cd0 2023-12-22T10:02:20.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.407+0000 7ff2f8d46700 1 -- 172.21.15.45:0/1092325816 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2f4062ef0 con 0x7ff2f4151cd0 2023-12-22T10:02:20.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.411+0000 7ff2e27fc700 1 -- 172.21.15.45:0/1092325816 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7ff2ec003040 con 0x7ff2f4151cd0 2023-12-22T10:02:20.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.411+0000 7ff2e27fc700 1 --2- 172.21.15.45:0/1092325816 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7ff2d405a590 0x7ff2d405ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:20.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.411+0000 7ff2e27fc700 1 -- 172.21.15.45:0/1092325816 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5355+0+0 (secure 0 0 0) 0x7ff2ec076250 con 0x7ff2f4151cd0 2023-12-22T10:02:20.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.411+0000 7ff2f259c700 1 --2- 172.21.15.45:0/1092325816 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7ff2d405a590 0x7ff2d405ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:20.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.411+0000 7ff2f259c700 1 --2- 172.21.15.45:0/1092325816 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7ff2d405a590 0x7ff2d405ca50 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7ff2e40011e0 tx=0x7ff2e4009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:20.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.419+0000 7ff2e27fc700 1 -- 172.21.15.45:0/1092325816 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff2f4062ef0 con 0x7ff2f4151cd0 2023-12-22T10:02:20.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.583+0000 7ff2f8d46700 1 -- 172.21.15.45:0/1092325816 --> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7ff2f40a9870 con 0x7ff2d405a590 2023-12-22T10:02:20.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.583+0000 7ff2e27fc700 1 -- 172.21.15.45:0/1092325816 <== mgr.4104 v2:172.21.15.45:6832/33679 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ff2e40019e0 con 0x7ff2d405a590 2023-12-22T10:02:20.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.587+0000 7ff2f8d46700 1 -- 172.21.15.45:0/1092325816 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7ff2d405a590 msgr2=0x7ff2d405ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:20.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.587+0000 7ff2f8d46700 1 --2- 172.21.15.45:0/1092325816 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7ff2d405a590 0x7ff2d405ca50 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7ff2e40011e0 tx=0x7ff2e4009040).stop 2023-12-22T10:02:20.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.587+0000 7ff2f8d46700 1 -- 172.21.15.45:0/1092325816 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff2f4151cd0 msgr2=0x7ff2f414aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:20.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.587+0000 7ff2f8d46700 1 --2- 172.21.15.45:0/1092325816 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff2f4151cd0 0x7ff2f414aed0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7ff2ec014000 tx=0x7ff2ec009780).stop 2023-12-22T10:02:20.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.587+0000 7ff2f8d46700 1 -- 172.21.15.45:0/1092325816 shutdown_connections 2023-12-22T10:02:20.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.587+0000 7ff2f8d46700 1 --2- 172.21.15.45:0/1092325816 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff2f4151cd0 0x7ff2f414aed0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:20.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.587+0000 7ff2f8d46700 1 --2- 172.21.15.45:0/1092325816 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7ff2d405a590 0x7ff2d405ca50 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:20.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.587+0000 7ff2f8d46700 1 --2- 172.21.15.45:0/1092325816 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7ff2f41518f0 0x7ff2f416bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:20.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.587+0000 7ff2f8d46700 1 --2- 172.21.15.45:0/1092325816 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7ff2f40a7420 0x7ff2f41425c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:20.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.587+0000 7ff2f8d46700 1 -- 172.21.15.45:0/1092325816 >> 172.21.15.45:0/1092325816 conn(0x7ff2f4066a70 msgr2=0x7ff2f40bfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:02:20.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.587+0000 7ff2f8d46700 1 -- 172.21.15.45:0/1092325816 shutdown_connections 2023-12-22T10:02:20.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.587+0000 7ff2f8d46700 1 -- 172.21.15.45:0/1092325816 wait complete. 2023-12-22T10:02:20.589 INFO:teuthology.orchestra.run.smithi045.stderr:instructed osd(s) 5 to deep-scrub 2023-12-22T10:02:20.606 INFO:tasks.ceph:Scrubbing osd.6 2023-12-22T10:02:20.606 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-12-22T10:02:20.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.775+0000 7f4a55879700 1 Processor -- start 2023-12-22T10:02:20.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.775+0000 7f4a55879700 1 -- start start 2023-12-22T10:02:20.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.779+0000 7f4a55879700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f4a500acca0 0x7f4a500ad080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:20.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.779+0000 7f4a55879700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4a500c9d20 0x7f4a500c97e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:20.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.779+0000 7f4a55879700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f4a500ca230 0x7f4a50068ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:20.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.779+0000 7f4a55879700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a500c5810 con 0x7f4a500c9d20 2023-12-22T10:02:20.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.779+0000 7f4a55879700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a500c8d90 con 0x7f4a500acca0 2023-12-22T10:02:20.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.779+0000 7f4a55879700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a500c9350 con 0x7f4a500ca230 2023-12-22T10:02:20.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.779+0000 7f4a4ffff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4a500c9d20 0x7f4a500c97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:20.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.779+0000 7f4a54877700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f4a500acca0 0x7f4a500ad080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:20.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.779+0000 7f4a4ffff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4a500c9d20 0x7f4a500c97e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47130/0 (socket says 172.21.15.45:47130) 2023-12-22T10:02:20.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.779+0000 7f4a4ffff700 1 -- 172.21.15.45:0/2819433459 learned_addr learned my addr 172.21.15.45:0/2819433459 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:02:20.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.779+0000 7f4a55078700 1 --2- 172.21.15.45:0/2819433459 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f4a500ca230 0x7f4a50068ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:20.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.779+0000 7f4a4ffff700 1 -- 172.21.15.45:0/2819433459 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f4a500ca230 msgr2=0x7f4a50068ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:02:20.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.779+0000 7f4a4ffff700 1 --2- 172.21.15.45:0/2819433459 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f4a500ca230 0x7f4a50068ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:20.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.779+0000 7f4a4ffff700 1 -- 172.21.15.45:0/2819433459 >> v2:172.21.15.113:3300/0 conn(0x7f4a500acca0 msgr2=0x7f4a500ad080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:02:20.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.779+0000 7f4a4ffff700 1 --2- 172.21.15.45:0/2819433459 >> v2:172.21.15.113:3300/0 conn(0x7f4a500acca0 0x7f4a500ad080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:20.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.779+0000 7f4a4ffff700 1 -- 172.21.15.45:0/2819433459 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a50154070 con 0x7f4a500c9d20 2023-12-22T10:02:20.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.779+0000 7f4a54877700 1 --2- 172.21.15.45:0/2819433459 >> v2:172.21.15.113:3300/0 conn(0x7f4a500acca0 0x7f4a500ad080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-12-22T10:02:20.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.779+0000 7f4a4ffff700 1 --2- 172.21.15.45:0/2819433459 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a500c9d20 0x7f4a500c97e0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 rx=0x7f4a50069db0 tx=0x7f4a3c0090f0).ready entity=mon.0 client_cookie=6d5aa96500e55e9c server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:20.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.783+0000 7f4a4f7fe700 1 -- 172.21.15.45:0/2819433459 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a3c00b520 con 0x7f4a500c9d20 2023-12-22T10:02:20.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.783+0000 7f4a4f7fe700 1 -- 172.21.15.45:0/2819433459 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a3c00b680 con 0x7f4a500c9d20 2023-12-22T10:02:20.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.783+0000 7f4a4f7fe700 1 -- 172.21.15.45:0/2819433459 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a3c00ba00 con 0x7f4a500c9d20 2023-12-22T10:02:20.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.783+0000 7f4a55879700 1 -- 172.21.15.45:0/2819433459 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a500c9d20 msgr2=0x7f4a500c97e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:20.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.783+0000 7f4a55879700 1 --2- 172.21.15.45:0/2819433459 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a500c9d20 0x7f4a500c97e0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 rx=0x7f4a50069db0 tx=0x7f4a3c0090f0).stop 2023-12-22T10:02:20.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.783+0000 7f4a55879700 1 -- 172.21.15.45:0/2819433459 shutdown_connections 2023-12-22T10:02:20.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.783+0000 7f4a55879700 1 --2- 172.21.15.45:0/2819433459 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f4a500ca230 0x7f4a50068ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:20.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.783+0000 7f4a55879700 1 --2- 172.21.15.45:0/2819433459 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a500c9d20 0x7f4a500c97e0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:20.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.783+0000 7f4a55879700 1 --2- 172.21.15.45:0/2819433459 >> v2:172.21.15.113:3300/0 conn(0x7f4a500acca0 0x7f4a500ad080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:20.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.783+0000 7f4a55879700 1 -- 172.21.15.45:0/2819433459 >> 172.21.15.45:0/2819433459 conn(0x7f4a500674f0 msgr2=0x7f4a500ca820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:02:20.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.783+0000 7f4a55879700 1 -- 172.21.15.45:0/2819433459 shutdown_connections 2023-12-22T10:02:20.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.783+0000 7f4a55879700 1 -- 172.21.15.45:0/2819433459 wait complete. 2023-12-22T10:02:20.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.783+0000 7f4a55879700 1 Processor -- start 2023-12-22T10:02:20.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.783+0000 7f4a55879700 1 -- start start 2023-12-22T10:02:20.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.787+0000 7f4a55879700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a500acca0 0x7f4a50163970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:20.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.787+0000 7f4a55879700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4a500c9d20 0x7f4a500a1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:20.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.787+0000 7f4a55879700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f4a500ca230 0x7f4a500a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:20.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.787+0000 7f4a55879700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a500a1fe0 con 0x7f4a500acca0 2023-12-22T10:02:20.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.787+0000 7f4a55879700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a500c4110 con 0x7f4a500c9d20 2023-12-22T10:02:20.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.787+0000 7f4a55879700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a500c37e0 con 0x7f4a500ca230 2023-12-22T10:02:20.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.787+0000 7f4a54877700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a500acca0 0x7f4a50163970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:20.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.787+0000 7f4a54877700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a500acca0 0x7f4a50163970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47138/0 (socket says 172.21.15.45:47138) 2023-12-22T10:02:20.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.787+0000 7f4a54877700 1 -- 172.21.15.45:0/1897287761 learned_addr learned my addr 172.21.15.45:0/1897287761 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:02:20.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.787+0000 7f4a55078700 1 --2- 172.21.15.45:0/1897287761 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f4a500ca230 0x7f4a500a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:20.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.787+0000 7f4a4ffff700 1 --2- 172.21.15.45:0/1897287761 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4a500c9d20 0x7f4a500a1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:20.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.787+0000 7f4a54877700 1 -- 172.21.15.45:0/1897287761 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f4a500ca230 msgr2=0x7f4a500a1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:20.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.787+0000 7f4a54877700 1 --2- 172.21.15.45:0/1897287761 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f4a500ca230 0x7f4a500a1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:20.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.787+0000 7f4a54877700 1 -- 172.21.15.45:0/1897287761 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4a500c9d20 msgr2=0x7f4a500a1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:20.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.787+0000 7f4a54877700 1 --2- 172.21.15.45:0/1897287761 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f4a500c9d20 0x7f4a500a1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:20.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.787+0000 7f4a54877700 1 -- 172.21.15.45:0/1897287761 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a44009a20 con 0x7f4a500acca0 2023-12-22T10:02:20.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.787+0000 7f4a55078700 1 --2- 172.21.15.45:0/1897287761 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f4a500ca230 0x7f4a500a1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T10:02:20.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.787+0000 7f4a54877700 1 --2- 172.21.15.45:0/1897287761 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a500acca0 0x7f4a50163970 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0x7f4a4400c0c0 tx=0x7f4a4400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:20.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.787+0000 7f4a4cff9700 1 -- 172.21.15.45:0/1897287761 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a4400cd60 con 0x7f4a500acca0 2023-12-22T10:02:20.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.787+0000 7f4a4cff9700 1 -- 172.21.15.45:0/1897287761 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a4400f040 con 0x7f4a500acca0 2023-12-22T10:02:20.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.787+0000 7f4a4cff9700 1 -- 172.21.15.45:0/1897287761 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a44013610 con 0x7f4a500acca0 2023-12-22T10:02:20.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.787+0000 7f4a55879700 1 -- 172.21.15.45:0/1897287761 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a3c009370 con 0x7f4a500acca0 2023-12-22T10:02:20.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.787+0000 7f4a55879700 1 -- 172.21.15.45:0/1897287761 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a500c3da0 con 0x7f4a500acca0 2023-12-22T10:02:20.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.791+0000 7f4a55879700 1 -- 172.21.15.45:0/1897287761 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4a50047060 con 0x7f4a500acca0 2023-12-22T10:02:20.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.791+0000 7f4a4cff9700 1 -- 172.21.15.45:0/1897287761 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f4a440139c0 con 0x7f4a500acca0 2023-12-22T10:02:20.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.791+0000 7f4a4cff9700 1 --2- 172.21.15.45:0/1897287761 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f4a3405a510 0x7f4a3405c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:20.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.791+0000 7f4a4cff9700 1 -- 172.21.15.45:0/1897287761 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f4a44074f90 con 0x7f4a500acca0 2023-12-22T10:02:20.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.791+0000 7f4a4cff9700 1 --2- 172.21.15.45:0/1897287761 >> [v2:172.21.15.113:6808/34101,v1:172.21.15.113:6810/34101] conn(0x7f4a34060b00 0x7f4a34062f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:20.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.791+0000 7f4a4cff9700 1 -- 172.21.15.45:0/1897287761 --> [v2:172.21.15.113:6808/34101,v1:172.21.15.113:6810/34101] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4a340635e0 con 0x7f4a34060b00 2023-12-22T10:02:20.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.791+0000 7f4a4cff9700 1 -- 172.21.15.45:0/1897287761 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4a44077490 con 0x7f4a500acca0 2023-12-22T10:02:20.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.791+0000 7f4a4ffff700 1 --2- 172.21.15.45:0/1897287761 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f4a3405a510 0x7f4a3405c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:20.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.795+0000 7f4a55078700 1 --2- 172.21.15.45:0/1897287761 >> [v2:172.21.15.113:6808/34101,v1:172.21.15.113:6810/34101] conn(0x7f4a34060b00 0x7f4a34062f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:20.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.795+0000 7f4a4ffff700 1 --2- 172.21.15.45:0/1897287761 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f4a3405a510 0x7f4a3405c9d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7f4a50069db0 tx=0x7f4a3c017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:20.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.795+0000 7f4a55078700 1 --2- 172.21.15.45:0/1897287761 >> [v2:172.21.15.113:6808/34101,v1:172.21.15.113:6810/34101] conn(0x7f4a34060b00 0x7f4a34062f60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:20.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.795+0000 7f4a4cff9700 1 -- 172.21.15.45:0/1897287761 <== osd.6 v2:172.21.15.113:6808/34101 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7f4a340635e0 con 0x7f4a34060b00 2023-12-22T10:02:20.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.815+0000 7f4a55879700 1 -- 172.21.15.45:0/1897287761 --> [v2:172.21.15.113:6808/34101,v1:172.21.15.113:6810/34101] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f4a500c5a60 con 0x7f4a34060b00 2023-12-22T10:02:20.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.815+0000 7f4a4cff9700 1 -- 172.21.15.45:0/1897287761 <== osd.6 v2:172.21.15.113:6808/34101 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f4a500c5a60 con 0x7f4a34060b00 2023-12-22T10:02:20.817 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-22T10:02:20.817 INFO:teuthology.orchestra.run.smithi045.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-12-22T10:02:20.817 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-22T10:02:20.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.819+0000 7f4a55879700 1 -- 172.21.15.45:0/1897287761 >> [v2:172.21.15.113:6808/34101,v1:172.21.15.113:6810/34101] conn(0x7f4a34060b00 msgr2=0x7f4a34062f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:20.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.819+0000 7f4a55879700 1 --2- 172.21.15.45:0/1897287761 >> [v2:172.21.15.113:6808/34101,v1:172.21.15.113:6810/34101] conn(0x7f4a34060b00 0x7f4a34062f60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:20.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.819+0000 7f4a55879700 1 -- 172.21.15.45:0/1897287761 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f4a3405a510 msgr2=0x7f4a3405c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:20.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.819+0000 7f4a55879700 1 --2- 172.21.15.45:0/1897287761 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f4a3405a510 0x7f4a3405c9d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7f4a50069db0 tx=0x7f4a3c017000).stop 2023-12-22T10:02:20.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.819+0000 7f4a55879700 1 -- 172.21.15.45:0/1897287761 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a500acca0 msgr2=0x7f4a50163970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:20.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.819+0000 7f4a55879700 1 --2- 172.21.15.45:0/1897287761 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a500acca0 0x7f4a50163970 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0x7f4a4400c0c0 tx=0x7f4a4400b040).stop 2023-12-22T10:02:20.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.819+0000 7f4a55078700 1 -- 172.21.15.45:0/1897287761 reap_dead start 2023-12-22T10:02:20.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.819+0000 7f4a55879700 1 -- 172.21.15.45:0/1897287761 shutdown_connections 2023-12-22T10:02:20.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.819+0000 7f4a55879700 1 -- 172.21.15.45:0/1897287761 >> 172.21.15.45:0/1897287761 conn(0x7f4a500674f0 msgr2=0x7f4a500ab640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:02:20.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.819+0000 7f4a55879700 1 -- 172.21.15.45:0/1897287761 shutdown_connections 2023-12-22T10:02:20.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:20.819+0000 7f4a55879700 1 -- 172.21.15.45:0/1897287761 wait complete. 2023-12-22T10:02:20.844 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-12-22T10:02:21.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.011+0000 7fd7b821b700 1 Processor -- start 2023-12-22T10:02:21.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.015+0000 7fd7b821b700 1 -- start start 2023-12-22T10:02:21.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.015+0000 7fd7b821b700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7fd7b00c5900 0x7fd7b01580d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:21.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.015+0000 7fd7b821b700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7b00c9720 con 0x7fd7b00ac5c0 2023-12-22T10:02:21.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.015+0000 7fd7b821b700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7b0153ec0 con 0x7fd7b00c7430 2023-12-22T10:02:21.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.015+0000 7fd7b821b700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7b01585c0 con 0x7fd7b00c5900 2023-12-22T10:02:21.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.015+0000 7fd7b5fb7700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fd7b00ac5c0 0x7fd7b00aa660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:53532/0 (socket says 172.21.15.45:53532) 2023-12-22T10:02:21.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.015+0000 7fd7b5fb7700 1 -- 172.21.15.45:0/3467240414 learned_addr learned my addr 172.21.15.45:0/3467240414 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:02:21.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.015+0000 7fd7b57b6700 1 --2- 172.21.15.45:0/3467240414 >> v2:172.21.15.113:3300/0 conn(0x7fd7b00c5900 0x7fd7b01580d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:21.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.015+0000 7fd7b4fb5700 1 -- 172.21.15.45:0/3467240414 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 275570148 0 0) 0x7fd7b00c9720 con 0x7fd7b00ac5c0 2023-12-22T10:02:21.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.015+0000 7fd7b4fb5700 1 -- 172.21.15.45:0/3467240414 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd79c0033f0 con 0x7fd7b00ac5c0 2023-12-22T10:02:21.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.015+0000 7fd7b57b6700 1 -- 172.21.15.45:0/3467240414 >> v1:172.21.15.113:6789/0 conn(0x7fd7b00c7430 legacy=0x7fd7b00c9bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:21.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.015+0000 7fd7b57b6700 1 -- 172.21.15.45:0/3467240414 >> v1:172.21.15.45:6789/0 conn(0x7fd7b00ac5c0 legacy=0x7fd7b00aa660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:21.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.015+0000 7fd7b57b6700 1 -- 172.21.15.45:0/3467240414 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7b00c5d60 con 0x7fd7b00c5900 2023-12-22T10:02:21.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.019+0000 7fd7b57b6700 1 --2- 172.21.15.45:0/3467240414 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd7b00c5900 0x7fd7b01580d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7fd7a0009760 tx=0x7fd7a0009060).ready entity=mon.1 client_cookie=d5547c15e5ee8bac server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:21.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.019+0000 7fd7b4fb5700 1 -- 172.21.15.45:0/3467240414 <== mon.1 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a000b590 con 0x7fd7b00c5900 2023-12-22T10:02:21.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.019+0000 7fd7b4fb5700 1 -- 172.21.15.45:0/3467240414 <== mon.1 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7a000b6f0 con 0x7fd7b00c5900 2023-12-22T10:02:21.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.019+0000 7fd7b4fb5700 1 -- 172.21.15.45:0/3467240414 <== mon.1 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a000ba70 con 0x7fd7b00c5900 2023-12-22T10:02:21.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.019+0000 7fd7b821b700 1 -- 172.21.15.45:0/3467240414 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd7b00c5900 msgr2=0x7fd7b01580d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:21.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.019+0000 7fd7b821b700 1 --2- 172.21.15.45:0/3467240414 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd7b00c5900 0x7fd7b01580d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7fd7a0009760 tx=0x7fd7a0009060).stop 2023-12-22T10:02:21.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.019+0000 7fd7b821b700 1 -- 172.21.15.45:0/3467240414 shutdown_connections 2023-12-22T10:02:21.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.019+0000 7fd7b821b700 1 --2- 172.21.15.45:0/3467240414 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd7b00c5900 0x7fd7b01580d0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:21.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.019+0000 7fd7b821b700 1 -- 172.21.15.45:0/3467240414 >> 172.21.15.45:0/3467240414 conn(0x7fd7b0082a30 msgr2=0x7fd7b0066a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:02:21.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.019+0000 7fd7b821b700 1 -- 172.21.15.45:0/3467240414 shutdown_connections 2023-12-22T10:02:21.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.019+0000 7fd7b821b700 1 -- 172.21.15.45:0/3467240414 wait complete. 2023-12-22T10:02:21.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.023+0000 7fd7b821b700 1 Processor -- start 2023-12-22T10:02:21.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.023+0000 7fd7b821b700 1 -- start start 2023-12-22T10:02:21.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.023+0000 7fd7b821b700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd7b00ac5c0 0x7fd7b0151c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:21.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.023+0000 7fd7b821b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7b00c5900 0x7fd7b0164d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:21.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.023+0000 7fd7b821b700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd7b00c7430 0x7fd7b01530e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:21.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.023+0000 7fd7b821b700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b0152140 con 0x7fd7b00c5900 2023-12-22T10:02:21.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.023+0000 7fd7b821b700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b00af920 con 0x7fd7b00c7430 2023-12-22T10:02:21.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.023+0000 7fd7b821b700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b0165250 con 0x7fd7b00ac5c0 2023-12-22T10:02:21.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.023+0000 7fd7b57b6700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7b00c5900 0x7fd7b0164d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:21.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.023+0000 7fd7b57b6700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7b00c5900 0x7fd7b0164d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47142/0 (socket says 172.21.15.45:47142) 2023-12-22T10:02:21.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.023+0000 7fd7b57b6700 1 -- 172.21.15.45:0/2321100249 learned_addr learned my addr 172.21.15.45:0/2321100249 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:02:21.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.023+0000 7fd7b5fb7700 1 --2- 172.21.15.45:0/2321100249 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd7b00ac5c0 0x7fd7b0151c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:21.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.023+0000 7fd7b67b8700 1 --2- 172.21.15.45:0/2321100249 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd7b00c7430 0x7fd7b01530e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:21.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.027+0000 7fd7b57b6700 1 -- 172.21.15.45:0/2321100249 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd7b00ac5c0 msgr2=0x7fd7b0151c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:21.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.027+0000 7fd7b57b6700 1 --2- 172.21.15.45:0/2321100249 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd7b00ac5c0 0x7fd7b0151c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:21.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.027+0000 7fd7b57b6700 1 -- 172.21.15.45:0/2321100249 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd7b00c7430 msgr2=0x7fd7b01530e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:21.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.027+0000 7fd7b57b6700 1 --2- 172.21.15.45:0/2321100249 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd7b00c7430 0x7fd7b01530e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:21.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.027+0000 7fd7b57b6700 1 -- 172.21.15.45:0/2321100249 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7a00092a0 con 0x7fd7b00c5900 2023-12-22T10:02:21.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.027+0000 7fd7b57b6700 1 --2- 172.21.15.45:0/2321100249 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7b00c5900 0x7fd7b0164d60 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 rx=0x7fd7a0009e00 tx=0x7fd7a0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:21.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.027+0000 7fd7a5ffb700 1 -- 172.21.15.45:0/2321100249 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a0009e30 con 0x7fd7b00c5900 2023-12-22T10:02:21.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.027+0000 7fd7a5ffb700 1 -- 172.21.15.45:0/2321100249 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7a000b860 con 0x7fd7b00c5900 2023-12-22T10:02:21.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.027+0000 7fd7a5ffb700 1 -- 172.21.15.45:0/2321100249 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a001b640 con 0x7fd7b00c5900 2023-12-22T10:02:21.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.027+0000 7fd7b821b700 1 -- 172.21.15.45:0/2321100249 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7b00afbe0 con 0x7fd7b00c5900 2023-12-22T10:02:21.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.027+0000 7fd7b821b700 1 -- 172.21.15.45:0/2321100249 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7b00b01a0 con 0x7fd7b00c5900 2023-12-22T10:02:21.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.027+0000 7fd7b821b700 1 -- 172.21.15.45:0/2321100249 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7b006c070 con 0x7fd7b00c5900 2023-12-22T10:02:21.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.031+0000 7fd7a5ffb700 1 -- 172.21.15.45:0/2321100249 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7fd7a001b9b0 con 0x7fd7b00c5900 2023-12-22T10:02:21.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.031+0000 7fd7a5ffb700 1 --2- 172.21.15.45:0/2321100249 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fd79405a4e0 0x7fd79405c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:21.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.031+0000 7fd7a5ffb700 1 -- 172.21.15.45:0/2321100249 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5355+0+0 (secure 0 0 0) 0x7fd7a0075c00 con 0x7fd7b00c5900 2023-12-22T10:02:21.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.031+0000 7fd7b5fb7700 1 --2- 172.21.15.45:0/2321100249 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fd79405a4e0 0x7fd79405c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:21.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.031+0000 7fd7b5fb7700 1 --2- 172.21.15.45:0/2321100249 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fd79405a4e0 0x7fd79405c9a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7fd7ac005750 tx=0x7fd7ac009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:21.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.035+0000 7fd7a5ffb700 1 -- 172.21.15.45:0/2321100249 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd7a007c080 con 0x7fd7b00c5900 2023-12-22T10:02:21.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.207+0000 7fd7b821b700 1 -- 172.21.15.45:0/2321100249 --> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7fd7b00c5fc0 con 0x7fd79405a4e0 2023-12-22T10:02:21.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.207+0000 7fd7a5ffb700 1 -- 172.21.15.45:0/2321100249 <== mgr.4104 v2:172.21.15.45:6832/33679 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd7b00c5fc0 con 0x7fd79405a4e0 2023-12-22T10:02:21.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.211+0000 7fd7b821b700 1 -- 172.21.15.45:0/2321100249 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fd79405a4e0 msgr2=0x7fd79405c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:21.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.211+0000 7fd7b821b700 1 --2- 172.21.15.45:0/2321100249 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fd79405a4e0 0x7fd79405c9a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7fd7ac005750 tx=0x7fd7ac009040).stop 2023-12-22T10:02:21.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.211+0000 7fd7b821b700 1 -- 172.21.15.45:0/2321100249 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7b00c5900 msgr2=0x7fd7b0164d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:21.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.211+0000 7fd7b821b700 1 --2- 172.21.15.45:0/2321100249 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7b00c5900 0x7fd7b0164d60 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 rx=0x7fd7a0009e00 tx=0x7fd7a0017000).stop 2023-12-22T10:02:21.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.211+0000 7fd7b821b700 1 -- 172.21.15.45:0/2321100249 shutdown_connections 2023-12-22T10:02:21.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.211+0000 7fd7b821b700 1 --2- 172.21.15.45:0/2321100249 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7fd7b00c7430 0x7fd7b01530e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:21.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.211+0000 7fd7b821b700 1 --2- 172.21.15.45:0/2321100249 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7b00c5900 0x7fd7b0164d60 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:21.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.211+0000 7fd7b821b700 1 --2- 172.21.15.45:0/2321100249 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7fd79405a4e0 0x7fd79405c9a0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:21.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.211+0000 7fd7b821b700 1 --2- 172.21.15.45:0/2321100249 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7fd7b00ac5c0 0x7fd7b0151c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:21.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.211+0000 7fd7b821b700 1 -- 172.21.15.45:0/2321100249 >> 172.21.15.45:0/2321100249 conn(0x7fd7b0082a30 msgr2=0x7fd7b00c0fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:02:21.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.211+0000 7fd7b821b700 1 -- 172.21.15.45:0/2321100249 shutdown_connections 2023-12-22T10:02:21.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.211+0000 7fd7b821b700 1 -- 172.21.15.45:0/2321100249 wait complete. 2023-12-22T10:02:21.212 INFO:teuthology.orchestra.run.smithi045.stderr:instructed osd(s) 6 to deep-scrub 2023-12-22T10:02:21.228 INFO:tasks.ceph:Scrubbing osd.7 2023-12-22T10:02:21.229 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-12-22T10:02:21.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.399+0000 7f39ba7b9700 1 Processor -- start 2023-12-22T10:02:21.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.399+0000 7f39ba7b9700 1 -- start start 2023-12-22T10:02:21.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.399+0000 7f39ba7b9700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f39b4153b30 0x7f39b4158020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:21.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.399+0000 7f39ba7b9700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f39b40c4340 0x7f39b4064620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:21.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.399+0000 7f39ba7b9700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39b40657b0 con 0x7f39b4064b10 2023-12-22T10:02:21.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.399+0000 7f39ba7b9700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39b406a860 con 0x7f39b40c4340 2023-12-22T10:02:21.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.399+0000 7f39ba7b9700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39b40c53e0 con 0x7f39b4153b30 2023-12-22T10:02:21.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.403+0000 7f39b8fb6700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f39b40c4340 0x7f39b4064620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:21.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.403+0000 7f39b9fb8700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f39b4064b10 0x7f39b4153f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:53540/0 (socket says 172.21.15.45:53540) 2023-12-22T10:02:21.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.403+0000 7f39b9fb8700 1 -- 172.21.15.45:0/809757498 learned_addr learned my addr 172.21.15.45:0/809757498 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:02:21.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.403+0000 7f39b8fb6700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f39b40c4340 0x7f39b4064620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47152/0 (socket says 172.21.15.45:47152) 2023-12-22T10:02:21.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.403+0000 7f39b97b7700 1 --2- 172.21.15.45:0/809757498 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f39b4153b30 0x7f39b4158020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:21.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.403+0000 7f39b8fb6700 1 -- 172.21.15.45:0/809757498 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f39b4153b30 msgr2=0x7f39b4158020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:02:21.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.403+0000 7f39b8fb6700 1 --2- 172.21.15.45:0/809757498 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f39b4153b30 0x7f39b4158020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:21.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.403+0000 7f39b8fb6700 1 -- 172.21.15.45:0/809757498 >> v1:172.21.15.45:6789/0 conn(0x7f39b4064b10 legacy=0x7f39b4153f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:21.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.403+0000 7f39b8fb6700 1 -- 172.21.15.45:0/809757498 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39b4064f40 con 0x7f39b40c4340 2023-12-22T10:02:21.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.403+0000 7f39abfff700 1 -- 172.21.15.45:0/809757498 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 866588413 0 0) 0x7f39b40657b0 con 0x7f39b4064b10 2023-12-22T10:02:21.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.403+0000 7f39b8fb6700 1 --2- 172.21.15.45:0/809757498 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39b40c4340 0x7f39b4064620 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 rx=0x7f39a4009760 tx=0x7f39a4009060).ready entity=mon.0 client_cookie=88fd119b192bbfdd server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:21.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.403+0000 7f39abfff700 1 -- 172.21.15.45:0/809757498 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a400f510 con 0x7f39b40c4340 2023-12-22T10:02:21.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.403+0000 7f39abfff700 1 -- 172.21.15.45:0/809757498 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39a400f670 con 0x7f39b40c4340 2023-12-22T10:02:21.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.403+0000 7f39abfff700 1 -- 172.21.15.45:0/809757498 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a400f9f0 con 0x7f39b40c4340 2023-12-22T10:02:21.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.403+0000 7f39ba7b9700 1 -- 172.21.15.45:0/809757498 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39b40c4340 msgr2=0x7f39b4064620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:21.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.403+0000 7f39ba7b9700 1 --2- 172.21.15.45:0/809757498 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39b40c4340 0x7f39b4064620 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 rx=0x7f39a4009760 tx=0x7f39a4009060).stop 2023-12-22T10:02:21.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.403+0000 7f39ba7b9700 1 -- 172.21.15.45:0/809757498 shutdown_connections 2023-12-22T10:02:21.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.403+0000 7f39ba7b9700 1 --2- 172.21.15.45:0/809757498 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39b40c4340 0x7f39b4064620 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:21.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.403+0000 7f39ba7b9700 1 --2- 172.21.15.45:0/809757498 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f39b4153b30 0x7f39b4158020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:21.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.403+0000 7f39ba7b9700 1 -- 172.21.15.45:0/809757498 >> 172.21.15.45:0/809757498 conn(0x7f39b4067500 msgr2=0x7f39b40c6440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:02:21.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.403+0000 7f39ba7b9700 1 -- 172.21.15.45:0/809757498 shutdown_connections 2023-12-22T10:02:21.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.403+0000 7f39ba7b9700 1 -- 172.21.15.45:0/809757498 wait complete. 2023-12-22T10:02:21.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.407+0000 7f39ba7b9700 1 Processor -- start 2023-12-22T10:02:21.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.407+0000 7f39ba7b9700 1 -- start start 2023-12-22T10:02:21.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.411+0000 7f39ba7b9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39b4064b10 0x7f39b40a8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:21.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.411+0000 7f39ba7b9700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f39b4153b30 0x7f39b40aa4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:21.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.411+0000 7f39ba7b9700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f39b40aa9e0 0x7f39b40bfaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:21.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.411+0000 7f39ba7b9700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39b40aae60 con 0x7f39b4064b10 2023-12-22T10:02:21.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.411+0000 7f39ba7b9700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39b40abc70 con 0x7f39b40aa9e0 2023-12-22T10:02:21.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.411+0000 7f39ba7b9700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39b4164570 con 0x7f39b4153b30 2023-12-22T10:02:21.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.411+0000 7f39b97b7700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39b4064b10 0x7f39b40a8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:21.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.411+0000 7f39b97b7700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39b4064b10 0x7f39b40a8540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47158/0 (socket says 172.21.15.45:47158) 2023-12-22T10:02:21.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.411+0000 7f39b97b7700 1 -- 172.21.15.45:0/3479096929 learned_addr learned my addr 172.21.15.45:0/3479096929 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:02:21.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.411+0000 7f39b8fb6700 1 --2- 172.21.15.45:0/3479096929 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f39b4153b30 0x7f39b40aa4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:21.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.411+0000 7f39b97b7700 1 -- 172.21.15.45:0/3479096929 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f39b4153b30 msgr2=0x7f39b40aa4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:21.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.411+0000 7f39b97b7700 1 --2- 172.21.15.45:0/3479096929 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f39b4153b30 0x7f39b40aa4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:21.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.411+0000 7f39b97b7700 1 -- 172.21.15.45:0/3479096929 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f39b40aa9e0 msgr2=0x7f39b40bfaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:21.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.411+0000 7f39b97b7700 1 --2- 172.21.15.45:0/3479096929 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f39b40aa9e0 0x7f39b40bfaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-12-22T10:02:21.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.411+0000 7f39b97b7700 1 -- 172.21.15.45:0/3479096929 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39a40092a0 con 0x7f39b4064b10 2023-12-22T10:02:21.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.411+0000 7f39b8fb6700 1 --2- 172.21.15.45:0/3479096929 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f39b4153b30 0x7f39b40aa4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-12-22T10:02:21.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.411+0000 7f39b97b7700 1 --2- 172.21.15.45:0/3479096929 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39b4064b10 0x7f39b40a8540 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 rx=0x7f39b0009e50 tx=0x7f39b000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:21.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.411+0000 7f39a97fa700 1 -- 172.21.15.45:0/3479096929 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b000cc20 con 0x7f39b4064b10 2023-12-22T10:02:21.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.411+0000 7f39a97fa700 1 -- 172.21.15.45:0/3479096929 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39b000f040 con 0x7f39b4064b10 2023-12-22T10:02:21.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.411+0000 7f39a97fa700 1 -- 172.21.15.45:0/3479096929 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b0013400 con 0x7f39b4064b10 2023-12-22T10:02:21.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.411+0000 7f39ba7b9700 1 -- 172.21.15.45:0/3479096929 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39b40ab060 con 0x7f39b4064b10 2023-12-22T10:02:21.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.411+0000 7f39ba7b9700 1 -- 172.21.15.45:0/3479096929 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39b40ab620 con 0x7f39b4064b10 2023-12-22T10:02:21.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.415+0000 7f39ba7b9700 1 -- 172.21.15.45:0/3479096929 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f39b4047060 con 0x7f39b4064b10 2023-12-22T10:02:21.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.415+0000 7f39a97fa700 1 -- 172.21.15.45:0/3479096929 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f39b0013770 con 0x7f39b4064b10 2023-12-22T10:02:21.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.415+0000 7f39a97fa700 1 --2- 172.21.15.45:0/3479096929 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f399805a4e0 0x7f399805c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:21.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.415+0000 7f39a97fa700 1 -- 172.21.15.45:0/3479096929 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f39b0074e40 con 0x7f39b4064b10 2023-12-22T10:02:21.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.415+0000 7f39b8fb6700 1 --2- 172.21.15.45:0/3479096929 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f399805a4e0 0x7f399805c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:21.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.415+0000 7f39a97fa700 1 --2- 172.21.15.45:0/3479096929 >> [v2:172.21.15.113:6821/34102,v1:172.21.15.113:6825/34102] conn(0x7f3998060ad0 0x7f3998062f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:21.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.415+0000 7f39a97fa700 1 -- 172.21.15.45:0/3479096929 --> [v2:172.21.15.113:6821/34102,v1:172.21.15.113:6825/34102] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f39980635b0 con 0x7f3998060ad0 2023-12-22T10:02:21.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.415+0000 7f39a97fa700 1 -- 172.21.15.45:0/3479096929 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f39b0077340 con 0x7f39b4064b10 2023-12-22T10:02:21.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.415+0000 7f39b9fb8700 1 --2- 172.21.15.45:0/3479096929 >> [v2:172.21.15.113:6821/34102,v1:172.21.15.113:6825/34102] conn(0x7f3998060ad0 0x7f3998062f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:21.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.419+0000 7f39b8fb6700 1 --2- 172.21.15.45:0/3479096929 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f399805a4e0 0x7f399805c9a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f39b4063e50 tx=0x7f39a4017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:21.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.419+0000 7f39b9fb8700 1 --2- 172.21.15.45:0/3479096929 >> [v2:172.21.15.113:6821/34102,v1:172.21.15.113:6825/34102] conn(0x7f3998060ad0 0x7f3998062f30 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:21.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.419+0000 7f39a97fa700 1 -- 172.21.15.45:0/3479096929 <== osd.7 v2:172.21.15.113:6821/34102 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7f39980635b0 con 0x7f3998060ad0 2023-12-22T10:02:21.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.435+0000 7f39ba7b9700 1 -- 172.21.15.45:0/3479096929 --> [v2:172.21.15.113:6821/34102,v1:172.21.15.113:6825/34102] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f39b40c47d0 con 0x7f3998060ad0 2023-12-22T10:02:21.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.443+0000 7f39a97fa700 1 -- 172.21.15.45:0/3479096929 <== osd.7 v2:172.21.15.113:6821/34102 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f39b40c47d0 con 0x7f3998060ad0 2023-12-22T10:02:21.438 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-22T10:02:21.438 INFO:teuthology.orchestra.run.smithi045.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-12-22T10:02:21.438 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-22T10:02:21.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.443+0000 7f39ba7b9700 1 -- 172.21.15.45:0/3479096929 >> [v2:172.21.15.113:6821/34102,v1:172.21.15.113:6825/34102] conn(0x7f3998060ad0 msgr2=0x7f3998062f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:21.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.443+0000 7f39ba7b9700 1 --2- 172.21.15.45:0/3479096929 >> [v2:172.21.15.113:6821/34102,v1:172.21.15.113:6825/34102] conn(0x7f3998060ad0 0x7f3998062f30 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:21.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.443+0000 7f39ba7b9700 1 -- 172.21.15.45:0/3479096929 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f399805a4e0 msgr2=0x7f399805c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:21.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.443+0000 7f39ba7b9700 1 --2- 172.21.15.45:0/3479096929 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f399805a4e0 0x7f399805c9a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f39b4063e50 tx=0x7f39a4017000).stop 2023-12-22T10:02:21.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.443+0000 7f39ba7b9700 1 -- 172.21.15.45:0/3479096929 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39b4064b10 msgr2=0x7f39b40a8540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:21.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.443+0000 7f39ba7b9700 1 --2- 172.21.15.45:0/3479096929 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39b4064b10 0x7f39b40a8540 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 rx=0x7f39b0009e50 tx=0x7f39b000b040).stop 2023-12-22T10:02:21.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.443+0000 7f39b9fb8700 1 -- 172.21.15.45:0/3479096929 reap_dead start 2023-12-22T10:02:21.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.443+0000 7f39ba7b9700 1 -- 172.21.15.45:0/3479096929 shutdown_connections 2023-12-22T10:02:21.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.443+0000 7f39ba7b9700 1 -- 172.21.15.45:0/3479096929 >> 172.21.15.45:0/3479096929 conn(0x7f39b4067500 msgr2=0x7f39b4156920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:02:21.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.443+0000 7f39ba7b9700 1 -- 172.21.15.45:0/3479096929 shutdown_connections 2023-12-22T10:02:21.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.443+0000 7f39ba7b9700 1 -- 172.21.15.45:0/3479096929 wait complete. 2023-12-22T10:02:21.458 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-12-22T10:02:21.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.627+0000 7f68ab239700 1 Processor -- start 2023-12-22T10:02:21.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.627+0000 7f68ab239700 1 -- start start 2023-12-22T10:02:21.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.631+0000 7f68ab239700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f68a4068a80 0x7f68a406a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:21.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.631+0000 7f68ab239700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f68a4150880 0x7f68a40c2060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:21.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.631+0000 7f68ab239700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68a4069bc0 con 0x7f68a41504a0 2023-12-22T10:02:21.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.631+0000 7f68ab239700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68a406a540 con 0x7f68a4068a80 2023-12-22T10:02:21.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.631+0000 7f68ab239700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68a4068fb0 con 0x7f68a4150880 2023-12-22T10:02:21.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.631+0000 7f68aa237700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f68a41504a0 0x7f68a40c6c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:53550/0 (socket says 172.21.15.45:53550) 2023-12-22T10:02:21.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.631+0000 7f68aa237700 1 -- 172.21.15.45:0/31543077 learned_addr learned my addr 172.21.15.45:0/31543077 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:02:21.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.631+0000 7f68a9a36700 1 --2- 172.21.15.45:0/31543077 >> v2:172.21.15.113:3300/0 conn(0x7f68a4068a80 0x7f68a406a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:21.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.631+0000 7f68aaa38700 1 --2- 172.21.15.45:0/31543077 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f68a4150880 0x7f68a40c2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:21.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.631+0000 7f68a9a36700 1 -- 172.21.15.45:0/31543077 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f68a4150880 msgr2=0x7f68a40c2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:02:21.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.631+0000 7f68a9235700 1 -- 172.21.15.45:0/31543077 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1149106871 0 0) 0x7f68a4069bc0 con 0x7f68a41504a0 2023-12-22T10:02:21.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.631+0000 7f68a9a36700 1 --2- 172.21.15.45:0/31543077 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f68a4150880 0x7f68a40c2060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:21.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.631+0000 7f68a9a36700 1 -- 172.21.15.45:0/31543077 >> v1:172.21.15.45:6789/0 conn(0x7f68a41504a0 legacy=0x7f68a40c6c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:21.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.631+0000 7f68a9a36700 1 -- 172.21.15.45:0/31543077 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68a4069290 con 0x7f68a4068a80 2023-12-22T10:02:21.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.631+0000 7f68aaa38700 1 --2- 172.21.15.45:0/31543077 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f68a4150880 0x7f68a40c2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T10:02:21.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.631+0000 7f68a9a36700 1 --2- 172.21.15.45:0/31543077 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f68a4068a80 0x7f68a406a050 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7f6894009760 tx=0x7f6894009060).ready entity=mon.1 client_cookie=f66b362197b49915 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:21.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.635+0000 7f68a9235700 1 -- 172.21.15.45:0/31543077 <== mon.1 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f689400f6b0 con 0x7f68a4068a80 2023-12-22T10:02:21.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.635+0000 7f68a9235700 1 -- 172.21.15.45:0/31543077 <== mon.1 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f689400f810 con 0x7f68a4068a80 2023-12-22T10:02:21.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.635+0000 7f68a9235700 1 -- 172.21.15.45:0/31543077 <== mon.1 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f689400fb90 con 0x7f68a4068a80 2023-12-22T10:02:21.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.635+0000 7f68ab239700 1 -- 172.21.15.45:0/31543077 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f68a4068a80 msgr2=0x7f68a406a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:21.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.635+0000 7f68ab239700 1 --2- 172.21.15.45:0/31543077 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f68a4068a80 0x7f68a406a050 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7f6894009760 tx=0x7f6894009060).stop 2023-12-22T10:02:21.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.635+0000 7f68ab239700 1 -- 172.21.15.45:0/31543077 shutdown_connections 2023-12-22T10:02:21.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.635+0000 7f68ab239700 1 --2- 172.21.15.45:0/31543077 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f68a4150880 0x7f68a40c2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:21.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.635+0000 7f68ab239700 1 --2- 172.21.15.45:0/31543077 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f68a4068a80 0x7f68a406a050 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:21.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.635+0000 7f68ab239700 1 -- 172.21.15.45:0/31543077 >> 172.21.15.45:0/31543077 conn(0x7f68a4067500 msgr2=0x7f68a40c6400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:02:21.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.635+0000 7f68ab239700 1 -- 172.21.15.45:0/31543077 shutdown_connections 2023-12-22T10:02:21.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.635+0000 7f68ab239700 1 -- 172.21.15.45:0/31543077 wait complete. 2023-12-22T10:02:21.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.639+0000 7f68ab239700 1 Processor -- start 2023-12-22T10:02:21.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.639+0000 7f68ab239700 1 -- start start 2023-12-22T10:02:21.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.639+0000 7f68ab239700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68a4068a80 0x7f68a414f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:21.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.639+0000 7f68ab239700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f68a41504a0 0x7f68a40bfb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:21.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.639+0000 7f68ab239700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f68a4150880 0x7f68a40c0020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:21.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.639+0000 7f68ab239700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68a4159500 con 0x7f68a4068a80 2023-12-22T10:02:21.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.639+0000 7f68ab239700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68a4163dd0 con 0x7f68a4150880 2023-12-22T10:02:21.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.639+0000 7f68ab239700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68a40c0510 con 0x7f68a41504a0 2023-12-22T10:02:21.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.639+0000 7f68aa237700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68a4068a80 0x7f68a414f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:21.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.639+0000 7f68aa237700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68a4068a80 0x7f68a414f6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47160/0 (socket says 172.21.15.45:47160) 2023-12-22T10:02:21.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.639+0000 7f68aa237700 1 -- 172.21.15.45:0/3294300079 learned_addr learned my addr 172.21.15.45:0/3294300079 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:02:21.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.639+0000 7f68aaa38700 1 --2- 172.21.15.45:0/3294300079 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f68a4150880 0x7f68a40c0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:21.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.639+0000 7f68a9a36700 1 --2- 172.21.15.45:0/3294300079 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f68a41504a0 0x7f68a40bfb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:21.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.639+0000 7f68aa237700 1 -- 172.21.15.45:0/3294300079 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f68a41504a0 msgr2=0x7f68a40bfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:21.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.639+0000 7f68aa237700 1 --2- 172.21.15.45:0/3294300079 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f68a41504a0 0x7f68a40bfb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:21.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.639+0000 7f68aa237700 1 -- 172.21.15.45:0/3294300079 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f68a4150880 msgr2=0x7f68a40c0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:21.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.639+0000 7f68aa237700 1 --2- 172.21.15.45:0/3294300079 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f68a4150880 0x7f68a40c0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:21.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.639+0000 7f68aa237700 1 -- 172.21.15.45:0/3294300079 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68940092a0 con 0x7f68a4068a80 2023-12-22T10:02:21.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.639+0000 7f68aaa38700 1 --2- 172.21.15.45:0/3294300079 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f68a4150880 0x7f68a40c0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-22T10:02:21.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.643+0000 7f68aa237700 1 --2- 172.21.15.45:0/3294300079 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68a4068a80 0x7f68a414f6a0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7f68a000c960 tx=0x7f68a0001630).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:21.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.643+0000 7f689a7fc700 1 -- 172.21.15.45:0/3294300079 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68a0005d30 con 0x7f68a4068a80 2023-12-22T10:02:21.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.643+0000 7f689a7fc700 1 -- 172.21.15.45:0/3294300079 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68a0005e90 con 0x7f68a4068a80 2023-12-22T10:02:21.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.643+0000 7f68ab239700 1 -- 172.21.15.45:0/3294300079 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68a4158c60 con 0x7f68a4068a80 2023-12-22T10:02:21.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.643+0000 7f689a7fc700 1 -- 172.21.15.45:0/3294300079 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68a0007320 con 0x7f68a4068a80 2023-12-22T10:02:21.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.643+0000 7f68ab239700 1 -- 172.21.15.45:0/3294300079 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68a4159220 con 0x7f68a4068a80 2023-12-22T10:02:21.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.643+0000 7f68ab239700 1 -- 172.21.15.45:0/3294300079 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68a4047060 con 0x7f68a4068a80 2023-12-22T10:02:21.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.643+0000 7f689a7fc700 1 -- 172.21.15.45:0/3294300079 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f68a0007710 con 0x7f68a4068a80 2023-12-22T10:02:21.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.647+0000 7f689a7fc700 1 --2- 172.21.15.45:0/3294300079 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f688805a510 0x7f688805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:21.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.647+0000 7f689a7fc700 1 -- 172.21.15.45:0/3294300079 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f68a0074730 con 0x7f68a4068a80 2023-12-22T10:02:21.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.647+0000 7f68a9a36700 1 --2- 172.21.15.45:0/3294300079 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f688805a510 0x7f688805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:21.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.647+0000 7f68a9a36700 1 --2- 172.21.15.45:0/3294300079 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f688805a510 0x7f688805c9d0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7f6894009760 tx=0x7f6894019000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:21.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.651+0000 7f689a7fc700 1 -- 172.21.15.45:0/3294300079 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f68a0048150 con 0x7f68a4068a80 2023-12-22T10:02:21.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.815+0000 7f68ab239700 1 -- 172.21.15.45:0/3294300079 --> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f68a40c5c00 con 0x7f688805a510 2023-12-22T10:02:21.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.819+0000 7f689a7fc700 1 -- 172.21.15.45:0/3294300079 <== mgr.4104 v2:172.21.15.45:6832/33679 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f68a40c5c00 con 0x7f688805a510 2023-12-22T10:02:21.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.823+0000 7f68ab239700 1 -- 172.21.15.45:0/3294300079 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f688805a510 msgr2=0x7f688805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:21.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.823+0000 7f68ab239700 1 --2- 172.21.15.45:0/3294300079 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f688805a510 0x7f688805c9d0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7f6894009760 tx=0x7f6894019000).stop 2023-12-22T10:02:21.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.823+0000 7f68ab239700 1 -- 172.21.15.45:0/3294300079 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68a4068a80 msgr2=0x7f68a414f6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:21.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.823+0000 7f68ab239700 1 --2- 172.21.15.45:0/3294300079 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68a4068a80 0x7f68a414f6a0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7f68a000c960 tx=0x7f68a0001630).stop 2023-12-22T10:02:21.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.823+0000 7f68ab239700 1 -- 172.21.15.45:0/3294300079 shutdown_connections 2023-12-22T10:02:21.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.823+0000 7f68ab239700 1 --2- 172.21.15.45:0/3294300079 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f68a4150880 0x7f68a40c0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:21.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.823+0000 7f68ab239700 1 --2- 172.21.15.45:0/3294300079 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f688805a510 0x7f688805c9d0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:21.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.823+0000 7f68ab239700 1 --2- 172.21.15.45:0/3294300079 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f68a41504a0 0x7f68a40bfb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:21.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.823+0000 7f68ab239700 1 --2- 172.21.15.45:0/3294300079 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68a4068a80 0x7f68a414f6a0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:21.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.823+0000 7f68ab239700 1 -- 172.21.15.45:0/3294300079 >> 172.21.15.45:0/3294300079 conn(0x7f68a4067500 msgr2=0x7f68a40c37b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:02:21.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.823+0000 7f68ab239700 1 -- 172.21.15.45:0/3294300079 shutdown_connections 2023-12-22T10:02:21.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:21.823+0000 7f68ab239700 1 -- 172.21.15.45:0/3294300079 wait complete. 2023-12-22T10:02:21.825 INFO:teuthology.orchestra.run.smithi045.stderr:instructed osd(s) 7 to deep-scrub 2023-12-22T10:02:21.843 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-22T10:02:22.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:22.015+0000 7f5855c5b700 1 Processor -- start 2023-12-22T10:02:22.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:22.015+0000 7f5855c5b700 1 -- start start 2023-12-22T10:02:22.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:22.019+0000 7f5855c5b700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f5850153aa0 0x7f58500bfbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:22.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:22.019+0000 7f5855c5b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5850154e90 0x7f58500c00c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:22.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:22.019+0000 7f5855c5b700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58500c27d0 con 0x7f5850067590 2023-12-22T10:02:22.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:22.019+0000 7f5855c5b700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58500c05b0 con 0x7f5850154e90 2023-12-22T10:02:22.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:22.019+0000 7f5855c5b700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5850065870 con 0x7f5850153aa0 2023-12-22T10:02:22.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:22.019+0000 7f584ffff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5850154e90 0x7f58500c00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:22.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:22.019+0000 7f584ffff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5850154e90 0x7f58500c00c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47168/0 (socket says 172.21.15.45:47168) 2023-12-22T10:02:22.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:22.019+0000 7f584ffff700 1 -- 172.21.15.45:0/1293424572 learned_addr learned my addr 172.21.15.45:0/1293424572 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:02:22.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:22.019+0000 7f584f7fe700 1 --2- 172.21.15.45:0/1293424572 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f5850153aa0 0x7f58500bfbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:22.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:22.019+0000 7f584ffff700 1 -- 172.21.15.45:0/1293424572 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f5850153aa0 msgr2=0x7f58500bfbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:02:22.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:22.019+0000 7f584ffff700 1 --2- 172.21.15.45:0/1293424572 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f5850153aa0 0x7f58500bfbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:22.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:22.019+0000 7f584ffff700 1 -- 172.21.15.45:0/1293424572 >> v1:172.21.15.45:6789/0 conn(0x7f5850067590 legacy=0x7f58500c2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:02:22.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:22.019+0000 7f584ffff700 1 -- 172.21.15.45:0/1293424572 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5850065b50 con 0x7f5850154e90 2023-12-22T10:02:22.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:22.019+0000 7f584ffff700 1 --2- 172.21.15.45:0/1293424572 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5850154e90 0x7f58500c00c0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 rx=0x7f5848009f20 tx=0x7f5848009840).ready entity=mon.0 client_cookie=f66f30b222133a1 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:22.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:22.019+0000 7f584effd700 1 -- 172.21.15.45:0/1293424572 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f584800e070 con 0x7f5850154e90 2023-12-22T10:02:22.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:22.023+0000 7f584effd700 1 -- 172.21.15.45:0/1293424572 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f584800ba40 con 0x7f5850154e90 2023-12-22T10:02:22.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:22.023+0000 7f584effd700 1 -- 172.21.15.45:0/1293424572 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f584800bdc0 con 0x7f5850154e90 2023-12-22T10:02:22.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:22.023+0000 7f5855c5b700 1 -- 172.21.15.45:0/1293424572 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5850154e90 msgr2=0x7f58500c00c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:22.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:22.023+0000 7f5855c5b700 1 --2- 172.21.15.45:0/1293424572 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5850154e90 0x7f58500c00c0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 rx=0x7f5848009f20 tx=0x7f5848009840).stop 2023-12-22T10:02:22.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:22.023+0000 7f5855c5b700 1 -- 172.21.15.45:0/1293424572 shutdown_connections 2023-12-22T10:02:22.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:22.023+0000 7f5855c5b700 1 --2- 172.21.15.45:0/1293424572 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5850154e90 0x7f58500c00c0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:22.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:22.023+0000 7f5855c5b700 1 --2- 172.21.15.45:0/1293424572 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f5850153aa0 0x7f58500bfbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:22.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:22.023+0000 7f5855c5b700 1 -- 172.21.15.45:0/1293424572 >> 172.21.15.45:0/1293424572 conn(0x7f5850066a70 msgr2=0x7f5850066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:02:22.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:22.023+0000 7f5855c5b700 1 -- 172.21.15.45:0/1293424572 shutdown_connections 2023-12-22T10:02:22.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:22.023+0000 7f5855c5b700 1 -- 172.21.15.45:0/1293424572 wait complete. 2023-12-22T10:02:22.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:22.023+0000 7f5855c5b700 1 Processor -- start 2023-12-22T10:02:22.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:22.023+0000 7f5855c5b700 1 -- start start 2023-12-22T10:02:22.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:22.027+0000 7f5855c5b700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f5850067590 0x7f58501501b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:22.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:22.027+0000 7f5855c5b700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5850153aa0 0x7f58500ab210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:22.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:22.027+0000 7f5855c5b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5850154e90 0x7f58500ab700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:22.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:22.027+0000 7f5855c5b700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58500ac2d0 con 0x7f5850154e90 2023-12-22T10:02:22.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:22.027+0000 7f5855c5b700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5850164080 con 0x7f5850153aa0 2023-12-22T10:02:22.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:22.027+0000 7f5855c5b700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58500abd10 con 0x7f5850067590 2023-12-22T10:02:22.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:22.027+0000 7f584ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5850154e90 0x7f58500ab700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:22.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:22.027+0000 7f584ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5850154e90 0x7f58500ab700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47174/0 (socket says 172.21.15.45:47174) 2023-12-22T10:02:22.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:22.027+0000 7f584ffff700 1 -- 172.21.15.45:0/3364497079 learned_addr learned my addr 172.21.15.45:0/3364497079 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:02:22.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:22.027+0000 7f584f7fe700 1 --2- 172.21.15.45:0/3364497079 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f5850067590 0x7f58501501b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:22.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:22.027+0000 7f5847fff700 1 --2- 172.21.15.45:0/3364497079 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5850153aa0 0x7f58500ab210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:22.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:22.027+0000 7f584ffff700 1 -- 172.21.15.45:0/3364497079 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f5850067590 msgr2=0x7f58501501b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:22.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:22.027+0000 7f584ffff700 1 --2- 172.21.15.45:0/3364497079 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f5850067590 0x7f58501501b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:22.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:22.027+0000 7f584ffff700 1 -- 172.21.15.45:0/3364497079 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5850153aa0 msgr2=0x7f58500ab210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:22.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:22.027+0000 7f584ffff700 1 --2- 172.21.15.45:0/3364497079 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5850153aa0 0x7f58500ab210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:22.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:22.027+0000 7f584ffff700 1 -- 172.21.15.45:0/3364497079 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5848009ae0 con 0x7f5850154e90 2023-12-22T10:02:22.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:22.027+0000 7f584ffff700 1 --2- 172.21.15.45:0/3364497079 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5850154e90 0x7f58500ab700 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 rx=0x7f5848010000 tx=0x7f5848009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:22.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:22.027+0000 7f58477fe700 1 -- 172.21.15.45:0/3364497079 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f584800bdc0 con 0x7f5850154e90 2023-12-22T10:02:22.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:22.027+0000 7f58477fe700 1 -- 172.21.15.45:0/3364497079 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f584801d460 con 0x7f5850154e90 2023-12-22T10:02:22.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:22.027+0000 7f5855c5b700 1 -- 172.21.15.45:0/3364497079 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58500abff0 con 0x7f5850154e90 2023-12-22T10:02:22.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:22.027+0000 7f58477fe700 1 -- 172.21.15.45:0/3364497079 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f584801d800 con 0x7f5850154e90 2023-12-22T10:02:22.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:22.027+0000 7f5855c5b700 1 -- 172.21.15.45:0/3364497079 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58501645a0 con 0x7f5850154e90 2023-12-22T10:02:22.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:22.031+0000 7f5855c5b700 1 -- 172.21.15.45:0/3364497079 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58501647c0 con 0x7f5850154e90 2023-12-22T10:02:22.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:22.031+0000 7f58477fe700 1 -- 172.21.15.45:0/3364497079 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f5848003040 con 0x7f5850154e90 2023-12-22T10:02:22.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:22.031+0000 7f58477fe700 1 --2- 172.21.15.45:0/3364497079 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f583005a510 0x7f583005c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:22.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:22.031+0000 7f58477fe700 1 -- 172.21.15.45:0/3364497079 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f5848075940 con 0x7f5850154e90 2023-12-22T10:02:22.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:22.031+0000 7f584f7fe700 1 --2- 172.21.15.45:0/3364497079 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f583005a510 0x7f583005c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:22.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:22.035+0000 7f584f7fe700 1 --2- 172.21.15.45:0/3364497079 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f583005a510 0x7f583005c9d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7f584000bb20 tx=0x7f5840008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:22.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:22.039+0000 7f58477fe700 1 -- 172.21.15.45:0/3364497079 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f5848049410 con 0x7f5850154e90 2023-12-22T10:02:22.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:22.203+0000 7f5855c5b700 1 -- 172.21.15.45:0/3364497079 --> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5850065e30 con 0x7f583005a510 2023-12-22T10:02:22.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:22.211+0000 7f58477fe700 1 -- 172.21.15.45:0/3364497079 <== mgr.4104 v2:172.21.15.45:6832/33679 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+68264 (secure 0 0 0) 0x7f5850065e30 con 0x7f583005a510 2023-12-22T10:02:22.213 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:02:22.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:22.215+0000 7f5855c5b700 1 -- 172.21.15.45:0/3364497079 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f583005a510 msgr2=0x7f583005c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:22.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:22.215+0000 7f5855c5b700 1 --2- 172.21.15.45:0/3364497079 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f583005a510 0x7f583005c9d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7f584000bb20 tx=0x7f5840008040).stop 2023-12-22T10:02:22.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:22.215+0000 7f5855c5b700 1 -- 172.21.15.45:0/3364497079 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5850154e90 msgr2=0x7f58500ab700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:22.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:22.215+0000 7f5855c5b700 1 --2- 172.21.15.45:0/3364497079 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5850154e90 0x7f58500ab700 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 rx=0x7f5848010000 tx=0x7f5848009840).stop 2023-12-22T10:02:22.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:22.215+0000 7f5855c5b700 1 -- 172.21.15.45:0/3364497079 shutdown_connections 2023-12-22T10:02:22.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:22.215+0000 7f5855c5b700 1 --2- 172.21.15.45:0/3364497079 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5850154e90 0x7f58500ab700 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:22.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:22.215+0000 7f5855c5b700 1 --2- 172.21.15.45:0/3364497079 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f5850153aa0 0x7f58500ab210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:22.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:22.215+0000 7f5855c5b700 1 --2- 172.21.15.45:0/3364497079 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f583005a510 0x7f583005c9d0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:22.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:22.215+0000 7f5855c5b700 1 --2- 172.21.15.45:0/3364497079 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f5850067590 0x7f58501501b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:22.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:22.215+0000 7f5855c5b700 1 -- 172.21.15.45:0/3364497079 >> 172.21.15.45:0/3364497079 conn(0x7f5850066a70 msgr2=0x7f58500c2c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:02:22.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:22.215+0000 7f5855c5b700 1 -- 172.21.15.45:0/3364497079 shutdown_connections 2023-12-22T10:02:22.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:22.215+0000 7f5855c5b700 1 -- 172.21.15.45:0/3364497079 wait complete. 2023-12-22T10:02:22.218 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-12-22T10:02:22.236 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":98,"stamp":"2023-12-22T10:02:21.987807+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381120,"kb_used_data":4352,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752593600,"statfs":{"total":773094113280,"available":770655846400,"internally_reserved":0,"allocated":4456448,"data_stored":1963576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6291456,"num_objects":-2,"num_object_clones":0,"num_object_copies":-4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-4,"num_write_kb":-6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.073819"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":35,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-22T10:02:10.969626+0000","last_change":"2023-12-22T10:00:28.036372+0000","last_active":"2023-12-22T10:02:10.969626+0000","last_peered":"2023-12-22T10:02:10.969626+0000","last_clean":"2023-12-22T10:02:10.969626+0000","last_became_active":"2023-12-22T10:00:28.035974+0000","last_became_peered":"2023-12-22T10:00:28.035974+0000","last_unstale":"2023-12-22T10:02:10.969626+0000","last_undegraded":"2023-12-22T10:02:10.969626+0000","last_fullsized":"2023-12-22T10:02:10.969626+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_clean_scrub_stamp":"2023-12-22T10:00:27.001906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":38,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-22T10:02:10.958280+0000","last_change":"2023-12-22T10:00:28.035308+0000","last_active":"2023-12-22T10:02:10.958280+0000","last_peered":"2023-12-22T10:02:10.958280+0000","last_clean":"2023-12-22T10:02:10.958280+0000","last_became_active":"2023-12-22T10:00:28.035002+0000","last_became_peered":"2023-12-22T10:00:28.035002+0000","last_unstale":"2023-12-22T10:02:10.958280+0000","last_undegraded":"2023-12-22T10:02:10.958280+0000","last_fullsized":"2023-12-22T10:02:10.958280+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_clean_scrub_stamp":"2023-12-22T10:00:27.001906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":35,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-22T10:02:10.964946+0000","last_change":"2023-12-22T10:00:28.029892+0000","last_active":"2023-12-22T10:02:10.964946+0000","last_peered":"2023-12-22T10:02:10.964946+0000","last_clean":"2023-12-22T10:02:10.964946+0000","last_became_active":"2023-12-22T10:00:28.029391+0000","last_became_peered":"2023-12-22T10:00:28.029391+0000","last_unstale":"2023-12-22T10:02:10.964946+0000","last_undegraded":"2023-12-22T10:02:10.964946+0000","last_fullsized":"2023-12-22T10:02:10.964946+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_clean_scrub_stamp":"2023-12-22T10:00:27.001906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":34,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-22T10:02:10.926869+0000","last_change":"2023-12-22T10:00:28.025395+0000","last_active":"2023-12-22T10:02:10.926869+0000","last_peered":"2023-12-22T10:02:10.926869+0000","last_clean":"2023-12-22T10:02:10.926869+0000","last_became_active":"2023-12-22T10:00:28.024588+0000","last_became_peered":"2023-12-22T10:00:28.024588+0000","last_unstale":"2023-12-22T10:02:10.926869+0000","last_undegraded":"2023-12-22T10:02:10.926869+0000","last_fullsized":"2023-12-22T10:02:10.926869+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_clean_scrub_stamp":"2023-12-22T10:00:27.001906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":40,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-22T10:02:20.682250+0000","last_change":"2023-12-22T10:02:20.682250+0000","last_active":"2023-12-22T10:02:20.682250+0000","last_peered":"2023-12-22T10:02:20.682250+0000","last_clean":"2023-12-22T10:02:20.682250+0000","last_became_active":"2023-12-22T10:00:28.029422+0000","last_became_peered":"2023-12-22T10:00:28.029422+0000","last_unstale":"2023-12-22T10:02:20.682250+0000","last_undegraded":"2023-12-22T10:02:20.682250+0000","last_fullsized":"2023-12-22T10:02:20.682250+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:02:20.682093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:02:20.682093+0000","last_clean_scrub_stamp":"2023-12-22T10:02:20.682093+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":36,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-22T10:02:10.918400+0000","last_change":"2023-12-22T10:00:28.028621+0000","last_active":"2023-12-22T10:02:10.918400+0000","last_peered":"2023-12-22T10:02:10.918400+0000","last_clean":"2023-12-22T10:02:10.918400+0000","last_became_active":"2023-12-22T10:00:28.028159+0000","last_became_peered":"2023-12-22T10:00:28.028159+0000","last_unstale":"2023-12-22T10:02:10.918400+0000","last_undegraded":"2023-12-22T10:02:10.918400+0000","last_fullsized":"2023-12-22T10:02:10.918400+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_clean_scrub_stamp":"2023-12-22T10:00:27.001906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":40,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-22T10:02:19.692909+0000","last_change":"2023-12-22T10:02:19.692909+0000","last_active":"2023-12-22T10:02:19.692909+0000","last_peered":"2023-12-22T10:02:19.692909+0000","last_clean":"2023-12-22T10:02:19.692909+0000","last_became_active":"2023-12-22T10:00:28.030284+0000","last_became_peered":"2023-12-22T10:00:28.030284+0000","last_unstale":"2023-12-22T10:02:19.692909+0000","last_undegraded":"2023-12-22T10:02:19.692909+0000","last_fullsized":"2023-12-22T10:02:19.692909+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:02:19.692723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:02:19.692723+0000","last_clean_scrub_stamp":"2023-12-22T10:02:19.692723+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":35,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-22T10:02:10.960122+0000","last_change":"2023-12-22T10:00:28.031790+0000","last_active":"2023-12-22T10:02:10.960122+0000","last_peered":"2023-12-22T10:02:10.960122+0000","last_clean":"2023-12-22T10:02:10.960122+0000","last_became_active":"2023-12-22T10:00:28.031190+0000","last_became_peered":"2023-12-22T10:00:28.031190+0000","last_unstale":"2023-12-22T10:02:10.960122+0000","last_undegraded":"2023-12-22T10:02:10.960122+0000","last_fullsized":"2023-12-22T10:02:10.960122+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:00:27.001906+0000","last_clean_scrub_stamp":"2023-12-22T10:00:27.001906+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":41,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-22T10:02:18.176967+0000","last_change":"2023-12-22T10:02:18.176967+0000","last_active":"2023-12-22T10:02:18.176967+0000","last_peered":"2023-12-22T10:02:18.176967+0000","last_clean":"2023-12-22T10:02:18.176967+0000","last_became_active":"2023-12-22T10:00:27.888164+0000","last_became_peered":"2023-12-22T10:00:27.888164+0000","last_unstale":"2023-12-22T10:02:18.176967+0000","last_undegraded":"2023-12-22T10:02:18.176967+0000","last_fullsized":"2023-12-22T10:02:18.176967+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:02:18.176813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:02:18.176813+0000","last_clean_scrub_stamp":"2023-12-22T10:02:18.176813+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574873,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297640,"kb_used_data":544,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074200,"statfs":{"total":96636764160,"available":96331980800,"internally_reserved":0,"allocated":557056,"data_stored":245447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 10:01:29 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.143,"15min":1.143},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.677,"5min":1.677,"15min":1.677},"last":1.165},{"interface":"front","average":{"1min":1.161,"5min":1.161,"15min":1.161},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":1.1930000000000001}]},{"osd":1,"last update":"Fri Dec 22 10:01:29 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.25,"15min":1.25},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.8899999999999999,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":1.2849999999999999},{"interface":"front","average":{"1min":1.337,"5min":1.337,"15min":1.337},"min":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":2.6819999999999999,"5min":2.6819999999999999,"15min":2.6819999999999999},"last":1.327}]},{"osd":2,"last update":"Fri Dec 22 10:01:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":2.8490000000000002,"5min":2.8490000000000002,"15min":2.8490000000000002},"last":1.3460000000000001},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.774,"5min":1.774,"15min":1.774},"last":1.4650000000000001}]},{"osd":3,"last update":"Fri Dec 22 10:01:29 2023","interfaces":[{"interface":"back","average":{"1min":1.321,"5min":1.321,"15min":1.321},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":2.3690000000000002,"5min":2.3690000000000002,"15min":2.3690000000000002},"last":1.5029999999999999},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"min":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"max":{"1min":2.0899999999999999,"5min":2.0899999999999999,"15min":2.0899999999999999},"last":1.651}]},{"osd":4,"last update":"Fri Dec 22 10:01:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.764,"5min":1.764,"15min":1.764},"last":1.4059999999999999},{"interface":"front","average":{"1min":1.278,"5min":1.278,"15min":1.278},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":2.2930000000000001,"5min":2.2930000000000001,"15min":2.2930000000000001},"last":1.2529999999999999}]},{"osd":5,"last update":"Fri Dec 22 10:01:29 2023","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.228,"15min":1.228},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.786,"5min":1.786,"15min":1.786},"last":1.548},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":2.73,"5min":2.73,"15min":2.73},"last":1.536}]},{"osd":6,"last update":"Fri Dec 22 10:01:29 2023","interfaces":[{"interface":"back","average":{"1min":1.476,"5min":1.476,"15min":1.476},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":2.7690000000000001,"5min":2.7690000000000001,"15min":2.7690000000000001},"last":1.6160000000000001},{"interface":"front","average":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":2.8820000000000001,"5min":2.8820000000000001,"15min":2.8820000000000001},"last":1.571}]}]},{"osd":6,"up_from":13,"seq":55834574873,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297640,"kb_used_data":544,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074200,"statfs":{"total":96636764160,"available":96331980800,"internally_reserved":0,"allocated":557056,"data_stored":245447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.131,"15min":1.131},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":0.96599999999999997},{"interface":"front","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.617,"5min":1.617,"15min":1.617},"last":1.2050000000000001}]},{"osd":1,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":1.3380000000000001},{"interface":"front","average":{"1min":1.085,"5min":1.085,"15min":1.085},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.657,"5min":1.657,"15min":1.657},"last":0.79900000000000004}]},{"osd":2,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.077,"15min":1.077},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":1.101},{"interface":"front","average":{"1min":1.145,"5min":1.145,"15min":1.145},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.583,"5min":1.583,"15min":1.583},"last":1.252}]},{"osd":3,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.262,"15min":1.262},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":1.0609999999999999},{"interface":"front","average":{"1min":1.252,"5min":1.252,"15min":1.252},"min":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":1.6359999999999999,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":1.022}]},{"osd":4,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.282,"15min":1.282},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.7310000000000001,"5min":1.7310000000000001,"15min":1.7310000000000001},"last":1.3109999999999999},{"interface":"front","average":{"1min":1.361,"5min":1.361,"15min":1.361},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":2.2280000000000002,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":1.423}]},{"osd":5,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"min":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":1.907,"5min":1.907,"15min":1.907},"last":1.464},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":2.363,"5min":2.363,"15min":2.363},"last":1.1699999999999999}]},{"osd":7,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"min":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"max":{"1min":2.1459999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.2929999999999999},{"interface":"front","average":{"1min":1.403,"5min":1.403,"15min":1.403},"min":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"max":{"1min":2.1779999999999999,"5min":2.1779999999999999,"15min":2.1779999999999999},"last":1.536}]}]},{"osd":5,"up_from":13,"seq":55834574873,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297640,"kb_used_data":544,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074200,"statfs":{"total":96636764160,"available":96331980800,"internally_reserved":0,"allocated":557056,"data_stored":245447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":0.996},{"interface":"front","average":{"1min":1.123,"5min":1.123,"15min":1.123},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.6559999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":0.79200000000000004}]},{"osd":1,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.89200000000000002},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":2.0070000000000001,"5min":2.0070000000000001,"15min":2.0070000000000001},"last":0.95099999999999996}]},{"osd":2,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":1.0589999999999999},{"interface":"front","average":{"1min":1.119,"5min":1.119,"15min":1.119},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.607,"5min":1.607,"15min":1.607},"last":1.2709999999999999}]},{"osd":3,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.133,"15min":1.133},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":1.1910000000000001},{"interface":"front","average":{"1min":1.179,"5min":1.179,"15min":1.179},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.488,"5min":1.488,"15min":1.488},"last":1.357}]},{"osd":4,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.145,"15min":1.145},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":1.8779999999999999,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":1.341},{"interface":"front","average":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"min":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":1.1020000000000001}]},{"osd":6,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.242,"15min":1.242},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.7749999999999999,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":1.1299999999999999},{"interface":"front","average":{"1min":1.236,"5min":1.236,"15min":1.236},"min":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":1.1559999999999999}]},{"osd":7,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.236,"15min":1.236},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":1.516,"5min":1.516,"15min":1.516},"last":0.98299999999999998},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.8620000000000001,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":1.23}]}]},{"osd":4,"up_from":13,"seq":55834574873,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297640,"kb_used_data":544,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074200,"statfs":{"total":96636764160,"available":96331980800,"internally_reserved":0,"allocated":557056,"data_stored":245447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.149,"15min":1.149},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":1.2250000000000001},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"min":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.999}]},{"osd":1,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":1.012,"15min":1.012},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":1.2589999999999999},{"interface":"front","average":{"1min":1.077,"5min":1.077,"15min":1.077},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.78400000000000003}]},{"osd":2,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.641,"5min":1.641,"15min":1.641},"last":1.3300000000000001},{"interface":"front","average":{"1min":1.272,"5min":1.272,"15min":1.272},"min":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"max":{"1min":1.8340000000000001,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":1.1459999999999999}]},{"osd":3,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.173,"15min":1.173},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":1.7490000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.874},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"min":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"max":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":1.3759999999999999}]},{"osd":5,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":1.216,"15min":1.216},"min":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"max":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":1.024},{"interface":"front","average":{"1min":1.173,"5min":1.173,"15min":1.173},"min":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":1.9350000000000001,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":1.1639999999999999}]},{"osd":6,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":1.869,"5min":1.869,"15min":1.869},"last":1.419},{"interface":"front","average":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"min":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"max":{"1min":1.9910000000000001,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":1.296}]},{"osd":7,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"min":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"max":{"1min":2.1960000000000002,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":1.081},{"interface":"front","average":{"1min":1.391,"5min":1.391,"15min":1.391},"min":{"1min":1.044,"5min":1.044,"15min":1.044},"max":{"1min":1.8680000000000001,"5min":1.8680000000000001,"15min":1.8680000000000001},"last":1.4610000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574873,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297640,"kb_used_data":544,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074200,"statfs":{"total":96636764160,"available":96331980800,"internally_reserved":0,"allocated":557056,"data_stored":245447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 10:01:25 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.65300000000000002}]},{"osd":1,"last update":"Fri Dec 22 10:01:25 2023","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.69599999999999995},{"interface":"front","average":{"1min":1.109,"5min":1.109,"15min":1.109},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":0.97699999999999998}]},{"osd":2,"last update":"Fri Dec 22 10:01:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":0.92500000000000004},{"interface":"front","average":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.702,"5min":1.702,"15min":1.702},"last":0.79800000000000004}]},{"osd":4,"last update":"Fri Dec 22 10:01:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.2,"15min":1.2},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":1.1779999999999999},{"interface":"front","average":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":2.0619999999999998,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":1.254}]},{"osd":5,"last update":"Fri Dec 22 10:01:25 2023","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.333,"15min":1.333},"min":{"1min":0.878,"5min":0.878,"15min":0.878},"max":{"1min":1.9339999999999999,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":1.419},{"interface":"front","average":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"min":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"max":{"1min":2.1720000000000002,"5min":2.1720000000000002,"15min":2.1720000000000002},"last":1.3360000000000001}]},{"osd":6,"last update":"Fri Dec 22 10:01:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.8640000000000001,"5min":1.8640000000000001,"15min":1.8640000000000001},"last":1.528},{"interface":"front","average":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":2.2130000000000001,"5min":2.2130000000000001,"15min":2.2130000000000001},"last":1.3460000000000001}]},{"osd":7,"last update":"Fri Dec 22 10:01:25 2023","interfaces":[{"interface":"back","average":{"1min":1.405,"5min":1.405,"15min":1.405},"min":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"max":{"1min":2.1389999999999998,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":1.462},{"interface":"front","average":{"1min":1.431,"5min":1.431,"15min":1.431},"min":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":2.105,"5min":2.105,"15min":2.105},"last":1.4410000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574874,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297640,"kb_used_data":544,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074200,"statfs":{"total":96636764160,"available":96331980800,"internally_reserved":0,"allocated":557056,"data_stored":245447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":0.78300000000000003},{"interface":"front","average":{"1min":1.083,"5min":1.083,"15min":1.083},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.80300000000000005}]},{"osd":1,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.52,"5min":1.52,"15min":1.52},"last":0.94799999999999995},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":2.3809999999999998,"5min":2.3809999999999998,"15min":2.3809999999999998},"last":0.96399999999999997}]},{"osd":3,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.698,"5min":1.698,"15min":1.698},"last":1.0169999999999999},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.788,"5min":1.788,"15min":1.788},"last":1.198}]},{"osd":4,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.381,"15min":1.381},"min":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"max":{"1min":2.234,"5min":2.234,"15min":2.234},"last":1.0580000000000001},{"interface":"front","average":{"1min":1.296,"5min":1.296,"15min":1.296},"min":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"max":{"1min":2.1230000000000002,"5min":2.1230000000000002,"15min":2.1230000000000002},"last":1.119}]},{"osd":5,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"min":{"1min":1.109,"5min":1.109,"15min":1.109},"max":{"1min":2.0960000000000001,"5min":2.0960000000000001,"15min":2.0960000000000001},"last":1.04},{"interface":"front","average":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"min":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"max":{"1min":1.9730000000000001,"5min":1.9730000000000001,"15min":1.9730000000000001},"last":1.2470000000000001}]},{"osd":6,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"min":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"max":{"1min":2.298,"5min":2.298,"15min":2.298},"last":0.88400000000000001},{"interface":"front","average":{"1min":1.46,"5min":1.46,"15min":1.46},"min":{"1min":1.02,"5min":1.02,"15min":1.02},"max":{"1min":1.899,"5min":1.899,"15min":1.899},"last":1.333}]},{"osd":7,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.458,"5min":1.458,"15min":1.458},"min":{"1min":1,"5min":1,"15min":1},"max":{"1min":2.0289999999999999,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":1.157},{"interface":"front","average":{"1min":1.415,"5min":1.415,"15min":1.415},"min":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"max":{"1min":2.0179999999999998,"5min":2.0179999999999998,"15min":2.0179999999999998},"last":1.266}]}]},{"osd":1,"up_from":13,"seq":55834574873,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297640,"kb_used_data":544,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074200,"statfs":{"total":96636764160,"available":96331980800,"internally_reserved":0,"allocated":557056,"data_stored":245447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.75}]},{"osd":2,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.79900000000000004},{"interface":"front","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.93899999999999995}]},{"osd":3,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":1.0600000000000001},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.91600000000000004}]},{"osd":4,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":1.2529999999999999},{"interface":"front","average":{"1min":1.236,"5min":1.236,"15min":1.236},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":2.0710000000000002,"5min":2.0710000000000002,"15min":2.0710000000000002},"last":1.1120000000000001}]},{"osd":5,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"min":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"max":{"1min":1.8129999999999999,"5min":1.8129999999999999,"15min":1.8129999999999999},"last":1.1299999999999999},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"min":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"max":{"1min":1.881,"5min":1.881,"15min":1.881},"last":1.014}]},{"osd":6,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"min":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"max":{"1min":1.8779999999999999,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":1.4039999999999999},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"min":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":1.946,"5min":1.946,"15min":1.946},"last":1.4199999999999999}]},{"osd":7,"last update":"Fri Dec 22 10:01:27 2023","interfaces":[{"interface":"back","average":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"min":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"max":{"1min":1.9279999999999999,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":1.329},{"interface":"front","average":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"min":{"1min":1.03,"5min":1.03,"15min":1.03},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":1.4650000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574873,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297640,"kb_used_data":544,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074200,"statfs":{"total":96636764160,"available":96331980800,"internally_reserved":0,"allocated":557056,"data_stored":245447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":2.7250000000000001,"5min":2.7250000000000001,"15min":2.7250000000000001},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.82299999999999995}]},{"osd":2,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":2.7799999999999998,"5min":2.7799999999999998,"15min":2.7799999999999998},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":1.0289999999999999}]},{"osd":3,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":2.919,"5min":2.919,"15min":2.919},"last":0.69899999999999995},{"interface":"front","average":{"1min":1.248,"5min":1.248,"15min":1.248},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":2.8959999999999999,"5min":2.8959999999999999,"15min":2.8959999999999999},"last":1.119}]},{"osd":4,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.292,"5min":1.292,"15min":1.292},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":3.1280000000000001,"5min":3.1280000000000001,"15min":3.1280000000000001},"last":1.274}]},{"osd":5,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"min":{"1min":0.87,"5min":0.87,"15min":0.87},"max":{"1min":3.0760000000000001,"5min":3.0760000000000001,"15min":3.0760000000000001},"last":1.0800000000000001},{"interface":"front","average":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":2.512,"5min":2.512,"15min":2.512},"last":1.3160000000000001}]},{"osd":6,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.5,"5min":1.5,"15min":1.5},"min":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"max":{"1min":2.8199999999999998,"5min":2.8199999999999998,"15min":2.8199999999999998},"last":1.411},{"interface":"front","average":{"1min":1.51,"5min":1.51,"15min":1.51},"min":{"1min":1.032,"5min":1.032,"15min":1.032},"max":{"1min":4.6029999999999998,"5min":4.6029999999999998,"15min":4.6029999999999998},"last":1.1519999999999999}]},{"osd":7,"last update":"Fri Dec 22 10:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.417,"5min":1.417,"15min":1.417},"min":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"max":{"1min":2.0190000000000001,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":1.1839999999999999},{"interface":"front","average":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"min":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"max":{"1min":3.6339999999999999,"5min":3.6339999999999999,"15min":3.6339999999999999},"last":1.2030000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-22T10:02:22.240 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-12-22T10:00:27.001906+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=10, tm_min=0, tm_sec=27, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=10, tm_min=2, tm_sec=15, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T10:02:22.241 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-12-22T10:00:27.001906+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=10, tm_min=0, tm_sec=27, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=10, tm_min=2, tm_sec=15, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T10:02:22.241 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-12-22T10:00:27.001906+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=10, tm_min=0, tm_sec=27, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=10, tm_min=2, tm_sec=15, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T10:02:22.241 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-12-22T10:00:27.001906+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=10, tm_min=0, tm_sec=27, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=10, tm_min=2, tm_sec=15, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T10:02:22.241 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-12-22T10:00:27.001906+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=10, tm_min=0, tm_sec=27, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=10, tm_min=2, tm_sec=15, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T10:02:22.242 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-12-22T10:00:27.001906+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=10, tm_min=0, tm_sec=27, tm_wday=4, tm_yday=356, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=22, tm_hour=10, tm_min=2, tm_sec=15, tm_wday=4, tm_yday=356, tm_isdst=0) 2023-12-22T10:02:22.242 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-22T10:02:33.157 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:02:33.166 DEBUG:teuthology.orchestra.run.smithi113:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:02:42.243 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-22T10:02:42.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.418+0000 7f7e1149b700 1 Processor -- start 2023-12-22T10:02:42.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.418+0000 7f7e1149b700 1 -- start start 2023-12-22T10:02:42.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.418+0000 7f7e1149b700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f7e0c153870 0x7f7e0c158070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:42.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.418+0000 7f7e1149b700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e0c0aa690 con 0x7f7e0c153c50 2023-12-22T10:02:42.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.418+0000 7f7e1149b700 1 -- --> v1:172.21.15.113:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e0c0c59d0 con 0x7f7e0c0ca680 2023-12-22T10:02:42.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.418+0000 7f7e1149b700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e0c157620 con 0x7f7e0c153870 2023-12-22T10:02:42.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.418+0000 7f7e0b7fe700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f7e0c153c50 0x7f7e0c0c7460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44970/0 (socket says 172.21.15.45:44970) 2023-12-22T10:02:42.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.418+0000 7f7e0b7fe700 1 -- 172.21.15.45:0/872735168 learned_addr learned my addr 172.21.15.45:0/872735168 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:02:42.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.422+0000 7f7e0affd700 1 --2- 172.21.15.45:0/872735168 >> v2:172.21.15.113:3300/0 conn(0x7f7e0c153870 0x7f7e0c158070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:42.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.422+0000 7f7e09ffb700 1 -- 172.21.15.45:0/872735168 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 821354726 0 0) 0x7f7e0c0aa690 con 0x7f7e0c153c50 2023-12-22T10:02:42.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.422+0000 7f7e09ffb700 1 -- 172.21.15.45:0/872735168 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7df40033f0 con 0x7f7e0c153c50 2023-12-22T10:02:42.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.422+0000 7f7e09ffb700 1 -- 172.21.15.45:0/872735168 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2437935660 0 0) 0x7f7df40033f0 con 0x7f7e0c153c50 2023-12-22T10:02:42.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.422+0000 7f7e09ffb700 1 -- 172.21.15.45:0/872735168 >> v2:172.21.15.113:3300/0 conn(0x7f7e0c153870 msgr2=0x7f7e0c158070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:02:42.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.422+0000 7f7e09ffb700 1 --2- 172.21.15.45:0/872735168 >> v2:172.21.15.113:3300/0 conn(0x7f7e0c153870 0x7f7e0c158070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:42.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.422+0000 7f7e09ffb700 1 -- 172.21.15.45:0/872735168 >> v1:172.21.15.113:6789/0 conn(0x7f7e0c0ca680 legacy=0x7f7e0c0c5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:42.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.422+0000 7f7e09ffb700 1 -- 172.21.15.45:0/872735168 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e0c157be0 con 0x7f7e0c153c50 2023-12-22T10:02:42.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.422+0000 7f7e09ffb700 1 -- 172.21.15.45:0/872735168 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2619163070 0 0) 0x7f7e040017f0 con 0x7f7e0c153c50 2023-12-22T10:02:42.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.422+0000 7f7e09ffb700 1 -- 172.21.15.45:0/872735168 >> v1:172.21.15.45:6789/0 conn(0x7f7e0c153c50 legacy=0x7f7e0c0c7460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:42.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.422+0000 7f7e09ffb700 1 --2- 172.21.15.45:0/872735168 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7df40038e0 0x7f7df4003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:42.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.422+0000 7f7e09ffb700 1 --2- 172.21.15.45:0/872735168 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7df4004690 0x7f7df4004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:42.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.422+0000 7f7e09ffb700 1 --2- 172.21.15.45:0/872735168 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7df4005000 0x7f7df400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:42.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.422+0000 7f7e09ffb700 1 -- 172.21.15.45:0/872735168 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0c157620 con 0x7f7df4005000 2023-12-22T10:02:42.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.422+0000 7f7e09ffb700 1 -- 172.21.15.45:0/872735168 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7df400be00 con 0x7f7df4004690 2023-12-22T10:02:42.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.422+0000 7f7e09ffb700 1 -- 172.21.15.45:0/872735168 --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7df400bfc0 con 0x7f7df40038e0 2023-12-22T10:02:42.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.422+0000 7f7e0b7fe700 1 --2- 172.21.15.45:0/872735168 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7df4005000 0x7f7df400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:42.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.422+0000 7f7e0a7fc700 1 --2- 172.21.15.45:0/872735168 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7df4004690 0x7f7df4004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:42.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.422+0000 7f7e0affd700 1 --2- 172.21.15.45:0/872735168 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7df40038e0 0x7f7df4003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:42.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.422+0000 7f7e0b7fe700 1 -- 172.21.15.45:0/872735168 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7df40038e0 msgr2=0x7f7df4003cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:02:42.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.422+0000 7f7e0b7fe700 1 --2- 172.21.15.45:0/872735168 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7df40038e0 0x7f7df4003cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:42.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.422+0000 7f7e0b7fe700 1 -- 172.21.15.45:0/872735168 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7df4004690 msgr2=0x7f7df4004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:02:42.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.422+0000 7f7e0b7fe700 1 --2- 172.21.15.45:0/872735168 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7df4004690 0x7f7df4004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:42.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.422+0000 7f7e0b7fe700 1 -- 172.21.15.45:0/872735168 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7df40033f0 con 0x7f7df4005000 2023-12-22T10:02:42.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.422+0000 7f7e0b7fe700 1 -- 172.21.15.45:0/872735168 reap_dead start 2023-12-22T10:02:42.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.422+0000 7f7e0b7fe700 1 --2- 172.21.15.45:0/872735168 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7df4005000 0x7f7df400b8e0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7f7e0400c5f0 tx=0x7f7e0c157760).ready entity=mon.0 client_cookie=1194caedb8da84d6 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:42.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.422+0000 7f7e09ffb700 1 -- 172.21.15.45:0/872735168 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e04007d90 con 0x7f7df4005000 2023-12-22T10:02:42.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.422+0000 7f7e09ffb700 1 -- 172.21.15.45:0/872735168 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e0400cdf0 con 0x7f7df4005000 2023-12-22T10:02:42.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.422+0000 7f7e09ffb700 1 -- 172.21.15.45:0/872735168 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e04005d70 con 0x7f7df4005000 2023-12-22T10:02:42.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.426+0000 7f7e1149b700 1 -- 172.21.15.45:0/872735168 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7df4005000 msgr2=0x7f7df400b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:42.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.426+0000 7f7e1149b700 1 --2- 172.21.15.45:0/872735168 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7df4005000 0x7f7df400b8e0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7f7e0400c5f0 tx=0x7f7e0c157760).stop 2023-12-22T10:02:42.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.426+0000 7f7e1149b700 1 -- 172.21.15.45:0/872735168 shutdown_connections 2023-12-22T10:02:42.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.426+0000 7f7e1149b700 1 --2- 172.21.15.45:0/872735168 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7df4005000 0x7f7df400b8e0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:42.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.426+0000 7f7e1149b700 1 -- 172.21.15.45:0/872735168 >> 172.21.15.45:0/872735168 conn(0x7f7e0c082a80 msgr2=0x7f7e0c066a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:02:42.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.426+0000 7f7e1149b700 1 -- 172.21.15.45:0/872735168 shutdown_connections 2023-12-22T10:02:42.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.426+0000 7f7e1149b700 1 -- 172.21.15.45:0/872735168 wait complete. 2023-12-22T10:02:42.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.430+0000 7f7e1149b700 1 Processor -- start 2023-12-22T10:02:42.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.430+0000 7f7e1149b700 1 -- start start 2023-12-22T10:02:42.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.430+0000 7f7e1149b700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7df4005000 0x7f7e0c14ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:42.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.430+0000 7f7e1149b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e0c0c09a0 0x7f7e0c0c0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:42.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.430+0000 7f7e1149b700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e0c0ae850 0x7f7e0c0aecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:42.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.430+0000 7f7e1149b700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0c0af460 con 0x7f7e0c0c09a0 2023-12-22T10:02:42.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.430+0000 7f7e1149b700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0c14d370 con 0x7f7e0c0ae850 2023-12-22T10:02:42.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.430+0000 7f7e1149b700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0c153130 con 0x7f7df4005000 2023-12-22T10:02:42.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.430+0000 7f7e0a7fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e0c0c09a0 0x7f7e0c0c0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:42.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.430+0000 7f7e0affd700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7df4005000 0x7f7e0c14ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:42.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.430+0000 7f7e0b7fe700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e0c0ae850 0x7f7e0c0aecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:42.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.430+0000 7f7e0b7fe700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e0c0ae850 0x7f7e0c0aecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.113:3300/0 says I am v2:172.21.15.45:43194/0 (socket says 172.21.15.45:43194) 2023-12-22T10:02:42.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.430+0000 7f7e0a7fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e0c0c09a0 0x7f7e0c0c0e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42972/0 (socket says 172.21.15.45:42972) 2023-12-22T10:02:42.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.430+0000 7f7e0b7fe700 1 -- 172.21.15.45:0/636440740 learned_addr learned my addr 172.21.15.45:0/636440740 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:02:42.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.430+0000 7f7e0b7fe700 1 -- 172.21.15.45:0/636440740 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7df4005000 msgr2=0x7f7e0c14ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:42.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.430+0000 7f7e0b7fe700 1 --2- 172.21.15.45:0/636440740 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7df4005000 0x7f7e0c14ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:42.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.430+0000 7f7e0b7fe700 1 -- 172.21.15.45:0/636440740 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e0c0c09a0 msgr2=0x7f7e0c0c0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:42.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.430+0000 7f7e0b7fe700 1 --2- 172.21.15.45:0/636440740 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e0c0c09a0 0x7f7e0c0c0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:42.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.430+0000 7f7e0b7fe700 1 -- 172.21.15.45:0/636440740 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e0c1641a0 con 0x7f7e0c0ae850 2023-12-22T10:02:42.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.430+0000 7f7e0b7fe700 1 --2- 172.21.15.45:0/636440740 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e0c0ae850 0x7f7e0c0aecd0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f7e04006000 tx=0x7f7e04013000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:42.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.434+0000 7f7df2ffd700 1 -- 172.21.15.45:0/636440740 <== mon.1 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e040017b0 con 0x7f7e0c0ae850 2023-12-22T10:02:42.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.434+0000 7f7df2ffd700 1 -- 172.21.15.45:0/636440740 <== mon.1 v2:172.21.15.113:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e04001df0 con 0x7f7e0c0ae850 2023-12-22T10:02:42.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.434+0000 7f7df2ffd700 1 -- 172.21.15.45:0/636440740 <== mon.1 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e04004c80 con 0x7f7e0c0ae850 2023-12-22T10:02:42.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.434+0000 7f7e1149b700 1 -- 172.21.15.45:0/636440740 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e0c164d10 con 0x7f7e0c0ae850 2023-12-22T10:02:42.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.434+0000 7f7e1149b700 1 -- 172.21.15.45:0/636440740 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e0c1651a0 con 0x7f7e0c0ae850 2023-12-22T10:02:42.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.434+0000 7f7e1149b700 1 -- 172.21.15.45:0/636440740 --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e0c1573f0 con 0x7f7e0c0ae850 2023-12-22T10:02:42.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.434+0000 7f7df2ffd700 1 -- 172.21.15.45:0/636440740 <== mon.1 v2:172.21.15.113:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f7e04013450 con 0x7f7e0c0ae850 2023-12-22T10:02:42.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.434+0000 7f7df2ffd700 1 --2- 172.21.15.45:0/636440740 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f7df805a510 0x7f7df805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:42.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.434+0000 7f7df2ffd700 1 -- 172.21.15.45:0/636440740 <== mon.1 v2:172.21.15.113:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f7e04075440 con 0x7f7e0c0ae850 2023-12-22T10:02:42.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.434+0000 7f7e0affd700 1 --2- 172.21.15.45:0/636440740 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f7df805a510 0x7f7df805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:42.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.438+0000 7f7e0affd700 1 --2- 172.21.15.45:0/636440740 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f7df805a510 0x7f7df805c9d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7f7e0c0ab9c0 tx=0x7f7dfc008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:42.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.446+0000 7f7df2ffd700 1 -- 172.21.15.45:0/636440740 <== mon.1 v2:172.21.15.113:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f7e04048e00 con 0x7f7e0c0ae850 2023-12-22T10:02:42.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.606+0000 7f7e1149b700 1 -- 172.21.15.45:0/636440740 --> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7e0c1641a0 con 0x7f7df805a510 2023-12-22T10:02:42.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.614+0000 7f7df2ffd700 1 -- 172.21.15.45:0/636440740 <== mgr.4104 v2:172.21.15.45:6832/33679 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+68539 (secure 0 0 0) 0x7f7e0c1641a0 con 0x7f7df805a510 2023-12-22T10:02:42.614 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:02:42.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.618+0000 7f7e1149b700 1 -- 172.21.15.45:0/636440740 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f7df805a510 msgr2=0x7f7df805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:42.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.618+0000 7f7e1149b700 1 --2- 172.21.15.45:0/636440740 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f7df805a510 0x7f7df805c9d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7f7e0c0ab9c0 tx=0x7f7dfc008040).stop 2023-12-22T10:02:42.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.618+0000 7f7e1149b700 1 -- 172.21.15.45:0/636440740 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e0c0ae850 msgr2=0x7f7e0c0aecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:42.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.618+0000 7f7e1149b700 1 --2- 172.21.15.45:0/636440740 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e0c0ae850 0x7f7e0c0aecd0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f7e04006000 tx=0x7f7e04013000).stop 2023-12-22T10:02:42.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.618+0000 7f7e1149b700 1 -- 172.21.15.45:0/636440740 shutdown_connections 2023-12-22T10:02:42.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.618+0000 7f7e1149b700 1 --2- 172.21.15.45:0/636440740 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f7e0c0ae850 0x7f7e0c0aecd0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:42.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.618+0000 7f7e1149b700 1 --2- 172.21.15.45:0/636440740 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e0c0c09a0 0x7f7e0c0c0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:42.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.618+0000 7f7e1149b700 1 --2- 172.21.15.45:0/636440740 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f7df805a510 0x7f7df805c9d0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:42.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.618+0000 7f7e1149b700 1 --2- 172.21.15.45:0/636440740 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f7df4005000 0x7f7e0c14ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:42.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.618+0000 7f7e1149b700 1 -- 172.21.15.45:0/636440740 >> 172.21.15.45:0/636440740 conn(0x7f7e0c082a80 msgr2=0x7f7e0c0c73c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:02:42.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.618+0000 7f7e1149b700 1 -- 172.21.15.45:0/636440740 shutdown_connections 2023-12-22T10:02:42.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.618+0000 7f7e1149b700 1 -- 172.21.15.45:0/636440740 wait complete. 2023-12-22T10:02:42.619 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-12-22T10:02:42.638 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":108,"stamp":"2023-12-22T10:02:41.993893+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381120,"kb_used_data":4352,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752593600,"statfs":{"total":773094113280,"available":770655846400,"internally_reserved":0,"allocated":4456448,"data_stored":1963576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6291456,"num_objects":-2,"num_object_clones":0,"num_object_copies":-4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-4,"num_write_kb":-6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.073819"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":40,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-22T10:02:27.653338+0000","last_change":"2023-12-22T10:02:27.653338+0000","last_active":"2023-12-22T10:02:27.653338+0000","last_peered":"2023-12-22T10:02:27.653338+0000","last_clean":"2023-12-22T10:02:27.653338+0000","last_became_active":"2023-12-22T10:00:28.035974+0000","last_became_peered":"2023-12-22T10:00:28.035974+0000","last_unstale":"2023-12-22T10:02:27.653338+0000","last_undegraded":"2023-12-22T10:02:27.653338+0000","last_fullsized":"2023-12-22T10:02:27.653338+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:02:27.653107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:02:27.653107+0000","last_clean_scrub_stamp":"2023-12-22T10:02:27.653107+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":43,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-22T10:02:28.631340+0000","last_change":"2023-12-22T10:02:28.631340+0000","last_active":"2023-12-22T10:02:28.631340+0000","last_peered":"2023-12-22T10:02:28.631340+0000","last_clean":"2023-12-22T10:02:28.631340+0000","last_became_active":"2023-12-22T10:00:28.035002+0000","last_became_peered":"2023-12-22T10:00:28.035002+0000","last_unstale":"2023-12-22T10:02:28.631340+0000","last_undegraded":"2023-12-22T10:02:28.631340+0000","last_fullsized":"2023-12-22T10:02:28.631340+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:02:28.631061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:02:28.631061+0000","last_clean_scrub_stamp":"2023-12-22T10:02:28.631061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":40,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-22T10:02:26.613266+0000","last_change":"2023-12-22T10:02:26.613266+0000","last_active":"2023-12-22T10:02:26.613266+0000","last_peered":"2023-12-22T10:02:26.613266+0000","last_clean":"2023-12-22T10:02:26.613266+0000","last_became_active":"2023-12-22T10:00:28.029391+0000","last_became_peered":"2023-12-22T10:00:28.029391+0000","last_unstale":"2023-12-22T10:02:26.613266+0000","last_undegraded":"2023-12-22T10:02:26.613266+0000","last_fullsized":"2023-12-22T10:02:26.613266+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:02:26.613041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:02:26.613041+0000","last_clean_scrub_stamp":"2023-12-22T10:02:26.613041+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":39,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-22T10:02:22.569282+0000","last_change":"2023-12-22T10:02:22.569282+0000","last_active":"2023-12-22T10:02:22.569282+0000","last_peered":"2023-12-22T10:02:22.569282+0000","last_clean":"2023-12-22T10:02:22.569282+0000","last_became_active":"2023-12-22T10:00:28.024588+0000","last_became_peered":"2023-12-22T10:00:28.024588+0000","last_unstale":"2023-12-22T10:02:22.569282+0000","last_undegraded":"2023-12-22T10:02:22.569282+0000","last_fullsized":"2023-12-22T10:02:22.569282+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:02:22.569070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:02:22.569070+0000","last_clean_scrub_stamp":"2023-12-22T10:02:22.569070+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":40,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-22T10:02:20.682250+0000","last_change":"2023-12-22T10:02:20.682250+0000","last_active":"2023-12-22T10:02:20.682250+0000","last_peered":"2023-12-22T10:02:20.682250+0000","last_clean":"2023-12-22T10:02:20.682250+0000","last_became_active":"2023-12-22T10:00:28.029422+0000","last_became_peered":"2023-12-22T10:00:28.029422+0000","last_unstale":"2023-12-22T10:02:20.682250+0000","last_undegraded":"2023-12-22T10:02:20.682250+0000","last_fullsized":"2023-12-22T10:02:20.682250+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:02:20.682093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:02:20.682093+0000","last_clean_scrub_stamp":"2023-12-22T10:02:20.682093+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":41,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-22T10:02:24.832338+0000","last_change":"2023-12-22T10:02:24.832338+0000","last_active":"2023-12-22T10:02:24.832338+0000","last_peered":"2023-12-22T10:02:24.832338+0000","last_clean":"2023-12-22T10:02:24.832338+0000","last_became_active":"2023-12-22T10:00:28.028159+0000","last_became_peered":"2023-12-22T10:00:28.028159+0000","last_unstale":"2023-12-22T10:02:24.832338+0000","last_undegraded":"2023-12-22T10:02:24.832338+0000","last_fullsized":"2023-12-22T10:02:24.832338+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:02:24.832029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:02:24.832029+0000","last_clean_scrub_stamp":"2023-12-22T10:02:24.832029+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":40,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-22T10:02:19.692909+0000","last_change":"2023-12-22T10:02:19.692909+0000","last_active":"2023-12-22T10:02:19.692909+0000","last_peered":"2023-12-22T10:02:19.692909+0000","last_clean":"2023-12-22T10:02:19.692909+0000","last_became_active":"2023-12-22T10:00:28.030284+0000","last_became_peered":"2023-12-22T10:00:28.030284+0000","last_unstale":"2023-12-22T10:02:19.692909+0000","last_undegraded":"2023-12-22T10:02:19.692909+0000","last_fullsized":"2023-12-22T10:02:19.692909+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:02:19.692723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:02:19.692723+0000","last_clean_scrub_stamp":"2023-12-22T10:02:19.692723+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":40,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-22T10:02:21.663001+0000","last_change":"2023-12-22T10:02:21.663001+0000","last_active":"2023-12-22T10:02:21.663001+0000","last_peered":"2023-12-22T10:02:21.663001+0000","last_clean":"2023-12-22T10:02:21.663001+0000","last_became_active":"2023-12-22T10:00:28.031190+0000","last_became_peered":"2023-12-22T10:00:28.031190+0000","last_unstale":"2023-12-22T10:02:21.663001+0000","last_undegraded":"2023-12-22T10:02:21.663001+0000","last_fullsized":"2023-12-22T10:02:21.663001+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:02:21.662747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:02:21.662747+0000","last_clean_scrub_stamp":"2023-12-22T10:02:21.662747+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":41,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-22T10:02:18.176967+0000","last_change":"2023-12-22T10:02:18.176967+0000","last_active":"2023-12-22T10:02:18.176967+0000","last_peered":"2023-12-22T10:02:18.176967+0000","last_clean":"2023-12-22T10:02:18.176967+0000","last_became_active":"2023-12-22T10:00:27.888164+0000","last_became_peered":"2023-12-22T10:00:27.888164+0000","last_unstale":"2023-12-22T10:02:18.176967+0000","last_undegraded":"2023-12-22T10:02:18.176967+0000","last_fullsized":"2023-12-22T10:02:18.176967+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-22T10:02:18.176813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-22T10:02:18.176813+0000","last_clean_scrub_stamp":"2023-12-22T10:02:18.176813+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297640,"kb_used_data":544,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074200,"statfs":{"total":96636764160,"available":96331980800,"internally_reserved":0,"allocated":557056,"data_stored":245447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 10:02:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.1359999999999999,"15min":1.1399999999999999},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.4419999999999999,"5min":1.677,"15min":1.677},"last":0.96999999999999997},{"interface":"front","average":{"1min":1.2350000000000001,"5min":1.175,"15min":1.165},"min":{"1min":0.83999999999999997,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.7909999999999999,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":1.0600000000000001}]},{"osd":1,"last update":"Fri Dec 22 10:02:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.2370000000000001,"15min":1.2450000000000001},"min":{"1min":0.89000000000000001,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.494,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":1.232},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.306,"15min":1.3260000000000001},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.548,"5min":2.6819999999999999,"15min":2.6819999999999999},"last":1.155}]},{"osd":2,"last update":"Fri Dec 22 10:02:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.2,"15min":1.212},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.363,"5min":2.8490000000000002,"15min":2.8490000000000002},"last":1.103},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.202,"15min":1.206},"min":{"1min":0.94899999999999995,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.5129999999999999,"5min":1.774,"15min":1.774},"last":1.361}]},{"osd":3,"last update":"Fri Dec 22 10:02:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2410000000000001,"5min":1.3049999999999999,"15min":1.3149999999999999},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.669,"5min":2.3690000000000002,"15min":2.3690000000000002},"last":1.27},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.329,"15min":1.335},"min":{"1min":0.97399999999999998,"5min":0.97099999999999997,"15min":0.97099999999999997},"max":{"1min":1.7529999999999999,"5min":2.0899999999999999,"15min":2.0899999999999999},"last":1.49}]},{"osd":4,"last update":"Fri Dec 22 10:02:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.175,"15min":1.181},"min":{"1min":0.85099999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.595,"5min":1.764,"15min":1.764},"last":0.94699999999999995},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.27,"15min":1.2749999999999999},"min":{"1min":0.71799999999999997,"5min":0.628,"15min":0.628},"max":{"1min":1.5089999999999999,"5min":2.2930000000000001,"15min":2.2930000000000001},"last":1.1910000000000001}]},{"osd":5,"last update":"Fri Dec 22 10:02:29 2023","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":1.25,"15min":1.2350000000000001},"min":{"1min":0.872,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":2.6469999999999998,"5min":2.6469999999999998,"15min":2.6469999999999998},"last":1.444},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"min":{"1min":0.92000000000000004,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":2.9260000000000002,"5min":2.9260000000000002,"15min":2.9260000000000002},"last":1.284}]},{"osd":6,"last update":"Fri Dec 22 10:02:29 2023","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.4670000000000001,"15min":1.4730000000000001},"min":{"1min":0.997,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":2.145,"5min":2.7690000000000001,"15min":2.7690000000000001},"last":1.395},{"interface":"front","average":{"1min":1.399,"5min":1.4530000000000001,"15min":1.462},"min":{"1min":1.036,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.9670000000000001,"5min":2.8820000000000001,"15min":2.8820000000000001},"last":1.4039999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297640,"kb_used_data":544,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074200,"statfs":{"total":96636764160,"available":96331980800,"internally_reserved":0,"allocated":557056,"data_stored":245447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 10:02:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.1319999999999999,"15min":1.131},"min":{"1min":0.76500000000000001,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.5940000000000001,"5min":1.627,"15min":1.627},"last":1.3280000000000001},{"interface":"front","average":{"1min":1.254,"5min":1.2070000000000001,"15min":1.1990000000000001},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":1.569,"5min":1.617,"15min":1.617},"last":1.4870000000000001}]},{"osd":1,"last update":"Fri Dec 22 10:02:29 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.077,"15min":1.071},"min":{"1min":0.84099999999999997,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.3420000000000001,"5min":1.399,"15min":1.399},"last":1.073},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.095,"15min":1.0880000000000001},"min":{"1min":0.79900000000000004,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.8300000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.1419999999999999}]},{"osd":2,"last update":"Fri Dec 22 10:02:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.073,"15min":1.075},"min":{"1min":0.76100000000000001,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.458,"5min":1.468,"15min":1.468},"last":1.3680000000000001},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.1479999999999999,"15min":1.1459999999999999},"min":{"1min":0.85999999999999999,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.425,"5min":1.583,"15min":1.583},"last":1.2030000000000001}]},{"osd":3,"last update":"Fri Dec 22 10:02:29 2023","interfaces":[{"interface":"back","average":{"1min":1.256,"5min":1.26,"15min":1.2609999999999999},"min":{"1min":0.995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.633,"5min":1.633,"15min":1.633},"last":0.94599999999999995},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.254,"15min":1.252},"min":{"1min":1.002,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":1.5940000000000001,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":1.54}]},{"osd":4,"last update":"Fri Dec 22 10:02:29 2023","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":1.28,"15min":1.2809999999999999},"min":{"1min":0.86299999999999999,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.5369999999999999,"5min":1.7310000000000001,"15min":1.7310000000000001},"last":1.4279999999999999},{"interface":"front","average":{"1min":1.3,"5min":1.3480000000000001,"15min":1.3560000000000001},"min":{"1min":1.0029999999999999,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.6910000000000001,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":1.6299999999999999}]},{"osd":5,"last update":"Fri Dec 22 10:02:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.232,"15min":1.244},"min":{"1min":0.90300000000000002,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":1.464,"5min":1.907,"15min":1.907},"last":1.282},{"interface":"front","average":{"1min":1.246,"5min":1.3720000000000001,"15min":1.393},"min":{"1min":0.95399999999999996,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.8680000000000001,"5min":2.363,"15min":2.363},"last":1.2250000000000001}]},{"osd":7,"last update":"Fri Dec 22 10:02:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.403,"15min":1.421},"min":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":1.6359999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.5860000000000001},{"interface":"front","average":{"1min":1.323,"5min":1.387,"15min":1.397},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.611,"5min":2.1779999999999999,"15min":2.1779999999999999},"last":1.409}]}]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297640,"kb_used_data":544,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074200,"statfs":{"total":96636764160,"available":96331980800,"internally_reserved":0,"allocated":557056,"data_stored":245447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 10:02:27 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.0369999999999999,"15min":1.024},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":1.1240000000000001},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.141,"15min":1.129},"min":{"1min":0.79200000000000004,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.502,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":1.3979999999999999}]},{"osd":1,"last update":"Fri Dec 22 10:02:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":0.97599999999999998,"15min":0.95799999999999996},"min":{"1min":0.71599999999999997,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.7589999999999999,"5min":1.7589999999999999,"15min":1.7589999999999999},"last":1.175},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.0780000000000001,"15min":1.0660000000000001},"min":{"1min":0.63300000000000001,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":2.286,"5min":2.286,"15min":2.286},"last":1.139}]},{"osd":2,"last update":"Fri Dec 22 10:02:27 2023","interfaces":[{"interface":"back","average":{"1min":1.264,"5min":1.139,"15min":1.1180000000000001},"min":{"1min":0.76000000000000001,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":2.6739999999999999,"5min":2.6739999999999999,"15min":2.6739999999999999},"last":1.2889999999999999},{"interface":"front","average":{"1min":1.153,"5min":1.125,"15min":1.121},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.694,"5min":1.694,"15min":1.694},"last":1.3220000000000001}]},{"osd":3,"last update":"Fri Dec 22 10:02:27 2023","interfaces":[{"interface":"back","average":{"1min":1.208,"5min":1.1479999999999999,"15min":1.1379999999999999},"min":{"1min":0.80600000000000005,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":2.0510000000000002,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":1.3480000000000001},{"interface":"front","average":{"1min":1.347,"5min":1.212,"15min":1.1899999999999999},"min":{"1min":1.0369999999999999,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":2.508,"5min":2.508,"15min":2.508},"last":1.498}]},{"osd":4,"last update":"Fri Dec 22 10:02:27 2023","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.1499999999999999,"15min":1.1459999999999999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":2.391,"5min":2.391,"15min":2.391},"last":1.383},{"interface":"front","average":{"1min":1.349,"5min":1.2889999999999999,"15min":1.2789999999999999},"min":{"1min":1.006,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":2.1520000000000001,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":1.0269999999999999}]},{"osd":6,"last update":"Fri Dec 22 10:02:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3120000000000001,"5min":1.256,"15min":1.246},"min":{"1min":0.877,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":2.7690000000000001,"5min":2.7690000000000001,"15min":2.7690000000000001},"last":0.94199999999999995},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.2470000000000001,"15min":1.2390000000000001},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":2.569,"5min":2.569,"15min":2.569},"last":1.224}]},{"osd":7,"last update":"Fri Dec 22 10:02:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.2529999999999999,"15min":1.2410000000000001},"min":{"1min":0.92200000000000004,"5min":0.752,"15min":0.752},"max":{"1min":2.2410000000000001,"5min":2.2410000000000001,"15min":2.2410000000000001},"last":1.2609999999999999},{"interface":"front","average":{"1min":1.448,"5min":1.343,"15min":1.325},"min":{"1min":1.1020000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":2.7250000000000001,"5min":2.7250000000000001,"15min":2.7250000000000001},"last":1.415}]}]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297640,"kb_used_data":544,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074200,"statfs":{"total":96636764160,"available":96331980800,"internally_reserved":0,"allocated":557056,"data_stored":245447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 10:02:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.141,"15min":1.1459999999999999},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":1.099},{"interface":"front","average":{"1min":1.127,"5min":1.151,"15min":1.155},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.804,"5min":1.804,"15min":1.804},"last":1.119}]},{"osd":1,"last update":"Fri Dec 22 10:02:28 2023","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.024,"15min":1.016},"min":{"1min":0.72899999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.3280000000000001,"5min":1.448,"15min":1.448},"last":0.86199999999999999},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.083,"15min":1.079},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":0.89100000000000001}]},{"osd":2,"last update":"Fri Dec 22 10:02:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.1459999999999999,"15min":1.1419999999999999},"min":{"1min":0.754,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.5469999999999999,"5min":1.641,"15min":1.641},"last":1.27},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.2749999999999999,"15min":1.2729999999999999},"min":{"1min":1.0109999999999999,"5min":0.89700000000000002,"15min":0.89700000000000002},"max":{"1min":1.7969999999999999,"5min":1.8340000000000001,"15min":1.8340000000000001},"last":1.0329999999999999}]},{"osd":3,"last update":"Fri Dec 22 10:02:28 2023","interfaces":[{"interface":"back","average":{"1min":1.218,"5min":1.1819999999999999,"15min":1.1759999999999999},"min":{"1min":0.874,"5min":0.752,"15min":0.752},"max":{"1min":1.972,"5min":1.972,"15min":1.972},"last":1.0089999999999999},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.3029999999999999,"15min":1.296},"min":{"1min":1.1120000000000001,"5min":0.90100000000000002,"15min":0.90100000000000002},"max":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":1.0549999999999999}]},{"osd":5,"last update":"Fri Dec 22 10:02:28 2023","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.228,"15min":1.22},"min":{"1min":0.94499999999999995,"5min":0.90300000000000002,"15min":0.90300000000000002},"max":{"1min":1.9259999999999999,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":0.80700000000000005},{"interface":"front","average":{"1min":1.2250000000000001,"5min":1.1830000000000001,"15min":1.1759999999999999},"min":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.9419999999999999,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":0.82699999999999996}]},{"osd":6,"last update":"Fri Dec 22 10:02:28 2023","interfaces":[{"interface":"back","average":{"1min":1.2829999999999999,"5min":1.27,"15min":1.268},"min":{"1min":0.84199999999999997,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":1.645,"5min":1.869,"15min":1.869},"last":1.2190000000000001},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.389,"15min":1.3919999999999999},"min":{"1min":0.97199999999999998,"5min":0.93799999999999994,"15min":0.93799999999999994},"max":{"1min":2.0219999999999998,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":0.74399999999999999}]},{"osd":7,"last update":"Fri Dec 22 10:02:28 2023","interfaces":[{"interface":"back","average":{"1min":1.4099999999999999,"5min":1.3420000000000001,"15min":1.331},"min":{"1min":1.073,"5min":0.94999999999999996,"15min":0.94999999999999996},"max":{"1min":2.2320000000000002,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":1.196},{"interface":"front","average":{"1min":1.4319999999999999,"5min":1.399,"15min":1.393},"min":{"1min":1.0920000000000001,"5min":1.044,"15min":1.044},"max":{"1min":2.0409999999999999,"5min":2.0409999999999999,"15min":2.0409999999999999},"last":1.153}]}]},{"osd":3,"up_from":13,"seq":55834574877,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297640,"kb_used_data":544,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074200,"statfs":{"total":96636764160,"available":96331980800,"internally_reserved":0,"allocated":557056,"data_stored":245447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 10:02:26 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.80500000000000005,"15min":0.81399999999999995},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.145,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.84099999999999997,"15min":0.84599999999999997},"min":{"1min":0.51800000000000002,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.129,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.72999999999999998}]},{"osd":1,"last update":"Fri Dec 22 10:02:26 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.91300000000000003,"15min":0.90700000000000003},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":1.05},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.1020000000000001,"15min":1.1060000000000001},"min":{"1min":0.70199999999999996,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.4199999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":0.98799999999999999}]},{"osd":2,"last update":"Fri Dec 22 10:02:26 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":1.0640000000000001,"15min":1.077},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":2.1200000000000001,"5min":2.1200000000000001,"15min":2.1200000000000001},"last":1.2849999999999999},{"interface":"front","average":{"1min":0.98599999999999999,"5min":1.075,"15min":1.0900000000000001},"min":{"1min":0.753,"5min":0.746,"15min":0.746},"max":{"1min":1.258,"5min":1.702,"15min":1.702},"last":1.101}]},{"osd":4,"last update":"Fri Dec 22 10:02:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.1899999999999999,"15min":1.196},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.4730000000000001,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":1.335},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.2729999999999999,"15min":1.278},"min":{"1min":0.77700000000000002,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.6100000000000001,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":1.4750000000000001}]},{"osd":5,"last update":"Fri Dec 22 10:02:26 2023","interfaces":[{"interface":"back","average":{"1min":1.3420000000000001,"5min":1.3340000000000001,"15min":1.333},"min":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":2.0190000000000001,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":1.3979999999999999},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.331,"15min":1.3380000000000001},"min":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"max":{"1min":1.8160000000000001,"5min":2.1720000000000002,"15min":2.1720000000000002},"last":1.389}]},{"osd":6,"last update":"Fri Dec 22 10:02:26 2023","interfaces":[{"interface":"back","average":{"1min":1.23,"5min":1.3260000000000001,"15min":1.3420000000000001},"min":{"1min":0.76200000000000001,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.5389999999999999,"5min":1.8640000000000001,"15min":1.8640000000000001},"last":1.4970000000000001},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.413,"15min":1.4159999999999999},"min":{"1min":0.81499999999999995,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":2.2029999999999998,"5min":2.2130000000000001,"15min":2.2130000000000001},"last":1.6200000000000001}]},{"osd":7,"last update":"Fri Dec 22 10:02:26 2023","interfaces":[{"interface":"back","average":{"1min":1.3720000000000001,"5min":1.3979999999999999,"15min":1.4019999999999999},"min":{"1min":1.0409999999999999,"5min":0.94199999999999995,"15min":0.94199999999999995},"max":{"1min":1.9399999999999999,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":1.3100000000000001},{"interface":"front","average":{"1min":1.391,"5min":1.423,"15min":1.4279999999999999},"min":{"1min":0.90000000000000002,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":1.728,"5min":2.105,"15min":2.105},"last":1.4199999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574878,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297640,"kb_used_data":544,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074200,"statfs":{"total":96636764160,"available":96331980800,"internally_reserved":0,"allocated":557056,"data_stored":245447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 10:02:26 2023","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":0.96699999999999997,"15min":0.95699999999999996},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":3.1589999999999998,"5min":3.1589999999999998,"15min":3.1589999999999998},"last":0.82999999999999996},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.075,"15min":1.0800000000000001},"min":{"1min":0.68799999999999994,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":2.3039999999999998,"5min":2.3039999999999998,"15min":2.3039999999999998},"last":1}]},{"osd":1,"last update":"Fri Dec 22 10:02:26 2023","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":1.0649999999999999,"15min":1.054},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":3.194,"5min":3.194,"15min":3.194},"last":0.93899999999999995},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.075,"15min":1.069},"min":{"1min":0.61299999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":3.0910000000000002,"5min":3.0910000000000002,"15min":3.0910000000000002},"last":0.79100000000000004}]},{"osd":3,"last update":"Fri Dec 22 10:02:26 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.024,"15min":0.99399999999999999},"min":{"1min":0.68600000000000005,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":5.4059999999999997,"5min":5.4059999999999997,"15min":5.4059999999999997},"last":0.85799999999999998},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.2010000000000001,"15min":1.1759999999999999},"min":{"1min":0.74099999999999999,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":5.2789999999999999,"5min":5.2789999999999999,"15min":5.2789999999999999},"last":1.202}]},{"osd":4,"last update":"Fri Dec 22 10:02:26 2023","interfaces":[{"interface":"back","average":{"1min":1.3180000000000001,"5min":1.3680000000000001,"15min":1.3759999999999999},"min":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"max":{"1min":2.2130000000000001,"5min":2.234,"15min":2.234},"last":1.2509999999999999},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.284,"15min":1.292},"min":{"1min":0.92200000000000004,"5min":0.85199999999999998,"15min":0.85199999999999998},"max":{"1min":2.004,"5min":2.1230000000000002,"15min":2.1230000000000002},"last":1.1279999999999999}]},{"osd":5,"last update":"Fri Dec 22 10:02:26 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.448,"15min":1.4590000000000001},"min":{"1min":1.04,"5min":1.04,"15min":1.04},"max":{"1min":2.5339999999999998,"5min":2.5339999999999998,"15min":2.5339999999999998},"last":1.4630000000000001},{"interface":"front","average":{"1min":1.4159999999999999,"5min":1.4319999999999999,"15min":1.4350000000000001},"min":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"max":{"1min":2.2610000000000001,"5min":2.2610000000000001,"15min":2.2610000000000001},"last":1.3899999999999999}]},{"osd":6,"last update":"Fri Dec 22 10:02:26 2023","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.3700000000000001,"15min":1.3740000000000001},"min":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":1.95,"5min":2.298,"15min":2.298},"last":1.2849999999999999},{"interface":"front","average":{"1min":1.47,"5min":1.462,"15min":1.46},"min":{"1min":1.03,"5min":1.02,"15min":1.02},"max":{"1min":3.1179999999999999,"5min":3.1179999999999999,"15min":3.1179999999999999},"last":1.3640000000000001}]},{"osd":7,"last update":"Fri Dec 22 10:02:26 2023","interfaces":[{"interface":"back","average":{"1min":1.4830000000000001,"5min":1.4630000000000001,"15min":1.4590000000000001},"min":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"max":{"1min":2.7269999999999999,"5min":2.7269999999999999,"15min":2.7269999999999999},"last":1.325},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.4119999999999999,"15min":1.4139999999999999},"min":{"1min":1,"5min":0.98099999999999998,"15min":0.98099999999999998},"max":{"1min":2.0419999999999998,"5min":2.0419999999999998,"15min":2.0419999999999998},"last":1.3420000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297640,"kb_used_data":544,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074200,"statfs":{"total":96636764160,"available":96331980800,"internally_reserved":0,"allocated":557056,"data_stored":245447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 22 10:02:32 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.91200000000000003,"15min":0.92200000000000004},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.323,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.91600000000000004,"15min":0.91500000000000004},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.583,"5min":1.583,"15min":1.583},"last":1.2629999999999999}]},{"osd":2,"last update":"Fri Dec 22 10:02:32 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.92600000000000005,"15min":0.93500000000000005},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.421,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.83299999999999996},{"interface":"front","average":{"1min":1.036,"5min":1.0229999999999999,"15min":1.0209999999999999},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":1.0029999999999999}]},{"osd":3,"last update":"Fri Dec 22 10:02:32 2023","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":1.1950000000000001,"15min":1.1910000000000001},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.5760000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":1.2989999999999999},{"interface":"front","average":{"1min":1.022,"5min":1.073,"15min":1.081},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":1.0680000000000001}]},{"osd":4,"last update":"Fri Dec 22 10:02:32 2023","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.1879999999999999,"15min":1.1819999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.6579999999999999,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":1.042},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.2450000000000001,"15min":1.2390000000000001},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.6719999999999999,"5min":2.0710000000000002,"15min":2.0710000000000002},"last":1.103}]},{"osd":5,"last update":"Fri Dec 22 10:02:32 2023","interfaces":[{"interface":"back","average":{"1min":1.3089999999999999,"5min":1.3120000000000001,"15min":1.3120000000000001},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.8260000000000001,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":1.355},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.2829999999999999,"15min":1.2869999999999999},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.7390000000000001,"5min":1.881,"15min":1.881},"last":1.3220000000000001}]},{"osd":6,"last update":"Fri Dec 22 10:02:32 2023","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.3859999999999999,"15min":1.3899999999999999},"min":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"max":{"1min":1.887,"5min":1.887,"15min":1.887},"last":1.4490000000000001},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.3740000000000001,"15min":1.3720000000000001},"min":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":1.754,"5min":1.946,"15min":1.946},"last":1.2290000000000001}]},{"osd":7,"last update":"Fri Dec 22 10:02:32 2023","interfaces":[{"interface":"back","average":{"1min":1.4379999999999999,"5min":1.4219999999999999,"15min":1.419},"min":{"1min":0.872,"5min":0.872,"15min":0.872},"max":{"1min":1.899,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":1.391},{"interface":"front","average":{"1min":1.4870000000000001,"5min":1.458,"15min":1.4530000000000001},"min":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"max":{"1min":1.919,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":1.4079999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297640,"kb_used_data":544,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074200,"statfs":{"total":96636764160,"available":96331980800,"internally_reserved":0,"allocated":557056,"data_stored":245447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 22 10:02:28 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.96699999999999997,"15min":0.97499999999999998},"min":{"1min":0.64900000000000002,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.1859999999999999,"5min":2.7250000000000001,"15min":2.7250000000000001},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.72899999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.349,"5min":1.349,"15min":1.349},"last":1.044}]},{"osd":2,"last update":"Fri Dec 22 10:02:28 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":1.0049999999999999,"15min":1.0129999999999999},"min":{"1min":0.65500000000000003,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.2450000000000001,"5min":2.7799999999999998,"15min":2.7799999999999998},"last":0.80300000000000005},{"interface":"front","average":{"1min":1.0369999999999999,"5min":0.99299999999999999,"15min":0.98499999999999999},"min":{"1min":0.68899999999999995,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.3959999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":1.159}]},{"osd":3,"last update":"Fri Dec 22 10:02:28 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":1.0129999999999999,"15min":1.0329999999999999},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.377,"5min":2.919,"15min":2.919},"last":0.75800000000000001},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.22,"15min":1.238},"min":{"1min":0.72499999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.4450000000000001,"5min":2.8959999999999999,"15min":2.8959999999999999},"last":1.2250000000000001}]},{"osd":4,"last update":"Fri Dec 22 10:02:28 2023","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.1930000000000001,"15min":1.1859999999999999},"min":{"1min":0.84599999999999997,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.74,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":1.456},{"interface":"front","average":{"1min":1.202,"5min":1.274,"15min":1.286},"min":{"1min":0.95599999999999996,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.504,"5min":3.1280000000000001,"15min":3.1280000000000001},"last":1.0980000000000001}]},{"osd":5,"last update":"Fri Dec 22 10:02:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.3109999999999999,"15min":1.333},"min":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":1.6739999999999999,"5min":3.0760000000000001,"15min":3.0760000000000001},"last":1.21},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.3520000000000001,"15min":1.3620000000000001},"min":{"1min":1.04,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":1.7609999999999999,"5min":2.512,"15min":2.512},"last":1.5009999999999999}]},{"osd":6,"last update":"Fri Dec 22 10:02:28 2023","interfaces":[{"interface":"back","average":{"1min":1.375,"5min":1.4750000000000001,"15min":1.4910000000000001},"min":{"1min":1.0860000000000001,"5min":0.95599999999999996,"15min":0.95599999999999996},"max":{"1min":1.843,"5min":2.8199999999999998,"15min":2.8199999999999998},"last":1.3799999999999999},{"interface":"front","average":{"1min":1.343,"5min":1.476,"15min":1.498},"min":{"1min":1.0389999999999999,"5min":1.032,"15min":1.032},"max":{"1min":1.8819999999999999,"5min":4.6029999999999998,"15min":4.6029999999999998},"last":1.2809999999999999}]},{"osd":7,"last update":"Fri Dec 22 10:02:28 2023","interfaces":[{"interface":"back","average":{"1min":1.411,"5min":1.415,"15min":1.4159999999999999},"min":{"1min":1.1839999999999999,"5min":1.0860000000000001,"15min":1.0860000000000001},"max":{"1min":1.9830000000000001,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":1.3500000000000001},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.47,"15min":1.4970000000000001},"min":{"1min":1.077,"5min":0.89200000000000002,"15min":0.89200000000000002},"max":{"1min":1.5840000000000001,"5min":3.6339999999999999,"15min":3.6339999999999999},"last":1.333}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-22T10:02:42.641 DEBUG:teuthology.orchestra.run.smithi045:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-12-22T10:02:42.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.802+0000 7f8c2e169700 1 Processor -- start 2023-12-22T10:02:42.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.802+0000 7f8c2e169700 1 -- start start 2023-12-22T10:02:42.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.806+0000 7f8c2e169700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f8c280ac2d0 0x7f8c280c5900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:42.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.806+0000 7f8c2e169700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8c280ac6b0 0x7f8c280aa660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:42.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.806+0000 7f8c2e169700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f8c28158050 0x7f8c280c7430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:42.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.806+0000 7f8c2e169700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c280c8d50 con 0x7f8c280ac6b0 2023-12-22T10:02:42.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.806+0000 7f8c2e169700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c280c95f0 con 0x7f8c28158050 2023-12-22T10:02:42.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.806+0000 7f8c2e169700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c280aab50 con 0x7f8c280ac2d0 2023-12-22T10:02:42.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.806+0000 7f8c26ffd700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8c280ac6b0 0x7f8c280aa660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:42.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.806+0000 7f8c26ffd700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8c280ac6b0 0x7f8c280aa660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42976/0 (socket says 172.21.15.45:42976) 2023-12-22T10:02:42.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.806+0000 7f8c26ffd700 1 -- 172.21.15.45:0/1900637253 learned_addr learned my addr 172.21.15.45:0/1900637253 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:02:42.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.806+0000 7f8c27fff700 1 --2- 172.21.15.45:0/1900637253 >> v2:172.21.15.113:3300/0 conn(0x7f8c28158050 0x7f8c280c7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:42.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.806+0000 7f8c277fe700 1 --2- 172.21.15.45:0/1900637253 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f8c280ac2d0 0x7f8c280c5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:42.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.806+0000 7f8c26ffd700 1 -- 172.21.15.45:0/1900637253 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f8c280ac2d0 msgr2=0x7f8c280c5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:02:42.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.806+0000 7f8c26ffd700 1 --2- 172.21.15.45:0/1900637253 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f8c280ac2d0 0x7f8c280c5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:42.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.806+0000 7f8c26ffd700 1 -- 172.21.15.45:0/1900637253 >> v2:172.21.15.113:3300/0 conn(0x7f8c28158050 msgr2=0x7f8c280c7430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:02:42.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.806+0000 7f8c26ffd700 1 --2- 172.21.15.45:0/1900637253 >> v2:172.21.15.113:3300/0 conn(0x7f8c28158050 0x7f8c280c7430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:42.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.806+0000 7f8c26ffd700 1 -- 172.21.15.45:0/1900637253 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c280acb10 con 0x7f8c280ac6b0 2023-12-22T10:02:42.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.806+0000 7f8c27fff700 1 --2- 172.21.15.45:0/1900637253 >> v2:172.21.15.113:3300/0 conn(0x7f8c28158050 0x7f8c280c7430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-12-22T10:02:42.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.810+0000 7f8c26ffd700 1 --2- 172.21.15.45:0/1900637253 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c280ac6b0 0x7f8c280aa660 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 rx=0x7f8c280c5480 tx=0x7f8c1c0090f0).ready entity=mon.0 client_cookie=58af6950659a0456 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:42.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.810+0000 7f8c267fc700 1 -- 172.21.15.45:0/1900637253 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c1c00f510 con 0x7f8c280ac6b0 2023-12-22T10:02:42.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.810+0000 7f8c267fc700 1 -- 172.21.15.45:0/1900637253 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c1c00f670 con 0x7f8c280ac6b0 2023-12-22T10:02:42.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.810+0000 7f8c267fc700 1 -- 172.21.15.45:0/1900637253 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c1c00fa10 con 0x7f8c280ac6b0 2023-12-22T10:02:42.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.810+0000 7f8c2e169700 1 -- 172.21.15.45:0/1900637253 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c280ac6b0 msgr2=0x7f8c280aa660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:42.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.810+0000 7f8c2e169700 1 --2- 172.21.15.45:0/1900637253 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c280ac6b0 0x7f8c280aa660 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 rx=0x7f8c280c5480 tx=0x7f8c1c0090f0).stop 2023-12-22T10:02:42.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.810+0000 7f8c2e169700 1 -- 172.21.15.45:0/1900637253 shutdown_connections 2023-12-22T10:02:42.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.810+0000 7f8c2e169700 1 --2- 172.21.15.45:0/1900637253 >> v2:172.21.15.113:3300/0 conn(0x7f8c28158050 0x7f8c280c7430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:42.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.810+0000 7f8c2e169700 1 --2- 172.21.15.45:0/1900637253 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c280ac6b0 0x7f8c280aa660 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:42.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.810+0000 7f8c2e169700 1 --2- 172.21.15.45:0/1900637253 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f8c280ac2d0 0x7f8c280c5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:42.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.810+0000 7f8c2e169700 1 -- 172.21.15.45:0/1900637253 >> 172.21.15.45:0/1900637253 conn(0x7f8c28082a50 msgr2=0x7f8c28066a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:02:42.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.810+0000 7f8c2e169700 1 -- 172.21.15.45:0/1900637253 shutdown_connections 2023-12-22T10:02:42.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.810+0000 7f8c2e169700 1 -- 172.21.15.45:0/1900637253 wait complete. 2023-12-22T10:02:42.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.814+0000 7f8c2e169700 1 Processor -- start 2023-12-22T10:02:42.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.814+0000 7f8c2e169700 1 -- start start 2023-12-22T10:02:42.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.814+0000 7f8c2e169700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f8c280ac2d0 0x7f8c280c1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:42.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.814+0000 7f8c2e169700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8c280ac6b0 0x7f8c281475f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:42.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.814+0000 7f8c2e169700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c28158050 0x7f8c280af9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:42.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.814+0000 7f8c2e169700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c280c46d0 con 0x7f8c28158050 2023-12-22T10:02:42.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.814+0000 7f8c2e169700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c280c2f20 con 0x7f8c280ac6b0 2023-12-22T10:02:42.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.814+0000 7f8c2e169700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c280c2310 con 0x7f8c280ac2d0 2023-12-22T10:02:42.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.814+0000 7f8c27fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c28158050 0x7f8c280af9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:42.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.814+0000 7f8c27fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c28158050 0x7f8c280af9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42984/0 (socket says 172.21.15.45:42984) 2023-12-22T10:02:42.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.814+0000 7f8c27fff700 1 -- 172.21.15.45:0/848934543 learned_addr learned my addr 172.21.15.45:0/848934543 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:02:42.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.814+0000 7f8c277fe700 1 --2- 172.21.15.45:0/848934543 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f8c280ac2d0 0x7f8c280c1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:42.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.814+0000 7f8c26ffd700 1 --2- 172.21.15.45:0/848934543 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8c280ac6b0 0x7f8c281475f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:42.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.814+0000 7f8c27fff700 1 -- 172.21.15.45:0/848934543 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f8c280ac2d0 msgr2=0x7f8c280c1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:42.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.814+0000 7f8c27fff700 1 --2- 172.21.15.45:0/848934543 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f8c280ac2d0 0x7f8c280c1ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:42.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.814+0000 7f8c27fff700 1 -- 172.21.15.45:0/848934543 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8c280ac6b0 msgr2=0x7f8c281475f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:42.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.814+0000 7f8c27fff700 1 --2- 172.21.15.45:0/848934543 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8c280ac6b0 0x7f8c281475f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:42.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.814+0000 7f8c27fff700 1 -- 172.21.15.45:0/848934543 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c20009a20 con 0x7f8c28158050 2023-12-22T10:02:42.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.814+0000 7f8c27fff700 1 --2- 172.21.15.45:0/848934543 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c28158050 0x7f8c280af9e0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7f8c20009fc0 tx=0x7f8c2000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:42.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.818+0000 7f8c0f7fe700 1 -- 172.21.15.45:0/848934543 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c20009d20 con 0x7f8c28158050 2023-12-22T10:02:42.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.818+0000 7f8c0f7fe700 1 -- 172.21.15.45:0/848934543 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c2000f040 con 0x7f8c28158050 2023-12-22T10:02:42.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.818+0000 7f8c0f7fe700 1 -- 172.21.15.45:0/848934543 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c2000cde0 con 0x7f8c28158050 2023-12-22T10:02:42.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.818+0000 7f8c2e169700 1 -- 172.21.15.45:0/848934543 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c1c009370 con 0x7f8c28158050 2023-12-22T10:02:42.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.818+0000 7f8c2e169700 1 -- 172.21.15.45:0/848934543 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c280c28d0 con 0x7f8c28158050 2023-12-22T10:02:42.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.818+0000 7f8c2e169700 1 -- 172.21.15.45:0/848934543 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c280c30b0 con 0x7f8c28158050 2023-12-22T10:02:42.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.818+0000 7f8c0f7fe700 1 -- 172.21.15.45:0/848934543 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f8c20013610 con 0x7f8c28158050 2023-12-22T10:02:42.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.822+0000 7f8c0f7fe700 1 --2- 172.21.15.45:0/848934543 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f8c1405a540 0x7f8c1405ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:42.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.822+0000 7f8c0f7fe700 1 -- 172.21.15.45:0/848934543 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f8c20074de0 con 0x7f8c28158050 2023-12-22T10:02:42.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.822+0000 7f8c277fe700 1 --2- 172.21.15.45:0/848934543 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f8c1405a540 0x7f8c1405ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:42.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.822+0000 7f8c277fe700 1 --2- 172.21.15.45:0/848934543 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f8c1405a540 0x7f8c1405ca00 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7f8c18009b00 tx=0x7f8c18009060).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:42.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.826+0000 7f8c0f7fe700 1 -- 172.21.15.45:0/848934543 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f8c20048800 con 0x7f8c28158050 2023-12-22T10:02:42.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:42.990+0000 7f8c2e169700 1 -- 172.21.15.45:0/848934543 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f8c2806c070 con 0x7f8c28158050 2023-12-22T10:02:42.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:43.002+0000 7f8c0f7fe700 1 -- 172.21.15.45:0/848934543 <== mon.0 v2:172.21.15.45:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f8c20078030 con 0x7f8c28158050 2023-12-22T10:02:42.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:43.002+0000 7f8c0f7fe700 1 -- 172.21.15.45:0/848934543 <== mon.0 v2:172.21.15.45:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v4)=0 v4) v1 ==== 123+0+0 (secure 0 0 0) 0x7f8c2004be20 con 0x7f8c28158050 2023-12-22T10:02:43.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:43.006+0000 7f8c2e169700 1 -- 172.21.15.45:0/848934543 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f8c1405a540 msgr2=0x7f8c1405ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:43.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:43.006+0000 7f8c2e169700 1 --2- 172.21.15.45:0/848934543 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f8c1405a540 0x7f8c1405ca00 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7f8c18009b00 tx=0x7f8c18009060).stop 2023-12-22T10:02:43.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:43.006+0000 7f8c2e169700 1 -- 172.21.15.45:0/848934543 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c28158050 msgr2=0x7f8c280af9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:43.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:43.006+0000 7f8c2e169700 1 --2- 172.21.15.45:0/848934543 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c28158050 0x7f8c280af9e0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7f8c20009fc0 tx=0x7f8c2000b040).stop 2023-12-22T10:02:43.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:43.006+0000 7f8c2e169700 1 -- 172.21.15.45:0/848934543 shutdown_connections 2023-12-22T10:02:43.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:43.006+0000 7f8c2e169700 1 --2- 172.21.15.45:0/848934543 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c28158050 0x7f8c280af9e0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:43.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:43.006+0000 7f8c2e169700 1 --2- 172.21.15.45:0/848934543 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f8c280ac6b0 0x7f8c281475f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:43.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:43.006+0000 7f8c2e169700 1 --2- 172.21.15.45:0/848934543 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f8c1405a540 0x7f8c1405ca00 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:43.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:43.006+0000 7f8c2e169700 1 --2- 172.21.15.45:0/848934543 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f8c280ac2d0 0x7f8c280c1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:43.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:43.006+0000 7f8c2e169700 1 -- 172.21.15.45:0/848934543 >> 172.21.15.45:0/848934543 conn(0x7f8c28082a50 msgr2=0x7f8c280bf9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:02:43.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:43.006+0000 7f8c2e169700 1 -- 172.21.15.45:0/848934543 shutdown_connections 2023-12-22T10:02:43.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:43.006+0000 7f8c2e169700 1 -- 172.21.15.45:0/848934543 wait complete. 2023-12-22T10:02:43.021 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-22T10:02:43.021 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-22T10:02:43.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:43.190+0000 7f451b61b700 1 Processor -- start 2023-12-22T10:02:43.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:43.190+0000 7f451b61b700 1 -- start start 2023-12-22T10:02:43.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:43.190+0000 7f451b61b700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f45140bdf50 0x7f45140be3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:43.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:43.190+0000 7f451b61b700 1 --2- >> v2:172.21.15.113:3300/0 conn(0x7f45140c7400 0x7f45140c7870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:43.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:43.190+0000 7f451b61b700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45140c6f70 con 0x7f45140c57d0 2023-12-22T10:02:43.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:43.190+0000 7f451b61b700 1 -- --> v2:172.21.15.113:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4514069c20 con 0x7f45140c7400 2023-12-22T10:02:43.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:43.190+0000 7f451b61b700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45141540e0 con 0x7f45140bdf50 2023-12-22T10:02:43.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:43.190+0000 7f45193b7700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f45140c57d0 0x7f4514068e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44978/0 (socket says 172.21.15.45:44978) 2023-12-22T10:02:43.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:43.190+0000 7f45193b7700 1 -- 172.21.15.45:0/2332174636 learned_addr learned my addr 172.21.15.45:0/2332174636 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-22T10:02:43.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:43.190+0000 7f4519bb8700 1 --2- 172.21.15.45:0/2332174636 >> v2:172.21.15.113:3300/0 conn(0x7f45140c7400 0x7f45140c7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:43.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:43.190+0000 7f4518bb6700 1 --2- 172.21.15.45:0/2332174636 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f45140bdf50 0x7f45140be3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:43.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:43.190+0000 7f450bfff700 1 -- 172.21.15.45:0/2332174636 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 98487653 0 0) 0x7f45140c6f70 con 0x7f45140c57d0 2023-12-22T10:02:43.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:43.190+0000 7f450bfff700 1 -- 172.21.15.45:0/2332174636 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45000033f0 con 0x7f45140c57d0 2023-12-22T10:02:43.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:43.194+0000 7f4519bb8700 1 -- 172.21.15.45:0/2332174636 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f45140bdf50 msgr2=0x7f45140be3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-22T10:02:43.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:43.194+0000 7f4519bb8700 1 --2- 172.21.15.45:0/2332174636 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f45140bdf50 0x7f45140be3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:43.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:43.194+0000 7f4519bb8700 1 -- 172.21.15.45:0/2332174636 >> v1:172.21.15.45:6789/0 conn(0x7f45140c57d0 legacy=0x7f4514068e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:43.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:43.194+0000 7f4519bb8700 1 -- 172.21.15.45:0/2332174636 --> v2:172.21.15.113:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45140be8a0 con 0x7f45140c7400 2023-12-22T10:02:43.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:43.194+0000 7f4519bb8700 1 --2- 172.21.15.45:0/2332174636 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f45140c7400 0x7f45140c7870 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7f450c009e60 tx=0x7f450c009780).ready entity=mon.1 client_cookie=bc9c45f6fcfc6d0e server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:43.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:43.194+0000 7f450bfff700 1 -- 172.21.15.45:0/2332174636 <== mon.1 v2:172.21.15.113:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f450c00e070 con 0x7f45140c7400 2023-12-22T10:02:43.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:43.194+0000 7f450bfff700 1 -- 172.21.15.45:0/2332174636 <== mon.1 v2:172.21.15.113:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f450c00bab0 con 0x7f45140c7400 2023-12-22T10:02:43.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:43.194+0000 7f450bfff700 1 -- 172.21.15.45:0/2332174636 <== mon.1 v2:172.21.15.113:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f450c00be50 con 0x7f45140c7400 2023-12-22T10:02:43.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:43.194+0000 7f451b61b700 1 -- 172.21.15.45:0/2332174636 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f45140c7400 msgr2=0x7f45140c7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:43.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:43.194+0000 7f451b61b700 1 --2- 172.21.15.45:0/2332174636 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f45140c7400 0x7f45140c7870 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7f450c009e60 tx=0x7f450c009780).stop 2023-12-22T10:02:43.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:43.194+0000 7f451b61b700 1 -- 172.21.15.45:0/2332174636 shutdown_connections 2023-12-22T10:02:43.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:43.194+0000 7f451b61b700 1 --2- 172.21.15.45:0/2332174636 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f45140c7400 0x7f45140c7870 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:43.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:43.194+0000 7f451b61b700 1 --2- 172.21.15.45:0/2332174636 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f45140bdf50 0x7f45140be3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:43.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:43.194+0000 7f451b61b700 1 -- 172.21.15.45:0/2332174636 >> 172.21.15.45:0/2332174636 conn(0x7f4514082670 msgr2=0x7f4514091f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:02:43.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:43.194+0000 7f451b61b700 1 -- 172.21.15.45:0/2332174636 shutdown_connections 2023-12-22T10:02:43.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:43.194+0000 7f451b61b700 1 -- 172.21.15.45:0/2332174636 wait complete. 2023-12-22T10:02:43.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:43.198+0000 7f451b61b700 1 Processor -- start 2023-12-22T10:02:43.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:43.198+0000 7f451b61b700 1 -- start start 2023-12-22T10:02:43.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:43.198+0000 7f451b61b700 1 --2- >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f45140bdf50 0x7f451416c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:43.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:43.198+0000 7f451b61b700 1 --2- >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f45140c57d0 0x7f4514151ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:43.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:43.198+0000 7f451b61b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45140c7400 0x7f4514152390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:43.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:43.198+0000 7f451b61b700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45141531d0 con 0x7f45140c7400 2023-12-22T10:02:43.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:43.198+0000 7f451b61b700 1 -- --> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f451414ad80 con 0x7f45140c57d0 2023-12-22T10:02:43.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:43.198+0000 7f451b61b700 1 -- --> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4514152930 con 0x7f45140bdf50 2023-12-22T10:02:43.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:43.198+0000 7f4519bb8700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45140c7400 0x7f4514152390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:43.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:43.198+0000 7f4519bb8700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45140c7400 0x7f4514152390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43002/0 (socket says 172.21.15.45:43002) 2023-12-22T10:02:43.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:43.198+0000 7f4519bb8700 1 -- 172.21.15.45:0/1538097378 learned_addr learned my addr 172.21.15.45:0/1538097378 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-22T10:02:43.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:43.198+0000 7f45193b7700 1 --2- 172.21.15.45:0/1538097378 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f45140bdf50 0x7f451416c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:43.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:43.198+0000 7f4518bb6700 1 --2- 172.21.15.45:0/1538097378 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f45140c57d0 0x7f4514151ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:43.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:43.198+0000 7f4519bb8700 1 -- 172.21.15.45:0/1538097378 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f45140bdf50 msgr2=0x7f451416c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:43.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:43.198+0000 7f4519bb8700 1 --2- 172.21.15.45:0/1538097378 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f45140bdf50 0x7f451416c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:43.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:43.198+0000 7f4519bb8700 1 -- 172.21.15.45:0/1538097378 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f45140c57d0 msgr2=0x7f4514151ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:43.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:43.198+0000 7f4519bb8700 1 --2- 172.21.15.45:0/1538097378 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f45140c57d0 0x7f4514151ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:43.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:43.198+0000 7f4519bb8700 1 -- 172.21.15.45:0/1538097378 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f450c009a20 con 0x7f45140c7400 2023-12-22T10:02:43.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:43.198+0000 7f4519bb8700 1 --2- 172.21.15.45:0/1538097378 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45140c7400 0x7f4514152390 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7f450c012cb0 tx=0x7f450c009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:43.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:43.202+0000 7f45097fa700 1 -- 172.21.15.45:0/1538097378 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f450c01d5a0 con 0x7f45140c7400 2023-12-22T10:02:43.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:43.202+0000 7f45097fa700 1 -- 172.21.15.45:0/1538097378 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f450c01d700 con 0x7f45140c7400 2023-12-22T10:02:43.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:43.202+0000 7f451b61b700 1 -- 172.21.15.45:0/1538097378 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4514152c10 con 0x7f45140c7400 2023-12-22T10:02:43.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:43.202+0000 7f45097fa700 1 -- 172.21.15.45:0/1538097378 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f450c01dae0 con 0x7f45140c7400 2023-12-22T10:02:43.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:43.202+0000 7f451b61b700 1 -- 172.21.15.45:0/1538097378 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f451416bff0 con 0x7f45140c7400 2023-12-22T10:02:43.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:43.202+0000 7f451b61b700 1 -- 172.21.15.45:0/1538097378 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f451414af10 con 0x7f45140c7400 2023-12-22T10:02:43.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:43.202+0000 7f45097fa700 1 -- 172.21.15.45:0/1538097378 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 72060+0+0 (secure 0 0 0) 0x7f450c003040 con 0x7f45140c7400 2023-12-22T10:02:43.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:43.206+0000 7f45097fa700 1 --2- 172.21.15.45:0/1538097378 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f44f805a510 0x7f44f805c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-12-22T10:02:43.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:43.206+0000 7f45097fa700 1 -- 172.21.15.45:0/1538097378 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f450c076800 con 0x7f45140c7400 2023-12-22T10:02:43.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:43.206+0000 7f45193b7700 1 --2- 172.21.15.45:0/1538097378 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f44f805a510 0x7f44f805c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-22T10:02:43.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:43.206+0000 7f45193b7700 1 --2- 172.21.15.45:0/1538097378 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f44f805a510 0x7f44f805c9d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7f45140c1720 tx=0x7f4510009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-22T10:02:43.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:43.210+0000 7f45097fa700 1 -- 172.21.15.45:0/1538097378 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f450c04a1c0 con 0x7f45140c7400 2023-12-22T10:02:43.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:43.414+0000 7f451b61b700 1 -- 172.21.15.45:0/1538097378 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f451406c070 con 0x7f45140c7400 2023-12-22T10:02:43.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:43.418+0000 7f45097fa700 1 -- 172.21.15.45:0/1538097378 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+3535 (secure 0 0 0) 0x7f450c017030 con 0x7f45140c7400 2023-12-22T10:02:43.414 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-22T10:02:43.414 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":25,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4925,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6836/1120392063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1120392063},{"type":"v1","addr":"172.21.15.45:6836","nonce":1120392063}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6835/2332598072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6834","nonce":2332598072},{"type":"v1","addr":"172.21.15.113:6835","nonce":2332598072}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5253,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/2884671415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6835","nonce":2884671415},{"type":"v1","addr":"172.21.15.45:6837","nonce":2884671415}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":5284,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.113:6833/2223286979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.113:6832","nonce":2223286979},{"type":"v1","addr":"172.21.15.113:6833","nonce":2223286979}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[]} 2023-12-22T10:02:43.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:43.422+0000 7f451b61b700 1 -- 172.21.15.45:0/1538097378 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f44f805a510 msgr2=0x7f44f805c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:43.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:43.422+0000 7f451b61b700 1 --2- 172.21.15.45:0/1538097378 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f44f805a510 0x7f44f805c9d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7f45140c1720 tx=0x7f4510009040).stop 2023-12-22T10:02:43.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:43.422+0000 7f451b61b700 1 -- 172.21.15.45:0/1538097378 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45140c7400 msgr2=0x7f4514152390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-22T10:02:43.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:43.422+0000 7f451b61b700 1 --2- 172.21.15.45:0/1538097378 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45140c7400 0x7f4514152390 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7f450c012cb0 tx=0x7f450c009780).stop 2023-12-22T10:02:43.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:43.422+0000 7f451b61b700 1 -- 172.21.15.45:0/1538097378 shutdown_connections 2023-12-22T10:02:43.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:43.422+0000 7f451b61b700 1 --2- 172.21.15.45:0/1538097378 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45140c7400 0x7f4514152390 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:43.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:43.422+0000 7f451b61b700 1 --2- 172.21.15.45:0/1538097378 >> [v2:172.21.15.113:3300/0,v1:172.21.15.113:6789/0] conn(0x7f45140c57d0 0x7f4514151ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:43.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:43.422+0000 7f451b61b700 1 --2- 172.21.15.45:0/1538097378 >> [v2:172.21.15.45:6832/33679,v1:172.21.15.45:6833/33679] conn(0x7f44f805a510 0x7f44f805c9d0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:43.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:43.422+0000 7f451b61b700 1 --2- 172.21.15.45:0/1538097378 >> [v2:172.21.15.113:3301/0,v1:172.21.15.113:6790/0] conn(0x7f45140bdf50 0x7f451416c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-12-22T10:02:43.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:43.422+0000 7f451b61b700 1 -- 172.21.15.45:0/1538097378 >> 172.21.15.45:0/1538097378 conn(0x7f4514082670 msgr2=0x7f45140aabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-22T10:02:43.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:43.422+0000 7f451b61b700 1 -- 172.21.15.45:0/1538097378 shutdown_connections 2023-12-22T10:02:43.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-22T10:02:43.422+0000 7f451b61b700 1 -- 172.21.15.45:0/1538097378 wait complete. 2023-12-22T10:02:43.422 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 25 2023-12-22T10:02:43.441 DEBUG:tasks.cephfs.filesystem:already dead... 2023-12-22T10:02:43.441 INFO:teuthology.misc:Shutting down mds daemons... 2023-12-22T10:02:43.444 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-22T10:02:43.444 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T10:02:43.463 INFO:tasks.ceph.mds.a:Stopped 2023-12-22T10:02:43.464 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-22T10:02:43.464 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T10:02:43.527 INFO:tasks.ceph.mds.c:Stopped 2023-12-22T10:02:43.527 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-22T10:02:43.528 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T10:02:43.550 INFO:tasks.ceph.mds.b:Stopped 2023-12-22T10:02:43.550 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-22T10:02:43.550 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T10:02:43.617 INFO:tasks.ceph.mds.d:Stopped 2023-12-22T10:02:43.617 INFO:teuthology.misc:Shutting down osd daemons... 2023-12-22T10:02:43.618 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-12-22T10:02:43.618 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T10:02:43.692 INFO:tasks.ceph.osd.0:Stopped 2023-12-22T10:02:43.692 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-12-22T10:02:43.692 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T10:02:43.786 INFO:tasks.ceph.osd.1:Stopped 2023-12-22T10:02:43.787 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-12-22T10:02:43.787 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T10:02:46.946 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2023-12-22T10:02:49.888 INFO:tasks.ceph.osd.2:Stopped 2023-12-22T10:02:49.889 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-12-22T10:02:49.889 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T10:02:49.971 INFO:tasks.ceph.osd.3:Stopped 2023-12-22T10:02:49.971 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-12-22T10:02:49.971 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T10:02:50.062 INFO:tasks.ceph.osd.4:Stopped 2023-12-22T10:02:50.062 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-12-22T10:02:50.062 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T10:02:50.157 INFO:tasks.ceph.osd.5:Stopped 2023-12-22T10:02:50.158 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-12-22T10:02:50.158 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T10:02:52.551 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2023-12-22T10:02:52.552 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2023-12-22T10:02:56.261 INFO:tasks.ceph.osd.6:Stopped 2023-12-22T10:02:56.262 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-12-22T10:02:56.262 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T10:02:56.348 INFO:tasks.ceph.osd.7:Stopped 2023-12-22T10:02:56.348 INFO:teuthology.misc:Shutting down mgr daemons... 2023-12-22T10:02:56.349 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-12-22T10:02:56.349 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T10:02:57.956 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~0s 2023-12-22T10:02:57.957 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2023-12-22T10:03:02.450 INFO:tasks.ceph.mgr.y:Stopped 2023-12-22T10:03:02.451 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-12-22T10:03:02.451 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T10:03:02.509 INFO:tasks.ceph.mgr.x:Stopped 2023-12-22T10:03:02.510 INFO:teuthology.misc:Shutting down mon daemons... 2023-12-22T10:03:02.510 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-12-22T10:03:02.510 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T10:03:02.547 INFO:tasks.ceph.mon.a:Stopped 2023-12-22T10:03:02.547 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-12-22T10:03:02.547 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T10:03:02.579 INFO:tasks.ceph.mon.b:Stopped 2023-12-22T10:03:02.580 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-12-22T10:03:02.580 INFO:teuthology.orchestra.run:waiting for 300 2023-12-22T10:03:02.654 INFO:tasks.ceph.mon.c:Stopped 2023-12-22T10:03:02.654 INFO:tasks.ceph:Checking cluster log for badness... 2023-12-22T10:03:02.654 DEBUG:teuthology.orchestra.run.smithi045:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'bad backtrace' | egrep -v 'object missing on disk' | egrep -v 'error reading table object' | egrep -v 'error reading sessionmap' | egrep -v 'unmatched fragstat' | egrep -v 'unmatched rstat' | egrep -v 'was unreadable, recreating it now' | egrep -v 'Scrub error on inode' | egrep -v 'Metadata damage detected' | egrep -v MDS_FAILED | egrep -v MDS_DAMAGE | head -n 1 2023-12-22T10:03:02.708 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi045.front.sepia.ceph.com 2023-12-22T10:03:02.708 DEBUG:teuthology.orchestra.run.smithi045:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-12-22T10:03:02.919 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi045.front.sepia.ceph.com 2023-12-22T10:03:02.919 DEBUG:teuthology.orchestra.run.smithi045:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-12-22T10:03:02.957 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y has been restored 2023-12-22T10:03:03.089 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi045.front.sepia.ceph.com 2023-12-22T10:03:03.090 DEBUG:teuthology.orchestra.run.smithi045:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-12-22T10:03:03.249 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi045.front.sepia.ceph.com 2023-12-22T10:03:03.249 DEBUG:teuthology.orchestra.run.smithi045:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-12-22T10:03:03.255 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:03:03.303 DEBUG:teuthology.orchestra.run.smithi113:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:03:03.393 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi113.front.sepia.ceph.com 2023-12-22T10:03:03.393 DEBUG:teuthology.orchestra.run.smithi113:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-12-22T10:03:03.618 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi113.front.sepia.ceph.com 2023-12-22T10:03:03.618 DEBUG:teuthology.orchestra.run.smithi113:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-12-22T10:03:03.840 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi113.front.sepia.ceph.com 2023-12-22T10:03:03.840 DEBUG:teuthology.orchestra.run.smithi113:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-12-22T10:03:04.041 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi113.front.sepia.ceph.com 2023-12-22T10:03:04.042 DEBUG:teuthology.orchestra.run.smithi113:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-12-22T10:03:04.257 INFO:tasks.ceph:Archiving mon data... 2023-12-22T10:03:04.258 DEBUG:teuthology.misc:Transferring archived files from smithi045:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2023-12-22_08:19:05-fs-rishabh-mdscap-pacific-testing-default-smithi/7499495/data/mon.a.tgz 2023-12-22T10:03:04.258 DEBUG:teuthology.orchestra.run.smithi045:> mktemp 2023-12-22T10:03:04.279 INFO:teuthology.orchestra.run.smithi045.stdout:/tmp/tmp.PrQBP1kjLt 2023-12-22T10:03:04.280 DEBUG:teuthology.orchestra.run.smithi045:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.PrQBP1kjLt 2023-12-22T10:03:04.507 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 0666 /tmp/tmp.PrQBP1kjLt 2023-12-22T10:03:04.615 DEBUG:teuthology.orchestra.remote:smithi045:/tmp/tmp.PrQBP1kjLt is 580KB 2023-12-22T10:03:04.696 DEBUG:teuthology.orchestra.run.smithi045:> rm -fr /tmp/tmp.PrQBP1kjLt 2023-12-22T10:03:04.718 DEBUG:teuthology.misc:Transferring archived files from smithi113:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2023-12-22_08:19:05-fs-rishabh-mdscap-pacific-testing-default-smithi/7499495/data/mon.b.tgz 2023-12-22T10:03:04.718 DEBUG:teuthology.orchestra.run.smithi113:> mktemp 2023-12-22T10:03:04.736 INFO:teuthology.orchestra.run.smithi113.stdout:/tmp/tmp.rWyShvGbtE 2023-12-22T10:03:04.736 DEBUG:teuthology.orchestra.run.smithi113:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.rWyShvGbtE 2023-12-22T10:03:05.011 DEBUG:teuthology.orchestra.run.smithi113:> sudo chmod 0666 /tmp/tmp.rWyShvGbtE 2023-12-22T10:03:05.106 DEBUG:teuthology.orchestra.remote:smithi113:/tmp/tmp.rWyShvGbtE is 764KB 2023-12-22T10:03:05.190 DEBUG:teuthology.orchestra.run.smithi113:> rm -fr /tmp/tmp.rWyShvGbtE 2023-12-22T10:03:05.209 DEBUG:teuthology.misc:Transferring archived files from smithi113:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2023-12-22_08:19:05-fs-rishabh-mdscap-pacific-testing-default-smithi/7499495/data/mon.c.tgz 2023-12-22T10:03:05.209 DEBUG:teuthology.orchestra.run.smithi113:> mktemp 2023-12-22T10:03:05.272 INFO:teuthology.orchestra.run.smithi113.stdout:/tmp/tmp.Jm9pm6R2Hp 2023-12-22T10:03:05.272 DEBUG:teuthology.orchestra.run.smithi113:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.Jm9pm6R2Hp 2023-12-22T10:03:05.542 DEBUG:teuthology.orchestra.run.smithi113:> sudo chmod 0666 /tmp/tmp.Jm9pm6R2Hp 2023-12-22T10:03:05.639 DEBUG:teuthology.orchestra.remote:smithi113:/tmp/tmp.Jm9pm6R2Hp is 764KB 2023-12-22T10:03:05.678 DEBUG:teuthology.orchestra.run.smithi113:> rm -fr /tmp/tmp.Jm9pm6R2Hp 2023-12-22T10:03:05.695 INFO:tasks.ceph:Cleaning ceph cluster... 2023-12-22T10:03:05.696 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-12-22T10:03:05.703 DEBUG:teuthology.orchestra.run.smithi113:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-12-22T10:03:05.776 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-12-22T10:03:05.776 DEBUG:teuthology.orchestra.run.smithi045:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-12-22T10:03:05.783 DEBUG:teuthology.orchestra.run.smithi113:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-12-22T10:03:05.832 INFO:teuthology.orchestra.run.smithi045.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-12-22T10:03:05.878 INFO:teuthology.orchestra.run.smithi113.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-12-22T10:03:05.893 INFO:tasks.ceph:Archiving crash dumps... 2023-12-22T10:03:05.895 DEBUG:teuthology.misc:Transferring archived files from smithi045:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-12-22_08:19:05-fs-rishabh-mdscap-pacific-testing-default-smithi/7499495/remote/smithi045/crash 2023-12-22T10:03:05.896 DEBUG:teuthology.orchestra.run.smithi045:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-22T10:03:05.933 DEBUG:teuthology.misc:Transferring archived files from smithi113:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-12-22_08:19:05-fs-rishabh-mdscap-pacific-testing-default-smithi/7499495/remote/smithi113/crash 2023-12-22T10:03:05.934 DEBUG:teuthology.orchestra.run.smithi113:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-22T10:03:05.970 INFO:tasks.ceph:Shutting down logrotate 2023-12-22T10:03:05.971 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:03:05.988 DEBUG:teuthology.orchestra.run.smithi113:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-22T10:03:06.093 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-12-22T10:03:06.128 DEBUG:teuthology.orchestra.run.smithi113:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-12-22T10:03:06.164 INFO:tasks.ceph:Compressing logs... 2023-12-22T10:03:06.164 DEBUG:teuthology.orchestra.run.smithi045:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-22T10:03:06.176 DEBUG:teuthology.orchestra.run.smithi113:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-22T10:03:06.236 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42618.log 2023-12-22T10:03:06.238 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40273.log 2023-12-22T10:03:06.240 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43095.log 2023-12-22T10:03:06.241 INFO:teuthology.orchestra.run.smithi045.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42618.log.gz 2023-12-22T10:03:06.242 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.40273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42457.log 2023-12-22T10:03:06.242 INFO:teuthology.orchestra.run.smithi045.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40273.log.gz 2023-12-22T10:03:06.244 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37247.log 2023-12-22T10:03:06.244 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43095.log: /var/log/ceph/ceph-client.admin.42457.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43095.log.gz 2023-12-22T10:03:06.245 INFO:teuthology.orchestra.run.smithi045.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.42457.log.gz 2023-12-22T10:03:06.245 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39638.log 2023-12-22T10:03:06.247 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.37247.log: gzip -5 --verbose -- 87.3%/var/log/ceph/ceph-client.admin.43365.log -- replaced with /var/log/ceph/ceph-client.admin.37247.log.gz 2023-12-22T10:03:06.247 INFO:teuthology.orchestra.run.smithi045.stderr: 2023-12-22T10:03:06.249 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.39638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38200.log 2023-12-22T10:03:06.250 INFO:teuthology.orchestra.run.smithi045.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.39638.log.gz 2023-12-22T10:03:06.251 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43365.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.43365.log.gz 2023-12-22T10:03:06.251 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40406.log 2023-12-22T10:03:06.252 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.38200.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.38200.log.gz 2023-12-22T10:03:06.253 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37509.log 2023-12-22T10:03:06.254 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.40406.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.40406.log.gz 2023-12-22T10:03:06.254 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-12-22T10:03:06.255 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.37509.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37509.log.gz 2023-12-22T10:03:06.256 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37592.log 2023-12-22T10:03:06.256 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-12-22T10:03:06.257 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39422.log 2023-12-22T10:03:06.258 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-12-22T10:03:06.259 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.37592.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37592.log.gz 2023-12-22T10:03:06.259 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39368.log 2023-12-22T10:03:06.260 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.39422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43068.log 2023-12-22T10:03:06.261 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34005.log 2023-12-22T10:03:06.261 INFO:teuthology.orchestra.run.smithi045.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.39422.log.gz 2023-12-22T10:03:06.261 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.39368.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.39368.log.gz 2023-12-22T10:03:06.262 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40822.log 2023-12-22T10:03:06.262 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-12-22T10:03:06.263 INFO:teuthology.orchestra.run.smithi113.stderr: 92.1% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-12-22T10:03:06.263 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40851.log 2023-12-22T10:03:06.263 INFO:teuthology.orchestra.run.smithi045.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43068.log.gz 2023-12-22T10:03:06.264 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.40822.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.40822.log.gz 2023-12-22T10:03:06.264 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-12-22T10:03:06.265 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.34005.log: /var/log/ceph/ceph-osd.5.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.34005.log.gz 2023-12-22T10:03:06.265 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42320.log 2023-12-22T10:03:06.266 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34059.log 2023-12-22T10:03:06.266 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.40851.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40851.log.gz 2023-12-22T10:03:06.267 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39881.log 2023-12-22T10:03:06.268 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39503.log 2023-12-22T10:03:06.268 INFO:teuthology.orchestra.run.smithi045.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.42320.log.gz 2023-12-22T10:03:06.269 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.39881.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.39881.log.gz 2023-12-22T10:03:06.269 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-12-22T10:03:06.270 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41746.log 2023-12-22T10:03:06.270 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.34059.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.34059.log.gz 2023-12-22T10:03:06.271 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.39503.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.39503.log.gz 2023-12-22T10:03:06.272 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37930.log 2023-12-22T10:03:06.272 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-12-22T10:03:06.274 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.41746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40552.log 2023-12-22T10:03:06.274 INFO:teuthology.orchestra.run.smithi045.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.41746.log.gz 2023-12-22T10:03:06.274 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.37930.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37930.log.gz 2023-12-22T10:03:06.276 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-12-22T10:03:06.276 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-12-22T10:03:06.277 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.40552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38470.log 2023-12-22T10:03:06.277 INFO:teuthology.orchestra.run.smithi045.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.40552.log.gz 2023-12-22T10:03:06.278 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37476.log 2023-12-22T10:03:06.279 INFO:teuthology.orchestra.run.smithi113.stderr: 93.0% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-12-22T10:03:06.279 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-osd.6.log: 93.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-12-22T10:03:06.279 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43041.log 2023-12-22T10:03:06.280 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33899.log 2023-12-22T10:03:06.280 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38848.log 2023-12-22T10:03:06.281 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.37736.log 2023-12-22T10:03:06.282 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.38470.log: /var/log/ceph/ceph-client.admin.43041.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38470.log.gz 2023-12-22T10:03:06.282 INFO:teuthology.orchestra.run.smithi045.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43041.log.gz 2023-12-22T10:03:06.283 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42753.log 2023-12-22T10:03:06.283 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.37476.log: /var/log/ceph/ceph-client.admin.33899.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37476.log.gz 2023-12-22T10:03:06.283 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-12-22T10:03:06.283 INFO:teuthology.orchestra.run.smithi113.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33899.log.gz 2023-12-22T10:03:06.284 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.38848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41136.log 2023-12-22T10:03:06.285 INFO:teuthology.orchestra.run.smithi045.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.38848.log.gz 2023-12-22T10:03:06.285 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.3.37736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34033.log 2023-12-22T10:03:06.285 INFO:teuthology.orchestra.run.smithi113.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.3.37736.log.gz 2023-12-22T10:03:06.286 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37644.log 2023-12-22T10:03:06.286 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42753.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42753.log.gz 2023-12-22T10:03:06.286 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40003.log 2023-12-22T10:03:06.288 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.34033.log: 92.1% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-12-22T10:03:06.288 INFO:teuthology.orchestra.run.smithi113.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34033.log.gz 2023-12-22T10:03:06.288 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-12-22T10:03:06.288 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.41136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38632.log 2023-12-22T10:03:06.288 INFO:teuthology.orchestra.run.smithi045.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41136.log.gz 2023-12-22T10:03:06.290 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.40003.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40003.log.gz 2023-12-22T10:03:06.290 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38254.log 2023-12-22T10:03:06.290 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.37644.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37644.log.gz 2023-12-22T10:03:06.290 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-12-22T10:03:06.291 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.38632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40030.log 2023-12-22T10:03:06.291 INFO:teuthology.orchestra.run.smithi045.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38632.log.gz 2023-12-22T10:03:06.292 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33926.log 2023-12-22T10:03:06.292 INFO:teuthology.orchestra.run.smithi113.stderr: 92.1% -- replaced with /var/log/ceph/ceph.log.gz 2023-12-22T10:03:06.293 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.38254.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.38254.log.gz 2023-12-22T10:03:06.293 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40057.log 2023-12-22T10:03:06.294 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33951.log 2023-12-22T10:03:06.294 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.33926.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33926.log.gz 2023-12-22T10:03:06.295 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.40030.log: 88.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.40030.log.gz 2023-12-22T10:03:06.295 INFO:teuthology.orchestra.run.smithi045.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.39611.log 2023-12-22T10:03:06.296 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.40057.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-12-22T10:03:06.296 INFO:teuthology.orchestra.run.smithi045.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40057.log.gz 2023-12-22T10:03:06.296 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33874.log 2023-12-22T10:03:06.296 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.33951.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33951.log.gz 2023-12-22T10:03:06.297 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.39611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42401.log 2023-12-22T10:03:06.298 INFO:teuthology.orchestra.run.smithi045.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.39611.log.gz 2023-12-22T10:03:06.298 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33977.log 2023-12-22T10:03:06.298 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.33874.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33874.log.gz 2023-12-22T10:03:06.298 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-12-22T10:03:06.299 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40633.log 2023-12-22T10:03:06.299 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-client.admin.33977.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33977.log.gz 2023-12-22T10:03:06.300 INFO:teuthology.orchestra.run.smithi113.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.37598.log 2023-12-22T10:03:06.300 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41989.log 2023-12-22T10:03:06.301 INFO:teuthology.orchestra.run.smithi045.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.42401.log.gz 2023-12-22T10:03:06.302 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.40633.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.40633.log.gz 2023-12-22T10:03:06.302 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38065.log 2023-12-22T10:03:06.303 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.41989.log: 92.0% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-12-22T10:03:06.303 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40606.log 2023-12-22T10:03:06.304 INFO:teuthology.orchestra.run.smithi113.stderr:/var/log/ceph/ceph-osd.7.log: /var/log/ceph/ceph-client.1.37598.log: 90.1% -- replaced with /var/log/ceph/ceph-client.1.37598.log.gz 2023-12-22T10:03:06.305 INFO:teuthology.orchestra.run.smithi045.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41989.log.gz 2023-12-22T10:03:06.305 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.38065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39530.log 2023-12-22T10:03:06.305 INFO:teuthology.orchestra.run.smithi045.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.38065.log.gz 2023-12-22T10:03:06.306 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.40606.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.40606.log.gz 2023-12-22T10:03:06.306 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42726.log 2023-12-22T10:03:06.307 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.39530.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.39530.log.gz 2023-12-22T10:03:06.307 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.28759.log 2023-12-22T10:03:06.308 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42726.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42726.log.gz 2023-12-22T10:03:06.308 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38713.log 2023-12-22T10:03:06.309 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph.tmp-client.admin.28759.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.28759.log.gz 2023-12-22T10:03:06.309 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42131.log 2023-12-22T10:03:06.310 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.38713.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38713.log.gz 2023-12-22T10:03:06.311 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37221.log 2023-12-22T10:03:06.312 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40084.log 2023-12-22T10:03:06.312 INFO:teuthology.orchestra.run.smithi045.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42131.log.gz 2023-12-22T10:03:06.314 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.37221.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37221.log.gz 2023-12-22T10:03:06.314 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41109.log 2023-12-22T10:03:06.316 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.40084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39395.log 2023-12-22T10:03:06.317 INFO:teuthology.orchestra.run.smithi045.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.40084.log.gz 2023-12-22T10:03:06.317 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.41109.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.41109.log.gz 2023-12-22T10:03:06.317 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42483.log 2023-12-22T10:03:06.318 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.39395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38227.log 2023-12-22T10:03:06.318 INFO:teuthology.orchestra.run.smithi045.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.39395.log.gz 2023-12-22T10:03:06.318 INFO:teuthology.orchestra.run.smithi045.stderr: 91.3% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-12-22T10:03:06.319 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42483.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42483.log.gz 2023-12-22T10:03:06.319 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41580.log 2023-12-22T10:03:06.320 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42537.log 2023-12-22T10:03:06.322 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.38227.log: /var/log/ceph/ceph-client.admin.41580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40714.log 2023-12-22T10:03:06.322 INFO:teuthology.orchestra.run.smithi045.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41580.log.gz 2023-12-22T10:03:06.322 INFO:teuthology.orchestra.run.smithi045.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38227.log.gz 2023-12-22T10:03:06.323 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41217.log 2023-12-22T10:03:06.323 INFO:teuthology.orchestra.run.smithi045.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42537.log.gz 2023-12-22T10:03:06.324 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.40714.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.40714.log.gz 2023-12-22T10:03:06.325 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40944.log 2023-12-22T10:03:06.326 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.41217.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-12-22T10:03:06.327 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.40944.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.41217.log.gz 2023-12-22T10:03:06.327 INFO:teuthology.orchestra.run.smithi045.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40944.log.gz 2023-12-22T10:03:06.328 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39719.log 2023-12-22T10:03:06.329 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38416.log 2023-12-22T10:03:06.330 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.39719.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.39719.log.gz 2023-12-22T10:03:06.332 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38578.log 2023-12-22T10:03:06.333 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40346.log 2023-12-22T10:03:06.334 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.38416.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38416.log.gz 2023-12-22T10:03:06.335 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.38578.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38578.log.gz 2023-12-22T10:03:06.335 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39908.log 2023-12-22T10:03:06.343 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.40346.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.40346.log.gz 2023-12-22T10:03:06.343 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37712.log 2023-12-22T10:03:06.343 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.39908.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.39908.log.gz 2023-12-22T10:03:06.344 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37822.log 2023-12-22T10:03:06.344 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.37712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37795.log 2023-12-22T10:03:06.344 INFO:teuthology.orchestra.run.smithi045.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37712.log.gz 2023-12-22T10:03:06.344 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.37822.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37822.log.gz 2023-12-22T10:03:06.344 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37536.log 2023-12-22T10:03:06.344 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.37795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43311.log 2023-12-22T10:03:06.352 INFO:teuthology.orchestra.run.smithi045.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.37795.log.gz 2023-12-22T10:03:06.356 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.37536.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.37536.log.gz 2023-12-22T10:03:06.356 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37455.log 2023-12-22T10:03:06.356 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37685.log 2023-12-22T10:03:06.356 INFO:teuthology.orchestra.run.smithi045.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43311.log.gz 2023-12-22T10:03:06.356 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.37455.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37455.log.gz 2023-12-22T10:03:06.356 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38038.log 2023-12-22T10:03:06.357 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.37685.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.37685.log.gz 2023-12-22T10:03:06.357 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37658.log 2023-12-22T10:03:06.357 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.38038.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.38038.log.gz 2023-12-22T10:03:06.357 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37903.log 2023-12-22T10:03:06.357 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.37658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38281.log 2023-12-22T10:03:06.357 INFO:teuthology.orchestra.run.smithi045.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37658.log.gz 2023-12-22T10:03:06.357 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.37903.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37903.log.gz 2023-12-22T10:03:06.357 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42564.log 2023-12-22T10:03:06.358 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.38281.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38281.log.gz 2023-12-22T10:03:06.358 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43014.log 2023-12-22T10:03:06.359 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42564.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42564.log.gz 2023-12-22T10:03:06.359 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38119.log 2023-12-22T10:03:06.359 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38011.log 2023-12-22T10:03:06.359 INFO:teuthology.orchestra.run.smithi045.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43014.log.gz 2023-12-22T10:03:06.359 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.38119.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38119.log.gz 2023-12-22T10:03:06.360 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40579.log 2023-12-22T10:03:06.361 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.38011.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.38011.log.gz 2023-12-22T10:03:06.361 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41935.log 2023-12-22T10:03:06.362 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 /var/log/ceph/ceph-client.admin.40579.log: --verbose -- /var/log/ceph/ceph-client.admin.38335.log 2023-12-22T10:03:06.363 INFO:teuthology.orchestra.run.smithi045.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40579.log.gz 2023-12-22T10:03:06.364 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.41935.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41935.log.gz 2023-12-22T10:03:06.364 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37984.log 2023-12-22T10:03:06.366 INFO:teuthology.orchestra.run.smithi045.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-12-22T10:03:06.366 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.38335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41800.log 2023-12-22T10:03:06.366 INFO:teuthology.orchestra.run.smithi045.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38335.log.gz 2023-12-22T10:03:06.367 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.37984.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37984.log.gz 2023-12-22T10:03:06.367 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43531.log 2023-12-22T10:03:06.369 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.41800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38092.log 2023-12-22T10:03:06.369 INFO:teuthology.orchestra.run.smithi045.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41800.log.gz 2023-12-22T10:03:06.370 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38686.log 2023-12-22T10:03:06.370 INFO:teuthology.orchestra.run.smithi045.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43531.log.gz 2023-12-22T10:03:06.371 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.38092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41190.log 2023-12-22T10:03:06.371 INFO:teuthology.orchestra.run.smithi045.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.38092.log.gz 2023-12-22T10:03:06.372 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.38686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42861.log 2023-12-22T10:03:06.372 INFO:teuthology.orchestra.run.smithi045.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38686.log.gz 2023-12-22T10:03:06.373 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.41190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38308.log 2023-12-22T10:03:06.374 INFO:teuthology.orchestra.run.smithi045.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41190.log.gz 2023-12-22T10:03:06.374 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43284.log 2023-12-22T10:03:06.374 INFO:teuthology.orchestra.run.smithi045.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42861.log.gz 2023-12-22T10:03:06.375 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.38308.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.38308.log.gz 2023-12-22T10:03:06.376 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42374.log 2023-12-22T10:03:06.377 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43284.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43284.log.gz 2023-12-22T10:03:06.377 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-12-22T10:03:06.378 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43230.log 2023-12-22T10:03:06.378 INFO:teuthology.orchestra.run.smithi045.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.42374.log.gz 2023-12-22T10:03:06.380 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37400.log 2023-12-22T10:03:06.381 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40310.log 2023-12-22T10:03:06.381 INFO:teuthology.orchestra.run.smithi045.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43230.log.gz 2023-12-22T10:03:06.381 INFO:teuthology.orchestra.run.smithi045.stderr: 88.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-12-22T10:03:06.381 INFO:teuthology.orchestra.run.smithi113.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-12-22T10:03:06.386 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.37400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38497.log 2023-12-22T10:03:06.386 INFO:teuthology.orchestra.run.smithi045.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37400.log.gz 2023-12-22T10:03:06.386 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.40310.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40310.log.gz 2023-12-22T10:03:06.386 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42347.log 2023-12-22T10:03:06.387 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.38497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42591.log 2023-12-22T10:03:06.387 INFO:teuthology.orchestra.run.smithi045.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38497.log.gz 2023-12-22T10:03:06.387 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42347.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42347.log.gz 2023-12-22T10:03:06.387 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38443.log 2023-12-22T10:03:06.388 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38389.log 2023-12-22T10:03:06.389 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.38443.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42591.log.gz 2023-12-22T10:03:06.389 INFO:teuthology.orchestra.run.smithi045.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.38443.log.gz 2023-12-22T10:03:06.390 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37307.log 2023-12-22T10:03:06.391 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.38389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40998.log 2023-12-22T10:03:06.391 INFO:teuthology.orchestra.run.smithi045.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.38389.log.gz 2023-12-22T10:03:06.392 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.37307.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.37307.log.gz 2023-12-22T10:03:06.392 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39854.log 2023-12-22T10:03:06.394 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.40998.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.40998.log.gz 2023-12-22T10:03:06.394 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41319.log 2023-12-22T10:03:06.395 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.39854.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.39854.log.gz 2023-12-22T10:03:06.396 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40165.log 2023-12-22T10:03:06.397 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43556.log 2023-12-22T10:03:06.398 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.0.41319.log: /var/log/ceph/ceph-client.admin.40165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43583.log 2023-12-22T10:03:06.399 INFO:teuthology.orchestra.run.smithi045.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.40165.log.gz 2023-12-22T10:03:06.400 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39314.log 2023-12-22T10:03:06.400 INFO:teuthology.orchestra.run.smithi045.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43556.log.gz 2023-12-22T10:03:06.401 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43583.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43583.log.gz 2023-12-22T10:03:06.401 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39584.log 2023-12-22T10:03:06.402 INFO:teuthology.orchestra.run.smithi045.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.0.41319.log.gz 2023-12-22T10:03:06.403 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.39314.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.39314.log.gz 2023-12-22T10:03:06.403 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38524.log 2023-12-22T10:03:06.404 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40880.log 2023-12-22T10:03:06.405 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.39584.log: /var/log/ceph/ceph-client.admin.38524.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38524.log.gz 2023-12-22T10:03:06.406 INFO:teuthology.orchestra.run.smithi045.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.39584.log.gz 2023-12-22T10:03:06.406 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42050.log 2023-12-22T10:03:06.407 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.40880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41881.log 2023-12-22T10:03:06.407 INFO:teuthology.orchestra.run.smithi113.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-12-22T10:03:06.408 INFO:teuthology.orchestra.run.smithi045.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40880.log.gz 2023-12-22T10:03:06.408 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39976.log 2023-12-22T10:03:06.408 INFO:teuthology.orchestra.run.smithi045.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42050.log.gz 2023-12-22T10:03:06.409 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.41881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40660.log 2023-12-22T10:03:06.409 INFO:teuthology.orchestra.run.smithi045.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41881.log.gz 2023-12-22T10:03:06.410 INFO:teuthology.orchestra.run.smithi113.stderr: 91.3% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-12-22T10:03:06.410 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.39976.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.39976.log.gz 2023-12-22T10:03:06.411 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40138.log 2023-12-22T10:03:06.412 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.40660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40525.log 2023-12-22T10:03:06.412 INFO:teuthology.orchestra.run.smithi045.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.40660.log.gz 2023-12-22T10:03:06.413 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.40138.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.40138.log.gz 2023-12-22T10:03:06.413 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40795.log 2023-12-22T10:03:06.415 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.40525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40246.log 2023-12-22T10:03:06.415 INFO:teuthology.orchestra.run.smithi045.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40525.log.gz 2023-12-22T10:03:06.417 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.40795.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40795.log.gz 2023-12-22T10:03:06.417 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41663.log 2023-12-22T10:03:06.418 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.40246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39233.log 2023-12-22T10:03:06.418 INFO:teuthology.orchestra.run.smithi045.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.40246.log.gz 2023-12-22T10:03:06.420 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.41663.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41663.log.gz 2023-12-22T10:03:06.420 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37482.log 2023-12-22T10:03:06.421 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.39233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41962.log 2023-12-22T10:03:06.422 INFO:teuthology.orchestra.run.smithi045.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.39233.log.gz 2023-12-22T10:03:06.422 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.37482.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37482.log.gz 2023-12-22T10:03:06.423 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38173.log 2023-12-22T10:03:06.423 INFO:teuthology.orchestra.run.smithi113.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-12-22T10:03:06.424 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.41962.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.41962.log.gz 2023-12-22T10:03:06.424 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41419.log 2023-12-22T10:03:06.425 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.38173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43500.log 2023-12-22T10:03:06.426 INFO:teuthology.orchestra.run.smithi045.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38173.log.gz 2023-12-22T10:03:06.427 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.41419.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41419.log.gz 2023-12-22T10:03:06.427 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-12-22T10:03:06.428 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42212.log 2023-12-22T10:03:06.429 INFO:teuthology.orchestra.run.smithi045.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43500.log.gz 2023-12-22T10:03:06.430 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42104.log 2023-12-22T10:03:06.431 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42212.log: 88.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.42212.log.gz 2023-12-22T10:03:06.432 INFO:teuthology.orchestra.run.smithi045.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.43122.log 2023-12-22T10:03:06.433 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37957.log 2023-12-22T10:03:06.433 INFO:teuthology.orchestra.run.smithi045.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42104.log.gz 2023-12-22T10:03:06.434 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43122.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43122.log.gz 2023-12-22T10:03:06.435 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41908.log 2023-12-22T10:03:06.437 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.37957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39476.log 2023-12-22T10:03:06.437 INFO:teuthology.orchestra.run.smithi045.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.37957.log.gz 2023-12-22T10:03:06.438 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.41908.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41908.log.gz 2023-12-22T10:03:06.438 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38740.log 2023-12-22T10:03:06.439 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.39476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39049.log 2023-12-22T10:03:06.440 INFO:teuthology.orchestra.run.smithi045.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39476.log.gz 2023-12-22T10:03:06.441 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.38740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38551.log 2023-12-22T10:03:06.441 INFO:teuthology.orchestra.run.smithi045.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38740.log.gz 2023-12-22T10:03:06.442 INFO:teuthology.orchestra.run.smithi113.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-12-22T10:03:06.443 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.0.39049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41690.log 2023-12-22T10:03:06.443 INFO:teuthology.orchestra.run.smithi045.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.39049.log.gz 2023-12-22T10:03:06.444 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.38551.log: 88.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.38551.log.gz-5 2023-12-22T10:03:06.444 INFO:teuthology.orchestra.run.smithi045.stderr:--verbose -- /var/log/ceph/ceph-client.admin.42834.log 2023-12-22T10:03:06.446 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.41690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40768.log 2023-12-22T10:03:06.446 INFO:teuthology.orchestra.run.smithi045.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41690.log.gz 2023-12-22T10:03:06.447 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42780.log 2023-12-22T10:03:06.447 INFO:teuthology.orchestra.run.smithi045.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42834.log.gz 2023-12-22T10:03:06.448 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.40768.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.40768.log.gz 2023-12-22T10:03:06.449 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37563.log 2023-12-22T10:03:06.450 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42987.log 2023-12-22T10:03:06.450 INFO:teuthology.orchestra.run.smithi045.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42780.log.gz 2023-12-22T10:03:06.451 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.37563.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37563.log.gz 2023-12-22T10:03:06.452 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42239.log 2023-12-22T10:03:06.453 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42077.log 2023-12-22T10:03:06.453 INFO:teuthology.orchestra.run.smithi045.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.42987.log.gz 2023-12-22T10:03:06.454 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42239.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42239.log.gz 2023-12-22T10:03:06.454 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43392.log 2023-12-22T10:03:06.455 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39557.log 2023-12-22T10:03:06.456 INFO:teuthology.orchestra.run.smithi045.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42077.log.gz 2023-12-22T10:03:06.457 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43392.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43392.log.gz 2023-12-22T10:03:06.457 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40741.log 2023-12-22T10:03:06.458 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.39557.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.39557.log.gz 2023-12-22T10:03:06.459 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39260.log 2023-12-22T10:03:06.460 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39287.log 2023-12-22T10:03:06.461 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.40741.log: /var/log/ceph/ceph-client.admin.39260.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.40741.log.gz 2023-12-22T10:03:06.461 INFO:teuthology.orchestra.run.smithi045.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.39260.log.gz 2023-12-22T10:03:06.461 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38821.log 2023-12-22T10:03:06.462 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.39287.log: gzip -5 --verbose -- 88.5%/var/log/ceph/ceph-client.admin.41055.log -- replaced with /var/log/ceph/ceph-client.admin.39287.log.gz 2023-12-22T10:03:06.463 INFO:teuthology.orchestra.run.smithi045.stderr: 2023-12-22T10:03:06.465 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.38821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37274.log 2023-12-22T10:03:06.465 INFO:teuthology.orchestra.run.smithi045.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.38821.log.gz 2023-12-22T10:03:06.466 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.41055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37768.log 87.4% 2023-12-22T10:03:06.466 INFO:teuthology.orchestra.run.smithi045.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41055.log.gz 2023-12-22T10:03:06.467 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.37274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42672.log 2023-12-22T10:03:06.467 INFO:teuthology.orchestra.run.smithi045.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.37274.log.gz 2023-12-22T10:03:06.468 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.37768.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37768.log.gz 2023-12-22T10:03:06.468 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42510.log 2023-12-22T10:03:06.470 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42672.log: gzip -5 87.6%--verbose -- replaced with /var/log/ceph/ceph-client.admin.42672.log.gz-- 2023-12-22T10:03:06.470 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.40687.log 2023-12-22T10:03:06.470 INFO:teuthology.orchestra.run.smithi045.stderr: 91.0% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-12-22T10:03:06.471 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43473.log 2023-12-22T10:03:06.471 INFO:teuthology.orchestra.run.smithi045.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42510.log.gz 2023-12-22T10:03:06.472 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.40687.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40687.log.gz 2023-12-22T10:03:06.473 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42960.log 2023-12-22T10:03:06.474 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41609.log 2023-12-22T10:03:06.474 INFO:teuthology.orchestra.run.smithi045.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43473.log.gz 2023-12-22T10:03:06.475 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40469.log 2023-12-22T10:03:06.476 INFO:teuthology.orchestra.run.smithi045.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.42960.log.gz 2023-12-22T10:03:06.477 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.41609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37741.log 2023-12-22T10:03:06.477 INFO:teuthology.orchestra.run.smithi045.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41609.log.gz 2023-12-22T10:03:06.478 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.40469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43176.log 2023-12-22T10:03:06.479 INFO:teuthology.orchestra.run.smithi045.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.40469.log.gz 2023-12-22T10:03:06.479 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.37741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41636.log 2023-12-22T10:03:06.480 INFO:teuthology.orchestra.run.smithi045.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.37741.log.gz 2023-12-22T10:03:06.481 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43176.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43176.log.gz 2023-12-22T10:03:06.481 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33649.log 2023-12-22T10:03:06.482 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.41636.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41636.log.gz 2023-12-22T10:03:06.482 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42645.log 2023-12-22T10:03:06.483 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.33649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41717.log 2023-12-22T10:03:06.484 INFO:teuthology.orchestra.run.smithi045.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33649.log.gz 2023-12-22T10:03:06.485 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42645.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42645.log.gz 2023-12-22T10:03:06.485 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42888.log 2023-12-22T10:03:06.487 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.41717.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41717.log.gz 2023-12-22T10:03:06.488 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39341.log 2023-12-22T10:03:06.489 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37428.log 2023-12-22T10:03:06.491 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42888.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42888.log.gz 2023-12-22T10:03:06.491 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.39341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37849.log 2023-12-22T10:03:06.492 INFO:teuthology.orchestra.run.smithi045.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.39341.log.gz 2023-12-22T10:03:06.493 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.37428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41827.log 2023-12-22T10:03:06.493 INFO:teuthology.orchestra.run.smithi045.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37428.log.gz 2023-12-22T10:03:06.495 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.37849.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37849.log.gz 2023-12-22T10:03:06.495 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.39181.log 2023-12-22T10:03:06.496 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.41827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41163.log 2023-12-22T10:03:06.496 INFO:teuthology.orchestra.run.smithi045.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41827.log.gz 2023-12-22T10:03:06.498 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.2.39181.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-12-22T10:03:06.498 INFO:teuthology.orchestra.run.smithi045.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.2.39181.log.gz 2023-12-22T10:03:06.499 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.41163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41854.log 2023-12-22T10:03:06.500 INFO:teuthology.orchestra.run.smithi045.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41163.log.gz 2023-12-22T10:03:06.501 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41773.log 2023-12-22T10:03:06.502 INFO:teuthology.orchestra.run.smithi113.stderr: 94.2% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-12-22T10:03:06.502 INFO:teuthology.orchestra.run.smithi045.stderr: 85.6% -- replaced with /var/log/ceph/ceph.log.gz 2023-12-22T10:03:06.502 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.41854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37373.log 2023-12-22T10:03:06.503 INFO:teuthology.orchestra.run.smithi045.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41854.log.gz 2023-12-22T10:03:06.503 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.41773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43257.log 2023-12-22T10:03:06.504 INFO:teuthology.orchestra.run.smithi045.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.41773.log.gz 2023-12-22T10:03:06.504 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.37373.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37373.log.gz 2023-12-22T10:03:06.505 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40219.log 2023-12-22T10:03:06.505 INFO:teuthology.orchestra.run.smithi113.stderr: 2023-12-22T10:03:06.506 INFO:teuthology.orchestra.run.smithi113.stderr:real 0m0.282s 2023-12-22T10:03:06.506 INFO:teuthology.orchestra.run.smithi113.stderr:user 0m0.865s 2023-12-22T10:03:06.506 INFO:teuthology.orchestra.run.smithi113.stderr:sys 0m0.182s 2023-12-22T10:03:06.507 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41265.log 2023-12-22T10:03:06.507 INFO:teuthology.orchestra.run.smithi045.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43257.log.gz 2023-12-22T10:03:06.508 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.40219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39746.log 2023-12-22T10:03:06.508 INFO:teuthology.orchestra.run.smithi045.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.40219.log.gz 2023-12-22T10:03:06.509 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.41265.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41265.log.gz 2023-12-22T10:03:06.509 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39827.log 2023-12-22T10:03:06.511 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.39746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43419.log 2023-12-22T10:03:06.511 INFO:teuthology.orchestra.run.smithi045.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39746.log.gz 2023-12-22T10:03:06.513 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.39827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39800.log 2023-12-22T10:03:06.513 INFO:teuthology.orchestra.run.smithi045.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.39827.log.gz 2023-12-22T10:03:06.514 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43419.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.43419.log.gz 2023-12-22T10:03:06.514 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41082.log 2023-12-22T10:03:06.516 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.39800.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.39800.log.gz 2023-12-22T10:03:06.516 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-12-22T10:03:06.517 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.41082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42807.log 2023-12-22T10:03:06.517 INFO:teuthology.orchestra.run.smithi045.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41082.log.gz 2023-12-22T10:03:06.518 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43203.log 2023-12-22T10:03:06.520 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38362.log 2023-12-22T10:03:06.520 INFO:teuthology.orchestra.run.smithi045.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42807.log.gz 2023-12-22T10:03:06.521 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43203.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43203.log.gz 2023-12-22T10:03:06.521 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33904.log 2023-12-22T10:03:06.523 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.38362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43149.log 2023-12-22T10:03:06.523 INFO:teuthology.orchestra.run.smithi045.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38362.log.gz 2023-12-22T10:03:06.524 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.33904.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33904.log.gz 2023-12-22T10:03:06.525 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40971.log 2023-12-22T10:03:06.526 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43149.log: 88.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.43149.log.gz 2023-12-22T10:03:06.527 INFO:teuthology.orchestra.run.smithi045.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.39091.log 2023-12-22T10:03:06.528 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.40971.log: gzip -5 --verbose -- 88.3%/var/log/ceph/ceph-client.admin.42158.log -- replaced with /var/log/ceph/ceph-client.admin.40971.log.gz 2023-12-22T10:03:06.528 INFO:teuthology.orchestra.run.smithi045.stderr: 2023-12-22T10:03:06.529 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.39091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41451.log 2023-12-22T10:03:06.529 INFO:teuthology.orchestra.run.smithi045.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.39091.log.gz 2023-12-22T10:03:06.531 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38875.log 2023-12-22T10:03:06.531 INFO:teuthology.orchestra.run.smithi045.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42158.log.gz 2023-12-22T10:03:06.532 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.41451.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.41451.log.gz 2023-12-22T10:03:06.532 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37623.log 2023-12-22T10:03:06.534 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.38875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42931.log 2023-12-22T10:03:06.535 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.37623.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.38875.log.gz 2023-12-22T10:03:06.535 INFO:teuthology.orchestra.run.smithi045.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37623.log.gz 2023-12-22T10:03:06.536 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40909.log 2023-12-22T10:03:06.537 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40111.log 2023-12-22T10:03:06.537 INFO:teuthology.orchestra.run.smithi045.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.42931.log.gz 2023-12-22T10:03:06.538 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.40909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41027.log 2023-12-22T10:03:06.538 INFO:teuthology.orchestra.run.smithi045.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40909.log.gz 2023-12-22T10:03:06.539 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.40111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42428.log 2023-12-22T10:03:06.539 INFO:teuthology.orchestra.run.smithi045.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.40111.log.gz 2023-12-22T10:03:06.541 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.41027.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41027.log.gz 2023-12-22T10:03:06.541 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38767.log 2023-12-22T10:03:06.544 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40373.log 2023-12-22T10:03:06.544 INFO:teuthology.orchestra.run.smithi045.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42428.log.gz 2023-12-22T10:03:06.544 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.38767.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.38767.log.gz 2023-12-22T10:03:06.544 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38605.log 2023-12-22T10:03:06.545 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.40373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39449.log 2023-12-22T10:03:06.545 INFO:teuthology.orchestra.run.smithi045.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40373.log.gz 2023-12-22T10:03:06.546 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.38605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42185.log 2023-12-22T10:03:06.546 INFO:teuthology.orchestra.run.smithi045.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.38605.log.gz 2023-12-22T10:03:06.547 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.39449.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.39449.log.gz 2023-12-22T10:03:06.548 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-12-22T10:03:06.549 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42016.log 2023-12-22T10:03:06.550 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42185.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42185.log.gz 2023-12-22T10:03:06.551 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33781.log 2023-12-22T10:03:06.552 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42016.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42016.log.gz 2023-12-22T10:03:06.553 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38659.log 2023-12-22T10:03:06.555 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41513.log 2023-12-22T10:03:06.555 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.33781.log: /var/log/ceph/ceph-client.admin.38659.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33781.log.gz 2023-12-22T10:03:06.556 INFO:teuthology.orchestra.run.smithi045.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38659.log.gz 2023-12-22T10:03:06.556 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37876.log 2023-12-22T10:03:06.557 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41513.log: /var/log/ceph/ceph-client.admin.40192.log 2023-12-22T10:03:06.559 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.37876.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37876.log.gz 2023-12-22T10:03:06.559 INFO:teuthology.orchestra.run.smithi045.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.41513.log.gz 2023-12-22T10:03:06.560 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42293.log 2023-12-22T10:03:06.560 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.40192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38146.log 2023-12-22T10:03:06.561 INFO:teuthology.orchestra.run.smithi045.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40192.log.gz 2023-12-22T10:03:06.562 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42293.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42293.log.gz 2023-12-22T10:03:06.562 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42699.log 2023-12-22T10:03:06.563 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.38146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39773.log 2023-12-22T10:03:06.565 INFO:teuthology.orchestra.run.smithi045.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.38146.log.gz 2023-12-22T10:03:06.566 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42699.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42699.log.gz 2023-12-22T10:03:06.566 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43446.log 2023-12-22T10:03:06.566 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.39773.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.39773.log.gz 2023-12-22T10:03:06.567 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39665.log 2023-12-22T10:03:06.568 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39935.log 2023-12-22T10:03:06.569 INFO:teuthology.orchestra.run.smithi045.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43446.log.gz 2023-12-22T10:03:06.571 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.39665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40498.log 2023-12-22T10:03:06.571 INFO:teuthology.orchestra.run.smithi045.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.39665.log.gz 2023-12-22T10:03:06.572 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.39935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42266.log 2023-12-22T10:03:06.572 INFO:teuthology.orchestra.run.smithi045.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39935.log.gz 2023-12-22T10:03:06.573 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.40498.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40498.log.gz 2023-12-22T10:03:06.573 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43338.log 2023-12-22T10:03:06.575 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42266.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42266.log.gz 2023-12-22T10:03:06.575 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-12-22T10:03:06.576 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38794.log 2023-12-22T10:03:06.576 INFO:teuthology.orchestra.run.smithi045.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43338.log.gz 2023-12-22T10:03:06.578 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38928.log 2023-12-22T10:03:06.579 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.38794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39692.log 2023-12-22T10:03:06.580 INFO:teuthology.orchestra.run.smithi045.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38794.log.gz 2023-12-22T10:03:06.581 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.38928.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.38928.log.gz 2023-12-22T10:03:06.583 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.39692.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.39692.log.gz 2023-12-22T10:03:06.588 INFO:teuthology.orchestra.run.smithi045.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-12-22T10:03:06.675 INFO:teuthology.orchestra.run.smithi045.stderr: 94.2% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-12-22T10:03:06.715 INFO:teuthology.orchestra.run.smithi045.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-12-22T10:03:06.732 INFO:teuthology.orchestra.run.smithi045.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-12-22T10:03:06.736 INFO:teuthology.orchestra.run.smithi045.stderr: 2023-12-22T10:03:06.736 INFO:teuthology.orchestra.run.smithi045.stderr:real 0m0.550s 2023-12-22T10:03:06.736 INFO:teuthology.orchestra.run.smithi045.stderr:user 0m1.071s 2023-12-22T10:03:06.736 INFO:teuthology.orchestra.run.smithi045.stderr:sys 0m0.695s 2023-12-22T10:03:06.737 INFO:tasks.ceph:Archiving logs... 2023-12-22T10:03:06.737 DEBUG:teuthology.misc:Transferring archived files from smithi045:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-12-22_08:19:05-fs-rishabh-mdscap-pacific-testing-default-smithi/7499495/remote/smithi045/log 2023-12-22T10:03:06.738 DEBUG:teuthology.orchestra.run.smithi045:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-22T10:03:07.098 DEBUG:teuthology.misc:Transferring archived files from smithi113:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-12-22_08:19:05-fs-rishabh-mdscap-pacific-testing-default-smithi/7499495/remote/smithi113/log 2023-12-22T10:03:07.099 DEBUG:teuthology.orchestra.run.smithi113:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-22T10:03:07.258 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-12-22T10:03:07.279 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-12-22T10:03:07.280 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-22T10:03:07.287 DEBUG:teuthology.orchestra.run.smithi113:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-22T10:03:07.378 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-12-22T10:03:07.388 INFO:teuthology.task.clock:Checking final clock skew... 2023-12-22T10:03:07.389 DEBUG:teuthology.orchestra.run.smithi045:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-22T10:03:07.396 DEBUG:teuthology.orchestra.run.smithi113:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-22T10:03:07.433 INFO:teuthology.orchestra.run.smithi045.stdout: remote refid st t when poll reach delay offset jitter 2023-12-22T10:03:07.433 INFO:teuthology.orchestra.run.smithi045.stdout:============================================================================== 2023-12-22T10:03:07.433 INFO:teuthology.orchestra.run.smithi045.stdout:*hv01.front.sepi 44.4.53.2 2 u 2 64 177 0.071 -2.164 1.164 2023-12-22T10:03:07.433 INFO:teuthology.orchestra.run.smithi045.stdout:+hv02.front.sepi 63.231.80.2 3 u 63 64 77 0.095 -0.978 0.424 2023-12-22T10:03:07.434 INFO:teuthology.orchestra.run.smithi045.stdout:+hv03.front.sepi 74.6.168.72 3 u 3 64 177 0.103 0.832 0.688 2023-12-22T10:03:07.434 INFO:teuthology.orchestra.run.smithi045.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-12-22T10:03:07.438 INFO:teuthology.orchestra.run.smithi113.stdout: remote refid st t when poll reach delay offset jitter 2023-12-22T10:03:07.438 INFO:teuthology.orchestra.run.smithi113.stdout:============================================================================== 2023-12-22T10:03:07.438 INFO:teuthology.orchestra.run.smithi113.stdout:+hv01.front.sepi 44.4.53.2 2 u 63 64 77 0.072 -2.437 1.204 2023-12-22T10:03:07.439 INFO:teuthology.orchestra.run.smithi113.stdout:*hv02.front.sepi 63.231.80.2 3 u 66 64 77 0.120 -1.873 1.623 2023-12-22T10:03:07.439 INFO:teuthology.orchestra.run.smithi113.stdout:+hv03.front.sepi 74.6.168.72 3 u 61 64 77 0.083 0.283 1.269 2023-12-22T10:03:07.439 INFO:teuthology.orchestra.run.smithi113.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-12-22T10:03:07.440 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-12-22T10:03:07.449 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-12-22T10:03:07.450 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-12-22T10:03:07.458 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-12-22T10:03:07.467 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-12-22T10:03:07.476 INFO:teuthology.task.internal:Duration was 916.905315 seconds 2023-12-22T10:03:07.476 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-12-22T10:03:07.490 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-12-22T10:03:07.490 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-22T10:03:07.498 DEBUG:teuthology.orchestra.run.smithi113:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-22T10:03:07.670 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-12-22T10:03:07.670 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi045.front.sepia.ceph.com 2023-12-22T10:03:07.671 DEBUG:teuthology.orchestra.run.smithi045:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-22T10:03:07.709 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi113.front.sepia.ceph.com 2023-12-22T10:03:07.710 DEBUG:teuthology.orchestra.run.smithi113:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-22T10:03:07.746 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-12-22T10:03:07.746 DEBUG:teuthology.orchestra.run.smithi045:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-22T10:03:07.765 DEBUG:teuthology.orchestra.run.smithi113:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-22T10:03:07.848 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-12-22T10:03:07.848 DEBUG:teuthology.orchestra.run.smithi045:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-22T10:03:07.856 DEBUG:teuthology.orchestra.run.smithi113:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-22T10:03:07.960 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-12-22T10:03:07.971 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-12-22T10:03:07.971 DEBUG:teuthology.orchestra.run.smithi045:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-22T10:03:08.010 DEBUG:teuthology.orchestra.run.smithi113:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-22T10:03:08.049 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-12-22T10:03:08.059 DEBUG:teuthology.orchestra.run.smithi045:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-22T10:03:08.066 DEBUG:teuthology.orchestra.run.smithi113:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-22T10:03:08.096 INFO:teuthology.orchestra.run.smithi045.stdout:kernel.core_pattern = core 2023-12-22T10:03:08.126 INFO:teuthology.orchestra.run.smithi113.stdout:kernel.core_pattern = core 2023-12-22T10:03:08.159 DEBUG:teuthology.orchestra.run.smithi045:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-22T10:03:08.194 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-22T10:03:08.195 DEBUG:teuthology.orchestra.run.smithi113:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-22T10:03:08.216 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-22T10:03:08.216 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-12-22T10:03:08.228 INFO:teuthology.task.internal:Transferring archived files... 2023-12-22T10:03:08.229 DEBUG:teuthology.misc:Transferring archived files from smithi045:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-12-22_08:19:05-fs-rishabh-mdscap-pacific-testing-default-smithi/7499495/remote/smithi045 2023-12-22T10:03:08.229 DEBUG:teuthology.orchestra.run.smithi045:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-22T10:03:08.281 DEBUG:teuthology.misc:Transferring archived files from smithi113:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-12-22_08:19:05-fs-rishabh-mdscap-pacific-testing-default-smithi/7499495/remote/smithi113 2023-12-22T10:03:08.281 DEBUG:teuthology.orchestra.run.smithi113:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-22T10:03:08.326 INFO:teuthology.task.internal:Removing archive directory... 2023-12-22T10:03:08.326 DEBUG:teuthology.orchestra.run.smithi045:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-22T10:03:08.333 DEBUG:teuthology.orchestra.run.smithi113:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-22T10:03:08.386 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-12-22T10:03:08.398 INFO:teuthology.task.internal:Not uploading archives. 2023-12-22T10:03:08.398 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-12-22T10:03:08.408 INFO:teuthology.task.internal:Tidying up after the test... 2023-12-22T10:03:08.408 DEBUG:teuthology.orchestra.run.smithi045:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-22T10:03:08.415 DEBUG:teuthology.orchestra.run.smithi113:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-22T10:03:08.430 INFO:teuthology.orchestra.run.smithi045.stdout: 1048609 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 22 10:03 /home/ubuntu/cephtest 2023-12-22T10:03:08.451 INFO:teuthology.orchestra.run.smithi113.stdout: 1048600 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 22 10:03 /home/ubuntu/cephtest 2023-12-22T10:03:08.457 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-12-22T10:03:08.473 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-12-22T10:03:08.546 INFO:teuthology.nuke:Checking targets against current locks 2023-12-22T10:03:08.572 DEBUG:teuthology.nuke:shortname: smithi045 2023-12-22T10:03:08.572 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-22T10:03:08.597 DEBUG:teuthology.nuke:shortname: smithi113 2023-12-22T10:03:08.597 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-22T10:03:08.612 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi045.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-22_08:19:05-fs-rishabh-mdscap-pacific-testing-default-smithi/7499495', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-22 09:37:35.888859', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-12-22T10:03:08.616 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi113.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-22_08:19:05-fs-rishabh-mdscap-pacific-testing-default-smithi/7499495', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-22 09:37:35.887459', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-12-22T10:03:08.661 INFO:teuthology.orchestra.console.smithi045:Power off 2023-12-22T10:03:08.662 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-22T10:03:08.678 INFO:teuthology.orchestra.console.smithi113:Power off 2023-12-22T10:03:08.678 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-22T10:03:08.688 DEBUG:teuthology.orchestra.console.smithi045:power off output: Chassis Power Control: Down/Off 2023-12-22T10:03:08.689 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-22T10:03:08.702 DEBUG:teuthology.orchestra.console.smithi113:power off output: Chassis Power Control: Down/Off 2023-12-22T10:03:08.702 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-22T10:03:08.712 DEBUG:teuthology.orchestra.console.smithi045:check power output: Chassis Power is on 2023-12-22T10:03:08.727 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is on 2023-12-22T10:03:12.712 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-22T10:03:12.728 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-22T10:03:12.823 DEBUG:teuthology.orchestra.console.smithi045:check power output: Chassis Power is on 2023-12-22T10:03:12.840 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is on 2023-12-22T10:03:16.827 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-22T10:03:16.842 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-22T10:03:16.938 DEBUG:teuthology.orchestra.console.smithi045:check power output: Chassis Power is on 2023-12-22T10:03:16.953 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is off 2023-12-22T10:03:17.054 INFO:teuthology.orchestra.console.smithi113:Power off completed 2023-12-22T10:03:20.941 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-22T10:03:21.054 DEBUG:teuthology.orchestra.console.smithi045:check power output: Chassis Power is off 2023-12-22T10:03:21.155 INFO:teuthology.orchestra.console.smithi045:Power off completed 2023-12-22T10:03:21.261 INFO:teuthology.run:Summary data: description: fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/alternate-pool} duration: 916.9053146839142 failure_reason: 'Test failure: test_rebuild_simple (tasks.cephfs.test_recovery_pool.TestRecoveryPool)' flavor: default mon.a-kernel-sha1: 623393c9d50c04c7ea1d88824b8e92712e3e5611 mon.b-kernel-sha1: 623393c9d50c04c7ea1d88824b8e92712e3e5611 owner: scheduled_rishabh@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=89679aae2ff6414aa30ef5bbb5b74d98 status: fail success: false 2023-12-22T10:03:21.261 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T10:03:21.343 INFO:teuthology.run:FAIL